2023-12-07T20:46:43.281 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-07T20:46:43.281 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323 --name alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi --verbose --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} --owner scheduled_alimasa@teuthology -- /home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323/orig.config.yaml 2023-12-07T20:46:43.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T20:46:43.417 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323 branch: wip-alimasa-multi-pubsub-etag-test description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7482323' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-alimasa-multi-pubsub-etag-test ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-alimasa-multi-pubsub-etag-test sha1: e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0 owner: scheduled_alimasa@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 sha1: e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0 sleep_before_teardown: 0 suite: rgw suite_branch: wip-alimasa-multi-pubsub-etag-test suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0 targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLM2438ztJXfdnTagA2nT29HZR9nBGpJrnYRh2U9uLn0mBlAUk+OofhGilOo4qq4ke7uRXDOCkEo8B3dymSV6aM= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIl5farQZmxpaZ6o/if+Dk79iL9fDEl5O2THifirD3722iW1FYBNJQCUdolBA0qWqVJZdCH9zoCIGsDGMaQYNqs= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-07_20:37:17 tube: smithi user: alimasa verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-07T20:46:43.418 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/qa; will attempt to use it 2023-12-07T20:46:43.418 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/qa/tasks 2023-12-07T20:46:43.418 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-07T20:46:43.420 INFO:teuthology.task.internal:Checking packages... 2023-12-07T20:46:43.447 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0' 2023-12-07T20:46:43.447 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-07T20:46:43.447 INFO:teuthology.packaging:ref: None 2023-12-07T20:46:43.447 INFO:teuthology.packaging:tag: None 2023-12-07T20:46:43.447 INFO:teuthology.packaging:branch: wip-alimasa-multi-pubsub-etag-test 2023-12-07T20:46:43.447 INFO:teuthology.packaging:sha1: e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0 2023-12-07T20:46:43.447 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-alimasa-multi-pubsub-etag-test 2023-12-07T20:46:43.592 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-38.ge93c2b5c 2023-12-07T20:46:43.592 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-07T20:46:43.599 INFO:teuthology.task.internal:no buildpackages task found 2023-12-07T20:46:43.599 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-07T20:46:43.639 INFO:teuthology.task.internal:Saving configuration 2023-12-07T20:46:43.652 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-07T20:46:43.662 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T20:46:43.689 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 20:38:29.251787', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLM2438ztJXfdnTagA2nT29HZR9nBGpJrnYRh2U9uLn0mBlAUk+OofhGilOo4qq4ke7uRXDOCkEo8B3dymSV6aM='} 2023-12-07T20:46:43.714 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 20:38:29.250530', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIl5farQZmxpaZ6o/if+Dk79iL9fDEl5O2THifirD3722iW1FYBNJQCUdolBA0qWqVJZdCH9zoCIGsDGMaQYNqs='} 2023-12-07T20:46:43.714 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-07T20:46:43.724 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2023-12-07T20:46:43.725 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2023-12-07T20:46:43.725 INFO:teuthology.run_tasks:Running task console_log... 2023-12-07T20:46:43.823 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9e416eaee0>, signals=[15]) 2023-12-07T20:46:43.823 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-07T20:46:43.832 INFO:teuthology.task.internal:Opening connections... 2023-12-07T20:46:43.832 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T20:46:43.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T20:46:43.918 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2023-12-07T20:46:43.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T20:46:44.001 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-07T20:46:44.009 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-12-07T20:46:44.026 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-12-07T20:46:44.026 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-12-07T20:46:44.082 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-12-07T20:46:44.082 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2023-12-07T20:46:44.082 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-12-07T20:46:44.082 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-12-07T20:46:44.083 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2023-12-07T20:46:44.083 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2023-12-07T20:46:44.083 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-07T20:46:44.083 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-12-07T20:46:44.083 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2023-12-07T20:46:44.083 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-07T20:46:44.083 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-12-07T20:46:44.083 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-07T20:46:44.083 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-07T20:46:44.083 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-07T20:46:44.084 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-12-07T20:46:44.113 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2023-12-07T20:46:44.131 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2023-12-07T20:46:44.131 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2023-12-07T20:46:44.188 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2023-12-07T20:46:44.188 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-07T20:46:44.189 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-07T20:46:44.190 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-12-07T20:46:44.213 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-07T20:46:44.223 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-07T20:46:44.246 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-07T20:46:44.246 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-12-07T20:46:44.249 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2023-12-07T20:46:44.264 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-07T20:46:44.277 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-07T20:46:44.277 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-12-07T20:46:44.305 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2023-12-07T20:46:44.408 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-07T20:46:44.460 INFO:teuthology.run_tasks:Running task kernel... 2023-12-07T20:46:44.479 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-07T20:46:44.479 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-07T20:46:44.480 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-07T20:46:44.480 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-07T20:46:44.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T20:46:44.496 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2023-12-07T20:46:44.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T20:46:44.496 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-12-07T20:46:44.551 INFO:teuthology.orchestra.run.smithi121.stdout:5.14.0-361.el9.x86_64 2023-12-07T20:46:44.552 INFO:teuthology.task.kernel:Running kernel on smithi121: 5.14.0-361.el9.x86_64 2023-12-07T20:46:44.552 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum install -y kernel 2023-12-07T20:46:44.553 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-361.el9.x86_64 2023-12-07T20:46:44.553 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.14.0-361.el9.x86_64 2023-12-07T20:46:44.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2023-12-07T20:46:46.609 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS-9 - AppStream 14 MB/s | 6.4 MB 00:00 2023-12-07T20:46:46.740 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-07T20:46:48.051 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2023-12-07T20:46:48.383 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2023-12-07T20:46:48.801 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 7.9 MB 00:00 2023-12-07T20:46:50.356 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 7.9 MB 00:01 2023-12-07T20:46:51.812 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 18 MB 00:01 2023-12-07T20:46:53.124 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 11 MB/s | 18 MB 00:01 2023-12-07T20:46:56.754 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 5.8 MB 00:01 2023-12-07T20:46:57.108 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 5.8 MB 00:00 2023-12-07T20:46:58.302 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 15 kB 00:00 2023-12-07T20:46:58.567 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 15 kB 00:00 2023-12-07T20:46:59.912 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2023-12-07T20:47:00.447 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 20 MB 00:02 2023-12-07T20:47:04.619 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2023-12-07T20:47:05.194 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2023-12-07T20:47:06.816 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-07T20:47:06.817 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-07T20:47:06.933 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T20:47:06.938 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T20:47:06.938 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2023-12-07T20:47:06.939 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T20:47:06.939 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T20:47:06.939 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 5.14.0-390.el9 baseos 5.6 M 2023-12-07T20:47:06.939 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-12-07T20:47:06.939 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 5.14.0-390.el9 baseos 20 M 2023-12-07T20:47:06.939 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 5.14.0-390.el9 baseos 38 M 2023-12-07T20:47:06.940 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core x86_64 5.14.0-390.el9 baseos 32 M 2023-12-07T20:47:06.940 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T20:47:06.940 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T20:47:06.940 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T20:47:06.940 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2023-12-07T20:47:06.940 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T20:47:06.941 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 96 M 2023-12-07T20:47:06.942 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 121 M 2023-12-07T20:47:06.942 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T20:47:07.484 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-07T20:47:07.484 INFO:teuthology.orchestra.run.smithi121.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-07T20:47:07.572 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T20:47:07.577 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T20:47:07.577 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: kernel x86_64 5.14.0-390.el9 baseos 5.6 M 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-core x86_64 5.14.0-390.el9 baseos 20 M 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules x86_64 5.14.0-390.el9 baseos 38 M 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-core x86_64 5.14.0-390.el9 baseos 32 M 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout:Install 4 Packages 2023-12-07T20:47:07.578 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T20:47:07.579 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 96 M 2023-12-07T20:47:07.579 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 121 M 2023-12-07T20:47:07.579 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T20:47:08.287 INFO:teuthology.orchestra.run.smithi121.stdout:(1/4): kernel-5.14.0-390.el9.x86_64.rpm 13 MB/s | 5.6 MB 00:00 2023-12-07T20:47:08.545 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): kernel-5.14.0-390.el9.x86_64.rpm 3.6 MB/s | 5.6 MB 00:01 2023-12-07T20:47:08.812 INFO:teuthology.orchestra.run.smithi121.stdout:(2/4): kernel-core-5.14.0-390.el9.x86_64.rpm 21 MB/s | 20 MB 00:00 2023-12-07T20:47:09.288 INFO:teuthology.orchestra.run.smithi121.stdout:(3/4): kernel-modules-5.14.0-390.el9.x86_64.rpm 26 MB/s | 38 MB 00:01 2023-12-07T20:47:09.688 INFO:teuthology.orchestra.run.smithi121.stdout:(4/4): kernel-modules-core-5.14.0-390.el9.x86_6 23 MB/s | 32 MB 00:01 2023-12-07T20:47:09.688 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T20:47:09.688 INFO:teuthology.orchestra.run.smithi121.stdout:Total 46 MB/s | 96 MB 00:02 2023-12-07T20:47:10.546 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T20:47:10.906 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T20:47:10.906 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T20:47:12.220 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T20:47:12.221 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T20:47:12.711 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): kernel-core-5.14.0-390.el9.x86_64.rpm 3.6 MB/s | 20 MB 00:05 2023-12-07T20:47:13.445 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): kernel-modules-5.14.0-390.el9.x86_64.rpm 5.9 MB/s | 38 MB 00:06 2023-12-07T20:47:14.857 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T20:47:15.492 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-modules-core-5.14.0-390.el9.x86_64 1/4 2023-12-07T20:47:15.630 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-07T20:47:16.011 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): kernel-modules-core-5.14.0-390.el9.x86_6 4.3 MB/s | 32 MB 00:07 2023-12-07T20:47:16.011 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T20:47:16.012 INFO:teuthology.orchestra.run.smithi089.stdout:Total 11 MB/s | 96 MB 00:09 2023-12-07T20:47:16.864 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T20:47:17.259 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T20:47:17.259 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T20:47:18.429 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-07T20:47:18.576 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T20:47:18.577 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T20:47:18.615 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-07T20:47:21.190 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T20:47:21.833 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-core-5.14.0-390.el9.x86_64 1/4 2023-12-07T20:47:21.962 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-07T20:47:23.231 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-07T20:47:23.515 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : kernel-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:47:24.699 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-07T20:47:24.882 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-07T20:47:28.136 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-core-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:47:29.495 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-07T20:47:29.608 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:47:34.254 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-core-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:47:56.935 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-core-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:47:56.978 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-modules-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:47:57.355 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: kernel-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:47:57.355 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-5.14.0-390.el9.x86_64 1/4 2023-12-07T20:47:57.355 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-07T20:47:57.355 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-07T20:47:57.782 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : kernel-modules-core-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:47:57.783 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T20:47:57.783 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T20:47:57.783 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-5.14.0-390.el9.x86_64 2023-12-07T20:47:57.783 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-core-5.14.0-390.el9.x86_64 2023-12-07T20:47:57.783 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-5.14.0-390.el9.x86_64 2023-12-07T20:47:57.783 INFO:teuthology.orchestra.run.smithi121.stdout: kernel-modules-core-5.14.0-390.el9.x86_64 2023-12-07T20:47:57.783 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T20:47:57.783 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T20:47:58.291 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2023-12-07T20:47:58.436 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-390.el9.x86_64 2023-12-07T20:47:58.436 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-390.el9.x86_64 2023-12-07T20:47:58.436 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-390.el9.x86_64 2023-12-07T20:47:58.437 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-07T20:47:58.437 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-07T20:47:58.437 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2023-12-07T20:47:58.437 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi121.front.sepia.ceph.com, path=None, version=distro) 2023-12-07T20:47:58.437 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q kernel | sort -rV | head -n 1 2023-12-07T20:47:58.555 INFO:teuthology.orchestra.run.smithi121.stdout:kernel-5.14.0-390.el9.x86_64 2023-12-07T20:47:58.555 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-390.el9.x86_64 2023-12-07T20:47:58.555 DEBUG:teuthology.orchestra.run.smithi121:> sudo rpm -qi grub2-tools 2023-12-07T20:47:58.592 INFO:teuthology.orchestra.run.smithi121.stdout:Name : grub2-tools 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Epoch : 1 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Version : 2.06 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Release : 68.el9 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Architecture: x86_64 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Group : Unspecified 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Size : 8264254 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:License : GPLv3+ 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Packager : builder@centos.org 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:Vendor : CentOS 2023-12-07T20:47:58.593 INFO:teuthology.orchestra.run.smithi121.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-07T20:47:58.594 INFO:teuthology.orchestra.run.smithi121.stdout:Summary : Support tools for GRUB. 2023-12-07T20:47:58.594 INFO:teuthology.orchestra.run.smithi121.stdout:Description : 2023-12-07T20:47:58.594 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T20:47:58.594 INFO:teuthology.orchestra.run.smithi121.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-07T20:47:58.594 INFO:teuthology.orchestra.run.smithi121.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-07T20:47:58.594 INFO:teuthology.orchestra.run.smithi121.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-07T20:47:58.594 INFO:teuthology.orchestra.run.smithi121.stdout:hardware devices. 2023-12-07T20:47:58.594 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T20:47:58.594 INFO:teuthology.orchestra.run.smithi121.stdout:This subpackage provides tools for support of all platforms. 2023-12-07T20:47:58.595 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-07T20:47:58.595 INFO:teuthology.task.kernel:Updating grub on smithi121 to boot 5.14.0-390.el9.x86_64 2023-12-07T20:47:58.595 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-07T20:47:59.261 INFO:teuthology.orchestra.run.smithi121.stderr:Generating grub configuration file ... 2023-12-07T20:48:00.619 INFO:teuthology.orchestra.run.smithi121.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-07T20:48:00.673 INFO:teuthology.orchestra.run.smithi121.stderr:done 2023-12-07T20:48:00.675 DEBUG:teuthology.orchestra.run.smithi121:> mktemp 2023-12-07T20:48:00.691 INFO:teuthology.orchestra.run.smithi121.stdout:/tmp/tmp.4NxkM6asuM 2023-12-07T20:48:00.691 DEBUG:teuthology.orchestra.run.smithi121:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4NxkM6asuM 2023-12-07T20:48:00.760 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0666 /tmp/tmp.4NxkM6asuM 2023-12-07T20:48:00.900 DEBUG:teuthology.orchestra.remote:smithi121:/tmp/tmp.4NxkM6asuM is 6KB 2023-12-07T20:48:00.948 DEBUG:teuthology.orchestra.run.smithi121:> rm -fr /tmp/tmp.4NxkM6asuM 2023-12-07T20:48:00.962 DEBUG:teuthology.orchestra.run.smithi121:> sudo /bin/ls /boot/loader/entries || true 2023-12-07T20:48:01.041 INFO:teuthology.orchestra.run.smithi121.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-07T20:48:01.041 INFO:teuthology.orchestra.run.smithi121.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-07T20:48:01.041 INFO:teuthology.orchestra.run.smithi121.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-07T20:48:01.041 INFO:teuthology.orchestra.run.smithi121.stdout:15949e3c88704300882482eddfd7baae-5.14.0-390.el9.x86_64.conf 2023-12-07T20:48:01.042 DEBUG:teuthology.orchestra.run.smithi121:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-390.el9.x86_64 2023-12-07T20:48:01.203 DEBUG:teuthology.orchestra.run.smithi121:> sudo shutdown -r now 2023-12-07T20:48:03.096 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:48:03.139 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:48:03.530 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:48:03.530 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-5.14.0-390.el9.x86_64 1/4 2023-12-07T20:48:03.530 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-5.14.0-390.el9.x86_64 2/4 2023-12-07T20:48:03.530 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-5.14.0-390.el9.x86_64 3/4 2023-12-07T20:48:03.965 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-core-5.14.0-390.el9.x86_64 4/4 2023-12-07T20:48:03.966 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T20:48:03.966 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T20:48:03.966 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-5.14.0-390.el9.x86_64 2023-12-07T20:48:03.966 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core-5.14.0-390.el9.x86_64 2023-12-07T20:48:03.966 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-5.14.0-390.el9.x86_64 2023-12-07T20:48:03.966 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core-5.14.0-390.el9.x86_64 2023-12-07T20:48:03.966 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T20:48:03.966 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T20:48:04.476 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2023-12-07T20:48:04.659 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-390.el9.x86_64 2023-12-07T20:48:04.659 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-390.el9.x86_64 2023-12-07T20:48:04.659 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-390.el9.x86_64 2023-12-07T20:48:04.659 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-07T20:48:04.660 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-07T20:48:04.660 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-07T20:48:04.660 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2023-12-07T20:48:04.660 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2023-12-07T20:48:04.776 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-390.el9.x86_64 2023-12-07T20:48:04.776 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-390.el9.x86_64 2023-12-07T20:48:04.776 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2023-12-07T20:48:04.810 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 68.el9 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8264254 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2023-12-07T20:48:04.811 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2023-12-07T20:48:04.812 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-07T20:48:04.812 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2023-12-07T20:48:04.812 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2023-12-07T20:48:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T20:48:04.812 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-07T20:48:04.812 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-07T20:48:04.812 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-07T20:48:04.812 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2023-12-07T20:48:04.812 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T20:48:04.812 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2023-12-07T20:48:04.813 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-07T20:48:04.813 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 5.14.0-390.el9.x86_64 2023-12-07T20:48:04.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-07T20:48:05.584 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2023-12-07T20:48:07.022 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-07T20:48:07.054 INFO:teuthology.orchestra.run.smithi089.stderr:done 2023-12-07T20:48:07.057 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-07T20:48:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.i5wVRqfXd8 2023-12-07T20:48:07.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.i5wVRqfXd8 2023-12-07T20:48:07.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.i5wVRqfXd8 2023-12-07T20:48:07.273 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.i5wVRqfXd8 is 6KB 2023-12-07T20:48:07.321 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.i5wVRqfXd8 2023-12-07T20:48:07.335 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2023-12-07T20:48:07.400 INFO:teuthology.orchestra.run.smithi089.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-07T20:48:07.400 INFO:teuthology.orchestra.run.smithi089.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-07T20:48:07.400 INFO:teuthology.orchestra.run.smithi089.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-07T20:48:07.400 INFO:teuthology.orchestra.run.smithi089.stdout:15949e3c88704300882482eddfd7baae-5.14.0-390.el9.x86_64.conf 2023-12-07T20:48:07.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-390.el9.x86_64 2023-12-07T20:48:07.564 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2023-12-07T20:48:31.226 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2023-12-07T20:48:31.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-12-07T20:48:31.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T20:48:37.573 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-07T20:48:37.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T20:48:37.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T20:49:31.283 DEBUG:teuthology.orchestra.remote:timed out 2023-12-07T20:49:37.581 DEBUG:teuthology.orchestra.remote:timed out 2023-12-07T20:49:40.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-12-07T20:49:40.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T20:49:41.783 DEBUG:teuthology.orchestra.run.smithi121:> true 2023-12-07T20:49:42.211 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-12-07T20:49:42.211 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-390.el9.x86_64"... 2023-12-07T20:49:42.212 DEBUG:teuthology.orchestra.run.smithi121:> uname -r 2023-12-07T20:49:42.226 INFO:teuthology.orchestra.run.smithi121.stdout:5.14.0-390.el9.x86_64 2023-12-07T20:49:42.226 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-390.el9.x86_64 vs 5.14.0-390.el9.x86_64 2023-12-07T20:49:42.226 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-07T20:49:42.226 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-07T20:49:43.227 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2023-12-07T20:49:43.228 DEBUG:teuthology.orchestra.run.smithi121:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-07T20:49:43.314 INFO:teuthology.orchestra.run.smithi121.stdout:ttyS1 2023-12-07T20:49:43.351 DEBUG:teuthology.parallel:result is None 2023-12-07T20:49:46.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T20:49:46.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T20:49:46.998 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-12-07T20:49:47.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T20:49:47.420 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-390.el9.x86_64"... 2023-12-07T20:49:47.421 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-12-07T20:49:47.435 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-390.el9.x86_64 2023-12-07T20:49:47.435 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-390.el9.x86_64 vs 5.14.0-390.el9.x86_64 2023-12-07T20:49:47.436 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-07T20:49:47.436 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-07T20:49:48.436 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-07T20:49:48.437 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-07T20:49:48.529 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2023-12-07T20:49:48.579 DEBUG:teuthology.parallel:result is None 2023-12-07T20:49:48.580 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-07T20:49:48.593 INFO:teuthology.task.internal:Creating test directory... 2023-12-07T20:49:48.593 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-07T20:49:48.596 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-07T20:49:48.623 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-07T20:49:48.630 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-07T20:49:48.653 INFO:teuthology.task.internal:Creating archive directory... 2023-12-07T20:49:48.654 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-07T20:49:48.656 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-07T20:49:48.713 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-07T20:49:48.721 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-07T20:49:48.723 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-07T20:49:48.730 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-07T20:49:48.761 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T20:49:48.774 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T20:49:48.851 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T20:49:48.870 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T20:49:48.872 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-07T20:49:48.879 INFO:teuthology.task.internal:Configuring sudo... 2023-12-07T20:49:48.879 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-07T20:49:48.885 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-07T20:49:48.928 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-07T20:49:48.942 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-07T20:49:48.943 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-07T20:49:48.952 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-07T20:49:48.999 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T20:49:49.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T20:49:49.100 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T20:49:49.183 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T20:49:49.224 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T20:49:49.224 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-07T20:49:49.292 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T20:49:49.349 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T20:49:49.417 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T20:49:49.475 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T20:49:49.520 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T20:49:49.520 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-07T20:49:49.595 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-12-07T20:49:49.597 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2023-12-07T20:49:49.651 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-07T20:49:49.700 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-07T20:49:49.964 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-07T20:49:49.971 INFO:teuthology.task.internal:Starting timer... 2023-12-07T20:49:49.972 INFO:teuthology.run_tasks:Running task pcp... 2023-12-07T20:49:50.015 INFO:teuthology.run_tasks:Running task selinux... 2023-12-07T20:49:50.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2023-12-07T20:49:50.092 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2023-12-07T20:49:50.094 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2023-12-07T20:49:50.270 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2023-12-07T20:49:50.273 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-07T20:49:50.273 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2023-12-07T20:49:50.288 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2023-12-07T20:49:50.288 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2023-12-07T20:49:50.308 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2023-12-07T20:49:50.309 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi089.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi121.front.sepia.ceph.com': 'permissive'} 2023-12-07T20:49:50.309 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-07T20:49:50.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T20:49:50.355 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-07T20:49:50.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T20:49:50.385 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-07T20:49:50.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2023-12-07T20:49:50.441 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2023-12-07T20:49:50.483 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-07T20:49:50.493 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-07T20:49:50.493 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-07T20:49:50.518 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-07T20:49:50.519 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi121.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-07T21:00:28.212 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com')] 2023-12-07T21:00:28.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T21:00:28.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T21:00:28.305 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-12-07T21:00:28.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-12-07T21:00:28.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-12-07T21:00:28.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T21:00:28.462 DEBUG:teuthology.orchestra.run.smithi121:> true 2023-12-07T21:00:28.537 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-12-07T21:00:28.537 INFO:teuthology.run_tasks:Running task clock... 2023-12-07T21:00:28.554 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-07T21:00:28.555 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-07T21:00:28.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T21:00:28.564 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-07T21:00:28.573 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T21:00:28.594 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-07T21:00:28.611 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-07T21:00:28.612 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-07T21:00:28.629 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-07T21:00:28.642 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2023-12-07T21:00:28.656 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2023-12-07T21:00:28.659 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2023-12-07T21:00:28.673 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-07T21:00:28.673 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2023-12-07T21:00:28.690 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-07T21:00:28.691 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-07T21:00:28.706 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-07T21:00:28.733 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2023-12-07T21:00:28.737 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-07T21:00:28.737 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-12-07T21:00:28.737 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T21:00:28.737 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T21:00:28.738 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T21:00:28.738 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T21:00:28.749 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2023-12-07T21:00:28.753 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-07T21:00:28.753 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2023-12-07T21:00:28.753 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T21:00:28.753 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T21:00:28.753 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T21:00:28.753 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T21:00:28.754 INFO:teuthology.run_tasks:Running task install... 2023-12-07T21:00:28.762 DEBUG:teuthology.task.install:project ceph 2023-12-07T21:00:28.763 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0'}} 2023-12-07T21:00:28.763 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0'} 2023-12-07T21:00:28.763 INFO:teuthology.task.install:Using flavor: default 2023-12-07T21:00:28.770 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-07T21:00:28.770 INFO:teuthology.task.install:extra packages: [] 2023-12-07T21:00:28.770 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0', 'tag': None, 'wait_for_package': False} 2023-12-07T21:00:28.771 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0 2023-12-07T21:00:28.777 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0', 'tag': None, 'wait_for_package': False} 2023-12-07T21:00:28.777 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0 2023-12-07T21:00:29.001 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag-test/e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/centos/9/flavors/default/ 2023-12-07T21:00:29.002 INFO:teuthology.task.install.rpm:Package version is 19.0.0-38.ge93c2b5c 2023-12-07T21:00:29.008 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag-test/e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/centos/9/flavors/default/ 2023-12-07T21:00:29.009 INFO:teuthology.task.install.rpm:Package version is 19.0.0-38.ge93c2b5c 2023-12-07T21:00:29.124 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag-test/e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag-test/e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag-test/e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-07T21:00:29.124 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:00:29.124 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-07T21:00:29.153 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-07T21:00:29.153 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-07T21:00:29.174 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag-test/e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag-test/e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag-test/e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-07T21:00:29.174 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:00:29.174 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-07T21:00:29.203 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-07T21:00:29.203 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-07T21:00:29.221 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-07T21:00:29.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-07T21:00:29.301 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-07T21:00:29.351 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-07T21:00:29.369 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2023-12-07T21:00:29.370 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2023-12-07T21:00:29.418 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2023-12-07T21:00:29.420 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2023-12-07T21:00:29.615 INFO:teuthology.orchestra.run.smithi121.stdout:73 files removed 2023-12-07T21:00:29.642 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw 2023-12-07T21:00:29.668 INFO:teuthology.orchestra.run.smithi089.stdout:73 files removed 2023-12-07T21:00:29.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw 2023-12-07T21:00:30.351 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 198 kB/s | 78 kB 00:00 2023-12-07T21:00:30.412 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 197 kB/s | 78 kB 00:00 2023-12-07T21:00:30.768 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2023-12-07T21:00:30.871 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 23 kB/s | 9.5 kB 00:00 2023-12-07T21:00:31.210 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2023-12-07T21:00:31.280 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2023-12-07T21:00:31.613 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-12-07T21:00:32.024 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - AppStream 9.0 MB/s | 6.4 MB 00:00 2023-12-07T21:00:33.088 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2023-12-07T21:00:33.376 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2023-12-07T21:00:34.448 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-12-07T21:00:35.271 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 7.9 MB 00:01 2023-12-07T21:00:39.263 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 18 MB 00:02 2023-12-07T21:00:40.487 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 3.7 MB/s | 18 MB 00:04 2023-12-07T21:00:44.205 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 5.8 MB 00:01 2023-12-07T21:00:44.783 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 5.8 MB 00:00 2023-12-07T21:00:45.606 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 15 kB 00:00 2023-12-07T21:00:46.226 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 15 kB 00:00 2023-12-07T21:00:47.236 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2023-12-07T21:00:52.202 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2023-12-07T21:00:54.793 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:00:54.803 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:00:54.803 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-07T21:00:54.803 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:00:54.803 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 8.6 M 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 3.3 M 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 3.0 M 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 5.2 M 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 19 M 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 24 k 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-07T21:00:54.808 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 718 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 476 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 4.8 M 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 45 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 129 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 162 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 321 k 2023-12-07T21:00:54.809 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 299 k 2023-12-07T21:00:54.810 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 99 k 2023-12-07T21:00:54.810 INFO:teuthology.orchestra.run.smithi089.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-07T21:00:54.810 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-07T21:00:54.810 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:00:54.810 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:00:54.810 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:00:54.810 INFO:teuthology.orchestra.run.smithi089.stdout:Install 27 Packages 2023-12-07T21:00:54.810 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 2 Packages 2023-12-07T21:00:54.810 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:00:54.811 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 55 M 2023-12-07T21:00:54.811 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:00:55.479 INFO:teuthology.orchestra.run.smithi089.stdout:(1/29): ceph-base-19.0.0-38.ge93c2b5c.el9.x86_6 8.4 MB/s | 5.2 MB 00:00 2023-12-07T21:00:55.537 INFO:teuthology.orchestra.run.smithi089.stdout:(2/29): ceph-selinux-19.0.0-38.ge93c2b5c.el9.x8 414 kB/s | 24 kB 00:00 2023-12-07T21:00:55.646 INFO:teuthology.orchestra.run.smithi089.stdout:(3/29): libcephfs2-19.0.0-38.ge93c2b5c.el9.x86_ 6.5 MB/s | 718 kB 00:00 2023-12-07T21:00:55.721 INFO:teuthology.orchestra.run.smithi089.stdout:(4/29): libradosstriper1-19.0.0-38.ge93c2b5c.el 6.2 MB/s | 476 kB 00:00 2023-12-07T21:00:56.196 INFO:teuthology.orchestra.run.smithi089.stdout:(5/29): librgw2-19.0.0-38.ge93c2b5c.el9.x86_64. 10 MB/s | 4.8 MB 00:00 2023-12-07T21:00:56.382 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 1.8 MB/s | 20 MB 00:10 2023-12-07T21:00:56.413 INFO:teuthology.orchestra.run.smithi089.stdout:(6/29): ceph-common-19.0.0-38.ge93c2b5c.el9.x86 12 MB/s | 19 MB 00:01 2023-12-07T21:00:56.430 INFO:teuthology.orchestra.run.smithi089.stdout:(7/29): python3-ceph-argparse-19.0.0-38.ge93c2b 193 kB/s | 45 kB 00:00 2023-12-07T21:00:56.464 INFO:teuthology.orchestra.run.smithi089.stdout:(8/29): python3-ceph-common-19.0.0-38.ge93c2b5c 2.5 MB/s | 129 kB 00:00 2023-12-07T21:00:56.489 INFO:teuthology.orchestra.run.smithi089.stdout:(9/29): python3-cephfs-19.0.0-38.ge93c2b5c.el9. 2.7 MB/s | 162 kB 00:00 2023-12-07T21:00:56.514 INFO:teuthology.orchestra.run.smithi089.stdout:(10/29): python3-rados-19.0.0-38.ge93c2b5c.el9. 6.2 MB/s | 321 kB 00:00 2023-12-07T21:00:56.549 INFO:teuthology.orchestra.run.smithi089.stdout:(11/29): python3-rbd-19.0.0-38.ge93c2b5c.el9.x8 5.0 MB/s | 299 kB 00:00 2023-12-07T21:00:56.565 INFO:teuthology.orchestra.run.smithi089.stdout:(12/29): python3-rgw-19.0.0-38.ge93c2b5c.el9.x8 1.9 MB/s | 99 kB 00:00 2023-12-07T21:00:56.673 INFO:teuthology.orchestra.run.smithi089.stdout:(13/29): boost-program-options-1.75.0-8.el9.x86 845 kB/s | 106 kB 00:00 2023-12-07T21:00:56.704 INFO:teuthology.orchestra.run.smithi089.stdout:(14/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2023-12-07T21:00:56.721 INFO:teuthology.orchestra.run.smithi089.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 930 kB/s | 44 kB 00:00 2023-12-07T21:00:56.771 INFO:teuthology.orchestra.run.smithi089.stdout:(16/29): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2023-12-07T21:00:56.798 INFO:teuthology.orchestra.run.smithi089.stdout:(17/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-12-07T21:00:56.822 INFO:teuthology.orchestra.run.smithi089.stdout:(18/29): python3-prettytable-0.7.2-27.el9.noarc 819 kB/s | 41 kB 00:00 2023-12-07T21:00:57.264 INFO:teuthology.orchestra.run.smithi089.stdout:(19/29): ceph-radosgw-19.0.0-38.ge93c2b5c.el9.x 3.6 MB/s | 8.6 MB 00:02 2023-12-07T21:00:57.290 INFO:teuthology.orchestra.run.smithi089.stdout:(20/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 628 kB/s | 309 kB 00:00 2023-12-07T21:00:57.381 INFO:teuthology.orchestra.run.smithi089.stdout:(21/29): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2023-12-07T21:00:57.473 INFO:teuthology.orchestra.run.smithi089.stdout:(22/29): libunwind-1.6.2-1.el9.x86_64.rpm 743 kB/s | 67 kB 00:00 2023-12-07T21:00:57.549 INFO:teuthology.orchestra.run.smithi089.stdout:(23/29): libarrow-9.0.0-10.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2023-12-07T21:00:57.574 INFO:teuthology.orchestra.run.smithi089.stdout:(24/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 84 kB/s | 26 kB 00:00 2023-12-07T21:00:57.641 INFO:teuthology.orchestra.run.smithi089.stdout:(25/29): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-12-07T21:00:57.674 INFO:teuthology.orchestra.run.smithi089.stdout:(26/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.1 MB/s | 838 kB 00:00 2023-12-07T21:00:57.925 INFO:teuthology.orchestra.run.smithi089.stdout:(27/29): thrift-0.15.0-2.el9.x86_64.rpm 4.5 MB/s | 1.6 MB 00:00 2023-12-07T21:00:57.983 INFO:teuthology.orchestra.run.smithi089.stdout:(28/29): librados2-19.0.0-38.ge93c2b5c.el9.x86_ 9.7 MB/s | 3.3 MB 00:00 2023-12-07T21:00:58.033 INFO:teuthology.orchestra.run.smithi089.stdout:(29/29): librbd1-19.0.0-38.ge93c2b5c.el9.x86_64 8.4 MB/s | 3.0 MB 00:00 2023-12-07T21:00:58.039 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:00:58.040 INFO:teuthology.orchestra.run.smithi089.stdout:Total 17 MB/s | 55 MB 00:03 2023-12-07T21:00:58.040 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:00:58.070 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:00:58.070 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:00:58.525 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:00:58.526 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:00:59.890 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:00:59.980 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-12-07T21:01:00.013 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2023-12-07T21:01:00.072 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2023-12-07T21:01:00.384 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2023-12-07T21:01:00.446 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/31 2023-12-07T21:01:00.537 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/31 2023-12-07T21:01:00.630 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:19.0.0-38.ge93c2b5c.el9.x86_64 6/31 2023-12-07T21:01:00.656 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:19.0.0-38.ge93c2b5c.el9.x86_64 7/31 2023-12-07T21:01:00.701 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:19.0.0-38.ge93c2b5c.el9.x86_64 7/31 2023-12-07T21:01:00.741 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2023-12-07T21:01:00.785 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:19.0.0-38.ge93c2b5c.el9.x8 9/31 2023-12-07T21:01:00.848 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:19.0.0-38.ge93c2b5c.el9.x86_64 10/31 2023-12-07T21:01:00.875 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:19.0.0-38.ge93c2b5c.el9.x86_64 11/31 2023-12-07T21:01:00.924 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:19.0.0-38.ge93c2b5c.el9.x86_64 11/31 2023-12-07T21:01:01.029 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-12-07T21:01:01.087 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2023-12-07T21:01:01.113 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2023-12-07T21:01:01.124 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-12-07T21:01:01.148 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-12-07T21:01:01.177 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2023-12-07T21:01:01.210 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-12-07T21:01:01.513 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-12-07T21:01:01.540 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:19.0.0-38.ge93c2b5c.el9.x86_64 19/31 2023-12-07T21:01:01.613 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:19.0.0-38.ge93c2b5c.el9.x86_64 19/31 2023-12-07T21:01:01.645 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 20/31 2023-12-07T21:01:01.681 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-12-07T21:01:02.140 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2023-12-07T21:01:02.168 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:19.0.0-38.ge93c2b5c.el9.x86_64 23/31 2023-12-07T21:01:02.222 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:19.0.0-38.ge93c2b5c.el9.x86_64 23/31 2023-12-07T21:01:02.300 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 24/31 2023-12-07T21:01:02.329 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_ 25/31 2023-12-07T21:01:03.704 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:01:03.709 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:01:03.709 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-12-07T21:01:03.709 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:01:03.709 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:01:03.709 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 8.6 M 2023-12-07T21:01:03.709 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2023-12-07T21:01:03.709 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 3.3 M 2023-12-07T21:01:03.709 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 3.0 M 2023-12-07T21:01:03.709 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2023-12-07T21:01:03.709 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 5.2 M 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 19 M 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 24 k 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 718 k 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 476 k 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 4.8 M 2023-12-07T21:01:03.710 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 45 k 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 129 k 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 162 k 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 321 k 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 299 k 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 99 k 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:01:03.711 INFO:teuthology.orchestra.run.smithi121.stdout:Install 27 Packages 2023-12-07T21:01:03.712 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 2 Packages 2023-12-07T21:01:03.712 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:03.712 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 55 M 2023-12-07T21:01:03.712 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:01:04.463 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 26/31 2023-12-07T21:01:04.509 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 26/31 2023-12-07T21:01:04.981 INFO:teuthology.orchestra.run.smithi121.stdout:(1/29): ceph-radosgw-19.0.0-38.ge93c2b5c.el9.x8 7.9 MB/s | 8.6 MB 00:01 2023-12-07T21:01:05.047 INFO:teuthology.orchestra.run.smithi121.stdout:(2/29): ceph-selinux-19.0.0-38.ge93c2b5c.el9.x8 362 kB/s | 24 kB 00:00 2023-12-07T21:01:05.064 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 26/31 2023-12-07T21:01:05.112 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:19.0.0-38.ge93c2b5c.el9.x86_64 27/31 2023-12-07T21:01:05.181 INFO:teuthology.orchestra.run.smithi121.stdout:(3/29): libcephfs2-19.0.0-38.ge93c2b5c.el9.x86_ 5.3 MB/s | 718 kB 00:00 2023-12-07T21:01:05.196 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:19.0.0-38.ge93c2b5c.el9.x86_64 27/31 2023-12-07T21:01:05.197 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-07T21:01:05.197 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-07T21:01:05.197 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:05.238 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:19.0.0-38.ge93c2b5c.el9.x86_64 28/31 2023-12-07T21:01:05.440 INFO:teuthology.orchestra.run.smithi121.stdout:(4/29): ceph-common-19.0.0-38.ge93c2b5c.el9.x86 12 MB/s | 19 MB 00:01 2023-12-07T21:01:05.465 INFO:teuthology.orchestra.run.smithi121.stdout:(5/29): libradosstriper1-19.0.0-38.ge93c2b5c.el 1.6 MB/s | 476 kB 00:00 2023-12-07T21:01:05.540 INFO:teuthology.orchestra.run.smithi121.stdout:(6/29): python3-ceph-argparse-19.0.0-38.ge93c2b 604 kB/s | 45 kB 00:00 2023-12-07T21:01:05.607 INFO:teuthology.orchestra.run.smithi121.stdout:(7/29): python3-ceph-common-19.0.0-38.ge93c2b5c 1.9 MB/s | 129 kB 00:00 2023-12-07T21:01:05.708 INFO:teuthology.orchestra.run.smithi121.stdout:(8/29): librgw2-19.0.0-38.ge93c2b5c.el9.x86_64. 18 MB/s | 4.8 MB 00:00 2023-12-07T21:01:05.733 INFO:teuthology.orchestra.run.smithi121.stdout:(9/29): python3-cephfs-19.0.0-38.ge93c2b5c.el9. 1.3 MB/s | 162 kB 00:00 2023-12-07T21:01:05.763 INFO:teuthology.orchestra.run.smithi121.stdout:(10/29): python3-rados-19.0.0-38.ge93c2b5c.el9. 5.7 MB/s | 321 kB 00:00 2023-12-07T21:01:05.788 INFO:teuthology.orchestra.run.smithi121.stdout:(11/29): python3-rbd-19.0.0-38.ge93c2b5c.el9.x8 5.3 MB/s | 299 kB 00:00 2023-12-07T21:01:05.813 INFO:teuthology.orchestra.run.smithi121.stdout:(12/29): python3-rgw-19.0.0-38.ge93c2b5c.el9.x8 1.9 MB/s | 99 kB 00:00 2023-12-07T21:01:05.930 INFO:teuthology.orchestra.run.smithi121.stdout:(13/29): boost-program-options-1.75.0-8.el9.x86 747 kB/s | 106 kB 00:00 2023-12-07T21:01:05.956 INFO:teuthology.orchestra.run.smithi121.stdout:(14/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2023-12-07T21:01:05.981 INFO:teuthology.orchestra.run.smithi121.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 870 kB/s | 44 kB 00:00 2023-12-07T21:01:06.057 INFO:teuthology.orchestra.run.smithi121.stdout:(16/29): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 661 kB 00:00 2023-12-07T21:01:06.083 INFO:teuthology.orchestra.run.smithi121.stdout:(17/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 282 kB 00:00 2023-12-07T21:01:06.107 INFO:teuthology.orchestra.run.smithi121.stdout:(18/29): python3-prettytable-0.7.2-27.el9.noarc 827 kB/s | 41 kB 00:00 2023-12-07T21:01:06.616 INFO:teuthology.orchestra.run.smithi121.stdout:(19/29): ceph-base-19.0.0-38.ge93c2b5c.el9.x86_ 1.9 MB/s | 5.2 MB 00:02 2023-12-07T21:01:06.683 INFO:teuthology.orchestra.run.smithi121.stdout:(20/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 514 kB/s | 309 kB 00:00 2023-12-07T21:01:06.783 INFO:teuthology.orchestra.run.smithi121.stdout:(21/29): liboath-2.6.7-2.el9.x86_64.rpm 486 kB/s | 49 kB 00:00 2023-12-07T21:01:06.825 INFO:teuthology.orchestra.run.smithi121.stdout:(22/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 124 kB/s | 26 kB 00:00 2023-12-07T21:01:07.009 INFO:teuthology.orchestra.run.smithi121.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 299 kB/s | 67 kB 00:00 2023-12-07T21:01:07.367 INFO:teuthology.orchestra.run.smithi121.stdout:(24/29): re2-20211101-3.el9.x86_64.rpm 535 kB/s | 192 kB 00:00 2023-12-07T21:01:07.942 INFO:teuthology.orchestra.run.smithi121.stdout:(25/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 750 kB/s | 838 kB 00:01 2023-12-07T21:01:08.576 INFO:teuthology.orchestra.run.smithi121.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 1.3 MB/s | 1.6 MB 00:01 2023-12-07T21:01:08.843 INFO:teuthology.orchestra.run.smithi121.stdout:(27/29): librbd1-19.0.0-38.ge93c2b5c.el9.x86_64 11 MB/s | 3.0 MB 00:00 2023-12-07T21:01:08.968 INFO:teuthology.orchestra.run.smithi121.stdout:(28/29): librados2-19.0.0-38.ge93c2b5c.el9.x86_ 3.2 MB/s | 3.3 MB 00:01 2023-12-07T21:01:09.509 INFO:teuthology.orchestra.run.smithi121.stdout:(29/29): libarrow-9.0.0-10.el9.x86_64.rpm 1.3 MB/s | 4.4 MB 00:03 2023-12-07T21:01:09.517 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:01:09.517 INFO:teuthology.orchestra.run.smithi121.stdout:Total 9.4 MB/s | 55 MB 00:05 2023-12-07T21:01:09.518 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:01:09.554 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:01:09.554 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:01:10.022 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:01:10.022 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:01:11.391 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:01:11.480 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2023-12-07T21:01:11.514 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2023-12-07T21:01:11.576 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2023-12-07T21:01:11.885 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2023-12-07T21:01:11.947 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/31 2023-12-07T21:01:12.044 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/31 2023-12-07T21:01:12.122 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:19.0.0-38.ge93c2b5c.el9.x86_64 6/31 2023-12-07T21:01:12.157 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:19.0.0-38.ge93c2b5c.el9.x86_64 7/31 2023-12-07T21:01:12.210 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:19.0.0-38.ge93c2b5c.el9.x86_64 7/31 2023-12-07T21:01:12.324 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2023-12-07T21:01:12.458 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:19.0.0-38.ge93c2b5c.el9.x8 9/31 2023-12-07T21:01:12.525 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:19.0.0-38.ge93c2b5c.el9.x86_64 10/31 2023-12-07T21:01:12.550 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:19.0.0-38.ge93c2b5c.el9.x86_64 11/31 2023-12-07T21:01:12.600 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:19.0.0-38.ge93c2b5c.el9.x86_64 11/31 2023-12-07T21:01:12.706 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2023-12-07T21:01:12.760 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2023-12-07T21:01:12.800 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2023-12-07T21:01:12.832 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2023-12-07T21:01:12.862 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2023-12-07T21:01:12.897 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2023-12-07T21:01:13.347 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2023-12-07T21:01:13.382 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:19.0.0-38.ge93c2b5c.el9.x86_64 19/31 2023-12-07T21:01:13.456 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:19.0.0-38.ge93c2b5c.el9.x86_64 19/31 2023-12-07T21:01:13.486 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 20/31 2023-12-07T21:01:13.523 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2023-12-07T21:01:13.946 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2023-12-07T21:01:13.978 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:19.0.0-38.ge93c2b5c.el9.x86_64 23/31 2023-12-07T21:01:14.030 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:19.0.0-38.ge93c2b5c.el9.x86_64 23/31 2023-12-07T21:01:14.098 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 24/31 2023-12-07T21:01:14.128 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_ 25/31 2023-12-07T21:01:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:19.0.0-38.ge93c2b5c.el9.x86_64 28/31 2023-12-07T21:01:14.922 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2023-12-07T21:01:14.922 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2023-12-07T21:01:14.922 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2023-12-07T21:01:14.922 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2023-12-07T21:01:14.922 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2023-12-07T21:01:14.922 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2023-12-07T21:01:14.922 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2023-12-07T21:01:14.922 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:15.751 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 29/31 2023-12-07T21:01:15.775 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 29/31 2023-12-07T21:01:15.776 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:01:15.776 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-07T21:01:15.776 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-07T21:01:15.776 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-07T21:01:15.776 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:15.778 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-07T21:01:15.862 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-07T21:01:15.863 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-07T21:01:16.269 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 26/31 2023-12-07T21:01:16.300 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 26/31 2023-12-07T21:01:16.854 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 26/31 2023-12-07T21:01:16.894 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:19.0.0-38.ge93c2b5c.el9.x86_64 27/31 2023-12-07T21:01:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-07T21:01:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/31 2023-12-07T21:01:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 2/31 2023-12-07T21:01:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 3/31 2023-12-07T21:01:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:19.0.0-38.ge93c2b5c.el9.x86_64 4/31 2023-12-07T21:01:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/31 2023-12-07T21:01:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:19.0.0-38.ge93c2b5c.el9.x86_64 6/31 2023-12-07T21:01:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:19.0.0-38.ge93c2b5c.el9.x86_64 7/31 2023-12-07T21:01:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:19.0.0-38.ge93c2b5c.el9.x8 8/31 2023-12-07T21:01:16.952 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_ 9/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:19.0.0-38.ge93c2b5c.el9.x86_64 10/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:19.0.0-38.ge93c2b5c.el9.x86_64 11/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 12/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 13/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-12-07T21:01:16.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2023-12-07T21:01:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-12-07T21:01:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-12-07T21:01:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:19.0.0-38.ge93c2b5c.el9.x86_64 28/31 2023-12-07T21:01:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-12-07T21:01:16.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:19.0.0-38.ge93c2b5c.el9.x86_64 30/31 2023-12-07T21:01:16.976 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:19.0.0-38.ge93c2b5c.el9.x86_64 27/31 2023-12-07T21:01:16.977 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-07T21:01:16.977 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-07T21:01:16.977 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:17.012 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:19.0.0-38.ge93c2b5c.el9.x86_64 28/31 2023-12-07T21:01:18.039 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-12-07T21:01:18.039 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:18.039 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-12-07T21:01:18.039 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.039 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.039 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:01:18.039 INFO:teuthology.orchestra.run.smithi089.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-07T21:01:18.040 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: re2-1:20211101-3.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:18.041 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:01:18.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-test 2023-12-07T21:01:18.973 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:26 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:01:19.120 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:01:19.121 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:19.121 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-07T21:01:19.121 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:19.121 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:01:19.121 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 41 M 2023-12-07T21:01:19.121 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-12-07T21:01:19.121 INFO:teuthology.orchestra.run.smithi089.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-07T21:01:19.122 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 163 k 2023-12-07T21:01:19.122 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-07T21:01:19.122 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-07T21:01:19.122 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-07T21:01:19.122 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:19.122 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:01:19.122 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:19.122 INFO:teuthology.orchestra.run.smithi089.stdout:Install 6 Packages 2023-12-07T21:01:19.122 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:19.123 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 42 M 2023-12-07T21:01:19.123 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 173 M 2023-12-07T21:01:19.123 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:01:19.293 INFO:teuthology.orchestra.run.smithi089.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 186 kB 00:00 2023-12-07T21:01:19.335 INFO:teuthology.orchestra.run.smithi089.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2023-12-07T21:01:19.377 INFO:teuthology.orchestra.run.smithi089.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2023-12-07T21:01:19.402 INFO:teuthology.orchestra.run.smithi089.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 63 kB 00:00 2023-12-07T21:01:19.702 INFO:teuthology.orchestra.run.smithi089.stdout:(5/6): libcephsqlite-19.0.0-38.ge93c2b5c.el9.x8 282 kB/s | 163 kB 00:00 2023-12-07T21:01:21.436 INFO:teuthology.orchestra.run.smithi089.stdout:(6/6): ceph-test-19.0.0-38.ge93c2b5c.el9.x86_64 18 MB/s | 41 MB 00:02 2023-12-07T21:01:21.439 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:01:21.439 INFO:teuthology.orchestra.run.smithi089.stdout:Total 18 MB/s | 42 MB 00:02 2023-12-07T21:01:21.439 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:01:21.459 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:01:21.459 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:01:21.798 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:01:21.798 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:01:22.329 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:01:22.412 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-12-07T21:01:22.452 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-12-07T21:01:22.493 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-12-07T21:01:22.561 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2023-12-07T21:01:22.589 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/6 2023-12-07T21:01:26.349 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:19.0.0-38.ge93c2b5c.el9.x86_64 28/31 2023-12-07T21:01:26.350 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2023-12-07T21:01:26.350 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2023-12-07T21:01:26.350 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2023-12-07T21:01:26.350 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2023-12-07T21:01:26.350 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2023-12-07T21:01:26.350 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2023-12-07T21:01:26.350 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2023-12-07T21:01:26.350 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:26.422 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/6 2023-12-07T21:01:26.496 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:19.0.0-38.ge93c2b5c.el9.x86_64 6/6 2023-12-07T21:01:27.190 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 29/31 2023-12-07T21:01:27.215 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 29/31 2023-12-07T21:01:27.215 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:01:27.215 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-07T21:01:27.215 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-07T21:01:27.215 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-07T21:01:27.215 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:27.216 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-07T21:01:27.284 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2023-12-07T21:01:27.284 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-07T21:01:28.370 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 2/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 3/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:19.0.0-38.ge93c2b5c.el9.x86_64 4/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:19.0.0-38.ge93c2b5c.el9.x86_64 6/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:19.0.0-38.ge93c2b5c.el9.x86_64 7/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:19.0.0-38.ge93c2b5c.el9.x8 8/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_ 9/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:19.0.0-38.ge93c2b5c.el9.x86_64 10/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:19.0.0-38.ge93c2b5c.el9.x86_64 11/31 2023-12-07T21:01:28.371 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 12/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 13/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2023-12-07T21:01:28.372 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:19.0.0-38.ge93c2b5c.el9.x86_64 28/31 2023-12-07T21:01:28.373 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2023-12-07T21:01:28.373 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:19.0.0-38.ge93c2b5c.el9.x86_64 30/31 2023-12-07T21:01:28.714 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-test-2:19.0.0-38.ge93c2b5c.el9.x86_64 6/6 2023-12-07T21:01:28.714 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/6 2023-12-07T21:01:28.714 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:19.0.0-38.ge93c2b5c.el9.x86_64 2/6 2023-12-07T21:01:28.714 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2023-12-07T21:01:28.714 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2023-12-07T21:01:28.715 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2023-12-07T21:01:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2023-12-07T21:01:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:29.074 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:01:29.074 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:19.0.0-38.ge93c2b5c.el9.x86_64 jq-1.6-16.el9.x86_64 2023-12-07T21:01:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:19.0.0-38.ge93c2b5c.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2023-12-07T21:01:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2023-12-07T21:01:29.075 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:29.075 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:01:29.371 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph 2023-12-07T21:01:29.546 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2023-12-07T21:01:29.546 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:29.546 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-07T21:01:29.547 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:29.548 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-3.el9.x86_64 2023-12-07T21:01:29.549 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-07T21:01:29.549 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:29.549 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:01:29.894 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-test 2023-12-07T21:01:29.952 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:37 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:01:30.100 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:01:30.106 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2023-12-07T21:01:30.106 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-07T21:01:30.106 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2023-12-07T21:01:30.106 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:01:30.106 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 6.5 k 2023-12-07T21:01:30.106 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-12-07T21:01:30.106 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 2.1 M 2023-12-07T21:01:30.106 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 1.5 M 2023-12-07T21:01:30.106 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 243 k 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 4.4 M 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 18 M 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-07T21:01:30.107 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-07T21:01:30.108 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout:Install 36 Packages 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 30 M 2023-12-07T21:01:30.109 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 111 M 2023-12-07T21:01:30.110 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:01:30.476 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:29 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:01:30.630 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 41 M 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 163 k 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:30.631 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:01:30.632 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:01:30.632 INFO:teuthology.orchestra.run.smithi121.stdout:Install 6 Packages 2023-12-07T21:01:30.632 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:30.632 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 42 M 2023-12-07T21:01:30.632 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 173 M 2023-12-07T21:01:30.633 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:01:30.812 INFO:teuthology.orchestra.run.smithi121.stdout:(1/6): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 186 kB 00:00 2023-12-07T21:01:30.840 INFO:teuthology.orchestra.run.smithi089.stdout:(1/36): ceph-19.0.0-38.ge93c2b5c.el9.x86_64.rpm 18 kB/s | 6.5 kB 00:00 2023-12-07T21:01:30.914 INFO:teuthology.orchestra.run.smithi121.stdout:(2/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.1 MB/s | 217 kB 00:00 2023-12-07T21:01:31.021 INFO:teuthology.orchestra.run.smithi121.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 300 kB 00:00 2023-12-07T21:01:31.062 INFO:teuthology.orchestra.run.smithi121.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2023-12-07T21:01:31.371 INFO:teuthology.orchestra.run.smithi121.stdout:(5/6): libcephsqlite-19.0.0-38.ge93c2b5c.el9.x8 221 kB/s | 163 kB 00:00 2023-12-07T21:01:31.373 INFO:teuthology.orchestra.run.smithi089.stdout:(2/36): ceph-mgr-19.0.0-38.ge93c2b5c.el9.x86_64 1.6 MB/s | 1.5 MB 00:00 2023-12-07T21:01:31.666 INFO:teuthology.orchestra.run.smithi089.stdout:(3/36): ceph-mds-19.0.0-38.ge93c2b5c.el9.x86_64 1.7 MB/s | 2.1 MB 00:01 2023-12-07T21:01:31.766 INFO:teuthology.orchestra.run.smithi089.stdout:(4/36): ceph-mgr-modules-core-19.0.0-38.ge93c2b 2.4 MB/s | 243 kB 00:00 2023-12-07T21:01:31.875 INFO:teuthology.orchestra.run.smithi089.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-12-07T21:01:31.917 INFO:teuthology.orchestra.run.smithi089.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2023-12-07T21:01:31.950 INFO:teuthology.orchestra.run.smithi089.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 949 kB/s | 32 kB 00:00 2023-12-07T21:01:31.984 INFO:teuthology.orchestra.run.smithi089.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2023-12-07T21:01:32.017 INFO:teuthology.orchestra.run.smithi089.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-12-07T21:01:32.060 INFO:teuthology.orchestra.run.smithi089.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-12-07T21:01:32.135 INFO:teuthology.orchestra.run.smithi089.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 15 MB/s | 1.1 MB 00:00 2023-12-07T21:01:32.169 INFO:teuthology.orchestra.run.smithi089.stdout:(12/36): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2023-12-07T21:01:32.202 INFO:teuthology.orchestra.run.smithi089.stdout:(13/36): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2023-12-07T21:01:32.236 INFO:teuthology.orchestra.run.smithi089.stdout:(14/36): python3-requests-2.25.1-7.el9.noarch.r 3.3 MB/s | 113 kB 00:00 2023-12-07T21:01:32.278 INFO:teuthology.orchestra.run.smithi089.stdout:(15/36): python3-urllib3-1.26.5-4.el9.noarch.rp 4.4 MB/s | 187 kB 00:00 2023-12-07T21:01:32.362 INFO:teuthology.orchestra.run.smithi089.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2023-12-07T21:01:32.929 INFO:teuthology.orchestra.run.smithi089.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 266 kB/s | 151 kB 00:00 2023-12-07T21:01:33.063 INFO:teuthology.orchestra.run.smithi089.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 325 kB/s | 43 kB 00:00 2023-12-07T21:01:33.230 INFO:teuthology.orchestra.run.smithi089.stdout:(19/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2023-12-07T21:01:33.430 INFO:teuthology.orchestra.run.smithi089.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2023-12-07T21:01:33.530 INFO:teuthology.orchestra.run.smithi089.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 107 kB/s | 11 kB 00:00 2023-12-07T21:01:33.631 INFO:teuthology.orchestra.run.smithi089.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 176 kB/s | 18 kB 00:00 2023-12-07T21:01:33.731 INFO:teuthology.orchestra.run.smithi089.stdout:(23/36): python3-jaraco-collections-3.0.0-8.el9 231 kB/s | 23 kB 00:00 2023-12-07T21:01:33.831 INFO:teuthology.orchestra.run.smithi089.stdout:(24/36): python3-jaraco-functools-3.5.0-2.el9.n 194 kB/s | 19 kB 00:00 2023-12-07T21:01:33.932 INFO:teuthology.orchestra.run.smithi089.stdout:(25/36): python3-jaraco-text-3.2.0-6.el9.noarch 196 kB/s | 20 kB 00:00 2023-12-07T21:01:33.999 INFO:teuthology.orchestra.run.smithi089.stdout:(26/36): ceph-mon-19.0.0-38.ge93c2b5c.el9.x86_6 1.4 MB/s | 4.4 MB 00:03 2023-12-07T21:01:34.032 INFO:teuthology.orchestra.run.smithi089.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 462 kB/s | 46 kB 00:00 2023-12-07T21:01:34.158 INFO:teuthology.orchestra.run.smithi089.stdout:(28/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2023-12-07T21:01:34.258 INFO:teuthology.orchestra.run.smithi089.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 164 kB/s | 16 kB 00:00 2023-12-07T21:01:34.366 INFO:teuthology.orchestra.run.smithi089.stdout:(30/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 830 kB/s | 90 kB 00:00 2023-12-07T21:01:34.475 INFO:teuthology.orchestra.run.smithi089.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 329 kB/s | 36 kB 00:00 2023-12-07T21:01:34.501 INFO:teuthology.orchestra.run.smithi089.stdout:(32/36): python3-more-itertools-8.12.0-2.el9.no 157 kB/s | 79 kB 00:00 2023-12-07T21:01:34.601 INFO:teuthology.orchestra.run.smithi089.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-12-07T21:01:34.701 INFO:teuthology.orchestra.run.smithi089.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 200 kB/s | 20 kB 00:00 2023-12-07T21:01:34.835 INFO:teuthology.orchestra.run.smithi089.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.2 MB/s | 427 kB 00:00 2023-12-07T21:01:35.602 INFO:teuthology.orchestra.run.smithi089.stdout:(36/36): ceph-osd-19.0.0-38.ge93c2b5c.el9.x86_6 4.2 MB/s | 18 MB 00:04 2023-12-07T21:01:35.607 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:01:35.607 INFO:teuthology.orchestra.run.smithi089.stdout:Total 5.5 MB/s | 30 MB 00:05 2023-12-07T21:01:35.619 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:01:35.659 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:01:35.659 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:01:36.073 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:01:36.073 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:01:37.418 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:01:37.488 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2023-12-07T21:01:37.520 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2023-12-07T21:01:37.549 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2023-12-07T21:01:37.627 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2023-12-07T21:01:37.664 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2023-12-07T21:01:37.697 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2023-12-07T21:01:37.789 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2023-12-07T21:01:37.867 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2023-12-07T21:01:37.909 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2023-12-07T21:01:37.979 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2023-12-07T21:01:38.033 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 11/36 2023-12-07T21:01:38.072 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 12/36 2023-12-07T21:01:38.121 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2023-12-07T21:01:38.185 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2023-12-07T21:01:38.369 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2023-12-07T21:01:38.427 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2023-12-07T21:01:38.462 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2023-12-07T21:01:38.500 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2023-12-07T21:01:38.531 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2023-12-07T21:01:38.606 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2023-12-07T21:01:38.641 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2023-12-07T21:01:38.683 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2023-12-07T21:01:38.723 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2023-12-07T21:01:38.758 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2023-12-07T21:01:38.793 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2023-12-07T21:01:38.881 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2023-12-07T21:01:38.933 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2023-12-07T21:01:39.004 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2023-12-07T21:01:39.141 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2023-12-07T21:01:39.275 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2023-12-07T21:01:39.429 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-38.ge93c2b5c.el9.no 31/36 2023-12-07T21:01:39.455 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:19.0.0-38.ge93c2b5c.el9.x86_64 32/36 2023-12-07T21:01:39.480 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:19.0.0-38.ge93c2b5c.el9.x86_64 32/36 2023-12-07T21:01:39.480 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:01:39.480 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-07T21:01:39.481 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-07T21:01:39.481 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-07T21:01:39.481 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:41.023 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:19.0.0-38.ge93c2b5c.el9.x86_64 33/36 2023-12-07T21:01:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:19.0.0-38.ge93c2b5c.el9.x86_64 33/36 2023-12-07T21:01:41.053 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:01:41.053 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-07T21:01:41.053 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-07T21:01:41.053 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-07T21:01:41.053 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:41.499 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:19.0.0-38.ge93c2b5c.el9.x86_64 34/36 2023-12-07T21:01:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:19.0.0-38.ge93c2b5c.el9.x86_64 34/36 2023-12-07T21:01:41.523 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:01:41.523 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-07T21:01:41.523 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-07T21:01:41.523 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-07T21:01:41.523 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:19.0.0-38.ge93c2b5c.el9.x86_64 35/36 2023-12-07T21:01:41.756 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:19.0.0-38.ge93c2b5c.el9.x86_64 35/36 2023-12-07T21:01:41.757 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:01:41.757 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-07T21:01:41.757 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-07T21:01:41.757 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-07T21:01:41.757 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:41.822 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:19.0.0-38.ge93c2b5c.el9.x86_64 36/36 2023-12-07T21:01:43.626 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-2:19.0.0-38.ge93c2b5c.el9.x86_64 36/36 2023-12-07T21:01:43.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/36 2023-12-07T21:01:43.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:19.0.0-38.ge93c2b5c.el9.x86_64 2/36 2023-12-07T21:01:43.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:19.0.0-38.ge93c2b5c.el9.x86_64 3/36 2023-12-07T21:01:43.626 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:19.0.0-38.ge93c2b5c.el9.x86_64 4/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-38.ge93c2b5c.el9.no 6/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 17/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2023-12-07T21:01:43.627 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2023-12-07T21:01:43.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2023-12-07T21:01:43.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2023-12-07T21:01:43.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2023-12-07T21:01:43.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2023-12-07T21:01:43.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2023-12-07T21:01:43.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2023-12-07T21:01:43.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2023-12-07T21:01:43.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2023-12-07T21:01:43.628 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2023-12-07T21:01:43.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2023-12-07T21:01:43.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2023-12-07T21:01:43.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2023-12-07T21:01:43.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2023-12-07T21:01:43.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2023-12-07T21:01:43.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2023-12-07T21:01:43.629 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2023-12-07T21:01:44.252 INFO:teuthology.orchestra.run.smithi121.stdout:(6/6): ceph-test-19.0.0-38.ge93c2b5c.el9.x86_64 3.0 MB/s | 41 MB 00:13 2023-12-07T21:01:44.255 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:01:44.255 INFO:teuthology.orchestra.run.smithi121.stdout:Total 3.1 MB/s | 42 MB 00:13 2023-12-07T21:01:44.255 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:01:44.275 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:01:44.275 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:01:44.619 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:01:44.619 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:01:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2023-12-07T21:01:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:44.726 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:01:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:01:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: lua-5.4.4-4.el9.x86_64 2023-12-07T21:01:44.726 INFO:teuthology.orchestra.run.smithi089.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-07T21:01:44.727 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-07T21:01:44.728 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:44.729 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:01:45.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-base 2023-12-07T21:01:45.142 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:01:45.282 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-12-07T21:01:45.312 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-12-07T21:01:45.335 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-12-07T21:01:45.378 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2023-12-07T21:01:45.405 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/6 2023-12-07T21:01:45.670 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:53 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:01:45.762 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-base-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:01:45.812 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:01:45.813 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-12-07T21:01:45.813 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:01:45.882 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install cephadm 2023-12-07T21:01:46.462 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:54 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:01:46.605 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:01:46.605 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 801 k 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 801 k 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 817 k 2023-12-07T21:01:46.606 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:01:46.883 INFO:teuthology.orchestra.run.smithi089.stdout:cephadm-19.0.0-38.ge93c2b5c.el9.noarch.rpm 2.8 MB/s | 801 kB 00:00 2023-12-07T21:01:46.884 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:01:46.884 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.8 MB/s | 801 kB 00:00 2023-12-07T21:01:46.884 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:01:46.890 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:01:46.890 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:01:46.895 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:01:46.896 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:01:46.968 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:01:47.435 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:01:47.547 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:01:47.928 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:01:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:01:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:48.212 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:01:48.212 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:01:48.213 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:48.213 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:01:48.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-immutable-object-cache 2023-12-07T21:01:48.981 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:56 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:01:49.129 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:01:49.130 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:49.130 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2023-12-07T21:01:49.130 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:49.130 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:01:49.130 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 141 k 2023-12-07T21:01:49.130 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:49.130 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:01:49.131 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:49.131 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-12-07T21:01:49.131 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:49.131 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 141 k 2023-12-07T21:01:49.131 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 395 k 2023-12-07T21:01:49.131 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:01:49.255 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/6 2023-12-07T21:01:49.328 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:19.0.0-38.ge93c2b5c.el9.x86_64 6/6 2023-12-07T21:01:49.350 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-immutable-object-cache-19.0.0-38.ge93c2b5c 646 kB/s | 141 kB 00:00 2023-12-07T21:01:49.351 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:01:49.351 INFO:teuthology.orchestra.run.smithi089.stdout:Total 641 kB/s | 141 kB 00:00 2023-12-07T21:01:49.351 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:01:49.358 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:01:49.358 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:01:49.410 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:01:49.410 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:01:49.547 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:01:49.609 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-38.ge93c2b5c.el 1/1 2023-12-07T21:01:49.632 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-38.ge93c2b5c.el 1/1 2023-12-07T21:01:49.633 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:01:49.633 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-07T21:01:49.633 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:50.596 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-38.ge93c2b5c.el 1/1 2023-12-07T21:01:50.596 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:01:50.596 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:01:50.596 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:50.596 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:01:50.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr 2023-12-07T21:01:51.396 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-test-2:19.0.0-38.ge93c2b5c.el9.x86_64 6/6 2023-12-07T21:01:51.396 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/6 2023-12-07T21:01:51.396 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:19.0.0-38.ge93c2b5c.el9.x86_64 2/6 2023-12-07T21:01:51.396 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2023-12-07T21:01:51.397 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2023-12-07T21:01:51.397 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2023-12-07T21:01:51.416 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:59 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:01:51.509 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-mgr-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:01:51.558 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:01:51.559 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-12-07T21:01:51.559 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:01:51.629 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-dashboard 2023-12-07T21:01:51.762 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2023-12-07T21:01:51.763 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:51.763 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:01:51.763 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:19.0.0-38.ge93c2b5c.el9.x86_64 jq-1.6-16.el9.x86_64 2023-12-07T21:01:51.763 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:19.0.0-38.ge93c2b5c.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2023-12-07T21:01:51.763 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2023-12-07T21:01:51.763 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:51.763 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:01:52.064 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph 2023-12-07T21:01:52.205 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:00 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:01:52.348 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:01:52.350 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:52.350 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-07T21:01:52.351 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:52.351 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:01:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 1.8 M 2023-12-07T21:01:52.351 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-12-07T21:01:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 28 k 2023-12-07T21:01:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 15 k 2023-12-07T21:01:52.351 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-07T21:01:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-07T21:01:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-07T21:01:52.352 INFO:teuthology.orchestra.run.smithi089.stdout:Installing weak dependencies: 2023-12-07T21:01:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-07T21:01:52.352 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:52.352 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:01:52.352 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:01:52.352 INFO:teuthology.orchestra.run.smithi089.stdout:Install 7 Packages 2023-12-07T21:01:52.353 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:52.353 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 2.1 M 2023-12-07T21:01:52.353 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 8.7 M 2023-12-07T21:01:52.353 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:01:52.648 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:00:51 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:01:52.797 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:01:52.799 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 6.5 k 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 2.1 M 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 1.5 M 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 243 k 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 4.4 M 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 18 M 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-07T21:01:52.800 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-07T21:01:52.801 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-07T21:01:52.802 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:52.803 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:01:52.803 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2023-12-07T21:01:52.803 INFO:teuthology.orchestra.run.smithi121.stdout:Install 36 Packages 2023-12-07T21:01:52.803 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:01:52.803 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 30 M 2023-12-07T21:01:52.803 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 111 M 2023-12-07T21:01:52.803 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:01:52.947 INFO:teuthology.orchestra.run.smithi089.stdout:(1/7): ceph-prometheus-alerts-19.0.0-38.ge93c2b 60 kB/s | 15 kB 00:00 2023-12-07T21:01:52.981 INFO:teuthology.orchestra.run.smithi089.stdout:(2/7): ceph-grafana-dashboards-19.0.0-38.ge93c2 98 kB/s | 28 kB 00:00 2023-12-07T21:01:53.039 INFO:teuthology.orchestra.run.smithi089.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 99 kB/s | 9.0 kB 00:00 2023-12-07T21:01:53.064 INFO:teuthology.orchestra.run.smithi089.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 490 kB/s | 41 kB 00:00 2023-12-07T21:01:53.106 INFO:teuthology.orchestra.run.smithi089.stdout:(5/7): ceph-mgr-dashboard-19.0.0-38.ge93c2b5c.e 4.3 MB/s | 1.8 MB 00:00 2023-12-07T21:01:53.131 INFO:teuthology.orchestra.run.smithi089.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 333 kB/s | 31 kB 00:00 2023-12-07T21:01:53.157 INFO:teuthology.orchestra.run.smithi089.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.0 MB/s | 188 kB 00:00 2023-12-07T21:01:53.159 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:01:53.159 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.6 MB/s | 2.1 MB 00:00 2023-12-07T21:01:53.159 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:01:53.169 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:01:53.169 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:01:53.172 INFO:teuthology.orchestra.run.smithi121.stdout:(1/36): ceph-19.0.0-38.ge93c2b5c.el9.x86_64.rpm 38 kB/s | 6.5 kB 00:00 2023-12-07T21:01:53.234 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:01:53.234 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:01:53.415 INFO:teuthology.orchestra.run.smithi121.stdout:(2/36): ceph-mds-19.0.0-38.ge93c2b5c.el9.x86_64 5.1 MB/s | 2.1 MB 00:00 2023-12-07T21:01:53.527 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:01:53.608 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-07T21:01:53.642 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-07T21:01:53.688 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-07T21:01:53.721 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-07T21:01:53.752 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-38.ge93c2b5c.el9.noa 5/7 2023-12-07T21:01:53.822 INFO:teuthology.orchestra.run.smithi121.stdout:(3/36): ceph-mon-19.0.0-38.ge93c2b5c.el9.x86_64 6.7 MB/s | 4.4 MB 00:00 2023-12-07T21:01:53.865 INFO:teuthology.orchestra.run.smithi121.stdout:(4/36): ceph-mgr-19.0.0-38.ge93c2b5c.el9.x86_64 1.7 MB/s | 1.5 MB 00:00 2023-12-07T21:01:53.890 INFO:teuthology.orchestra.run.smithi121.stdout:(5/36): ceph-mgr-modules-core-19.0.0-38.ge93c2b 3.6 MB/s | 243 kB 00:00 2023-12-07T21:01:53.988 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-38.ge93c2b5c.el9.no 6/7 2023-12-07T21:01:54.015 INFO:teuthology.orchestra.run.smithi121.stdout:(6/36): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-12-07T21:01:54.019 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-38.ge93c2b5c.el9.noarch 7/7 2023-12-07T21:01:54.040 INFO:teuthology.orchestra.run.smithi121.stdout:(7/36): python3-mako-1.1.4-6.el9.noarch.rpm 960 kB/s | 144 kB 00:00 2023-12-07T21:01:54.065 INFO:teuthology.orchestra.run.smithi121.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 633 kB/s | 32 kB 00:00 2023-12-07T21:01:54.082 INFO:teuthology.orchestra.run.smithi121.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2023-12-07T21:01:54.099 INFO:teuthology.orchestra.run.smithi121.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-12-07T21:01:54.126 INFO:teuthology.orchestra.run.smithi121.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-12-07T21:01:54.183 INFO:teuthology.orchestra.run.smithi121.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 14 MB/s | 1.1 MB 00:00 2023-12-07T21:01:54.213 INFO:teuthology.orchestra.run.smithi121.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-12-07T21:01:54.245 INFO:teuthology.orchestra.run.smithi121.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.0 MB/s | 124 kB 00:00 2023-12-07T21:01:54.271 INFO:teuthology.orchestra.run.smithi121.stdout:(15/36): python3-requests-2.25.1-7.el9.noarch.r 1.9 MB/s | 113 kB 00:00 2023-12-07T21:01:54.287 INFO:teuthology.orchestra.run.smithi121.stdout:(16/36): python3-urllib3-1.26.5-4.el9.noarch.rp 4.4 MB/s | 187 kB 00:00 2023-12-07T21:01:54.455 INFO:teuthology.orchestra.run.smithi121.stdout:(17/36): ceph-osd-19.0.0-38.ge93c2b5c.el9.x86_6 17 MB/s | 18 MB 00:01 2023-12-07T21:01:54.572 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-38.ge93c2b5c.el9.noarch 7/7 2023-12-07T21:01:54.573 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-38.ge93c2b5c.el9.no 1/7 2023-12-07T21:01:54.573 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-38.ge93c2b5c.el9.noarch 2/7 2023-12-07T21:01:54.573 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-38.ge93c2b5c.el9.noa 3/7 2023-12-07T21:01:54.573 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-07T21:01:54.573 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-07T21:01:54.573 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-07T21:01:54.747 INFO:teuthology.orchestra.run.smithi121.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 47 kB/s | 22 kB 00:00 2023-12-07T21:01:54.878 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-07T21:01:54.878 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:54.878 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:01:54.879 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:01:54.879 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:01:54.879 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:01:54.879 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-07T21:01:54.879 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-07T21:01:54.879 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-07T21:01:54.879 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-07T21:01:54.879 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:54.879 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:01:54.913 INFO:teuthology.orchestra.run.smithi121.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 105 kB/s | 43 kB 00:00 2023-12-07T21:01:54.980 INFO:teuthology.orchestra.run.smithi121.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 218 kB/s | 151 kB 00:00 2023-12-07T21:01:55.039 INFO:teuthology.orchestra.run.smithi121.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 588 kB/s | 172 kB 00:00 2023-12-07T21:01:55.117 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-07T21:01:55.173 INFO:teuthology.orchestra.run.smithi121.stdout:(22/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2023-12-07T21:01:55.198 INFO:teuthology.orchestra.run.smithi121.stdout:(23/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 49 kB/s | 11 kB 00:00 2023-12-07T21:01:55.223 INFO:teuthology.orchestra.run.smithi121.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 96 kB/s | 18 kB 00:00 2023-12-07T21:01:55.697 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:03 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:01:55.731 INFO:teuthology.orchestra.run.smithi121.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 41 kB/s | 23 kB 00:00 2023-12-07T21:01:55.757 INFO:teuthology.orchestra.run.smithi121.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 36 kB/s | 19 kB 00:00 2023-12-07T21:01:55.774 INFO:teuthology.orchestra.run.smithi121.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 36 kB/s | 20 kB 00:00 2023-12-07T21:01:55.844 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:01:55.845 INFO:teuthology.orchestra.run.smithi089.stdout:========================================================================================== 2023-12-07T21:01:55.845 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-07T21:01:55.845 INFO:teuthology.orchestra.run.smithi089.stdout:========================================================================================== 2023-12-07T21:01:55.845 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:01:55.845 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 7.4 M 2023-12-07T21:01:55.845 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-12-07T21:01:55.845 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-07T21:01:55.845 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-07T21:01:55.845 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-07T21:01:55.845 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-07T21:01:55.845 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-07T21:01:55.846 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-07T21:01:55.846 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-07T21:01:55.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-07T21:01:55.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-07T21:01:55.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-07T21:01:55.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-07T21:01:55.846 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:55.846 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:01:55.846 INFO:teuthology.orchestra.run.smithi089.stdout:========================================================================================== 2023-12-07T21:01:55.846 INFO:teuthology.orchestra.run.smithi089.stdout:Install 12 Packages 2023-12-07T21:01:55.846 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:01:55.847 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 37 M 2023-12-07T21:01:55.847 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 209 M 2023-12-07T21:01:55.847 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:01:55.899 INFO:teuthology.orchestra.run.smithi121.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 277 kB/s | 46 kB 00:00 2023-12-07T21:01:55.941 INFO:teuthology.orchestra.run.smithi121.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 473 kB/s | 79 kB 00:00 2023-12-07T21:01:55.966 INFO:teuthology.orchestra.run.smithi121.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2023-12-07T21:01:55.991 INFO:teuthology.orchestra.run.smithi121.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 180 kB/s | 16 kB 00:00 2023-12-07T21:01:56.023 INFO:teuthology.orchestra.run.smithi089.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 236 kB/s | 32 kB 00:00 2023-12-07T21:01:56.057 INFO:teuthology.orchestra.run.smithi089.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 534 kB/s | 17 kB 00:00 2023-12-07T21:01:56.058 INFO:teuthology.orchestra.run.smithi121.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 767 kB/s | 90 kB 00:00 2023-12-07T21:01:56.075 INFO:teuthology.orchestra.run.smithi121.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 328 kB/s | 36 kB 00:00 2023-12-07T21:01:56.099 INFO:teuthology.orchestra.run.smithi089.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 847 kB/s | 34 kB 00:00 2023-12-07T21:01:56.117 INFO:teuthology.orchestra.run.smithi121.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2023-12-07T21:01:56.149 INFO:teuthology.orchestra.run.smithi089.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2023-12-07T21:01:56.201 INFO:teuthology.orchestra.run.smithi121.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.9 MB/s | 427 kB 00:00 2023-12-07T21:01:56.217 INFO:teuthology.orchestra.run.smithi121.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 141 kB/s | 20 kB 00:00 2023-12-07T21:01:56.225 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:01:56.225 INFO:teuthology.orchestra.run.smithi121.stdout:Total 8.8 MB/s | 30 MB 00:03 2023-12-07T21:01:56.238 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:01:56.280 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:01:56.280 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:01:56.341 INFO:teuthology.orchestra.run.smithi089.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-12-07T21:01:56.408 INFO:teuthology.orchestra.run.smithi089.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2023-12-07T21:01:56.434 INFO:teuthology.orchestra.run.smithi089.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.3 MB/s | 217 kB 00:00 2023-12-07T21:01:56.609 INFO:teuthology.orchestra.run.smithi089.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2023-12-07T21:01:56.694 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:01:56.695 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:01:56.759 INFO:teuthology.orchestra.run.smithi089.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2023-12-07T21:01:56.784 INFO:teuthology.orchestra.run.smithi089.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2023-12-07T21:01:56.984 INFO:teuthology.orchestra.run.smithi089.stdout:(11/12): ceph-mgr-diskprediction-local-19.0.0-3 6.7 MB/s | 7.4 MB 00:01 2023-12-07T21:01:57.009 INFO:teuthology.orchestra.run.smithi089.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 983 kB/s | 245 kB 00:00 2023-12-07T21:01:57.012 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:01:57.012 INFO:teuthology.orchestra.run.smithi089.stdout:Total 32 MB/s | 37 MB 00:01 2023-12-07T21:01:57.025 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:01:57.047 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:01:57.048 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:01:57.436 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:01:57.436 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:01:58.042 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:01:58.104 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2023-12-07T21:01:58.135 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:01:58.136 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2023-12-07T21:01:58.181 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2023-12-07T21:01:58.212 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-07T21:01:58.239 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-07T21:01:58.251 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2023-12-07T21:01:58.296 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2023-12-07T21:01:58.329 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2023-12-07T21:01:58.331 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-07T21:01:58.368 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-07T21:01:58.421 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2023-12-07T21:01:58.508 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2023-12-07T21:01:58.544 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-07T21:01:58.548 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2023-12-07T21:01:58.583 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-07T21:01:58.620 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2023-12-07T21:01:58.662 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-07T21:01:58.674 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 11/36 2023-12-07T21:01:58.713 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 12/36 2023-12-07T21:01:58.761 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2023-12-07T21:01:58.818 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2023-12-07T21:01:59.001 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2023-12-07T21:01:59.051 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2023-12-07T21:01:59.097 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2023-12-07T21:01:59.133 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2023-12-07T21:01:59.162 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2023-12-07T21:01:59.238 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2023-12-07T21:01:59.273 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2023-12-07T21:01:59.306 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2023-12-07T21:01:59.310 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-07T21:01:59.338 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2023-12-07T21:01:59.373 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2023-12-07T21:01:59.408 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2023-12-07T21:01:59.446 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-07T21:01:59.495 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2023-12-07T21:01:59.530 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2023-12-07T21:01:59.602 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2023-12-07T21:01:59.739 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2023-12-07T21:01:59.855 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2023-12-07T21:02:00.017 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-38.ge93c2b5c.el9.no 31/36 2023-12-07T21:02:00.044 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:19.0.0-38.ge93c2b5c.el9.x86_64 32/36 2023-12-07T21:02:00.069 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:19.0.0-38.ge93c2b5c.el9.x86_64 32/36 2023-12-07T21:02:00.069 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:02:00.070 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-07T21:02:00.070 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-07T21:02:00.070 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-07T21:02:00.070 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:00.654 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-07T21:02:01.603 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:19.0.0-38.ge93c2b5c.el9.x86_64 33/36 2023-12-07T21:02:01.629 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:19.0.0-38.ge93c2b5c.el9.x86_64 33/36 2023-12-07T21:02:01.630 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:02:01.630 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-07T21:02:01.630 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-07T21:02:01.630 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-07T21:02:01.630 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:01.693 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-07T21:02:01.727 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-38.ge93c2b5 12/12 2023-12-07T21:02:02.070 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:19.0.0-38.ge93c2b5c.el9.x86_64 34/36 2023-12-07T21:02:02.093 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:19.0.0-38.ge93c2b5c.el9.x86_64 34/36 2023-12-07T21:02:02.094 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:02:02.094 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-07T21:02:02.094 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-07T21:02:02.094 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-07T21:02:02.094 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:02.296 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:19.0.0-38.ge93c2b5c.el9.x86_64 35/36 2023-12-07T21:02:02.319 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:19.0.0-38.ge93c2b5c.el9.x86_64 35/36 2023-12-07T21:02:02.319 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:02:02.319 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-07T21:02:02.320 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-07T21:02:02.320 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-07T21:02:02.320 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:02.385 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:19.0.0-38.ge93c2b5c.el9.x86_64 36/36 2023-12-07T21:02:04.209 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-2:19.0.0-38.ge93c2b5c.el9.x86_64 36/36 2023-12-07T21:02:04.209 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/36 2023-12-07T21:02:04.209 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:19.0.0-38.ge93c2b5c.el9.x86_64 2/36 2023-12-07T21:02:04.209 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:19.0.0-38.ge93c2b5c.el9.x86_64 3/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:19.0.0-38.ge93c2b5c.el9.x86_64 4/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:19.0.0-38.ge93c2b5c.el9.x86_64 5/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-38.ge93c2b5c.el9.no 6/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 16/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 17/36 2023-12-07T21:02:04.210 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2023-12-07T21:02:04.211 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2023-12-07T21:02:04.212 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2023-12-07T21:02:04.212 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2023-12-07T21:02:04.363 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-38.ge93c2b5 12/12 2023-12-07T21:02:04.363 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-38.ge93c2b5 1/12 2023-12-07T21:02:04.363 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-07T21:02:04.363 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-07T21:02:04.363 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-07T21:02:04.364 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-07T21:02:04.364 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-07T21:02:04.364 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-07T21:02:04.364 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-07T21:02:04.364 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-07T21:02:04.364 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-07T21:02:04.365 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-07T21:02:04.784 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-07T21:02:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:02:04.785 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:02:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:02:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-07T21:02:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-07T21:02:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-07T21:02:04.785 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-07T21:02:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-07T21:02:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-07T21:02:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-07T21:02:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-07T21:02:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-07T21:02:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-07T21:02:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-07T21:02:04.786 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:02:04.786 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:02:05.165 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2023-12-07T21:02:05.165 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:05.165 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:02:05.165 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:02:05.165 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:02:05.165 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:02:05.165 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:02:05.165 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:02:05.165 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:02:05.165 INFO:teuthology.orchestra.run.smithi121.stdout: lua-5.4.4-4.el9.x86_64 2023-12-07T21:02:05.165 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-07T21:02:05.166 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-07T21:02:05.167 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-07T21:02:05.168 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-07T21:02:05.168 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-07T21:02:05.168 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:05.168 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:02:05.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-rook 2023-12-07T21:02:05.507 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-base 2023-12-07T21:02:05.831 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:13 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:02:05.976 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:02:05.977 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2023-12-07T21:02:05.977 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-07T21:02:05.977 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2023-12-07T21:02:05.977 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:02:05.977 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 50 k 2023-12-07T21:02:05.977 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-12-07T21:02:05.977 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:02:05.978 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2023-12-07T21:02:05.979 INFO:teuthology.orchestra.run.smithi089.stdout:Install 13 Packages 2023-12-07T21:02:05.979 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:02:05.979 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 2.0 M 2023-12-07T21:02:05.979 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 26 M 2023-12-07T21:02:05.979 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:02:06.081 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:05 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:02:06.173 INFO:teuthology.orchestra.run.smithi121.stdout:Package ceph-base-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:02:06.222 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:02:06.223 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2023-12-07T21:02:06.223 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:02:06.247 INFO:teuthology.orchestra.run.smithi089.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 242 kB/s | 24 kB 00:00 2023-12-07T21:02:06.290 INFO:teuthology.orchestra.run.smithi089.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 127 kB/s | 18 kB 00:00 2023-12-07T21:02:06.298 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install cephadm 2023-12-07T21:02:06.339 INFO:teuthology.orchestra.run.smithi089.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.5 MB/s | 174 kB 00:00 2023-12-07T21:02:06.366 INFO:teuthology.orchestra.run.smithi089.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-12-07T21:02:06.390 INFO:teuthology.orchestra.run.smithi089.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-12-07T21:02:06.415 INFO:teuthology.orchestra.run.smithi089.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 860 kB/s | 43 kB 00:00 2023-12-07T21:02:06.503 INFO:teuthology.orchestra.run.smithi089.stdout:(7/13): ceph-mgr-rook-19.0.0-38.ge93c2b5c.el9.n 142 kB/s | 50 kB 00:00 2023-12-07T21:02:06.533 INFO:teuthology.orchestra.run.smithi089.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 128 kB/s | 15 kB 00:00 2023-12-07T21:02:06.558 INFO:teuthology.orchestra.run.smithi089.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 192 kB/s | 32 kB 00:00 2023-12-07T21:02:06.683 INFO:teuthology.orchestra.run.smithi089.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 472 kB/s | 59 kB 00:00 2023-12-07T21:02:06.725 INFO:teuthology.orchestra.run.smithi089.stdout:(11/13): python3-google-auth-2.23.4-1.el9.noarc 874 kB/s | 197 kB 00:00 2023-12-07T21:02:06.767 INFO:teuthology.orchestra.run.smithi089.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2023-12-07T21:02:06.817 INFO:teuthology.orchestra.run.smithi089.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.6 MB/s | 1.0 MB 00:00 2023-12-07T21:02:06.819 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:02:06.819 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.4 MB/s | 2.0 MB 00:00 2023-12-07T21:02:06.820 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:02:06.833 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:02:06.833 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:02:06.880 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:05 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:02:06.928 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:02:06.928 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:02:07.023 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:02:07.024 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:02:07.024 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-12-07T21:02:07.024 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:02:07.025 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:02:07.025 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 801 k 2023-12-07T21:02:07.025 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:07.025 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:02:07.025 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:02:07.025 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2023-12-07T21:02:07.025 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:07.025 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 801 k 2023-12-07T21:02:07.025 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 817 k 2023-12-07T21:02:07.025 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:02:07.319 INFO:teuthology.orchestra.run.smithi121.stdout:cephadm-19.0.0-38.ge93c2b5c.el9.noarch.rpm 2.7 MB/s | 801 kB 00:00 2023-12-07T21:02:07.320 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:02:07.320 INFO:teuthology.orchestra.run.smithi121.stdout:Total 2.6 MB/s | 801 kB 00:00 2023-12-07T21:02:07.320 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:02:07.325 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:02:07.325 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:02:07.331 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:02:07.332 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:02:07.408 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:02:07.437 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:02:07.609 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-07T21:02:07.660 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-07T21:02:07.715 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-07T21:02:07.753 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-07T21:02:07.798 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-07T21:02:07.837 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:02:07.887 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-07T21:02:07.932 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:02:07.988 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-07T21:02:08.038 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-07T21:02:08.319 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:02:08.610 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:02:08.610 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:08.610 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:02:08.610 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:02:08.611 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:08.611 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:02:08.755 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-07T21:02:08.802 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-07T21:02:08.832 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-immutable-object-cache 2023-12-07T21:02:08.836 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-07T21:02:08.884 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-07T21:02:08.906 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:19.0.0-38.ge93c2b5c.el9.noarch 13/13 2023-12-07T21:02:09.412 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:08 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:02:09.562 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:02:09.563 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:02:09.563 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repo Size 2023-12-07T21:02:09.563 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:02:09.563 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:02:09.563 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 141 k 2023-12-07T21:02:09.563 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:09.563 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:02:09.563 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:02:09.563 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2023-12-07T21:02:09.563 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:09.564 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 141 k 2023-12-07T21:02:09.564 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 395 k 2023-12-07T21:02:09.564 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:02:09.731 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-38.ge93c2b5c.el9.noarch 13/13 2023-12-07T21:02:09.731 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:19.0.0-38.ge93c2b5c.el9.noarch 1/13 2023-12-07T21:02:09.731 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-07T21:02:09.731 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-07T21:02:09.731 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-07T21:02:09.731 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-07T21:02:09.732 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-07T21:02:09.732 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-07T21:02:09.732 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-07T21:02:09.732 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-07T21:02:09.732 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-07T21:02:09.732 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-07T21:02:09.732 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-07T21:02:10.119 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-07T21:02:10.119 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:02:10.119 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:02:10.120 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:02:10.300 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-immutable-object-cache-19.0.0-38.ge93c2b5c 191 kB/s | 141 kB 00:00 2023-12-07T21:02:10.301 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:02:10.301 INFO:teuthology.orchestra.run.smithi121.stdout:Total 191 kB/s | 141 kB 00:00 2023-12-07T21:02:10.301 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:02:10.309 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:02:10.309 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:02:10.361 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:02:10.362 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:02:10.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-cephadm 2023-12-07T21:02:10.494 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:02:10.551 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-38.ge93c2b5c.el 1/1 2023-12-07T21:02:10.576 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-38.ge93c2b5c.el 1/1 2023-12-07T21:02:10.576 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:02:10.576 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-07T21:02:10.576 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:10.974 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:18 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:02:11.118 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:02:11.119 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2023-12-07T21:02:11.119 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-07T21:02:11.119 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2023-12-07T21:02:11.119 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:02:11.119 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 133 k 2023-12-07T21:02:11.119 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-12-07T21:02:11.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-07T21:02:11.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-07T21:02:11.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-07T21:02:11.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-07T21:02:11.120 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-07T21:02:11.120 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:02:11.120 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:02:11.121 INFO:teuthology.orchestra.run.smithi089.stdout:====================================================================================== 2023-12-07T21:02:11.121 INFO:teuthology.orchestra.run.smithi089.stdout:Install 6 Packages 2023-12-07T21:02:11.121 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:02:11.121 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 6.8 M 2023-12-07T21:02:11.122 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 33 M 2023-12-07T21:02:11.122 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:02:11.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-38.ge93c2b5c.el 1/1 2023-12-07T21:02:11.568 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:11.568 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:02:11.568 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:02:11.568 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:11.568 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:02:11.786 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr 2023-12-07T21:02:12.380 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:11 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:02:12.472 INFO:teuthology.orchestra.run.smithi121.stdout:Package ceph-mgr-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:02:12.521 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:02:12.522 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2023-12-07T21:02:12.522 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:02:12.598 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-dashboard 2023-12-07T21:02:13.169 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:01:12 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:02:13.314 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 1.8 M 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 28 k 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 15 k 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-07T21:02:13.315 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2023-12-07T21:02:13.316 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-07T21:02:13.316 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:13.316 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:02:13.316 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:02:13.316 INFO:teuthology.orchestra.run.smithi121.stdout:Install 7 Packages 2023-12-07T21:02:13.316 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:02:13.316 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 2.1 M 2023-12-07T21:02:13.316 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 8.7 M 2023-12-07T21:02:13.317 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:04:20.936 INFO:teuthology.orchestra.run.smithi089.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 989 kB/s | 228 kB 00:00 2023-12-07T21:04:21.144 INFO:teuthology.orchestra.run.smithi089.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 5.8 MB 00:00 2023-12-07T21:04:21.394 INFO:teuthology.orchestra.run.smithi089.stdout:(3/6): ceph-mgr-cephadm-19.0.0-38.ge93c2b5c.el9 192 kB/s | 133 kB 00:00 2023-12-07T21:04:21.519 INFO:teuthology.orchestra.run.smithi089.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 154 kB/s | 58 kB 00:00 2023-12-07T21:04:21.578 INFO:teuthology.orchestra.run.smithi089.stdout:(5/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 854 kB/s | 548 kB 00:00 2023-12-07T21:04:21.736 INFO:teuthology.orchestra.run.smithi089.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 149 kB/s | 51 kB 00:00 2023-12-07T21:04:21.740 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:04:21.740 INFO:teuthology.orchestra.run.smithi089.stdout:Total 53 kB/s | 6.8 MB 02:10 2023-12-07T21:04:21.741 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:04:21.750 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:04:21.750 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:04:21.839 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:04:21.839 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:04:22.134 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:04:22.289 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-07T21:04:22.346 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-07T21:04:22.850 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-07T21:04:22.923 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-07T21:04:22.993 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-07T21:04:23.017 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 6/6 2023-12-07T21:04:23.831 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 6/6 2023-12-07T21:04:23.831 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 1/6 2023-12-07T21:04:23.831 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-07T21:04:23.831 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-07T21:04:23.831 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-07T21:04:23.831 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-07T21:04:24.145 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-07T21:04:24.145 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:24.145 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:04:24.145 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:04:24.145 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-07T21:04:24.145 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-07T21:04:24.145 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-07T21:04:24.145 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-07T21:04:24.145 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-07T21:04:24.145 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:24.145 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:24.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-fuse 2023-12-07T21:04:24.993 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:32 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:25.139 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 860 k 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout:Install 2 Packages 2023-12-07T21:04:25.140 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:25.141 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 938 k 2023-12-07T21:04:25.141 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 2.7 M 2023-12-07T21:04:25.141 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:04:25.297 INFO:teuthology.orchestra.run.smithi089.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 506 kB/s | 79 kB 00:00 2023-12-07T21:04:25.872 INFO:teuthology.orchestra.run.smithi089.stdout:(2/2): ceph-fuse-19.0.0-38.ge93c2b5c.el9.x86_64 1.1 MB/s | 860 kB 00:00 2023-12-07T21:04:25.873 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:04:25.874 INFO:teuthology.orchestra.run.smithi089.stdout:Total 1.3 MB/s | 938 kB 00:00 2023-12-07T21:04:25.874 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:04:25.896 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:04:25.896 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:04:25.970 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:04:25.971 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:04:26.165 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:04:26.305 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-07T21:04:26.373 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 2/2 2023-12-07T21:04:27.066 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 2/2 2023-12-07T21:04:27.067 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/2 2023-12-07T21:04:27.376 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-07T21:04:27.376 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:27.377 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:04:27.377 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-07T21:04:27.377 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:27.377 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:27.669 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-volume 2023-12-07T21:04:28.258 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:36 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:28.406 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 262 k 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 262 k 2023-12-07T21:04:28.407 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 1.2 M 2023-12-07T21:04:28.408 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:04:29.328 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-volume-19.0.0-38.ge93c2b5c.el9.noarch.rpm 285 kB/s | 262 kB 00:00 2023-12-07T21:04:29.328 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:04:29.329 INFO:teuthology.orchestra.run.smithi089.stdout:Total 284 kB/s | 262 kB 00:00 2023-12-07T21:04:29.329 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:04:29.337 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:04:29.337 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:04:29.374 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:04:29.375 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:04:29.595 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:04:29.663 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:04:29.679 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:04:29.679 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:04:29.679 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-07T21:04:29.679 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:30.649 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:04:30.649 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:30.649 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:04:30.649 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:04:30.649 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:30.649 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:31.008 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados-devel 2023-12-07T21:04:31.606 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:39 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:31.751 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:31.752 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2023-12-07T21:04:31.752 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:31.752 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:04:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 126 k 2023-12-07T21:04:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:31.752 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:04:31.752 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:31.752 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-12-07T21:04:31.752 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:31.753 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 126 k 2023-12-07T21:04:31.753 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 456 k 2023-12-07T21:04:31.753 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:04:32.426 INFO:teuthology.orchestra.run.smithi089.stdout:librados-devel-19.0.0-38.ge93c2b5c.el9.x86_64.r 188 kB/s | 126 kB 00:00 2023-12-07T21:04:32.427 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:04:32.427 INFO:teuthology.orchestra.run.smithi089.stdout:Total 187 kB/s | 126 kB 00:00 2023-12-07T21:04:32.427 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:04:32.432 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:04:32.433 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:04:32.489 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:04:32.489 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:04:32.636 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:04:32.733 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:33.178 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:33.508 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:33.508 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:33.508 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:04:33.508 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:04:33.508 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:33.508 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:33.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs2 2023-12-07T21:04:34.396 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:42 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:34.492 INFO:teuthology.orchestra.run.smithi089.stdout:Package libcephfs2-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:04:34.542 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:34.543 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-12-07T21:04:34.543 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:34.627 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs-devel 2023-12-07T21:04:35.210 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:43 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:35.356 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:35.356 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:35.356 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2023-12-07T21:04:35.356 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:35.356 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:04:35.356 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 31 k 2023-12-07T21:04:35.357 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:35.357 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:04:35.357 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:35.357 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-12-07T21:04:35.357 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:35.357 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 31 k 2023-12-07T21:04:35.357 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 139 k 2023-12-07T21:04:35.357 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:04:35.888 INFO:teuthology.orchestra.run.smithi089.stdout:libcephfs-devel-19.0.0-38.ge93c2b5c.el9.x86_64. 59 kB/s | 31 kB 00:00 2023-12-07T21:04:35.889 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:04:35.889 INFO:teuthology.orchestra.run.smithi089.stdout:Total 58 kB/s | 31 kB 00:00 2023-12-07T21:04:35.889 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:04:35.893 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:04:35.893 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:04:35.912 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:04:35.913 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:04:35.994 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:04:36.110 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:36.508 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:36.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:36.785 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:36.785 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:04:36.786 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:04:36.786 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:36.786 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:37.003 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados2 2023-12-07T21:04:37.578 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:45 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:37.673 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:04:37.724 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:37.725 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-12-07T21:04:37.725 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:37.815 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librbd1 2023-12-07T21:04:38.395 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:46 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:38.488 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:04:38.538 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:38.539 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-12-07T21:04:38.539 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:38.624 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rados 2023-12-07T21:04:39.201 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:47 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:39.296 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rados-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:04:39.346 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:39.347 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-12-07T21:04:39.347 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:39.432 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rgw 2023-12-07T21:04:40.012 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:48 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:40.107 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:04:40.157 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:40.158 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-12-07T21:04:40.158 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:40.244 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-cephfs 2023-12-07T21:04:40.823 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:48 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:40.918 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-cephfs-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:04:40.968 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:40.969 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-12-07T21:04:40.969 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:41.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rbd 2023-12-07T21:04:41.640 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:49 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:41.736 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:04:41.785 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:41.786 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-12-07T21:04:41.786 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:41.872 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-fuse 2023-12-07T21:04:42.456 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:50 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:42.600 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:42.601 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:42.601 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2023-12-07T21:04:42.601 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:42.601 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:04:42.601 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 85 k 2023-12-07T21:04:42.601 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:42.601 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:04:42.601 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:42.601 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-12-07T21:04:42.602 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:42.602 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 85 k 2023-12-07T21:04:42.602 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 231 k 2023-12-07T21:04:42.602 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:04:43.176 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-fuse-19.0.0-38.ge93c2b5c.el9.x86_64.rpm 148 kB/s | 85 kB 00:00 2023-12-07T21:04:43.176 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:04:43.176 INFO:teuthology.orchestra.run.smithi089.stdout:Total 148 kB/s | 85 kB 00:00 2023-12-07T21:04:43.176 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:04:43.183 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:04:43.184 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:04:43.239 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:04:43.239 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:04:43.371 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:04:43.465 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:43.886 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:44.225 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:04:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:04:44.225 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:44.225 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:44.484 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-mirror 2023-12-07T21:04:45.063 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:53 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:45.213 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:45.214 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2023-12-07T21:04:45.214 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:45.214 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:04:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 3.0 M 2023-12-07T21:04:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:45.214 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:04:45.214 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:45.214 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-12-07T21:04:45.214 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:45.215 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 3.0 M 2023-12-07T21:04:45.215 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 12 M 2023-12-07T21:04:45.215 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:04:46.404 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-mirror-19.0.0-38.ge93c2b5c.el9.x86_64.rpm 2.5 MB/s | 3.0 MB 00:01 2023-12-07T21:04:46.404 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:04:46.405 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.5 MB/s | 3.0 MB 00:01 2023-12-07T21:04:46.405 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:04:46.415 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:04:46.415 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:04:46.488 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:04:46.488 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:04:46.904 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:04:46.955 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:46.978 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:46.978 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:04:46.979 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-07T21:04:46.979 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-07T21:04:46.979 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-07T21:04:46.979 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:48.090 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:48.090 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:48.090 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:04:48.090 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:04:48.090 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:48.091 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:48.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-nbd 2023-12-07T21:04:48.952 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:03:56 ago on Thu 07 Dec 2023 09:00:52 PM UTC. 2023-12-07T21:04:49.097 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-12-07T21:04:49.097 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:49.097 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2023-12-07T21:04:49.097 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:49.097 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-12-07T21:04:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 170 k 2023-12-07T21:04:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:49.098 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-12-07T21:04:49.098 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2023-12-07T21:04:49.098 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2023-12-07T21:04:49.098 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:49.098 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 170 k 2023-12-07T21:04:49.098 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 490 k 2023-12-07T21:04:49.098 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-12-07T21:04:49.759 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-nbd-19.0.0-38.ge93c2b5c.el9.x86_64.rpm 257 kB/s | 170 kB 00:00 2023-12-07T21:04:49.760 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:04:49.760 INFO:teuthology.orchestra.run.smithi089.stdout:Total 257 kB/s | 170 kB 00:00 2023-12-07T21:04:49.760 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-12-07T21:04:49.768 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-12-07T21:04:49.768 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-12-07T21:04:49.825 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-12-07T21:04:49.825 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-12-07T21:04:49.980 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-12-07T21:04:50.092 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:50.507 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-nbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:50.804 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:04:50.804 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:50.804 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-12-07T21:04:50.805 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:04:50.805 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:04:50.805 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-12-07T21:04:51.053 DEBUG:teuthology.parallel:result is None 2023-12-07T21:07:05.891 INFO:teuthology.orchestra.run.smithi121.stdout:(1/7): ceph-grafana-dashboards-19.0.0-38.ge93c2 46 kB/s | 28 kB 00:00 2023-12-07T21:07:05.906 INFO:teuthology.orchestra.run.smithi121.stdout:(2/7): ceph-prometheus-alerts-19.0.0-38.ge93c2b 24 kB/s | 15 kB 00:00 2023-12-07T21:07:06.115 INFO:teuthology.orchestra.run.smithi121.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 40 kB/s | 9.0 kB 00:00 2023-12-07T21:07:06.240 INFO:teuthology.orchestra.run.smithi121.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 123 kB/s | 41 kB 00:00 2023-12-07T21:07:06.266 INFO:teuthology.orchestra.run.smithi121.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 204 kB/s | 31 kB 00:00 2023-12-07T21:07:06.474 INFO:teuthology.orchestra.run.smithi121.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 807 kB/s | 188 kB 00:00 2023-12-07T21:07:06.866 INFO:teuthology.orchestra.run.smithi121.stdout:(7/7): ceph-mgr-dashboard-19.0.0-38.ge93c2b5c.e 1.1 MB/s | 1.8 MB 00:01 2023-12-07T21:07:06.870 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:07:06.871 INFO:teuthology.orchestra.run.smithi121.stdout:Total 7.2 kB/s | 2.1 MB 04:53 2023-12-07T21:07:06.871 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:07:06.880 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:07:06.881 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:07:06.953 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:07:06.954 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:07:07.253 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:07:07.309 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-12-07T21:07:07.343 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-12-07T21:07:07.389 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-12-07T21:07:07.422 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-12-07T21:07:07.451 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-38.ge93c2b5c.el9.noa 5/7 2023-12-07T21:07:07.688 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-38.ge93c2b5c.el9.no 6/7 2023-12-07T21:07:07.793 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-38.ge93c2b5c.el9.noarch 7/7 2023-12-07T21:07:08.244 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-38.ge93c2b5c.el9.noarch 7/7 2023-12-07T21:07:08.244 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-38.ge93c2b5c.el9.no 1/7 2023-12-07T21:07:08.245 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-38.ge93c2b5c.el9.noarch 2/7 2023-12-07T21:07:08.245 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-38.ge93c2b5c.el9.noa 3/7 2023-12-07T21:07:08.245 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-12-07T21:07:08.245 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-12-07T21:07:08.245 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-12-07T21:07:08.582 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-12-07T21:07:08.583 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:08.583 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:07:08.583 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:07:08.583 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:07:08.583 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:07:08.583 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-07T21:07:08.583 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-07T21:07:08.583 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-07T21:07:08.583 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-07T21:07:08.583 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:08.583 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:08.805 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-07T21:07:09.388 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:08 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:09.533 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:09.534 INFO:teuthology.orchestra.run.smithi121.stdout:========================================================================================== 2023-12-07T21:07:09.534 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-12-07T21:07:09.534 INFO:teuthology.orchestra.run.smithi121.stdout:========================================================================================== 2023-12-07T21:07:09.534 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:07:09.534 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 7.4 M 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:07:09.535 INFO:teuthology.orchestra.run.smithi121.stdout:========================================================================================== 2023-12-07T21:07:09.536 INFO:teuthology.orchestra.run.smithi121.stdout:Install 12 Packages 2023-12-07T21:07:09.536 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:09.536 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 37 M 2023-12-07T21:07:09.536 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 209 M 2023-12-07T21:07:09.536 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:07:14.223 INFO:teuthology.orchestra.run.smithi121.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 189 kB/s | 32 kB 00:00 2023-12-07T21:07:14.273 INFO:teuthology.orchestra.run.smithi121.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 343 kB/s | 17 kB 00:00 2023-12-07T21:07:14.331 INFO:teuthology.orchestra.run.smithi121.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 596 kB/s | 34 kB 00:00 2023-12-07T21:07:14.465 INFO:teuthology.orchestra.run.smithi121.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.3 MB/s | 3.0 MB 00:00 2023-12-07T21:07:14.932 INFO:teuthology.orchestra.run.smithi121.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 7.9 MB/s | 4.7 MB 00:00 2023-12-07T21:07:15.007 INFO:teuthology.orchestra.run.smithi121.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.8 MB/s | 4.8 MB 00:00 2023-12-07T21:07:15.033 INFO:teuthology.orchestra.run.smithi121.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 217 kB 00:00 2023-12-07T21:07:15.308 INFO:teuthology.orchestra.run.smithi121.stdout:(8/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2023-12-07T21:07:15.642 INFO:teuthology.orchestra.run.smithi121.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2023-12-07T21:07:15.683 INFO:teuthology.orchestra.run.smithi121.stdout:(10/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 523 kB/s | 195 kB 00:00 2023-12-07T21:07:15.925 INFO:teuthology.orchestra.run.smithi121.stdout:(11/12): ceph-mgr-diskprediction-local-19.0.0-3 4.0 MB/s | 7.4 MB 00:01 2023-12-07T21:07:15.950 INFO:teuthology.orchestra.run.smithi121.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 797 kB/s | 245 kB 00:00 2023-12-07T21:07:15.954 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:07:15.954 INFO:teuthology.orchestra.run.smithi121.stdout:Total 5.8 MB/s | 37 MB 00:06 2023-12-07T21:07:15.968 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:07:15.994 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:07:15.994 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:07:16.369 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:07:16.369 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:07:17.062 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:07:17.125 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-12-07T21:07:17.163 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-12-07T21:07:17.255 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-12-07T21:07:17.299 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-12-07T21:07:17.478 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-07T21:07:17.498 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-07T21:07:17.574 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-12-07T21:07:18.234 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-12-07T21:07:18.353 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-12-07T21:07:19.596 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-12-07T21:07:20.635 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-12-07T21:07:20.673 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-38.ge93c2b5 12/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-38.ge93c2b5 12/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-38.ge93c2b5 1/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 10/12 2023-12-07T21:07:23.059 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 11/12 2023-12-07T21:07:23.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2023-12-07T21:07:23.559 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:23.559 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:07:23.559 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:23.560 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:23.931 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-rook 2023-12-07T21:07:24.514 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:23 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:24.658 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:24.659 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2023-12-07T21:07:24.659 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-12-07T21:07:24.659 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2023-12-07T21:07:24.659 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:07:24.659 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 50 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:07:24.660 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2023-12-07T21:07:24.661 INFO:teuthology.orchestra.run.smithi121.stdout:Install 13 Packages 2023-12-07T21:07:24.661 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:24.661 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 2.0 M 2023-12-07T21:07:24.661 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 26 M 2023-12-07T21:07:24.661 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:07:29.998 INFO:teuthology.orchestra.run.smithi121.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 210 kB/s | 24 kB 00:00 2023-12-07T21:07:30.014 INFO:teuthology.orchestra.run.smithi121.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 136 kB/s | 18 kB 00:00 2023-12-07T21:07:30.065 INFO:teuthology.orchestra.run.smithi121.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.5 MB/s | 174 kB 00:00 2023-12-07T21:07:30.090 INFO:teuthology.orchestra.run.smithi121.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-12-07T21:07:30.124 INFO:teuthology.orchestra.run.smithi121.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.5 MB/s | 211 kB 00:00 2023-12-07T21:07:30.149 INFO:teuthology.orchestra.run.smithi121.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 736 kB/s | 43 kB 00:00 2023-12-07T21:07:30.199 INFO:teuthology.orchestra.run.smithi121.stdout:(7/13): ceph-mgr-rook-19.0.0-38.ge93c2b5c.el9.n 158 kB/s | 50 kB 00:00 2023-12-07T21:07:30.224 INFO:teuthology.orchestra.run.smithi121.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 199 kB/s | 15 kB 00:00 2023-12-07T21:07:30.250 INFO:teuthology.orchestra.run.smithi121.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 256 kB/s | 32 kB 00:00 2023-12-07T21:07:30.308 INFO:teuthology.orchestra.run.smithi121.stdout:(10/13): python3-google-auth-2.23.4-1.el9.noarc 1.8 MB/s | 197 kB 00:00 2023-12-07T21:07:30.334 INFO:teuthology.orchestra.run.smithi121.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 707 kB/s | 59 kB 00:00 2023-12-07T21:07:30.359 INFO:teuthology.orchestra.run.smithi121.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2023-12-07T21:07:30.417 INFO:teuthology.orchestra.run.smithi121.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.3 MB/s | 1.0 MB 00:00 2023-12-07T21:07:30.419 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:07:30.419 INFO:teuthology.orchestra.run.smithi121.stdout:Total 363 kB/s | 2.0 MB 00:05 2023-12-07T21:07:30.420 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:07:30.435 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:07:30.435 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:07:30.537 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:07:30.538 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:07:31.058 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:07:31.230 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-12-07T21:07:31.284 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-12-07T21:07:31.342 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-12-07T21:07:31.380 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-12-07T21:07:31.421 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-12-07T21:07:31.512 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-12-07T21:07:31.622 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 7/13 2023-12-07T21:07:31.672 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-12-07T21:07:32.392 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-12-07T21:07:32.444 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-12-07T21:07:32.478 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-12-07T21:07:32.526 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-12-07T21:07:32.548 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:19.0.0-38.ge93c2b5c.el9.noarch 13/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-38.ge93c2b5c.el9.noarch 13/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:19.0.0-38.ge93c2b5c.el9.noarch 1/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 10/13 2023-12-07T21:07:33.351 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-12-07T21:07:33.352 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-12-07T21:07:33.719 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-12-07T21:07:33.719 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:33.719 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:07:33.719 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:33.720 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:33.993 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-mgr-cephadm 2023-12-07T21:07:34.576 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:33 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:34.720 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:34.721 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2023-12-07T21:07:34.721 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-12-07T21:07:34.721 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2023-12-07T21:07:34.721 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:07:34.721 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 133 k 2023-12-07T21:07:34.721 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2023-12-07T21:07:34.721 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-07T21:07:34.721 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-07T21:07:34.722 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-07T21:07:34.722 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-07T21:07:34.722 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-07T21:07:34.722 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:34.722 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:07:34.722 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2023-12-07T21:07:34.722 INFO:teuthology.orchestra.run.smithi121.stdout:Install 6 Packages 2023-12-07T21:07:34.722 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:34.723 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 6.8 M 2023-12-07T21:07:34.723 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 33 M 2023-12-07T21:07:34.723 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:07:41.746 INFO:teuthology.orchestra.run.smithi121.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.3 MB/s | 228 kB 00:00 2023-12-07T21:07:41.887 INFO:teuthology.orchestra.run.smithi121.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-12-07T21:07:42.104 INFO:teuthology.orchestra.run.smithi121.stdout:(3/6): ceph-mgr-cephadm-19.0.0-38.ge93c2b5c.el9 248 kB/s | 133 kB 00:00 2023-12-07T21:07:42.246 INFO:teuthology.orchestra.run.smithi121.stdout:(4/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2023-12-07T21:07:42.271 INFO:teuthology.orchestra.run.smithi121.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 150 kB/s | 58 kB 00:00 2023-12-07T21:07:42.338 INFO:teuthology.orchestra.run.smithi121.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 218 kB/s | 51 kB 00:00 2023-12-07T21:07:42.340 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:07:42.340 INFO:teuthology.orchestra.run.smithi121.stdout:Total 910 kB/s | 6.8 MB 00:07 2023-12-07T21:07:42.341 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:07:42.351 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:07:42.351 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:07:42.443 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:07:42.446 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:07:42.746 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:07:42.913 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-12-07T21:07:42.973 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-12-07T21:07:43.497 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-12-07T21:07:43.584 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-12-07T21:07:43.645 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-12-07T21:07:43.669 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 6/6 2023-12-07T21:07:44.432 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 6/6 2023-12-07T21:07:44.432 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 1/6 2023-12-07T21:07:44.433 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-12-07T21:07:44.433 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-12-07T21:07:44.433 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-12-07T21:07:44.433 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-12-07T21:07:44.768 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-12-07T21:07:44.768 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:44.768 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:07:44.768 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:07:44.768 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-07T21:07:44.768 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-07T21:07:44.768 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-07T21:07:44.768 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-07T21:07:44.768 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-07T21:07:44.768 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:44.768 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:45.024 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-fuse 2023-12-07T21:07:45.609 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:44 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:45.755 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:45.755 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:45.755 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-12-07T21:07:45.755 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:45.755 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:07:45.755 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 860 k 2023-12-07T21:07:45.755 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2023-12-07T21:07:45.755 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-07T21:07:45.755 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:45.756 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:07:45.756 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:45.756 INFO:teuthology.orchestra.run.smithi121.stdout:Install 2 Packages 2023-12-07T21:07:45.756 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:45.756 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 938 k 2023-12-07T21:07:45.756 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 2.7 M 2023-12-07T21:07:45.756 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:07:45.865 INFO:teuthology.orchestra.run.smithi121.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 724 kB/s | 79 kB 00:00 2023-12-07T21:07:46.740 INFO:teuthology.orchestra.run.smithi121.stdout:(2/2): ceph-fuse-19.0.0-38.ge93c2b5c.el9.x86_64 874 kB/s | 860 kB 00:00 2023-12-07T21:07:46.742 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:07:46.742 INFO:teuthology.orchestra.run.smithi121.stdout:Total 951 kB/s | 938 kB 00:00 2023-12-07T21:07:46.742 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:07:46.765 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:07:46.765 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:07:46.844 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:07:46.844 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:07:47.037 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:07:47.164 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-12-07T21:07:47.249 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 2/2 2023-12-07T21:07:47.973 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 2/2 2023-12-07T21:07:47.973 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/2 2023-12-07T21:07:48.289 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-12-07T21:07:48.289 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:48.289 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:07:48.289 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-12-07T21:07:48.289 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:48.289 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:48.565 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-volume 2023-12-07T21:07:49.156 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:48 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:49.301 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:49.301 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:49.301 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2023-12-07T21:07:49.301 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:49.301 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:07:49.302 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:19.0.0-38.ge93c2b5c.el9 ceph-noarch 262 k 2023-12-07T21:07:49.302 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:49.302 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:07:49.302 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:49.302 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2023-12-07T21:07:49.302 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:49.303 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 262 k 2023-12-07T21:07:49.303 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 1.2 M 2023-12-07T21:07:49.303 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:07:49.679 INFO:teuthology.orchestra.run.smithi121.stdout:ceph-volume-19.0.0-38.ge93c2b5c.el9.noarch.rpm 698 kB/s | 262 kB 00:00 2023-12-07T21:07:49.679 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:07:49.680 INFO:teuthology.orchestra.run.smithi121.stdout:Total 695 kB/s | 262 kB 00:00 2023-12-07T21:07:49.680 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:07:49.688 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:07:49.688 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:07:49.720 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:07:49.720 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:07:49.934 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:07:50.006 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:07:50.021 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:07:50.021 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:07:50.021 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-07T21:07:50.021 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:51.056 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:19.0.0-38.ge93c2b5c.el9.noarch 1/1 2023-12-07T21:07:51.056 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:51.056 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:07:51.056 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:19.0.0-38.ge93c2b5c.el9.noarch 2023-12-07T21:07:51.056 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:51.056 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:51.359 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install librados-devel 2023-12-07T21:07:51.947 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:50 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:52.092 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:52.093 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:52.093 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repo Size 2023-12-07T21:07:52.093 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:52.093 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:07:52.093 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 126 k 2023-12-07T21:07:52.093 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:52.093 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:07:52.093 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:52.093 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2023-12-07T21:07:52.093 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:52.093 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 126 k 2023-12-07T21:07:52.094 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 456 k 2023-12-07T21:07:52.094 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:07:52.301 INFO:teuthology.orchestra.run.smithi121.stdout:librados-devel-19.0.0-38.ge93c2b5c.el9.x86_64.r 611 kB/s | 126 kB 00:00 2023-12-07T21:07:52.302 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:07:52.302 INFO:teuthology.orchestra.run.smithi121.stdout:Total 608 kB/s | 126 kB 00:00 2023-12-07T21:07:52.302 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:07:52.307 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:07:52.307 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:07:52.362 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:07:52.362 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:07:52.504 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:07:52.607 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:07:53.086 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:07:53.397 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:07:53.397 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:53.397 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:07:53.397 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:07:53.397 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:53.398 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:53.610 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install libcephfs2 2023-12-07T21:07:54.202 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:53 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:54.300 INFO:teuthology.orchestra.run.smithi121.stdout:Package libcephfs2-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:07:54.351 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:54.352 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2023-12-07T21:07:54.352 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:54.424 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install libcephfs-devel 2023-12-07T21:07:55.017 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:54 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:55.161 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:55.162 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:55.162 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repo Size 2023-12-07T21:07:55.162 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:55.162 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:07:55.162 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 31 k 2023-12-07T21:07:55.162 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:55.162 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:07:55.162 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:07:55.162 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2023-12-07T21:07:55.162 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:55.163 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 31 k 2023-12-07T21:07:55.163 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 139 k 2023-12-07T21:07:55.163 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:07:55.405 INFO:teuthology.orchestra.run.smithi121.stdout:libcephfs-devel-19.0.0-38.ge93c2b5c.el9.x86_64. 129 kB/s | 31 kB 00:00 2023-12-07T21:07:55.405 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:07:55.406 INFO:teuthology.orchestra.run.smithi121.stdout:Total 128 kB/s | 31 kB 00:00 2023-12-07T21:07:55.406 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:07:55.409 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:07:55.409 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:07:55.434 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:07:55.434 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:07:55.522 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:07:55.628 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:07:56.035 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:07:56.306 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:07:56.306 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:56.306 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:07:56.306 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:07:56.307 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:07:56.307 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:56.472 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install librados2 2023-12-07T21:07:57.042 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:56 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:57.136 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:07:57.186 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:57.187 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2023-12-07T21:07:57.187 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:57.257 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install librbd1 2023-12-07T21:07:57.830 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:56 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:57.924 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:07:57.974 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:57.976 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2023-12-07T21:07:57.976 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:58.052 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-rados 2023-12-07T21:07:58.631 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:57 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:58.726 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-rados-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:07:58.777 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:58.778 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2023-12-07T21:07:58.778 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:58.853 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-rgw 2023-12-07T21:07:59.433 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:58 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:07:59.527 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-rgw-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:07:59.578 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:07:59.579 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2023-12-07T21:07:59.579 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:07:59.648 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-cephfs 2023-12-07T21:08:00.232 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:06:59 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:08:00.328 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-cephfs-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:08:00.377 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:08:00.378 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2023-12-07T21:08:00.378 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:08:00.449 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install python3-rbd 2023-12-07T21:08:01.029 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:07:00 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:08:01.124 INFO:teuthology.orchestra.run.smithi121.stdout:Package python3-rbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 is already installed. 2023-12-07T21:08:01.175 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:08:01.176 INFO:teuthology.orchestra.run.smithi121.stdout:Nothing to do. 2023-12-07T21:08:01.176 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:08:01.248 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install rbd-fuse 2023-12-07T21:08:01.828 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:07:00 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:08:01.973 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:08:01.973 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:08:01.973 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2023-12-07T21:08:01.973 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:08:01.973 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:08:01.973 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 85 k 2023-12-07T21:08:01.974 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:01.974 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:08:01.974 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:08:01.974 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2023-12-07T21:08:01.974 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:01.974 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 85 k 2023-12-07T21:08:01.974 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 231 k 2023-12-07T21:08:01.974 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:08:02.482 INFO:teuthology.orchestra.run.smithi121.stdout:rbd-fuse-19.0.0-38.ge93c2b5c.el9.x86_64.rpm 168 kB/s | 85 kB 00:00 2023-12-07T21:08:02.483 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:08:02.483 INFO:teuthology.orchestra.run.smithi121.stdout:Total 167 kB/s | 85 kB 00:00 2023-12-07T21:08:02.483 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:08:02.490 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:08:02.490 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:08:02.545 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:08:02.546 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:08:02.683 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:08:02.800 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:08:03.196 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:08:03.505 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:08:03.505 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:03.505 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:08:03.505 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:08:03.505 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:03.505 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:08:03.732 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install rbd-mirror 2023-12-07T21:08:04.311 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:07:03 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:08:04.462 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:08:04.463 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:08:04.463 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2023-12-07T21:08:04.463 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:08:04.463 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:08:04.463 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 3.0 M 2023-12-07T21:08:04.463 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:04.463 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:08:04.463 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:08:04.463 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2023-12-07T21:08:04.463 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:04.464 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 3.0 M 2023-12-07T21:08:04.464 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 12 M 2023-12-07T21:08:04.464 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:08:05.602 INFO:teuthology.orchestra.run.smithi121.stdout:rbd-mirror-19.0.0-38.ge93c2b5c.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2023-12-07T21:08:05.603 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:08:05.603 INFO:teuthology.orchestra.run.smithi121.stdout:Total 2.6 MB/s | 3.0 MB 00:01 2023-12-07T21:08:05.603 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:08:05.612 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:08:05.612 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:08:05.685 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:08:05.685 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:08:06.117 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:08:06.178 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:08:06.202 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:08:06.202 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-07T21:08:06.202 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-07T21:08:06.202 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-07T21:08:06.202 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-07T21:08:06.203 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:07.310 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:08:07.311 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:07.311 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:08:07.311 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:08:07.311 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:07.311 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:08:07.529 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install rbd-nbd 2023-12-07T21:08:08.126 INFO:teuthology.orchestra.run.smithi121.stdout:Last metadata expiration check: 0:07:07 ago on Thu 07 Dec 2023 09:01:01 PM UTC. 2023-12-07T21:08:08.270 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2023-12-07T21:08:08.270 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:08:08.270 INFO:teuthology.orchestra.run.smithi121.stdout: Package Architecture Version Repository Size 2023-12-07T21:08:08.270 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:08:08.270 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2023-12-07T21:08:08.270 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:19.0.0-38.ge93c2b5c.el9 ceph 170 k 2023-12-07T21:08:08.271 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:08.271 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2023-12-07T21:08:08.271 INFO:teuthology.orchestra.run.smithi121.stdout:================================================================================ 2023-12-07T21:08:08.271 INFO:teuthology.orchestra.run.smithi121.stdout:Install 1 Package 2023-12-07T21:08:08.271 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:08.271 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 170 k 2023-12-07T21:08:08.271 INFO:teuthology.orchestra.run.smithi121.stdout:Installed size: 490 k 2023-12-07T21:08:08.271 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2023-12-07T21:08:08.539 INFO:teuthology.orchestra.run.smithi121.stdout:rbd-nbd-19.0.0-38.ge93c2b5c.el9.x86_64.rpm 637 kB/s | 170 kB 00:00 2023-12-07T21:08:08.539 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2023-12-07T21:08:08.539 INFO:teuthology.orchestra.run.smithi121.stdout:Total 634 kB/s | 170 kB 00:00 2023-12-07T21:08:08.540 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2023-12-07T21:08:08.547 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2023-12-07T21:08:08.547 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2023-12-07T21:08:08.602 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2023-12-07T21:08:08.602 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2023-12-07T21:08:08.746 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2023-12-07T21:08:08.854 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:08:09.277 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-nbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:08:09.569 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 1/1 2023-12-07T21:08:09.569 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:09.569 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2023-12-07T21:08:09.569 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:19.0.0-38.ge93c2b5c.el9.x86_64 2023-12-07T21:08:09.569 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:09.569 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2023-12-07T21:08:09.773 DEBUG:teuthology.parallel:result is None 2023-12-07T21:08:09.774 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0 2023-12-07T21:08:09.913 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-07T21:08:09.937 INFO:teuthology.orchestra.run.smithi089.stdout:19.0.0-38.ge93c2b5c.el9 2023-12-07T21:08:09.937 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-38.ge93c2b5c.el9 2023-12-07T21:08:09.937 INFO:teuthology.task.install:The correct ceph version 19.0.0-38.ge93c2b5c is installed. 2023-12-07T21:08:09.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0 2023-12-07T21:08:10.147 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-07T21:08:10.168 INFO:teuthology.orchestra.run.smithi121.stdout:19.0.0-38.ge93c2b5c.el9 2023-12-07T21:08:10.168 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-38.ge93c2b5c.el9 2023-12-07T21:08:10.168 INFO:teuthology.task.install:The correct ceph version 19.0.0-38.ge93c2b5c is installed. 2023-12-07T21:08:10.168 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-07T21:08:10.169 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:10.169 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-07T21:08:10.201 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:10.201 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-07T21:08:10.235 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-07T21:08:10.236 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:10.236 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-12-07T21:08:10.271 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-07T21:08:10.342 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:10.342 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2023-12-07T21:08:10.368 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-07T21:08:10.445 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-07T21:08:10.445 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:10.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-07T21:08:10.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-07T21:08:10.543 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:10.543 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-07T21:08:10.570 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-07T21:08:10.636 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-07T21:08:10.636 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:10.637 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2023-12-07T21:08:10.663 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-07T21:08:10.729 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:10.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2023-12-07T21:08:10.756 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-07T21:08:10.823 INFO:teuthology.run_tasks:Running task ceph... 2023-12-07T21:08:10.897 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-07T21:08:10.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-12-07T21:08:10.899 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /var/log/ceph 2023-12-07T21:08:10.926 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-07T21:08:10.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-07T21:08:10.966 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-07T21:08:10.993 INFO:tasks.ceph:Creating extra log directories... 2023-12-07T21:08:10.993 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-07T21:08:11.033 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-07T21:08:11.069 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-07T21:08:11.069 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-07T21:08:11.069 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323', 'branch': 'wip-alimasa-multi-pubsub-etag-test', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7482323', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-alimasa-multi-pubsub-etag-test'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-alimasa-multi-pubsub-etag-test', 'sha1': 'e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0'}}, 'owner': 'scheduled_alimasa@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'sha1': 'e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-alimasa-multi-pubsub-etag-test', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0', 'targets': {'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLM2438ztJXfdnTagA2nT29HZR9nBGpJrnYRh2U9uLn0mBlAUk+OofhGilOo4qq4ke7uRXDOCkEo8B3dymSV6aM=', 'smithi121.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIl5farQZmxpaZ6o/if+Dk79iL9fDEl5O2THifirD3722iW1FYBNJQCUdolBA0qWqVJZdCH9zoCIGsDGMaQYNqs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-07_20:37:17', 'tube': 'smithi', 'user': 'alimasa', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-07T21:08:11.070 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-07T21:08:11.100 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-07T21:08:11.115 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-12-07T21:08:11.155 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m0777 -- /var/run/ceph 2023-12-07T21:08:11.181 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:11.181 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2023-12-07T21:08:11.235 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-07T21:08:11.235 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2023-12-07T21:08:11.290 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-07T21:08:11.290 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T21:08:11.290 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-12-07T21:08:11.290 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T21:08:11.290 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T21:08:11.290 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-07 21:04:47.213830452 +0000 2023-12-07T21:08:11.290 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-07 20:59:40.182719472 +0000 2023-12-07T21:08:11.290 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-07 20:59:40.182719472 +0000 2023-12-07T21:08:11.290 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-07 20:59:40.182719472 +0000 2023-12-07T21:08:11.291 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-07T21:08:11.355 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-07T21:08:11.355 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-07T21:08:11.355 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000186352 s, 2.7 MB/s 2023-12-07T21:08:11.356 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-07T21:08:11.410 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2023-12-07T21:08:11.465 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-07T21:08:11.465 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T21:08:11.465 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-12-07T21:08:11.466 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T21:08:11.466 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T21:08:11.466 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-07 21:04:47.213830452 +0000 2023-12-07T21:08:11.466 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-07 20:59:41.214695273 +0000 2023-12-07T21:08:11.466 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-07 20:59:41.214695273 +0000 2023-12-07T21:08:11.466 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-07 20:59:41.214695273 +0000 2023-12-07T21:08:11.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-07T21:08:11.531 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-07T21:08:11.531 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-07T21:08:11.531 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00019621 s, 2.6 MB/s 2023-12-07T21:08:11.532 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-07T21:08:11.587 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2023-12-07T21:08:11.641 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-07T21:08:11.641 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T21:08:11.641 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-12-07T21:08:11.641 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T21:08:11.641 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T21:08:11.641 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-07 21:04:47.213830452 +0000 2023-12-07T21:08:11.641 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-07 20:59:42.209671939 +0000 2023-12-07T21:08:11.641 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-07 20:59:42.209671939 +0000 2023-12-07T21:08:11.641 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-07 20:59:42.209671939 +0000 2023-12-07T21:08:11.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-07T21:08:11.706 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-07T21:08:11.707 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-07T21:08:11.707 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000189967 s, 2.7 MB/s 2023-12-07T21:08:11.708 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-07T21:08:11.763 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2023-12-07T21:08:11.817 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-07T21:08:11.817 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T21:08:11.817 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-12-07T21:08:11.817 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T21:08:11.817 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T21:08:11.817 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-12-07 21:04:47.214830429 +0000 2023-12-07T21:08:11.817 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-12-07 20:59:43.279646845 +0000 2023-12-07T21:08:11.817 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-12-07 20:59:43.279646845 +0000 2023-12-07T21:08:11.817 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2023-12-07 20:59:43.279646845 +0000 2023-12-07T21:08:11.817 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-07T21:08:11.882 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-12-07T21:08:11.882 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-12-07T21:08:11.882 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000179309 s, 2.9 MB/s 2023-12-07T21:08:11.883 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-07T21:08:11.939 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-12-07T21:08:11.939 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:11.939 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2023-12-07T21:08:11.956 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-07T21:08:11.956 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2023-12-07T21:08:12.012 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-07T21:08:12.012 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T21:08:12.012 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-12-07T21:08:12.012 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T21:08:12.012 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T21:08:12.012 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-12-07 21:08:06.439980932 +0000 2023-12-07T21:08:12.012 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-12-07 20:59:41.560961150 +0000 2023-12-07T21:08:12.012 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-12-07 20:59:41.560961150 +0000 2023-12-07T21:08:12.012 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2023-12-07 20:59:41.560961150 +0000 2023-12-07T21:08:12.012 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-07T21:08:12.078 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-12-07T21:08:12.078 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-12-07T21:08:12.078 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000219394 s, 2.3 MB/s 2023-12-07T21:08:12.079 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-07T21:08:12.136 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2023-12-07T21:08:12.191 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-07T21:08:12.191 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T21:08:12.191 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-12-07T21:08:12.191 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T21:08:12.191 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T21:08:12.191 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-12-07 21:08:06.440980919 +0000 2023-12-07T21:08:12.191 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-12-07 20:59:42.875943202 +0000 2023-12-07T21:08:12.191 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-12-07 20:59:42.875943202 +0000 2023-12-07T21:08:12.191 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2023-12-07 20:59:42.875943202 +0000 2023-12-07T21:08:12.191 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-07T21:08:12.256 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-12-07T21:08:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-12-07T21:08:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000161677 s, 3.2 MB/s 2023-12-07T21:08:12.257 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-07T21:08:12.313 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2023-12-07T21:08:12.367 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-07T21:08:12.367 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T21:08:12.367 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-07T21:08:12.367 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T21:08:12.367 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T21:08:12.367 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-12-07 21:08:06.440980919 +0000 2023-12-07T21:08:12.367 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-12-07 20:59:43.751931246 +0000 2023-12-07T21:08:12.367 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-12-07 20:59:43.751931246 +0000 2023-12-07T21:08:12.368 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2023-12-07 20:59:43.751931246 +0000 2023-12-07T21:08:12.368 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-07T21:08:12.433 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-12-07T21:08:12.433 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-12-07T21:08:12.433 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000206758 s, 2.5 MB/s 2023-12-07T21:08:12.434 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-07T21:08:12.490 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2023-12-07T21:08:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-07T21:08:12.544 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T21:08:12.544 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-12-07T21:08:12.544 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T21:08:12.544 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T21:08:12.544 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2023-12-07 21:08:06.440980919 +0000 2023-12-07T21:08:12.545 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2023-12-07 20:59:44.632919222 +0000 2023-12-07T21:08:12.545 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2023-12-07 20:59:44.632919222 +0000 2023-12-07T21:08:12.545 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2023-12-07 20:59:44.632919222 +0000 2023-12-07T21:08:12.545 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-07T21:08:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2023-12-07T21:08:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2023-12-07T21:08:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000201934 s, 2.5 MB/s 2023-12-07T21:08:12.611 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-07T21:08:12.666 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-12-07T21:08:12.667 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2023-12-07T21:08:12.667 INFO:tasks.ceph:Generating config... 2023-12-07T21:08:12.668 INFO:tasks.ceph:[client] debug ms = 1 2023-12-07T21:08:12.668 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2023-12-07T21:08:12.668 INFO:tasks.ceph:[client] debug rgw = 20 2023-12-07T21:08:12.668 INFO:tasks.ceph:[client] setgroup = ceph 2023-12-07T21:08:12.668 INFO:tasks.ceph:[client] setuser = ceph 2023-12-07T21:08:12.668 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-07T21:08:12.668 INFO:tasks.ceph:[osd] debug objclass = 20 2023-12-07T21:08:12.668 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-07T21:08:12.668 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-07T21:08:12.668 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-07T21:08:12.668 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-07T21:08:12.668 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-07T21:08:12.668 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-07T21:08:12.669 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-07T21:08:12.669 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-07T21:08:12.669 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-07T21:08:12.669 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-07T21:08:12.669 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-07T21:08:12.669 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-07T21:08:12.669 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-07T21:08:12.669 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-07T21:08:12.669 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-07T21:08:12.669 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-07T21:08:12.669 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-07T21:08:12.669 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-07T21:08:12.669 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-07T21:08:12.669 INFO:tasks.ceph:Setting up mon.a... 2023-12-07T21:08:12.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-07T21:08:12.735 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.keyring 2023-12-07T21:08:12.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-07T21:08:12.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-07T21:08:12.848 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.89')] 2023-12-07T21:08:12.848 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.89'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2023-12-07T21:08:12.849 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:12.849 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-07T21:08:12.902 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.89 --print /home/ubuntu/cephtest/ceph.monmap 2023-12-07T21:08:12.981 INFO:teuthology.orchestra.run.smithi089.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:08:12.981 INFO:teuthology.orchestra.run.smithi089.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:08:12.981 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-07T21:08:12.982 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: generated fsid 49fe948c-b519-4268-9cf3-54fad381ce79 2023-12-07T21:08:12.982 INFO:teuthology.orchestra.run.smithi089.stdout:setting min_mon_release = pacific 2023-12-07T21:08:12.982 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 0 2023-12-07T21:08:12.982 INFO:teuthology.orchestra.run.smithi089.stdout:fsid 49fe948c-b519-4268-9cf3-54fad381ce79 2023-12-07T21:08:12.982 INFO:teuthology.orchestra.run.smithi089.stdout:last_changed 2023-12-07T21:08:12.988997+0000 2023-12-07T21:08:12.982 INFO:teuthology.orchestra.run.smithi089.stdout:created 2023-12-07T21:08:12.988997+0000 2023-12-07T21:08:12.982 INFO:teuthology.orchestra.run.smithi089.stdout:min_mon_release 16 (pacific) 2023-12-07T21:08:12.982 INFO:teuthology.orchestra.run.smithi089.stdout:election_strategy: 1 2023-12-07T21:08:12.982 INFO:teuthology.orchestra.run.smithi089.stdout:0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.a 2023-12-07T21:08:12.982 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-12-07T21:08:12.983 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-07T21:08:13.037 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 49fe948c-b519-4268-9cf3-54fad381ce79... 2023-12-07T21:08:13.038 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-07T21:08:13.081 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-07T21:08:13.126 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.127 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-07T21:08:13.128 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = 172.21.15.89 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 49fe948c-b519-4268-9cf3-54fad381ce79 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-12-07T21:08:13.129 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug trim objects = true 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-12-07T21:08:13.130 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: debug objclass = 20 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2023-12-07T21:08:13.131 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = bitmap 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-12-07T21:08:13.132 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-12-07T21:08:13.133 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-12-07T21:08:13.134 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: rgw gc obj min wait = 15 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: debug rgw = 20 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: setgroup = ceph 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout: setuser = ceph 2023-12-07T21:08:13.135 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout:[global] 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: chdir = "" 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: auth supported = cephx 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: filestore xattr use omap = true 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: mon clock drift allowed = 1.000 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: osd crush chooseleaf type = 0 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: auth debug = true 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on old message = true 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: ms die on bug = true 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.136 INFO:teuthology.orchestra.run.smithi121.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon pg warn max object skew = 0 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: # disable pg_autoscaler by default for new pools 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default size = 2 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow primary affinity = true 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd allow pg remap = true 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on legacy crush tunables = false 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on crush straw calc version zero = false 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on no sortbitwise = false 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on osd down out interval zero = false 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon warn on too few osds = false 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-07T21:08:13.137 INFO:teuthology.orchestra.run.smithi121.stdout: mon_allow_pool_size_one = true 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: osd default data pool replay window = 5 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: mon allow pool delete = true 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: mon cluster log file level = debug 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: debug asserts on shutdown = true 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: mon health detail to clog = false 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: mon host = 172.21.15.89 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: fsid = 49fe948c-b519-4268-9cf3-54fad381ce79 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.138 INFO:teuthology.orchestra.run.smithi121.stdout:[osd] 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: osd journal size = 100 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub load threshold = 5.0 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: osd scrub max interval = 600 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: osd mclock profile = high_recovery_ops 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: osd recover clone overlap = true 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: osd recovery max chunk = 1048576 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug shutdown = true 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug op order = true 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug verify stray on activate = true 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug trim objects = true 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.139 INFO:teuthology.orchestra.run.smithi121.stdout: osd open classes on start = true 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug pg log writeout = true 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: osd deep scrub update digest min age = 30 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: osd map max advance = 10 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: journal zero on create = true 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: filestore ondisk finisher threads = 3 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: filestore apply finisher threads = 3 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: bdev debug aio = true 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: osd debug misdirected ops = true 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: debug objclass = 20 2023-12-07T21:08:13.140 INFO:teuthology.orchestra.run.smithi121.stdout: bdev async discard = True 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: bdev enable discard = True 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore allocator = bitmap 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore block size = 96636764160 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: bluestore fsck on mount = True 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluefs = 1/20 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: debug bluestore = 1/20 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: debug osd = 20 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: debug rocksdb = 4/10 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd backfillfull_ratio = 0.85 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd full ratio = 0.9 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd nearfull ratio = 0.8 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: osd failsafe full ratio = 0.95 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: osd objectstore = bluestore 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout:[mgr] 2023-12-07T21:08:13.141 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: debug mgr = 20 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: mgr/telemetry/nag = false 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout:[mon] 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: debug mon = 20 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: debug paxos = 20 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: debug auth = 20 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: mon data avail warn = 5 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: mon mgr mkfs grace = 240 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min pgs per osd = 4 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd reporter subtree level = osd 2023-12-07T21:08:13.142 INFO:teuthology.orchestra.run.smithi121.stdout: mon osd prime pg temp = true 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: mon reweight min bytes per osd = 10 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: auth mon ticket ttl = 660 # 11m 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: auth service ticket ttl = 240 # 4m 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: # don't complain about insecure global_id in the test suite 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: # 1m isn't quite enough 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: mon_down_mkfs_grace = 2m 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: mon_warn_on_filestore_osds = false 2023-12-07T21:08:13.143 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout:[client] 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout: rgw cache enabled = true 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable ops log = true 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout: rgw enable usage log = true 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout: debug ms = 1 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout: rgw gc obj min wait = 15 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout: debug rgw = 20 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout: setgroup = ceph 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout: setuser = ceph 2023-12-07T21:08:13.144 INFO:teuthology.orchestra.run.smithi121.stdout:[mon.a] 2023-12-07T21:08:13.146 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-07T21:08:13.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-07T21:08:13.241 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-07T21:08:13.242 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:13.242 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-07T21:08:13.256 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:13.256 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-07T21:08:13.311 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T21:08:13.311 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:13.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-07T21:08:13.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-07T21:08:13.390 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:13.390 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-07T21:08:13.444 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi121.front.sepia.ceph.com 2023-12-07T21:08:13.445 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:13.445 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-07T21:08:13.445 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-07T21:08:13.485 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:13.485 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-07T21:08:13.539 INFO:tasks.ceph:Setting up mon nodes... 2023-12-07T21:08:13.539 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-07T21:08:13.540 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-07T21:08:13.643 INFO:teuthology.orchestra.run.smithi121.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-07T21:08:13.645 INFO:tasks.ceph:Setting up mds nodes... 2023-12-07T21:08:13.645 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-07T21:08:13.645 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-07T21:08:13.687 INFO:teuthology.orchestra.run.smithi121.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-07T21:08:13.702 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-07T21:08:13.702 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi121.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2023-12-07T21:08:13.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-07T21:08:13.729 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-12-07T21:08:13.729 INFO:tasks.ceph:role: osd.0 2023-12-07T21:08:13.729 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T21:08:13.729 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-07T21:08:13.803 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T21:08:13.803 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T21:08:13.803 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T21:08:13.803 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-07T21:08:13.803 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T21:08:13.803 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-12-07T21:08:13.803 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T21:08:13.803 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-07T21:08:13.803 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T21:08:13.803 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T21:08:14.320 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-12-07T21:08:14.322 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-12-07T21:08:14.322 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-07T21:08:14.441 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-07T21:08:14.474 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T21:08:14.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:14.574+0000 7fe002c0d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-07T21:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:14.577+0000 7fe002c0d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-07T21:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:14.577+0000 7fe002c0d500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-07T21:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:14.577+0000 7fe002c0d500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-07T21:08:14.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:14.577+0000 7fe002c0d500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-07T21:08:14.578 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:14.584+0000 7fe002c0d500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-07T21:08:17.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-07T21:08:17.451 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-07T21:08:17.482 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-12-07T21:08:17.483 INFO:tasks.ceph:role: osd.1 2023-12-07T21:08:17.483 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com 2023-12-07T21:08:17.483 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-07T21:08:17.560 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T21:08:17.560 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T21:08:17.560 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T21:08:17.560 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-07T21:08:17.560 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T21:08:17.560 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2023-12-07T21:08:17.560 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T21:08:17.560 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-07T21:08:17.560 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T21:08:17.560 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T21:08:18.069 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2023-12-07T21:08:18.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2023-12-07T21:08:18.072 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-12-07T21:08:18.221 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-07T21:08:18.254 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-07T21:08:18.321 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-12-07T21:08:18.321 INFO:tasks.ceph:role: osd.2 2023-12-07T21:08:18.321 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com 2023-12-07T21:08:18.321 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-07T21:08:18.397 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T21:08:18.397 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T21:08:18.397 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T21:08:18.397 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-07T21:08:18.398 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T21:08:18.398 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2023-12-07T21:08:18.398 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T21:08:18.398 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-07T21:08:18.398 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T21:08:18.398 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T21:08:18.848 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2023-12-07T21:08:18.850 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2023-12-07T21:08:18.850 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2023-12-07T21:08:18.940 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-07T21:08:18.971 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-07T21:08:19.037 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-12-07T21:08:19.037 INFO:tasks.ceph:role: osd.3 2023-12-07T21:08:19.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com 2023-12-07T21:08:19.037 DEBUG:teuthology.orchestra.run.smithi121:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-07T21:08:19.111 INFO:teuthology.orchestra.run.smithi121.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T21:08:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T21:08:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T21:08:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-07T21:08:19.111 INFO:teuthology.orchestra.run.smithi121.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T21:08:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: = sunit=0 swidth=0 blks 2023-12-07T21:08:19.111 INFO:teuthology.orchestra.run.smithi121.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T21:08:19.111 INFO:teuthology.orchestra.run.smithi121.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-07T21:08:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T21:08:19.111 INFO:teuthology.orchestra.run.smithi121.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T21:08:19.602 INFO:teuthology.orchestra.run.smithi121.stdout:Discarding blocks...Done. 2023-12-07T21:08:19.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi121.front.sepia.ceph.com -o noatime 2023-12-07T21:08:19.604 DEBUG:teuthology.orchestra.run.smithi121:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2023-12-07T21:08:19.725 DEBUG:teuthology.orchestra.run.smithi121:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-07T21:08:19.756 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T21:08:19.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:19.858+0000 7fc029b82500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-07T21:08:19.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:19.862+0000 7fc029b82500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-07T21:08:19.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:19.862+0000 7fc029b82500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-07T21:08:19.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:19.862+0000 7fc029b82500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-07T21:08:19.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:19.862+0000 7fc029b82500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-07T21:08:19.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:19.868+0000 7fc029b82500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-07T21:08:22.720 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-07T21:08:22.750 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T21:08:22.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:22.847+0000 7f15fc02a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-07T21:08:22.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:22.847+0000 7f15fc02a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-07T21:08:22.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:22.847+0000 7f15fc02a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-07T21:08:22.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:22.847+0000 7f15fc02a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-07T21:08:22.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:22.847+0000 7f15fc02a500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-07T21:08:22.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:22.848+0000 7f15fc02a500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-07T21:08:25.694 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-07T21:08:25.724 DEBUG:teuthology.orchestra.run.smithi121:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T21:08:25.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:25.821+0000 7fc560937500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-07T21:08:25.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:25.821+0000 7fc560937500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-07T21:08:25.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:25.821+0000 7fc560937500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-07T21:08:25.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:25.821+0000 7fc560937500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-07T21:08:25.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:25.821+0000 7fc560937500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-07T21:08:25.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:25.821+0000 7fc560937500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-07T21:08:28.671 DEBUG:teuthology.orchestra.run.smithi121:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-07T21:08:28.702 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-07T21:08:28.702 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:28.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-07T21:08:28.735 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:28.735 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-07T21:08:28.772 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:28.772 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-07T21:08:28.841 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:28.841 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-07T21:08:28.909 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:28.909 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-07T21:08:28.977 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:28.977 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-07T21:08:29.036 INFO:tasks.ceph:Adding keys to all mons... 2023-12-07T21:08:29.036 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-07T21:08:29.066 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2023-12-07T21:08:29.066 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA+NHJlihlUIhAAhGiIEKE0D05lCizW6Q7WLw== 2023-12-07T21:08:29.066 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2023-12-07T21:08:29.066 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA9NHJlsHzFJhAAIeKnNyvmST3n9VasPGajzw== 2023-12-07T21:08:29.066 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2023-12-07T21:08:29.066 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBDNHJlyIRFMxAAPG9X64396AqAqLfMAwM2Aw== 2023-12-07T21:08:29.066 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2023-12-07T21:08:29.066 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBGNHJlgjiRMhAAA6i5W51rmqy3jqMF2a2FMw== 2023-12-07T21:08:29.066 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2023-12-07T21:08:29.067 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBJNHJl3/37MBAAfj7QTmcap4Y9yc7vBRpjAQ== 2023-12-07T21:08:29.067 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-12-07T21:08:29.067 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA9NHJlrd1kKRAAaLPG0wU1GxrDtrexBOM7Lw== 2023-12-07T21:08:29.068 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T21:08:29.166 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-07T21:08:29.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T21:08:29.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T21:08:29.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T21:08:29.374 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T21:08:29.427 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-07T21:08:29.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-07T21:08:29.454 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-07T21:08:29.553 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-07T21:08:29.579 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-07T21:08:29.634 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-07T21:08:29.634 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-07T21:08:29.634 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-07T21:08:29.677 INFO:tasks.ceph.mon.a:Started 2023-12-07T21:08:29.677 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-07T21:08:29.677 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-07T21:08:29.677 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-07T21:08:29.679 INFO:tasks.ceph.mgr.x:Started 2023-12-07T21:08:29.680 INFO:tasks.ceph:Setting crush tunables to default 2023-12-07T21:08:29.680 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd crush tunables default 2023-12-07T21:08:29.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.784+0000 7fb563197640 1 Processor -- start 2023-12-07T21:08:29.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.784+0000 7fb563197640 1 -- start start 2023-12-07T21:08:29.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.785+0000 7fb563197640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb55c12a360 0x7fb55c12a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:29.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.785+0000 7fb563197640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c09bdd0 con 0x7fb55c12ac80 2023-12-07T21:08:29.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.785+0000 7fb563197640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c0990d0 con 0x7fb55c12a360 2023-12-07T21:08:29.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.785+0000 7fb560f33640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb55c12a360 0x7fb55c12a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:29.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.785+0000 7fb55bfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb55c12ac80 0x7fb55c097a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:50986/0 (socket says 172.21.15.89:50986) 2023-12-07T21:08:29.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.785+0000 7fb55bfff640 1 -- 172.21.15.89:0/946696760 learned_addr learned my addr 172.21.15.89:0/946696760 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:29.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.785+0000 7fb560f33640 1 -- 172.21.15.89:0/946696760 >> v2:172.21.15.89:3300/0 conn(0x7fb55c12a360 msgr2=0x7fb55c12a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-07T21:08:29.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.785+0000 7fb560f33640 1 -- 172.21.15.89:0/946696760 >> v2:172.21.15.89:3300/0 conn(0x7fb55c12a360 msgr2=0x7fb55c12a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-07T21:08:29.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.785+0000 7fb560f33640 1 --2- 172.21.15.89:0/946696760 >> v2:172.21.15.89:3300/0 conn(0x7fb55c12a360 0x7fb55c12a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-07T21:08:29.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.785+0000 7fb560f33640 1 --2- 172.21.15.89:0/946696760 >> v2:172.21.15.89:3300/0 conn(0x7fb55c12a360 0x7fb55c12a740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T21:08:29.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.807+0000 7fb55b7fe640 1 -- 172.21.15.89:0/946696760 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330635799 0 0) 0x7fb55c09bdd0 con 0x7fb55c12ac80 2023-12-07T21:08:29.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.807+0000 7fb55b7fe640 1 -- 172.21.15.89:0/946696760 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb54c003520 con 0x7fb55c12ac80 2023-12-07T21:08:29.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.807+0000 7fb55b7fe640 1 -- 172.21.15.89:0/946696760 <== mon.0 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3386455158 0 0) 0x7fb54c003520 con 0x7fb55c12ac80 2023-12-07T21:08:29.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.807+0000 7fb55b7fe640 1 -- 172.21.15.89:0/946696760 >> v2:172.21.15.89:3300/0 conn(0x7fb55c12a360 msgr2=0x7fb55c12a740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-07T21:08:29.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.807+0000 7fb55b7fe640 1 --2- 172.21.15.89:0/946696760 >> v2:172.21.15.89:3300/0 conn(0x7fb55c12a360 0x7fb55c12a740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:29.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.807+0000 7fb55b7fe640 1 -- 172.21.15.89:0/946696760 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c09b850 con 0x7fb55c12ac80 2023-12-07T21:08:29.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.807+0000 7fb55b7fe640 1 -- 172.21.15.89:0/946696760 <== mon.0 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 3875063423 0 0) 0x7fb5480015a0 con 0x7fb55c12ac80 2023-12-07T21:08:29.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.807+0000 7fb55b7fe640 1 -- 172.21.15.89:0/946696760 >> v1:172.21.15.89:6789/0 conn(0x7fb55c12ac80 legacy=0x7fb55c097a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:29.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.808+0000 7fb55b7fe640 1 --2- 172.21.15.89:0/946696760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 0x7fb54c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:29.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.808+0000 7fb55b7fe640 1 -- 172.21.15.89:0/946696760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0990d0 con 0x7fb54c003970 2023-12-07T21:08:29.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.808+0000 7fb560f33640 1 --2- 172.21.15.89:0/946696760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 0x7fb54c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:29.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.808+0000 7fb560f33640 1 -- 172.21.15.89:0/946696760 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c003520 con 0x7fb54c003970 2023-12-07T21:08:29.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.809+0000 7fb560f33640 1 --2- 172.21.15.89:0/946696760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 0x7fb54c003d70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb55000b960 tx=0x7fb54c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b6ef2e2f46f95a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:29.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.809+0000 7fb55b7fe640 1 -- 172.21.15.89:0/946696760 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb55002d5d0 con 0x7fb54c003970 2023-12-07T21:08:29.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.809+0000 7fb55b7fe640 1 -- 172.21.15.89:0/946696760 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55002d730 con 0x7fb54c003970 2023-12-07T21:08:29.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.809+0000 7fb55b7fe640 1 -- 172.21.15.89:0/946696760 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb55002da10 con 0x7fb54c003970 2023-12-07T21:08:29.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.810+0000 7fb563197640 1 -- 172.21.15.89:0/946696760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 msgr2=0x7fb54c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:29.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.810+0000 7fb563197640 1 --2- 172.21.15.89:0/946696760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 0x7fb54c003d70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb55000b960 tx=0x7fb54c0057f0 comp rx=0 tx=0).stop 2023-12-07T21:08:29.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.810+0000 7fb563197640 1 -- 172.21.15.89:0/946696760 shutdown_connections 2023-12-07T21:08:29.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.810+0000 7fb563197640 1 --2- 172.21.15.89:0/946696760 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 0x7fb54c003d70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:29.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.810+0000 7fb563197640 1 --2- 172.21.15.89:0/946696760 >> v2:172.21.15.89:3300/0 conn(0x7fb55c12a360 0x7fb55c12a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:29.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.810+0000 7fb563197640 1 -- 172.21.15.89:0/946696760 >> 172.21.15.89:0/946696760 conn(0x7fb55c09c8b0 msgr2=0x7fb55c09ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:29.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.810+0000 7fb563197640 1 -- 172.21.15.89:0/946696760 shutdown_connections 2023-12-07T21:08:29.805 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.810+0000 7fb563197640 1 -- 172.21.15.89:0/946696760 wait complete. 2023-12-07T21:08:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.811+0000 7fb563197640 1 Processor -- start 2023-12-07T21:08:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.811+0000 7fb563197640 1 -- start start 2023-12-07T21:08:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.811+0000 7fb563197640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 0x7fb55c11d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb563197640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c120b70 con 0x7fb54c003970 2023-12-07T21:08:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb560f33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 0x7fb55c11d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb560f33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 0x7fb55c11d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45566/0 (socket says 172.21.15.89:45566) 2023-12-07T21:08:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb560f33640 1 -- 172.21.15.89:0/1203334192 learned_addr learned my addr 172.21.15.89:0/1203334192 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb560f33640 1 -- 172.21.15.89:0/1203334192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c120840 con 0x7fb54c003970 2023-12-07T21:08:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb560f33640 1 --2- 172.21.15.89:0/1203334192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 0x7fb55c11d5a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb550000c00 tx=0x7fb550004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb5597fa640 1 -- 172.21.15.89:0/1203334192 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb55002eb90 con 0x7fb54c003970 2023-12-07T21:08:29.807 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb5597fa640 1 -- 172.21.15.89:0/1203334192 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55002ecf0 con 0x7fb54c003970 2023-12-07T21:08:29.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb563197640 1 -- 172.21.15.89:0/1203334192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c11ed20 con 0x7fb54c003970 2023-12-07T21:08:29.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb5597fa640 1 -- 172.21.15.89:0/1203334192 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb55003a450 con 0x7fb54c003970 2023-12-07T21:08:29.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb563197640 1 -- 172.21.15.89:0/1203334192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c11fec0 con 0x7fb54c003970 2023-12-07T21:08:29.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb5597fa640 1 -- 172.21.15.89:0/1203334192 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb55003a8b0 con 0x7fb54c003970 2023-12-07T21:08:29.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.812+0000 7fb5597fa640 1 -- 172.21.15.89:0/1203334192 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb55004dbe0 con 0x7fb54c003970 2023-12-07T21:08:29.808 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.813+0000 7fb563197640 1 -- 172.21.15.89:0/1203334192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c120110 con 0x7fb54c003970 2023-12-07T21:08:29.809 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.815+0000 7fb5597fa640 1 -- 172.21.15.89:0/1203334192 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb550035070 con 0x7fb54c003970 2023-12-07T21:08:29.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.878+0000 7fb563197640 1 -- 172.21.15.89:0/1203334192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb55c120630 con 0x7fb54c003970 2023-12-07T21:08:29.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.879+0000 7fb5597fa640 1 -- 172.21.15.89:0/1203334192 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb55000b5e0 con 0x7fb54c003970 2023-12-07T21:08:29.872 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2023-12-07T21:08:29.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.879+0000 7fb563197640 1 -- 172.21.15.89:0/1203334192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 msgr2=0x7fb55c11d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:29.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.879+0000 7fb563197640 1 --2- 172.21.15.89:0/1203334192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 0x7fb55c11d5a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb550000c00 tx=0x7fb550004730 comp rx=0 tx=0).stop 2023-12-07T21:08:29.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.879+0000 7fb563197640 1 -- 172.21.15.89:0/1203334192 shutdown_connections 2023-12-07T21:08:29.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.879+0000 7fb563197640 1 --2- 172.21.15.89:0/1203334192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb54c003970 0x7fb55c11d5a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:29.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.879+0000 7fb563197640 1 -- 172.21.15.89:0/1203334192 >> 172.21.15.89:0/1203334192 conn(0x7fb55c09c8b0 msgr2=0x7fb55c116220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:29.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.879+0000 7fb563197640 1 -- 172.21.15.89:0/1203334192 shutdown_connections 2023-12-07T21:08:29.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:29.879+0000 7fb563197640 1 -- 172.21.15.89:0/1203334192 wait complete. 2023-12-07T21:08:29.883 INFO:tasks.ceph:check_enable_crimson: False 2023-12-07T21:08:29.883 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-07T21:08:29.884 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-12-07T21:08:29.884 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-07T21:08:29.910 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:29.910 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-07T21:08:29.938 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:29.938 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-07T21:08:30.005 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2023-12-07T21:08:30.005 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-07T21:08:30.072 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new c7d49515-b2a2-4323-9af0-d3ba338a0dc8 0 2023-12-07T21:08:30.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.218+0000 7f1beb561640 1 Processor -- start 2023-12-07T21:08:30.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.218+0000 7f1beb561640 1 -- start start 2023-12-07T21:08:30.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.218+0000 7f1beb561640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1be4119c80 0x7f1be411c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:30.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.218+0000 7f1beb561640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be411c5b0 con 0x7f1be4116f20 2023-12-07T21:08:30.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.218+0000 7f1beb561640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be411d750 con 0x7f1be4119c80 2023-12-07T21:08:30.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.218+0000 7f1be8afc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1be4119c80 0x7f1be411c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:30.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.218+0000 7f1be8afc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1be4119c80 0x7f1be411c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55428/0 (socket says 172.21.15.121:55428) 2023-12-07T21:08:30.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.218+0000 7f1be8afc640 1 -- 172.21.15.121:0/1976182380 learned_addr learned my addr 172.21.15.121:0/1976182380 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:30.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.219+0000 7f1be8afc640 1 -- 172.21.15.121:0/1976182380 >> v1:172.21.15.89:6789/0 conn(0x7f1be4116f20 legacy=0x7f1be4117300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.219+0000 7f1bdbfff640 1 -- 172.21.15.121:0/1976182380 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820819154 0 0) 0x7f1be411c5b0 con 0x7f1be4116f20 2023-12-07T21:08:30.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.219+0000 7f1be8afc640 1 -- 172.21.15.121:0/1976182380 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be411d890 con 0x7f1be4119c80 2023-12-07T21:08:30.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.220+0000 7f1be8afc640 1 --2- 172.21.15.121:0/1976182380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be4119c80 0x7f1be411c070 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40097f0 tx=0x7f1bd402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b408e0ee95c2189 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:30.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.220+0000 7f1bdbfff640 1 -- 172.21.15.121:0/1976182380 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd40317a0 con 0x7f1be4119c80 2023-12-07T21:08:30.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.220+0000 7f1bdbfff640 1 -- 172.21.15.121:0/1976182380 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd4031900 con 0x7f1be4119c80 2023-12-07T21:08:30.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.220+0000 7f1bdbfff640 1 -- 172.21.15.121:0/1976182380 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1bd4031bc0 con 0x7f1be4119c80 2023-12-07T21:08:30.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.220+0000 7f1beb561640 1 -- 172.21.15.121:0/1976182380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be4119c80 msgr2=0x7f1be411c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.220+0000 7f1beb561640 1 --2- 172.21.15.121:0/1976182380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be4119c80 0x7f1be411c070 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40097f0 tx=0x7f1bd402b910 comp rx=0 tx=0).stop 2023-12-07T21:08:30.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.220+0000 7f1beb561640 1 -- 172.21.15.121:0/1976182380 shutdown_connections 2023-12-07T21:08:30.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.220+0000 7f1beb561640 1 --2- 172.21.15.121:0/1976182380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be4119c80 0x7f1be411c070 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:30.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.220+0000 7f1beb561640 1 -- 172.21.15.121:0/1976182380 >> 172.21.15.121:0/1976182380 conn(0x7f1be410cdb0 msgr2=0x7f1be410f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:30.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.221+0000 7f1beb561640 1 -- 172.21.15.121:0/1976182380 shutdown_connections 2023-12-07T21:08:30.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.221+0000 7f1beb561640 1 -- 172.21.15.121:0/1976182380 wait complete. 2023-12-07T21:08:30.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.221+0000 7f1beb561640 1 Processor -- start 2023-12-07T21:08:30.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.221+0000 7f1beb561640 1 -- start start 2023-12-07T21:08:30.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.221+0000 7f1beb561640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be4116f20 0x7f1be41ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:30.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.221+0000 7f1beb561640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be41ab920 con 0x7f1be4116f20 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.222+0000 7f1be92fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be4116f20 0x7f1be41ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.222+0000 7f1be92fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be4116f20 0x7f1be41ab350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55430/0 (socket says 172.21.15.121:55430) 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.222+0000 7f1be92fd640 1 -- 172.21.15.121:0/3483149239 learned_addr learned my addr 172.21.15.121:0/3483149239 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.222+0000 7f1be92fd640 1 -- 172.21.15.121:0/3483149239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40094d0 con 0x7f1be4116f20 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.222+0000 7f1be92fd640 1 --2- 172.21.15.121:0/3483149239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be4116f20 0x7f1be41ab350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1be000c3b0 tx=0x7f1be000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.222+0000 7f1bd9ffb640 1 -- 172.21.15.121:0/3483149239 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1be0005410 con 0x7f1be4116f20 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.222+0000 7f1bd9ffb640 1 -- 172.21.15.121:0/3483149239 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be00035f0 con 0x7f1be4116f20 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.222+0000 7f1beb561640 1 -- 172.21.15.121:0/3483149239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be41abb20 con 0x7f1be4116f20 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.222+0000 7f1bd9ffb640 1 -- 172.21.15.121:0/3483149239 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1be0003910 con 0x7f1be4116f20 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.222+0000 7f1beb561640 1 -- 172.21.15.121:0/3483149239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be41a53c0 con 0x7f1be4116f20 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.222+0000 7f1bd9ffb640 1 -- 172.21.15.121:0/3483149239 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1be0012400 con 0x7f1be4116f20 2023-12-07T21:08:30.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.223+0000 7f1bd9ffb640 1 -- 172.21.15.121:0/3483149239 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1be00129f0 con 0x7f1be4116f20 2023-12-07T21:08:30.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.223+0000 7f1beb561640 1 -- 172.21.15.121:0/3483149239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be404f090 con 0x7f1be4116f20 2023-12-07T21:08:30.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.225+0000 7f1bd9ffb640 1 -- 172.21.15.121:0/3483149239 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1be0017070 con 0x7f1be4116f20 2023-12-07T21:08:30.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.296+0000 7f1beb561640 1 -- 172.21.15.121:0/3483149239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c7d49515-b2a2-4323-9af0-d3ba338a0dc8", "id": 0} v 0) v1 -- 0x7f1be4119c80 con 0x7f1be4116f20 2023-12-07T21:08:30.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.298+0000 7f1bd9ffb640 1 -- 172.21.15.121:0/3483149239 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7d49515-b2a2-4323-9af0-d3ba338a0dc8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1be0012c80 con 0x7f1be4116f20 2023-12-07T21:08:30.291 INFO:teuthology.orchestra.run.smithi121.stdout:0 2023-12-07T21:08:30.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.299+0000 7f1beb561640 1 -- 172.21.15.121:0/3483149239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be4116f20 msgr2=0x7f1be41ab350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.299+0000 7f1beb561640 1 --2- 172.21.15.121:0/3483149239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be4116f20 0x7f1be41ab350 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1be000c3b0 tx=0x7f1be000c870 comp rx=0 tx=0).stop 2023-12-07T21:08:30.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.299+0000 7f1beb561640 1 -- 172.21.15.121:0/3483149239 shutdown_connections 2023-12-07T21:08:30.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.299+0000 7f1beb561640 1 --2- 172.21.15.121:0/3483149239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1be4116f20 0x7f1be41ab350 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:30.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.299+0000 7f1beb561640 1 -- 172.21.15.121:0/3483149239 >> 172.21.15.121:0/3483149239 conn(0x7f1be410cdb0 msgr2=0x7f1be411a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:30.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.299+0000 7f1beb561640 1 -- 172.21.15.121:0/3483149239 shutdown_connections 2023-12-07T21:08:30.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.299+0000 7f1beb561640 1 -- 172.21.15.121:0/3483149239 wait complete. 2023-12-07T21:08:30.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new ab1d5fe6-a976-4a30-abd1-a28b2c6de703 1 2023-12-07T21:08:30.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.408+0000 7f0a47978640 1 Processor -- start 2023-12-07T21:08:30.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.408+0000 7f0a47978640 1 -- start start 2023-12-07T21:08:30.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.408+0000 7f0a47978640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0a40116f20 0x7f0a40117300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:30.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.408+0000 7f0a47978640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a401179c0 con 0x7f0a40110e90 2023-12-07T21:08:30.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.408+0000 7f0a47978640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a40111a50 con 0x7f0a40116f20 2023-12-07T21:08:30.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.408+0000 7f0a45714640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0a40116f20 0x7f0a40117300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:30.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.408+0000 7f0a44f13640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0a40110e90 0x7f0a40111340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:56134/0 (socket says 172.21.15.121:56134) 2023-12-07T21:08:30.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.409+0000 7f0a44f13640 1 -- 172.21.15.121:0/2725052362 learned_addr learned my addr 172.21.15.121:0/2725052362 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:08:30.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.409+0000 7f0a45714640 1 -- 172.21.15.121:0/2725052362 >> v1:172.21.15.89:6789/0 conn(0x7f0a40110e90 legacy=0x7f0a40111340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.409+0000 7f0a45714640 1 -- 172.21.15.121:0/2725052362 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40111bc0 con 0x7f0a40116f20 2023-12-07T21:08:30.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.409+0000 7f0a37fff640 1 -- 172.21.15.121:0/2725052362 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568274983 0 0) 0x7f0a401179c0 con 0x7f0a40110e90 2023-12-07T21:08:30.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.410+0000 7f0a45714640 1 --2- 172.21.15.121:0/2725052362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a40116f20 0x7f0a40117300 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009720 tx=0x7f0a3c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05925d938265184 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:30.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.410+0000 7f0a37fff640 1 -- 172.21.15.121:0/2725052362 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c02e070 con 0x7f0a40116f20 2023-12-07T21:08:30.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.410+0000 7f0a37fff640 1 -- 172.21.15.121:0/2725052362 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c0316d0 con 0x7f0a40116f20 2023-12-07T21:08:30.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.410+0000 7f0a37fff640 1 -- 172.21.15.121:0/2725052362 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c031990 con 0x7f0a40116f20 2023-12-07T21:08:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.410+0000 7f0a47978640 1 -- 172.21.15.121:0/2725052362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a40116f20 msgr2=0x7f0a40117300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.410+0000 7f0a47978640 1 --2- 172.21.15.121:0/2725052362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a40116f20 0x7f0a40117300 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009720 tx=0x7f0a3c02b840 comp rx=0 tx=0).stop 2023-12-07T21:08:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.410+0000 7f0a47978640 1 -- 172.21.15.121:0/2725052362 shutdown_connections 2023-12-07T21:08:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.410+0000 7f0a47978640 1 --2- 172.21.15.121:0/2725052362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a40116f20 0x7f0a40117300 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.410+0000 7f0a47978640 1 -- 172.21.15.121:0/2725052362 >> 172.21.15.121:0/2725052362 conn(0x7f0a4010cdb0 msgr2=0x7f0a4010f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.410+0000 7f0a47978640 1 -- 172.21.15.121:0/2725052362 shutdown_connections 2023-12-07T21:08:30.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.410+0000 7f0a47978640 1 -- 172.21.15.121:0/2725052362 wait complete. 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.411+0000 7f0a47978640 1 Processor -- start 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.411+0000 7f0a47978640 1 -- start start 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.411+0000 7f0a47978640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a40110e90 0x7f0a401ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.411+0000 7f0a47978640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a401ab830 con 0x7f0a40110e90 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.411+0000 7f0a45714640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a40110e90 0x7f0a401ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.411+0000 7f0a45714640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a40110e90 0x7f0a401ab260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55442/0 (socket says 172.21.15.121:55442) 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.411+0000 7f0a45714640 1 -- 172.21.15.121:0/1927712688 learned_addr learned my addr 172.21.15.121:0/1927712688 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.412+0000 7f0a45714640 1 -- 172.21.15.121:0/1927712688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c009400 con 0x7f0a40110e90 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.412+0000 7f0a45714640 1 --2- 172.21.15.121:0/1927712688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a40110e90 0x7f0a401ab260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c034040 tx=0x7f0a3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.412+0000 7f0a35ffb640 1 -- 172.21.15.121:0/1927712688 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c032830 con 0x7f0a40110e90 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.412+0000 7f0a35ffb640 1 -- 172.21.15.121:0/1927712688 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c032990 con 0x7f0a40110e90 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.412+0000 7f0a47978640 1 -- 172.21.15.121:0/1927712688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a401ab9d0 con 0x7f0a40110e90 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.412+0000 7f0a35ffb640 1 -- 172.21.15.121:0/1927712688 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c032c50 con 0x7f0a40110e90 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.412+0000 7f0a47978640 1 -- 172.21.15.121:0/1927712688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a401a52d0 con 0x7f0a40110e90 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.412+0000 7f0a35ffb640 1 -- 172.21.15.121:0/1927712688 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0a3c005c90 con 0x7f0a40110e90 2023-12-07T21:08:30.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.413+0000 7f0a35ffb640 1 -- 172.21.15.121:0/1927712688 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0a3c0457a0 con 0x7f0a40110e90 2023-12-07T21:08:30.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.413+0000 7f0a47978640 1 -- 172.21.15.121:0/1927712688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4004f090 con 0x7f0a40110e90 2023-12-07T21:08:30.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.415+0000 7f0a35ffb640 1 -- 172.21.15.121:0/1927712688 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0a3c032e60 con 0x7f0a40110e90 2023-12-07T21:08:30.427 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:30.434+0000 7fd8b1c2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-07T21:08:30.481 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:30.487+0000 7fd8b1c2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-07T21:08:30.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.487+0000 7f0a47978640 1 -- 172.21.15.121:0/1927712688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ab1d5fe6-a976-4a30-abd1-a28b2c6de703", "id": 1} v 0) v1 -- 0x7f0a40116f20 con 0x7f0a40110e90 2023-12-07T21:08:30.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.488+0000 7f0a35ffb640 1 -- 172.21.15.121:0/1927712688 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab1d5fe6-a976-4a30-abd1-a28b2c6de703", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0a3c006900 con 0x7f0a40110e90 2023-12-07T21:08:30.482 INFO:teuthology.orchestra.run.smithi121.stdout:1 2023-12-07T21:08:30.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.489+0000 7f0a47978640 1 -- 172.21.15.121:0/1927712688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a40110e90 msgr2=0x7f0a401ab260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.489+0000 7f0a47978640 1 --2- 172.21.15.121:0/1927712688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a40110e90 0x7f0a401ab260 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c034040 tx=0x7f0a3c0046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:30.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.489+0000 7f0a47978640 1 -- 172.21.15.121:0/1927712688 shutdown_connections 2023-12-07T21:08:30.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.489+0000 7f0a47978640 1 --2- 172.21.15.121:0/1927712688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a40110e90 0x7f0a401ab260 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:30.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.489+0000 7f0a47978640 1 -- 172.21.15.121:0/1927712688 >> 172.21.15.121:0/1927712688 conn(0x7f0a4010cdb0 msgr2=0x7f0a40112c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:30.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.489+0000 7f0a47978640 1 -- 172.21.15.121:0/1927712688 shutdown_connections 2023-12-07T21:08:30.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.489+0000 7f0a47978640 1 -- 172.21.15.121:0/1927712688 wait complete. 2023-12-07T21:08:30.493 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 9426627e-2a0c-4ce2-9f5d-57bb763a881c 2 2023-12-07T21:08:30.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.599+0000 7f9ecc34c640 1 Processor -- start 2023-12-07T21:08:30.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.599+0000 7f9ecc34c640 1 -- start start 2023-12-07T21:08:30.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.599+0000 7f9ecc34c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ec4119c80 0x7f9ec411c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:30.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.599+0000 7f9ecc34c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec411c5b0 con 0x7f9ec4116f20 2023-12-07T21:08:30.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.599+0000 7f9ecc34c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec411d750 con 0x7f9ec4119c80 2023-12-07T21:08:30.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.600+0000 7f9ec98e7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ec4119c80 0x7f9ec411c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:30.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.600+0000 7f9eca0e8640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9ec4116f20 0x7f9ec4117300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:56138/0 (socket says 172.21.15.121:56138) 2023-12-07T21:08:30.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.600+0000 7f9ec98e7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ec4119c80 0x7f9ec411c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55452/0 (socket says 172.21.15.121:55452) 2023-12-07T21:08:30.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.600+0000 7f9eca0e8640 1 -- 172.21.15.121:0/411162774 learned_addr learned my addr 172.21.15.121:0/411162774 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:08:30.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.600+0000 7f9ec98e7640 1 -- 172.21.15.121:0/411162774 >> v1:172.21.15.89:6789/0 conn(0x7f9ec4116f20 legacy=0x7f9ec4117300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.600+0000 7f9ec98e7640 1 -- 172.21.15.121:0/411162774 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec411d890 con 0x7f9ec4119c80 2023-12-07T21:08:30.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.600+0000 7f9ec90e6640 1 -- 172.21.15.121:0/411162774 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438267674 0 0) 0x7f9ec411c5b0 con 0x7f9ec4116f20 2023-12-07T21:08:30.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.601+0000 7f9ec98e7640 1 --2- 172.21.15.121:0/411162774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec4119c80 0x7f9ec411c070 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009720 tx=0x7f9eb802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3652a639ff2f70f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:30.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.601+0000 7f9ec90e6640 1 -- 172.21.15.121:0/411162774 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9eb802e070 con 0x7f9ec4119c80 2023-12-07T21:08:30.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.601+0000 7f9ec90e6640 1 -- 172.21.15.121:0/411162774 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb80316d0 con 0x7f9ec4119c80 2023-12-07T21:08:30.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.601+0000 7f9ec90e6640 1 -- 172.21.15.121:0/411162774 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9eb8031990 con 0x7f9ec4119c80 2023-12-07T21:08:30.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.601+0000 7f9ecc34c640 1 -- 172.21.15.121:0/411162774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec4119c80 msgr2=0x7f9ec411c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.601+0000 7f9ecc34c640 1 --2- 172.21.15.121:0/411162774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec4119c80 0x7f9ec411c070 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8009720 tx=0x7f9eb802b840 comp rx=0 tx=0).stop 2023-12-07T21:08:30.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.601+0000 7f9ecc34c640 1 -- 172.21.15.121:0/411162774 shutdown_connections 2023-12-07T21:08:30.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.601+0000 7f9ecc34c640 1 --2- 172.21.15.121:0/411162774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec4119c80 0x7f9ec411c070 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:30.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.601+0000 7f9ecc34c640 1 -- 172.21.15.121:0/411162774 >> 172.21.15.121:0/411162774 conn(0x7f9ec410cdb0 msgr2=0x7f9ec410f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:30.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.601+0000 7f9ecc34c640 1 -- 172.21.15.121:0/411162774 shutdown_connections 2023-12-07T21:08:30.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.602+0000 7f9ecc34c640 1 -- 172.21.15.121:0/411162774 wait complete. 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.602+0000 7f9ecc34c640 1 Processor -- start 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.602+0000 7f9ecc34c640 1 -- start start 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.602+0000 7f9ecc34c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec4116f20 0x7f9ec41ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.602+0000 7f9ecc34c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41ab920 con 0x7f9ec4116f20 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9eca0e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec4116f20 0x7f9ec41ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9eca0e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec4116f20 0x7f9ec41ab350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55464/0 (socket says 172.21.15.121:55464) 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9eca0e8640 1 -- 172.21.15.121:0/1218199427 learned_addr learned my addr 172.21.15.121:0/1218199427 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9eca0e8640 1 -- 172.21.15.121:0/1218199427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb8009400 con 0x7f9ec4116f20 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9eca0e8640 1 --2- 172.21.15.121:0/1218199427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec4116f20 0x7f9ec41ab350 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000c3e0 tx=0x7f9ec000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9eb6ffd640 1 -- 172.21.15.121:0/1218199427 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ec0007410 con 0x7f9ec4116f20 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9eb6ffd640 1 -- 172.21.15.121:0/1218199427 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec0007590 con 0x7f9ec4116f20 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9eb6ffd640 1 -- 172.21.15.121:0/1218199427 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ec0004950 con 0x7f9ec4116f20 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9ecc34c640 1 -- 172.21.15.121:0/1218199427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec41abb20 con 0x7f9ec4116f20 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9ecc34c640 1 -- 172.21.15.121:0/1218199427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec41a53c0 con 0x7f9ec4116f20 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9eb6ffd640 1 -- 172.21.15.121:0/1218199427 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9ec001d3f0 con 0x7f9ec4116f20 2023-12-07T21:08:30.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.603+0000 7f9eb6ffd640 1 -- 172.21.15.121:0/1218199427 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9ec00137e0 con 0x7f9ec4116f20 2023-12-07T21:08:30.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.604+0000 7f9ecc34c640 1 -- 172.21.15.121:0/1218199427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec404f090 con 0x7f9ec4116f20 2023-12-07T21:08:30.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.607+0000 7f9eb6ffd640 1 -- 172.21.15.121:0/1218199427 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f9ec0013470 con 0x7f9ec4116f20 2023-12-07T21:08:30.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.730+0000 7f9ecc34c640 1 -- 172.21.15.121:0/1218199427 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9426627e-2a0c-4ce2-9f5d-57bb763a881c", "id": 2} v 0) v1 -- 0x7f9ec4119c80 con 0x7f9ec4116f20 2023-12-07T21:08:30.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.732+0000 7f9eb6ffd640 1 -- 172.21.15.121:0/1218199427 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9426627e-2a0c-4ce2-9f5d-57bb763a881c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9ec00139a0 con 0x7f9ec4116f20 2023-12-07T21:08:30.725 INFO:teuthology.orchestra.run.smithi121.stdout:2 2023-12-07T21:08:30.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.732+0000 7f9ecc34c640 1 -- 172.21.15.121:0/1218199427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec4116f20 msgr2=0x7f9ec41ab350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.732+0000 7f9ecc34c640 1 --2- 172.21.15.121:0/1218199427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec4116f20 0x7f9ec41ab350 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000c3e0 tx=0x7f9ec000c8a0 comp rx=0 tx=0).stop 2023-12-07T21:08:30.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.732+0000 7f9ecc34c640 1 -- 172.21.15.121:0/1218199427 shutdown_connections 2023-12-07T21:08:30.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.732+0000 7f9ecc34c640 1 --2- 172.21.15.121:0/1218199427 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec4116f20 0x7f9ec41ab350 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:30.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.732+0000 7f9ecc34c640 1 -- 172.21.15.121:0/1218199427 >> 172.21.15.121:0/1218199427 conn(0x7f9ec410cdb0 msgr2=0x7f9ec411a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:30.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.733+0000 7f9ecc34c640 1 -- 172.21.15.121:0/1218199427 shutdown_connections 2023-12-07T21:08:30.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.733+0000 7f9ecc34c640 1 -- 172.21.15.121:0/1218199427 wait complete. 2023-12-07T21:08:30.736 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph --cluster ceph osd new 02e748fb-1486-4c5c-8d34-7221bdfca701 3 2023-12-07T21:08:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.840+0000 7f83c216c640 1 Processor -- start 2023-12-07T21:08:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.840+0000 7f83c216c640 1 -- start start 2023-12-07T21:08:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.840+0000 7f83c216c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f83bc06e090 0x7f83bc06e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.841+0000 7f83c216c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc06eef0 con 0x7f83bc06e9b0 2023-12-07T21:08:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.841+0000 7f83c216c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc072230 con 0x7f83bc06e090 2023-12-07T21:08:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.841+0000 7f83bb7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f83bc06e090 0x7f83bc06e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.841+0000 7f83bb7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f83bc06e090 0x7f83bc06e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55474/0 (socket says 172.21.15.121:55474) 2023-12-07T21:08:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.841+0000 7f83bb7fe640 1 -- 172.21.15.121:0/816595394 learned_addr learned my addr 172.21.15.121:0/816595394 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.841+0000 7f83bb7fe640 1 -- 172.21.15.121:0/816595394 >> v1:172.21.15.89:6789/0 conn(0x7f83bc06e9b0 legacy=0x7f83bc11f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.841+0000 7f83bb7fe640 1 -- 172.21.15.121:0/816595394 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc121e10 con 0x7f83bc06e090 2023-12-07T21:08:30.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.841+0000 7f83ba7fc640 1 -- 172.21.15.121:0/816595394 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340302161 0 0) 0x7f83bc06eef0 con 0x7f83bc06e9b0 2023-12-07T21:08:30.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.842+0000 7f83bb7fe640 1 --2- 172.21.15.121:0/816595394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc06e090 0x7f83bc06e470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009e50 tx=0x7f83ac02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135a1fe936620b80 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:30.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.842+0000 7f83ba7fc640 1 -- 172.21.15.121:0/816595394 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83ac02c8a0 con 0x7f83bc06e090 2023-12-07T21:08:30.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.842+0000 7f83ba7fc640 1 -- 172.21.15.121:0/816595394 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac02ca00 con 0x7f83bc06e090 2023-12-07T21:08:30.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.842+0000 7f83ba7fc640 1 -- 172.21.15.121:0/816595394 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83ac02ccc0 con 0x7f83bc06e090 2023-12-07T21:08:30.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.842+0000 7f83c216c640 1 -- 172.21.15.121:0/816595394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc06e090 msgr2=0x7f83bc06e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.842+0000 7f83c216c640 1 --2- 172.21.15.121:0/816595394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc06e090 0x7f83bc06e470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009e50 tx=0x7f83ac02bf80 comp rx=0 tx=0).stop 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.843+0000 7f83c216c640 1 -- 172.21.15.121:0/816595394 shutdown_connections 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.843+0000 7f83c216c640 1 --2- 172.21.15.121:0/816595394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc06e090 0x7f83bc06e470 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.843+0000 7f83c216c640 1 -- 172.21.15.121:0/816595394 >> 172.21.15.121:0/816595394 conn(0x7f83bc10cdb0 msgr2=0x7f83bc10f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.843+0000 7f83c216c640 1 -- 172.21.15.121:0/816595394 shutdown_connections 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.843+0000 7f83c216c640 1 -- 172.21.15.121:0/816595394 wait complete. 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.843+0000 7f83c216c640 1 Processor -- start 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.843+0000 7f83c216c640 1 -- start start 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83c216c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc06e090 0x7f83bc1a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83c216c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1a9fc0 con 0x7f83bc06e090 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83bb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc06e090 0x7f83bc1a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83bb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc06e090 0x7f83bc1a9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55476/0 (socket says 172.21.15.121:55476) 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83bb7fe640 1 -- 172.21.15.121:0/66023916 learned_addr learned my addr 172.21.15.121:0/66023916 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:30.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83bb7fe640 1 -- 172.21.15.121:0/66023916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac009b30 con 0x7f83bc06e090 2023-12-07T21:08:30.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83bb7fe640 1 --2- 172.21.15.121:0/66023916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc06e090 0x7f83bc1a9a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000f80 tx=0x7f83ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:30.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83b3fff640 1 -- 172.21.15.121:0/66023916 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83ac007d80 con 0x7f83bc06e090 2023-12-07T21:08:30.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83b3fff640 1 -- 172.21.15.121:0/66023916 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac03e450 con 0x7f83bc06e090 2023-12-07T21:08:30.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83c216c640 1 -- 172.21.15.121:0/66023916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc1aa1c0 con 0x7f83bc06e090 2023-12-07T21:08:30.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83b3fff640 1 -- 172.21.15.121:0/66023916 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83ac03e730 con 0x7f83bc06e090 2023-12-07T21:08:30.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.844+0000 7f83c216c640 1 -- 172.21.15.121:0/66023916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc1ae1a0 con 0x7f83bc06e090 2023-12-07T21:08:30.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.845+0000 7f83b3fff640 1 -- 172.21.15.121:0/66023916 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f83ac03eb90 con 0x7f83bc06e090 2023-12-07T21:08:30.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.845+0000 7f83b3fff640 1 -- 172.21.15.121:0/66023916 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f83ac03ee40 con 0x7f83bc06e090 2023-12-07T21:08:30.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.845+0000 7f83c216c640 1 -- 172.21.15.121:0/66023916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc04f090 con 0x7f83bc06e090 2023-12-07T21:08:30.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.848+0000 7f83b3fff640 1 -- 172.21.15.121:0/66023916 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f83ac066ce0 con 0x7f83bc06e090 2023-12-07T21:08:30.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.920+0000 7f83c216c640 1 -- 172.21.15.121:0/66023916 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "02e748fb-1486-4c5c-8d34-7221bdfca701", "id": 3} v 0) v1 -- 0x7f83bc06e9b0 con 0x7f83bc06e090 2023-12-07T21:08:30.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.921+0000 7f83b3fff640 1 -- 172.21.15.121:0/66023916 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02e748fb-1486-4c5c-8d34-7221bdfca701", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f83ac055030 con 0x7f83bc06e090 2023-12-07T21:08:30.915 INFO:teuthology.orchestra.run.smithi121.stdout:3 2023-12-07T21:08:30.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.922+0000 7f83c216c640 1 -- 172.21.15.121:0/66023916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc06e090 msgr2=0x7f83bc1a9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:30.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.922+0000 7f83c216c640 1 --2- 172.21.15.121:0/66023916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc06e090 0x7f83bc1a9a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000f80 tx=0x7f83ac004a40 comp rx=0 tx=0).stop 2023-12-07T21:08:30.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.922+0000 7f83c216c640 1 -- 172.21.15.121:0/66023916 shutdown_connections 2023-12-07T21:08:30.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.922+0000 7f83c216c640 1 --2- 172.21.15.121:0/66023916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc06e090 0x7f83bc1a9a80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:30.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.922+0000 7f83c216c640 1 -- 172.21.15.121:0/66023916 >> 172.21.15.121:0/66023916 conn(0x7f83bc10cdb0 msgr2=0x7f83bc10dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:30.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.922+0000 7f83c216c640 1 -- 172.21.15.121:0/66023916 shutdown_connections 2023-12-07T21:08:30.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:30.922+0000 7f83c216c640 1 -- 172.21.15.121:0/66023916 wait complete. 2023-12-07T21:08:30.926 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-07T21:08:30.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-07T21:08:30.928 INFO:tasks.ceph.osd.0:Started 2023-12-07T21:08:30.929 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-07T21:08:30.929 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-07T21:08:30.931 INFO:tasks.ceph.osd.1:Started 2023-12-07T21:08:30.931 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-07T21:08:30.931 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-07T21:08:30.932 INFO:tasks.ceph.osd.2:Started 2023-12-07T21:08:30.933 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-07T21:08:30.933 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-07T21:08:30.934 INFO:tasks.ceph.osd.3:Started 2023-12-07T21:08:30.935 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T21:08:31.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.047+0000 7f7ca3c0e640 1 Processor -- start 2023-12-07T21:08:31.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.047+0000 7f7ca3c0e640 1 -- start start 2023-12-07T21:08:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.048+0000 7f7ca3c0e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c9c12cd30 0x7f7c9c12f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.048+0000 7f7ca3c0e640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9c06e240 con 0x7f7c9c070610 2023-12-07T21:08:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.048+0000 7f7ca3c0e640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c070140 con 0x7f7c9c12cd30 2023-12-07T21:08:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.048+0000 7f7ca11a9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c9c12cd30 0x7f7c9c12f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.048+0000 7f7ca19aa640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7c9c070610 0x7f7c9c0709f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:50994/0 (socket says 172.21.15.89:50994) 2023-12-07T21:08:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.048+0000 7f7ca19aa640 1 -- 172.21.15.89:0/2356922025 learned_addr learned my addr 172.21.15.89:0/2356922025 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.048+0000 7f7ca11a9640 1 -- 172.21.15.89:0/2356922025 >> v1:172.21.15.89:6789/0 conn(0x7f7c9c070610 legacy=0x7f7c9c0709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:31.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.048+0000 7f7ca11a9640 1 -- 172.21.15.89:0/2356922025 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c06e9a0 con 0x7f7c9c12cd30 2023-12-07T21:08:31.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.048+0000 7f7ca09a8640 1 -- 172.21.15.89:0/2356922025 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782181453 0 0) 0x7f7c9c06e240 con 0x7f7c9c070610 2023-12-07T21:08:31.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.049+0000 7f7ca11a9640 1 --2- 172.21.15.89:0/2356922025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c9c12cd30 0x7f7c9c12f120 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000bfa0 tx=0x7f7c9002e0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13fade9f26704ed server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:31.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.049+0000 7f7ca09a8640 1 -- 172.21.15.89:0/2356922025 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c9002ed10 con 0x7f7c9c12cd30 2023-12-07T21:08:31.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.049+0000 7f7ca09a8640 1 -- 172.21.15.89:0/2356922025 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c90032070 con 0x7f7c9c12cd30 2023-12-07T21:08:31.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.049+0000 7f7ca09a8640 1 -- 172.21.15.89:0/2356922025 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c90038400 con 0x7f7c9c12cd30 2023-12-07T21:08:31.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.049+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/2356922025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c9c12cd30 msgr2=0x7f7c9c12f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:31.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.049+0000 7f7ca3c0e640 1 --2- 172.21.15.89:0/2356922025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c9c12cd30 0x7f7c9c12f120 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000bfa0 tx=0x7f7c9002e0b0 comp rx=0 tx=0).stop 2023-12-07T21:08:31.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.049+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/2356922025 shutdown_connections 2023-12-07T21:08:31.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.049+0000 7f7ca3c0e640 1 --2- 172.21.15.89:0/2356922025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c9c12cd30 0x7f7c9c12f120 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:31.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.049+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/2356922025 >> 172.21.15.89:0/2356922025 conn(0x7f7c9c0987f0 msgr2=0x7f7c9c098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:31.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.049+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/2356922025 shutdown_connections 2023-12-07T21:08:31.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.050+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/2356922025 wait complete. 2023-12-07T21:08:31.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.050+0000 7f7ca3c0e640 1 Processor -- start 2023-12-07T21:08:31.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.050+0000 7f7ca3c0e640 1 -- start start 2023-12-07T21:08:31.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7ca3c0e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c9c070610 0x7f7c9c08ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:31.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7ca3c0e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c090ed0 con 0x7f7c9c070610 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7ca19aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c9c070610 0x7f7c9c08ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7ca19aa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c9c070610 0x7f7c9c08ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45602/0 (socket says 172.21.15.89:45602) 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7ca19aa640 1 -- 172.21.15.89:0/1095690499 learned_addr learned my addr 172.21.15.89:0/1095690499 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7ca19aa640 1 -- 172.21.15.89:0/1095690499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9000bc80 con 0x7f7c9c070610 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7ca19aa640 1 --2- 172.21.15.89:0/1095690499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c9c070610 0x7f7c9c08ec10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c420 tx=0x7f7c9400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7c8e7fc640 1 -- 172.21.15.89:0/1095690499 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c940074d0 con 0x7f7c9c070610 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7c8e7fc640 1 -- 172.21.15.89:0/1095690499 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c94007630 con 0x7f7c9c070610 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7c8e7fc640 1 -- 172.21.15.89:0/1095690499 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c94004950 con 0x7f7c9c070610 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/1095690499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9c091e90 con 0x7f7c9c070610 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/1095690499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9c08ff40 con 0x7f7c9c070610 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7c8e7fc640 1 -- 172.21.15.89:0/1095690499 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7c9401d440 con 0x7f7c9c070610 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.051+0000 7f7c8e7fc640 1 -- 172.21.15.89:0/1095690499 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f7c9401c950 con 0x7f7c9c070610 2023-12-07T21:08:31.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.052+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/1095690499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9c062110 con 0x7f7c9c070610 2023-12-07T21:08:31.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.054+0000 7f7c8e7fc640 1 -- 172.21.15.89:0/1095690499 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7c94018070 con 0x7f7c9c070610 2023-12-07T21:08:31.085 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:31.091+0000 7fd8b1c2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-07T21:08:31.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.112+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/1095690499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c9c066d20 con 0x7f7c9c070610 2023-12-07T21:08:31.106 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.112+0000 7f7c8e7fc640 1 -- 172.21.15.89:0/1095690499 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7f7c9401cb60 con 0x7f7c9c070610 2023-12-07T21:08:31.106 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:31.106 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":6,"fsid":"49fe948c-b519-4268-9cf3-54fad381ce79","created":"2023-12-07T21:08:29.796839+0000","modified":"2023-12-07T21:08:30.921504+0000","last_up_change":"0.000000","last_in_change":"2023-12-07T21:08:30.921504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7d49515-b2a2-4323-9af0-d3ba338a0dc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ab1d5fe6-a976-4a30-abd1-a28b2c6de703","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9426627e-2a0c-4ce2-9f5d-57bb763a881c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"02e748fb-1486-4c5c-8d34-7221bdfca701","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T21:08:31.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.113+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/1095690499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c9c070610 msgr2=0x7f7c9c08ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:31.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.113+0000 7f7ca3c0e640 1 --2- 172.21.15.89:0/1095690499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c9c070610 0x7f7c9c08ec10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c420 tx=0x7f7c9400c8e0 comp rx=0 tx=0).stop 2023-12-07T21:08:31.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.113+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/1095690499 shutdown_connections 2023-12-07T21:08:31.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.113+0000 7f7ca3c0e640 1 --2- 172.21.15.89:0/1095690499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c9c070610 0x7f7c9c08ec10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:31.107 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.113+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/1095690499 >> 172.21.15.89:0/1095690499 conn(0x7f7c9c0987f0 msgr2=0x7f7c9c095910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:31.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.113+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/1095690499 shutdown_connections 2023-12-07T21:08:31.108 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:31.113+0000 7f7ca3c0e640 1 -- 172.21.15.89:0/1095690499 wait complete. 2023-12-07T21:08:31.117 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-07T21:08:31.117 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-07T21:08:31.137 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:31.143+0000 7fd8b1c2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-07T21:08:31.181 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:31.188+0000 7fd8b1c2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-07T21:08:31.234 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:31.240+0000 7fd8b1c2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-07T21:08:31.276 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:31.283+0000 7fd8b1c2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-07T21:08:31.378 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:31.385+0000 7fd8b1c2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-07T21:08:31.448 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:31.454+0000 7fd8b1c2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-07T21:08:31.493 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:31.499+0000 7fd8b1c2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-07T21:08:31.521 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-07T21:08:31.525 INFO:tasks.ceph.osd.3.smithi121.stderr:2023-12-07T21:08:31.531+0000 7f4732402500 -1 Falling back to public interface 2023-12-07T21:08:31.528 INFO:tasks.ceph.osd.1.smithi121.stderr:2023-12-07T21:08:31.534+0000 7fc400f1c500 -1 Falling back to public interface 2023-12-07T21:08:31.528 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-12-07T21:08:31.534+0000 7f59a774a500 -1 Falling back to public interface 2023-12-07T21:08:31.532 INFO:tasks.ceph.osd.2.smithi121.stderr:2023-12-07T21:08:31.539+0000 7fe58e712500 -1 Falling back to public interface 2023-12-07T21:08:31.549 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:31.556+0000 7fd8b1c2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-07T21:08:31.597 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:31.603+0000 7fd8b1c2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-07T21:08:31.608 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.614+0000 7f65f6797640 1 Processor -- start 2023-12-07T21:08:31.608 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.615+0000 7f65f6797640 1 -- start start 2023-12-07T21:08:31.609 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.615+0000 7f65f6797640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65f00710c0 0x7f65f00714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:31.609 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.615+0000 7f65f6797640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f00709b0 con 0x7f65f006faf0 2023-12-07T21:08:31.609 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.615+0000 7f65f6797640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f0071f10 con 0x7f65f00710c0 2023-12-07T21:08:31.609 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.615+0000 7f65effff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65f00710c0 0x7f65f00714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:31.609 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.615+0000 7f65ef7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f65f006faf0 0x7f65f012a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51004/0 (socket says 172.21.15.89:51004) 2023-12-07T21:08:31.609 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.615+0000 7f65ef7fe640 1 -- 172.21.15.89:0/1147065372 learned_addr learned my addr 172.21.15.89:0/1147065372 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:31.609 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.615+0000 7f65effff640 1 -- 172.21.15.89:0/1147065372 >> v1:172.21.15.89:6789/0 conn(0x7f65f006faf0 legacy=0x7f65f012a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:31.609 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.615+0000 7f65effff640 1 -- 172.21.15.89:0/1147065372 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f006cec0 con 0x7f65f00710c0 2023-12-07T21:08:31.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.616+0000 7f65effff640 1 --2- 172.21.15.89:0/1147065372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00710c0 0x7f65f00714a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009720 tx=0x7f65e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c2fe1ab265ad31 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:31.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.616+0000 7f65eeffd640 1 -- 172.21.15.89:0/1147065372 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65e4031760 con 0x7f65f00710c0 2023-12-07T21:08:31.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.616+0000 7f65eeffd640 1 -- 172.21.15.89:0/1147065372 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e40318c0 con 0x7f65f00710c0 2023-12-07T21:08:31.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.616+0000 7f65eeffd640 1 -- 172.21.15.89:0/1147065372 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65e4031b80 con 0x7f65f00710c0 2023-12-07T21:08:31.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.617+0000 7f65f6797640 1 -- 172.21.15.89:0/1147065372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00710c0 msgr2=0x7f65f00714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:31.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.617+0000 7f65f6797640 1 --2- 172.21.15.89:0/1147065372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00710c0 0x7f65f00714a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009720 tx=0x7f65e402b8d0 comp rx=0 tx=0).stop 2023-12-07T21:08:31.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.617+0000 7f65f6797640 1 -- 172.21.15.89:0/1147065372 shutdown_connections 2023-12-07T21:08:31.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.617+0000 7f65f6797640 1 --2- 172.21.15.89:0/1147065372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00710c0 0x7f65f00714a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:31.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.617+0000 7f65f6797640 1 -- 172.21.15.89:0/1147065372 >> 172.21.15.89:0/1147065372 conn(0x7f65f00962d0 msgr2=0x7f65f00966e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:31.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.617+0000 7f65f6797640 1 -- 172.21.15.89:0/1147065372 shutdown_connections 2023-12-07T21:08:31.611 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.617+0000 7f65f6797640 1 -- 172.21.15.89:0/1147065372 wait complete. 2023-12-07T21:08:31.613 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.617+0000 7f65f6797640 1 Processor -- start 2023-12-07T21:08:31.613 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.618+0000 7f65f6797640 1 -- start start 2023-12-07T21:08:31.613 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.618+0000 7f65f6797640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f006faf0 0x7f65f0126120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:31.613 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.618+0000 7f65f6797640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f01275e0 con 0x7f65f006faf0 2023-12-07T21:08:31.613 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.618+0000 7f65effff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f006faf0 0x7f65f0126120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:31.613 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.618+0000 7f65effff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f006faf0 0x7f65f0126120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45618/0 (socket says 172.21.15.89:45618) 2023-12-07T21:08:31.613 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.618+0000 7f65effff640 1 -- 172.21.15.89:0/3601688939 learned_addr learned my addr 172.21.15.89:0/3601688939 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:31.613 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.618+0000 7f65effff640 1 -- 172.21.15.89:0/3601688939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e4009400 con 0x7f65f006faf0 2023-12-07T21:08:31.613 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.618+0000 7f65effff640 1 --2- 172.21.15.89:0/3601688939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f006faf0 0x7f65f0126120 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009840 tx=0x7f65e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:31.614 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.619+0000 7f65ecff9640 1 -- 172.21.15.89:0/3601688939 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65e403b870 con 0x7f65f006faf0 2023-12-07T21:08:31.614 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.619+0000 7f65ecff9640 1 -- 172.21.15.89:0/3601688939 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e403b9f0 con 0x7f65f006faf0 2023-12-07T21:08:31.614 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.619+0000 7f65f6797640 1 -- 172.21.15.89:0/3601688939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f0089620 con 0x7f65f006faf0 2023-12-07T21:08:31.614 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.619+0000 7f65ecff9640 1 -- 172.21.15.89:0/3601688939 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f65e403bcd0 con 0x7f65f006faf0 2023-12-07T21:08:31.614 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.619+0000 7f65f6797640 1 -- 172.21.15.89:0/3601688939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f006d6c0 con 0x7f65f006faf0 2023-12-07T21:08:31.614 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.619+0000 7f65ecff9640 1 -- 172.21.15.89:0/3601688939 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f65e404e750 con 0x7f65f006faf0 2023-12-07T21:08:31.614 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.619+0000 7f65ecff9640 1 -- 172.21.15.89:0/3601688939 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f65e4045d10 con 0x7f65f006faf0 2023-12-07T21:08:31.614 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.619+0000 7f65f6797640 1 -- 172.21.15.89:0/3601688939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f00897b0 con 0x7f65f006faf0 2023-12-07T21:08:31.615 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.621+0000 7f65ecff9640 1 -- 172.21.15.89:0/3601688939 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f65e4035020 con 0x7f65f006faf0 2023-12-07T21:08:31.674 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.679+0000 7f65f6797640 1 -- 172.21.15.89:0/3601688939 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65f0062110 con 0x7f65f006faf0 2023-12-07T21:08:31.674 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.680+0000 7f65ecff9640 1 -- 172.21.15.89:0/3601688939 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4152 (secure 0 0 0) 0x7f65e403be30 con 0x7f65f006faf0 2023-12-07T21:08:31.674 INFO:teuthology.misc.health.smithi089.stdout: 2023-12-07T21:08:31.675 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":6,"fsid":"49fe948c-b519-4268-9cf3-54fad381ce79","created":"2023-12-07T21:08:29.796839+0000","modified":"2023-12-07T21:08:30.921504+0000","last_up_change":"0.000000","last_in_change":"2023-12-07T21:08:30.921504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7d49515-b2a2-4323-9af0-d3ba338a0dc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ab1d5fe6-a976-4a30-abd1-a28b2c6de703","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9426627e-2a0c-4ce2-9f5d-57bb763a881c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"02e748fb-1486-4c5c-8d34-7221bdfca701","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T21:08:31.676 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.680+0000 7f65f6797640 1 -- 172.21.15.89:0/3601688939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f006faf0 msgr2=0x7f65f0126120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:31.676 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.680+0000 7f65f6797640 1 --2- 172.21.15.89:0/3601688939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f006faf0 0x7f65f0126120 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009840 tx=0x7f65e40046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:31.676 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.680+0000 7f65f6797640 1 -- 172.21.15.89:0/3601688939 shutdown_connections 2023-12-07T21:08:31.677 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.680+0000 7f65f6797640 1 --2- 172.21.15.89:0/3601688939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f006faf0 0x7f65f0126120 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:31.677 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.680+0000 7f65f6797640 1 -- 172.21.15.89:0/3601688939 >> 172.21.15.89:0/3601688939 conn(0x7f65f00962d0 msgr2=0x7f65f01b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:31.677 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.680+0000 7f65f6797640 1 -- 172.21.15.89:0/3601688939 shutdown_connections 2023-12-07T21:08:31.677 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:31.680+0000 7f65f6797640 1 -- 172.21.15.89:0/3601688939 wait complete. 2023-12-07T21:08:31.684 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-12-07T21:08:31.973 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:31.980+0000 7fd8b1c2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-07T21:08:32.108 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:32.115+0000 7fd8b1c2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-07T21:08:32.231 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:32.238+0000 7fd8b1c2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-07T21:08:32.276 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:32.283+0000 7fd8b1c2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-07T21:08:32.375 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:32.381+0000 7fd8b1c2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-07T21:08:32.468 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:32.475+0000 7fd8b1c2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-07T21:08:32.607 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:32.614+0000 7fd8b1c2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-07T21:08:32.651 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:32.658+0000 7fd8b1c2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-07T21:08:32.788 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:32.795+0000 7fd8b1c2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-07T21:08:33.587 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:33.594+0000 7fd8b1c2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-07T21:08:33.856 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:33.863+0000 7fd8b1c2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-07T21:08:33.906 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:33.913+0000 7fd8b1c2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-07T21:08:34.020 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:34.027+0000 7fd8b1c2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-07T21:08:34.955 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-12-07T21:08:34.961+0000 7f59a774a500 -1 osd.0 0 log_to_monitors true 2023-12-07T21:08:35.020 INFO:tasks.ceph.osd.3.smithi121.stderr:2023-12-07T21:08:35.027+0000 7f4732402500 -1 osd.3 0 log_to_monitors true 2023-12-07T21:08:35.043 INFO:tasks.ceph.mgr.x.smithi121.stderr:2023-12-07T21:08:35.049+0000 7fd85273a640 -1 mgr.server handle_report got status from non-daemon mon.a 2023-12-07T21:08:35.062 INFO:tasks.ceph.osd.2.smithi121.stderr:2023-12-07T21:08:35.069+0000 7fe58e712500 -1 osd.2 0 log_to_monitors true 2023-12-07T21:08:35.062 INFO:tasks.ceph.osd.1.smithi121.stderr:2023-12-07T21:08:35.069+0000 7fc400f1c500 -1 osd.1 0 log_to_monitors true 2023-12-07T21:08:37.616 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-12-07T21:08:37.622+0000 7f59a2eb7640 -1 osd.0 0 waiting for initial osdmap 2023-12-07T21:08:37.629 INFO:tasks.ceph.osd.0.smithi089.stderr:2023-12-07T21:08:37.636+0000 7f599b4f0640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T21:08:38.087 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-07T21:08:38.174 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.180+0000 7ff9a84e7640 1 Processor -- start 2023-12-07T21:08:38.174 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.180+0000 7ff9a84e7640 1 -- start start 2023-12-07T21:08:38.175 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.181+0000 7ff9a84e7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9a006ecd0 0x7ff9a006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:38.175 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.181+0000 7ff9a84e7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a00700f0 con 0x7ff9a006f5f0 2023-12-07T21:08:38.175 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.181+0000 7ff9a84e7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a0070ed0 con 0x7ff9a006ecd0 2023-12-07T21:08:38.175 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.181+0000 7ff9a6283640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9a006ecd0 0x7ff9a006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:38.175 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.181+0000 7ff9a5a82640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff9a006f5f0 0x7ff9a012a260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:51018/0 (socket says 172.21.15.89:51018) 2023-12-07T21:08:38.175 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.181+0000 7ff9a5a82640 1 -- 172.21.15.89:0/389208567 learned_addr learned my addr 172.21.15.89:0/389208567 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:38.176 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.181+0000 7ff9a6283640 1 -- 172.21.15.89:0/389208567 >> v1:172.21.15.89:6789/0 conn(0x7ff9a006f5f0 legacy=0x7ff9a012a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:38.176 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.181+0000 7ff9a6283640 1 -- 172.21.15.89:0/389208567 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0071100 con 0x7ff9a006ecd0 2023-12-07T21:08:38.176 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.182+0000 7ff9a6283640 1 --2- 172.21.15.89:0/389208567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a006ecd0 0x7ff9a006f0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff998009d90 tx=0x7ff99802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a554706e000d257 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:38.177 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.182+0000 7ff9a5281640 1 -- 172.21.15.89:0/389208567 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff99802cb10 con 0x7ff9a006ecd0 2023-12-07T21:08:38.177 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.182+0000 7ff9a5281640 1 -- 172.21.15.89:0/389208567 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99802cc70 con 0x7ff9a006ecd0 2023-12-07T21:08:38.177 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.182+0000 7ff9a5281640 1 -- 172.21.15.89:0/389208567 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff998034440 con 0x7ff9a006ecd0 2023-12-07T21:08:38.177 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.182+0000 7ff9a84e7640 1 -- 172.21.15.89:0/389208567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a006ecd0 msgr2=0x7ff9a006f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:38.177 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.182+0000 7ff9a84e7640 1 --2- 172.21.15.89:0/389208567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a006ecd0 0x7ff9a006f0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff998009d90 tx=0x7ff99802beb0 comp rx=0 tx=0).stop 2023-12-07T21:08:38.177 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.183+0000 7ff9a84e7640 1 -- 172.21.15.89:0/389208567 shutdown_connections 2023-12-07T21:08:38.177 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.183+0000 7ff9a84e7640 1 --2- 172.21.15.89:0/389208567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a006ecd0 0x7ff9a006f0b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:38.177 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.183+0000 7ff9a84e7640 1 -- 172.21.15.89:0/389208567 >> 172.21.15.89:0/389208567 conn(0x7ff9a009ddc0 msgr2=0x7ff9a009e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:38.177 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.183+0000 7ff9a84e7640 1 -- 172.21.15.89:0/389208567 shutdown_connections 2023-12-07T21:08:38.178 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.183+0000 7ff9a84e7640 1 -- 172.21.15.89:0/389208567 wait complete. 2023-12-07T21:08:38.178 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.183+0000 7ff9a84e7640 1 Processor -- start 2023-12-07T21:08:38.178 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.183+0000 7ff9a84e7640 1 -- start start 2023-12-07T21:08:38.179 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff9a84e7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a006ecd0 0x7ff9a011a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff9a84e7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a011d9d0 con 0x7ff9a006ecd0 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff9a6283640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a006ecd0 0x7ff9a011a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff9a6283640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a006ecd0 0x7ff9a011a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45654/0 (socket says 172.21.15.89:45654) 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff9a6283640 1 -- 172.21.15.89:0/767604361 learned_addr learned my addr 172.21.15.89:0/767604361 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff9a6283640 1 -- 172.21.15.89:0/767604361 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998009a70 con 0x7ff9a006ecd0 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff9a6283640 1 --2- 172.21.15.89:0/767604361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a006ecd0 0x7ff9a011a530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff998000f80 tx=0x7ff998004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff996ffd640 1 -- 172.21.15.89:0/767604361 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff998040580 con 0x7ff9a006ecd0 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff996ffd640 1 -- 172.21.15.89:0/767604361 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9980406e0 con 0x7ff9a006ecd0 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff9a84e7640 1 -- 172.21.15.89:0/767604361 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a011d6c0 con 0x7ff9a006ecd0 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff996ffd640 1 -- 172.21.15.89:0/767604361 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9980409a0 con 0x7ff9a006ecd0 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.184+0000 7ff9a84e7640 1 -- 172.21.15.89:0/767604361 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a0129f60 con 0x7ff9a006ecd0 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.185+0000 7ff996ffd640 1 -- 172.21.15.89:0/767604361 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 4) v1 ==== 44800+0+0 (secure 0 0 0) 0x7ff998040b00 con 0x7ff9a006ecd0 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.185+0000 7ff996ffd640 1 --2- 172.21.15.89:0/767604361 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff984037790 0x7ff984039c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:38.180 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.185+0000 7ff9a84e7640 1 -- 172.21.15.89:0/767604361 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a011d520 con 0x7ff9a006ecd0 2023-12-07T21:08:38.181 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.185+0000 7ff996ffd640 1 -- 172.21.15.89:0/767604361 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1623+0+0 (secure 0 0 0) 0x7ff99806c9b0 con 0x7ff9a006ecd0 2023-12-07T21:08:38.181 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.186+0000 7ff9a5a82640 1 --2- 172.21.15.89:0/767604361 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff984037790 0x7ff984039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:38.181 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.186+0000 7ff9a5a82640 1 --2- 172.21.15.89:0/767604361 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff984037790 0x7ff984039c50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff990007fd0 tx=0x7ff990007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:38.184 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.190+0000 7ff996ffd640 1 -- 172.21.15.89:0/767604361 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9a011d520 con 0x7ff9a006ecd0 2023-12-07T21:08:38.350 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.357+0000 7ff9a84e7640 1 -- 172.21.15.89:0/767604361 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9a011d520 con 0x7ff9a006ecd0 2023-12-07T21:08:38.351 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.357+0000 7ff996ffd640 1 -- 172.21.15.89:0/767604361 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4152 (secure 0 0 0) 0x7ff9a011d520 con 0x7ff9a006ecd0 2023-12-07T21:08:38.351 INFO:teuthology.misc.health.smithi089.stdout: 2023-12-07T21:08:38.351 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":8,"fsid":"49fe948c-b519-4268-9cf3-54fad381ce79","created":"2023-12-07T21:08:29.796839+0000","modified":"2023-12-07T21:08:36.769048+0000","last_up_change":"0.000000","last_in_change":"2023-12-07T21:08:30.921504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c7d49515-b2a2-4323-9af0-d3ba338a0dc8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ab1d5fe6-a976-4a30-abd1-a28b2c6de703","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9426627e-2a0c-4ce2-9f5d-57bb763a881c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"02e748fb-1486-4c5c-8d34-7221bdfca701","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T21:08:38.353 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.359+0000 7ff9a84e7640 1 -- 172.21.15.89:0/767604361 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff984037790 msgr2=0x7ff984039c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:38.353 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.359+0000 7ff9a84e7640 1 --2- 172.21.15.89:0/767604361 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff984037790 0x7ff984039c50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff990007fd0 tx=0x7ff990007ac0 comp rx=0 tx=0).stop 2023-12-07T21:08:38.353 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.359+0000 7ff9a84e7640 1 -- 172.21.15.89:0/767604361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a006ecd0 msgr2=0x7ff9a011a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:38.353 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.359+0000 7ff9a84e7640 1 --2- 172.21.15.89:0/767604361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a006ecd0 0x7ff9a011a530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff998000f80 tx=0x7ff998004a40 comp rx=0 tx=0).stop 2023-12-07T21:08:38.353 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.359+0000 7ff9a84e7640 1 -- 172.21.15.89:0/767604361 shutdown_connections 2023-12-07T21:08:38.353 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.359+0000 7ff9a84e7640 1 --2- 172.21.15.89:0/767604361 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff984037790 0x7ff984039c50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:38.353 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.359+0000 7ff9a84e7640 1 --2- 172.21.15.89:0/767604361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a006ecd0 0x7ff9a011a530 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:38.353 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.359+0000 7ff9a84e7640 1 -- 172.21.15.89:0/767604361 >> 172.21.15.89:0/767604361 conn(0x7ff9a009ddc0 msgr2=0x7ff9a006ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:38.353 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.359+0000 7ff9a84e7640 1 -- 172.21.15.89:0/767604361 shutdown_connections 2023-12-07T21:08:38.354 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:38.359+0000 7ff9a84e7640 1 -- 172.21.15.89:0/767604361 wait complete. 2023-12-07T21:08:38.362 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-12-07T21:08:38.450 INFO:tasks.ceph.osd.2.smithi121.stderr:2023-12-07T21:08:38.456+0000 7fe589e7d640 -1 osd.2 0 waiting for initial osdmap 2023-12-07T21:08:38.460 INFO:tasks.ceph.osd.1.smithi121.stderr:2023-12-07T21:08:38.467+0000 7fc3fc687640 -1 osd.1 0 waiting for initial osdmap 2023-12-07T21:08:38.464 INFO:tasks.ceph.osd.2.smithi121.stderr:2023-12-07T21:08:38.471+0000 7fe5824b6640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T21:08:38.471 INFO:tasks.ceph.osd.1.smithi121.stderr:2023-12-07T21:08:38.478+0000 7fc3f4cc0640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T21:08:38.499 INFO:tasks.ceph.osd.3.smithi121.stderr:2023-12-07T21:08:38.505+0000 7f472db6d640 -1 osd.3 0 waiting for initial osdmap 2023-12-07T21:08:38.508 INFO:tasks.ceph.osd.3.smithi121.stderr:2023-12-07T21:08:38.515+0000 7f47261a6640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T21:08:44.766 DEBUG:teuthology.orchestra.run.smithi089:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-07T21:08:44.865 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.871+0000 7f381bb7c640 1 Processor -- start 2023-12-07T21:08:44.865 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.871+0000 7f381bb7c640 1 -- start start 2023-12-07T21:08:44.866 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.872+0000 7f381bb7c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f381406f7c0 0x7f3814132ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:44.866 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.872+0000 7f381bb7c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38140700f0 con 0x7f381406ecd0 2023-12-07T21:08:44.866 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.872+0000 7f381bb7c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3814070ed0 con 0x7f381406f7c0 2023-12-07T21:08:44.866 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.872+0000 7f3819918640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f381406ecd0 0x7f381406f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48614/0 (socket says 172.21.15.89:48614) 2023-12-07T21:08:44.866 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.872+0000 7f3819918640 1 -- 172.21.15.89:0/3355794238 learned_addr learned my addr 172.21.15.89:0/3355794238 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:44.866 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.872+0000 7f3819117640 1 --2- 172.21.15.89:0/3355794238 >> v2:172.21.15.89:3300/0 conn(0x7f381406f7c0 0x7f3814132ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:44.866 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.872+0000 7f3818916640 1 -- 172.21.15.89:0/3355794238 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792618414 0 0) 0x7f38140700f0 con 0x7f381406ecd0 2023-12-07T21:08:44.866 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.872+0000 7f3818916640 1 -- 172.21.15.89:0/3355794238 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3800003520 con 0x7f381406ecd0 2023-12-07T21:08:44.867 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.872+0000 7f3819117640 1 -- 172.21.15.89:0/3355794238 >> v1:172.21.15.89:6789/0 conn(0x7f381406ecd0 legacy=0x7f381406f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:44.867 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.872+0000 7f3819117640 1 -- 172.21.15.89:0/3355794238 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3814071100 con 0x7f381406f7c0 2023-12-07T21:08:44.868 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.873+0000 7f3819117640 1 --2- 172.21.15.89:0/3355794238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381406f7c0 0x7f3814132ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3804009720 tx=0x7f380402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c1c2e8dcc2fc0d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:44.868 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.873+0000 7f3818916640 1 -- 172.21.15.89:0/3355794238 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f380402e070 con 0x7f381406f7c0 2023-12-07T21:08:44.868 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.873+0000 7f3818916640 1 -- 172.21.15.89:0/3355794238 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38040316d0 con 0x7f381406f7c0 2023-12-07T21:08:44.868 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.873+0000 7f3818916640 1 -- 172.21.15.89:0/3355794238 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3804031990 con 0x7f381406f7c0 2023-12-07T21:08:44.868 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.874+0000 7f381bb7c640 1 -- 172.21.15.89:0/3355794238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381406f7c0 msgr2=0x7f3814132ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:44.868 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.874+0000 7f381bb7c640 1 --2- 172.21.15.89:0/3355794238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381406f7c0 0x7f3814132ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3804009720 tx=0x7f380402b840 comp rx=0 tx=0).stop 2023-12-07T21:08:44.868 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.874+0000 7f381bb7c640 1 -- 172.21.15.89:0/3355794238 shutdown_connections 2023-12-07T21:08:44.868 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.874+0000 7f381bb7c640 1 --2- 172.21.15.89:0/3355794238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381406f7c0 0x7f3814132ab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:44.868 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.874+0000 7f381bb7c640 1 -- 172.21.15.89:0/3355794238 >> 172.21.15.89:0/3355794238 conn(0x7f381409ddc0 msgr2=0x7f381409e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:44.868 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.874+0000 7f381bb7c640 1 -- 172.21.15.89:0/3355794238 shutdown_connections 2023-12-07T21:08:44.869 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.874+0000 7f381bb7c640 1 -- 172.21.15.89:0/3355794238 wait complete. 2023-12-07T21:08:44.872 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.875+0000 7f381bb7c640 1 Processor -- start 2023-12-07T21:08:44.872 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.875+0000 7f381bb7c640 1 -- start start 2023-12-07T21:08:44.872 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.875+0000 7f381bb7c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381406ecd0 0x7f38141c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:44.872 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.875+0000 7f381bb7c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381411b3a0 con 0x7f381406ecd0 2023-12-07T21:08:44.872 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.875+0000 7f3819918640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381406ecd0 0x7f38141c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:44.872 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.875+0000 7f3819918640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381406ecd0 0x7f38141c2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39754/0 (socket says 172.21.15.89:39754) 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.875+0000 7f3819918640 1 -- 172.21.15.89:0/1942686284 learned_addr learned my addr 172.21.15.89:0/1942686284 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.876+0000 7f3819918640 1 -- 172.21.15.89:0/1942686284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3804009400 con 0x7f381406ecd0 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.876+0000 7f3819918640 1 --2- 172.21.15.89:0/1942686284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381406ecd0 0x7f38141c2310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f381000c480 tx=0x7f381000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.876+0000 7f380a7fc640 1 -- 172.21.15.89:0/1942686284 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3810005c10 con 0x7f381406ecd0 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.876+0000 7f380a7fc640 1 -- 172.21.15.89:0/1942686284 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3810005d70 con 0x7f381406ecd0 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.876+0000 7f381bb7c640 1 -- 172.21.15.89:0/1942686284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381412e3a0 con 0x7f381406ecd0 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.876+0000 7f380a7fc640 1 -- 172.21.15.89:0/1942686284 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38100071e0 con 0x7f381406ecd0 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.876+0000 7f381bb7c640 1 -- 172.21.15.89:0/1942686284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381411bad0 con 0x7f381406ecd0 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.877+0000 7f380a7fc640 1 -- 172.21.15.89:0/1942686284 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3810007340 con 0x7f381406ecd0 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.877+0000 7f381bb7c640 1 -- 172.21.15.89:0/1942686284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381411c420 con 0x7f381406ecd0 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.877+0000 7f380a7fc640 1 --2- 172.21.15.89:0/1942686284 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f80377d0 0x7f37f8039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.877+0000 7f380a7fc640 1 -- 172.21.15.89:0/1942686284 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f3810049550 con 0x7f381406ecd0 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.877+0000 7f3819117640 1 --2- 172.21.15.89:0/1942686284 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f80377d0 0x7f37f8039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:44.873 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.878+0000 7f3819117640 1 --2- 172.21.15.89:0/1942686284 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f80377d0 0x7f37f8039c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3804036000 tx=0x7f3804008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:44.875 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:44.882+0000 7f380a7fc640 1 -- 172.21.15.89:0/1942686284 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f381001b8d0 con 0x7f381406ecd0 2023-12-07T21:08:45.043 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.050+0000 7f381bb7c640 1 -- 172.21.15.89:0/1942686284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3814062110 con 0x7f381406ecd0 2023-12-07T21:08:45.044 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.050+0000 7f380a7fc640 1 -- 172.21.15.89:0/1942686284 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7941 (secure 0 0 0) 0x7f3810017020 con 0x7f381406ecd0 2023-12-07T21:08:45.044 INFO:teuthology.misc.health.smithi089.stdout: 2023-12-07T21:08:45.044 INFO:teuthology.misc.health.smithi089.stdout:{"epoch":13,"fsid":"49fe948c-b519-4268-9cf3-54fad381ce79","created":"2023-12-07T21:08:29.796839+0000","modified":"2023-12-07T21:08:42.796479+0000","last_up_change":"2023-12-07T21:08:38.626187+0000","last_in_change":"2023-12-07T21:08:30.921504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T21:08:40.087062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7d49515-b2a2-4323-9af0-d3ba338a0dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6801","nonce":654939948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6803","nonce":654939948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6807","nonce":654939948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6805","nonce":654939948}]},"public_addr":"172.21.15.89:6801/654939948","cluster_addr":"172.21.15.89:6803/654939948","heartbeat_back_addr":"172.21.15.89:6807/654939948","heartbeat_front_addr":"172.21.15.89:6805/654939948","state":["exists","up"]},{"osd":1,"uuid":"ab1d5fe6-a976-4a30-abd1-a28b2c6de703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6809","nonce":2140819418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6811","nonce":2140819418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6815","nonce":2140819418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6813","nonce":2140819418}]},"public_addr":"172.21.15.121:6809/2140819418","cluster_addr":"172.21.15.121:6811/2140819418","heartbeat_back_addr":"172.21.15.121:6815/2140819418","heartbeat_front_addr":"172.21.15.121:6813/2140819418","state":["exists","up"]},{"osd":2,"uuid":"9426627e-2a0c-4ce2-9f5d-57bb763a881c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6817","nonce":2557538450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6819","nonce":2557538450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6823","nonce":2557538450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6821","nonce":2557538450}]},"public_addr":"172.21.15.121:6817/2557538450","cluster_addr":"172.21.15.121:6819/2557538450","heartbeat_back_addr":"172.21.15.121:6823/2557538450","heartbeat_front_addr":"172.21.15.121:6821/2557538450","state":["exists","up"]},{"osd":3,"uuid":"02e748fb-1486-4c5c-8d34-7221bdfca701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6801","nonce":4032235766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6803","nonce":4032235766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6807","nonce":4032235766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6805","nonce":4032235766}]},"public_addr":"172.21.15.121:6801/4032235766","cluster_addr":"172.21.15.121:6803/4032235766","heartbeat_back_addr":"172.21.15.121:6807/4032235766","heartbeat_front_addr":"172.21.15.121:6805/4032235766","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:35.919729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:36.084357+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:36.076845+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:35.994710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T21:08:45.046 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.052+0000 7f381bb7c640 1 -- 172.21.15.89:0/1942686284 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f80377d0 msgr2=0x7f37f8039c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:45.047 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.052+0000 7f381bb7c640 1 --2- 172.21.15.89:0/1942686284 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f80377d0 0x7f37f8039c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3804036000 tx=0x7f3804008030 comp rx=0 tx=0).stop 2023-12-07T21:08:45.047 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.052+0000 7f381bb7c640 1 -- 172.21.15.89:0/1942686284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381406ecd0 msgr2=0x7f38141c2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:45.047 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.052+0000 7f381bb7c640 1 --2- 172.21.15.89:0/1942686284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381406ecd0 0x7f38141c2310 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f381000c480 tx=0x7f381000c940 comp rx=0 tx=0).stop 2023-12-07T21:08:45.047 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.052+0000 7f381bb7c640 1 -- 172.21.15.89:0/1942686284 shutdown_connections 2023-12-07T21:08:45.047 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.052+0000 7f381bb7c640 1 --2- 172.21.15.89:0/1942686284 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f80377d0 0x7f37f8039c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:45.047 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.052+0000 7f381bb7c640 1 --2- 172.21.15.89:0/1942686284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f381406ecd0 0x7f38141c2310 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:45.047 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.052+0000 7f381bb7c640 1 -- 172.21.15.89:0/1942686284 >> 172.21.15.89:0/1942686284 conn(0x7f381409ddc0 msgr2=0x7f381412d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:45.047 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.052+0000 7f381bb7c640 1 -- 172.21.15.89:0/1942686284 shutdown_connections 2023-12-07T21:08:45.047 INFO:teuthology.misc.health.smithi089.stderr:2023-12-07T21:08:45.052+0000 7f381bb7c640 1 -- 172.21.15.89:0/1942686284 wait complete. 2023-12-07T21:08:45.055 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-12-07T21:08:45.056 INFO:tasks.ceph:Creating RBD pool 2023-12-07T21:08:45.056 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool create rbd 8 2023-12-07T21:08:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.161+0000 7f3129cbb640 1 Processor -- start 2023-12-07T21:08:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.161+0000 7f3129cbb640 1 -- start start 2023-12-07T21:08:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.162+0000 7f3129cbb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f312406dd80 0x7f312406e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.162+0000 7f3129cbb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312406f190 con 0x7f312406e6a0 2023-12-07T21:08:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.162+0000 7f3129cbb640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312406f3c0 con 0x7f312406dd80 2023-12-07T21:08:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.162+0000 7f31237fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f312406dd80 0x7f312406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.162+0000 7f3122ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f312406e6a0 0x7f31240950b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48620/0 (socket says 172.21.15.89:48620) 2023-12-07T21:08:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.162+0000 7f3122ffd640 1 -- 172.21.15.89:0/981936375 learned_addr learned my addr 172.21.15.89:0/981936375 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.162+0000 7f31237fe640 1 -- 172.21.15.89:0/981936375 >> v1:172.21.15.89:6789/0 conn(0x7f312406e6a0 legacy=0x7f31240950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.162+0000 7f31237fe640 1 -- 172.21.15.89:0/981936375 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312409af00 con 0x7f312406dd80 2023-12-07T21:08:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.163+0000 7f31237fe640 1 --2- 172.21.15.89:0/981936375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f312406dd80 0x7f312406e160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3114009720 tx=0x7f311402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca6695c50061f76 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.163+0000 7f31227fc640 1 -- 172.21.15.89:0/981936375 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f311402e070 con 0x7f312406dd80 2023-12-07T21:08:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.163+0000 7f31227fc640 1 -- 172.21.15.89:0/981936375 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31140316d0 con 0x7f312406dd80 2023-12-07T21:08:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.163+0000 7f31227fc640 1 -- 172.21.15.89:0/981936375 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3114031990 con 0x7f312406dd80 2023-12-07T21:08:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.163+0000 7f3129cbb640 1 -- 172.21.15.89:0/981936375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f312406dd80 msgr2=0x7f312406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.163+0000 7f3129cbb640 1 --2- 172.21.15.89:0/981936375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f312406dd80 0x7f312406e160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3114009720 tx=0x7f311402b840 comp rx=0 tx=0).stop 2023-12-07T21:08:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.163+0000 7f3129cbb640 1 -- 172.21.15.89:0/981936375 shutdown_connections 2023-12-07T21:08:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.163+0000 7f3129cbb640 1 --2- 172.21.15.89:0/981936375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f312406dd80 0x7f312406e160 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.163+0000 7f3129cbb640 1 -- 172.21.15.89:0/981936375 >> 172.21.15.89:0/981936375 conn(0x7f3124098880 msgr2=0x7f3124098c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.163+0000 7f3129cbb640 1 -- 172.21.15.89:0/981936375 shutdown_connections 2023-12-07T21:08:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.163+0000 7f3129cbb640 1 -- 172.21.15.89:0/981936375 wait complete. 2023-12-07T21:08:45.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.164+0000 7f3129cbb640 1 Processor -- start 2023-12-07T21:08:45.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.164+0000 7f3129cbb640 1 -- start start 2023-12-07T21:08:45.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f3129cbb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f312406dd80 0x7f3124121a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:45.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f3129cbb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31241234a0 con 0x7f312406dd80 2023-12-07T21:08:45.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f31237fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f312406dd80 0x7f3124121a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f31237fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f312406dd80 0x7f3124121a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39770/0 (socket says 172.21.15.89:39770) 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f31237fe640 1 -- 172.21.15.89:0/3736797651 learned_addr learned my addr 172.21.15.89:0/3736797651 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f31237fe640 1 -- 172.21.15.89:0/3736797651 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3114009400 con 0x7f312406dd80 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f31237fe640 1 --2- 172.21.15.89:0/3736797651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f312406dd80 0x7f3124121a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f31140316a0 tx=0x7f31140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f310bfff640 1 -- 172.21.15.89:0/3736797651 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3114032830 con 0x7f312406dd80 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f310bfff640 1 -- 172.21.15.89:0/3736797651 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3114032990 con 0x7f312406dd80 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f3129cbb640 1 -- 172.21.15.89:0/3736797651 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31241248a0 con 0x7f312406dd80 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f310bfff640 1 -- 172.21.15.89:0/3736797651 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3114032c70 con 0x7f312406dd80 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.165+0000 7f3129cbb640 1 -- 172.21.15.89:0/3736797651 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3124124070 con 0x7f312406dd80 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.166+0000 7f310bfff640 1 -- 172.21.15.89:0/3736797651 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f311404d3f0 con 0x7f312406dd80 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.166+0000 7f310bfff640 1 --2- 172.21.15.89:0/3736797651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3110037820 0x7f3110039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.166+0000 7f3129cbb640 1 -- 172.21.15.89:0/3736797651 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3124062110 con 0x7f312406dd80 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.166+0000 7f310bfff640 1 -- 172.21.15.89:0/3736797651 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f311406bd00 con 0x7f312406dd80 2023-12-07T21:08:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.167+0000 7f3122ffd640 1 --2- 172.21.15.89:0/3736797651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3110037820 0x7f3110039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:45.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.167+0000 7f3122ffd640 1 --2- 172.21.15.89:0/3736797651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3110037820 0x7f3110039ce0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3118007fd0 tx=0x7f3118007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:45.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.171+0000 7f310bfff640 1 -- 172.21.15.89:0/3736797651 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31140308e0 con 0x7f312406dd80 2023-12-07T21:08:45.330 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.337+0000 7f3129cbb640 1 -- 172.21.15.89:0/3736797651 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f3124066d20 con 0x7f312406dd80 2023-12-07T21:08:45.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.807+0000 7f310bfff640 1 -- 172.21.15.89:0/3736797651 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f311403a380 con 0x7f312406dd80 2023-12-07T21:08:45.801 INFO:teuthology.orchestra.run.smithi089.stderr:pool 'rbd' created 2023-12-07T21:08:45.803 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.809+0000 7f3129cbb640 1 -- 172.21.15.89:0/3736797651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3110037820 msgr2=0x7f3110039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.809+0000 7f3129cbb640 1 --2- 172.21.15.89:0/3736797651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3110037820 0x7f3110039ce0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3118007fd0 tx=0x7f3118007ac0 comp rx=0 tx=0).stop 2023-12-07T21:08:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.809+0000 7f3129cbb640 1 -- 172.21.15.89:0/3736797651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f312406dd80 msgr2=0x7f3124121a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.809+0000 7f3129cbb640 1 --2- 172.21.15.89:0/3736797651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f312406dd80 0x7f3124121a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f31140316a0 tx=0x7f31140046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.809+0000 7f3129cbb640 1 -- 172.21.15.89:0/3736797651 shutdown_connections 2023-12-07T21:08:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.809+0000 7f3129cbb640 1 --2- 172.21.15.89:0/3736797651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3110037820 0x7f3110039ce0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.809+0000 7f3129cbb640 1 --2- 172.21.15.89:0/3736797651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f312406dd80 0x7f3124121a70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.809+0000 7f3129cbb640 1 -- 172.21.15.89:0/3736797651 >> 172.21.15.89:0/3736797651 conn(0x7f3124098880 msgr2=0x7f31241b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.810+0000 7f3129cbb640 1 -- 172.21.15.89:0/3736797651 shutdown_connections 2023-12-07T21:08:45.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.810+0000 7f3129cbb640 1 -- 172.21.15.89:0/3736797651 wait complete. 2023-12-07T21:08:45.815 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-07T21:08:45.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.923+0000 7f7b5566f640 1 Processor -- start 2023-12-07T21:08:45.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.923+0000 7f7b5566f640 1 -- start start 2023-12-07T21:08:45.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.923+0000 7f7b5566f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7b5009c060 0x7f7b50132a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:45.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.923+0000 7f7b5566f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b50097f40 con 0x7f7b5009b570 2023-12-07T21:08:45.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.923+0000 7f7b5566f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b500985d0 con 0x7f7b5009c060 2023-12-07T21:08:45.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.923+0000 7f7b4e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7b5009c060 0x7f7b50132a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:45.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.923+0000 7f7b4effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7b5009b570 0x7f7b5009b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48624/0 (socket says 172.21.15.89:48624) 2023-12-07T21:08:45.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.923+0000 7f7b4effd640 1 -- 172.21.15.89:0/1693452286 learned_addr learned my addr 172.21.15.89:0/1693452286 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:45.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.924+0000 7f7b4e7fc640 1 -- 172.21.15.89:0/1693452286 >> v1:172.21.15.89:6789/0 conn(0x7f7b5009b570 legacy=0x7f7b5009b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:45.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.924+0000 7f7b4e7fc640 1 -- 172.21.15.89:0/1693452286 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5006d4f0 con 0x7f7b5009c060 2023-12-07T21:08:45.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.924+0000 7f7b4e7fc640 1 --2- 172.21.15.89:0/1693452286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5009c060 0x7f7b50132a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009720 tx=0x7f7b4402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519bcdf2d16e3b8d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:45.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.924+0000 7f7b4dffb640 1 -- 172.21.15.89:0/1693452286 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b4402e070 con 0x7f7b5009c060 2023-12-07T21:08:45.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.925+0000 7f7b4dffb640 1 -- 172.21.15.89:0/1693452286 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b440316d0 con 0x7f7b5009c060 2023-12-07T21:08:45.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.925+0000 7f7b4dffb640 1 -- 172.21.15.89:0/1693452286 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b44031990 con 0x7f7b5009c060 2023-12-07T21:08:45.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.925+0000 7f7b5566f640 1 -- 172.21.15.89:0/1693452286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5009c060 msgr2=0x7f7b50132a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:45.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.925+0000 7f7b5566f640 1 --2- 172.21.15.89:0/1693452286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5009c060 0x7f7b50132a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009720 tx=0x7f7b4402b840 comp rx=0 tx=0).stop 2023-12-07T21:08:45.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.925+0000 7f7b5566f640 1 -- 172.21.15.89:0/1693452286 shutdown_connections 2023-12-07T21:08:45.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.925+0000 7f7b5566f640 1 --2- 172.21.15.89:0/1693452286 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5009c060 0x7f7b50132a60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:45.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.925+0000 7f7b5566f640 1 -- 172.21.15.89:0/1693452286 >> 172.21.15.89:0/1693452286 conn(0x7f7b5006c760 msgr2=0x7f7b5006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:45.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.925+0000 7f7b5566f640 1 -- 172.21.15.89:0/1693452286 shutdown_connections 2023-12-07T21:08:45.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.925+0000 7f7b5566f640 1 -- 172.21.15.89:0/1693452286 wait complete. 2023-12-07T21:08:45.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.926+0000 7f7b5566f640 1 Processor -- start 2023-12-07T21:08:45.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.926+0000 7f7b5566f640 1 -- start start 2023-12-07T21:08:45.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.926+0000 7f7b5566f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5009b570 0x7f7b5011a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:45.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.926+0000 7f7b5566f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5011c240 con 0x7f7b5009b570 2023-12-07T21:08:45.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.926+0000 7f7b4effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5009b570 0x7f7b5011a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:45.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.926+0000 7f7b4effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5009b570 0x7f7b5011a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39796/0 (socket says 172.21.15.89:39796) 2023-12-07T21:08:45.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.926+0000 7f7b4effd640 1 -- 172.21.15.89:0/2973186089 learned_addr learned my addr 172.21.15.89:0/2973186089 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.927+0000 7f7b4effd640 1 -- 172.21.15.89:0/2973186089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44009400 con 0x7f7b5009b570 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.927+0000 7f7b4effd640 1 --2- 172.21.15.89:0/2973186089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5009b570 0x7f7b5011a990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000cb20 tx=0x7f7b4000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.927+0000 7f7b377fe640 1 -- 172.21.15.89:0/2973186089 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b4000abf0 con 0x7f7b5009b570 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.927+0000 7f7b377fe640 1 -- 172.21.15.89:0/2973186089 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4000ad50 con 0x7f7b5009b570 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.927+0000 7f7b377fe640 1 -- 172.21.15.89:0/2973186089 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b40012400 con 0x7f7b5009b570 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.927+0000 7f7b5566f640 1 -- 172.21.15.89:0/2973186089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5012e270 con 0x7f7b5009b570 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.927+0000 7f7b5566f640 1 -- 172.21.15.89:0/2973186089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5011df90 con 0x7f7b5009b570 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.928+0000 7f7b377fe640 1 -- 172.21.15.89:0/2973186089 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7b40007070 con 0x7f7b5009b570 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.928+0000 7f7b5566f640 1 -- 172.21.15.89:0/2973186089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5011cf40 con 0x7f7b5009b570 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.928+0000 7f7b377fe640 1 --2- 172.21.15.89:0/2973186089 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b3c037820 0x7f7b3c039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.928+0000 7f7b377fe640 1 -- 172.21.15.89:0/2973186089 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3471+0+0 (secure 0 0 0) 0x7f7b4004a030 con 0x7f7b5009b570 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.928+0000 7f7b4e7fc640 1 --2- 172.21.15.89:0/2973186089 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b3c037820 0x7f7b3c039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:45.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.929+0000 7f7b4e7fc640 1 --2- 172.21.15.89:0/2973186089 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b3c037820 0x7f7b3c039ce0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7b44036000 tx=0x7f7b44008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:45.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:45.933+0000 7f7b377fe640 1 -- 172.21.15.89:0/2973186089 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b400196d0 con 0x7f7b5009b570 2023-12-07T21:08:46.093 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.100+0000 7f7b5566f640 1 -- 172.21.15.89:0/2973186089 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7b50062110 con 0x7f7b5009b570 2023-12-07T21:08:46.801 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.808+0000 7f7b377fe640 1 -- 172.21.15.89:0/2973186089 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7b40017070 con 0x7f7b5009b570 2023-12-07T21:08:46.801 INFO:teuthology.orchestra.run.smithi089.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-07T21:08:46.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.810+0000 7f7b5566f640 1 -- 172.21.15.89:0/2973186089 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b3c037820 msgr2=0x7f7b3c039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:46.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.810+0000 7f7b5566f640 1 --2- 172.21.15.89:0/2973186089 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b3c037820 0x7f7b3c039ce0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7b44036000 tx=0x7f7b44008030 comp rx=0 tx=0).stop 2023-12-07T21:08:46.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.810+0000 7f7b5566f640 1 -- 172.21.15.89:0/2973186089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5009b570 msgr2=0x7f7b5011a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:46.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.810+0000 7f7b5566f640 1 --2- 172.21.15.89:0/2973186089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5009b570 0x7f7b5011a990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000cb20 tx=0x7f7b4000a060 comp rx=0 tx=0).stop 2023-12-07T21:08:46.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.810+0000 7f7b5566f640 1 -- 172.21.15.89:0/2973186089 shutdown_connections 2023-12-07T21:08:46.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.810+0000 7f7b5566f640 1 --2- 172.21.15.89:0/2973186089 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b3c037820 0x7f7b3c039ce0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:46.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.810+0000 7f7b5566f640 1 --2- 172.21.15.89:0/2973186089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5009b570 0x7f7b5011a990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:46.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.810+0000 7f7b5566f640 1 -- 172.21.15.89:0/2973186089 >> 172.21.15.89:0/2973186089 conn(0x7f7b5006c760 msgr2=0x7f7b5012d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:46.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.810+0000 7f7b5566f640 1 -- 172.21.15.89:0/2973186089 shutdown_connections 2023-12-07T21:08:46.804 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.810+0000 7f7b5566f640 1 -- 172.21.15.89:0/2973186089 wait complete. 2023-12-07T21:08:46.817 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-07T21:08:46.817 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-07T21:08:46.818 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-07T21:08:46.818 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-07T21:08:46.818 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-07T21:08:46.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a42d47640 1 Processor -- start 2023-12-07T21:08:46.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a42d47640 1 -- start start 2023-12-07T21:08:46.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a42d47640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a3c12d530 0x7f5a3c12f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:46.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a42d47640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c12a1e0 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.920 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a42d47640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c06f890 con 0x7f5a3c12d530 2023-12-07T21:08:46.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a3bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a3c12d530 0x7f5a3c12f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:46.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a40ae3640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5a3c12a5a0 0x7f5a3c12a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48626/0 (socket says 172.21.15.89:48626) 2023-12-07T21:08:46.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a40ae3640 1 -- 172.21.15.89:0/62775501 learned_addr learned my addr 172.21.15.89:0/62775501 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:46.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a3b7fe640 1 -- 172.21.15.89:0/62775501 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493507134 0 0) 0x7f5a3c12a1e0 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a3b7fe640 1 -- 172.21.15.89:0/62775501 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a24003520 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a3bfff640 1 -- 172.21.15.89:0/62775501 >> v1:172.21.15.89:6789/0 conn(0x7f5a3c12a5a0 legacy=0x7f5a3c12a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:46.921 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.926+0000 7f5a3bfff640 1 -- 172.21.15.89:0/62775501 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c06f220 con 0x7f5a3c12d530 2023-12-07T21:08:46.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.927+0000 7f5a3bfff640 1 --2- 172.21.15.89:0/62775501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a3c12d530 0x7f5a3c12f920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009720 tx=0x7f5a3002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9805d15aec2f94 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:46.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.927+0000 7f5a3b7fe640 1 -- 172.21.15.89:0/62775501 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a30031760 con 0x7f5a3c12d530 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.927+0000 7f5a3b7fe640 1 -- 172.21.15.89:0/62775501 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a300318c0 con 0x7f5a3c12d530 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.927+0000 7f5a3b7fe640 1 -- 172.21.15.89:0/62775501 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a30031b80 con 0x7f5a3c12d530 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.928+0000 7f5a42d47640 1 -- 172.21.15.89:0/62775501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a3c12d530 msgr2=0x7f5a3c12f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.928+0000 7f5a42d47640 1 --2- 172.21.15.89:0/62775501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a3c12d530 0x7f5a3c12f920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009720 tx=0x7f5a3002b8d0 comp rx=0 tx=0).stop 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.928+0000 7f5a42d47640 1 -- 172.21.15.89:0/62775501 shutdown_connections 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.928+0000 7f5a42d47640 1 --2- 172.21.15.89:0/62775501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a3c12d530 0x7f5a3c12f920 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.928+0000 7f5a42d47640 1 -- 172.21.15.89:0/62775501 >> 172.21.15.89:0/62775501 conn(0x7f5a3c0987f0 msgr2=0x7f5a3c098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.928+0000 7f5a42d47640 1 -- 172.21.15.89:0/62775501 shutdown_connections 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.928+0000 7f5a42d47640 1 -- 172.21.15.89:0/62775501 wait complete. 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.929+0000 7f5a42d47640 1 Processor -- start 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.929+0000 7f5a42d47640 1 -- start start 2023-12-07T21:08:46.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.929+0000 7f5a42d47640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a3c12a5a0 0x7f5a3c1beae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:46.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.929+0000 7f5a42d47640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c08d9f0 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.929+0000 7f5a40ae3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a3c12a5a0 0x7f5a3c1beae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:46.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.929+0000 7f5a40ae3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a3c12a5a0 0x7f5a3c1beae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39814/0 (socket says 172.21.15.89:39814) 2023-12-07T21:08:46.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.929+0000 7f5a40ae3640 1 -- 172.21.15.89:0/269353930 learned_addr learned my addr 172.21.15.89:0/269353930 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:46.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.929+0000 7f5a40ae3640 1 -- 172.21.15.89:0/269353930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009400 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.930+0000 7f5a40ae3640 1 --2- 172.21.15.89:0/269353930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a3c12a5a0 0x7f5a3c1beae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400cb40 tx=0x7f5a3400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:46.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.930+0000 7f5a397fa640 1 -- 172.21.15.89:0/269353930 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a3400abf0 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.930+0000 7f5a397fa640 1 -- 172.21.15.89:0/269353930 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3400ad50 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.930+0000 7f5a42d47640 1 -- 172.21.15.89:0/269353930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c123c00 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.930+0000 7f5a397fa640 1 -- 172.21.15.89:0/269353930 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5a34012400 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.930+0000 7f5a42d47640 1 -- 172.21.15.89:0/269353930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c08d790 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.931+0000 7f5a397fa640 1 -- 172.21.15.89:0/269353930 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f5a34007070 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.931+0000 7f5a397fa640 1 --2- 172.21.15.89:0/269353930 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5a28037820 0x7f5a28039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:46.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.931+0000 7f5a42d47640 1 -- 172.21.15.89:0/269353930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c062110 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.931+0000 7f5a397fa640 1 -- 172.21.15.89:0/269353930 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f5a3404a050 con 0x7f5a3c12a5a0 2023-12-07T21:08:46.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.931+0000 7f5a3bfff640 1 --2- 172.21.15.89:0/269353930 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5a28037820 0x7f5a28039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:46.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.932+0000 7f5a3bfff640 1 --2- 172.21.15.89:0/269353930 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5a28037820 0x7f5a28039ce0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5a30036000 tx=0x7f5a30008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:46.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:46.935+0000 7f5a397fa640 1 -- 172.21.15.89:0/269353930 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a34017080 con 0x7f5a3c12a5a0 2023-12-07T21:08:47.140 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.146+0000 7f5a42d47640 1 -- 172.21.15.89:0/269353930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5a3c066d20 con 0x7f5a3c12a5a0 2023-12-07T21:08:47.142 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.148+0000 7f5a397fa640 1 -- 172.21.15.89:0/269353930 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+86182 (secure 0 0 0) 0x7f5a340192c0 con 0x7f5a3c12a5a0 2023-12-07T21:08:47.143 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:47.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.150+0000 7f5a42d47640 1 -- 172.21.15.89:0/269353930 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5a28037820 msgr2=0x7f5a28039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.150+0000 7f5a42d47640 1 --2- 172.21.15.89:0/269353930 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5a28037820 0x7f5a28039ce0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5a30036000 tx=0x7f5a30008030 comp rx=0 tx=0).stop 2023-12-07T21:08:47.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.150+0000 7f5a42d47640 1 -- 172.21.15.89:0/269353930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a3c12a5a0 msgr2=0x7f5a3c1beae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.150+0000 7f5a42d47640 1 --2- 172.21.15.89:0/269353930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a3c12a5a0 0x7f5a3c1beae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400cb40 tx=0x7f5a3400a060 comp rx=0 tx=0).stop 2023-12-07T21:08:47.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.150+0000 7f5a42d47640 1 -- 172.21.15.89:0/269353930 shutdown_connections 2023-12-07T21:08:47.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.150+0000 7f5a42d47640 1 --2- 172.21.15.89:0/269353930 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5a28037820 0x7f5a28039ce0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.150+0000 7f5a42d47640 1 --2- 172.21.15.89:0/269353930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a3c12a5a0 0x7f5a3c1beae0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.144 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.150+0000 7f5a42d47640 1 -- 172.21.15.89:0/269353930 >> 172.21.15.89:0/269353930 conn(0x7f5a3c0987f0 msgr2=0x7f5a3c126df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.150+0000 7f5a42d47640 1 -- 172.21.15.89:0/269353930 shutdown_connections 2023-12-07T21:08:47.145 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.150+0000 7f5a42d47640 1 -- 172.21.15.89:0/269353930 wait complete. 2023-12-07T21:08:47.154 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3175226153},{"type":"v1","addr":"172.21.15.121:6825","nonce":3175226153}]},"active_addr":"172.21.15.121:6825/3175226153","active_change":"2023-12-07T21:08:34.040906+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":4104601005}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":2931756564}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":1236705934}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.121:0","nonce":139862020}]}]} 2023-12-07T21:08:47.157 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-07T21:08:47.157 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-07T21:08:47.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T21:08:47.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.263+0000 7f5518761640 1 Processor -- start 2023-12-07T21:08:47.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.263+0000 7f5518761640 1 -- start start 2023-12-07T21:08:47.257 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.263+0000 7f5518761640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f551012a5a0 0x7f551012a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.263+0000 7f5518761640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551012a1e0 con 0x7f551012aec0 2023-12-07T21:08:47.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.263+0000 7f5518761640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551006f890 con 0x7f551012a5a0 2023-12-07T21:08:47.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.263+0000 7f55164fd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f551012a5a0 0x7f551012a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.263+0000 7f5515cfc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f551012aec0 0x7f5510126ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48640/0 (socket says 172.21.15.89:48640) 2023-12-07T21:08:47.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.263+0000 7f5515cfc640 1 -- 172.21.15.89:0/3094393133 learned_addr learned my addr 172.21.15.89:0/3094393133 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:47.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.264+0000 7f55164fd640 1 -- 172.21.15.89:0/3094393133 >> v1:172.21.15.89:6789/0 conn(0x7f551012aec0 legacy=0x7f5510126ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.264+0000 7f55164fd640 1 -- 172.21.15.89:0/3094393133 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551006f220 con 0x7f551012a5a0 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.264+0000 7f55164fd640 1 --2- 172.21.15.89:0/3094393133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551012a5a0 0x7f551012a980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f550c009720 tx=0x7f550c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db87067e8d5e0dbc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.264+0000 7f55154fb640 1 -- 172.21.15.89:0/3094393133 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f550c031760 con 0x7f551012a5a0 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.264+0000 7f55154fb640 1 -- 172.21.15.89:0/3094393133 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c0318c0 con 0x7f551012a5a0 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.264+0000 7f55154fb640 1 -- 172.21.15.89:0/3094393133 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f550c031b80 con 0x7f551012a5a0 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.265+0000 7f5518761640 1 -- 172.21.15.89:0/3094393133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551012a5a0 msgr2=0x7f551012a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.265+0000 7f5518761640 1 --2- 172.21.15.89:0/3094393133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551012a5a0 0x7f551012a980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f550c009720 tx=0x7f550c02b8d0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.265+0000 7f5518761640 1 -- 172.21.15.89:0/3094393133 shutdown_connections 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.265+0000 7f5518761640 1 --2- 172.21.15.89:0/3094393133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551012a5a0 0x7f551012a980 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.265+0000 7f5518761640 1 -- 172.21.15.89:0/3094393133 >> 172.21.15.89:0/3094393133 conn(0x7f55100987f0 msgr2=0x7f5510098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.265+0000 7f5518761640 1 -- 172.21.15.89:0/3094393133 shutdown_connections 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.265+0000 7f5518761640 1 -- 172.21.15.89:0/3094393133 wait complete. 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.266+0000 7f5518761640 1 Processor -- start 2023-12-07T21:08:47.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.266+0000 7f5518761640 1 -- start start 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.266+0000 7f5518761640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551012a5a0 0x7f551012b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.266+0000 7f5518761640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551009acd0 con 0x7f551012a5a0 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.266+0000 7f55164fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551012a5a0 0x7f551012b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.266+0000 7f55164fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551012a5a0 0x7f551012b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39826/0 (socket says 172.21.15.89:39826) 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.266+0000 7f55164fd640 1 -- 172.21.15.89:0/883305836 learned_addr learned my addr 172.21.15.89:0/883305836 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.266+0000 7f55164fd640 1 -- 172.21.15.89:0/883305836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c009400 con 0x7f551012a5a0 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.267+0000 7f55164fd640 1 --2- 172.21.15.89:0/883305836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551012a5a0 0x7f551012b2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f550c009840 tx=0x7f550c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.267+0000 7f5506ffd640 1 -- 172.21.15.89:0/883305836 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f550c03b870 con 0x7f551012a5a0 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.267+0000 7f5506ffd640 1 -- 172.21.15.89:0/883305836 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c03b9f0 con 0x7f551012a5a0 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.267+0000 7f5518761640 1 -- 172.21.15.89:0/883305836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55101302c0 con 0x7f551012a5a0 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.267+0000 7f5506ffd640 1 -- 172.21.15.89:0/883305836 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f550c03bcd0 con 0x7f551012a5a0 2023-12-07T21:08:47.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.267+0000 7f5518761640 1 -- 172.21.15.89:0/883305836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551012cc70 con 0x7f551012a5a0 2023-12-07T21:08:47.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.267+0000 7f5506ffd640 1 -- 172.21.15.89:0/883305836 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f550c04e450 con 0x7f551012a5a0 2023-12-07T21:08:47.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.268+0000 7f5506ffd640 1 --2- 172.21.15.89:0/883305836 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f54f4037820 0x7f54f4039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.268+0000 7f5518761640 1 -- 172.21.15.89:0/883305836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551012d210 con 0x7f551012a5a0 2023-12-07T21:08:47.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.268+0000 7f5506ffd640 1 -- 172.21.15.89:0/883305836 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f550c06c390 con 0x7f551012a5a0 2023-12-07T21:08:47.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.268+0000 7f5515cfc640 1 --2- 172.21.15.89:0/883305836 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f54f4037820 0x7f54f4039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.268+0000 7f5515cfc640 1 --2- 172.21.15.89:0/883305836 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f54f4037820 0x7f54f4039ce0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5500005880 tx=0x7f5500007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.272+0000 7f5506ffd640 1 -- 172.21.15.89:0/883305836 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f550c03be30 con 0x7f551012a5a0 2023-12-07T21:08:47.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.439+0000 7f5518761640 1 -- 172.21.15.89:0/883305836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5510062110 con 0x7f551012a5a0 2023-12-07T21:08:47.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.439+0000 7f5506ffd640 1 -- 172.21.15.89:0/883305836 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9689 (secure 0 0 0) 0x7f550c04db50 con 0x7f551012a5a0 2023-12-07T21:08:47.433 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:47.433 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":15,"fsid":"49fe948c-b519-4268-9cf3-54fad381ce79","created":"2023-12-07T21:08:29.796839+0000","modified":"2023-12-07T21:08:46.808225+0000","last_up_change":"2023-12-07T21:08:38.626187+0000","last_in_change":"2023-12-07T21:08:30.921504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T21:08:40.087062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-07T21:08:45.355151+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7d49515-b2a2-4323-9af0-d3ba338a0dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6801","nonce":654939948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6803","nonce":654939948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6807","nonce":654939948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6805","nonce":654939948}]},"public_addr":"172.21.15.89:6801/654939948","cluster_addr":"172.21.15.89:6803/654939948","heartbeat_back_addr":"172.21.15.89:6807/654939948","heartbeat_front_addr":"172.21.15.89:6805/654939948","state":["exists","up"]},{"osd":1,"uuid":"ab1d5fe6-a976-4a30-abd1-a28b2c6de703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6809","nonce":2140819418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6811","nonce":2140819418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6815","nonce":2140819418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6813","nonce":2140819418}]},"public_addr":"172.21.15.121:6809/2140819418","cluster_addr":"172.21.15.121:6811/2140819418","heartbeat_back_addr":"172.21.15.121:6815/2140819418","heartbeat_front_addr":"172.21.15.121:6813/2140819418","state":["exists","up"]},{"osd":2,"uuid":"9426627e-2a0c-4ce2-9f5d-57bb763a881c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6817","nonce":2557538450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6819","nonce":2557538450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6823","nonce":2557538450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6821","nonce":2557538450}]},"public_addr":"172.21.15.121:6817/2557538450","cluster_addr":"172.21.15.121:6819/2557538450","heartbeat_back_addr":"172.21.15.121:6823/2557538450","heartbeat_front_addr":"172.21.15.121:6821/2557538450","state":["exists","up"]},{"osd":3,"uuid":"02e748fb-1486-4c5c-8d34-7221bdfca701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6801","nonce":4032235766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6803","nonce":4032235766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6807","nonce":4032235766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6805","nonce":4032235766}]},"public_addr":"172.21.15.121:6801/4032235766","cluster_addr":"172.21.15.121:6803/4032235766","heartbeat_back_addr":"172.21.15.121:6807/4032235766","heartbeat_front_addr":"172.21.15.121:6805/4032235766","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:35.919729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:36.084357+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:36.076845+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:35.994710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T21:08:47.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.441+0000 7f5518761640 1 -- 172.21.15.89:0/883305836 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f54f4037820 msgr2=0x7f54f4039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.441+0000 7f5518761640 1 --2- 172.21.15.89:0/883305836 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f54f4037820 0x7f54f4039ce0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5500005880 tx=0x7f5500007a80 comp rx=0 tx=0).stop 2023-12-07T21:08:47.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.441+0000 7f5518761640 1 -- 172.21.15.89:0/883305836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551012a5a0 msgr2=0x7f551012b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.441+0000 7f5518761640 1 --2- 172.21.15.89:0/883305836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551012a5a0 0x7f551012b2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f550c009840 tx=0x7f550c0046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.441+0000 7f5518761640 1 -- 172.21.15.89:0/883305836 shutdown_connections 2023-12-07T21:08:47.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.441+0000 7f5518761640 1 --2- 172.21.15.89:0/883305836 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f54f4037820 0x7f54f4039ce0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.441+0000 7f5518761640 1 --2- 172.21.15.89:0/883305836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f551012a5a0 0x7f551012b2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.441+0000 7f5518761640 1 -- 172.21.15.89:0/883305836 >> 172.21.15.89:0/883305836 conn(0x7f55100987f0 msgr2=0x7f5510129270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.441+0000 7f5518761640 1 -- 172.21.15.89:0/883305836 shutdown_connections 2023-12-07T21:08:47.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.441+0000 7f5518761640 1 -- 172.21.15.89:0/883305836 wait complete. 2023-12-07T21:08:47.445 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-07T21:08:47.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T21:08:47.544 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.550+0000 7fb219690640 1 Processor -- start 2023-12-07T21:08:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.550+0000 7fb219690640 1 -- start start 2023-12-07T21:08:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.551+0000 7fb219690640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb21409c060 0x7fb214132bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.551+0000 7fb219690640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb214099490 con 0x7fb21409b570 2023-12-07T21:08:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.551+0000 7fb219690640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb214099ad0 con 0x7fb21409c060 2023-12-07T21:08:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.551+0000 7fb2127fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb21409c060 0x7fb214132bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.551+0000 7fb212ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb21409b570 0x7fb21409b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48648/0 (socket says 172.21.15.89:48648) 2023-12-07T21:08:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.551+0000 7fb212ffd640 1 -- 172.21.15.89:0/502932208 learned_addr learned my addr 172.21.15.89:0/502932208 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.551+0000 7fb2127fc640 1 -- 172.21.15.89:0/502932208 >> v1:172.21.15.89:6789/0 conn(0x7fb21409b570 legacy=0x7fb21409b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.551+0000 7fb211ffb640 1 -- 172.21.15.89:0/502932208 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452557527 0 0) 0x7fb214099490 con 0x7fb21409b570 2023-12-07T21:08:47.545 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.551+0000 7fb2127fc640 1 -- 172.21.15.89:0/502932208 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21409a040 con 0x7fb21409c060 2023-12-07T21:08:47.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.552+0000 7fb2127fc640 1 --2- 172.21.15.89:0/502932208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb21409c060 0x7fb214132bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb208009720 tx=0x7fb20802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5808e8b001dc0ab server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.552+0000 7fb211ffb640 1 -- 172.21.15.89:0/502932208 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb20802e070 con 0x7fb21409c060 2023-12-07T21:08:47.546 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.552+0000 7fb211ffb640 1 -- 172.21.15.89:0/502932208 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2080316d0 con 0x7fb21409c060 2023-12-07T21:08:47.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.552+0000 7fb211ffb640 1 -- 172.21.15.89:0/502932208 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb208031990 con 0x7fb21409c060 2023-12-07T21:08:47.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.552+0000 7fb219690640 1 -- 172.21.15.89:0/502932208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb21409c060 msgr2=0x7fb214132bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.552+0000 7fb219690640 1 --2- 172.21.15.89:0/502932208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb21409c060 0x7fb214132bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb208009720 tx=0x7fb20802b840 comp rx=0 tx=0).stop 2023-12-07T21:08:47.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.552+0000 7fb219690640 1 -- 172.21.15.89:0/502932208 shutdown_connections 2023-12-07T21:08:47.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.552+0000 7fb219690640 1 --2- 172.21.15.89:0/502932208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb21409c060 0x7fb214132bd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.552+0000 7fb219690640 1 -- 172.21.15.89:0/502932208 >> 172.21.15.89:0/502932208 conn(0x7fb21406c730 msgr2=0x7fb21406cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.552+0000 7fb219690640 1 -- 172.21.15.89:0/502932208 shutdown_connections 2023-12-07T21:08:47.547 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.552+0000 7fb219690640 1 -- 172.21.15.89:0/502932208 wait complete. 2023-12-07T21:08:47.548 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.553+0000 7fb219690640 1 Processor -- start 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.553+0000 7fb219690640 1 -- start start 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb219690640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb21409b570 0x7fb214129d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb219690640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21412e0e0 con 0x7fb21409b570 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb212ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb21409b570 0x7fb214129d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb212ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb21409b570 0x7fb214129d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39854/0 (socket says 172.21.15.89:39854) 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb212ffd640 1 -- 172.21.15.89:0/526628024 learned_addr learned my addr 172.21.15.89:0/526628024 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb212ffd640 1 -- 172.21.15.89:0/526628024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb208009400 con 0x7fb21409b570 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb212ffd640 1 --2- 172.21.15.89:0/526628024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb21409b570 0x7fb214129d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb20400c700 tx=0x7fb20400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb1fb7fe640 1 -- 172.21.15.89:0/526628024 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb204004d70 con 0x7fb21409b570 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb1fb7fe640 1 -- 172.21.15.89:0/526628024 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20400a660 con 0x7fb21409b570 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb219690640 1 -- 172.21.15.89:0/526628024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21411c130 con 0x7fb21409b570 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb1fb7fe640 1 -- 172.21.15.89:0/526628024 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb20400a940 con 0x7fb21409b570 2023-12-07T21:08:47.549 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.554+0000 7fb219690640 1 -- 172.21.15.89:0/526628024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21411cd80 con 0x7fb21409b570 2023-12-07T21:08:47.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.555+0000 7fb1fb7fe640 1 -- 172.21.15.89:0/526628024 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fb20400aaa0 con 0x7fb21409b570 2023-12-07T21:08:47.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.555+0000 7fb219690640 1 -- 172.21.15.89:0/526628024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb214062110 con 0x7fb21409b570 2023-12-07T21:08:47.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.556+0000 7fb1fb7fe640 1 --2- 172.21.15.89:0/526628024 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb200037820 0x7fb200039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.556+0000 7fb1fb7fe640 1 -- 172.21.15.89:0/526628024 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fb204049970 con 0x7fb21409b570 2023-12-07T21:08:47.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.556+0000 7fb2127fc640 1 --2- 172.21.15.89:0/526628024 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb200037820 0x7fb200039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.556+0000 7fb2127fc640 1 --2- 172.21.15.89:0/526628024 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb200037820 0x7fb200039ce0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb208036000 tx=0x7fb208008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.560+0000 7fb1fb7fe640 1 -- 172.21.15.89:0/526628024 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb20401a2c0 con 0x7fb21409b570 2023-12-07T21:08:47.719 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.726+0000 7fb219690640 1 -- 172.21.15.89:0/526628024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb214066d20 con 0x7fb21409b570 2023-12-07T21:08:47.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.726+0000 7fb1fb7fe640 1 -- 172.21.15.89:0/526628024 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+9689 (secure 0 0 0) 0x7fb204018030 con 0x7fb21409b570 2023-12-07T21:08:47.720 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:47.720 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":15,"fsid":"49fe948c-b519-4268-9cf3-54fad381ce79","created":"2023-12-07T21:08:29.796839+0000","modified":"2023-12-07T21:08:46.808225+0000","last_up_change":"2023-12-07T21:08:38.626187+0000","last_in_change":"2023-12-07T21:08:30.921504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T21:08:40.087062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-07T21:08:45.355151+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7d49515-b2a2-4323-9af0-d3ba338a0dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6801","nonce":654939948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6803","nonce":654939948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6807","nonce":654939948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6805","nonce":654939948}]},"public_addr":"172.21.15.89:6801/654939948","cluster_addr":"172.21.15.89:6803/654939948","heartbeat_back_addr":"172.21.15.89:6807/654939948","heartbeat_front_addr":"172.21.15.89:6805/654939948","state":["exists","up"]},{"osd":1,"uuid":"ab1d5fe6-a976-4a30-abd1-a28b2c6de703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6809","nonce":2140819418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6811","nonce":2140819418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6815","nonce":2140819418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6813","nonce":2140819418}]},"public_addr":"172.21.15.121:6809/2140819418","cluster_addr":"172.21.15.121:6811/2140819418","heartbeat_back_addr":"172.21.15.121:6815/2140819418","heartbeat_front_addr":"172.21.15.121:6813/2140819418","state":["exists","up"]},{"osd":2,"uuid":"9426627e-2a0c-4ce2-9f5d-57bb763a881c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6817","nonce":2557538450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6819","nonce":2557538450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6823","nonce":2557538450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6821","nonce":2557538450}]},"public_addr":"172.21.15.121:6817/2557538450","cluster_addr":"172.21.15.121:6819/2557538450","heartbeat_back_addr":"172.21.15.121:6823/2557538450","heartbeat_front_addr":"172.21.15.121:6821/2557538450","state":["exists","up"]},{"osd":3,"uuid":"02e748fb-1486-4c5c-8d34-7221bdfca701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6801","nonce":4032235766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6803","nonce":4032235766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6807","nonce":4032235766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6805","nonce":4032235766}]},"public_addr":"172.21.15.121:6801/4032235766","cluster_addr":"172.21.15.121:6803/4032235766","heartbeat_back_addr":"172.21.15.121:6807/4032235766","heartbeat_front_addr":"172.21.15.121:6805/4032235766","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:35.919729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:36.084357+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:36.076845+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:35.994710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T21:08:47.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.728+0000 7fb219690640 1 -- 172.21.15.89:0/526628024 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb200037820 msgr2=0x7fb200039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.728+0000 7fb219690640 1 --2- 172.21.15.89:0/526628024 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb200037820 0x7fb200039ce0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb208036000 tx=0x7fb208008030 comp rx=0 tx=0).stop 2023-12-07T21:08:47.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.728+0000 7fb219690640 1 -- 172.21.15.89:0/526628024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb21409b570 msgr2=0x7fb214129d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.728+0000 7fb219690640 1 --2- 172.21.15.89:0/526628024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb21409b570 0x7fb214129d70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb20400c700 tx=0x7fb20400cbc0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.728+0000 7fb219690640 1 -- 172.21.15.89:0/526628024 shutdown_connections 2023-12-07T21:08:47.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.728+0000 7fb219690640 1 --2- 172.21.15.89:0/526628024 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb200037820 0x7fb200039ce0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.728+0000 7fb219690640 1 --2- 172.21.15.89:0/526628024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb21409b570 0x7fb214129d70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.728+0000 7fb219690640 1 -- 172.21.15.89:0/526628024 >> 172.21.15.89:0/526628024 conn(0x7fb21406c730 msgr2=0x7fb21409e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.728+0000 7fb219690640 1 -- 172.21.15.89:0/526628024 shutdown_connections 2023-12-07T21:08:47.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.728+0000 7fb219690640 1 -- 172.21.15.89:0/526628024 wait complete. 2023-12-07T21:08:47.734 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-07T21:08:47.735 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-07T21:08:47.735 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-07T21:08:47.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-07T21:08:47.841 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f4e18026640 1 Processor -- start 2023-12-07T21:08:47.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7fa560809640 1 Processor -- start 2023-12-07T21:08:47.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7fa560809640 1 -- start start 2023-12-07T21:08:47.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f8601d65640 1 Processor -- start 2023-12-07T21:08:47.842 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f4e18026640 1 -- start start 2023-12-07T21:08:47.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f8601d65640 1 -- start start 2023-12-07T21:08:47.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f8601d65640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f85fc127150 0x7f85fc127530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f4e18026640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4e1012dad0 0x7f4e1012deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.843 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f8601d65640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85fc06f190 con 0x7f85fc06f7e0 2023-12-07T21:08:47.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f8601d65640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85fc09ad20 con 0x7f85fc127150 2023-12-07T21:08:47.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7fa560809640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa55c096580 0x7fa55c096960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7fa560809640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c071580 con 0x7fa55c06efd0 2023-12-07T21:08:47.844 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7fa560809640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c070e30 con 0x7fa55c096580 2023-12-07T21:08:47.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f4e18026640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e100716d0 con 0x7f4e1012e3f0 2023-12-07T21:08:47.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f4e18026640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1006f090 con 0x7f4e1012dad0 2023-12-07T21:08:47.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f4e15dc2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4e1012dad0 0x7f4e1012deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f4e15dc2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4e1012dad0 0x7f4e1012deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39870/0 (socket says 172.21.15.89:39870) 2023-12-07T21:08:47.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7f4e15dc2640 1 -- 172.21.15.89:0/2385561000 learned_addr learned my addr 172.21.15.89:0/2385561000 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:47.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.848+0000 7fa55a59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa55c096580 0x7fa55c096960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7fa55a59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa55c096580 0x7fa55c096960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39884/0 (socket says 172.21.15.89:39884) 2023-12-07T21:08:47.845 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7fa55a59c640 1 -- 172.21.15.89:0/2127745827 learned_addr learned my addr 172.21.15.89:0/2127745827 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:47.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7f85faffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f85fc06f7e0 0x7f85fc06dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48664/0 (socket says 172.21.15.89:48664) 2023-12-07T21:08:47.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7f85fb7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f85fc127150 0x7f85fc127530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7f85faffd640 1 -- 172.21.15.89:0/8548321 learned_addr learned my addr 172.21.15.89:0/8548321 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:47.846 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7f195026f640 1 Processor -- start 2023-12-07T21:08:47.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7f4e15dc2640 1 -- 172.21.15.89:0/2385561000 >> v1:172.21.15.89:6789/0 conn(0x7f4e1012e3f0 legacy=0x7f4e1006c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7f4e15dc2640 1 -- 172.21.15.89:0/2385561000 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1006dd00 con 0x7f4e1012dad0 2023-12-07T21:08:47.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7fa55a59c640 1 -- 172.21.15.89:0/2127745827 >> v1:172.21.15.89:6789/0 conn(0x7fa55c06efd0 legacy=0x7fa55c06f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.847 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7fa55a59c640 1 -- 172.21.15.89:0/2127745827 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0706c0 con 0x7fa55c096580 2023-12-07T21:08:47.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7f85fb7fe640 1 -- 172.21.15.89:0/8548321 >> v1:172.21.15.89:6789/0 conn(0x7f85fc06f7e0 legacy=0x7f85fc06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7f85fb7fe640 1 -- 172.21.15.89:0/8548321 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc126d00 con 0x7f85fc127150 2023-12-07T21:08:47.848 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.849+0000 7f195026f640 1 -- start start 2023-12-07T21:08:47.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f195026f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1948096580 0x7f1948096960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f195026f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1948071580 con 0x7f194806efd0 2023-12-07T21:08:47.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f195026f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1948070e30 con 0x7f1948096580 2023-12-07T21:08:47.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f194e00b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1948096580 0x7f1948096960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f194e00b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1948096580 0x7f1948096960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39894/0 (socket says 172.21.15.89:39894) 2023-12-07T21:08:47.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f194e00b640 1 -- 172.21.15.89:0/427712924 learned_addr learned my addr 172.21.15.89:0/427712924 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:47.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f4e15dc2640 1 --2- 172.21.15.89:0/2385561000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1012dad0 0x7f4e1012deb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0097f0 tx=0x7f4e0c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414f79c98c4c9a56 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.849 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7fa55a59c640 1 --2- 172.21.15.89:0/2127745827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55c096580 0x7fa55c096960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0097f0 tx=0x7fa54c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a9d473e8d11d42 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f194e00b640 1 -- 172.21.15.89:0/427712924 >> v1:172.21.15.89:6789/0 conn(0x7f194806efd0 legacy=0x7f194806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f194d009640 1 -- 172.21.15.89:0/427712924 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985344507 0 0) 0x7f1948071580 con 0x7f194806efd0 2023-12-07T21:08:47.850 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f4e14dc0640 1 -- 172.21.15.89:0/2385561000 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e0c0317a0 con 0x7f4e1012dad0 2023-12-07T21:08:47.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f85fb7fe640 1 --2- 172.21.15.89:0/8548321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc127150 0x7f85fc127530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009720 tx=0x7f85ec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1090101281de6f7d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f194e00b640 1 -- 172.21.15.89:0/427712924 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480706c0 con 0x7f1948096580 2023-12-07T21:08:47.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f4e14dc0640 1 -- 172.21.15.89:0/2385561000 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c031900 con 0x7f4e1012dad0 2023-12-07T21:08:47.851 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f4e14dc0640 1 -- 172.21.15.89:0/2385561000 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e0c031bc0 con 0x7f4e1012dad0 2023-12-07T21:08:47.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7fa55959a640 1 -- 172.21.15.89:0/2127745827 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c0317a0 con 0x7fa55c096580 2023-12-07T21:08:47.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7fa55959a640 1 -- 172.21.15.89:0/2127745827 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c031900 con 0x7fa55c096580 2023-12-07T21:08:47.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7fa55959a640 1 -- 172.21.15.89:0/2127745827 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c031bc0 con 0x7fa55c096580 2023-12-07T21:08:47.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f85fa7fc640 1 -- 172.21.15.89:0/8548321 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85ec02e070 con 0x7f85fc127150 2023-12-07T21:08:47.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.850+0000 7f85fa7fc640 1 -- 172.21.15.89:0/8548321 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec0316d0 con 0x7f85fc127150 2023-12-07T21:08:47.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f85fa7fc640 1 -- 172.21.15.89:0/8548321 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85ec031990 con 0x7f85fc127150 2023-12-07T21:08:47.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f4e18026640 1 -- 172.21.15.89:0/2385561000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1012dad0 msgr2=0x7f4e1012deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f4e18026640 1 --2- 172.21.15.89:0/2385561000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1012dad0 0x7f4e1012deb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0097f0 tx=0x7f4e0c02b910 comp rx=0 tx=0).stop 2023-12-07T21:08:47.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7fa560809640 1 -- 172.21.15.89:0/2127745827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55c096580 msgr2=0x7fa55c096960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7fa560809640 1 --2- 172.21.15.89:0/2127745827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55c096580 0x7fa55c096960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0097f0 tx=0x7fa54c02b910 comp rx=0 tx=0).stop 2023-12-07T21:08:47.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f194e00b640 1 --2- 172.21.15.89:0/427712924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1948096580 0x7f1948096960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19440097f0 tx=0x7f194402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acbad4b789024a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f4e18026640 1 -- 172.21.15.89:0/2385561000 shutdown_connections 2023-12-07T21:08:47.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f4e18026640 1 --2- 172.21.15.89:0/2385561000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1012dad0 0x7f4e1012deb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f4e18026640 1 -- 172.21.15.89:0/2385561000 >> 172.21.15.89:0/2385561000 conn(0x7f4e1009ac70 msgr2=0x7f4e10098540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f8601d65640 1 -- 172.21.15.89:0/8548321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc127150 msgr2=0x7f85fc127530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f8601d65640 1 --2- 172.21.15.89:0/8548321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc127150 0x7f85fc127530 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009720 tx=0x7f85ec02b840 comp rx=0 tx=0).stop 2023-12-07T21:08:47.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7fa560809640 1 -- 172.21.15.89:0/2127745827 shutdown_connections 2023-12-07T21:08:47.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7fa560809640 1 --2- 172.21.15.89:0/2127745827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55c096580 0x7fa55c096960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.855 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7fa560809640 1 -- 172.21.15.89:0/2127745827 >> 172.21.15.89:0/2127745827 conn(0x7fa55c09cea0 msgr2=0x7fa55c099370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f4e18026640 1 -- 172.21.15.89:0/2385561000 shutdown_connections 2023-12-07T21:08:47.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f4e18026640 1 -- 172.21.15.89:0/2385561000 wait complete. 2023-12-07T21:08:47.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f194d009640 1 -- 172.21.15.89:0/427712924 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19440317a0 con 0x7f1948096580 2023-12-07T21:08:47.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f8601d65640 1 -- 172.21.15.89:0/8548321 shutdown_connections 2023-12-07T21:08:47.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7fa560809640 1 -- 172.21.15.89:0/2127745827 shutdown_connections 2023-12-07T21:08:47.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f194d009640 1 -- 172.21.15.89:0/427712924 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944031900 con 0x7f1948096580 2023-12-07T21:08:47.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f8601d65640 1 --2- 172.21.15.89:0/8548321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc127150 0x7f85fc127530 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f8601d65640 1 -- 172.21.15.89:0/8548321 >> 172.21.15.89:0/8548321 conn(0x7f85fc0986a0 msgr2=0x7f85fc098ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f194d009640 1 -- 172.21.15.89:0/427712924 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1944031bc0 con 0x7f1948096580 2023-12-07T21:08:47.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.851+0000 7f8601d65640 1 -- 172.21.15.89:0/8548321 shutdown_connections 2023-12-07T21:08:47.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.852+0000 7f8601d65640 1 -- 172.21.15.89:0/8548321 wait complete. 2023-12-07T21:08:47.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.852+0000 7fa560809640 1 -- 172.21.15.89:0/2127745827 wait complete. 2023-12-07T21:08:47.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.852+0000 7f4e18026640 1 Processor -- start 2023-12-07T21:08:47.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.852+0000 7f195026f640 1 -- 172.21.15.89:0/427712924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1948096580 msgr2=0x7f1948096960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.852+0000 7f8601d65640 1 Processor -- start 2023-12-07T21:08:47.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.852+0000 7f195026f640 1 --2- 172.21.15.89:0/427712924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1948096580 0x7f1948096960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19440097f0 tx=0x7f194402b910 comp rx=0 tx=0).stop 2023-12-07T21:08:47.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.852+0000 7f4e18026640 1 -- start start 2023-12-07T21:08:47.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.852+0000 7f195026f640 1 -- 172.21.15.89:0/427712924 shutdown_connections 2023-12-07T21:08:47.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.852+0000 7f195026f640 1 --2- 172.21.15.89:0/427712924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1948096580 0x7f1948096960 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.852+0000 7f195026f640 1 -- 172.21.15.89:0/427712924 >> 172.21.15.89:0/427712924 conn(0x7f194809cea0 msgr2=0x7f1948099370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f8601d65640 1 -- start start 2023-12-07T21:08:47.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f195026f640 1 -- 172.21.15.89:0/427712924 shutdown_connections 2023-12-07T21:08:47.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f195026f640 1 -- 172.21.15.89:0/427712924 wait complete. 2023-12-07T21:08:47.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f4e18026640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1012dad0 0x7f4e101bef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.861 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f4e18026640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e101210c0 con 0x7f4e1012dad0 2023-12-07T21:08:47.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f8601d65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc06f7e0 0x7f85fc1c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f4e15dc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1012dad0 0x7f4e101bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f8601d65640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc08dcf0 con 0x7f85fc06f7e0 2023-12-07T21:08:47.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f4e15dc2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1012dad0 0x7f4e101bef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39896/0 (socket says 172.21.15.89:39896) 2023-12-07T21:08:47.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f4e15dc2640 1 -- 172.21.15.89:0/2554368442 learned_addr learned my addr 172.21.15.89:0/2554368442 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:47.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7fa560809640 1 Processor -- start 2023-12-07T21:08:47.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f85fb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc06f7e0 0x7f85fc1c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f85fb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc06f7e0 0x7f85fc1c23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39910/0 (socket says 172.21.15.89:39910) 2023-12-07T21:08:47.863 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f85fb7fe640 1 -- 172.21.15.89:0/617140314 learned_addr learned my addr 172.21.15.89:0/617140314 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:47.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7fa560809640 1 -- start start 2023-12-07T21:08:47.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f4e15dc2640 1 -- 172.21.15.89:0/2554368442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c0094d0 con 0x7f4e1012dad0 2023-12-07T21:08:47.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f85fb7fe640 1 -- 172.21.15.89:0/617140314 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec009400 con 0x7f85fc06f7e0 2023-12-07T21:08:47.864 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.853+0000 7f4e15dc2640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1012dad0 0x7f4e101bef60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0097f0 tx=0x7f4e0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f85fb7fe640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc06f7e0 0x7f85fc1c23f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f85ec000c00 tx=0x7f85ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f4e067fc640 1 -- 172.21.15.89:0/2554368442 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e0c03ac70 con 0x7f4e1012dad0 2023-12-07T21:08:47.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f4e18026640 1 -- 172.21.15.89:0/2554368442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e10120d90 con 0x7f4e1012dad0 2023-12-07T21:08:47.865 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f4e067fc640 1 -- 172.21.15.89:0/2554368442 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c03adf0 con 0x7f4e1012dad0 2023-12-07T21:08:47.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f195026f640 1 Processor -- start 2023-12-07T21:08:47.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f4e067fc640 1 -- 172.21.15.89:0/2554368442 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e0c044560 con 0x7f4e1012dad0 2023-12-07T21:08:47.866 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f4e18026640 1 -- 172.21.15.89:0/2554368442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e1011f270 con 0x7f4e1012dad0 2023-12-07T21:08:47.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f195026f640 1 -- start start 2023-12-07T21:08:47.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7fa560809640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55c06efd0 0x7fa55c1bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f85e3fff640 1 -- 172.21.15.89:0/617140314 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85ec032b40 con 0x7f85fc06f7e0 2023-12-07T21:08:47.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f8601d65640 1 -- 172.21.15.89:0/617140314 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85fc0976f0 con 0x7f85fc06f7e0 2023-12-07T21:08:47.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f85e3fff640 1 -- 172.21.15.89:0/617140314 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec032ca0 con 0x7f85fc06f7e0 2023-12-07T21:08:47.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f85e3fff640 1 -- 172.21.15.89:0/617140314 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85ec0453f0 con 0x7f85fc06f7e0 2023-12-07T21:08:47.867 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.854+0000 7f8601d65640 1 -- 172.21.15.89:0/617140314 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85fc08f280 con 0x7f85fc06f7e0 2023-12-07T21:08:47.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f195026f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194806efd0 0x7f19481291f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f4e18026640 1 -- 172.21.15.89:0/2554368442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e100704a0 con 0x7f4e1012dad0 2023-12-07T21:08:47.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7fa560809640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c089e00 con 0x7fa55c06efd0 2023-12-07T21:08:47.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f195026f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194812ace0 con 0x7f194806efd0 2023-12-07T21:08:47.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7fa55a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55c06efd0 0x7fa55c1bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7fa55a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55c06efd0 0x7fa55c1bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39924/0 (socket says 172.21.15.89:39924) 2023-12-07T21:08:47.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7fa55a59c640 1 -- 172.21.15.89:0/4064448806 learned_addr learned my addr 172.21.15.89:0/4064448806 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:47.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f85e1ffb640 1 -- 172.21.15.89:0/617140314 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85fc097560 con 0x7f85fc06f7e0 2023-12-07T21:08:47.869 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f194e00b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194806efd0 0x7f19481291f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f194e00b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194806efd0 0x7f19481291f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39928/0 (socket says 172.21.15.89:39928) 2023-12-07T21:08:47.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f194e00b640 1 -- 172.21.15.89:0/2603540085 learned_addr learned my addr 172.21.15.89:0/2603540085 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:47.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f4e067fc640 1 -- 172.21.15.89:0/2554368442 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f4e0c04d450 con 0x7f4e1012dad0 2023-12-07T21:08:47.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f85e3fff640 1 -- 172.21.15.89:0/617140314 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f85ec04e450 con 0x7f85fc06f7e0 2023-12-07T21:08:47.870 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7fa55a59c640 1 -- 172.21.15.89:0/4064448806 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c0094d0 con 0x7fa55c06efd0 2023-12-07T21:08:47.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f4e067fc640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4df4037820 0x7f4df4039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f85e3fff640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85e80377d0 0x7f85e8039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f85e3fff640 1 -- 172.21.15.89:0/617140314 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f85ec06c660 con 0x7f85fc06f7e0 2023-12-07T21:08:47.871 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7fa55a59c640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55c06efd0 0x7fa55c1bfad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa54c02b950 tx=0x7fa54c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f85e3fff640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f85e803cef0 0x7f85e803f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f194e00b640 1 -- 172.21.15.89:0/2603540085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19440094d0 con 0x7f194806efd0 2023-12-07T21:08:47.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f85e3fff640 1 -- 172.21.15.89:0/617140314 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85e803fa00 con 0x7f85e803cef0 2023-12-07T21:08:47.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f85e3fff640 1 -- 172.21.15.89:0/617140314 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85ec06ec90 con 0x7f85fc06f7e0 2023-12-07T21:08:47.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f4e067fc640 1 -- 172.21.15.89:0/2554368442 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f4e0c02d040 con 0x7f4e1012dad0 2023-12-07T21:08:47.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.855+0000 7f4e067fc640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f4df403cf40 0x7f4df403f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f4e067fc640 1 -- 172.21.15.89:0/2554368442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4df403fa50 con 0x7f4df403cf40 2023-12-07T21:08:47.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f194e00b640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194806efd0 0x7f19481291f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1944000c00 tx=0x7f1944004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7fa54affd640 1 -- 172.21.15.89:0/4064448806 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c0443f0 con 0x7fa55c06efd0 2023-12-07T21:08:47.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7fa54affd640 1 -- 172.21.15.89:0/4064448806 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c044550 con 0x7fa55c06efd0 2023-12-07T21:08:47.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7fa560809640 1 -- 172.21.15.89:0/4064448806 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c08a060 con 0x7fa55c06efd0 2023-12-07T21:08:47.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f4e165c3640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f4df403cf40 0x7f4df403f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f4e067fc640 1 -- 172.21.15.89:0/2554368442 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e0c04b940 con 0x7f4e1012dad0 2023-12-07T21:08:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7fa54affd640 1 -- 172.21.15.89:0/4064448806 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c044830 con 0x7fa55c06efd0 2023-12-07T21:08:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7fa560809640 1 -- 172.21.15.89:0/4064448806 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c089640 con 0x7fa55c06efd0 2023-12-07T21:08:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f193effd640 1 -- 172.21.15.89:0/2603540085 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f194403be50 con 0x7f194806efd0 2023-12-07T21:08:47.875 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f4e155c1640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4df4037820 0x7f4df4039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f4e165c3640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f4df403cf40 0x7f4df403f380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f4e155c1640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4df4037820 0x7f4df4039ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e00000f60 tx=0x7f4e00007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f85faffd640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85e80377d0 0x7f85e8039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7f85fbfff640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f85e803cef0 0x7f85e803f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7fa54affd640 1 -- 172.21.15.89:0/4064448806 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa54c04d450 con 0x7fa55c06efd0 2023-12-07T21:08:47.876 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7fa560809640 1 -- 172.21.15.89:0/4064448806 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa55c071270 con 0x7fa55c06efd0 2023-12-07T21:08:47.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7f85faffd640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85e80377d0 0x7f85e8039c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f85f0007fd0 tx=0x7f85f0007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f195026f640 1 -- 172.21.15.89:0/2603540085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1948089e20 con 0x7f194806efd0 2023-12-07T21:08:47.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.856+0000 7f195026f640 1 -- 172.21.15.89:0/2603540085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1948089550 con 0x7f194806efd0 2023-12-07T21:08:47.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7f193effd640 1 -- 172.21.15.89:0/2603540085 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19440453f0 con 0x7f194806efd0 2023-12-07T21:08:47.877 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7f193effd640 1 -- 172.21.15.89:0/2603540085 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19440456d0 con 0x7f194806efd0 2023-12-07T21:08:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7f85fbfff640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f85e803cef0 0x7f85e803f330 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7fa54affd640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa53c037820 0x7fa53c039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7fa54affd640 1 -- 172.21.15.89:0/4064448806 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fa54c02d040 con 0x7fa55c06efd0 2023-12-07T21:08:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7fa54affd640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fa53c03cf40 0x7fa53c03f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7fa54affd640 1 -- 172.21.15.89:0/4064448806 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa53c03fa50 con 0x7fa53c03cf40 2023-12-07T21:08:47.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7fa54affd640 1 -- 172.21.15.89:0/4064448806 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa54c04b940 con 0x7fa55c06efd0 2023-12-07T21:08:47.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7f195026f640 1 -- 172.21.15.89:0/2603540085 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1930000f10 con 0x7f194806efd0 2023-12-07T21:08:47.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7f4e067fc640 1 -- 172.21.15.89:0/2554368442 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4df403fa50 con 0x7f4df403cf40 2023-12-07T21:08:47.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7fa559d9b640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa53c037820 0x7fa53c039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7f193effd640 1 -- 172.21.15.89:0/2603540085 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f19440303c0 con 0x7f194806efd0 2023-12-07T21:08:47.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.857+0000 7fa55ad9d640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fa53c03cf40 0x7fa53c03f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.858+0000 7f193effd640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f192c03bc30 0x7f192c03e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.858+0000 7f193effd640 1 -- 172.21.15.89:0/2603540085 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f194402d040 con 0x7f194806efd0 2023-12-07T21:08:47.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.858+0000 7fa55ad9d640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fa53c03cf40 0x7fa53c03f380 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.858+0000 7fa559d9b640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa53c037820 0x7fa53c039ce0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa550000f60 tx=0x7fa550007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.858+0000 7f85e3fff640 1 -- 172.21.15.89:0/617140314 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f85e803fa00 con 0x7f85e803cef0 2023-12-07T21:08:47.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.858+0000 7f193effd640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f192c041350 0x7f192c043790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.858+0000 7f194d80a640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f192c03bc30 0x7f192c03e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.858+0000 7f193effd640 1 -- 172.21.15.89:0/2603540085 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f192c043e60 con 0x7f192c041350 2023-12-07T21:08:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.858+0000 7f193effd640 1 -- 172.21.15.89:0/2603540085 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f194406ea80 con 0x7f194806efd0 2023-12-07T21:08:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.858+0000 7f194e80c640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f192c041350 0x7f192c043790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.858+0000 7f194d80a640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f192c03bc30 0x7f192c03e0f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1938001570 tx=0x7f19380079b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.859+0000 7f194e80c640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f192c041350 0x7f192c043790 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:47.884 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.859+0000 7fa54affd640 1 -- 172.21.15.89:0/4064448806 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa53c03fa50 con 0x7fa53c03cf40 2023-12-07T21:08:47.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.860+0000 7f193effd640 1 -- 172.21.15.89:0/2603540085 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f192c043e60 con 0x7f192c041350 2023-12-07T21:08:47.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.872+0000 7f4e18026640 1 -- 172.21.15.89:0/2554368442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e1012e630 con 0x7f4df403cf40 2023-12-07T21:08:47.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.872+0000 7f4e067fc640 1 -- 172.21.15.89:0/2554368442 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4e1012e630 con 0x7f4df403cf40 2023-12-07T21:08:47.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.872+0000 7f85e1ffb640 1 -- 172.21.15.89:0/617140314 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85fc08ee40 con 0x7f85e803cef0 2023-12-07T21:08:47.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 -- 172.21.15.89:0/2554368442 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f4df403cf40 msgr2=0x7f4df403f380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f4df403cf40 0x7f4df403f380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 -- 172.21.15.89:0/2554368442 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4df4037820 msgr2=0x7f4df4039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4df4037820 0x7f4df4039ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e00000f60 tx=0x7f4e00007a30 comp rx=0 tx=0).stop 2023-12-07T21:08:47.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e3fff640 1 -- 172.21.15.89:0/617140314 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f85fc08ee40 con 0x7f85e803cef0 2023-12-07T21:08:47.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 -- 172.21.15.89:0/2554368442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1012dad0 msgr2=0x7f4e101bef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1012dad0 0x7f4e101bef60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0097f0 tx=0x7f4e0c0046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 -- 172.21.15.89:0/2554368442 shutdown_connections 2023-12-07T21:08:47.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 -- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f85e803cef0 msgr2=0x7f85e803f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f85e803cef0 0x7f85e803f330 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f4df403cf40 0x7f4df403f380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4df4037820 0x7f4df4039ce0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 --2- 172.21.15.89:0/2554368442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e1012dad0 0x7f4e101bef60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 -- 172.21.15.89:0/2554368442 >> 172.21.15.89:0/2554368442 conn(0x7f4e1009ac70 msgr2=0x7f4e1009ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7fa560809640 1 -- 172.21.15.89:0/4064448806 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa55c073ef0 con 0x7fa53c03cf40 2023-12-07T21:08:47.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 -- 172.21.15.89:0/2554368442 shutdown_connections 2023-12-07T21:08:47.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 -- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85e80377d0 msgr2=0x7f85e8039c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85e80377d0 0x7f85e8039c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f85f0007fd0 tx=0x7f85f0007ac0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f4e18026640 1 -- 172.21.15.89:0/2554368442 wait complete. 2023-12-07T21:08:47.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 -- 172.21.15.89:0/617140314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc06f7e0 msgr2=0x7f85fc1c23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc06f7e0 0x7f85fc1c23f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f85ec000c00 tx=0x7f85ec0046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 -- 172.21.15.89:0/617140314 shutdown_connections 2023-12-07T21:08:47.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f85e803cef0 0x7f85e803f330 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85e80377d0 0x7f85e8039c90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 --2- 172.21.15.89:0/617140314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc06f7e0 0x7f85fc1c23f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 -- 172.21.15.89:0/617140314 >> 172.21.15.89:0/617140314 conn(0x7f85fc0986a0 msgr2=0x7f85fc0956a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7fa54affd640 1 -- 172.21.15.89:0/4064448806 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa55c073ef0 con 0x7fa53c03cf40 2023-12-07T21:08:47.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.873+0000 7f85e1ffb640 1 -- 172.21.15.89:0/617140314 shutdown_connections 2023-12-07T21:08:47.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7f85e1ffb640 1 -- 172.21.15.89:0/617140314 wait complete. 2023-12-07T21:08:47.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 -- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fa53c03cf40 msgr2=0x7fa53c03f380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fa53c03cf40 0x7fa53c03f380 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 -- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa53c037820 msgr2=0x7fa53c039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa53c037820 0x7fa53c039ce0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa550000f60 tx=0x7fa550007a30 comp rx=0 tx=0).stop 2023-12-07T21:08:47.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 -- 172.21.15.89:0/4064448806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55c06efd0 msgr2=0x7fa55c1bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55c06efd0 0x7fa55c1bfad0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa54c02b950 tx=0x7fa54c0046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 -- 172.21.15.89:0/4064448806 shutdown_connections 2023-12-07T21:08:47.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa53c037820 0x7fa53c039ce0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fa53c03cf40 0x7fa53c03f380 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7f195026f640 1 -- 172.21.15.89:0/2603540085 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1930002b50 con 0x7f192c041350 2023-12-07T21:08:47.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 --2- 172.21.15.89:0/4064448806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa55c06efd0 0x7fa55c1bfad0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 -- 172.21.15.89:0/4064448806 >> 172.21.15.89:0/4064448806 conn(0x7fa55c09cea0 msgr2=0x7fa55c094d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 -- 172.21.15.89:0/4064448806 shutdown_connections 2023-12-07T21:08:47.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7fa560809640 1 -- 172.21.15.89:0/4064448806 wait complete. 2023-12-07T21:08:47.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.874+0000 7f193effd640 1 -- 172.21.15.89:0/2603540085 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1930002b50 con 0x7f192c041350 2023-12-07T21:08:47.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.875+0000 7f195026f640 1 -- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f192c041350 msgr2=0x7f192c043790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.875+0000 7f195026f640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f192c041350 0x7f192c043790 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.875+0000 7f195026f640 1 -- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f192c03bc30 msgr2=0x7f192c03e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.875+0000 7f195026f640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f192c03bc30 0x7f192c03e0f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1938001570 tx=0x7f19380079b0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.875+0000 7f195026f640 1 -- 172.21.15.89:0/2603540085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194806efd0 msgr2=0x7f19481291f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:47.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.875+0000 7f195026f640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194806efd0 0x7f19481291f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1944000c00 tx=0x7f1944004730 comp rx=0 tx=0).stop 2023-12-07T21:08:47.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.875+0000 7f195026f640 1 -- 172.21.15.89:0/2603540085 shutdown_connections 2023-12-07T21:08:47.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.875+0000 7f195026f640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f192c041350 0x7f192c043790 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.875+0000 7f195026f640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f192c03bc30 0x7f192c03e0f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.875+0000 7f195026f640 1 --2- 172.21.15.89:0/2603540085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f194806efd0 0x7f19481291f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:47.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.875+0000 7f195026f640 1 -- 172.21.15.89:0/2603540085 >> 172.21.15.89:0/2603540085 conn(0x7f194809cea0 msgr2=0x7f1948094b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:47.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.877+0000 7f195026f640 1 -- 172.21.15.89:0/2603540085 shutdown_connections 2023-12-07T21:08:47.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:47.877+0000 7f195026f640 1 -- 172.21.15.89:0/2603540085 wait complete. 2023-12-07T21:08:47.898 INFO:teuthology.orchestra.run.smithi089.stdout:38654705669 2023-12-07T21:08:47.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-07T21:08:47.899 INFO:teuthology.orchestra.run.smithi089.stdout:38654705669 2023-12-07T21:08:47.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-07T21:08:47.900 INFO:teuthology.orchestra.run.smithi089.stdout:38654705668 2023-12-07T21:08:47.900 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-07T21:08:47.901 INFO:teuthology.orchestra.run.smithi089.stdout:38654705668 2023-12-07T21:08:47.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-07T21:08:48.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f0d92c83640 1 Processor -- start 2023-12-07T21:08:48.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7ff4224a2640 1 Processor -- start 2023-12-07T21:08:48.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f5976ebb640 1 Processor -- start 2023-12-07T21:08:48.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f5976ebb640 1 -- start start 2023-12-07T21:08:48.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f0d92c83640 1 -- start start 2023-12-07T21:08:48.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7ff4224a2640 1 -- start start 2023-12-07T21:08:48.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f430d4e0640 1 Processor -- start 2023-12-07T21:08:48.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f430d4e0640 1 -- start start 2023-12-07T21:08:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7ff4224a2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff41c095500 0x7ff41c0958e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7ff4224a2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c06e940 con 0x7ff41c06cc70 2023-12-07T21:08:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7ff4224a2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c06f390 con 0x7ff41c095500 2023-12-07T21:08:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f430d4e0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f430806dfc0 0x7f430806e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f5976ebb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f597009c060 0x7f5970132c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f5976ebb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5970097c10 con 0x7f597009b570 2023-12-07T21:08:48.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f5976ebb640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5970098960 con 0x7f597009c060 2023-12-07T21:08:48.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f0d92c83640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d8c095500 0x7f0d8c0958e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7ff41bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff41c095500 0x7ff41c0958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7ff41b7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff41c06cc70 0x7ff41c06d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48698/0 (socket says 172.21.15.89:48698) 2023-12-07T21:08:48.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7ff41b7fe640 1 -- 172.21.15.89:0/1345322056 learned_addr learned my addr 172.21.15.89:0/1345322056 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:48.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f4306ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f430806dfc0 0x7f430806e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.050+0000 7f430d4e0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430806f960 con 0x7f430806e8e0 2023-12-07T21:08:48.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f4306ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f430806dfc0 0x7f430806e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39948/0 (socket says 172.21.15.89:39948) 2023-12-07T21:08:48.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f4306ffd640 1 -- 172.21.15.89:0/2500991915 learned_addr learned my addr 172.21.15.89:0/2500991915 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:48.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f5974c57640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f597009b570 0x7f597009b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48710/0 (socket says 172.21.15.89:48710) 2023-12-07T21:08:48.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f430d4e0640 1 -- 172.21.15.89:0/2500991915 --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430806ab10 con 0x7f430806dfc0 2023-12-07T21:08:48.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f5974c57640 1 -- 172.21.15.89:0/99265992 learned_addr learned my addr 172.21.15.89:0/99265992 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:48.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f0d92c83640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c06e940 con 0x7f0d8c06cc70 2023-12-07T21:08:48.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f0d92c83640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c06f390 con 0x7f0d8c095500 2023-12-07T21:08:48.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f0d90a1f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d8c095500 0x7f0d8c0958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f0d90a1f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d8c095500 0x7f0d8c0958e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39960/0 (socket says 172.21.15.89:39960) 2023-12-07T21:08:48.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f0d90a1f640 1 -- 172.21.15.89:0/1926401748 learned_addr learned my addr 172.21.15.89:0/1926401748 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:48.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f596ffff640 1 --2- 172.21.15.89:0/99265992 >> v2:172.21.15.89:3300/0 conn(0x7f597009c060 0x7f5970132c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f4306ffd640 1 -- 172.21.15.89:0/2500991915 >> v1:172.21.15.89:6789/0 conn(0x7f430806e8e0 legacy=0x7f430812daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T21:08:48.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f4306ffd640 1 -- 172.21.15.89:0/2500991915 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430806af90 con 0x7f430806dfc0 2023-12-07T21:08:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7ff41affd640 1 -- 172.21.15.89:0/1345322056 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506491652 0 0) 0x7ff41c06e940 con 0x7ff41c06cc70 2023-12-07T21:08:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7ff41affd640 1 -- 172.21.15.89:0/1345322056 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff404003440 con 0x7ff41c06cc70 2023-12-07T21:08:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f0d90a1f640 1 -- 172.21.15.89:0/1926401748 >> v1:172.21.15.89:6789/0 conn(0x7f0d8c06cc70 legacy=0x7f0d8c06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f0d90a1f640 1 -- 172.21.15.89:0/1926401748 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c06e1e0 con 0x7f0d8c095500 2023-12-07T21:08:48.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f596f7fe640 1 -- 172.21.15.89:0/99265992 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985969536 0 0) 0x7f5970097c10 con 0x7f597009b570 2023-12-07T21:08:48.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f596f7fe640 1 -- 172.21.15.89:0/99265992 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5960003520 con 0x7f597009b570 2023-12-07T21:08:48.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7ff41bfff640 1 -- 172.21.15.89:0/1345322056 >> v1:172.21.15.89:6789/0 conn(0x7ff41c06cc70 legacy=0x7ff41c06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7ff41bfff640 1 -- 172.21.15.89:0/1345322056 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c06e1e0 con 0x7ff41c095500 2023-12-07T21:08:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f596ffff640 1 -- 172.21.15.89:0/99265992 >> v1:172.21.15.89:6789/0 conn(0x7f597009b570 legacy=0x7f597009b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.051+0000 7f596ffff640 1 -- 172.21.15.89:0/99265992 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970098f00 con 0x7f597009c060 2023-12-07T21:08:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.052+0000 7f4306ffd640 1 --2- 172.21.15.89:0/2500991915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f430806dfc0 0x7f430806e3a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097f0 tx=0x7f42f802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3cc2ed5553559a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.052+0000 7f4305ffb640 1 -- 172.21.15.89:0/2500991915 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42f80315e0 con 0x7f430806dfc0 2023-12-07T21:08:48.053 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.052+0000 7f4305ffb640 1 -- 172.21.15.89:0/2500991915 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f8031740 con 0x7f430806dfc0 2023-12-07T21:08:48.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.052+0000 7f4305ffb640 1 -- 172.21.15.89:0/2500991915 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42f8031a00 con 0x7f430806dfc0 2023-12-07T21:08:48.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.052+0000 7f0d90a1f640 1 --2- 172.21.15.89:0/1926401748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d8c095500 0x7f0d8c0958e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000ba80 tx=0x7f0d8002df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceba7dccb04b6727 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.052+0000 7ff41bfff640 1 --2- 172.21.15.89:0/1345322056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c095500 0x7ff41c0958e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009720 tx=0x7ff40c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947bc8c6c3884260 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.054 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.052+0000 7f596ffff640 1 --2- 172.21.15.89:0/99265992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f597009c060 0x7f5970132c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f595c009720 tx=0x7f595c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c7a921c144a971 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f0d8b7fe640 1 -- 172.21.15.89:0/1926401748 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d8002ec20 con 0x7f0d8c095500 2023-12-07T21:08:48.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f0d8b7fe640 1 -- 172.21.15.89:0/1926401748 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d80032070 con 0x7f0d8c095500 2023-12-07T21:08:48.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f0d8b7fe640 1 -- 172.21.15.89:0/1926401748 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d80038400 con 0x7f0d8c095500 2023-12-07T21:08:48.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7ff41affd640 1 -- 172.21.15.89:0/1345322056 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff40c031760 con 0x7ff41c095500 2023-12-07T21:08:48.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f596f7fe640 1 -- 172.21.15.89:0/99265992 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f595c02e070 con 0x7f597009c060 2023-12-07T21:08:48.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f596f7fe640 1 -- 172.21.15.89:0/99265992 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c0316d0 con 0x7f597009c060 2023-12-07T21:08:48.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f596f7fe640 1 -- 172.21.15.89:0/99265992 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f595c031970 con 0x7f597009c060 2023-12-07T21:08:48.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7ff41affd640 1 -- 172.21.15.89:0/1345322056 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c0318c0 con 0x7ff41c095500 2023-12-07T21:08:48.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7ff41affd640 1 -- 172.21.15.89:0/1345322056 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff40c031b60 con 0x7ff41c095500 2023-12-07T21:08:48.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f430d4e0640 1 -- 172.21.15.89:0/2500991915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f430806dfc0 msgr2=0x7f430806e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f430d4e0640 1 --2- 172.21.15.89:0/2500991915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f430806dfc0 0x7f430806e3a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097f0 tx=0x7f42f802b880 comp rx=0 tx=0).stop 2023-12-07T21:08:48.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f430d4e0640 1 -- 172.21.15.89:0/2500991915 shutdown_connections 2023-12-07T21:08:48.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f430d4e0640 1 --2- 172.21.15.89:0/2500991915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f430806dfc0 0x7f430806e3a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f430d4e0640 1 -- 172.21.15.89:0/2500991915 >> 172.21.15.89:0/2500991915 conn(0x7f430809cb50 msgr2=0x7f430809cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:48.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f430d4e0640 1 -- 172.21.15.89:0/2500991915 shutdown_connections 2023-12-07T21:08:48.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f430d4e0640 1 -- 172.21.15.89:0/2500991915 wait complete. 2023-12-07T21:08:48.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f0d92c83640 1 -- 172.21.15.89:0/1926401748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d8c095500 msgr2=0x7f0d8c0958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f0d92c83640 1 --2- 172.21.15.89:0/1926401748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d8c095500 0x7f0d8c0958e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000ba80 tx=0x7f0d8002df40 comp rx=0 tx=0).stop 2023-12-07T21:08:48.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f0d92c83640 1 -- 172.21.15.89:0/1926401748 shutdown_connections 2023-12-07T21:08:48.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f0d92c83640 1 --2- 172.21.15.89:0/1926401748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d8c095500 0x7f0d8c0958e0 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000ba80 tx=0x7f0d8002df40 comp rx=0 tx=0).stop 2023-12-07T21:08:48.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f0d92c83640 1 -- 172.21.15.89:0/1926401748 >> 172.21.15.89:0/1926401748 conn(0x7f0d8c0986a0 msgr2=0x7f0d8c098ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:48.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f5976ebb640 1 -- 172.21.15.89:0/99265992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f597009c060 msgr2=0x7f5970132c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.053+0000 7f5976ebb640 1 --2- 172.21.15.89:0/99265992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f597009c060 0x7f5970132c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f595c009720 tx=0x7f595c02b840 comp rx=0 tx=0).stop 2023-12-07T21:08:48.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7f5976ebb640 1 -- 172.21.15.89:0/99265992 shutdown_connections 2023-12-07T21:08:48.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7f5976ebb640 1 --2- 172.21.15.89:0/99265992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f597009c060 0x7f5970132c40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7f5976ebb640 1 -- 172.21.15.89:0/99265992 >> 172.21.15.89:0/99265992 conn(0x7f597006c730 msgr2=0x7f597006cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:48.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7f0d92c83640 1 -- 172.21.15.89:0/1926401748 shutdown_connections 2023-12-07T21:08:48.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7f0d92c83640 1 -- 172.21.15.89:0/1926401748 wait complete. 2023-12-07T21:08:48.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7ff4224a2640 1 -- 172.21.15.89:0/1345322056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c095500 msgr2=0x7ff41c0958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7ff4224a2640 1 --2- 172.21.15.89:0/1345322056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c095500 0x7ff41c0958e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009720 tx=0x7ff40c02b8d0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7f5976ebb640 1 -- 172.21.15.89:0/99265992 shutdown_connections 2023-12-07T21:08:48.060 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7f5976ebb640 1 -- 172.21.15.89:0/99265992 wait complete. 2023-12-07T21:08:48.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7ff4224a2640 1 -- 172.21.15.89:0/1345322056 shutdown_connections 2023-12-07T21:08:48.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7ff4224a2640 1 --2- 172.21.15.89:0/1345322056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c095500 0x7ff41c0958e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7ff4224a2640 1 -- 172.21.15.89:0/1345322056 >> 172.21.15.89:0/1345322056 conn(0x7ff41c0986a0 msgr2=0x7ff41c098ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:48.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7ff4224a2640 1 -- 172.21.15.89:0/1345322056 shutdown_connections 2023-12-07T21:08:48.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7ff4224a2640 1 -- 172.21.15.89:0/1345322056 wait complete. 2023-12-07T21:08:48.061 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.054+0000 7f5976ebb640 1 Processor -- start 2023-12-07T21:08:48.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f430d4e0640 1 Processor -- start 2023-12-07T21:08:48.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f5976ebb640 1 -- start start 2023-12-07T21:08:48.062 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f0d92c83640 1 Processor -- start 2023-12-07T21:08:48.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f430d4e0640 1 -- start start 2023-12-07T21:08:48.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f0d92c83640 1 -- start start 2023-12-07T21:08:48.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7ff4224a2640 1 Processor -- start 2023-12-07T21:08:48.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f430d4e0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f430806dfc0 0x7f43081220e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f430d4e0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4308124f60 con 0x7f430806dfc0 2023-12-07T21:08:48.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f5976ebb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f597009b570 0x7f5970129d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f5976ebb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597011cc30 con 0x7f597009b570 2023-12-07T21:08:48.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f4306ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f430806dfc0 0x7f43081220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7ff4224a2640 1 -- start start 2023-12-07T21:08:48.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f0d92c83640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d8c06cc70 0x7f0d8c092100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f4306ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f430806dfc0 0x7f43081220e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39980/0 (socket says 172.21.15.89:39980) 2023-12-07T21:08:48.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f4306ffd640 1 -- 172.21.15.89:0/444778699 learned_addr learned my addr 172.21.15.89:0/444778699 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:48.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f5974c57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f597009b570 0x7f5970129d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f0d92c83640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c098180 con 0x7f0d8c06cc70 2023-12-07T21:08:48.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f5974c57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f597009b570 0x7f5970129d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39988/0 (socket says 172.21.15.89:39988) 2023-12-07T21:08:48.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f5974c57640 1 -- 172.21.15.89:0/2389213576 learned_addr learned my addr 172.21.15.89:0/2389213576 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:48.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f0d90a1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d8c06cc70 0x7f0d8c092100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f0d90a1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d8c06cc70 0x7f0d8c092100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39990/0 (socket says 172.21.15.89:39990) 2023-12-07T21:08:48.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.055+0000 7f0d90a1f640 1 -- 172.21.15.89:0/4168229848 learned_addr learned my addr 172.21.15.89:0/4168229848 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:48.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7f5974c57640 1 -- 172.21.15.89:0/2389213576 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c009400 con 0x7f597009b570 2023-12-07T21:08:48.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7f0d90a1f640 1 -- 172.21.15.89:0/4168229848 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8000b760 con 0x7f0d8c06cc70 2023-12-07T21:08:48.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7ff4224a2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c06cc70 0x7ff41c092170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7f5974c57640 1 --2- 172.21.15.89:0/2389213576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f597009b570 0x7f5970129d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f596400c3b0 tx=0x7f596400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7f4306ffd640 1 -- 172.21.15.89:0/444778699 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f80094d0 con 0x7f430806dfc0 2023-12-07T21:08:48.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7ff4224a2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c094dd0 con 0x7ff41c06cc70 2023-12-07T21:08:48.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7ff41bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c06cc70 0x7ff41c092170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7f596d7fa640 1 -- 172.21.15.89:0/2389213576 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5964005c10 con 0x7f597009b570 2023-12-07T21:08:48.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7f0d90a1f640 1 --2- 172.21.15.89:0/4168229848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d8c06cc70 0x7f0d8c092100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d8002df80 tx=0x7f0d800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7ff41bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c06cc70 0x7ff41c092170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:39996/0 (socket says 172.21.15.89:39996) 2023-12-07T21:08:48.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7f5976ebb640 1 -- 172.21.15.89:0/2389213576 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597012ab50 con 0x7f597009b570 2023-12-07T21:08:48.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7ff41bfff640 1 -- 172.21.15.89:0/2198832814 learned_addr learned my addr 172.21.15.89:0/2198832814 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:48.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7f4306ffd640 1 --2- 172.21.15.89:0/444778699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f430806dfc0 0x7f43081220e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f42f802b8c0 tx=0x7f42f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7f5976ebb640 1 -- 172.21.15.89:0/2389213576 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597011d6e0 con 0x7f597009b570 2023-12-07T21:08:48.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7f596d7fa640 1 -- 172.21.15.89:0/2389213576 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5964005d70 con 0x7f597009b570 2023-12-07T21:08:48.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.056+0000 7f596d7fa640 1 -- 172.21.15.89:0/2389213576 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5964007200 con 0x7f597009b570 2023-12-07T21:08:48.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7ff41bfff640 1 -- 172.21.15.89:0/2198832814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c009400 con 0x7ff41c06cc70 2023-12-07T21:08:48.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7f0d897fa640 1 -- 172.21.15.89:0/4168229848 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d80043440 con 0x7f0d8c06cc70 2023-12-07T21:08:48.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7f0d897fa640 1 -- 172.21.15.89:0/4168229848 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d800435a0 con 0x7f0d8c06cc70 2023-12-07T21:08:48.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7f0d92c83640 1 -- 172.21.15.89:0/4168229848 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8c1a5980 con 0x7f0d8c06cc70 2023-12-07T21:08:48.074 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7f0d897fa640 1 -- 172.21.15.89:0/4168229848 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d80043880 con 0x7f0d8c06cc70 2023-12-07T21:08:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7f42ef7fe640 1 -- 172.21.15.89:0/444778699 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42f80328b0 con 0x7f430806dfc0 2023-12-07T21:08:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7f42ef7fe640 1 -- 172.21.15.89:0/444778699 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f8032a30 con 0x7f430806dfc0 2023-12-07T21:08:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7f42ef7fe640 1 -- 172.21.15.89:0/444778699 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42f8032d10 con 0x7f430806dfc0 2023-12-07T21:08:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7f430d4e0640 1 -- 172.21.15.89:0/444778699 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4308123f60 con 0x7f430806dfc0 2023-12-07T21:08:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7ff41bfff640 1 --2- 172.21.15.89:0/2198832814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c06cc70 0x7ff41c092170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff40c000c00 tx=0x7ff40c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.075 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7f430d4e0640 1 -- 172.21.15.89:0/444778699 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4308124a40 con 0x7f430806dfc0 2023-12-07T21:08:48.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7f596d7fa640 1 -- 172.21.15.89:0/2389213576 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f5964007360 con 0x7f597009b570 2023-12-07T21:08:48.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.058+0000 7f596d7fa640 1 --2- 172.21.15.89:0/2389213576 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59540377d0 0x7f5954039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.076 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.058+0000 7f596d7fa640 1 -- 172.21.15.89:0/2389213576 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f59640496e0 con 0x7f597009b570 2023-12-07T21:08:48.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.058+0000 7f0d897fa640 1 -- 172.21.15.89:0/4168229848 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0d800439e0 con 0x7f0d8c06cc70 2023-12-07T21:08:48.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.058+0000 7f0d92c83640 1 -- 172.21.15.89:0/4168229848 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c094f50 con 0x7f0d8c06cc70 2023-12-07T21:08:48.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.058+0000 7f0d897fa640 1 --2- 172.21.15.89:0/4168229848 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0d70037870 0x7f0d70039d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7ff418ff9640 1 -- 172.21.15.89:0/2198832814 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff40c004400 con 0x7ff41c06cc70 2023-12-07T21:08:48.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.057+0000 7ff418ff9640 1 -- 172.21.15.89:0/2198832814 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c003610 con 0x7ff41c06cc70 2023-12-07T21:08:48.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.058+0000 7ff4224a2640 1 -- 172.21.15.89:0/2198832814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c094550 con 0x7ff41c06cc70 2023-12-07T21:08:48.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.058+0000 7ff4224a2640 1 -- 172.21.15.89:0/2198832814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c0932d0 con 0x7ff41c06cc70 2023-12-07T21:08:48.077 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.058+0000 7ff418ff9640 1 -- 172.21.15.89:0/2198832814 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff40c0038b0 con 0x7ff41c06cc70 2023-12-07T21:08:48.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.058+0000 7f5976ebb640 1 -- 172.21.15.89:0/2389213576 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5950005040 con 0x7f597009b570 2023-12-07T21:08:48.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.059+0000 7f596ffff640 1 --2- 172.21.15.89:0/2389213576 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59540377d0 0x7f5954039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.059+0000 7f42ef7fe640 1 -- 172.21.15.89:0/444778699 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f42f804e430 con 0x7f430806dfc0 2023-12-07T21:08:48.078 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.059+0000 7f430d4e0640 1 -- 172.21.15.89:0/444778699 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43081240f0 con 0x7f430806dfc0 2023-12-07T21:08:48.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.058+0000 7f0d8bfff640 1 --2- 172.21.15.89:0/4168229848 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0d70037870 0x7f0d70039d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.059+0000 7f0d8bfff640 1 --2- 172.21.15.89:0/4168229848 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0d70037870 0x7f0d70039d30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0d78001560 tx=0x7f0d78007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.059+0000 7f42ef7fe640 1 --2- 172.21.15.89:0/444778699 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f42f40378c0 0x7f42f4039d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.079 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.059+0000 7f0d897fa640 1 -- 172.21.15.89:0/4168229848 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f0d80043c90 con 0x7f0d8c06cc70 2023-12-07T21:08:48.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.059+0000 7f42ef7fe640 1 -- 172.21.15.89:0/444778699 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f42f806c490 con 0x7f430806dfc0 2023-12-07T21:08:48.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.059+0000 7f0d92c83640 1 -- 172.21.15.89:0/4168229848 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c094b60 con 0x7f0d8c06cc70 2023-12-07T21:08:48.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.059+0000 7f596ffff640 1 --2- 172.21.15.89:0/2389213576 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59540377d0 0x7f5954039c90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f595c036000 tx=0x7f595c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.080 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.059+0000 7f43067fc640 1 --2- 172.21.15.89:0/444778699 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f42f40378c0 0x7f42f4039d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.059+0000 7ff4224a2640 1 -- 172.21.15.89:0/2198832814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3fc005040 con 0x7ff41c06cc70 2023-12-07T21:08:48.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.060+0000 7f43067fc640 1 --2- 172.21.15.89:0/444778699 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f42f40378c0 0x7f42f4039d80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f42fc003cd0 tx=0x7f42fc007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.081 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.064+0000 7f596d7fa640 1 -- 172.21.15.89:0/2389213576 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5964017070 con 0x7f597009b570 2023-12-07T21:08:48.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.064+0000 7ff418ff9640 1 -- 172.21.15.89:0/2198832814 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7ff40c003a10 con 0x7ff41c06cc70 2023-12-07T21:08:48.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.064+0000 7ff418ff9640 1 --2- 172.21.15.89:0/2198832814 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff408040080 0x7ff408042540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:48.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.065+0000 7ff41b7fe640 1 --2- 172.21.15.89:0/2198832814 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff408040080 0x7ff408042540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:48.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.065+0000 7ff41b7fe640 1 --2- 172.21.15.89:0/2198832814 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff408040080 0x7ff408042540 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff410001570 tx=0x7ff410007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:48.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.068+0000 7f42ef7fe640 1 -- 172.21.15.89:0/444778699 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42f8030920 con 0x7f430806dfc0 2023-12-07T21:08:48.082 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.076+0000 7ff418ff9640 1 -- 172.21.15.89:0/2198832814 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff40c03a420 con 0x7ff41c06cc70 2023-12-07T21:08:48.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.076+0000 7f0d897fa640 1 -- 172.21.15.89:0/4168229848 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d8c094b60 con 0x7f0d8c06cc70 2023-12-07T21:08:48.083 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.085+0000 7ff418ff9640 1 -- 172.21.15.89:0/2198832814 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff40c003cc0 con 0x7ff41c06cc70 2023-12-07T21:08:48.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.242+0000 7f5976ebb640 1 -- 172.21.15.89:0/2389213576 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f59500052f0 con 0x7f597009b570 2023-12-07T21:08:48.236 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.242+0000 7f596d7fa640 1 -- 172.21.15.89:0/2389213576 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5964012400 con 0x7f597009b570 2023-12-07T21:08:48.236 INFO:teuthology.orchestra.run.smithi089.stdout:38654705668 2023-12-07T21:08:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.244+0000 7f5976ebb640 1 -- 172.21.15.89:0/2389213576 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59540377d0 msgr2=0x7f5954039c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.244+0000 7f5976ebb640 1 --2- 172.21.15.89:0/2389213576 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59540377d0 0x7f5954039c90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f595c036000 tx=0x7f595c008030 comp rx=0 tx=0).stop 2023-12-07T21:08:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.244+0000 7f5976ebb640 1 -- 172.21.15.89:0/2389213576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f597009b570 msgr2=0x7f5970129d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.244+0000 7f5976ebb640 1 --2- 172.21.15.89:0/2389213576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f597009b570 0x7f5970129d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f596400c3b0 tx=0x7f596400c870 comp rx=0 tx=0).stop 2023-12-07T21:08:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.244+0000 7f5976ebb640 1 -- 172.21.15.89:0/2389213576 shutdown_connections 2023-12-07T21:08:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.244+0000 7f5976ebb640 1 --2- 172.21.15.89:0/2389213576 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59540377d0 0x7f5954039c90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.244+0000 7f5976ebb640 1 --2- 172.21.15.89:0/2389213576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f597009b570 0x7f5970129d20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.244+0000 7f5976ebb640 1 -- 172.21.15.89:0/2389213576 >> 172.21.15.89:0/2389213576 conn(0x7f597006c730 msgr2=0x7f597012cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:48.238 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.244+0000 7f5976ebb640 1 -- 172.21.15.89:0/2389213576 shutdown_connections 2023-12-07T21:08:48.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.244+0000 7f5976ebb640 1 -- 172.21.15.89:0/2389213576 wait complete. 2023-12-07T21:08:48.245 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.252+0000 7f430d4e0640 1 -- 172.21.15.89:0/444778699 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4308099dc0 con 0x7f430806dfc0 2023-12-07T21:08:48.246 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.252+0000 7f42ef7fe640 1 -- 172.21.15.89:0/444778699 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42f8030330 con 0x7f430806dfc0 2023-12-07T21:08:48.246 INFO:teuthology.orchestra.run.smithi089.stdout:38654705667 2023-12-07T21:08:48.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.253+0000 7f0d92c83640 1 -- 172.21.15.89:0/4168229848 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0d8c094b60 con 0x7f0d8c06cc70 2023-12-07T21:08:48.247 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.253+0000 7f0d897fa640 1 -- 172.21.15.89:0/4168229848 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d8c094b60 con 0x7f0d8c06cc70 2023-12-07T21:08:48.247 INFO:teuthology.orchestra.run.smithi089.stdout:38654705668 2023-12-07T21:08:48.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2023-12-07T21:08:48.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f430d4e0640 1 -- 172.21.15.89:0/444778699 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f42f40378c0 msgr2=0x7f42f4039d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f430d4e0640 1 --2- 172.21.15.89:0/444778699 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f42f40378c0 0x7f42f4039d80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f42fc003cd0 tx=0x7f42fc007a30 comp rx=0 tx=0).stop 2023-12-07T21:08:48.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f430d4e0640 1 -- 172.21.15.89:0/444778699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f430806dfc0 msgr2=0x7f43081220e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f430d4e0640 1 --2- 172.21.15.89:0/444778699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f430806dfc0 0x7f43081220e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f42f802b8c0 tx=0x7f42f80046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f430d4e0640 1 -- 172.21.15.89:0/444778699 shutdown_connections 2023-12-07T21:08:48.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f430d4e0640 1 --2- 172.21.15.89:0/444778699 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f42f40378c0 0x7f42f4039d80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f430d4e0640 1 --2- 172.21.15.89:0/444778699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f430806dfc0 0x7f43081220e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f430d4e0640 1 -- 172.21.15.89:0/444778699 >> 172.21.15.89:0/444778699 conn(0x7f430809cb50 msgr2=0x7f430808f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:48.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f430d4e0640 1 -- 172.21.15.89:0/444778699 shutdown_connections 2023-12-07T21:08:48.250 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f430d4e0640 1 -- 172.21.15.89:0/444778699 wait complete. 2023-12-07T21:08:48.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f0d92c83640 1 -- 172.21.15.89:0/4168229848 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0d70037870 msgr2=0x7f0d70039d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f0d92c83640 1 --2- 172.21.15.89:0/4168229848 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0d70037870 0x7f0d70039d30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0d78001560 tx=0x7f0d78007a50 comp rx=0 tx=0).stop 2023-12-07T21:08:48.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f0d92c83640 1 -- 172.21.15.89:0/4168229848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d8c06cc70 msgr2=0x7f0d8c092100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f0d92c83640 1 --2- 172.21.15.89:0/4168229848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d8c06cc70 0x7f0d8c092100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d8002df80 tx=0x7f0d800046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.251 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f0d92c83640 1 -- 172.21.15.89:0/4168229848 shutdown_connections 2023-12-07T21:08:48.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f0d92c83640 1 --2- 172.21.15.89:0/4168229848 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0d70037870 0x7f0d70039d30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f0d92c83640 1 --2- 172.21.15.89:0/4168229848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d8c06cc70 0x7f0d8c092100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f0d92c83640 1 -- 172.21.15.89:0/4168229848 >> 172.21.15.89:0/4168229848 conn(0x7f0d8c0986a0 msgr2=0x7f0d8c08b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:48.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f0d92c83640 1 -- 172.21.15.89:0/4168229848 shutdown_connections 2023-12-07T21:08:48.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.255+0000 7f0d92c83640 1 -- 172.21.15.89:0/4168229848 wait complete. 2023-12-07T21:08:48.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.262+0000 7ff4224a2640 1 -- 172.21.15.89:0/2198832814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff3fc0055c0 con 0x7ff41c06cc70 2023-12-07T21:08:48.256 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.262+0000 7ff418ff9640 1 -- 172.21.15.89:0/2198832814 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff40c048020 con 0x7ff41c06cc70 2023-12-07T21:08:48.256 INFO:teuthology.orchestra.run.smithi089.stdout:38654705667 2023-12-07T21:08:48.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.264+0000 7ff4224a2640 1 -- 172.21.15.89:0/2198832814 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff408040080 msgr2=0x7ff408042540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.264+0000 7ff4224a2640 1 --2- 172.21.15.89:0/2198832814 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff408040080 0x7ff408042540 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff410001570 tx=0x7ff410007970 comp rx=0 tx=0).stop 2023-12-07T21:08:48.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.264+0000 7ff4224a2640 1 -- 172.21.15.89:0/2198832814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c06cc70 msgr2=0x7ff41c092170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:48.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.264+0000 7ff4224a2640 1 --2- 172.21.15.89:0/2198832814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c06cc70 0x7ff41c092170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff40c000c00 tx=0x7ff40c0046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.264+0000 7ff4224a2640 1 -- 172.21.15.89:0/2198832814 shutdown_connections 2023-12-07T21:08:48.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.264+0000 7ff4224a2640 1 --2- 172.21.15.89:0/2198832814 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff408040080 0x7ff408042540 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.264+0000 7ff4224a2640 1 --2- 172.21.15.89:0/2198832814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff41c06cc70 0x7ff41c092170 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:48.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.264+0000 7ff4224a2640 1 -- 172.21.15.89:0/2198832814 >> 172.21.15.89:0/2198832814 conn(0x7ff41c0986a0 msgr2=0x7ff41c08b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:48.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.264+0000 7ff4224a2640 1 -- 172.21.15.89:0/2198832814 shutdown_connections 2023-12-07T21:08:48.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:48.264+0000 7ff4224a2640 1 -- 172.21.15.89:0/2198832814 wait complete. 2023-12-07T21:08:48.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2023-12-07T21:08:48.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2023-12-07T21:08:48.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2023-12-07T21:08:49.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-07T21:08:49.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-07T21:08:49.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-07T21:08:49.271 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-07T21:08:49.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.373+0000 7fd4f7d0f640 1 Processor -- start 2023-12-07T21:08:49.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.373+0000 7fd4f7d0f640 1 -- start start 2023-12-07T21:08:49.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.373+0000 7fd4f7d0f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4f012a360 0x7fd4f012a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.373+0000 7fd4f7d0f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f009bdd0 con 0x7fd4f012ac80 2023-12-07T21:08:49.368 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.373+0000 7fd4f7d0f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f00990d0 con 0x7fd4f012a360 2023-12-07T21:08:49.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.374+0000 7fd4f5aab640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd4f012a360 0x7fd4f012a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.374+0000 7fd4f52aa640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd4f012ac80 0x7fd4f0097a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37622/0 (socket says 172.21.15.89:37622) 2023-12-07T21:08:49.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.374+0000 7fd4f52aa640 1 -- 172.21.15.89:0/294639842 learned_addr learned my addr 172.21.15.89:0/294639842 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:49.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.374+0000 7fd4f4aa9640 1 -- 172.21.15.89:0/294639842 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946039425 0 0) 0x7fd4f009bdd0 con 0x7fd4f012ac80 2023-12-07T21:08:49.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.374+0000 7fd4f4aa9640 1 -- 172.21.15.89:0/294639842 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4dc003520 con 0x7fd4f012ac80 2023-12-07T21:08:49.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.374+0000 7fd4f5aab640 1 -- 172.21.15.89:0/294639842 >> v1:172.21.15.89:6789/0 conn(0x7fd4f012ac80 legacy=0x7fd4f0097a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.374+0000 7fd4f5aab640 1 -- 172.21.15.89:0/294639842 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f009b850 con 0x7fd4f012a360 2023-12-07T21:08:49.369 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.375+0000 7fd4f5aab640 1 --2- 172.21.15.89:0/294639842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4f012a360 0x7fd4f012a740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009720 tx=0x7fd4ec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ce89db1440377b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.375+0000 7fd4f4aa9640 1 -- 172.21.15.89:0/294639842 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec02e070 con 0x7fd4f012a360 2023-12-07T21:08:49.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.375+0000 7fd4f4aa9640 1 -- 172.21.15.89:0/294639842 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec0316d0 con 0x7fd4f012a360 2023-12-07T21:08:49.370 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.375+0000 7fd4f4aa9640 1 -- 172.21.15.89:0/294639842 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec031990 con 0x7fd4f012a360 2023-12-07T21:08:49.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.376+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/294639842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4f012a360 msgr2=0x7fd4f012a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.376+0000 7fd4f7d0f640 1 --2- 172.21.15.89:0/294639842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4f012a360 0x7fd4f012a740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009720 tx=0x7fd4ec02b840 comp rx=0 tx=0).stop 2023-12-07T21:08:49.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.376+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/294639842 shutdown_connections 2023-12-07T21:08:49.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.376+0000 7fd4f7d0f640 1 --2- 172.21.15.89:0/294639842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4f012a360 0x7fd4f012a740 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.376+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/294639842 >> 172.21.15.89:0/294639842 conn(0x7fd4f009c8b0 msgr2=0x7fd4f009ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:49.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.376+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/294639842 shutdown_connections 2023-12-07T21:08:49.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.376+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/294639842 wait complete. 2023-12-07T21:08:49.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.377+0000 7fd4f7d0f640 1 Processor -- start 2023-12-07T21:08:49.371 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.377+0000 7fd4f7d0f640 1 -- start start 2023-12-07T21:08:49.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.377+0000 7fd4f7d0f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4f012a360 0x7fd4f011a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.377+0000 7fd4f7d0f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f011db20 con 0x7fd4f012a360 2023-12-07T21:08:49.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.378+0000 7fd4f5aab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4f012a360 0x7fd4f011a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.378+0000 7fd4f5aab640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4f012a360 0x7fd4f011a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53186/0 (socket says 172.21.15.89:53186) 2023-12-07T21:08:49.372 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.378+0000 7fd4f5aab640 1 -- 172.21.15.89:0/2651483124 learned_addr learned my addr 172.21.15.89:0/2651483124 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:49.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.378+0000 7fd4f5aab640 1 -- 172.21.15.89:0/2651483124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec009400 con 0x7fd4f012a360 2023-12-07T21:08:49.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.378+0000 7fd4f5aab640 1 --2- 172.21.15.89:0/2651483124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4f012a360 0x7fd4f011a450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009720 tx=0x7fd4ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.378+0000 7fd4e67fc640 1 -- 172.21.15.89:0/2651483124 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec032770 con 0x7fd4f012a360 2023-12-07T21:08:49.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.378+0000 7fd4e67fc640 1 -- 172.21.15.89:0/2651483124 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec0328d0 con 0x7fd4f012a360 2023-12-07T21:08:49.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.378+0000 7fd4e67fc640 1 -- 172.21.15.89:0/2651483124 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec032b90 con 0x7fd4f012a360 2023-12-07T21:08:49.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.378+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/2651483124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f011d7f0 con 0x7fd4f012a360 2023-12-07T21:08:49.373 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.378+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/2651483124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f012a110 con 0x7fd4f012a360 2023-12-07T21:08:49.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.379+0000 7fd4e67fc640 1 -- 172.21.15.89:0/2651483124 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fd4ec032cf0 con 0x7fd4f012a360 2023-12-07T21:08:49.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.380+0000 7fd4e67fc640 1 --2- 172.21.15.89:0/2651483124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4d4037820 0x7fd4d4039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.380+0000 7fd4e67fc640 1 -- 172.21.15.89:0/2651483124 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fd4ec06be30 con 0x7fd4f012a360 2023-12-07T21:08:49.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.380+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/2651483124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f011d640 con 0x7fd4f012a360 2023-12-07T21:08:49.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.380+0000 7fd4f52aa640 1 --2- 172.21.15.89:0/2651483124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4d4037820 0x7fd4d4039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.374 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.381+0000 7fd4f52aa640 1 --2- 172.21.15.89:0/2651483124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4d4037820 0x7fd4d4039ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0001610 tx=0x7fd4e0007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.378 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.385+0000 7fd4e67fc640 1 -- 172.21.15.89:0/2651483124 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4ec03b3f0 con 0x7fd4f012a360 2023-12-07T21:08:49.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.410+0000 7f7514839640 1 Processor -- start 2023-12-07T21:08:49.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.410+0000 7f7514839640 1 -- start start 2023-12-07T21:08:49.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.410+0000 7eff2e7fc640 1 Processor -- start 2023-12-07T21:08:49.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.410+0000 7f6a213c5640 1 Processor -- start 2023-12-07T21:08:49.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.410+0000 7f6a213c5640 1 -- start start 2023-12-07T21:08:49.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.410+0000 7eff2e7fc640 1 -- start start 2023-12-07T21:08:49.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7eff2e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7eff281308e0 0x7eff28132cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f7514839640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f751012b400 0x7f751012b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f6a213c5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a1c0716e0 0x7f6a1c12f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f6a213c5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1c06f720 con 0x7f6a1c070bf0 2023-12-07T21:08:49.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f7514839640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7510071080 con 0x7f751012bd20 2023-12-07T21:08:49.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f7514839640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75100718c0 con 0x7f751012b400 2023-12-07T21:08:49.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f6a213c5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c06d860 con 0x7f6a1c0716e0 2023-12-07T21:08:49.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f6a1a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a1c0716e0 0x7f6a1c12f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f6a1a7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6a1c0716e0 0x7f6a1c12f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53200/0 (socket says 172.21.15.89:53200) 2023-12-07T21:08:49.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f6a1a7fc640 1 -- 172.21.15.89:0/1843961011 learned_addr learned my addr 172.21.15.89:0/1843961011 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:49.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f750e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f751012b400 0x7f751012b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7eff2e7fc640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2809be20 con 0x7eff2812dac0 2023-12-07T21:08:49.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7eff2e7fc640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2806d7c0 con 0x7eff281308e0 2023-12-07T21:08:49.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f750e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f751012b400 0x7f751012b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53198/0 (socket says 172.21.15.89:53198) 2023-12-07T21:08:49.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f750e59c640 1 -- 172.21.15.89:0/1916346710 learned_addr learned my addr 172.21.15.89:0/1916346710 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:49.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7eff277fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7eff281308e0 0x7eff28132cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f6a1a7fc640 1 -- 172.21.15.89:0/1843961011 >> v1:172.21.15.89:6789/0 conn(0x7f6a1c070bf0 legacy=0x7f6a1c070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T21:08:49.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7f6a1a7fc640 1 -- 172.21.15.89:0/1843961011 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c071d60 con 0x7f6a1c0716e0 2023-12-07T21:08:49.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7eff277fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7eff281308e0 0x7eff28132cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53210/0 (socket says 172.21.15.89:53210) 2023-12-07T21:08:49.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.411+0000 7eff277fe640 1 -- 172.21.15.89:0/980913384 learned_addr learned my addr 172.21.15.89:0/980913384 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:49.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.412+0000 7f750e59c640 1 -- 172.21.15.89:0/1916346710 >> v1:172.21.15.89:6789/0 conn(0x7f751012bd20 legacy=0x7f7510128260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.412+0000 7f750e59c640 1 -- 172.21.15.89:0/1916346710 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7510070d00 con 0x7f751012b400 2023-12-07T21:08:49.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.412+0000 7f6a1a7fc640 1 --2- 172.21.15.89:0/1843961011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c0716e0 0x7f6a1c12f6c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a100097f0 tx=0x7f6a1002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e0b245d02e63c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.412+0000 7eff277fe640 1 -- 172.21.15.89:0/980913384 >> v1:172.21.15.89:6789/0 conn(0x7eff2812dac0 legacy=0x7eff2812dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T21:08:49.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.412+0000 7eff277fe640 1 -- 172.21.15.89:0/980913384 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff28098970 con 0x7eff281308e0 2023-12-07T21:08:49.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.412+0000 7f6a19ffb640 1 -- 172.21.15.89:0/1843961011 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a100315e0 con 0x7f6a1c0716e0 2023-12-07T21:08:49.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.412+0000 7f6a19ffb640 1 -- 172.21.15.89:0/1843961011 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a10031740 con 0x7f6a1c0716e0 2023-12-07T21:08:49.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.412+0000 7f6a19ffb640 1 -- 172.21.15.89:0/1843961011 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a10031a00 con 0x7f6a1c0716e0 2023-12-07T21:08:49.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7f750e59c640 1 --2- 172.21.15.89:0/1916346710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f751012b400 0x7f751012b7e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75000097f0 tx=0x7f750002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c0081cf3a94cdfc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7eff277fe640 1 --2- 172.21.15.89:0/980913384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff281308e0 0x7eff28132cd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0097f0 tx=0x7eff1c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78802bb46b6bc386 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7f750d59a640 1 -- 172.21.15.89:0/1916346710 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75000317a0 con 0x7f751012b400 2023-12-07T21:08:49.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7f750d59a640 1 -- 172.21.15.89:0/1916346710 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7500031900 con 0x7f751012b400 2023-12-07T21:08:49.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7f750d59a640 1 -- 172.21.15.89:0/1916346710 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7500031bc0 con 0x7f751012b400 2023-12-07T21:08:49.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7eff26ffd640 1 -- 172.21.15.89:0/980913384 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff1c0315e0 con 0x7eff281308e0 2023-12-07T21:08:49.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7eff26ffd640 1 -- 172.21.15.89:0/980913384 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c031740 con 0x7eff281308e0 2023-12-07T21:08:49.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7eff26ffd640 1 -- 172.21.15.89:0/980913384 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff1c031a00 con 0x7eff281308e0 2023-12-07T21:08:49.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7f6a213c5640 1 -- 172.21.15.89:0/1843961011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c0716e0 msgr2=0x7f6a1c12f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7f6a213c5640 1 --2- 172.21.15.89:0/1843961011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c0716e0 0x7f6a1c12f6c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a100097f0 tx=0x7f6a1002b880 comp rx=0 tx=0).stop 2023-12-07T21:08:49.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7f6a213c5640 1 -- 172.21.15.89:0/1843961011 shutdown_connections 2023-12-07T21:08:49.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7f6a213c5640 1 --2- 172.21.15.89:0/1843961011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c0716e0 0x7f6a1c12f6c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7f6a213c5640 1 -- 172.21.15.89:0/1843961011 >> 172.21.15.89:0/1843961011 conn(0x7f6a1c09ab30 msgr2=0x7f6a1c09af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:49.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.413+0000 7f6a213c5640 1 -- 172.21.15.89:0/1843961011 shutdown_connections 2023-12-07T21:08:49.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7f6a213c5640 1 -- 172.21.15.89:0/1843961011 wait complete. 2023-12-07T21:08:49.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7f7514839640 1 -- 172.21.15.89:0/1916346710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f751012b400 msgr2=0x7f751012b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7f7514839640 1 --2- 172.21.15.89:0/1916346710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f751012b400 0x7f751012b7e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75000097f0 tx=0x7f750002b910 comp rx=0 tx=0).stop 2023-12-07T21:08:49.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7f7514839640 1 -- 172.21.15.89:0/1916346710 shutdown_connections 2023-12-07T21:08:49.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7f7514839640 1 --2- 172.21.15.89:0/1916346710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f751012b400 0x7f751012b7e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7f7514839640 1 -- 172.21.15.89:0/1916346710 >> 172.21.15.89:0/1916346710 conn(0x7f751009a9f0 msgr2=0x7f751009ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:49.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7eff2e7fc640 1 -- 172.21.15.89:0/980913384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff281308e0 msgr2=0x7eff28132cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7eff2e7fc640 1 --2- 172.21.15.89:0/980913384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff281308e0 0x7eff28132cd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0097f0 tx=0x7eff1c02b880 comp rx=0 tx=0).stop 2023-12-07T21:08:49.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7f7514839640 1 -- 172.21.15.89:0/1916346710 shutdown_connections 2023-12-07T21:08:49.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7f7514839640 1 -- 172.21.15.89:0/1916346710 wait complete. 2023-12-07T21:08:49.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7eff2e7fc640 1 -- 172.21.15.89:0/980913384 shutdown_connections 2023-12-07T21:08:49.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7eff2e7fc640 1 --2- 172.21.15.89:0/980913384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff281308e0 0x7eff28132cd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7eff2e7fc640 1 -- 172.21.15.89:0/980913384 >> 172.21.15.89:0/980913384 conn(0x7eff2809c940 msgr2=0x7eff2809cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:49.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7eff2e7fc640 1 -- 172.21.15.89:0/980913384 shutdown_connections 2023-12-07T21:08:49.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.414+0000 7eff2e7fc640 1 -- 172.21.15.89:0/980913384 wait complete. 2023-12-07T21:08:49.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7f6a213c5640 1 Processor -- start 2023-12-07T21:08:49.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7f6a213c5640 1 -- start start 2023-12-07T21:08:49.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7f7514839640 1 Processor -- start 2023-12-07T21:08:49.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7f7514839640 1 -- start start 2023-12-07T21:08:49.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7eff2e7fc640 1 Processor -- start 2023-12-07T21:08:49.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7f6a213c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c070bf0 0x7f6a1c088ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7f6a213c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c095ec0 con 0x7f6a1c070bf0 2023-12-07T21:08:49.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7eff2e7fc640 1 -- start start 2023-12-07T21:08:49.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7f6a1affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c070bf0 0x7f6a1c088ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7f6a1affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c070bf0 0x7f6a1c088ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53224/0 (socket says 172.21.15.89:53224) 2023-12-07T21:08:49.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7f6a1affd640 1 -- 172.21.15.89:0/1068704635 learned_addr learned my addr 172.21.15.89:0/1068704635 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:49.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7f7514839640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f751012b400 0x7f75101c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.415+0000 7f7514839640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751011ea40 con 0x7f751012b400 2023-12-07T21:08:49.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f750e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f751012b400 0x7f75101c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f750e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f751012b400 0x7f75101c00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53228/0 (socket says 172.21.15.89:53228) 2023-12-07T21:08:49.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f750e59c640 1 -- 172.21.15.89:0/1579970857 learned_addr learned my addr 172.21.15.89:0/1579970857 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:49.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f6a1affd640 1 -- 172.21.15.89:0/1068704635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a100094d0 con 0x7f6a1c070bf0 2023-12-07T21:08:49.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7eff2e7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff2812dac0 0x7eff281c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7eff2e7fc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff28096f50 con 0x7eff2812dac0 2023-12-07T21:08:49.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f6a1affd640 1 --2- 172.21.15.89:0/1068704635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c070bf0 0x7f6a1c088ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00c390 tx=0x7f6a0c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7eff27fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff2812dac0 0x7eff281c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7eff27fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff2812dac0 0x7eff281c04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53230/0 (socket says 172.21.15.89:53230) 2023-12-07T21:08:49.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7eff27fff640 1 -- 172.21.15.89:0/3736344877 learned_addr learned my addr 172.21.15.89:0/3736344877 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:49.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f750e59c640 1 -- 172.21.15.89:0/1579970857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000094d0 con 0x7f751012b400 2023-12-07T21:08:49.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f6a037fe640 1 -- 172.21.15.89:0/1068704635 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c005410 con 0x7f6a1c070bf0 2023-12-07T21:08:49.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f6a037fe640 1 -- 172.21.15.89:0/1068704635 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c0035f0 con 0x7f6a1c070bf0 2023-12-07T21:08:49.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f6a037fe640 1 -- 172.21.15.89:0/1068704635 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c0038d0 con 0x7f6a1c070bf0 2023-12-07T21:08:49.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f750e59c640 1 --2- 172.21.15.89:0/1579970857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f751012b400 0x7f75101c00c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7500000c00 tx=0x7f75000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f6a213c5640 1 -- 172.21.15.89:0/1068704635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c08a5a0 con 0x7f6a1c070bf0 2023-12-07T21:08:49.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7eff27fff640 1 -- 172.21.15.89:0/3736344877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0094d0 con 0x7eff2812dac0 2023-12-07T21:08:49.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f6a213c5640 1 -- 172.21.15.89:0/1068704635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c08bde0 con 0x7f6a1c070bf0 2023-12-07T21:08:49.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f74feffd640 1 -- 172.21.15.89:0/1579970857 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f750003ad00 con 0x7f751012b400 2023-12-07T21:08:49.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f74feffd640 1 -- 172.21.15.89:0/1579970857 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750003ae60 con 0x7f751012b400 2023-12-07T21:08:49.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7eff27fff640 1 --2- 172.21.15.89:0/3736344877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff2812dac0 0x7eff281c04f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7eff1800c390 tx=0x7eff1800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.416+0000 7f7514839640 1 -- 172.21.15.89:0/1579970857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751011d020 con 0x7f751012b400 2023-12-07T21:08:49.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.417+0000 7eff24ff9640 1 -- 172.21.15.89:0/3736344877 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff18005410 con 0x7eff2812dac0 2023-12-07T21:08:49.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.417+0000 7f74feffd640 1 -- 172.21.15.89:0/1579970857 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7500044560 con 0x7f751012b400 2023-12-07T21:08:49.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.417+0000 7f7514839640 1 -- 172.21.15.89:0/1579970857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751011e130 con 0x7f751012b400 2023-12-07T21:08:49.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.417+0000 7eff24ff9640 1 -- 172.21.15.89:0/3736344877 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff180035f0 con 0x7eff2812dac0 2023-12-07T21:08:49.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.417+0000 7eff24ff9640 1 -- 172.21.15.89:0/3736344877 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7eff180038d0 con 0x7eff2812dac0 2023-12-07T21:08:49.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.417+0000 7eff2e7fc640 1 -- 172.21.15.89:0/3736344877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2808a7c0 con 0x7eff2812dac0 2023-12-07T21:08:49.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.417+0000 7eff2e7fc640 1 -- 172.21.15.89:0/3736344877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2812ade0 con 0x7eff2812dac0 2023-12-07T21:08:49.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.418+0000 7f6a213c5640 1 -- 172.21.15.89:0/1068704635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c1240b0 con 0x7f6a1c070bf0 2023-12-07T21:08:49.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.418+0000 7f7514839640 1 -- 172.21.15.89:0/1579970857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7510062110 con 0x7f751012b400 2023-12-07T21:08:49.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.418+0000 7eff2e7fc640 1 -- 172.21.15.89:0/3736344877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2812a960 con 0x7eff2812dac0 2023-12-07T21:08:49.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.418+0000 7f74feffd640 1 -- 172.21.15.89:0/1579970857 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f750004d450 con 0x7f751012b400 2023-12-07T21:08:49.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.418+0000 7f74feffd640 1 --2- 172.21.15.89:0/1579970857 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f00377d0 0x7f74f0039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.418+0000 7f74feffd640 1 -- 172.21.15.89:0/1579970857 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f750002d040 con 0x7f751012b400 2023-12-07T21:08:49.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.418+0000 7f6a037fe640 1 -- 172.21.15.89:0/1068704635 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f6a0c003a30 con 0x7f6a1c070bf0 2023-12-07T21:08:49.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.419+0000 7f6a037fe640 1 --2- 172.21.15.89:0/1068704635 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6a08037870 0x7f6a08039d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.419+0000 7eff24ff9640 1 -- 172.21.15.89:0/3736344877 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7eff18003a30 con 0x7eff2812dac0 2023-12-07T21:08:49.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.419+0000 7f6a037fe640 1 -- 172.21.15.89:0/1068704635 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f6a0c049c10 con 0x7f6a1c070bf0 2023-12-07T21:08:49.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.419+0000 7f750dd9b640 1 --2- 172.21.15.89:0/1579970857 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f00377d0 0x7f74f0039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.419+0000 7eff24ff9640 1 --2- 172.21.15.89:0/3736344877 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7eff14037820 0x7eff14039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.419+0000 7f6a1a7fc640 1 --2- 172.21.15.89:0/1068704635 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6a08037870 0x7f6a08039d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.419+0000 7eff277fe640 1 --2- 172.21.15.89:0/3736344877 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7eff14037820 0x7eff14039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.419+0000 7f750dd9b640 1 --2- 172.21.15.89:0/1579970857 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f00377d0 0x7f74f0039c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f60 tx=0x7f7504007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.419+0000 7f6a1a7fc640 1 --2- 172.21.15.89:0/1068704635 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6a08037870 0x7f6a08039d30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a10036000 tx=0x7f6a10008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.420+0000 7eff277fe640 1 --2- 172.21.15.89:0/3736344877 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7eff14037820 0x7eff14039ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7eff1c036000 tx=0x7eff1c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.423+0000 7f6a037fe640 1 -- 172.21.15.89:0/1068704635 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a0c019d20 con 0x7f6a1c070bf0 2023-12-07T21:08:49.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.427+0000 7eff24ff9640 1 -- 172.21.15.89:0/3736344877 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7eff18010950 con 0x7eff2812dac0 2023-12-07T21:08:49.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.427+0000 7f74feffd640 1 -- 172.21.15.89:0/1579970857 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f750004b940 con 0x7f751012b400 2023-12-07T21:08:49.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.432+0000 7eff24ff9640 1 -- 172.21.15.89:0/3736344877 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff18019d20 con 0x7eff2812dac0 2023-12-07T21:08:49.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.563+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/2651483124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd4f0062110 con 0x7fd4f012a360 2023-12-07T21:08:49.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.563+0000 7fd4e67fc640 1 -- 172.21.15.89:0/2651483124 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4ec039310 con 0x7fd4f012a360 2023-12-07T21:08:49.557 INFO:teuthology.orchestra.run.smithi089.stdout:38654705669 2023-12-07T21:08:49.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.566+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/2651483124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4d4037820 msgr2=0x7fd4d4039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.566+0000 7fd4f7d0f640 1 --2- 172.21.15.89:0/2651483124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4d4037820 0x7fd4d4039ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0001610 tx=0x7fd4e0007970 comp rx=0 tx=0).stop 2023-12-07T21:08:49.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.566+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/2651483124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4f012a360 msgr2=0x7fd4f011a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.566+0000 7fd4f7d0f640 1 --2- 172.21.15.89:0/2651483124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4f012a360 0x7fd4f011a450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009720 tx=0x7fd4ec0046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.566+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/2651483124 shutdown_connections 2023-12-07T21:08:49.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.566+0000 7fd4f7d0f640 1 --2- 172.21.15.89:0/2651483124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4d4037820 0x7fd4d4039ce0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.566+0000 7fd4f7d0f640 1 --2- 172.21.15.89:0/2651483124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4f012a360 0x7fd4f011a450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.566+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/2651483124 >> 172.21.15.89:0/2651483124 conn(0x7fd4f009c8b0 msgr2=0x7fd4f01b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:49.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.566+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/2651483124 shutdown_connections 2023-12-07T21:08:49.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.566+0000 7fd4f7d0f640 1 -- 172.21.15.89:0/2651483124 wait complete. 2023-12-07T21:08:49.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2023-12-07T21:08:49.570 DEBUG:teuthology.parallel:result is None 2023-12-07T21:08:49.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.606+0000 7f7514839640 1 -- 172.21.15.89:0/1579970857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7510066d20 con 0x7f751012b400 2023-12-07T21:08:49.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.607+0000 7f74feffd640 1 -- 172.21.15.89:0/1579970857 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7500035070 con 0x7f751012b400 2023-12-07T21:08:49.600 INFO:teuthology.orchestra.run.smithi089.stdout:38654705669 2023-12-07T21:08:49.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.608+0000 7f7514839640 1 -- 172.21.15.89:0/1579970857 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f00377d0 msgr2=0x7f74f0039c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.608+0000 7f7514839640 1 --2- 172.21.15.89:0/1579970857 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f00377d0 0x7f74f0039c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7504000f60 tx=0x7f7504007a30 comp rx=0 tx=0).stop 2023-12-07T21:08:49.602 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.608+0000 7f7514839640 1 -- 172.21.15.89:0/1579970857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f751012b400 msgr2=0x7f75101c00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.608+0000 7f7514839640 1 --2- 172.21.15.89:0/1579970857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f751012b400 0x7f75101c00c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7500000c00 tx=0x7f75000046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.608+0000 7f7514839640 1 -- 172.21.15.89:0/1579970857 shutdown_connections 2023-12-07T21:08:49.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.608+0000 7f7514839640 1 --2- 172.21.15.89:0/1579970857 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f00377d0 0x7f74f0039c90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.608+0000 7f7514839640 1 --2- 172.21.15.89:0/1579970857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f751012b400 0x7f75101c00c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.608+0000 7f7514839640 1 -- 172.21.15.89:0/1579970857 >> 172.21.15.89:0/1579970857 conn(0x7f751009a9f0 msgr2=0x7f751012a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:49.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.609+0000 7f7514839640 1 -- 172.21.15.89:0/1579970857 shutdown_connections 2023-12-07T21:08:49.603 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.609+0000 7f7514839640 1 -- 172.21.15.89:0/1579970857 wait complete. 2023-12-07T21:08:49.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2023-12-07T21:08:49.612 DEBUG:teuthology.parallel:result is None 2023-12-07T21:08:49.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.620+0000 7f6a213c5640 1 -- 172.21.15.89:0/1068704635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6a1c08bc40 con 0x7f6a1c070bf0 2023-12-07T21:08:49.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.620+0000 7f6a037fe640 1 -- 172.21.15.89:0/1068704635 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a1c08bc40 con 0x7f6a1c070bf0 2023-12-07T21:08:49.614 INFO:teuthology.orchestra.run.smithi089.stdout:38654705668 2023-12-07T21:08:49.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.622+0000 7f6a213c5640 1 -- 172.21.15.89:0/1068704635 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6a08037870 msgr2=0x7f6a08039d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.622+0000 7f6a213c5640 1 --2- 172.21.15.89:0/1068704635 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6a08037870 0x7f6a08039d30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6a10036000 tx=0x7f6a10008030 comp rx=0 tx=0).stop 2023-12-07T21:08:49.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.622+0000 7f6a213c5640 1 -- 172.21.15.89:0/1068704635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c070bf0 msgr2=0x7f6a1c088ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.622+0000 7f6a213c5640 1 --2- 172.21.15.89:0/1068704635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c070bf0 0x7f6a1c088ff0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00c390 tx=0x7f6a0c00c850 comp rx=0 tx=0).stop 2023-12-07T21:08:49.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.623+0000 7f6a213c5640 1 -- 172.21.15.89:0/1068704635 shutdown_connections 2023-12-07T21:08:49.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.623+0000 7f6a213c5640 1 --2- 172.21.15.89:0/1068704635 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6a08037870 0x7f6a08039d30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.623+0000 7f6a213c5640 1 --2- 172.21.15.89:0/1068704635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a1c070bf0 0x7f6a1c088ff0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.623+0000 7f6a213c5640 1 -- 172.21.15.89:0/1068704635 >> 172.21.15.89:0/1068704635 conn(0x7f6a1c09ab30 msgr2=0x7f6a1c096820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:49.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.623+0000 7f6a213c5640 1 -- 172.21.15.89:0/1068704635 shutdown_connections 2023-12-07T21:08:49.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.623+0000 7f6a213c5640 1 -- 172.21.15.89:0/1068704635 wait complete. 2023-12-07T21:08:49.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.629+0000 7eff2e7fc640 1 -- 172.21.15.89:0/3736344877 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7eff2808a5b0 con 0x7eff2812dac0 2023-12-07T21:08:49.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.630+0000 7eff24ff9640 1 -- 172.21.15.89:0/3736344877 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff18017030 con 0x7eff2812dac0 2023-12-07T21:08:49.624 INFO:teuthology.orchestra.run.smithi089.stdout:38654705668 2023-12-07T21:08:49.626 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.632+0000 7eff2e7fc640 1 -- 172.21.15.89:0/3736344877 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7eff14037820 msgr2=0x7eff14039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.632+0000 7eff2e7fc640 1 --2- 172.21.15.89:0/3736344877 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7eff14037820 0x7eff14039ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7eff1c036000 tx=0x7eff1c008030 comp rx=0 tx=0).stop 2023-12-07T21:08:49.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.632+0000 7eff2e7fc640 1 -- 172.21.15.89:0/3736344877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff2812dac0 msgr2=0x7eff281c04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.632+0000 7eff2e7fc640 1 --2- 172.21.15.89:0/3736344877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff2812dac0 0x7eff281c04f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7eff1800c390 tx=0x7eff1800c850 comp rx=0 tx=0).stop 2023-12-07T21:08:49.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.632+0000 7eff2e7fc640 1 -- 172.21.15.89:0/3736344877 shutdown_connections 2023-12-07T21:08:49.627 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.632+0000 7eff2e7fc640 1 --2- 172.21.15.89:0/3736344877 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7eff14037820 0x7eff14039ce0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.632+0000 7eff2e7fc640 1 --2- 172.21.15.89:0/3736344877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff2812dac0 0x7eff281c04f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.632+0000 7eff2e7fc640 1 -- 172.21.15.89:0/3736344877 >> 172.21.15.89:0/3736344877 conn(0x7eff2809c940 msgr2=0x7eff281b59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:49.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.632+0000 7eff2e7fc640 1 -- 172.21.15.89:0/3736344877 shutdown_connections 2023-12-07T21:08:49.628 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.632+0000 7eff2e7fc640 1 -- 172.21.15.89:0/3736344877 wait complete. 2023-12-07T21:08:49.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.1 2023-12-07T21:08:49.630 DEBUG:teuthology.parallel:result is None 2023-12-07T21:08:49.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.2 2023-12-07T21:08:49.636 DEBUG:teuthology.parallel:result is None 2023-12-07T21:08:49.637 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-07T21:08:49.637 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:08:49.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.783+0000 7f89df741640 1 Processor -- start 2023-12-07T21:08:49.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.783+0000 7f89df741640 1 -- start start 2023-12-07T21:08:49.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.783+0000 7f89df741640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89d806cc90 0x7f89d806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.777 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.783+0000 7f89df741640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d8070340 con 0x7f89d806d5b0 2023-12-07T21:08:49.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.783+0000 7f89df741640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d8097940 con 0x7f89d806cc90 2023-12-07T21:08:49.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.783+0000 7f89dd4dd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89d806cc90 0x7f89d806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.783+0000 7f89dccdc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f89d806d5b0 0x7f89d80950b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37662/0 (socket says 172.21.15.89:37662) 2023-12-07T21:08:49.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.783+0000 7f89dccdc640 1 -- 172.21.15.89:0/3265828868 learned_addr learned my addr 172.21.15.89:0/3265828868 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:49.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.784+0000 7f89dd4dd640 1 -- 172.21.15.89:0/3265828868 >> v1:172.21.15.89:6789/0 conn(0x7f89d806d5b0 legacy=0x7f89d80950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.778 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.784+0000 7f89dd4dd640 1 -- 172.21.15.89:0/3265828868 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8071900 con 0x7f89d806cc90 2023-12-07T21:08:49.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.784+0000 7f89dd4dd640 1 --2- 172.21.15.89:0/3265828868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d806cc90 0x7f89d806d070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009720 tx=0x7f89d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2a5a053050efc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.784+0000 7f89cffff640 1 -- 172.21.15.89:0/3265828868 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89d402e070 con 0x7f89d806cc90 2023-12-07T21:08:49.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.785+0000 7f89cffff640 1 -- 172.21.15.89:0/3265828868 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d40316d0 con 0x7f89d806cc90 2023-12-07T21:08:49.779 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.785+0000 7f89cffff640 1 -- 172.21.15.89:0/3265828868 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89d4031990 con 0x7f89d806cc90 2023-12-07T21:08:49.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.785+0000 7f89df741640 1 -- 172.21.15.89:0/3265828868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d806cc90 msgr2=0x7f89d806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.785+0000 7f89df741640 1 --2- 172.21.15.89:0/3265828868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d806cc90 0x7f89d806d070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009720 tx=0x7f89d402b840 comp rx=0 tx=0).stop 2023-12-07T21:08:49.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.785+0000 7f89df741640 1 -- 172.21.15.89:0/3265828868 shutdown_connections 2023-12-07T21:08:49.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.785+0000 7f89df741640 1 --2- 172.21.15.89:0/3265828868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d806cc90 0x7f89d806d070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.785+0000 7f89df741640 1 -- 172.21.15.89:0/3265828868 >> 172.21.15.89:0/3265828868 conn(0x7f89d80987f0 msgr2=0x7f89d8098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:49.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.785+0000 7f89df741640 1 -- 172.21.15.89:0/3265828868 shutdown_connections 2023-12-07T21:08:49.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.785+0000 7f89df741640 1 -- 172.21.15.89:0/3265828868 wait complete. 2023-12-07T21:08:49.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.786+0000 7f89df741640 1 Processor -- start 2023-12-07T21:08:49.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.786+0000 7f89df741640 1 -- start start 2023-12-07T21:08:49.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.786+0000 7f89df741640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d806cc90 0x7f89d81c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.786+0000 7f89df741640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d808ca00 con 0x7f89d806cc90 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.786+0000 7f89dd4dd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d806cc90 0x7f89d81c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.786+0000 7f89dd4dd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d806cc90 0x7f89d81c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53248/0 (socket says 172.21.15.89:53248) 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.786+0000 7f89dd4dd640 1 -- 172.21.15.89:0/2183044592 learned_addr learned my addr 172.21.15.89:0/2183044592 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.787+0000 7f89dd4dd640 1 -- 172.21.15.89:0/2183044592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4009400 con 0x7f89d806cc90 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.787+0000 7f89dd4dd640 1 --2- 172.21.15.89:0/2183044592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d806cc90 0x7f89d81c2710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f89d4034040 tx=0x7f89d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.787+0000 7f89cdffb640 1 -- 172.21.15.89:0/2183044592 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89d4032830 con 0x7f89d806cc90 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.787+0000 7f89cdffb640 1 -- 172.21.15.89:0/2183044592 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d4032990 con 0x7f89d806cc90 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.787+0000 7f89df741640 1 -- 172.21.15.89:0/2183044592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d806fad0 con 0x7f89d806cc90 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.787+0000 7f89cdffb640 1 -- 172.21.15.89:0/2183044592 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89d4032c50 con 0x7f89d806cc90 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.787+0000 7f89df741640 1 -- 172.21.15.89:0/2183044592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d808dfc0 con 0x7f89d806cc90 2023-12-07T21:08:49.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.788+0000 7f89cdffb640 1 -- 172.21.15.89:0/2183044592 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f89d404d3f0 con 0x7f89d806cc90 2023-12-07T21:08:49.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.788+0000 7f89cdffb640 1 --2- 172.21.15.89:0/2183044592 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f89bc037820 0x7f89bc039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:49.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.788+0000 7f89cdffb640 1 -- 172.21.15.89:0/2183044592 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f89d406bc70 con 0x7f89d806cc90 2023-12-07T21:08:49.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.788+0000 7f89df741640 1 -- 172.21.15.89:0/2183044592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d806fad0 con 0x7f89d806cc90 2023-12-07T21:08:49.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.788+0000 7f89dccdc640 1 --2- 172.21.15.89:0/2183044592 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f89bc037820 0x7f89bc039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:49.784 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.789+0000 7f89dccdc640 1 --2- 172.21.15.89:0/2183044592 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f89bc037820 0x7f89bc039ce0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89c8007fd0 tx=0x7f89c8007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:49.786 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.793+0000 7f89cdffb640 1 -- 172.21.15.89:0/2183044592 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89d806fad0 con 0x7f89d806cc90 2023-12-07T21:08:49.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.957+0000 7f89df741640 1 -- 172.21.15.89:0/2183044592 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89d8070bf0 con 0x7f89bc037820 2023-12-07T21:08:49.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.959+0000 7f89cdffb640 1 -- 172.21.15.89:0/2183044592 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34649 (secure 0 0 0) 0x7f89c80012f0 con 0x7f89bc037820 2023-12-07T21:08:49.953 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:49.953 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:08:49.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.961+0000 7f89df741640 1 -- 172.21.15.89:0/2183044592 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f89bc037820 msgr2=0x7f89bc039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.961+0000 7f89df741640 1 --2- 172.21.15.89:0/2183044592 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f89bc037820 0x7f89bc039ce0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89c8007fd0 tx=0x7f89c8007ac0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.961+0000 7f89df741640 1 -- 172.21.15.89:0/2183044592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d806cc90 msgr2=0x7f89d81c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:49.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.961+0000 7f89df741640 1 --2- 172.21.15.89:0/2183044592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d806cc90 0x7f89d81c2710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f89d4034040 tx=0x7f89d40046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.961+0000 7f89df741640 1 -- 172.21.15.89:0/2183044592 shutdown_connections 2023-12-07T21:08:49.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.961+0000 7f89df741640 1 --2- 172.21.15.89:0/2183044592 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f89bc037820 0x7f89bc039ce0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.961+0000 7f89df741640 1 --2- 172.21.15.89:0/2183044592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89d806cc90 0x7f89d81c2710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:49.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.961+0000 7f89df741640 1 -- 172.21.15.89:0/2183044592 >> 172.21.15.89:0/2183044592 conn(0x7f89d80987f0 msgr2=0x7f89d806f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:49.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.961+0000 7f89df741640 1 -- 172.21.15.89:0/2183044592 shutdown_connections 2023-12-07T21:08:49.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:49.961+0000 7f89df741640 1 -- 172.21.15.89:0/2183044592 wait complete. 2023-12-07T21:08:49.965 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-12-07T21:08:48.047037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109760,"kb_used_data":1672,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377600,"statfs":{"total":386547056640,"available":386434662400,"internally_reserved":0,"allocated":1712128,"data_stored":1340484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":110618392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000845"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-07T21:08:47.172723+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:08:47.172723+0000","last_peered":"2023-12-07T21:08:47.172723+0000","last_clean":"2023-12-07T21:08:47.172723+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:08:47.172723+0000","last_undegraded":"2023-12-07T21:08:47.172723+0000","last_fullsized":"2023-12-07T21:08:47.172723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:49:28.884695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-07T21:08:47.822093+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:08:47.822093+0000","last_peered":"2023-12-07T21:08:47.822093+0000","last_clean":"2023-12-07T21:08:47.822093+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:08:47.822093+0000","last_undegraded":"2023-12-07T21:08:47.822093+0000","last_fullsized":"2023-12-07T21:08:47.822093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:02:32.429314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-07T21:08:46.824237+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:08:46.824237+0000","last_peered":"2023-12-07T21:08:46.824237+0000","last_clean":"2023-12-07T21:08:46.824237+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:08:46.824237+0000","last_undegraded":"2023-12-07T21:08:46.824237+0000","last_fullsized":"2023-12-07T21:08:46.824237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:21.178940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-07T21:08:47.822162+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:08:47.822162+0000","last_peered":"2023-12-07T21:08:47.822162+0000","last_clean":"2023-12-07T21:08:47.822162+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:08:47.822162+0000","last_undegraded":"2023-12-07T21:08:47.822162+0000","last_fullsized":"2023-12-07T21:08:47.822162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:24.297087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-07T21:08:46.824207+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:08:46.824207+0000","last_peered":"2023-12-07T21:08:46.824207+0000","last_clean":"2023-12-07T21:08:46.824207+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:08:46.824207+0000","last_undegraded":"2023-12-07T21:08:46.824207+0000","last_fullsized":"2023-12-07T21:08:46.824207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:22.108839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-07T21:08:46.824052+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:08:46.824052+0000","last_peered":"2023-12-07T21:08:46.824052+0000","last_clean":"2023-12-07T21:08:46.824052+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:08:46.824052+0000","last_undegraded":"2023-12-07T21:08:46.824052+0000","last_fullsized":"2023-12-07T21:08:46.824052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:33:32.675176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-07T21:08:46.824199+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:08:46.824199+0000","last_peered":"2023-12-07T21:08:46.824199+0000","last_clean":"2023-12-07T21:08:46.824199+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:08:46.824199+0000","last_undegraded":"2023-12-07T21:08:46.824199+0000","last_fullsized":"2023-12-07T21:08:46.824199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:33:32.675176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-07T21:08:46.824228+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:08:46.824228+0000","last_peered":"2023-12-07T21:08:46.824228+0000","last_clean":"2023-12-07T21:08:46.824228+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:08:46.824228+0000","last_undegraded":"2023-12-07T21:08:46.824228+0000","last_fullsized":"2023-12-07T21:08:46.824228+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:02:32.429314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":163,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-07T21:08:45.812723+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:08:45.812723+0000","last_peered":"2023-12-07T21:08:45.812723+0000","last_clean":"2023-12-07T21:08:45.812723+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:08:45.812723+0000","last_undegraded":"2023-12-07T21:08:45.812723+0000","last_fullsized":"2023-12-07T21:08:45.812723+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:17.092202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":131072,"data_stored":39937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":39937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:08:49.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:08:50.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.070+0000 7f706a541640 1 Processor -- start 2023-12-07T21:08:50.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.070+0000 7f706a541640 1 -- start start 2023-12-07T21:08:50.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.071+0000 7f706a541640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f706409c060 0x7f7064132bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:50.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.071+0000 7f706a541640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7064099490 con 0x7f706409b570 2023-12-07T21:08:50.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.071+0000 7f706a541640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7064099ad0 con 0x7f706409c060 2023-12-07T21:08:50.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.071+0000 7f7063fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f706409b570 0x7f706409b950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37668/0 (socket says 172.21.15.89:37668) 2023-12-07T21:08:50.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.071+0000 7f7063fff640 1 -- 172.21.15.89:0/1620886320 learned_addr learned my addr 172.21.15.89:0/1620886320 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:50.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.071+0000 7f70637fe640 1 --2- 172.21.15.89:0/1620886320 >> v2:172.21.15.89:3300/0 conn(0x7f706409c060 0x7f7064132bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:50.065 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.071+0000 7f7062ffd640 1 -- 172.21.15.89:0/1620886320 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631957057 0 0) 0x7f7064099490 con 0x7f706409b570 2023-12-07T21:08:50.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.071+0000 7f7062ffd640 1 -- 172.21.15.89:0/1620886320 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f704c003520 con 0x7f706409b570 2023-12-07T21:08:50.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.071+0000 7f70637fe640 1 -- 172.21.15.89:0/1620886320 >> v1:172.21.15.89:6789/0 conn(0x7f706409b570 legacy=0x7f706409b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:50.066 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.071+0000 7f70637fe640 1 -- 172.21.15.89:0/1620886320 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706409a040 con 0x7f706409c060 2023-12-07T21:08:50.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.072+0000 7f70637fe640 1 --2- 172.21.15.89:0/1620886320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706409c060 0x7f7064132bd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7058009720 tx=0x7f705802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9195b721b200ff0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:50.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.072+0000 7f7062ffd640 1 -- 172.21.15.89:0/1620886320 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f705802e070 con 0x7f706409c060 2023-12-07T21:08:50.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.072+0000 7f7062ffd640 1 -- 172.21.15.89:0/1620886320 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70580316d0 con 0x7f706409c060 2023-12-07T21:08:50.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.072+0000 7f7062ffd640 1 -- 172.21.15.89:0/1620886320 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7058031990 con 0x7f706409c060 2023-12-07T21:08:50.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.072+0000 7f706a541640 1 -- 172.21.15.89:0/1620886320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706409c060 msgr2=0x7f7064132bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:50.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.072+0000 7f706a541640 1 --2- 172.21.15.89:0/1620886320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706409c060 0x7f7064132bd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7058009720 tx=0x7f705802b840 comp rx=0 tx=0).stop 2023-12-07T21:08:50.067 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.073+0000 7f706a541640 1 -- 172.21.15.89:0/1620886320 shutdown_connections 2023-12-07T21:08:50.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.073+0000 7f706a541640 1 --2- 172.21.15.89:0/1620886320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706409c060 0x7f7064132bd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:50.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.073+0000 7f706a541640 1 -- 172.21.15.89:0/1620886320 >> 172.21.15.89:0/1620886320 conn(0x7f706406c730 msgr2=0x7f706406cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:50.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.073+0000 7f706a541640 1 -- 172.21.15.89:0/1620886320 shutdown_connections 2023-12-07T21:08:50.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.073+0000 7f706a541640 1 -- 172.21.15.89:0/1620886320 wait complete. 2023-12-07T21:08:50.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.073+0000 7f706a541640 1 Processor -- start 2023-12-07T21:08:50.068 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f706a541640 1 -- start start 2023-12-07T21:08:50.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f706a541640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706409b570 0x7f706412a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:50.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f706a541640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706412e160 con 0x7f706409b570 2023-12-07T21:08:50.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f7063fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706409b570 0x7f706412a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:50.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f7063fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706409b570 0x7f706412a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53268/0 (socket says 172.21.15.89:53268) 2023-12-07T21:08:50.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f7063fff640 1 -- 172.21.15.89:0/1189515009 learned_addr learned my addr 172.21.15.89:0/1189515009 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:50.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f7063fff640 1 -- 172.21.15.89:0/1189515009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7058009400 con 0x7f706409b570 2023-12-07T21:08:50.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f7063fff640 1 --2- 172.21.15.89:0/1189515009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706409b570 0x7f706412a040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f705400c390 tx=0x7f705400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:50.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f7060ff9640 1 -- 172.21.15.89:0/1189515009 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7054005c10 con 0x7f706409b570 2023-12-07T21:08:50.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f7060ff9640 1 -- 172.21.15.89:0/1189515009 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7054005d70 con 0x7f706409b570 2023-12-07T21:08:50.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f706a541640 1 -- 172.21.15.89:0/1189515009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706411c9d0 con 0x7f706409b570 2023-12-07T21:08:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f7060ff9640 1 -- 172.21.15.89:0/1189515009 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7054007220 con 0x7f706409b570 2023-12-07T21:08:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.074+0000 7f706a541640 1 -- 172.21.15.89:0/1189515009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706411d020 con 0x7f706409b570 2023-12-07T21:08:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.075+0000 7f7060ff9640 1 -- 172.21.15.89:0/1189515009 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7054007380 con 0x7f706409b570 2023-12-07T21:08:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.075+0000 7f7060ff9640 1 --2- 172.21.15.89:0/1189515009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f70500377d0 0x7f7050039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.075+0000 7f706a541640 1 -- 172.21.15.89:0/1189515009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7064098d90 con 0x7f706409b570 2023-12-07T21:08:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.075+0000 7f7060ff9640 1 -- 172.21.15.89:0/1189515009 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f7054049710 con 0x7f706409b570 2023-12-07T21:08:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.076+0000 7f70637fe640 1 --2- 172.21.15.89:0/1189515009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f70500377d0 0x7f7050039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:50.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.076+0000 7f70637fe640 1 --2- 172.21.15.89:0/1189515009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f70500377d0 0x7f7050039c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7058036000 tx=0x7f7058008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:50.073 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.080+0000 7f7060ff9640 1 -- 172.21.15.89:0/1189515009 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7064098d90 con 0x7f706409b570 2023-12-07T21:08:50.235 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.242+0000 7f706a541640 1 -- 172.21.15.89:0/1189515009 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f706412cce0 con 0x7f70500377d0 2023-12-07T21:08:50.237 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.244+0000 7f7060ff9640 1 -- 172.21.15.89:0/1189515009 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34580 (secure 0 0 0) 0x7f706412cce0 con 0x7f70500377d0 2023-12-07T21:08:50.238 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:50.238 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:08:50.239 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.246+0000 7f706a541640 1 -- 172.21.15.89:0/1189515009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f70500377d0 msgr2=0x7f7050039c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:50.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.246+0000 7f706a541640 1 --2- 172.21.15.89:0/1189515009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f70500377d0 0x7f7050039c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7058036000 tx=0x7f7058008030 comp rx=0 tx=0).stop 2023-12-07T21:08:50.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.246+0000 7f706a541640 1 -- 172.21.15.89:0/1189515009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706409b570 msgr2=0x7f706412a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:50.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.246+0000 7f706a541640 1 --2- 172.21.15.89:0/1189515009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706409b570 0x7f706412a040 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f705400c390 tx=0x7f705400c850 comp rx=0 tx=0).stop 2023-12-07T21:08:50.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.246+0000 7f706a541640 1 -- 172.21.15.89:0/1189515009 shutdown_connections 2023-12-07T21:08:50.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.246+0000 7f706a541640 1 --2- 172.21.15.89:0/1189515009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f70500377d0 0x7f7050039c90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:50.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.246+0000 7f706a541640 1 --2- 172.21.15.89:0/1189515009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706409b570 0x7f706412a040 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:50.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.246+0000 7f706a541640 1 -- 172.21.15.89:0/1189515009 >> 172.21.15.89:0/1189515009 conn(0x7f706406c730 msgr2=0x7f706409e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:50.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.246+0000 7f706a541640 1 -- 172.21.15.89:0/1189515009 shutdown_connections 2023-12-07T21:08:50.240 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.246+0000 7f706a541640 1 -- 172.21.15.89:0/1189515009 wait complete. 2023-12-07T21:08:50.250 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-07T21:08:50.047473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109760,"kb_used_data":1680,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377600,"statfs":{"total":386547056640,"available":386434662400,"internally_reserved":0,"allocated":1720320,"data_stored":1344504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":110618392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001281"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-07T21:08:48.531682+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:08:48.531682+0000","last_peered":"2023-12-07T21:08:48.531682+0000","last_clean":"2023-12-07T21:08:48.531682+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:08:48.531682+0000","last_undegraded":"2023-12-07T21:08:48.531682+0000","last_fullsized":"2023-12-07T21:08:48.531682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:13:59.600730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-07T21:08:47.822093+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:08:47.822093+0000","last_peered":"2023-12-07T21:08:47.822093+0000","last_clean":"2023-12-07T21:08:47.822093+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:08:47.822093+0000","last_undegraded":"2023-12-07T21:08:47.822093+0000","last_fullsized":"2023-12-07T21:08:47.822093+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:02:32.429314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-07T21:08:48.531668+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:08:48.531668+0000","last_peered":"2023-12-07T21:08:48.531668+0000","last_clean":"2023-12-07T21:08:48.531668+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:08:48.531668+0000","last_undegraded":"2023-12-07T21:08:48.531668+0000","last_fullsized":"2023-12-07T21:08:48.531668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:30:53.269300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-07T21:08:47.822162+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:08:47.822162+0000","last_peered":"2023-12-07T21:08:47.822162+0000","last_clean":"2023-12-07T21:08:47.822162+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:08:47.822162+0000","last_undegraded":"2023-12-07T21:08:47.822162+0000","last_fullsized":"2023-12-07T21:08:47.822162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:24.297087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-07T21:08:48.531680+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:08:48.531680+0000","last_peered":"2023-12-07T21:08:48.531680+0000","last_clean":"2023-12-07T21:08:48.531680+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:08:48.531680+0000","last_undegraded":"2023-12-07T21:08:48.531680+0000","last_fullsized":"2023-12-07T21:08:48.531680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:34.117128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-12-07T21:08:46.824052+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:08:46.824052+0000","last_peered":"2023-12-07T21:08:46.824052+0000","last_clean":"2023-12-07T21:08:46.824052+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:08:46.824052+0000","last_undegraded":"2023-12-07T21:08:46.824052+0000","last_fullsized":"2023-12-07T21:08:46.824052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:33:32.675176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-07T21:08:48.531648+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:08:48.531648+0000","last_peered":"2023-12-07T21:08:48.531648+0000","last_clean":"2023-12-07T21:08:48.531648+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:08:48.531648+0000","last_undegraded":"2023-12-07T21:08:48.531648+0000","last_fullsized":"2023-12-07T21:08:48.531648+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:38.020788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-07T21:08:48.531656+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:08:48.531656+0000","last_peered":"2023-12-07T21:08:48.531656+0000","last_clean":"2023-12-07T21:08:48.531656+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:08:48.531656+0000","last_undegraded":"2023-12-07T21:08:48.531656+0000","last_fullsized":"2023-12-07T21:08:48.531656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:39:44.793585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":163,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-12-07T21:08:45.812723+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:08:45.812723+0000","last_peered":"2023-12-07T21:08:45.812723+0000","last_clean":"2023-12-07T21:08:45.812723+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:08:45.812723+0000","last_undegraded":"2023-12-07T21:08:45.812723+0000","last_fullsized":"2023-12-07T21:08:45.812723+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:17.092202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":131072,"data_stored":39937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":43957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:08:50.250 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-07T21:08:50.251 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-07T21:08:50.251 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-07T21:08:50.251 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-07T21:08:50.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.354+0000 7fea78ebb640 1 Processor -- start 2023-12-07T21:08:50.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.354+0000 7fea78ebb640 1 -- start start 2023-12-07T21:08:50.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.354+0000 7fea78ebb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fea7412d530 0x7fea7412f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:50.348 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.354+0000 7fea78ebb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7412a1e0 con 0x7fea7412a5a0 2023-12-07T21:08:50.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.354+0000 7fea78ebb640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea7406f890 con 0x7fea7412d530 2023-12-07T21:08:50.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.354+0000 7fea6bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fea7412d530 0x7fea7412f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:50.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.354+0000 7fea7259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fea7412a5a0 0x7fea7412a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:37674/0 (socket says 172.21.15.89:37674) 2023-12-07T21:08:50.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.354+0000 7fea7259c640 1 -- 172.21.15.89:0/4154817913 learned_addr learned my addr 172.21.15.89:0/4154817913 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:08:50.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.355+0000 7fea6bfff640 1 -- 172.21.15.89:0/4154817913 >> v1:172.21.15.89:6789/0 conn(0x7fea7412a5a0 legacy=0x7fea7412a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:50.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.355+0000 7fea6bfff640 1 -- 172.21.15.89:0/4154817913 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7406f220 con 0x7fea7412d530 2023-12-07T21:08:50.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.355+0000 7fea6bfff640 1 --2- 172.21.15.89:0/4154817913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea7412d530 0x7fea7412f920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b9c0 tx=0x7fea5c02e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff5970ac949a2cc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:50.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.355+0000 7fea71d9b640 1 -- 172.21.15.89:0/4154817913 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea5c02ed80 con 0x7fea7412d530 2023-12-07T21:08:50.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.355+0000 7fea71d9b640 1 -- 172.21.15.89:0/4154817913 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c036440 con 0x7fea7412d530 2023-12-07T21:08:50.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.356+0000 7fea71d9b640 1 -- 172.21.15.89:0/4154817913 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea5c036700 con 0x7fea7412d530 2023-12-07T21:08:50.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.356+0000 7fea78ebb640 1 -- 172.21.15.89:0/4154817913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea7412d530 msgr2=0x7fea7412f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:50.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.356+0000 7fea78ebb640 1 --2- 172.21.15.89:0/4154817913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea7412d530 0x7fea7412f920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00b9c0 tx=0x7fea5c02e0a0 comp rx=0 tx=0).stop 2023-12-07T21:08:50.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.356+0000 7fea78ebb640 1 -- 172.21.15.89:0/4154817913 shutdown_connections 2023-12-07T21:08:50.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.356+0000 7fea78ebb640 1 --2- 172.21.15.89:0/4154817913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea7412d530 0x7fea7412f920 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:50.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.356+0000 7fea78ebb640 1 -- 172.21.15.89:0/4154817913 >> 172.21.15.89:0/4154817913 conn(0x7fea740987f0 msgr2=0x7fea74098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:50.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.356+0000 7fea78ebb640 1 -- 172.21.15.89:0/4154817913 shutdown_connections 2023-12-07T21:08:50.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.356+0000 7fea78ebb640 1 -- 172.21.15.89:0/4154817913 wait complete. 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.357+0000 7fea78ebb640 1 Processor -- start 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.357+0000 7fea78ebb640 1 -- start start 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.357+0000 7fea78ebb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea7412a5a0 0x7fea741c2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.357+0000 7fea78ebb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea74122d80 con 0x7fea7412a5a0 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.357+0000 7fea7259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea7412a5a0 0x7fea741c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.357+0000 7fea7259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea7412a5a0 0x7fea741c2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53278/0 (socket says 172.21.15.89:53278) 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.357+0000 7fea7259c640 1 -- 172.21.15.89:0/1175198764 learned_addr learned my addr 172.21.15.89:0/1175198764 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.358+0000 7fea7259c640 1 -- 172.21.15.89:0/1175198764 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c00b6a0 con 0x7fea7412a5a0 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.358+0000 7fea7259c640 1 --2- 172.21.15.89:0/1175198764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea7412a5a0 0x7fea741c2720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fea6400c4a0 tx=0x7fea6400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.358+0000 7fea6affd640 1 -- 172.21.15.89:0/1175198764 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea64005c10 con 0x7fea7412a5a0 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.358+0000 7fea6affd640 1 -- 172.21.15.89:0/1175198764 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea64005d70 con 0x7fea7412a5a0 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.358+0000 7fea78ebb640 1 -- 172.21.15.89:0/1175198764 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea74123a10 con 0x7fea7412a5a0 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.358+0000 7fea6affd640 1 -- 172.21.15.89:0/1175198764 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea640071a0 con 0x7fea7412a5a0 2023-12-07T21:08:50.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.358+0000 7fea78ebb640 1 -- 172.21.15.89:0/1175198764 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea741c2c60 con 0x7fea7412a5a0 2023-12-07T21:08:50.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.359+0000 7fea6affd640 1 -- 172.21.15.89:0/1175198764 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fea64007300 con 0x7fea7412a5a0 2023-12-07T21:08:50.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.359+0000 7fea78ebb640 1 -- 172.21.15.89:0/1175198764 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea74062110 con 0x7fea7412a5a0 2023-12-07T21:08:50.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.359+0000 7fea6affd640 1 --2- 172.21.15.89:0/1175198764 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fea54037820 0x7fea54039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:50.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.359+0000 7fea6affd640 1 -- 172.21.15.89:0/1175198764 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fea64049590 con 0x7fea7412a5a0 2023-12-07T21:08:50.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.359+0000 7fea6bfff640 1 --2- 172.21.15.89:0/1175198764 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fea54037820 0x7fea54039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:50.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.360+0000 7fea6bfff640 1 --2- 172.21.15.89:0/1175198764 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fea54037820 0x7fea54039ce0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea5c038000 tx=0x7fea5c032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:50.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.364+0000 7fea6affd640 1 -- 172.21.15.89:0/1175198764 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea640108f0 con 0x7fea7412a5a0 2023-12-07T21:08:50.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.567+0000 7fea78ebb640 1 -- 172.21.15.89:0/1175198764 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fea74066d20 con 0x7fea7412a5a0 2023-12-07T21:08:50.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.567+0000 7fea6affd640 1 -- 172.21.15.89:0/1175198764 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fea64017070 con 0x7fea7412a5a0 2023-12-07T21:08:50.561 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:08:50.561 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-07T21:08:50.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.569+0000 7fea78ebb640 1 -- 172.21.15.89:0/1175198764 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fea54037820 msgr2=0x7fea54039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:50.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.569+0000 7fea78ebb640 1 --2- 172.21.15.89:0/1175198764 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fea54037820 0x7fea54039ce0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea5c038000 tx=0x7fea5c032000 comp rx=0 tx=0).stop 2023-12-07T21:08:50.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.569+0000 7fea78ebb640 1 -- 172.21.15.89:0/1175198764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea7412a5a0 msgr2=0x7fea741c2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:50.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.569+0000 7fea78ebb640 1 --2- 172.21.15.89:0/1175198764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea7412a5a0 0x7fea741c2720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fea6400c4a0 tx=0x7fea6400c960 comp rx=0 tx=0).stop 2023-12-07T21:08:50.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.569+0000 7fea78ebb640 1 -- 172.21.15.89:0/1175198764 shutdown_connections 2023-12-07T21:08:50.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.569+0000 7fea78ebb640 1 --2- 172.21.15.89:0/1175198764 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fea54037820 0x7fea54039ce0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.569+0000 7fea78ebb640 1 --2- 172.21.15.89:0/1175198764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea7412a5a0 0x7fea741c2720 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.569+0000 7fea78ebb640 1 -- 172.21.15.89:0/1175198764 >> 172.21.15.89:0/1175198764 conn(0x7fea740987f0 msgr2=0x7fea74095470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.569+0000 7fea78ebb640 1 -- 172.21.15.89:0/1175198764 shutdown_connections 2023-12-07T21:08:50.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:08:50.569+0000 7fea78ebb640 1 -- 172.21.15.89:0/1175198764 wait complete. 2023-12-07T21:08:50.573 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-07T21:08:50.573 INFO:teuthology.run_tasks:Running task rgw... 2023-12-07T21:08:50.587 DEBUG:tasks.rgw:config is {'client.0': None} 2023-12-07T21:08:50.587 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2023-12-07T21:08:50.587 INFO:tasks.rgw:Creating data pools 2023-12-07T21:08:50.587 DEBUG:tasks.rgw:Obtaining remote for client client.0 2023-12-07T21:08:50.588 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2023-12-07T21:08:50.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.706+0000 7f8f719f5640 1 Processor -- start 2023-12-07T21:08:50.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.706+0000 7f8f719f5640 1 -- start start 2023-12-07T21:08:50.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.706+0000 7f8f719f5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f6c119c80 0x7f8f6c11c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:50.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.706+0000 7f8f719f5640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c11c640 con 0x7f8f6c116ef0 2023-12-07T21:08:50.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.706+0000 7f8f719f5640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c11d7e0 con 0x7f8f6c119c80 2023-12-07T21:08:50.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.706+0000 7f8f627fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f6c119c80 0x7f8f6c11c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:50.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.706+0000 7f8f6affd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8f6c116ef0 0x7f8f6c1172d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55858/0 (socket says 172.21.15.121:55858) 2023-12-07T21:08:50.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.706+0000 7f8f6affd640 1 -- 172.21.15.121:0/1233091466 learned_addr learned my addr 172.21.15.121:0/1233091466 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:08:50.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.707+0000 7f8f627fc640 1 -- 172.21.15.121:0/1233091466 >> v1:172.21.15.89:6789/0 conn(0x7f8f6c116ef0 legacy=0x7f8f6c1172d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:50.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.707+0000 7f8f627fc640 1 -- 172.21.15.121:0/1233091466 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c11d920 con 0x7f8f6c119c80 2023-12-07T21:08:50.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.708+0000 7f8f627fc640 1 --2- 172.21.15.121:0/1233091466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c119c80 0x7f8f6c11c070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f54009720 tx=0x7f8f5402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9679314f84d0bd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:50.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.708+0000 7f8f6a7fc640 1 -- 172.21.15.121:0/1233091466 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f5402e070 con 0x7f8f6c119c80 2023-12-07T21:08:50.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.708+0000 7f8f6a7fc640 1 -- 172.21.15.121:0/1233091466 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f540316d0 con 0x7f8f6c119c80 2023-12-07T21:08:50.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.708+0000 7f8f6a7fc640 1 -- 172.21.15.121:0/1233091466 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f54031990 con 0x7f8f6c119c80 2023-12-07T21:08:50.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.708+0000 7f8f719f5640 1 -- 172.21.15.121:0/1233091466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c119c80 msgr2=0x7f8f6c11c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:50.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.708+0000 7f8f719f5640 1 --2- 172.21.15.121:0/1233091466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c119c80 0x7f8f6c11c070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8f54009720 tx=0x7f8f5402b840 comp rx=0 tx=0).stop 2023-12-07T21:08:50.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.708+0000 7f8f719f5640 1 -- 172.21.15.121:0/1233091466 shutdown_connections 2023-12-07T21:08:50.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.708+0000 7f8f719f5640 1 --2- 172.21.15.121:0/1233091466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c119c80 0x7f8f6c11c070 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:50.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.708+0000 7f8f719f5640 1 -- 172.21.15.121:0/1233091466 >> 172.21.15.121:0/1233091466 conn(0x7f8f6c10cdb0 msgr2=0x7f8f6c10f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:50.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.708+0000 7f8f719f5640 1 -- 172.21.15.121:0/1233091466 shutdown_connections 2023-12-07T21:08:50.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.708+0000 7f8f719f5640 1 -- 172.21.15.121:0/1233091466 wait complete. 2023-12-07T21:08:50.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.709+0000 7f8f719f5640 1 Processor -- start 2023-12-07T21:08:50.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.709+0000 7f8f719f5640 1 -- start start 2023-12-07T21:08:50.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.709+0000 7f8f719f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c116ef0 0x7f8f6c1ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:50.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.709+0000 7f8f719f5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c1aba30 con 0x7f8f6c116ef0 2023-12-07T21:08:50.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.710+0000 7f8f6affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c116ef0 0x7f8f6c1ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:50.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.710+0000 7f8f6affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c116ef0 0x7f8f6c1ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:39026/0 (socket says 172.21.15.121:39026) 2023-12-07T21:08:50.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.710+0000 7f8f6affd640 1 -- 172.21.15.121:0/3761977570 learned_addr learned my addr 172.21.15.121:0/3761977570 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:50.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.710+0000 7f8f6affd640 1 -- 172.21.15.121:0/3761977570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f54009400 con 0x7f8f6c116ef0 2023-12-07T21:08:50.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.710+0000 7f8f6affd640 1 --2- 172.21.15.121:0/3761977570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c116ef0 0x7f8f6c1ab460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00c4a0 tx=0x7f8f5c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:50.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.710+0000 7f8f68ff9640 1 -- 172.21.15.121:0/3761977570 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c005c10 con 0x7f8f6c116ef0 2023-12-07T21:08:50.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.710+0000 7f8f68ff9640 1 -- 172.21.15.121:0/3761977570 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c005d70 con 0x7f8f6c116ef0 2023-12-07T21:08:50.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.710+0000 7f8f719f5640 1 -- 172.21.15.121:0/3761977570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c1abc30 con 0x7f8f6c116ef0 2023-12-07T21:08:50.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.710+0000 7f8f68ff9640 1 -- 172.21.15.121:0/3761977570 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f5c0071a0 con 0x7f8f6c116ef0 2023-12-07T21:08:50.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.710+0000 7f8f719f5640 1 -- 172.21.15.121:0/3761977570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c1a5550 con 0x7f8f6c116ef0 2023-12-07T21:08:50.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.711+0000 7f8f68ff9640 1 -- 172.21.15.121:0/3761977570 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f8f5c007300 con 0x7f8f6c116ef0 2023-12-07T21:08:50.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.711+0000 7f8f719f5640 1 -- 172.21.15.121:0/3761977570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c04f090 con 0x7f8f6c116ef0 2023-12-07T21:08:50.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.711+0000 7f8f68ff9640 1 --2- 172.21.15.121:0/3761977570 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8f4c037820 0x7f8f4c039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:50.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.711+0000 7f8f68ff9640 1 -- 172.21.15.121:0/3761977570 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f8f5c049650 con 0x7f8f6c116ef0 2023-12-07T21:08:50.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.712+0000 7f8f627fc640 1 --2- 172.21.15.121:0/3761977570 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8f4c037820 0x7f8f4c039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:50.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.712+0000 7f8f627fc640 1 --2- 172.21.15.121:0/3761977570 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8f4c037820 0x7f8f4c039ce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f54036000 tx=0x7f8f54008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:50.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.716+0000 7f8f68ff9640 1 -- 172.21.15.121:0/3761977570 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f5c0198b0 con 0x7f8f6c116ef0 2023-12-07T21:08:50.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:50.893+0000 7f8f719f5640 1 -- 172.21.15.121:0/3761977570 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f8f6c119c80 con 0x7f8f6c116ef0 2023-12-07T21:08:51.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.832+0000 7f8f68ff9640 1 -- 172.21.15.121:0/3761977570 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v17) v1 ==== 151+0+0 (secure 0 0 0) 0x7f8f5c017020 con 0x7f8f6c116ef0 2023-12-07T21:08:51.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.835+0000 7f8f719f5640 1 -- 172.21.15.121:0/3761977570 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8f4c037820 msgr2=0x7f8f4c039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:51.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.835+0000 7f8f719f5640 1 --2- 172.21.15.121:0/3761977570 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8f4c037820 0x7f8f4c039ce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f54036000 tx=0x7f8f54008030 comp rx=0 tx=0).stop 2023-12-07T21:08:51.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.835+0000 7f8f719f5640 1 -- 172.21.15.121:0/3761977570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c116ef0 msgr2=0x7f8f6c1ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:51.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.835+0000 7f8f719f5640 1 --2- 172.21.15.121:0/3761977570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c116ef0 0x7f8f6c1ab460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00c4a0 tx=0x7f8f5c00c960 comp rx=0 tx=0).stop 2023-12-07T21:08:51.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.835+0000 7f8f719f5640 1 -- 172.21.15.121:0/3761977570 shutdown_connections 2023-12-07T21:08:51.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.835+0000 7f8f719f5640 1 --2- 172.21.15.121:0/3761977570 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8f4c037820 0x7f8f4c039ce0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:51.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.835+0000 7f8f719f5640 1 --2- 172.21.15.121:0/3761977570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f6c116ef0 0x7f8f6c1ab460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:51.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.835+0000 7f8f719f5640 1 -- 172.21.15.121:0/3761977570 >> 172.21.15.121:0/3761977570 conn(0x7f8f6c10cdb0 msgr2=0x7f8f6c11a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:51.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.835+0000 7f8f719f5640 1 -- 172.21.15.121:0/3761977570 shutdown_connections 2023-12-07T21:08:51.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.835+0000 7f8f719f5640 1 -- 172.21.15.121:0/3761977570 wait complete. 2023-12-07T21:08:51.841 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2023-12-07T21:08:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.954+0000 7ff81d03f640 1 Processor -- start 2023-12-07T21:08:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.954+0000 7ff81d03f640 1 -- start start 2023-12-07T21:08:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.954+0000 7ff81d03f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff81810d200 0x7ff81810d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.954+0000 7ff81d03f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81810dc90 con 0x7ff818114c60 2023-12-07T21:08:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.954+0000 7ff81d03f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81810de20 con 0x7ff81810d200 2023-12-07T21:08:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.954+0000 7ff816d9d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff81810d200 0x7ff81810d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.954+0000 7ff81659c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff818114c60 0x7ff818115110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55866/0 (socket says 172.21.15.121:55866) 2023-12-07T21:08:51.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.954+0000 7ff81659c640 1 -- 172.21.15.121:0/2725850997 learned_addr learned my addr 172.21.15.121:0/2725850997 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:08:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.954+0000 7ff815d9b640 1 -- 172.21.15.121:0/2725850997 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13267416 0 0) 0x7ff81810dc90 con 0x7ff818114c60 2023-12-07T21:08:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.954+0000 7ff815d9b640 1 -- 172.21.15.121:0/2725850997 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff800003520 con 0x7ff818114c60 2023-12-07T21:08:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.955+0000 7ff816d9d640 1 -- 172.21.15.121:0/2725850997 >> v1:172.21.15.89:6789/0 conn(0x7ff818114c60 legacy=0x7ff818115110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:51.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.955+0000 7ff816d9d640 1 -- 172.21.15.121:0/2725850997 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff818115820 con 0x7ff81810d200 2023-12-07T21:08:51.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.955+0000 7ff816d9d640 1 --2- 172.21.15.121:0/2725850997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff81810d200 0x7ff81810d600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff808009720 tx=0x7ff80802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75423c81ca1dc41a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:51.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.955+0000 7ff815d9b640 1 -- 172.21.15.121:0/2725850997 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff80802e070 con 0x7ff81810d200 2023-12-07T21:08:51.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.955+0000 7ff815d9b640 1 -- 172.21.15.121:0/2725850997 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8080316d0 con 0x7ff81810d200 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.956+0000 7ff815d9b640 1 -- 172.21.15.121:0/2725850997 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff808031970 con 0x7ff81810d200 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.956+0000 7ff81d03f640 1 -- 172.21.15.121:0/2725850997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff81810d200 msgr2=0x7ff81810d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.956+0000 7ff81d03f640 1 --2- 172.21.15.121:0/2725850997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff81810d200 0x7ff81810d600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff808009720 tx=0x7ff80802b840 comp rx=0 tx=0).stop 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.956+0000 7ff81d03f640 1 -- 172.21.15.121:0/2725850997 shutdown_connections 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.956+0000 7ff81d03f640 1 --2- 172.21.15.121:0/2725850997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff81810d200 0x7ff81810d600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.956+0000 7ff81d03f640 1 -- 172.21.15.121:0/2725850997 >> 172.21.15.121:0/2725850997 conn(0x7ff81806ec70 msgr2=0x7ff818071090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.956+0000 7ff81d03f640 1 -- 172.21.15.121:0/2725850997 shutdown_connections 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.956+0000 7ff81d03f640 1 -- 172.21.15.121:0/2725850997 wait complete. 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.957+0000 7ff81d03f640 1 Processor -- start 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.957+0000 7ff81d03f640 1 -- start start 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.957+0000 7ff81d03f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff81810d200 0x7ff8181ab490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:51.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.957+0000 7ff81d03f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8181aba60 con 0x7ff81810d200 2023-12-07T21:08:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.957+0000 7ff816d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff81810d200 0x7ff8181ab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.957+0000 7ff816d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff81810d200 0x7ff8181ab490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:39042/0 (socket says 172.21.15.121:39042) 2023-12-07T21:08:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.957+0000 7ff816d9d640 1 -- 172.21.15.121:0/1190995067 learned_addr learned my addr 172.21.15.121:0/1190995067 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.958+0000 7ff816d9d640 1 -- 172.21.15.121:0/1190995067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff808009400 con 0x7ff81810d200 2023-12-07T21:08:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.958+0000 7ff816d9d640 1 --2- 172.21.15.121:0/1190995067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff81810d200 0x7ff8181ab490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff80802b880 tx=0x7ff8080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.958+0000 7ff7ff7fe640 1 -- 172.21.15.121:0/1190995067 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff808004150 con 0x7ff81810d200 2023-12-07T21:08:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.958+0000 7ff7ff7fe640 1 -- 172.21.15.121:0/1190995067 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8080042b0 con 0x7ff81810d200 2023-12-07T21:08:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.958+0000 7ff81d03f640 1 -- 172.21.15.121:0/1190995067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8181abc60 con 0x7ff81810d200 2023-12-07T21:08:51.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.958+0000 7ff7ff7fe640 1 -- 172.21.15.121:0/1190995067 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff808003610 con 0x7ff81810d200 2023-12-07T21:08:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.958+0000 7ff81d03f640 1 -- 172.21.15.121:0/1190995067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8181a5560 con 0x7ff81810d200 2023-12-07T21:08:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.959+0000 7ff7ff7fe640 1 -- 172.21.15.121:0/1190995067 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7ff808043070 con 0x7ff81810d200 2023-12-07T21:08:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.959+0000 7ff81d03f640 1 -- 172.21.15.121:0/1190995067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff81804f090 con 0x7ff81810d200 2023-12-07T21:08:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.959+0000 7ff7ff7fe640 1 --2- 172.21.15.121:0/1190995067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8040377d0 0x7ff804039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.959+0000 7ff7ff7fe640 1 -- 172.21.15.121:0/1190995067 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3702+0+0 (secure 0 0 0) 0x7ff80806bf50 con 0x7ff81810d200 2023-12-07T21:08:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.959+0000 7ff81659c640 1 --2- 172.21.15.121:0/1190995067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8040377d0 0x7ff804039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:51.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.960+0000 7ff81659c640 1 --2- 172.21.15.121:0/1190995067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8040377d0 0x7ff804039c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff80c007fd0 tx=0x7ff80c0010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:51.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:51.964+0000 7ff7ff7fe640 1 -- 172.21.15.121:0/1190995067 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff80804d3a0 con 0x7ff81810d200 2023-12-07T21:08:52.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:52.131+0000 7ff81d03f640 1 -- 172.21.15.121:0/1190995067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) v1 -- 0x7ff818067d70 con 0x7ff81810d200 2023-12-07T21:08:53.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.845+0000 7ff7ff7fe640 1 -- 172.21.15.121:0/1190995067 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v19) v1 ==== 227+0+0 (secure 0 0 0) 0x7ff80803ab70 con 0x7ff81810d200 2023-12-07T21:08:53.838 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'default.rgw.buckets.data' created 2023-12-07T21:08:53.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.848+0000 7ff81d03f640 1 -- 172.21.15.121:0/1190995067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8040377d0 msgr2=0x7ff804039c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:53.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.848+0000 7ff81d03f640 1 --2- 172.21.15.121:0/1190995067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8040377d0 0x7ff804039c90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff80c007fd0 tx=0x7ff80c0010a0 comp rx=0 tx=0).stop 2023-12-07T21:08:53.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.848+0000 7ff81d03f640 1 -- 172.21.15.121:0/1190995067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff81810d200 msgr2=0x7ff8181ab490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:53.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.848+0000 7ff81d03f640 1 --2- 172.21.15.121:0/1190995067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff81810d200 0x7ff8181ab490 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff80802b880 tx=0x7ff8080046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:53.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.848+0000 7ff81d03f640 1 -- 172.21.15.121:0/1190995067 shutdown_connections 2023-12-07T21:08:53.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.848+0000 7ff81d03f640 1 --2- 172.21.15.121:0/1190995067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8040377d0 0x7ff804039c90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:53.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.848+0000 7ff81d03f640 1 --2- 172.21.15.121:0/1190995067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff81810d200 0x7ff8181ab490 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:53.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.848+0000 7ff81d03f640 1 -- 172.21.15.121:0/1190995067 >> 172.21.15.121:0/1190995067 conn(0x7ff81806ec70 msgr2=0x7ff81810e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:53.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.848+0000 7ff81d03f640 1 -- 172.21.15.121:0/1190995067 shutdown_connections 2023-12-07T21:08:53.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.848+0000 7ff81d03f640 1 -- 172.21.15.121:0/1190995067 wait complete. 2023-12-07T21:08:53.861 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2023-12-07T21:08:53.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.971+0000 7f12b7b01640 1 Processor -- start 2023-12-07T21:08:53.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.971+0000 7f12b7b01640 1 -- start start 2023-12-07T21:08:53.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.971+0000 7f12b7b01640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12b0117ce0 0x7f12b011a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:53.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.971+0000 7f12b7b01640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b011a610 con 0x7f12b010d200 2023-12-07T21:08:53.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.971+0000 7f12b7b01640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b011b7b0 con 0x7f12b0117ce0 2023-12-07T21:08:53.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.971+0000 7f12b509c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12b0117ce0 0x7f12b011a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:53.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.972+0000 7f12b589d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f12b010d200 0x7f12b010d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55874/0 (socket says 172.21.15.121:55874) 2023-12-07T21:08:53.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.972+0000 7f12b509c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f12b0117ce0 0x7f12b011a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:39048/0 (socket says 172.21.15.121:39048) 2023-12-07T21:08:53.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.972+0000 7f12b589d640 1 -- 172.21.15.121:0/1552875749 learned_addr learned my addr 172.21.15.121:0/1552875749 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:08:53.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.972+0000 7f12b509c640 1 -- 172.21.15.121:0/1552875749 >> v1:172.21.15.89:6789/0 conn(0x7f12b010d200 legacy=0x7f12b010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:53.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.972+0000 7f12b509c640 1 -- 172.21.15.121:0/1552875749 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b011b8f0 con 0x7f12b0117ce0 2023-12-07T21:08:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.973+0000 7f12b509c640 1 --2- 172.21.15.121:0/1552875749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b0117ce0 0x7f12b011a0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009720 tx=0x7f12a402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807fc038044c878a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.973+0000 7f12b489b640 1 -- 172.21.15.121:0/1552875749 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a402e070 con 0x7f12b0117ce0 2023-12-07T21:08:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.973+0000 7f12b489b640 1 -- 172.21.15.121:0/1552875749 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40316d0 con 0x7f12b0117ce0 2023-12-07T21:08:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.973+0000 7f12b489b640 1 -- 172.21.15.121:0/1552875749 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12a4031990 con 0x7f12b0117ce0 2023-12-07T21:08:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.973+0000 7f12b7b01640 1 -- 172.21.15.121:0/1552875749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b0117ce0 msgr2=0x7f12b011a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.973+0000 7f12b7b01640 1 --2- 172.21.15.121:0/1552875749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b0117ce0 0x7f12b011a0d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009720 tx=0x7f12a402b840 comp rx=0 tx=0).stop 2023-12-07T21:08:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.973+0000 7f12b7b01640 1 -- 172.21.15.121:0/1552875749 shutdown_connections 2023-12-07T21:08:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.973+0000 7f12b7b01640 1 --2- 172.21.15.121:0/1552875749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b0117ce0 0x7f12b011a0d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.973+0000 7f12b7b01640 1 -- 172.21.15.121:0/1552875749 >> 172.21.15.121:0/1552875749 conn(0x7f12b006ec50 msgr2=0x7f12b0071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.973+0000 7f12b7b01640 1 -- 172.21.15.121:0/1552875749 shutdown_connections 2023-12-07T21:08:53.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.973+0000 7f12b7b01640 1 -- 172.21.15.121:0/1552875749 wait complete. 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.974+0000 7f12b7b01640 1 Processor -- start 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.974+0000 7f12b7b01640 1 -- start start 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.974+0000 7f12b7b01640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b010d200 0x7f12b01a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.974+0000 7f12b7b01640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01a3f30 con 0x7f12b010d200 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.975+0000 7f12b589d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b010d200 0x7f12b01a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.975+0000 7f12b589d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b010d200 0x7f12b01a3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:39054/0 (socket says 172.21.15.121:39054) 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.975+0000 7f12b589d640 1 -- 172.21.15.121:0/779023946 learned_addr learned my addr 172.21.15.121:0/779023946 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.975+0000 7f12b589d640 1 -- 172.21.15.121:0/779023946 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4009400 con 0x7f12b010d200 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.975+0000 7f12b589d640 1 --2- 172.21.15.121:0/779023946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b010d200 0x7f12b01a3960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c340 tx=0x7f12ac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.975+0000 7f12a27fc640 1 -- 172.21.15.121:0/779023946 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac005c10 con 0x7f12b010d200 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.975+0000 7f12a27fc640 1 -- 172.21.15.121:0/779023946 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac005d70 con 0x7f12b010d200 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.975+0000 7f12b7b01640 1 -- 172.21.15.121:0/779023946 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b01a4130 con 0x7f12b010d200 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.975+0000 7f12a27fc640 1 -- 172.21.15.121:0/779023946 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12ac004930 con 0x7f12b010d200 2023-12-07T21:08:53.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.975+0000 7f12b7b01640 1 -- 172.21.15.121:0/779023946 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b01a8210 con 0x7f12b010d200 2023-12-07T21:08:53.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.976+0000 7f12b7b01640 1 -- 172.21.15.121:0/779023946 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b004f090 con 0x7f12b010d200 2023-12-07T21:08:53.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.976+0000 7f12a27fc640 1 -- 172.21.15.121:0/779023946 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f12ac004a90 con 0x7f12b010d200 2023-12-07T21:08:53.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.976+0000 7f12a27fc640 1 --2- 172.21.15.121:0/779023946 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1294037820 0x7f1294039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:53.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.976+0000 7f12a27fc640 1 -- 172.21.15.121:0/779023946 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4177+0+0 (secure 0 0 0) 0x7f12ac049e40 con 0x7f12b010d200 2023-12-07T21:08:53.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.977+0000 7f12b509c640 1 --2- 172.21.15.121:0/779023946 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1294037820 0x7f1294039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:53.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.977+0000 7f12b509c640 1 --2- 172.21.15.121:0/779023946 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1294037820 0x7f1294039ce0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f12a4036000 tx=0x7f12a4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:53.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:53.981+0000 7f12a27fc640 1 -- 172.21.15.121:0/779023946 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f12ac011c00 con 0x7f12b010d200 2023-12-07T21:08:54.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.148+0000 7f12b7b01640 1 -- 172.21.15.121:0/779023946 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7f12b01a4320 con 0x7f12b010d200 2023-12-07T21:08:54.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.850+0000 7f12a27fc640 1 -- 172.21.15.121:0/779023946 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v20) v1 ==== 185+0+0 (secure 0 0 0) 0x7f12ac011810 con 0x7f12b010d200 2023-12-07T21:08:54.844 INFO:teuthology.orchestra.run.smithi121.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-12-07T21:08:54.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.853+0000 7f12b7b01640 1 -- 172.21.15.121:0/779023946 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1294037820 msgr2=0x7f1294039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:54.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.853+0000 7f12b7b01640 1 --2- 172.21.15.121:0/779023946 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1294037820 0x7f1294039ce0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f12a4036000 tx=0x7f12a4008030 comp rx=0 tx=0).stop 2023-12-07T21:08:54.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.853+0000 7f12b7b01640 1 -- 172.21.15.121:0/779023946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b010d200 msgr2=0x7f12b01a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:54.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.853+0000 7f12b7b01640 1 --2- 172.21.15.121:0/779023946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b010d200 0x7f12b01a3960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c340 tx=0x7f12ac001e70 comp rx=0 tx=0).stop 2023-12-07T21:08:54.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.855+0000 7f12b7b01640 1 -- 172.21.15.121:0/779023946 shutdown_connections 2023-12-07T21:08:54.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.855+0000 7f12b7b01640 1 --2- 172.21.15.121:0/779023946 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1294037820 0x7f1294039ce0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:54.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.855+0000 7f12b7b01640 1 --2- 172.21.15.121:0/779023946 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b010d200 0x7f12b01a3960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:54.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.855+0000 7f12b7b01640 1 -- 172.21.15.121:0/779023946 >> 172.21.15.121:0/779023946 conn(0x7f12b006ec50 msgr2=0x7f12b0118da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:54.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.861+0000 7f12b7b01640 1 -- 172.21.15.121:0/779023946 shutdown_connections 2023-12-07T21:08:54.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.861+0000 7f12b7b01640 1 -- 172.21.15.121:0/779023946 wait complete. 2023-12-07T21:08:54.875 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2023-12-07T21:08:54.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.986+0000 7f2222e39640 1 Processor -- start 2023-12-07T21:08:54.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.986+0000 7f2222e39640 1 -- start start 2023-12-07T21:08:54.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.986+0000 7f2222e39640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f221c117ce0 0x7f221c11a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:54.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.986+0000 7f2222e39640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221c11a610 con 0x7f221c10d200 2023-12-07T21:08:54.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.986+0000 7f2222e39640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221c11b7b0 con 0x7f221c117ce0 2023-12-07T21:08:54.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.987+0000 7f221bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f221c117ce0 0x7f221c11a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:54.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.987+0000 7f2220bd5640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f221c10d200 0x7f221c10d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55882/0 (socket says 172.21.15.121:55882) 2023-12-07T21:08:54.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.987+0000 7f2220bd5640 1 -- 172.21.15.121:0/3078259098 learned_addr learned my addr 172.21.15.121:0/3078259098 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:08:54.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.987+0000 7f221bfff640 1 -- 172.21.15.121:0/3078259098 >> v1:172.21.15.89:6789/0 conn(0x7f221c10d200 legacy=0x7f221c10d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:54.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.987+0000 7f221bfff640 1 -- 172.21.15.121:0/3078259098 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c11b8f0 con 0x7f221c117ce0 2023-12-07T21:08:54.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.988+0000 7f221bfff640 1 --2- 172.21.15.121:0/3078259098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f221c117ce0 0x7f221c11a0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2210009720 tx=0x7f221002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e95b23f317dcef2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:54.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.988+0000 7f221b7fe640 1 -- 172.21.15.121:0/3078259098 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f221002e070 con 0x7f221c117ce0 2023-12-07T21:08:54.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.988+0000 7f221b7fe640 1 -- 172.21.15.121:0/3078259098 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22100316d0 con 0x7f221c117ce0 2023-12-07T21:08:54.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.988+0000 7f221b7fe640 1 -- 172.21.15.121:0/3078259098 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2210031990 con 0x7f221c117ce0 2023-12-07T21:08:54.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.988+0000 7f2222e39640 1 -- 172.21.15.121:0/3078259098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f221c117ce0 msgr2=0x7f221c11a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:54.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.988+0000 7f2222e39640 1 --2- 172.21.15.121:0/3078259098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f221c117ce0 0x7f221c11a0d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2210009720 tx=0x7f221002b840 comp rx=0 tx=0).stop 2023-12-07T21:08:54.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.988+0000 7f2222e39640 1 -- 172.21.15.121:0/3078259098 shutdown_connections 2023-12-07T21:08:54.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.988+0000 7f2222e39640 1 --2- 172.21.15.121:0/3078259098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f221c117ce0 0x7f221c11a0d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:54.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.988+0000 7f2222e39640 1 -- 172.21.15.121:0/3078259098 >> 172.21.15.121:0/3078259098 conn(0x7f221c06ec50 msgr2=0x7f221c071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:54.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.989+0000 7f2222e39640 1 -- 172.21.15.121:0/3078259098 shutdown_connections 2023-12-07T21:08:54.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.989+0000 7f2222e39640 1 -- 172.21.15.121:0/3078259098 wait complete. 2023-12-07T21:08:54.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.989+0000 7f2222e39640 1 Processor -- start 2023-12-07T21:08:54.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.989+0000 7f2222e39640 1 -- start start 2023-12-07T21:08:54.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.989+0000 7f2222e39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f221c10d200 0x7f221c1a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:54.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.989+0000 7f2222e39640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c1a3f30 con 0x7f221c10d200 2023-12-07T21:08:54.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.990+0000 7f2220bd5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f221c10d200 0x7f221c1a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:54.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.990+0000 7f2220bd5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f221c10d200 0x7f221c1a3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:39076/0 (socket says 172.21.15.121:39076) 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.990+0000 7f2220bd5640 1 -- 172.21.15.121:0/595425063 learned_addr learned my addr 172.21.15.121:0/595425063 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.990+0000 7f2220bd5640 1 -- 172.21.15.121:0/595425063 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2210009400 con 0x7f221c10d200 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.990+0000 7f2220bd5640 1 --2- 172.21.15.121:0/595425063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f221c10d200 0x7f221c1a3960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f220c00c480 tx=0x7f220c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.990+0000 7f22197fa640 1 -- 172.21.15.121:0/595425063 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f220c005c10 con 0x7f221c10d200 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.990+0000 7f22197fa640 1 -- 172.21.15.121:0/595425063 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220c005d70 con 0x7f221c10d200 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.990+0000 7f2222e39640 1 -- 172.21.15.121:0/595425063 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221c1a4190 con 0x7f221c10d200 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.990+0000 7f22197fa640 1 -- 172.21.15.121:0/595425063 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f220c007200 con 0x7f221c10d200 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.990+0000 7f2222e39640 1 -- 172.21.15.121:0/595425063 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221c1a8210 con 0x7f221c10d200 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.991+0000 7f2222e39640 1 -- 172.21.15.121:0/595425063 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221c04f090 con 0x7f221c10d200 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.991+0000 7f22197fa640 1 -- 172.21.15.121:0/595425063 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f220c007360 con 0x7f221c10d200 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.991+0000 7f22197fa640 1 --2- 172.21.15.121:0/595425063 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f22080377d0 0x7f2208039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.991+0000 7f22197fa640 1 -- 172.21.15.121:0/595425063 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4188+0+0 (secure 0 0 0) 0x7f220c0498f0 con 0x7f221c10d200 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.991+0000 7f221bfff640 1 --2- 172.21.15.121:0/595425063 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f22080377d0 0x7f2208039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:54.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.992+0000 7f221bfff640 1 --2- 172.21.15.121:0/595425063 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f22080377d0 0x7f2208039c90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2210036000 tx=0x7f2210008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:54.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:54.996+0000 7f22197fa640 1 -- 172.21.15.121:0/595425063 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f220c01b3b0 con 0x7f221c10d200 2023-12-07T21:08:55.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.162+0000 7f2222e39640 1 -- 172.21.15.121:0/595425063 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f221c1a4320 con 0x7f221c10d200 2023-12-07T21:08:55.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.855+0000 7f22197fa640 1 -- 172.21.15.121:0/595425063 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v21) v1 ==== 169+0+0 (secure 0 0 0) 0x7f220c017070 con 0x7f221c10d200 2023-12-07T21:08:55.848 INFO:teuthology.orchestra.run.smithi121.stderr:pool 'default.rgw.buckets.index' created 2023-12-07T21:08:55.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.858+0000 7f2222e39640 1 -- 172.21.15.121:0/595425063 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f22080377d0 msgr2=0x7f2208039c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:55.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.858+0000 7f2222e39640 1 --2- 172.21.15.121:0/595425063 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f22080377d0 0x7f2208039c90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2210036000 tx=0x7f2210008030 comp rx=0 tx=0).stop 2023-12-07T21:08:55.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.858+0000 7f2222e39640 1 -- 172.21.15.121:0/595425063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f221c10d200 msgr2=0x7f221c1a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:55.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.858+0000 7f2222e39640 1 --2- 172.21.15.121:0/595425063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f221c10d200 0x7f221c1a3960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f220c00c480 tx=0x7f220c00c940 comp rx=0 tx=0).stop 2023-12-07T21:08:55.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.859+0000 7f2222e39640 1 -- 172.21.15.121:0/595425063 shutdown_connections 2023-12-07T21:08:55.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.859+0000 7f2222e39640 1 --2- 172.21.15.121:0/595425063 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f22080377d0 0x7f2208039c90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:55.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.859+0000 7f2222e39640 1 --2- 172.21.15.121:0/595425063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f221c10d200 0x7f221c1a3960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:55.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.859+0000 7f2222e39640 1 -- 172.21.15.121:0/595425063 >> 172.21.15.121:0/595425063 conn(0x7f221c06ec50 msgr2=0x7f221c118da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:55.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.861+0000 7f2222e39640 1 -- 172.21.15.121:0/595425063 shutdown_connections 2023-12-07T21:08:55.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.862+0000 7f2222e39640 1 -- 172.21.15.121:0/595425063 wait complete. 2023-12-07T21:08:55.873 DEBUG:teuthology.orchestra.run.smithi121:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2023-12-07T21:08:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.982+0000 7f49526af640 1 Processor -- start 2023-12-07T21:08:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.982+0000 7f49526af640 1 -- start start 2023-12-07T21:08:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.982+0000 7f49526af640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f494c10d200 0x7f494c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.982+0000 7f49526af640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c10dca0 con 0x7f494c114bf0 2023-12-07T21:08:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.982+0000 7f49526af640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c10de30 con 0x7f494c10d200 2023-12-07T21:08:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.982+0000 7f494bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f494c10d200 0x7f494c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.982+0000 7f494bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f494c10d200 0x7f494c10d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:58566/0 (socket says 172.21.15.121:58566) 2023-12-07T21:08:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.982+0000 7f494bfff640 1 -- 172.21.15.121:0/1323320650 learned_addr learned my addr 172.21.15.121:0/1323320650 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.982+0000 7f494b7fe640 1 --1- 172.21.15.121:0/1323320650 >> v1:172.21.15.89:6789/0 conn(0x7f494c114bf0 0x7f494c1150a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:35518/0 (socket says 172.21.15.121:35518) 2023-12-07T21:08:55.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.983+0000 7f494bfff640 1 -- 172.21.15.121:0/1323320650 >> v1:172.21.15.89:6789/0 conn(0x7f494c114bf0 legacy=0x7f494c1150a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:55.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.983+0000 7f494bfff640 1 -- 172.21.15.121:0/1323320650 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c1157b0 con 0x7f494c10d200 2023-12-07T21:08:55.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.983+0000 7f494bfff640 1 --2- 172.21.15.121:0/1323320650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c10d200 0x7f494c10d5e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f493c0097f0 tx=0x7f493c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf1656af0b0d50f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:55.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.984+0000 7f494affd640 1 -- 172.21.15.121:0/1323320650 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f493c0317a0 con 0x7f494c10d200 2023-12-07T21:08:55.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.984+0000 7f494affd640 1 -- 172.21.15.121:0/1323320650 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c031900 con 0x7f494c10d200 2023-12-07T21:08:55.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.984+0000 7f494affd640 1 -- 172.21.15.121:0/1323320650 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f493c031bc0 con 0x7f494c10d200 2023-12-07T21:08:55.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.984+0000 7f49526af640 1 -- 172.21.15.121:0/1323320650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c10d200 msgr2=0x7f494c10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:55.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.984+0000 7f49526af640 1 --2- 172.21.15.121:0/1323320650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c10d200 0x7f494c10d5e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f493c0097f0 tx=0x7f493c02b910 comp rx=0 tx=0).stop 2023-12-07T21:08:55.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.984+0000 7f49526af640 1 -- 172.21.15.121:0/1323320650 shutdown_connections 2023-12-07T21:08:55.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.984+0000 7f49526af640 1 --2- 172.21.15.121:0/1323320650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c10d200 0x7f494c10d5e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:55.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.984+0000 7f49526af640 1 -- 172.21.15.121:0/1323320650 >> 172.21.15.121:0/1323320650 conn(0x7f494c06ec50 msgr2=0x7f494c071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:55.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.984+0000 7f49526af640 1 -- 172.21.15.121:0/1323320650 shutdown_connections 2023-12-07T21:08:55.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.984+0000 7f49526af640 1 -- 172.21.15.121:0/1323320650 wait complete. 2023-12-07T21:08:55.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.985+0000 7f49526af640 1 Processor -- start 2023-12-07T21:08:55.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.985+0000 7f49526af640 1 -- start start 2023-12-07T21:08:55.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.985+0000 7f49526af640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c10d200 0x7f494c1a9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:55.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.985+0000 7f49526af640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c1a9a40 con 0x7f494c10d200 2023-12-07T21:08:55.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.985+0000 7f494bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c10d200 0x7f494c1a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:55.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.985+0000 7f494bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c10d200 0x7f494c1a9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:58578/0 (socket says 172.21.15.121:58578) 2023-12-07T21:08:55.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.985+0000 7f494bfff640 1 -- 172.21.15.121:0/1287159090 learned_addr learned my addr 172.21.15.121:0/1287159090 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:08:55.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.986+0000 7f494bfff640 1 -- 172.21.15.121:0/1287159090 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c0094d0 con 0x7f494c10d200 2023-12-07T21:08:55.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.986+0000 7f494bfff640 1 --2- 172.21.15.121:0/1287159090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c10d200 0x7f494c1a9470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f493c0090b0 tx=0x7f493c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:55.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.986+0000 7f4948ff9640 1 -- 172.21.15.121:0/1287159090 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f493c031ba0 con 0x7f494c10d200 2023-12-07T21:08:55.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.986+0000 7f4948ff9640 1 -- 172.21.15.121:0/1287159090 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c0443f0 con 0x7f494c10d200 2023-12-07T21:08:55.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.986+0000 7f49526af640 1 -- 172.21.15.121:0/1287159090 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c1a9be0 con 0x7f494c10d200 2023-12-07T21:08:55.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.986+0000 7f4948ff9640 1 -- 172.21.15.121:0/1287159090 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f493c044690 con 0x7f494c10d200 2023-12-07T21:08:55.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.986+0000 7f49526af640 1 -- 172.21.15.121:0/1287159090 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c1a34e0 con 0x7f494c10d200 2023-12-07T21:08:55.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.987+0000 7f49526af640 1 -- 172.21.15.121:0/1287159090 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c04f090 con 0x7f494c10d200 2023-12-07T21:08:55.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.987+0000 7f4948ff9640 1 -- 172.21.15.121:0/1287159090 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f493c04d450 con 0x7f494c10d200 2023-12-07T21:08:55.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.987+0000 7f4948ff9640 1 --2- 172.21.15.121:0/1287159090 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4938037820 0x7f4938039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:08:55.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.987+0000 7f4948ff9640 1 -- 172.21.15.121:0/1287159090 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4552+0+0 (secure 0 0 0) 0x7f493c02d040 con 0x7f494c10d200 2023-12-07T21:08:55.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.987+0000 7f494b7fe640 1 --2- 172.21.15.121:0/1287159090 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4938037820 0x7f4938039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:08:55.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.988+0000 7f494b7fe640 1 --2- 172.21.15.121:0/1287159090 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4938037820 0x7f4938039ce0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4940000f60 tx=0x7f4940007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:08:55.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:55.992+0000 7f4948ff9640 1 -- 172.21.15.121:0/1287159090 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f493c073080 con 0x7f494c10d200 2023-12-07T21:08:56.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.161+0000 7f49526af640 1 -- 172.21.15.121:0/1287159090 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7f494c067d70 con 0x7f494c10d200 2023-12-07T21:08:56.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.857+0000 7f4948ff9640 1 -- 172.21.15.121:0/1287159090 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v22) v1 ==== 187+0+0 (secure 0 0 0) 0x7f493c04b710 con 0x7f494c10d200 2023-12-07T21:08:56.851 INFO:teuthology.orchestra.run.smithi121.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-12-07T21:08:56.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.861+0000 7f49526af640 1 -- 172.21.15.121:0/1287159090 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4938037820 msgr2=0x7f4938039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:56.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.861+0000 7f49526af640 1 --2- 172.21.15.121:0/1287159090 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4938037820 0x7f4938039ce0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4940000f60 tx=0x7f4940007a80 comp rx=0 tx=0).stop 2023-12-07T21:08:56.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.861+0000 7f49526af640 1 -- 172.21.15.121:0/1287159090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c10d200 msgr2=0x7f494c1a9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:08:56.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.861+0000 7f49526af640 1 --2- 172.21.15.121:0/1287159090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c10d200 0x7f494c1a9470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f493c0090b0 tx=0x7f493c0046c0 comp rx=0 tx=0).stop 2023-12-07T21:08:56.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.863+0000 7f49526af640 1 -- 172.21.15.121:0/1287159090 shutdown_connections 2023-12-07T21:08:56.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.863+0000 7f49526af640 1 --2- 172.21.15.121:0/1287159090 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4938037820 0x7f4938039ce0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:56.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.863+0000 7f49526af640 1 --2- 172.21.15.121:0/1287159090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f494c10d200 0x7f494c1a9470 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:08:56.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.863+0000 7f49526af640 1 -- 172.21.15.121:0/1287159090 >> 172.21.15.121:0/1287159090 conn(0x7f494c06ec50 msgr2=0x7f494c110bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:08:56.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.867+0000 7f49526af640 1 -- 172.21.15.121:0/1287159090 shutdown_connections 2023-12-07T21:08:56.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:08:56.869+0000 7f49526af640 1 -- 172.21.15.121:0/1287159090 wait complete. 2023-12-07T21:08:56.884 DEBUG:tasks.rgw:Pools created 2023-12-07T21:08:56.884 INFO:tasks.rgw:Starting rgw... 2023-12-07T21:08:56.884 INFO:tasks.rgw:rgw client.0 config is {} 2023-12-07T21:08:56.884 INFO:tasks.rgw:Using beast as radosgw frontend 2023-12-07T21:08:56.885 INFO:tasks.rgw.client.0:Restarting daemon 2023-12-07T21:08:56.885 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2023-12-07T21:08:56.887 INFO:tasks.rgw.client.0:Started 2023-12-07T21:08:56.887 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi121.front.sepia.ceph.com:80/ 2023-12-07T21:08:56.887 DEBUG:teuthology.orchestra.run.smithi121:> curl http://smithi121.front.sepia.ceph.com:80/ 2023-12-07T21:08:56.926 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-07T21:08:56.926 INFO:teuthology.orchestra.run.smithi121.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-07T21:08:56.926 INFO:teuthology.orchestra.run.smithi121.stderr: Dload Upload Total Spent Left Speed 2023-12-07T21:08:56.926 INFO:teuthology.orchestra.run.smithi121.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-07T21:08:56.927 INFO:teuthology.orchestra.run.smithi121.stderr:curl: (7) Failed to connect to smithi121.front.sepia.ceph.com port 80: Connection refused 2023-12-07T21:08:57.927 DEBUG:teuthology.orchestra.run.smithi121:> curl http://smithi121.front.sepia.ceph.com:80/ 2023-12-07T21:08:57.951 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-07T21:08:57.951 INFO:teuthology.orchestra.run.smithi121.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-07T21:08:57.951 INFO:teuthology.orchestra.run.smithi121.stderr: Dload Upload Total Spent Left Speed 2023-12-07T21:08:57.952 INFO:teuthology.orchestra.run.smithi121.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-07T21:08:57.952 INFO:teuthology.orchestra.run.smithi121.stderr:curl: (7) Failed to connect to smithi121.front.sepia.ceph.com port 80: Connection refused 2023-12-07T21:08:59.953 DEBUG:teuthology.orchestra.run.smithi121:> curl http://smithi121.front.sepia.ceph.com:80/ 2023-12-07T21:08:59.975 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-07T21:08:59.976 INFO:teuthology.orchestra.run.smithi121.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-07T21:08:59.976 INFO:teuthology.orchestra.run.smithi121.stderr: Dload Upload Total Spent Left Speed 2023-12-07T21:08:59.976 INFO:teuthology.orchestra.run.smithi121.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-07T21:08:59.976 INFO:teuthology.orchestra.run.smithi121.stderr:curl: (7) Failed to connect to smithi121.front.sepia.ceph.com port 80: Connection refused 2023-12-07T21:09:03.976 DEBUG:teuthology.orchestra.run.smithi121:> curl http://smithi121.front.sepia.ceph.com:80/ 2023-12-07T21:09:04.000 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-07T21:09:04.000 INFO:teuthology.orchestra.run.smithi121.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-07T21:09:04.000 INFO:teuthology.orchestra.run.smithi121.stderr: Dload Upload Total Spent Left Speed 2023-12-07T21:09:04.000 INFO:teuthology.orchestra.run.smithi121.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-07T21:09:04.001 INFO:teuthology.orchestra.run.smithi121.stderr:curl: (7) Failed to connect to smithi121.front.sepia.ceph.com port 80: Connection refused 2023-12-07T21:09:12.001 DEBUG:teuthology.orchestra.run.smithi121:> curl http://smithi121.front.sepia.ceph.com:80/ 2023-12-07T21:09:12.023 INFO:teuthology.orchestra.run.smithi121.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-07T21:09:12.023 INFO:teuthology.orchestra.run.smithi121.stderr: Dload Upload Total Spent Left Speed 2023-12-07T21:09:12.026 INFO:teuthology.orchestra.run.smithi121.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2023-12-07T21:09:12.026 INFO:teuthology.orchestra.run.smithi121.stdout:anonymous 2023-12-07T21:09:12.026 INFO:teuthology.run_tasks:Running task radosgw-admin... 2023-12-07T21:09:12.082 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2023-12-07T21:09:12.082 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2023-12-07T21:09:12.083 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2023-12-07T21:09:12.083 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2023-12-07T21:09:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:12.130 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:12.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.137+0000 7f9a14dad800 1 Processor -- start 2023-12-07T21:09:12.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.137+0000 7f9a14dad800 1 -- start start 2023-12-07T21:09:12.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.138+0000 7f9a14dad800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55de4d68f4d0 0x55de4d691960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.138+0000 7f9a14dad800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55de4d5d7790 con 0x55de4d5ffb80 2023-12-07T21:09:12.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.138+0000 7f9a14dad800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55de4d5a0880 con 0x55de4d68f4d0 2023-12-07T21:09:12.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.138+0000 7f9a120ac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55de4d68f4d0 0x55de4d691960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.138+0000 7f9a120ac640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55de4d68f4d0 0x55de4d691960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52784/0 (socket says 172.21.15.121:52784) 2023-12-07T21:09:12.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.138+0000 7f9a128ad640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55de4d5ffb80 0x55de4d68ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37616/0 (socket says 172.21.15.121:37616) 2023-12-07T21:09:12.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.138+0000 7f9a120ac640 1 -- 172.21.15.121:0/3460048323 learned_addr learned my addr 172.21.15.121:0/3460048323 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.138+0000 7f9a120ac640 1 -- 172.21.15.121:0/3460048323 >> v1:172.21.15.89:6789/0 conn(0x55de4d5ffb80 legacy=0x55de4d68ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.138+0000 7f9a120ac640 1 -- 172.21.15.121:0/3460048323 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de4d693040 con 0x55de4d68f4d0 2023-12-07T21:09:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.140+0000 7f9a120ac640 1 --2- 172.21.15.121:0/3460048323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d68f4d0 0x55de4d691960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800a520 tx=0x7f9a0801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c39db0723d395e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.140+0000 7f9a118ab640 1 -- 172.21.15.121:0/3460048323 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a08052570 con 0x55de4d68f4d0 2023-12-07T21:09:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.140+0000 7f9a118ab640 1 -- 172.21.15.121:0/3460048323 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a080526d0 con 0x55de4d68f4d0 2023-12-07T21:09:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.140+0000 7f9a118ab640 1 -- 172.21.15.121:0/3460048323 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a08052990 con 0x55de4d68f4d0 2023-12-07T21:09:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.141+0000 7f9a14dad800 1 -- 172.21.15.121:0/3460048323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d68f4d0 msgr2=0x55de4d691960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.141+0000 7f9a14dad800 1 --2- 172.21.15.121:0/3460048323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d68f4d0 0x55de4d691960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800a520 tx=0x7f9a0801cee0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.141+0000 7f9a14dad800 1 -- 172.21.15.121:0/3460048323 shutdown_connections 2023-12-07T21:09:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.141+0000 7f9a14dad800 1 --2- 172.21.15.121:0/3460048323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d68f4d0 0x55de4d691960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.141+0000 7f9a14dad800 1 -- 172.21.15.121:0/3460048323 >> 172.21.15.121:0/3460048323 conn(0x55de4d685870 msgr2=0x55de4d687c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.141+0000 7f9a14dad800 1 -- 172.21.15.121:0/3460048323 shutdown_connections 2023-12-07T21:09:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.141+0000 7f9a14dad800 1 -- 172.21.15.121:0/3460048323 wait complete. 2023-12-07T21:09:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.142+0000 7f9a14dad800 1 Processor -- start 2023-12-07T21:09:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.142+0000 7f9a14dad800 1 -- start start 2023-12-07T21:09:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.142+0000 7f9a14dad800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d72fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.142+0000 7f9a14dad800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4d59ddb0 con 0x55de4d5ffb80 2023-12-07T21:09:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.142+0000 7f9a128ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d72fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.142+0000 7f9a128ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d72fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52788/0 (socket says 172.21.15.121:52788) 2023-12-07T21:09:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.142+0000 7f9a128ad640 1 -- 172.21.15.121:0/3482278192 learned_addr learned my addr 172.21.15.121:0/3482278192 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.142+0000 7f9a128ad640 1 -- 172.21.15.121:0/3482278192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08005de0 con 0x55de4d5ffb80 2023-12-07T21:09:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.143+0000 7f9a128ad640 1 --2- 172.21.15.121:0/3482278192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d72fe10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9a04006f80 tx=0x7f9a040019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e70ffe01f9a3946 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.143+0000 7f9a110aa640 1 -- 172.21.15.121:0/3482278192 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a04013420 con 0x55de4d5ffb80 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.143+0000 7f9a110aa640 1 -- 172.21.15.121:0/3482278192 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04013580 con 0x55de4d5ffb80 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.143+0000 7f9a110aa640 1 -- 172.21.15.121:0/3482278192 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a04013860 con 0x55de4d5ffb80 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.143+0000 7f9a14dad800 1 -- 172.21.15.121:0/3482278192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 msgr2=0x55de4d72fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.143+0000 7f9a14dad800 1 --2- 172.21.15.121:0/3482278192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d72fe10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9a04006f80 tx=0x7f9a040019a0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.143+0000 7f9a14dad800 1 -- 172.21.15.121:0/3482278192 shutdown_connections 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.143+0000 7f9a14dad800 1 --2- 172.21.15.121:0/3482278192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d72fe10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.143+0000 7f9a14dad800 1 -- 172.21.15.121:0/3482278192 >> 172.21.15.121:0/3482278192 conn(0x55de4d685870 msgr2=0x55de4d72ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.144+0000 7f9a14dad800 1 -- 172.21.15.121:0/3482278192 shutdown_connections 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.144+0000 7f9a14dad800 1 -- 172.21.15.121:0/3482278192 wait complete. 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.144+0000 7f9a14dad800 1 Processor -- start 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.144+0000 7f9a14dad800 1 -- start start 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.144+0000 7f9a14dad800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d68b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.144+0000 7f9a14dad800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4d5996a0 con 0x55de4d5ffb80 2023-12-07T21:09:12.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.144+0000 7f9a128ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d68b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.144+0000 7f9a128ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d68b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52802/0 (socket says 172.21.15.121:52802) 2023-12-07T21:09:12.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.144+0000 7f9a128ad640 1 -- 172.21.15.121:0/4138714745 learned_addr learned my addr 172.21.15.121:0/4138714745 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.145+0000 7f9a128ad640 1 -- 172.21.15.121:0/4138714745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de4d5d7790 con 0x55de4d5ffb80 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.145+0000 7f9a128ad640 1 --2- 172.21.15.121:0/4138714745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d68b640 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a04000f80 tx=0x7f9a04001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.145+0000 7f99fbfff640 1 -- 172.21.15.121:0/4138714745 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a04013420 con 0x55de4d5ffb80 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.145+0000 7f99fbfff640 1 -- 172.21.15.121:0/4138714745 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04006800 con 0x55de4d5ffb80 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.145+0000 7f9a14dad800 1 -- 172.21.15.121:0/4138714745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de4d68bb80 con 0x55de4d5ffb80 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.145+0000 7f99fbfff640 1 -- 172.21.15.121:0/4138714745 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a04004b70 con 0x55de4d5ffb80 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.145+0000 7f9a14dad800 1 -- 172.21.15.121:0/4138714745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de4d68a0c0 con 0x55de4d5ffb80 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f9a14dad800 1 Processor -- start 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f9a14dad800 1 -- start start 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f9a14dad800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 0x55de4d745ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f9a14dad800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4d533890 con 0x55de4d745690 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f99fbfff640 1 -- 172.21.15.121:0/4138714745 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f9a0401e420 con 0x55de4d5ffb80 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f9a130ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 0x55de4d745ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f9a130ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 0x55de4d745ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52818/0 (socket says 172.21.15.121:52818) 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f9a130ae640 1 -- 172.21.15.121:0/171417582 learned_addr learned my addr 172.21.15.121:0/171417582 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f99fbfff640 1 --2- 172.21.15.121:0/4138714745 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9a000360c0 0x7f9a00038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f99fbfff640 1 -- 172.21.15.121:0/4138714745 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f9a0404bac0 con 0x55de4d5ffb80 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f9a128ad640 1 --2- 172.21.15.121:0/4138714745 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9a000360c0 0x7f9a00038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f9a130ae640 1 -- 172.21.15.121:0/171417582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de4d745ff0 con 0x55de4d745690 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f9a130ae640 1 --2- 172.21.15.121:0/171417582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 0x55de4d745ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00a400 tx=0x7f9a0c00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74de476c86ceeafc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.146+0000 7f9a128ad640 1 --2- 172.21.15.121:0/4138714745 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9a000360c0 0x7f9a00038580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a04026f50 tx=0x7f9a04026e60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f99f9ffb640 1 -- 172.21.15.121:0/171417582 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c0087e0 con 0x55de4d745690 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f99f9ffb640 1 -- 172.21.15.121:0/171417582 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c008960 con 0x55de4d745690 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f99f9ffb640 1 -- 172.21.15.121:0/171417582 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c008c80 con 0x55de4d745690 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f9a14dad800 1 -- 172.21.15.121:0/171417582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 msgr2=0x55de4d745ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f9a14dad800 1 --2- 172.21.15.121:0/171417582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 0x55de4d745ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00a400 tx=0x7f9a0c00a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f9a14dad800 1 -- 172.21.15.121:0/171417582 shutdown_connections 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f9a14dad800 1 --2- 172.21.15.121:0/171417582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 0x55de4d745ab0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f9a14dad800 1 -- 172.21.15.121:0/171417582 >> 172.21.15.121:0/171417582 conn(0x55de4d68f4d0 msgr2=0x55de4d740a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f9a14dad800 1 -- 172.21.15.121:0/171417582 shutdown_connections 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f9a14dad800 1 -- 172.21.15.121:0/171417582 wait complete. 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f9a14dad800 1 Processor -- start 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.147+0000 7f9a14dad800 1 -- start start 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.148+0000 7f9a14dad800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 0x55de4d74c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.148+0000 7f9a14dad800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4d533530 con 0x55de4d745690 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.148+0000 7f9a130ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 0x55de4d74c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.148+0000 7f9a130ae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 0x55de4d74c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52820/0 (socket says 172.21.15.121:52820) 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.148+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 learned_addr learned my addr 172.21.15.121:0/1023395433 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.148+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c005c90 con 0x55de4d745690 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.149+0000 7f9a130ae640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 0x55de4d74c5e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00c010 tx=0x7f9a0c002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.149+0000 7f99f3fff640 1 -- 172.21.15.121:0/1023395433 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c013840 con 0x55de4d745690 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.149+0000 7f99f3fff640 1 -- 172.21.15.121:0/1023395433 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c0139a0 con 0x55de4d745690 2023-12-07T21:09:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.149+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de4d74cb20 con 0x55de4d745690 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.149+0000 7f99f3fff640 1 -- 172.21.15.121:0/1023395433 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9a0c013c80 con 0x55de4d745690 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.149+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de4d74cfe0 con 0x55de4d745690 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.150+0000 7f99f3fff640 1 -- 172.21.15.121:0/1023395433 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f9a0c01e420 con 0x55de4d745690 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.150+0000 7f9a14dad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.150+0000 7f99f3fff640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f99ec0360c0 0x7f99ec038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.150+0000 7f99f3fff640 1 -- 172.21.15.121:0/1023395433 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f9a0c04b890 con 0x55de4d745690 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.150+0000 7f9a120ac640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f99ec0360c0 0x7f99ec038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.150+0000 7f9a14dad800 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55de4d757d70 0x55de4d75a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.150+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75a980 con 0x55de4d757d70 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.150+0000 7f9a130ae640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55de4d757d70 0x55de4d75a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a120ac640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f99ec0360c0 0x7f99ec038580 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9a08054000 tx=0x7f9a0804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a130ae640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55de4d757d70 0x55de4d75a230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a0c024070 con 0x55de4d757d70 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a14dad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a14dad800 20 realm 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a14dad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75ad50 con 0x55de4d757d70 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a0c024070 con 0x55de4d757d70 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a14dad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a14dad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a14dad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75b5a0 con 0x55de4d757d70 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a0c024070 con 0x55de4d757d70 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a14dad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a14dad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.151+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75b900 con 0x55de4d757d70 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.152+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9a0c024070 con 0x55de4d757d70 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.152+0000 7f9a14dad800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:12.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.152+0000 7f9a14dad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.152+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75b240 con 0x55de4d757d70 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.152+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9a0c024070 con 0x55de4d757d70 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.152+0000 7f9a14dad800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.152+0000 7f9a14dad800 20 searching for the correct realm 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.152+0000 7f9a14dad800 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55de4d75db50 0x55de4d75ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.152+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d75db50 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.152+0000 7f9a128ad640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55de4d75db50 0x55de4d75ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.152+0000 7f9a128ad640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55de4d75db50 0x55de4d75ff40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.153+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04004d90 con 0x55de4d75db50 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.153+0000 7f9a128ad640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f9a04027030 0x7f9a0403c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.153+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a04027030 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.153+0000 7f9a120ac640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f9a04027030 0x7f9a0403c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.153+0000 7f9a120ac640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f9a04027030 0x7f9a0403c400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.153+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.153+0000 7f9a120ac640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f9a080663c0 0x7f9a08066820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.154+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a080663c0 2023-12-07T21:09:12.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.154+0000 7f9a130ae640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f9a080663c0 0x7f9a08066820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.154+0000 7f9a130ae640 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f9a080663c0 0x7f9a08066820 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.155+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c024070 con 0x7f9a080663c0 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.155+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d757d70 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.155+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c024070 con 0x55de4d757d70 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.155+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d757d70 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.155+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c024070 con 0x55de4d757d70 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.155+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a080663c0 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.155+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c024070 con 0x7f9a080663c0 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.155+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a080663c0 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.156+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c024070 con 0x7f9a080663c0 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.156+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a04027030 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.156+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.156+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d75db50 2023-12-07T21:09:12.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.156+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.156+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d757d70 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.156+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c024070 con 0x55de4d757d70 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.156+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a080663c0 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.157+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.157+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d757d70 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.157+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.157+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a04027030 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.157+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.157+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d75db50 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.158+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.158+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d75db50 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.158+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.158+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a080663c0 2023-12-07T21:09:12.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.158+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.158+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d75db50 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.158+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.158+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d75db50 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.159+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.159+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d757d70 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.159+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.159+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d757d70 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.159+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.159+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a080663c0 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.159+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.159+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d75db50 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.160+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.160+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a04027030 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.160+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.160+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d757d70 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.160+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.160+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a080663c0 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.161+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.161+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d75db50 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.161+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.161+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a080663c0 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.161+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.161+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x7f9a04027030 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.161+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.161+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7604d0 con 0x55de4d75db50 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.162+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.162+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9a04054040 con 0x7f9a080663c0 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.162+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.162+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9a04054040 con 0x55de4d757d70 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.162+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.162+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9a04054040 con 0x7f9a04027030 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c730 con 0x55de4d757d70 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d757d70 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:12.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75d040 con 0x55de4d75db50 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.163+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 20 zone default found 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 4 Realm: () 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 20 zonegroup default 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d760db0 con 0x7f9a080663c0 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.166 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d762820 con 0x55de4d75db50 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d762c70 con 0x55de4d75db50 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.164+0000 7f9a14dad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.165+0000 7f9a14dad800 20 started sync module instance, tier type = 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.165+0000 7f9a14dad800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.165+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d761d60 con 0x7f9a04027030 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.166+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.166+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94413268266832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7619a0 con 0x7f9a04027030 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.166+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d763570 con 0x55de4d757d70 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.167+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94413268266832] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.167+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.167+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94413270688016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d763920 con 0x55de4d757d70 2023-12-07T21:09:12.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.167+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d764120 con 0x55de4d75db50 2023-12-07T21:09:12.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.169+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94413270688016] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.169+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.169+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94413270691984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d764480 con 0x55de4d75db50 2023-12-07T21:09:12.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.170+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d764df0 con 0x7f9a04027030 2023-12-07T21:09:12.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.172+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94413270691984] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.172+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.172+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94413270694528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7655f0 con 0x7f9a04027030 2023-12-07T21:09:12.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.172+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d765df0 con 0x55de4d757d70 2023-12-07T21:09:12.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.173+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94413270694528] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.174+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.174+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94413270702416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d765d60 con 0x55de4d757d70 2023-12-07T21:09:12.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.174+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d766ae0 con 0x7f9a080663c0 2023-12-07T21:09:12.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.175+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94413270702416] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.176+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.176+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94413270704464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d766a00 con 0x7f9a080663c0 2023-12-07T21:09:12.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.176+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d767330 con 0x7f9a080663c0 2023-12-07T21:09:12.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.177+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.177+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94413270707776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7677d0 con 0x7f9a080663c0 2023-12-07T21:09:12.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.177+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d768220 con 0x7f9a080663c0 2023-12-07T21:09:12.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.178+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94413270704464] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.178+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.178+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94413270705504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d768220 con 0x7f9a080663c0 2023-12-07T21:09:12.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.178+0000 7f9a14dad800 20 add_watcher() i=0 2023-12-07T21:09:12.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.178+0000 7f9a14dad800 20 add_watcher() i=1 2023-12-07T21:09:12.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.178+0000 7f9a14dad800 20 add_watcher() i=2 2023-12-07T21:09:12.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.178+0000 7f9a14dad800 20 add_watcher() i=3 2023-12-07T21:09:12.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.178+0000 7f9a14dad800 20 add_watcher() i=4 2023-12-07T21:09:12.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.178+0000 7f9a14dad800 20 add_watcher() i=5 2023-12-07T21:09:12.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.178+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94413270707776] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.178+0000 7f9a14dad800 20 add_watcher() i=6 2023-12-07T21:09:12.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.179+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94413270705504] v31'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.179+0000 7f9a14dad800 20 add_watcher() i=7 2023-12-07T21:09:12.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.179+0000 7f9a14dad800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:12.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.179+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d767290 con 0x55de4d757d70 2023-12-07T21:09:12.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.180+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.173 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.180+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94413270711680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d767290 con 0x55de4d757d70 2023-12-07T21:09:12.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.181+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94413270711680] v31'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.181+0000 7f99d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:12.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.181+0000 7f9a14dad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:12.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.181+0000 7f9a14dad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:12.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.181+0000 7f9a14dad800 5 note: GC not initialized 2023-12-07T21:09:12.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.181+0000 7f99537fe640 20 reqs_thread_entry: start 2023-12-07T21:09:12.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.181+0000 7f9a14dad800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:12.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.181+0000 7f9a14dad800 20 Filter name: none 2023-12-07T21:09:12.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.181+0000 7f99517fa640 20 reqs_thread_entry: start 2023-12-07T21:09:12.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.182+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d79d890 con 0x55de4d75db50 2023-12-07T21:09:12.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.182+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.182+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d79d890 con 0x55de4d75db50 2023-12-07T21:09:12.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.182+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.182+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d79d890 con 0x55de4d757d70 2023-12-07T21:09:12.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.182+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.182+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d757d70 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.183+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.183+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a04027030 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.183+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.183+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d75db50 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.183+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.183+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d757d70 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.183+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.183+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d75db50 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.184+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.184+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a04027030 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.184+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.184+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d75db50 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.184+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.184+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d757d70 2023-12-07T21:09:12.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.184+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x55de4d757d70 2023-12-07T21:09:12.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.185+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a080663c0 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.185+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c03b040 con 0x7f9a080663c0 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.185+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a080663c0 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.185+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c053040 con 0x7f9a080663c0 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.185+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d75db50 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.186+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.186+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a080663c0 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.186+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c053040 con 0x7f9a080663c0 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.186+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a080663c0 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.186+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c053040 con 0x7f9a080663c0 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.186+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a080663c0 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.186+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c053040 con 0x7f9a080663c0 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.186+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d75db50 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.187+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.187+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a04027030 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.187+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(80 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.187+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d757d70 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.187+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c053040 con 0x55de4d757d70 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.187+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d757d70 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.187+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c053040 con 0x55de4d757d70 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.187+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d75db50 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.188+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.188+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a04027030 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.188+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.188+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a080663c0 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.188+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c053040 con 0x7f9a080663c0 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.188+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d757d70 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.188+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c053040 con 0x55de4d757d70 2023-12-07T21:09:12.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.188+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a080663c0 2023-12-07T21:09:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.189+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c053040 con 0x7f9a080663c0 2023-12-07T21:09:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.189+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d75db50 2023-12-07T21:09:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.189+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.189+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a04027030 2023-12-07T21:09:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.189+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.189+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a080663c0 2023-12-07T21:09:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.190+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c053040 con 0x7f9a080663c0 2023-12-07T21:09:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.190+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d757d70 2023-12-07T21:09:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.190+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a0c053040 con 0x55de4d757d70 2023-12-07T21:09:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.190+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x55de4d75db50 2023-12-07T21:09:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.190+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.190+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d75c350 con 0x7f9a04027030 2023-12-07T21:09:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.190+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.191+0000 7f99d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.191+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94413270711680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d79d850 con 0x55de4d757d70 2023-12-07T21:09:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.192+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94413270711680] v31'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9a0c053040 con 0x55de4d757d70 2023-12-07T21:09:12.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.192+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94413268266832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d768640 con 0x7f9a04027030 2023-12-07T21:09:12.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.193+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94413268266832] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.193+0000 7f9a14dad800 20 remove_watcher() i=0 2023-12-07T21:09:12.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.193+0000 7f9a14dad800 2 removed watcher, disabling cache 2023-12-07T21:09:12.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.193+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94413270688016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7689a0 con 0x55de4d757d70 2023-12-07T21:09:12.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.195+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94413270688016] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c053040 con 0x55de4d757d70 2023-12-07T21:09:12.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.195+0000 7f9a14dad800 20 remove_watcher() i=1 2023-12-07T21:09:12.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.195+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94413270691984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d7689a0 con 0x55de4d75db50 2023-12-07T21:09:12.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.196+0000 7f9a128ad640 1 -- 172.21.15.121:0/1023395433 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94413270691984] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a04046040 con 0x55de4d75db50 2023-12-07T21:09:12.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.196+0000 7f9a14dad800 20 remove_watcher() i=2 2023-12-07T21:09:12.189 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.196+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94413270694528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d768d00 con 0x7f9a04027030 2023-12-07T21:09:12.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.197+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94413270694528] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a08052b90 con 0x7f9a04027030 2023-12-07T21:09:12.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.197+0000 7f9a14dad800 20 remove_watcher() i=3 2023-12-07T21:09:12.190 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.197+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94413270702416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d768d00 con 0x55de4d757d70 2023-12-07T21:09:12.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.198+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94413270702416] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c053040 con 0x55de4d757d70 2023-12-07T21:09:12.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.198+0000 7f9a14dad800 20 remove_watcher() i=4 2023-12-07T21:09:12.191 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.198+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94413270704464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d768d00 con 0x7f9a080663c0 2023-12-07T21:09:12.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.199+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94413270704464] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c053040 con 0x7f9a080663c0 2023-12-07T21:09:12.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.199+0000 7f9a14dad800 20 remove_watcher() i=5 2023-12-07T21:09:12.192 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.199+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94413270707776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d766150 con 0x7f9a080663c0 2023-12-07T21:09:12.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.200+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94413270707776] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c053040 con 0x7f9a080663c0 2023-12-07T21:09:12.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.200+0000 7f9a14dad800 20 remove_watcher() i=6 2023-12-07T21:09:12.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.200+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94413270705504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55de4d766150 con 0x7f9a080663c0 2023-12-07T21:09:12.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.201+0000 7f9a130ae640 1 -- 172.21.15.121:0/1023395433 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94413270705504] v31'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9a0c053040 con 0x7f9a080663c0 2023-12-07T21:09:12.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.201+0000 7f9a14dad800 20 remove_watcher() i=7 2023-12-07T21:09:12.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f9a080663c0 msgr2=0x7f9a08066820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f9a080663c0 0x7f9a08066820 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55de4d757d70 msgr2=0x55de4d75a230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55de4d757d70 0x55de4d75a230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f9a04027030 msgr2=0x7f9a0403c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f9a04027030 0x7f9a0403c400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55de4d75db50 msgr2=0x55de4d75ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55de4d75db50 0x55de4d75ff40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f99ec0360c0 msgr2=0x7f99ec038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f99ec0360c0 0x7f99ec038580 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9a08054000 tx=0x7f9a0804e000 comp rx=0 tx=0).stop 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 msgr2=0x55de4d74c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 --2- 172.21.15.121:0/1023395433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d745690 0x55de4d74c5e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00c010 tx=0x7f9a0c002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 reap_dead start 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a120ac640 1 -- 172.21.15.121:0/1023395433 reap_dead start 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 shutdown_connections 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 >> 172.21.15.121:0/1023395433 conn(0x55de4d68f4d0 msgr2=0x55de4d740640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 shutdown_connections 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/1023395433 wait complete. 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/4138714745 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9a000360c0 msgr2=0x7f9a00038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 --2- 172.21.15.121:0/4138714745 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9a000360c0 0x7f9a00038580 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a04026f50 tx=0x7f9a04026e60 comp rx=0 tx=0).stop 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/4138714745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 msgr2=0x55de4d68b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 --2- 172.21.15.121:0/4138714745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d68b640 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a04000f80 tx=0x7f9a04001250 comp rx=0 tx=0).stop 2023-12-07T21:09:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/4138714745 shutdown_connections 2023-12-07T21:09:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 --2- 172.21.15.121:0/4138714745 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9a000360c0 0x7f9a00038580 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 --2- 172.21.15.121:0/4138714745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55de4d5ffb80 0x55de4d68b640 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/4138714745 >> 172.21.15.121:0/4138714745 conn(0x55de4d685870 msgr2=0x55de4d72eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/4138714745 shutdown_connections 2023-12-07T21:09:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.202+0000 7f9a14dad800 1 -- 172.21.15.121:0/4138714745 wait complete. 2023-12-07T21:09:12.208 INFO:teuthology.orchestra.run.smithi121.stdout:[] 2023-12-07T21:09:12.208 DEBUG:tasks.util.rgw: json result: [] 2023-12-07T21:09:12.208 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2023-12-07T21:09:12.208 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2023-12-07T21:09:12.208 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2023-12-07T21:09:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.259+0000 7f08f2613800 1 Processor -- start 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.259+0000 7f08f2613800 1 -- start start 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.259+0000 7f08f2613800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5646956507d0 0x564695652bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.259+0000 7f08f2613800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5646955987a0 con 0x56469564d840 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.259+0000 7f08f2613800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x564695561880 con 0x5646956507d0 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.259+0000 7f08f0113640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x56469564d840 0x56469564dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37620/0 (socket says 172.21.15.121:37620) 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.259+0000 7f08f0113640 1 -- 172.21.15.121:0/2665238462 learned_addr learned my addr 172.21.15.121:0/2665238462 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.259+0000 7f08ef912640 1 --2- 172.21.15.121:0/2665238462 >> v2:172.21.15.89:3300/0 conn(0x5646956507d0 0x564695652bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.259+0000 7f08ef111640 1 -- 172.21.15.121:0/2665238462 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209219305 0 0) 0x5646955987a0 con 0x56469564d840 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.260+0000 7f08ef111640 1 -- 172.21.15.121:0/2665238462 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08d8001e10 con 0x56469564d840 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.260+0000 7f08ef912640 1 -- 172.21.15.121:0/2665238462 >> v1:172.21.15.89:6789/0 conn(0x56469564d840 legacy=0x56469564dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.260+0000 7f08ef912640 1 -- 172.21.15.121:0/2665238462 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564695654110 con 0x5646956507d0 2023-12-07T21:09:12.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.261+0000 7f08ef912640 1 --2- 172.21.15.121:0/2665238462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5646956507d0 0x564695652bc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f08e400a470 tx=0x7f08e401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6d8bef7a49c86f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.262+0000 7f08ef111640 1 -- 172.21.15.121:0/2665238462 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08e404ad60 con 0x5646956507d0 2023-12-07T21:09:12.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.262+0000 7f08ef111640 1 -- 172.21.15.121:0/2665238462 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e4052440 con 0x5646956507d0 2023-12-07T21:09:12.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.262+0000 7f08ef111640 1 -- 172.21.15.121:0/2665238462 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08e40526e0 con 0x5646956507d0 2023-12-07T21:09:12.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.262+0000 7f08f2613800 1 -- 172.21.15.121:0/2665238462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5646956507d0 msgr2=0x564695652bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.262+0000 7f08f2613800 1 --2- 172.21.15.121:0/2665238462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5646956507d0 0x564695652bc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f08e400a470 tx=0x7f08e401cc80 comp rx=0 tx=0).stop 2023-12-07T21:09:12.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.262+0000 7f08f2613800 1 -- 172.21.15.121:0/2665238462 shutdown_connections 2023-12-07T21:09:12.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.262+0000 7f08f2613800 1 --2- 172.21.15.121:0/2665238462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5646956507d0 0x564695652bc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.262+0000 7f08f2613800 1 -- 172.21.15.121:0/2665238462 >> 172.21.15.121:0/2665238462 conn(0x564695645f60 msgr2=0x564695648380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.262+0000 7f08f2613800 1 -- 172.21.15.121:0/2665238462 shutdown_connections 2023-12-07T21:09:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.262+0000 7f08f2613800 1 -- 172.21.15.121:0/2665238462 wait complete. 2023-12-07T21:09:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.263+0000 7f08f2613800 1 Processor -- start 2023-12-07T21:09:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.263+0000 7f08f2613800 1 -- start start 2023-12-07T21:09:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.263+0000 7f08f2613800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.263+0000 7f08f2613800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469555edb0 con 0x56469564d840 2023-12-07T21:09:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.263+0000 7f08f0113640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.263+0000 7f08f0113640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52838/0 (socket says 172.21.15.121:52838) 2023-12-07T21:09:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.263+0000 7f08f0113640 1 -- 172.21.15.121:0/3257448310 learned_addr learned my addr 172.21.15.121:0/3257448310 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08f0113640 1 -- 172.21.15.121:0/3257448310 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e4005d20 con 0x56469564d840 2023-12-07T21:09:12.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08f0113640 1 --2- 172.21.15.121:0/3257448310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f0c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f08e0001c20 tx=0x7f08e000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f1103daaffd6fc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08ee910640 1 -- 172.21.15.121:0/3257448310 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08e000e470 con 0x56469564d840 2023-12-07T21:09:12.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08ee910640 1 -- 172.21.15.121:0/3257448310 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e000e5d0 con 0x56469564d840 2023-12-07T21:09:12.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08ee910640 1 -- 172.21.15.121:0/3257448310 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08e000e930 con 0x56469564d840 2023-12-07T21:09:12.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08f2613800 1 -- 172.21.15.121:0/3257448310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 msgr2=0x5646956f0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08f2613800 1 --2- 172.21.15.121:0/3257448310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f0c80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f08e0001c20 tx=0x7f08e000b6c0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08f2613800 1 -- 172.21.15.121:0/3257448310 shutdown_connections 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08f2613800 1 --2- 172.21.15.121:0/3257448310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f0c80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08f2613800 1 -- 172.21.15.121:0/3257448310 >> 172.21.15.121:0/3257448310 conn(0x564695645f60 msgr2=0x5646956ec8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08f2613800 1 -- 172.21.15.121:0/3257448310 shutdown_connections 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.264+0000 7f08f2613800 1 -- 172.21.15.121:0/3257448310 wait complete. 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.265+0000 7f08f2613800 1 Processor -- start 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.265+0000 7f08f2613800 1 -- start start 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.265+0000 7f08f2613800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.265+0000 7f08f2613800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469555a6a0 con 0x56469564d840 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.265+0000 7f08f0113640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.265+0000 7f08f0113640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52840/0 (socket says 172.21.15.121:52840) 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.265+0000 7f08f0113640 1 -- 172.21.15.121:0/2448412349 learned_addr learned my addr 172.21.15.121:0/2448412349 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.265+0000 7f08f0113640 1 -- 172.21.15.121:0/2448412349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8001e10 con 0x56469564d840 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.265+0000 7f08f0113640 1 --2- 172.21.15.121:0/2448412349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f81e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08e0001080 tx=0x7f08e0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.266+0000 7f08ed90e640 1 -- 172.21.15.121:0/2448412349 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08e001f070 con 0x56469564d840 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.266+0000 7f08ed90e640 1 -- 172.21.15.121:0/2448412349 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e0018770 con 0x56469564d840 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.266+0000 7f08f2613800 1 -- 172.21.15.121:0/2448412349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5646956f8720 con 0x56469564d840 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.266+0000 7f08ed90e640 1 -- 172.21.15.121:0/2448412349 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08e0018a10 con 0x56469564d840 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.266+0000 7f08f2613800 1 -- 172.21.15.121:0/2448412349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646956f8c00 con 0x56469564d840 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.266+0000 7f08f2613800 1 Processor -- start 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.266+0000 7f08f2613800 1 -- start start 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.266+0000 7f08f2613800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 0x564695704790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.266+0000 7f08f2613800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646954f4890 con 0x564695704370 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.266+0000 7f08ed90e640 1 -- 172.21.15.121:0/2448412349 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f08e0018c80 con 0x56469564d840 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08f0914640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 0x564695704790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08f0914640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 0x564695704790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52852/0 (socket says 172.21.15.121:52852) 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08f0914640 1 -- 172.21.15.121:0/1262385852 learned_addr learned my addr 172.21.15.121:0/1262385852 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08ed90e640 1 --2- 172.21.15.121:0/2448412349 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08dc0360c0 0x7f08dc038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08ed90e640 1 -- 172.21.15.121:0/2448412349 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f08e004bab0 con 0x56469564d840 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08f0113640 1 --2- 172.21.15.121:0/2448412349 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08dc0360c0 0x7f08dc038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08f0914640 1 -- 172.21.15.121:0/1262385852 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564695704cd0 con 0x564695704370 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08f0914640 1 --2- 172.21.15.121:0/1262385852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 0x564695704790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f08e800a430 tx=0x7f08e800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd4fcddb0fa2842 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08f0113640 1 --2- 172.21.15.121:0/2448412349 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08dc0360c0 0x7f08dc038580 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08e00015e0 tx=0x7f08e0001510 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08d77fe640 1 -- 172.21.15.121:0/1262385852 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08e8001650 con 0x564695704370 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08d77fe640 1 -- 172.21.15.121:0/1262385852 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e80017d0 con 0x564695704370 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.267+0000 7f08d77fe640 1 -- 172.21.15.121:0/1262385852 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08e8001ab0 con 0x564695704370 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f2613800 1 -- 172.21.15.121:0/1262385852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 msgr2=0x564695704790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f2613800 1 --2- 172.21.15.121:0/1262385852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 0x564695704790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f08e800a430 tx=0x7f08e800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f2613800 1 -- 172.21.15.121:0/1262385852 shutdown_connections 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f2613800 1 --2- 172.21.15.121:0/1262385852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 0x564695704790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f2613800 1 -- 172.21.15.121:0/1262385852 >> 172.21.15.121:0/1262385852 conn(0x5646956507d0 msgr2=0x5646956ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f2613800 1 -- 172.21.15.121:0/1262385852 shutdown_connections 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f2613800 1 -- 172.21.15.121:0/1262385852 wait complete. 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f2613800 1 Processor -- start 2023-12-07T21:09:12.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f2613800 1 -- start start 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f2613800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 0x56469570b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f2613800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646954f4530 con 0x564695704370 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f0914640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 0x56469570b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f0914640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 0x56469570b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52854/0 (socket says 172.21.15.121:52854) 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.268+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 learned_addr learned my addr 172.21.15.121:0/1831187324 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.269+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e800a0e0 con 0x564695704370 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.269+0000 7f08f0914640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 0x56469570b2a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f08e800ae40 tx=0x7f08e8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.269+0000 7f08d5ffb640 1 -- 172.21.15.121:0/1831187324 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08e80109e0 con 0x564695704370 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.269+0000 7f08d5ffb640 1 -- 172.21.15.121:0/1831187324 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e8010b40 con 0x564695704370 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.269+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56469570b7e0 con 0x564695704370 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.269+0000 7f08d5ffb640 1 -- 172.21.15.121:0/1831187324 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08e8010e20 con 0x564695704370 2023-12-07T21:09:12.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.269+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56469570bc40 con 0x564695704370 2023-12-07T21:09:12.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.270+0000 7f08d5ffb640 1 -- 172.21.15.121:0/1831187324 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f08e8017070 con 0x564695704370 2023-12-07T21:09:12.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.270+0000 7f08d5ffb640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08c80360c0 0x7f08c8038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.270+0000 7f08d5ffb640 1 -- 172.21.15.121:0/1831187324 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f08e804ba30 con 0x564695704370 2023-12-07T21:09:12.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.270+0000 7f08ef912640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08c80360c0 0x7f08c8038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.270+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.270+0000 7f08f2613800 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5646957169e0 0x564695718ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.270+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957195f0 con 0x5646957169e0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f0914640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5646957169e0 0x564695718ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08ef912640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08c80360c0 0x7f08c8038580 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08e4054000 tx=0x7f08e404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f0914640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5646957169e0 0x564695718ea0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08e800fc50 con 0x5646957169e0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f2613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f2613800 20 realm 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957199e0 con 0x5646957169e0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08e800fc50 con 0x5646957169e0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f2613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f2613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571a260 con 0x5646957169e0 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08e800fc50 con 0x5646957169e0 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f2613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.271+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571a5c0 con 0x5646957169e0 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f08e800fc50 con 0x5646957169e0 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f2613800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571adc0 con 0x5646957169e0 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f08e800fc50 con 0x5646957169e0 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f2613800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f2613800 20 searching for the correct realm 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f2613800 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56469571cae0 0x56469571ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x56469571cae0 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f0113640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56469571cae0 0x56469571ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.272+0000 7f08f0113640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56469571cae0 0x56469571ef50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.273+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.273+0000 7f08f0113640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f08e0017050 0x7f08e0016800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.273+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e0017050 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.273+0000 7f08ef912640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f08e0017050 0x7f08e0016800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.273+0000 7f08ef912640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f08e0017050 0x7f08e0016800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.273+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.273+0000 7f08ef912640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f08e405c920 0x7f08e4009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.273+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e405c920 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.274+0000 7f08f0914640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f08e405c920 0x7f08e4009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.274+0000 7f08f0914640 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f08e405c920 0x7f08e4009410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.274+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e800fc50 con 0x7f08e405c920 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.274+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x5646957169e0 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.275+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e800fc50 con 0x5646957169e0 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.275+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x5646957169e0 2023-12-07T21:09:12.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.275+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e800fc50 con 0x5646957169e0 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.275+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e405c920 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.275+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.275+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e405c920 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.275+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.275+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e0017050 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.276+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.276+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x56469571cae0 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.276+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.276+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x5646957169e0 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.276+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.276+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e405c920 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.276+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.276+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x5646957169e0 2023-12-07T21:09:12.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.277+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.277+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e0017050 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.277+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.277+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x56469571cae0 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.277+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.277+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x56469571cae0 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.277+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.277+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e405c920 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.278+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.278+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x56469571cae0 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.278+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.278+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x56469571cae0 2023-12-07T21:09:12.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.278+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.278+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x5646957169e0 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.278+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.278+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x5646957169e0 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.279+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.279+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e405c920 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.279+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.279+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x56469571cae0 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.279+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.279+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e0017050 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.279+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.279+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x5646957169e0 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.280+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.280+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e405c920 2023-12-07T21:09:12.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.280+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.280+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x56469571cae0 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.280+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.280+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e405c920 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.280+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.280+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e0017050 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.281+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.281+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x56469571cae0 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.281+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.281+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e405c920 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.281+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.281+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x5646957169e0 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571f620 con 0x7f08e0017050 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:12.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571b6c0 con 0x5646957169e0 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571b340 con 0x5646957169e0 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.282+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571c090 con 0x56469571cae0 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 20 zone default found 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 4 Realm: () 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 20 zonegroup default 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469571ff00 con 0x7f08e405c920 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957219d0 con 0x56469571cae0 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.283+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695721e20 con 0x56469571cae0 2023-12-07T21:09:12.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.284+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.284+0000 7f08f2613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.284+0000 7f08f2613800 20 started sync module instance, tier type = 2023-12-07T21:09:12.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.284+0000 7f08f2613800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:12.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.284+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695720d20 con 0x7f08e0017050 2023-12-07T21:09:12.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.285+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.285+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94861152567120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957210d0 con 0x7f08e0017050 2023-12-07T21:09:12.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.285+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957226e0 con 0x5646957169e0 2023-12-07T21:09:12.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.286+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94861152567120] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.286+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.286+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94861154977920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957226e0 con 0x5646957169e0 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.286+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695723180 con 0x56469571cae0 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.287+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.287+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94861154987104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957239d0 con 0x56469571cae0 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.287+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957243f0 con 0x7f08e0017050 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.288+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94861154977920] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.288+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94861154987104] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.288+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.288+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94861154991824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695723640 con 0x7f08e0017050 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.288+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695724ea0 con 0x5646957169e0 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.290+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94861154991824] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.290+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.290+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94861154994528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695725250 con 0x5646957169e0 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.290+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695725bc0 con 0x7f08e405c920 2023-12-07T21:09:12.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.291+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94861154994528] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.291+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.292+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94861154984512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695725bc0 con 0x7f08e405c920 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.292+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695726470 con 0x7f08e405c920 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.293+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.293+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94861154984512] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.293+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94861155000176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957268d0 con 0x7f08e405c920 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.293+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695725740 con 0x7f08e405c920 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.295+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.295+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94861155003856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695725740 con 0x7f08e405c920 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.295+0000 7f08f2613800 20 add_watcher() i=0 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.295+0000 7f08f2613800 20 add_watcher() i=1 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.295+0000 7f08f2613800 20 add_watcher() i=2 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.295+0000 7f08f2613800 20 add_watcher() i=3 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.295+0000 7f08f2613800 20 add_watcher() i=4 2023-12-07T21:09:12.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.295+0000 7f08f2613800 20 add_watcher() i=5 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.295+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94861155000176] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.296+0000 7f08f2613800 20 add_watcher() i=6 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.296+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94861155003856] v31'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.296+0000 7f08f2613800 20 add_watcher() i=7 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.296+0000 7f08f2613800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.296+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469572a210 con 0x5646957169e0 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.297+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.297+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94861155001392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695727680 con 0x5646957169e0 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.298+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94861155001392] v31'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.298+0000 7f08b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.298+0000 7f08f2613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.298+0000 7f08f2613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:12.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.298+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957326e0 con 0x5646957169e0 2023-12-07T21:09:12.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.299+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.299+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695732b20 con 0x7f08e405c920 2023-12-07T21:09:12.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.300+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'10 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.300+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695732f60 con 0x56469571cae0 2023-12-07T21:09:12.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.301+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.301+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695733930 con 0x5646957169e0 2023-12-07T21:09:12.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.302+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.302+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695730830 con 0x7f08e0017050 2023-12-07T21:09:12.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.303+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.303+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957344a0 con 0x56469571cae0 2023-12-07T21:09:12.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.306+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'13 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.306+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695734e70 con 0x5646957169e0 2023-12-07T21:09:12.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.309+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.309+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695734e70 con 0x7f08e405c920 2023-12-07T21:09:12.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.310+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'13 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.311+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695734e70 con 0x7f08e0017050 2023-12-07T21:09:12.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.312+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.312+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695735840 con 0x56469571cae0 2023-12-07T21:09:12.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.313+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.313+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56469572f730 con 0x7f08e0017050 2023-12-07T21:09:12.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.314+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.314+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957363b0 con 0x7f08e405c920 2023-12-07T21:09:12.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.315+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.315+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957363b0 con 0x7f08e0017050 2023-12-07T21:09:12.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.317+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.317+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695736440 con 0x7f08e405c920 2023-12-07T21:09:12.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.320+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'19 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.320+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695736440 con 0x5646957169e0 2023-12-07T21:09:12.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.322+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.322+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695736440 con 0x56469571cae0 2023-12-07T21:09:12.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.325+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.325+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957364d0 con 0x7f08e0017050 2023-12-07T21:09:12.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.327+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'22 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.327+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695736560 con 0x56469571cae0 2023-12-07T21:09:12.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.330+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.330+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695736560 con 0x5646957169e0 2023-12-07T21:09:12.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.333+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.333+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695736560 con 0x5646957169e0 2023-12-07T21:09:12.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.334+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'29 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.334+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695736560 con 0x56469571cae0 2023-12-07T21:09:12.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.335+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'15 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.335+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695736560 con 0x7f08e0017050 2023-12-07T21:09:12.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.336+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.337+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957365f0 con 0x56469571cae0 2023-12-07T21:09:12.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.338+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.338+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957365f0 con 0x56469571cae0 2023-12-07T21:09:12.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.341+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.341+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957365f0 con 0x56469571cae0 2023-12-07T21:09:12.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.343+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.344+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957365f0 con 0x56469571cae0 2023-12-07T21:09:12.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.346+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'14 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.346+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957365f0 con 0x7f08e405c920 2023-12-07T21:09:12.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.349+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.349+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957365f0 con 0x56469571cae0 2023-12-07T21:09:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.351+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.351+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957365f0 con 0x7f08e405c920 2023-12-07T21:09:12.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.353+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'14 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.353+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957365f0 con 0x56469571cae0 2023-12-07T21:09:12.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.354+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'16 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.354+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957365f0 con 0x7f08e405c920 2023-12-07T21:09:12.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.356+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'20 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.357+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957365f0 con 0x7f08e0017050 2023-12-07T21:09:12.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f08b57e2640 20 reqs_thread_entry: start 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f08f2613800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f08f2613800 20 Filter name: none 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f0826ffd640 20 reqs_thread_entry: start 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f08f2613800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f08f2613800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957615f0 con 0x7f08e0017050 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f08f2613800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f08f2613800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.358+0000 7f08f2613800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-12-07T21:09:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:could not remove user: unable to remove user, user does not exist 2023-12-07T21:09:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.359+0000 7f08b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.359+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94861155001392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957353a0 con 0x5646957169e0 2023-12-07T21:09:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.360+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94861155001392] v31'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.360+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94861152567120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957353a0 con 0x7f08e0017050 2023-12-07T21:09:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.361+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94861152567120] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.361+0000 7f08f2613800 20 remove_watcher() i=0 2023-12-07T21:09:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.361+0000 7f08f2613800 2 removed watcher, disabling cache 2023-12-07T21:09:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.361+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94861154977920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957353a0 con 0x5646957169e0 2023-12-07T21:09:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.362+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94861154977920] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.362+0000 7f08f2613800 20 remove_watcher() i=1 2023-12-07T21:09:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.362+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94861154987104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957353a0 con 0x56469571cae0 2023-12-07T21:09:12.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.364+0000 7f08f0113640 1 -- 172.21.15.121:0/1831187324 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94861154987104] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e0014070 con 0x56469571cae0 2023-12-07T21:09:12.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.364+0000 7f08f2613800 20 remove_watcher() i=2 2023-12-07T21:09:12.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.364+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94861154991824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5646957353a0 con 0x7f08e0017050 2023-12-07T21:09:12.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.365+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94861154991824] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e4052630 con 0x7f08e0017050 2023-12-07T21:09:12.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.365+0000 7f08f2613800 20 remove_watcher() i=3 2023-12-07T21:09:12.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.365+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94861154994528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695735840 con 0x5646957169e0 2023-12-07T21:09:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.367+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94861154994528] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x5646957169e0 2023-12-07T21:09:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.367+0000 7f08f2613800 20 remove_watcher() i=4 2023-12-07T21:09:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.367+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94861154984512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695724960 con 0x7f08e405c920 2023-12-07T21:09:12.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.368+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94861154984512] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.368+0000 7f08f2613800 20 remove_watcher() i=5 2023-12-07T21:09:12.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.368+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94861155000176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695722240 con 0x7f08e405c920 2023-12-07T21:09:12.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.369+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94861155000176] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.369+0000 7f08f2613800 20 remove_watcher() i=6 2023-12-07T21:09:12.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.369+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94861155003856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564695724960 con 0x7f08e405c920 2023-12-07T21:09:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f0914640 1 -- 172.21.15.121:0/1831187324 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94861155003856] v31'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f08e8038040 con 0x7f08e405c920 2023-12-07T21:09:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 20 remove_watcher() i=7 2023-12-07T21:09:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f08e405c920 msgr2=0x7f08e4009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f08e405c920 0x7f08e4009410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5646957169e0 msgr2=0x564695718ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5646957169e0 0x564695718ea0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f08e0017050 msgr2=0x7f08e0016800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f08e0017050 0x7f08e0016800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56469571cae0 msgr2=0x56469571ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56469571cae0 0x56469571ef50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08c80360c0 msgr2=0x7f08c8038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08c80360c0 0x7f08c8038580 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08e4054000 tx=0x7f08e404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 msgr2=0x56469570b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 --2- 172.21.15.121:0/1831187324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564695704370 0x56469570b2a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f08e800ae40 tx=0x7f08e8003370 comp rx=0 tx=0).stop 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 reap_dead start 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08ef912640 1 -- 172.21.15.121:0/1831187324 reap_dead start 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 shutdown_connections 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 >> 172.21.15.121:0/1831187324 conn(0x5646956507d0 msgr2=0x5646956fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 shutdown_connections 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.370+0000 7f08f2613800 1 -- 172.21.15.121:0/1831187324 wait complete. 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.371+0000 7f08f2613800 1 -- 172.21.15.121:0/2448412349 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08dc0360c0 msgr2=0x7f08dc038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.371+0000 7f08f2613800 1 --2- 172.21.15.121:0/2448412349 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08dc0360c0 0x7f08dc038580 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08e00015e0 tx=0x7f08e0001510 comp rx=0 tx=0).stop 2023-12-07T21:09:12.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.371+0000 7f08f2613800 1 -- 172.21.15.121:0/2448412349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 msgr2=0x5646956f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.371+0000 7f08f2613800 1 --2- 172.21.15.121:0/2448412349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f81e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f08e0001080 tx=0x7f08e0000bc0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.371+0000 7f08f2613800 1 -- 172.21.15.121:0/2448412349 shutdown_connections 2023-12-07T21:09:12.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.371+0000 7f08f2613800 1 --2- 172.21.15.121:0/2448412349 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08dc0360c0 0x7f08dc038580 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.371+0000 7f08f2613800 1 --2- 172.21.15.121:0/2448412349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56469564d840 0x5646956f81e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.371+0000 7f08f2613800 1 -- 172.21.15.121:0/2448412349 >> 172.21.15.121:0/2448412349 conn(0x564695645f60 msgr2=0x5646956ef990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.371+0000 7f08f2613800 1 -- 172.21.15.121:0/2448412349 shutdown_connections 2023-12-07T21:09:12.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.371+0000 7f08f2613800 1 -- 172.21.15.121:0/2448412349 wait complete. 2023-12-07T21:09:12.366 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-12-07T21:09:12.367 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2023-12-07T21:09:12.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2023-12-07T21:09:12.367 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2023-12-07T21:09:12.449 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:12.449 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:12.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.457+0000 7f8b30122800 1 Processor -- start 2023-12-07T21:09:12.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.457+0000 7f8b30122800 1 -- start start 2023-12-07T21:09:12.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.457+0000 7f8b30122800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562d7ae85540 0x562d7ae87930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.457+0000 7f8b30122800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562d7adce7a0 con 0x562d7ae81100 2023-12-07T21:09:12.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.457+0000 7f8b30122800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x562d7ad97880 con 0x562d7ae85540 2023-12-07T21:09:12.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.457+0000 7f8b23594640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562d7ae85540 0x562d7ae87930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.457+0000 7f8b23594640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562d7ae85540 0x562d7ae87930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52866/0 (socket says 172.21.15.121:52866) 2023-12-07T21:09:12.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.457+0000 7f8b23594640 1 -- 172.21.15.121:0/1955708506 learned_addr learned my addr 172.21.15.121:0/1955708506 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.457+0000 7f8b2bd95640 1 --1- 172.21.15.121:0/1955708506 >> v1:172.21.15.89:6789/0 conn(0x562d7ae81100 0x562d7ae81520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37628/0 (socket says 172.21.15.121:37628) 2023-12-07T21:09:12.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.458+0000 7f8b23594640 1 -- 172.21.15.121:0/1955708506 >> v1:172.21.15.89:6789/0 conn(0x562d7ae81100 legacy=0x562d7ae81520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.458+0000 7f8b23594640 1 -- 172.21.15.121:0/1955708506 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d7ae88f60 con 0x562d7ae85540 2023-12-07T21:09:12.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.459+0000 7f8b23594640 1 --2- 172.21.15.121:0/1955708506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae85540 0x562d7ae87930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400a520 tx=0x7f8b1401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad410ef95f7abf87 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.459+0000 7f8b2b594640 1 -- 172.21.15.121:0/1955708506 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b14052570 con 0x562d7ae85540 2023-12-07T21:09:12.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.460+0000 7f8b2b594640 1 -- 172.21.15.121:0/1955708506 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b140526d0 con 0x562d7ae85540 2023-12-07T21:09:12.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.460+0000 7f8b2b594640 1 -- 172.21.15.121:0/1955708506 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b14052990 con 0x562d7ae85540 2023-12-07T21:09:12.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.460+0000 7f8b30122800 1 -- 172.21.15.121:0/1955708506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae85540 msgr2=0x562d7ae87930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.460+0000 7f8b30122800 1 --2- 172.21.15.121:0/1955708506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae85540 0x562d7ae87930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400a520 tx=0x7f8b1401cee0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.460+0000 7f8b30122800 1 -- 172.21.15.121:0/1955708506 shutdown_connections 2023-12-07T21:09:12.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.460+0000 7f8b30122800 1 --2- 172.21.15.121:0/1955708506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae85540 0x562d7ae87930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.460+0000 7f8b30122800 1 -- 172.21.15.121:0/1955708506 >> 172.21.15.121:0/1955708506 conn(0x562d7ae7c880 msgr2=0x562d7ae7eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.460+0000 7f8b30122800 1 -- 172.21.15.121:0/1955708506 shutdown_connections 2023-12-07T21:09:12.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.460+0000 7f8b30122800 1 -- 172.21.15.121:0/1955708506 wait complete. 2023-12-07T21:09:12.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.461+0000 7f8b30122800 1 Processor -- start 2023-12-07T21:09:12.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.461+0000 7f8b30122800 1 -- start start 2023-12-07T21:09:12.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.461+0000 7f8b30122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7adf61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.461+0000 7f8b30122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d7ad94db0 con 0x562d7ae81100 2023-12-07T21:09:12.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.461+0000 7f8b2bd95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7adf61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.461+0000 7f8b2bd95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7adf61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52874/0 (socket says 172.21.15.121:52874) 2023-12-07T21:09:12.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.461+0000 7f8b2bd95640 1 -- 172.21.15.121:0/3138799130 learned_addr learned my addr 172.21.15.121:0/3138799130 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.462+0000 7f8b2bd95640 1 -- 172.21.15.121:0/3138799130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b14005de0 con 0x562d7ae81100 2023-12-07T21:09:12.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.462+0000 7f8b2bd95640 1 --2- 172.21.15.121:0/3138799130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7adf61b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c001d50 tx=0x7f8b1c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1603ae763f8f516 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.462+0000 7f8b2ad93640 1 -- 172.21.15.121:0/3138799130 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c014070 con 0x562d7ae81100 2023-12-07T21:09:12.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.462+0000 7f8b2ad93640 1 -- 172.21.15.121:0/3138799130 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c00f450 con 0x562d7ae81100 2023-12-07T21:09:12.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.462+0000 7f8b2ad93640 1 -- 172.21.15.121:0/3138799130 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c00f730 con 0x562d7ae81100 2023-12-07T21:09:12.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b30122800 1 -- 172.21.15.121:0/3138799130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 msgr2=0x562d7adf61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b30122800 1 --2- 172.21.15.121:0/3138799130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7adf61b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c001d50 tx=0x7f8b1c00b600 comp rx=0 tx=0).stop 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b30122800 1 -- 172.21.15.121:0/3138799130 shutdown_connections 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b30122800 1 --2- 172.21.15.121:0/3138799130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7adf61b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b30122800 1 -- 172.21.15.121:0/3138799130 >> 172.21.15.121:0/3138799130 conn(0x562d7ae7c880 msgr2=0x562d7af21a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b30122800 1 -- 172.21.15.121:0/3138799130 shutdown_connections 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b30122800 1 -- 172.21.15.121:0/3138799130 wait complete. 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b30122800 1 Processor -- start 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b30122800 1 -- start start 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b30122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7af2e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b30122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d7ad906a0 con 0x562d7ae81100 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b2bd95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7af2e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b2bd95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7af2e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52888/0 (socket says 172.21.15.121:52888) 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b2bd95640 1 -- 172.21.15.121:0/1899014221 learned_addr learned my addr 172.21.15.121:0/1899014221 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.463+0000 7f8b2bd95640 1 -- 172.21.15.121:0/1899014221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d7adce7a0 con 0x562d7ae81100 2023-12-07T21:09:12.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.464+0000 7f8b2bd95640 1 --2- 172.21.15.121:0/1899014221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7af2e490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x562d7af224b0 tx=0x7f8b1c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.464+0000 7f8b29d91640 1 -- 172.21.15.121:0/1899014221 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c014070 con 0x562d7ae81100 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.464+0000 7f8b29d91640 1 -- 172.21.15.121:0/1899014221 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c020070 con 0x562d7ae81100 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.464+0000 7f8b30122800 1 -- 172.21.15.121:0/1899014221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562d7af2e9d0 con 0x562d7ae81100 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.464+0000 7f8b29d91640 1 -- 172.21.15.121:0/1899014221 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c019900 con 0x562d7ae81100 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.464+0000 7f8b30122800 1 -- 172.21.15.121:0/1899014221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d7af2eeb0 con 0x562d7ae81100 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.464+0000 7f8b30122800 1 Processor -- start 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.464+0000 7f8b30122800 1 -- start start 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b30122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af3b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b30122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d7ad2a890 con 0x562d7af3adc0 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b29d91640 1 -- 172.21.15.121:0/1899014221 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f8b1c019a60 con 0x562d7ae81100 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b2c596640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af3b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b2c596640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af3b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52894/0 (socket says 172.21.15.121:52894) 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b2c596640 1 -- 172.21.15.121:0/3866424894 learned_addr learned my addr 172.21.15.121:0/3866424894 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b29d91640 1 --2- 172.21.15.121:0/1899014221 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b0c036110 0x7f8b0c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b29d91640 1 -- 172.21.15.121:0/1899014221 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f8b1c008030 con 0x562d7ae81100 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b2c596640 1 -- 172.21.15.121:0/3866424894 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d7af3b720 con 0x562d7af3adc0 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b2bd95640 1 --2- 172.21.15.121:0/1899014221 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b0c036110 0x7f8b0c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b2c596640 1 --2- 172.21.15.121:0/3866424894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af3b1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400a430 tx=0x7f8b2400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799d572d2b1940a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b2bd95640 1 --2- 172.21.15.121:0/1899014221 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b0c036110 0x7f8b0c0385d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c019e80 tx=0x7f8b1c034040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.465+0000 7f8b22d93640 1 -- 172.21.15.121:0/3866424894 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b24001650 con 0x562d7af3adc0 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b22d93640 1 -- 172.21.15.121:0/3866424894 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b240017d0 con 0x562d7af3adc0 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b22d93640 1 -- 172.21.15.121:0/3866424894 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b24001ab0 con 0x562d7af3adc0 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b30122800 1 -- 172.21.15.121:0/3866424894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 msgr2=0x562d7af3b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b30122800 1 --2- 172.21.15.121:0/3866424894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af3b1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400a430 tx=0x7f8b2400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b30122800 1 -- 172.21.15.121:0/3866424894 shutdown_connections 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b30122800 1 --2- 172.21.15.121:0/3866424894 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af3b1e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b30122800 1 -- 172.21.15.121:0/3866424894 >> 172.21.15.121:0/3866424894 conn(0x562d7af35a00 msgr2=0x562d7af368e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b30122800 1 -- 172.21.15.121:0/3866424894 shutdown_connections 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b30122800 1 -- 172.21.15.121:0/3866424894 wait complete. 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b30122800 1 Processor -- start 2023-12-07T21:09:12.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b30122800 1 -- start start 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b30122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af41ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.466+0000 7f8b30122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d7ad2a530 con 0x562d7af3adc0 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.467+0000 7f8b2c596640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af41ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.467+0000 7f8b2c596640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af41ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52896/0 (socket says 172.21.15.121:52896) 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.467+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 learned_addr learned my addr 172.21.15.121:0/467537206 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.467+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2400a0e0 con 0x562d7af3adc0 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.467+0000 7f8b2c596640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af41ac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400a930 tx=0x7f8b24003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.467+0000 7f8b21590640 1 -- 172.21.15.121:0/467537206 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b24010900 con 0x562d7af3adc0 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.467+0000 7f8b21590640 1 -- 172.21.15.121:0/467537206 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24010a60 con 0x562d7af3adc0 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.467+0000 7f8b21590640 1 -- 172.21.15.121:0/467537206 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b24010d20 con 0x562d7af3adc0 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.467+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562d7af42000 con 0x562d7af3adc0 2023-12-07T21:09:12.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.467+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d7af42460 con 0x562d7af3adc0 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.468+0000 7f8b21590640 1 -- 172.21.15.121:0/467537206 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f8b24017030 con 0x562d7af3adc0 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.468+0000 7f8b21590640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b04036110 0x7f8b040385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.468+0000 7f8b21590640 1 -- 172.21.15.121:0/467537206 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f8b2404b7a0 con 0x562d7af3adc0 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.468+0000 7f8b23594640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b04036110 0x7f8b040385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.469+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.469+0000 7f8b30122800 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562d7af4d240 0x562d7af4f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.469+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af4fe50 con 0x562d7af4d240 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.469+0000 7f8b23594640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b04036110 0x7f8b040385d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8b14054000 tx=0x7f8b1404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.469+0000 7f8b2c596640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562d7af4d240 0x562d7af4f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.469+0000 7f8b2c596640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562d7af4d240 0x562d7af4f700 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.469+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.469+0000 7f8b30122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.469+0000 7f8b30122800 20 realm 2023-12-07T21:09:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.469+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.469+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af50260 con 0x562d7af4d240 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af50ae0 con 0x562d7af4d240 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af50e40 con 0x562d7af4d240 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af51640 con 0x562d7af4d240 2023-12-07T21:09:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 20 searching for the correct realm 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562d7af53360 0x562d7af55820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af53360 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.470+0000 7f8b2bd95640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562d7af53360 0x562d7af55820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.471+0000 7f8b2bd95640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562d7af53360 0x562d7af55820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.471+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b1c016070 con 0x562d7af53360 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.471+0000 7f8b2bd95640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8b1c00f070 0x7f8b1c02e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.471+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x7f8b1c00f070 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.471+0000 7f8b23594640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8b1c00f070 0x7f8b1c02e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.471+0000 7f8b23594640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8b1c00f070 0x7f8b1c02e580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.472+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b14052af0 con 0x7f8b1c00f070 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.472+0000 7f8b23594640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x562d7ae85540 0x7f8b1405b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.472+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7ae85540 2023-12-07T21:09:12.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.472+0000 7f8b2c596640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x562d7ae85540 0x7f8b1405b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.472+0000 7f8b2c596640 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x562d7ae85540 0x7f8b1405b370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.473+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.473+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af4d240 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.473+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.473+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af4d240 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.473+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.473+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7ae85540 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.473+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.473+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7ae85540 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.474+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.474+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x7f8b1c00f070 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.474+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b14052af0 con 0x7f8b1c00f070 2023-12-07T21:09:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.474+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af53360 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.474+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b1c016070 con 0x562d7af53360 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.474+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af4d240 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.474+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.474+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7ae85540 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.475+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.475+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af4d240 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.475+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.475+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x7f8b1c00f070 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.475+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8b14052af0 con 0x7f8b1c00f070 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.475+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af53360 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.475+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b1c016070 con 0x562d7af53360 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.475+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af53360 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.475+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b1c016070 con 0x562d7af53360 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.475+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7ae85540 2023-12-07T21:09:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.476+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.476+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af53360 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.476+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b1c016070 con 0x562d7af53360 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.476+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af53360 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.476+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b1c016070 con 0x562d7af53360 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.476+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af4d240 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.476+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.476+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af4d240 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.477+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.477+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7ae85540 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.477+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.477+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af53360 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.477+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8b1c016070 con 0x562d7af53360 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.477+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x7f8b1c00f070 2023-12-07T21:09:12.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.477+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b14052af0 con 0x7f8b1c00f070 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.477+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af4d240 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.478+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.478+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7ae85540 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.478+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.478+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af53360 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.478+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b1c016070 con 0x562d7af53360 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.478+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7ae85540 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.478+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.478+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x7f8b1c00f070 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.479+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b14052af0 con 0x7f8b1c00f070 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.479+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af53360 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.479+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b1c016070 con 0x562d7af53360 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.479+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7ae85540 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.479+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.479+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af55ef0 con 0x562d7af4d240 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.479+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.479+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b24053080 con 0x7f8b1c00f070 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af51f40 con 0x562d7af4d240 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af52790 con 0x562d7af4d240 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af52790 con 0x562d7af53360 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8b1c016070 con 0x562d7af53360 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 zone default found 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 4 Realm: () 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 zonegroup default 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.480+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af56330 con 0x562d7ae85540 2023-12-07T21:09:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b30122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af580f0 con 0x562d7af53360 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b30122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af58450 con 0x562d7af53360 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b30122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b30122800 20 started sync module instance, tier type = 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b30122800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.481+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af579d0 con 0x7f8b1c00f070 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.482+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.482+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94753334009680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af57d80 con 0x7f8b1c00f070 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.482+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af58d40 con 0x562d7af4d240 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.483+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94753334009680] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.484+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.484+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94753336423728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af58d40 con 0x562d7af4d240 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.484+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af59790 con 0x562d7af53360 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.485+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.485+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94753336431216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af59fe0 con 0x562d7af53360 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.485+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af5a990 con 0x7f8b1c00f070 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.486+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94753336423728] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.487+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94753336431216] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.489+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.489+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94753336428704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af59c50 con 0x7f8b1c00f070 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.489+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af5b430 con 0x562d7af4d240 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.490+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.490+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94753336438544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af5bc80 con 0x562d7af4d240 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.490+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af5c630 con 0x562d7ae85540 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.490+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94753336428704] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.492+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94753336438544] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.492+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.492+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94753336435888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af5b760 con 0x562d7ae85540 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.492+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af5ceb0 con 0x562d7ae85540 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.493+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94753336435888] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.493+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.493+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94753336443216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af5b760 con 0x562d7ae85540 2023-12-07T21:09:12.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.493+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af5d350 con 0x562d7ae85540 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.494+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94753336443216] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94753336445312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af5d230 con 0x562d7ae85540 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b30122800 20 add_watcher() i=0 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b30122800 20 add_watcher() i=1 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b30122800 20 add_watcher() i=2 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b30122800 20 add_watcher() i=3 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b30122800 20 add_watcher() i=4 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b30122800 20 add_watcher() i=5 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b30122800 20 add_watcher() i=6 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94753336445312] v31'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b30122800 20 add_watcher() i=7 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b30122800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.495+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af605f0 con 0x562d7af4d240 2023-12-07T21:09:12.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.496+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.496+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94753336446816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af5db00 con 0x562d7af4d240 2023-12-07T21:09:12.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.498+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94753336446816] v31'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.498+0000 7f8af1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:12.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.498+0000 7f8b30122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:12.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.498+0000 7f8b30122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:12.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.499+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af68bd0 con 0x562d7af4d240 2023-12-07T21:09:12.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.500+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.500+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af68ff0 con 0x562d7ae85540 2023-12-07T21:09:12.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.501+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'11 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.501+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af69520 con 0x562d7af53360 2023-12-07T21:09:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.504+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.504+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af69ef0 con 0x562d7af4d240 2023-12-07T21:09:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.507+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.507+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af66c80 con 0x7f8b1c00f070 2023-12-07T21:09:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.509+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.509+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6aa60 con 0x562d7af53360 2023-12-07T21:09:12.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.512+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'15 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.512+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6af90 con 0x562d7af4d240 2023-12-07T21:09:12.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.514+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.514+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6af90 con 0x562d7ae85540 2023-12-07T21:09:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.515+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'15 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.515+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6af90 con 0x7f8b1c00f070 2023-12-07T21:09:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.516+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.516+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6b960 con 0x562d7af53360 2023-12-07T21:09:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.518+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.518+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6bd10 con 0x7f8b1c00f070 2023-12-07T21:09:12.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.521+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.521+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c240 con 0x562d7ae85540 2023-12-07T21:09:12.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.523+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.523+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c240 con 0x7f8b1c00f070 2023-12-07T21:09:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.524+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.524+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c6e0 con 0x562d7ae85540 2023-12-07T21:09:12.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.527+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'21 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.527+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c6e0 con 0x562d7af4d240 2023-12-07T21:09:12.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.530+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'33 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.530+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c6e0 con 0x562d7af53360 2023-12-07T21:09:12.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.532+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.532+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c6e0 con 0x7f8b1c00f070 2023-12-07T21:09:12.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.533+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'25 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.533+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c6e0 con 0x562d7af53360 2023-12-07T21:09:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.534+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.534+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c6e0 con 0x562d7af4d240 2023-12-07T21:09:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.536+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.536+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c6e0 con 0x562d7af4d240 2023-12-07T21:09:12.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.537+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'34 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.537+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c6e0 con 0x562d7af53360 2023-12-07T21:09:12.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.538+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.538+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c6e0 con 0x7f8b1c00f070 2023-12-07T21:09:12.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.539+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.539+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c770 con 0x562d7af53360 2023-12-07T21:09:12.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.541+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.541+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c770 con 0x562d7af53360 2023-12-07T21:09:12.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.542+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.542+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c770 con 0x562d7af53360 2023-12-07T21:09:12.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.546+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.546+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c770 con 0x562d7af53360 2023-12-07T21:09:12.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.548+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'16 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.548+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c770 con 0x562d7ae85540 2023-12-07T21:09:12.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.549+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.549+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c770 con 0x562d7af53360 2023-12-07T21:09:12.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.550+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.550+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c770 con 0x562d7ae85540 2023-12-07T21:09:12.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.551+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'16 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.551+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c770 con 0x562d7af53360 2023-12-07T21:09:12.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.552+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'19 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.552+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c770 con 0x562d7ae85540 2023-12-07T21:09:12.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.553+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'22 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.553+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af6c770 con 0x7f8b1c00f070 2023-12-07T21:09:12.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.554+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.555+0000 7f8af0fe1640 20 reqs_thread_entry: start 2023-12-07T21:09:12.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.555+0000 7f8b30122800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:12.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.555+0000 7f8b30122800 20 Filter name: none 2023-12-07T21:09:12.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.555+0000 7f8a6a7fc640 20 reqs_thread_entry: start 2023-12-07T21:09:12.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.555+0000 7f8b30122800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2023-12-07T21:09:12.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.555+0000 7f8b30122800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.555+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af97680 con 0x562d7ae85540 2023-12-07T21:09:12.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.555+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.555+0000 7f8b30122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.555+0000 7f8b30122800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2023-12-07T21:09:12.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.555+0000 7f8b30122800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2023-12-07T21:09:12.549 INFO:teuthology.orchestra.run.smithi121.stderr:could not remove user: unable to remove user, user does not exist 2023-12-07T21:09:12.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.556+0000 7f8af1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:12.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.556+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94753336446816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af69ef0 con 0x562d7af4d240 2023-12-07T21:09:12.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.557+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94753336446816] v31'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.557+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94753334009680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af65be0 con 0x7f8b1c00f070 2023-12-07T21:09:12.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.558+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94753334009680] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.558+0000 7f8b30122800 20 remove_watcher() i=0 2023-12-07T21:09:12.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.558+0000 7f8b30122800 2 removed watcher, disabling cache 2023-12-07T21:09:12.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.558+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94753336423728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af65be0 con 0x562d7af4d240 2023-12-07T21:09:12.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.560+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94753336423728] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.560+0000 7f8b30122800 20 remove_watcher() i=1 2023-12-07T21:09:12.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.560+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94753336431216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af65be0 con 0x562d7af53360 2023-12-07T21:09:12.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.561+0000 7f8b2bd95640 1 -- 172.21.15.121:0/467537206 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94753336431216] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b1c057040 con 0x562d7af53360 2023-12-07T21:09:12.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.561+0000 7f8b30122800 20 remove_watcher() i=2 2023-12-07T21:09:12.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.561+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94753336428704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af65be0 con 0x7f8b1c00f070 2023-12-07T21:09:12.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.562+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94753336428704] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b1406f040 con 0x7f8b1c00f070 2023-12-07T21:09:12.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.562+0000 7f8b30122800 20 remove_watcher() i=3 2023-12-07T21:09:12.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.562+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94753336438544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af65be0 con 0x562d7af4d240 2023-12-07T21:09:12.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.565+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94753336438544] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7af4d240 2023-12-07T21:09:12.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.565+0000 7f8b30122800 20 remove_watcher() i=4 2023-12-07T21:09:12.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.565+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94753336435888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af65be0 con 0x562d7ae85540 2023-12-07T21:09:12.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.566+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94753336435888] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.566+0000 7f8b30122800 20 remove_watcher() i=5 2023-12-07T21:09:12.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.566+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94753336443216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af65be0 con 0x562d7ae85540 2023-12-07T21:09:12.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.567+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94753336443216] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.567+0000 7f8b30122800 20 remove_watcher() i=6 2023-12-07T21:09:12.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.567+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94753336445312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562d7af65be0 con 0x562d7ae85540 2023-12-07T21:09:12.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b2c596640 1 -- 172.21.15.121:0/467537206 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94753336445312] v31'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b2402e9d0 con 0x562d7ae85540 2023-12-07T21:09:12.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 20 remove_watcher() i=7 2023-12-07T21:09:12.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x562d7ae85540 msgr2=0x7f8b1405b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x562d7ae85540 0x7f8b1405b370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562d7af4d240 msgr2=0x562d7af4f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562d7af4d240 0x562d7af4f700 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8b1c00f070 msgr2=0x7f8b1c02e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8b1c00f070 0x7f8b1c02e580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562d7af53360 msgr2=0x562d7af55820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562d7af53360 0x562d7af55820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b04036110 msgr2=0x7f8b040385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b04036110 0x7f8b040385d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8b14054000 tx=0x7f8b1404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 msgr2=0x562d7af41ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af41ac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b2400a930 tx=0x7f8b24003370 comp rx=0 tx=0).stop 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b23594640 1 -- 172.21.15.121:0/467537206 reap_dead start 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 shutdown_connections 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 --2- 172.21.15.121:0/467537206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7af3adc0 0x562d7af41ac0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 >> 172.21.15.121:0/467537206 conn(0x562d7af35a00 msgr2=0x562d7af368e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.568+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 shutdown_connections 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.569+0000 7f8b30122800 1 -- 172.21.15.121:0/467537206 wait complete. 2023-12-07T21:09:12.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.569+0000 7f8b30122800 1 -- 172.21.15.121:0/1899014221 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b0c036110 msgr2=0x7f8b0c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.569+0000 7f8b30122800 1 --2- 172.21.15.121:0/1899014221 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b0c036110 0x7f8b0c0385d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c019e80 tx=0x7f8b1c034040 comp rx=0 tx=0).stop 2023-12-07T21:09:12.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.569+0000 7f8b30122800 1 -- 172.21.15.121:0/1899014221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 msgr2=0x562d7af2e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.569+0000 7f8b30122800 1 --2- 172.21.15.121:0/1899014221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7af2e490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x562d7af224b0 tx=0x7f8b1c000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.569+0000 7f8b30122800 1 -- 172.21.15.121:0/1899014221 shutdown_connections 2023-12-07T21:09:12.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.569+0000 7f8b30122800 1 --2- 172.21.15.121:0/1899014221 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b0c036110 0x7f8b0c0385d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.569+0000 7f8b30122800 1 --2- 172.21.15.121:0/1899014221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562d7ae81100 0x562d7af2e490 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.569+0000 7f8b30122800 1 -- 172.21.15.121:0/1899014221 >> 172.21.15.121:0/1899014221 conn(0x562d7ae7c880 msgr2=0x562d7af24b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.569+0000 7f8b30122800 1 -- 172.21.15.121:0/1899014221 shutdown_connections 2023-12-07T21:09:12.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.569+0000 7f8b30122800 1 -- 172.21.15.121:0/1899014221 wait complete. 2023-12-07T21:09:12.564 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-12-07T21:09:12.565 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2023-12-07T21:09:12.565 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2023-12-07T21:09:12.565 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2023-12-07T21:09:12.649 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:12.649 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:12.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.657+0000 7f504fb2c800 1 Processor -- start 2023-12-07T21:09:12.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.657+0000 7f504fb2c800 1 -- start start 2023-12-07T21:09:12.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.657+0000 7f504fb2c800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560680887840 0x560680887c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.657+0000 7f504fb2c800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5606807d27a0 con 0x5606808881a0 2023-12-07T21:09:12.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.657+0000 7f504fb2c800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x56068079b880 con 0x560680887840 2023-12-07T21:09:12.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.657+0000 7f504b8f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560680887840 0x560680887c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.657+0000 7f504b8f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x560680887840 0x560680887c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52906/0 (socket says 172.21.15.121:52906) 2023-12-07T21:09:12.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.657+0000 7f504b8f0640 1 -- 172.21.15.121:0/2267149487 learned_addr learned my addr 172.21.15.121:0/2267149487 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.658+0000 7f504b8f0640 1 -- 172.21.15.121:0/2267149487 >> v1:172.21.15.89:6789/0 conn(0x5606808881a0 legacy=0x5606808842c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.658+0000 7f504b8f0640 1 -- 172.21.15.121:0/2267149487 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560680884b60 con 0x560680887840 2023-12-07T21:09:12.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.659+0000 7f504b8f0640 1 --2- 172.21.15.121:0/2267149487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680887c60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f503c00a520 tx=0x7f503c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51681e75cfed0f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.660+0000 7f504a8ee640 1 -- 172.21.15.121:0/2267149487 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f503c052570 con 0x560680887840 2023-12-07T21:09:12.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.660+0000 7f504a8ee640 1 -- 172.21.15.121:0/2267149487 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c0526d0 con 0x560680887840 2023-12-07T21:09:12.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.660+0000 7f504a8ee640 1 -- 172.21.15.121:0/2267149487 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f503c052990 con 0x560680887840 2023-12-07T21:09:12.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.660+0000 7f504fb2c800 1 -- 172.21.15.121:0/2267149487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 msgr2=0x560680887c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.660+0000 7f504fb2c800 1 --2- 172.21.15.121:0/2267149487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680887c60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f503c00a520 tx=0x7f503c01cee0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.660+0000 7f504fb2c800 1 -- 172.21.15.121:0/2267149487 shutdown_connections 2023-12-07T21:09:12.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.660+0000 7f504fb2c800 1 --2- 172.21.15.121:0/2267149487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680887c60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.660+0000 7f504fb2c800 1 -- 172.21.15.121:0/2267149487 >> 172.21.15.121:0/2267149487 conn(0x56068087ff60 msgr2=0x560680882380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.660+0000 7f504fb2c800 1 -- 172.21.15.121:0/2267149487 shutdown_connections 2023-12-07T21:09:12.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.660+0000 7f504fb2c800 1 -- 172.21.15.121:0/2267149487 wait complete. 2023-12-07T21:09:12.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.661+0000 7f504fb2c800 1 Processor -- start 2023-12-07T21:09:12.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.661+0000 7f504fb2c800 1 -- start start 2023-12-07T21:09:12.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.661+0000 7f504fb2c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680886cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.661+0000 7f504fb2c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560680798db0 con 0x560680887840 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.661+0000 7f504b8f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680886cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.661+0000 7f504b8f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680886cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52914/0 (socket says 172.21.15.121:52914) 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.661+0000 7f504b8f0640 1 -- 172.21.15.121:0/595455888 learned_addr learned my addr 172.21.15.121:0/595455888 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504b8f0640 1 -- 172.21.15.121:0/595455888 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c005de0 con 0x560680887840 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504b8f0640 1 --2- 172.21.15.121:0/595455888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680886cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f503c000c00 tx=0x7f503c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91715f870eaa12c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504a0ed640 1 -- 172.21.15.121:0/595455888 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f503c052840 con 0x560680887840 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504a0ed640 1 -- 172.21.15.121:0/595455888 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c0529a0 con 0x560680887840 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504a0ed640 1 -- 172.21.15.121:0/595455888 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f503c052c80 con 0x560680887840 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504fb2c800 1 -- 172.21.15.121:0/595455888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 msgr2=0x560680886cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504fb2c800 1 --2- 172.21.15.121:0/595455888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680886cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f503c000c00 tx=0x7f503c04c000 comp rx=0 tx=0).stop 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504fb2c800 1 -- 172.21.15.121:0/595455888 shutdown_connections 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504fb2c800 1 --2- 172.21.15.121:0/595455888 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680886cd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504fb2c800 1 -- 172.21.15.121:0/595455888 >> 172.21.15.121:0/595455888 conn(0x56068087ff60 msgr2=0x560680927010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504fb2c800 1 -- 172.21.15.121:0/595455888 shutdown_connections 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.662+0000 7f504fb2c800 1 -- 172.21.15.121:0/595455888 wait complete. 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.663+0000 7f504fb2c800 1 Processor -- start 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.663+0000 7f504fb2c800 1 -- start start 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.663+0000 7f504fb2c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680934a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.663+0000 7f504fb2c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606807946a0 con 0x560680887840 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.663+0000 7f504b8f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680934a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.663+0000 7f504b8f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680934a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52920/0 (socket says 172.21.15.121:52920) 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.663+0000 7f504b8f0640 1 -- 172.21.15.121:0/1179218494 learned_addr learned my addr 172.21.15.121:0/1179218494 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.663+0000 7f504b8f0640 1 -- 172.21.15.121:0/1179218494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560680884b60 con 0x560680887840 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.664+0000 7f504b8f0640 1 --2- 172.21.15.121:0/1179218494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680934a40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f503c01ceb0 tx=0x7f503c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.664+0000 7f50490eb640 1 -- 172.21.15.121:0/1179218494 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f503c06a070 con 0x560680887840 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.664+0000 7f50490eb640 1 -- 172.21.15.121:0/1179218494 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c052e50 con 0x560680887840 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.664+0000 7f504fb2c800 1 -- 172.21.15.121:0/1179218494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560680934f80 con 0x560680887840 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.664+0000 7f50490eb640 1 -- 172.21.15.121:0/1179218494 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f503c0655c0 con 0x560680887840 2023-12-07T21:09:12.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.664+0000 7f504fb2c800 1 -- 172.21.15.121:0/1179218494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606809354c0 con 0x560680887840 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.664+0000 7f504fb2c800 1 Processor -- start 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.664+0000 7f504fb2c800 1 -- start start 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.664+0000 7f504fb2c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680941000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.664+0000 7f504fb2c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068072e890 con 0x560680940be0 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.664+0000 7f50490eb640 1 -- 172.21.15.121:0/1179218494 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f503c059070 con 0x560680887840 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f50490eb640 1 --2- 172.21.15.121:0/1179218494 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5038036110 0x7f50380385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f50490eb640 1 -- 172.21.15.121:0/1179218494 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f503c08cdb0 con 0x560680887840 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f504c0f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680941000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f504c0f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680941000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52922/0 (socket says 172.21.15.121:52922) 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f504c0f1640 1 -- 172.21.15.121:0/3309612968 learned_addr learned my addr 172.21.15.121:0/3309612968 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f504b8f0640 1 --2- 172.21.15.121:0/1179218494 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5038036110 0x7f50380385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f504b8f0640 1 --2- 172.21.15.121:0/1179218494 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5038036110 0x7f50380385d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f503c065f90 tx=0x7f503c079040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f504c0f1640 1 -- 172.21.15.121:0/3309612968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560680941540 con 0x560680940be0 2023-12-07T21:09:12.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f504c0f1640 1 --2- 172.21.15.121:0/3309612968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680941000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f504400a430 tx=0x7f504400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7899ec53a06f103c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f5032ffd640 1 -- 172.21.15.121:0/3309612968 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5044001650 con 0x560680940be0 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f5032ffd640 1 -- 172.21.15.121:0/3309612968 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50440017d0 con 0x560680940be0 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.665+0000 7f5032ffd640 1 -- 172.21.15.121:0/3309612968 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5044001ab0 con 0x560680940be0 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.666+0000 7f504fb2c800 1 -- 172.21.15.121:0/3309612968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 msgr2=0x560680941000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.666+0000 7f504fb2c800 1 --2- 172.21.15.121:0/3309612968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680941000 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f504400a430 tx=0x7f504400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.666+0000 7f504fb2c800 1 -- 172.21.15.121:0/3309612968 shutdown_connections 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.666+0000 7f504fb2c800 1 --2- 172.21.15.121:0/3309612968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680941000 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.666+0000 7f504fb2c800 1 -- 172.21.15.121:0/3309612968 >> 172.21.15.121:0/3309612968 conn(0x5606808881a0 msgr2=0x56068093bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.666+0000 7f504fb2c800 1 -- 172.21.15.121:0/3309612968 shutdown_connections 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.666+0000 7f504fb2c800 1 -- 172.21.15.121:0/3309612968 wait complete. 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.666+0000 7f504fb2c800 1 Processor -- start 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.666+0000 7f504fb2c800 1 -- start start 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.666+0000 7f504fb2c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680947b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.666+0000 7f504fb2c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56068072e530 con 0x560680940be0 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.667+0000 7f504c0f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680947b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.667+0000 7f504c0f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680947b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52928/0 (socket says 172.21.15.121:52928) 2023-12-07T21:09:12.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.667+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 learned_addr learned my addr 172.21.15.121:0/3778893117 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.667+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504400a0e0 con 0x560680940be0 2023-12-07T21:09:12.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.667+0000 7f504c0f1640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680947b70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f504400ae40 tx=0x7f5044003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.667+0000 7f50317fa640 1 -- 172.21.15.121:0/3778893117 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50440109e0 con 0x560680940be0 2023-12-07T21:09:12.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.667+0000 7f50317fa640 1 -- 172.21.15.121:0/3778893117 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5044010b40 con 0x560680940be0 2023-12-07T21:09:12.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.667+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606809480b0 con 0x560680940be0 2023-12-07T21:09:12.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.667+0000 7f50317fa640 1 -- 172.21.15.121:0/3778893117 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5044010e20 con 0x560680940be0 2023-12-07T21:09:12.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.667+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560680948510 con 0x560680940be0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.668+0000 7f50317fa640 1 -- 172.21.15.121:0/3778893117 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f5044017070 con 0x560680940be0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.668+0000 7f50317fa640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5024036110 0x7f50240385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.669+0000 7f50317fa640 1 -- 172.21.15.121:0/3778893117 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f504404b5a0 con 0x560680940be0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.669+0000 7f504b0ef640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5024036110 0x7f50240385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.669+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.669+0000 7f504fb2c800 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5606809532b0 0x560680955770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.669+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680955ec0 con 0x5606809532b0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.669+0000 7f504b0ef640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5024036110 0x7f50240385d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x56068093cc00 tx=0x7f5040001310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.669+0000 7f504c0f1640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5606809532b0 0x560680955770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.669+0000 7f504c0f1640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5606809532b0 0x560680955770 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 20 realm 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606809562d0 con 0x5606809532b0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680956b50 con 0x5606809532b0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680956eb0 con 0x5606809532b0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.670+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606809576b0 con 0x5606809532b0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.671+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.671+0000 7f504fb2c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.671+0000 7f504fb2c800 20 searching for the correct realm 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.671+0000 7f504fb2c800 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5606809593f0 0x56068095b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.671+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809593f0 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.671+0000 7f504b8f0640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5606809593f0 0x56068095b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.671+0000 7f504b8f0640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5606809593f0 0x56068095b8b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.671+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.671+0000 7f504b8f0640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f503c065070 0x7f503c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.671+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x7f503c065070 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.671+0000 7f504b0ef640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f503c065070 0x7f503c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.672+0000 7f504b0ef640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f503c065070 0x7f503c06d390 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.672+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.672+0000 7f504b0ef640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f504000f8d0 0x7f504000e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.672+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x7f504000f8d0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.672+0000 7f504c0f1640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f504000f8d0 0x7f504000e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.673+0000 7f504c0f1640 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f504000f8d0 0x7f504000e360 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.673+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.673+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809532b0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.673+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.673+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809532b0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.673+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.673+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x7f504000f8d0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.673+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.673+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x7f504000f8d0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.674+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.674+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x7f503c065070 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.674+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.674+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809593f0 2023-12-07T21:09:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.674+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.674+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809532b0 2023-12-07T21:09:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.674+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.674+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x7f504000f8d0 2023-12-07T21:09:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.675+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.675+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809532b0 2023-12-07T21:09:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.675+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.675+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x7f503c065070 2023-12-07T21:09:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.675+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.675+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809593f0 2023-12-07T21:09:12.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.675+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.675+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809593f0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.676+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.676+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x7f504000f8d0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.676+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.676+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809593f0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.676+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.676+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809593f0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.676+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.676+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809532b0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.677+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.677+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809532b0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.677+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.677+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x7f504000f8d0 2023-12-07T21:09:12.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.677+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.677+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809593f0 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.677+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.677+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x7f503c065070 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.678+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.678+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x5606809532b0 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.678+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.678+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095bf80 con 0x7f504000f8d0 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.678+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.678+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5044053040 con 0x5606809593f0 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.678+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.678+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5044053040 con 0x7f504000f8d0 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.678+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.678+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5044053040 con 0x7f503c065070 2023-12-07T21:09:12.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.679+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.679+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5044053040 con 0x5606809593f0 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.679+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.679+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5044053040 con 0x7f504000f8d0 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.679+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.679+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5044053040 con 0x5606809532b0 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.679+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5044053040 con 0x7f503c065070 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:12.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680957fe0 con 0x5606809532b0 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680958830 con 0x5606809532b0 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.680+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680957c60 con 0x5606809593f0 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 20 zone default found 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 4 Realm: () 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:12.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 20 zonegroup default 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095c3c0 con 0x7f504000f8d0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095e150 con 0x5606809593f0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095e4b0 con 0x5606809593f0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.681+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.682+0000 7f504fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.682+0000 7f504fb2c800 20 started sync module instance, tier type = 2023-12-07T21:09:12.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.682+0000 7f504fb2c800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:12.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.682+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095da30 con 0x7f503c065070 2023-12-07T21:09:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.683+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.683+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94585924673360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095dde0 con 0x7f503c065070 2023-12-07T21:09:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.683+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095ed40 con 0x5606809532b0 2023-12-07T21:09:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.684+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94585924673360] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.684+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.684+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94585927095696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095edc0 con 0x5606809532b0 2023-12-07T21:09:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.684+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068095f870 con 0x5606809593f0 2023-12-07T21:09:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.685+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.685+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94585927103344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606809600f0 con 0x5606809593f0 2023-12-07T21:09:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.685+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680960ac0 con 0x7f503c065070 2023-12-07T21:09:12.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.686+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94585927103344] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.686+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94585927095696] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.689+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.689+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94585927108032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680960ea0 con 0x7f503c065070 2023-12-07T21:09:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.689+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606809616a0 con 0x5606809532b0 2023-12-07T21:09:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.692+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.692+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94585927111440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680961d20 con 0x5606809532b0 2023-12-07T21:09:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.692+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606809627f0 con 0x7f504000f8d0 2023-12-07T21:09:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.695+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.695+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94585927115472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606809627b0 con 0x7f504000f8d0 2023-12-07T21:09:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.695+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680963650 con 0x7f504000f8d0 2023-12-07T21:09:12.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.695+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94585927108032] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.695+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94585927115472] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.696+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.696+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94585927105616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606809631b0 con 0x7f504000f8d0 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.696+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680963ed0 con 0x7f504000f8d0 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.697+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94585927105616] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.697+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94585927111440] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.697+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.697+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94585927112576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680963730 con 0x7f504000f8d0 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.697+0000 7f504fb2c800 20 add_watcher() i=0 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.697+0000 7f504fb2c800 20 add_watcher() i=1 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.697+0000 7f504fb2c800 20 add_watcher() i=2 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.697+0000 7f504fb2c800 20 add_watcher() i=3 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.697+0000 7f504fb2c800 20 add_watcher() i=4 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.697+0000 7f504fb2c800 20 add_watcher() i=5 2023-12-07T21:09:12.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.697+0000 7f504fb2c800 20 add_watcher() i=6 2023-12-07T21:09:12.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.700+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94585927112576] v31'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.700+0000 7f504fb2c800 20 add_watcher() i=7 2023-12-07T21:09:12.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.700+0000 7f504fb2c800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:12.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.700+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680966760 con 0x5606809532b0 2023-12-07T21:09:12.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.700+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.700+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94585927117456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680963c40 con 0x5606809532b0 2023-12-07T21:09:12.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.701+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94585927117456] v31'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.702+0000 7f5011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:12.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.702+0000 7f504fb2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:12.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.702+0000 7f504fb2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:12.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.702+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068096ed10 con 0x5606809532b0 2023-12-07T21:09:12.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.703+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.703+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068096f130 con 0x7f504000f8d0 2023-12-07T21:09:12.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.704+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'12 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.704+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068096f660 con 0x5606809593f0 2023-12-07T21:09:12.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.705+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.705+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680970030 con 0x5606809532b0 2023-12-07T21:09:12.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.706+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'37 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.706+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068096cd30 con 0x7f503c065070 2023-12-07T21:09:12.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.707+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.707+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680970ba0 con 0x5606809593f0 2023-12-07T21:09:12.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.708+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.708+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680971570 con 0x5606809532b0 2023-12-07T21:09:12.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.709+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.709+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680971570 con 0x7f504000f8d0 2023-12-07T21:09:12.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.710+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'17 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.710+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680971570 con 0x7f503c065070 2023-12-07T21:09:12.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.711+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.711+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680971d70 con 0x5606809593f0 2023-12-07T21:09:12.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.712+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.712+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068096bdb0 con 0x7f503c065070 2023-12-07T21:09:12.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.715+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'27 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.715+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606809728e0 con 0x7f504000f8d0 2023-12-07T21:09:12.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.717+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.717+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5606809728e0 con 0x7f503c065070 2023-12-07T21:09:12.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.718+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.718+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x7f504000f8d0 2023-12-07T21:09:12.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.719+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'23 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.719+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x5606809532b0 2023-12-07T21:09:12.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.720+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'38 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.720+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x5606809593f0 2023-12-07T21:09:12.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.721+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.721+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972e10 con 0x7f503c065070 2023-12-07T21:09:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.722+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'28 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.722+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972ea0 con 0x5606809593f0 2023-12-07T21:09:12.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.723+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.723+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972ea0 con 0x5606809532b0 2023-12-07T21:09:12.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.724+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.724+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972ea0 con 0x5606809532b0 2023-12-07T21:09:12.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.725+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'39 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.725+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972e10 con 0x5606809593f0 2023-12-07T21:09:12.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.726+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.726+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x7f503c065070 2023-12-07T21:09:12.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.727+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.727+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x5606809593f0 2023-12-07T21:09:12.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.728+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.728+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x5606809593f0 2023-12-07T21:09:12.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.729+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.729+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x5606809593f0 2023-12-07T21:09:12.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.729+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.729+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x5606809593f0 2023-12-07T21:09:12.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.730+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.730+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x7f504000f8d0 2023-12-07T21:09:12.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.731+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.731+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x5606809593f0 2023-12-07T21:09:12.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.732+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.732+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x7f504000f8d0 2023-12-07T21:09:12.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.733+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'18 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.734+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x5606809593f0 2023-12-07T21:09:12.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.734+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'22 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.735+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x7f504000f8d0 2023-12-07T21:09:12.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.736+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'24 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.736+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680972d80 con 0x7f503c065070 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.737+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.737+0000 7f5010fe1640 20 reqs_thread_entry: start 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.737+0000 7f504fb2c800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.737+0000 7f504fb2c800 20 Filter name: none 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.737+0000 7f4f8a7fc640 20 reqs_thread_entry: start 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.737+0000 7f504fb2c800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.737+0000 7f504fb2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.737+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56068099dcb0 con 0x7f504000f8d0 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.738+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.738+0000 7f504fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.738+0000 7f504fb2c800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.738+0000 7f504fb2c800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:09:12.731 INFO:teuthology.orchestra.run.smithi121.stderr:could not remove user: unable to remove user, user does not exist 2023-12-07T21:09:12.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.738+0000 7f5011fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:12.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.738+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94585927117456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680970030 con 0x5606809532b0 2023-12-07T21:09:12.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.739+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94585927117456] v31'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.739+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94585924673360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680970030 con 0x7f503c065070 2023-12-07T21:09:12.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.740+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94585924673360] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.740+0000 7f504fb2c800 20 remove_watcher() i=0 2023-12-07T21:09:12.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.740+0000 7f504fb2c800 2 removed watcher, disabling cache 2023-12-07T21:09:12.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.740+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94585927095696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680970030 con 0x5606809532b0 2023-12-07T21:09:12.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.741+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94585927095696] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.741+0000 7f504fb2c800 20 remove_watcher() i=1 2023-12-07T21:09:12.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.741+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94585927103344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680970030 con 0x5606809593f0 2023-12-07T21:09:12.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.743+0000 7f504b8f0640 1 -- 172.21.15.121:0/3778893117 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94585927103344] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f503c065720 con 0x5606809593f0 2023-12-07T21:09:12.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.743+0000 7f504fb2c800 20 remove_watcher() i=2 2023-12-07T21:09:12.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.743+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94585927108032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680970030 con 0x7f503c065070 2023-12-07T21:09:12.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.744+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94585927108032] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5040010560 con 0x7f503c065070 2023-12-07T21:09:12.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.744+0000 7f504fb2c800 20 remove_watcher() i=3 2023-12-07T21:09:12.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.744+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94585927111440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680970030 con 0x5606809532b0 2023-12-07T21:09:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.747+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94585927111440] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x5606809532b0 2023-12-07T21:09:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.747+0000 7f504fb2c800 20 remove_watcher() i=4 2023-12-07T21:09:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.747+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94585927115472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680961310 con 0x7f504000f8d0 2023-12-07T21:09:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.748+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94585927115472] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.748+0000 7f504fb2c800 20 remove_watcher() i=5 2023-12-07T21:09:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.748+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94585927105616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680961310 con 0x7f504000f8d0 2023-12-07T21:09:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.749+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94585927105616] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.749+0000 7f504fb2c800 20 remove_watcher() i=6 2023-12-07T21:09:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.749+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94585927112576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x560680961310 con 0x7f504000f8d0 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.750+0000 7f504c0f1640 1 -- 172.21.15.121:0/3778893117 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94585927112576] v31'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5044044db0 con 0x7f504000f8d0 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.750+0000 7f504fb2c800 20 remove_watcher() i=7 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.750+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f504000f8d0 msgr2=0x7f504000e360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.750+0000 7f504fb2c800 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f504000f8d0 0x7f504000e360 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.750+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5606809532b0 msgr2=0x560680955770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.750+0000 7f504fb2c800 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5606809532b0 0x560680955770 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.750+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f503c065070 msgr2=0x7f503c06d390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.750+0000 7f504fb2c800 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f503c065070 0x7f503c06d390 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.750+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5606809593f0 msgr2=0x56068095b8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.750+0000 7f504fb2c800 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5606809593f0 0x56068095b8b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5024036110 msgr2=0x7f50240385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5024036110 0x7f50240385d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x56068093cc00 tx=0x7f5040001310 comp rx=0 tx=0).stop 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 msgr2=0x560680947b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680947b70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f504400ae40 tx=0x7f5044003370 comp rx=0 tx=0).stop 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504b0ef640 1 -- 172.21.15.121:0/3778893117 reap_dead start 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 shutdown_connections 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 --2- 172.21.15.121:0/3778893117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680940be0 0x560680947b70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 >> 172.21.15.121:0/3778893117 conn(0x5606808881a0 msgr2=0x56068093adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 shutdown_connections 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/3778893117 wait complete. 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/1179218494 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5038036110 msgr2=0x7f50380385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 --2- 172.21.15.121:0/1179218494 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5038036110 0x7f50380385d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f503c065f90 tx=0x7f503c079040 comp rx=0 tx=0).stop 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/1179218494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 msgr2=0x560680934a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 --2- 172.21.15.121:0/1179218494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680934a40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f503c01ceb0 tx=0x7f503c002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/1179218494 shutdown_connections 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 --2- 172.21.15.121:0/1179218494 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5038036110 0x7f50380385d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 --2- 172.21.15.121:0/1179218494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x560680887840 0x560680934a40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/1179218494 >> 172.21.15.121:0/1179218494 conn(0x56068087ff60 msgr2=0x560680885520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/1179218494 shutdown_connections 2023-12-07T21:09:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.751+0000 7f504fb2c800 1 -- 172.21.15.121:0/1179218494 wait complete. 2023-12-07T21:09:12.747 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-12-07T21:09:12.747 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2023-12-07T21:09:12.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2023-12-07T21:09:12.748 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2023-12-07T21:09:12.789 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:12.789 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.797+0000 7ff9222bc800 1 Processor -- start 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.797+0000 7ff9222bc800 1 -- start start 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.797+0000 7ff9222bc800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55820e7527d0 0x55820e754bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.797+0000 7ff9222bc800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55820e69a7a0 con 0x55820e74f840 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.797+0000 7ff9222bc800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55820e663880 con 0x55820e7527d0 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.798+0000 7ff91f5bb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55820e7527d0 0x55820e754bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.798+0000 7ff91f5bb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55820e7527d0 0x55820e754bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52940/0 (socket says 172.21.15.121:52940) 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.798+0000 7ff91fdbc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55820e74f840 0x55820e74fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37650/0 (socket says 172.21.15.121:37650) 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.798+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1682913687 learned_addr learned my addr 172.21.15.121:0/1682913687 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.798+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1682913687 >> v1:172.21.15.89:6789/0 conn(0x55820e74f840 legacy=0x55820e74fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.798+0000 7ff91edba640 1 -- 172.21.15.121:0/1682913687 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558730611 0 0) 0x55820e69a7a0 con 0x55820e74f840 2023-12-07T21:09:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.798+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1682913687 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55820e756110 con 0x55820e7527d0 2023-12-07T21:09:12.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.800+0000 7ff91f5bb640 1 --2- 172.21.15.121:0/1682913687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e7527d0 0x55820e754bc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff91400a520 tx=0x7ff91401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1fc3fcb67cf4f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.800+0000 7ff91edba640 1 -- 172.21.15.121:0/1682913687 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff914052570 con 0x55820e7527d0 2023-12-07T21:09:12.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.800+0000 7ff91edba640 1 -- 172.21.15.121:0/1682913687 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9140526d0 con 0x55820e7527d0 2023-12-07T21:09:12.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.800+0000 7ff91edba640 1 -- 172.21.15.121:0/1682913687 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff914052990 con 0x55820e7527d0 2023-12-07T21:09:12.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.800+0000 7ff9222bc800 1 -- 172.21.15.121:0/1682913687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e7527d0 msgr2=0x55820e754bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.800+0000 7ff9222bc800 1 --2- 172.21.15.121:0/1682913687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e7527d0 0x55820e754bc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff91400a520 tx=0x7ff91401cee0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.801+0000 7ff9222bc800 1 -- 172.21.15.121:0/1682913687 shutdown_connections 2023-12-07T21:09:12.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.801+0000 7ff9222bc800 1 --2- 172.21.15.121:0/1682913687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e7527d0 0x55820e754bc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.801+0000 7ff9222bc800 1 -- 172.21.15.121:0/1682913687 >> 172.21.15.121:0/1682913687 conn(0x55820e747f60 msgr2=0x55820e74a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.801+0000 7ff9222bc800 1 -- 172.21.15.121:0/1682913687 shutdown_connections 2023-12-07T21:09:12.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.801+0000 7ff9222bc800 1 -- 172.21.15.121:0/1682913687 wait complete. 2023-12-07T21:09:12.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.801+0000 7ff9222bc800 1 Processor -- start 2023-12-07T21:09:12.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.801+0000 7ff9222bc800 1 -- start start 2023-12-07T21:09:12.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.801+0000 7ff9222bc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74f840 0x55820e7f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.801+0000 7ff9222bc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820e660db0 con 0x55820e74f840 2023-12-07T21:09:12.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.802+0000 7ff91fdbc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74f840 0x55820e7f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.802+0000 7ff91fdbc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74f840 0x55820e7f2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52952/0 (socket says 172.21.15.121:52952) 2023-12-07T21:09:12.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.802+0000 7ff91fdbc640 1 -- 172.21.15.121:0/388384571 learned_addr learned my addr 172.21.15.121:0/388384571 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.802+0000 7ff91fdbc640 1 -- 172.21.15.121:0/388384571 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff914005de0 con 0x55820e74f840 2023-12-07T21:09:12.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.802+0000 7ff91fdbc640 1 --2- 172.21.15.121:0/388384571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74f840 0x55820e7f2c90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff910001660 tx=0x7ff910001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e1cb1132306ac6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.802+0000 7ff91e5b9640 1 -- 172.21.15.121:0/388384571 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff910003450 con 0x55820e74f840 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.802+0000 7ff91e5b9640 1 -- 172.21.15.121:0/388384571 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9100035d0 con 0x55820e74f840 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.802+0000 7ff91e5b9640 1 -- 172.21.15.121:0/388384571 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff910003930 con 0x55820e74f840 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff9222bc800 1 -- 172.21.15.121:0/388384571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74f840 msgr2=0x55820e7f2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff9222bc800 1 --2- 172.21.15.121:0/388384571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74f840 0x55820e7f2c90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff910001660 tx=0x7ff910001b20 comp rx=0 tx=0).stop 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff9222bc800 1 -- 172.21.15.121:0/388384571 shutdown_connections 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff9222bc800 1 --2- 172.21.15.121:0/388384571 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74f840 0x55820e7f2c90 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff910001660 tx=0x7ff910001b20 comp rx=0 tx=0).stop 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff9222bc800 1 -- 172.21.15.121:0/388384571 >> 172.21.15.121:0/388384571 conn(0x55820e747f60 msgr2=0x55820e7ee900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff9222bc800 1 -- 172.21.15.121:0/388384571 shutdown_connections 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff9222bc800 1 -- 172.21.15.121:0/388384571 wait complete. 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff9222bc800 1 Processor -- start 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff9222bc800 1 -- start start 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff9222bc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e7527d0 0x55820e7fa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff9222bc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820e65c6a0 con 0x55820e7527d0 2023-12-07T21:09:12.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff91fdbc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e7527d0 0x55820e7fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff91fdbc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e7527d0 0x55820e7fa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52960/0 (socket says 172.21.15.121:52960) 2023-12-07T21:09:12.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.803+0000 7ff91fdbc640 1 -- 172.21.15.121:0/604182298 learned_addr learned my addr 172.21.15.121:0/604182298 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.804+0000 7ff91fdbc640 1 -- 172.21.15.121:0/604182298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910006ce0 con 0x55820e7527d0 2023-12-07T21:09:12.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.804+0000 7ff91fdbc640 1 --2- 172.21.15.121:0/604182298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e7527d0 0x55820e7fa410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55820e7ef380 tx=0x7ff910001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.804+0000 7ff91d5b7640 1 -- 172.21.15.121:0/604182298 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff910013760 con 0x55820e7527d0 2023-12-07T21:09:12.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.804+0000 7ff91d5b7640 1 -- 172.21.15.121:0/604182298 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9100138c0 con 0x55820e7527d0 2023-12-07T21:09:12.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.804+0000 7ff9222bc800 1 -- 172.21.15.121:0/604182298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55820e7fa950 con 0x55820e7527d0 2023-12-07T21:09:12.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.804+0000 7ff91d5b7640 1 -- 172.21.15.121:0/604182298 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff910013b60 con 0x55820e7527d0 2023-12-07T21:09:12.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.804+0000 7ff9222bc800 1 -- 172.21.15.121:0/604182298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55820e7fae90 con 0x55820e7527d0 2023-12-07T21:09:12.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff9222bc800 1 Processor -- start 2023-12-07T21:09:12.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff9222bc800 1 -- start start 2023-12-07T21:09:12.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff9222bc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 0x55820e74eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff9222bc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820e5f6890 con 0x55820e74ea80 2023-12-07T21:09:12.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff91d5b7640 1 -- 172.21.15.121:0/604182298 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7ff910013cc0 con 0x55820e7527d0 2023-12-07T21:09:12.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff9205bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 0x55820e74eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff91d5b7640 1 --2- 172.21.15.121:0/604182298 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff90c036110 0x7ff90c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff9205bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 0x55820e74eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52972/0 (socket says 172.21.15.121:52972) 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff9205bd640 1 -- 172.21.15.121:0/931180987 learned_addr learned my addr 172.21.15.121:0/931180987 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff91d5b7640 1 -- 172.21.15.121:0/604182298 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7ff91004afa0 con 0x55820e7527d0 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff91fdbc640 1 --2- 172.21.15.121:0/604182298 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff90c036110 0x7ff90c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff9205bd640 1 -- 172.21.15.121:0/931180987 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55820e74f3e0 con 0x55820e74ea80 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.805+0000 7ff9205bd640 1 --2- 172.21.15.121:0/931180987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 0x55820e74eea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff91800a400 tx=0x7ff91800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e45cc1cf7a13eae server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff91fdbc640 1 --2- 172.21.15.121:0/604182298 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff90c036110 0x7ff90c0385d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff91001df70 tx=0x7ff91001df00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff906ffd640 1 -- 172.21.15.121:0/931180987 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9180087e0 con 0x55820e74ea80 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff906ffd640 1 -- 172.21.15.121:0/931180987 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918008960 con 0x55820e74ea80 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff906ffd640 1 -- 172.21.15.121:0/931180987 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff918008c80 con 0x55820e74ea80 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff9222bc800 1 -- 172.21.15.121:0/931180987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 msgr2=0x55820e74eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff9222bc800 1 --2- 172.21.15.121:0/931180987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 0x55820e74eea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff91800a400 tx=0x7ff91800a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff9222bc800 1 -- 172.21.15.121:0/931180987 shutdown_connections 2023-12-07T21:09:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff9222bc800 1 --2- 172.21.15.121:0/931180987 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 0x55820e74eea0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff9222bc800 1 -- 172.21.15.121:0/931180987 >> 172.21.15.121:0/931180987 conn(0x55820e8019f0 msgr2=0x55820e8028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff9222bc800 1 -- 172.21.15.121:0/931180987 shutdown_connections 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff9222bc800 1 -- 172.21.15.121:0/931180987 wait complete. 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff9222bc800 1 Processor -- start 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.806+0000 7ff9222bc800 1 -- start start 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9222bc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 0x55820e80fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9222bc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55820e5f6530 con 0x55820e74ea80 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9205bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 0x55820e80fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9205bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 0x55820e80fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52988/0 (socket says 172.21.15.121:52988) 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 learned_addr learned my addr 172.21.15.121:0/1988564365 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918005c90 con 0x55820e74ea80 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9205bd640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 0x55820e80fc20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff918010000 tx=0x7ff918002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9057fa640 1 -- 172.21.15.121:0/1988564365 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff918013650 con 0x55820e74ea80 2023-12-07T21:09:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9057fa640 1 -- 172.21.15.121:0/1988564365 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9180137b0 con 0x55820e74ea80 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55820e810160 con 0x55820e74ea80 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9057fa640 1 -- 172.21.15.121:0/1988564365 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff918013a70 con 0x55820e74ea80 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.807+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55820e810620 con 0x55820e74ea80 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.808+0000 7ff9057fa640 1 -- 172.21.15.121:0/1988564365 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7ff918013c60 con 0x55820e74ea80 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.808+0000 7ff9057fa640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8f80360c0 0x7ff8f8038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.808+0000 7ff9057fa640 1 -- 172.21.15.121:0/1988564365 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7ff91804b720 con 0x55820e74ea80 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.808+0000 7ff91f5bb640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8f80360c0 0x7ff8f8038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9222bc800 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55820e81b3a0 0x55820e81d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e81dfb0 con 0x55820e81b3a0 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff91f5bb640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8f80360c0 0x7ff8f8038580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff914054000 tx=0x7ff91404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9205bd640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55820e81b3a0 0x55820e81d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9205bd640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55820e81b3a0 0x55820e81d860 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9222bc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9222bc800 20 realm 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e81e3c0 con 0x55820e81b3a0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9222bc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.809+0000 7ff9222bc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e81ec40 con 0x55820e81b3a0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e81efa0 con 0x55820e81b3a0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e81f7a0 con 0x55820e81b3a0 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 20 searching for the correct realm 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55820e8214c0 0x55820e823950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e8214c0 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.810+0000 7ff91fdbc640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55820e8214c0 0x55820e823950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.811+0000 7ff91fdbc640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55820e8214c0 0x55820e823950 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.811+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff91001ec80 con 0x55820e8214c0 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.811+0000 7ff91fdbc640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x55820e74f840 0x7ff910010560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.811+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e74f840 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.811+0000 7ff91f5bb640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x55820e74f840 0x7ff910010560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.811+0000 7ff91f5bb640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x55820e74f840 0x7ff910010560 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.812+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff914052b50 con 0x55820e74f840 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.812+0000 7ff91f5bb640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7ff91405b370 0x7ff91405b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.812+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x7ff91405b370 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.812+0000 7ff9205bd640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7ff91405b370 0x7ff91405b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.812+0000 7ff9205bd640 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7ff91405b370 0x7ff91405b790 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.812+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.812+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e81b3a0 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.813+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.813+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e81b3a0 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.813+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.813+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x7ff91405b370 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.813+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.813+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x7ff91405b370 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.813+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.813+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e74f840 2023-12-07T21:09:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.814+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff914052b50 con 0x55820e74f840 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.814+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e8214c0 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.814+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff91001ec80 con 0x55820e8214c0 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.814+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e81b3a0 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.814+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.814+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x7ff91405b370 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.814+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.814+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e81b3a0 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.815+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.815+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e74f840 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.815+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff914052b50 con 0x55820e74f840 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.815+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e8214c0 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.815+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff91001ec80 con 0x55820e8214c0 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.815+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e8214c0 2023-12-07T21:09:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.815+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff91001ec80 con 0x55820e8214c0 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.815+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x7ff91405b370 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.816+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.816+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e8214c0 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.816+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff91001ec80 con 0x55820e8214c0 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.816+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e8214c0 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.816+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff91001ec80 con 0x55820e8214c0 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.816+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e81b3a0 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.816+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.816+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e81b3a0 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.817+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.817+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x7ff91405b370 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.817+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.817+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e8214c0 2023-12-07T21:09:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.817+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.817+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e74f840 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.817+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff914052b50 con 0x55820e74f840 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.818+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e81b3a0 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.818+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.818+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x7ff91405b370 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.818+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.818+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x55820e8214c0 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.818+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.818+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824020 con 0x7ff91405b370 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.818+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.819+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff918053040 con 0x55820e74f840 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.819+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff914052b50 con 0x55820e74f840 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.819+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff918053040 con 0x55820e8214c0 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.819+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.819+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff918053040 con 0x7ff91405b370 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff918053040 con 0x55820e81b3a0 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7ff918053040 con 0x55820e74f840 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9222bc800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9222bc800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9222bc800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9222bc800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9222bc800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9222bc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e8200a0 con 0x55820e81b3a0 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9222bc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.820+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e8208f0 con 0x55820e81b3a0 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e8208f0 con 0x55820e8214c0 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 20 zone default found 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 4 Realm: () 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 20 zonegroup default 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e824460 con 0x7ff91405b370 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e8262e0 con 0x55820e8214c0 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.821+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.822+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e826640 con 0x55820e8214c0 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.822+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.822+0000 7ff9222bc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.822+0000 7ff9222bc800 20 started sync module instance, tier type = 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.822+0000 7ff9222bc800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:12.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.822+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e8258b0 con 0x55820e74f840 2023-12-07T21:09:12.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.823+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.823+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94017075109712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e825cd0 con 0x55820e74f840 2023-12-07T21:09:12.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.823+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e826e40 con 0x55820e81b3a0 2023-12-07T21:09:12.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.824+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94017075109712] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.825+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.825+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94017077531664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e826e40 con 0x55820e81b3a0 2023-12-07T21:09:12.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.825+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e8278a0 con 0x55820e8214c0 2023-12-07T21:09:12.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.827+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.827+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94017077539728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e8280f0 con 0x55820e8214c0 2023-12-07T21:09:12.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.827+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e828af0 con 0x55820e74f840 2023-12-07T21:09:12.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.827+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94017077531664] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.828+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94017077539728] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.830+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.830+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94017077544432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e827d60 con 0x55820e74f840 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.830+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e829580 con 0x55820e81b3a0 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.832+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.832+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94017077547104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e829e00 con 0x55820e81b3a0 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.832+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e82a7b0 con 0x7ff91405b370 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.833+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.833+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94017077551824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e82a6e0 con 0x7ff91405b370 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.833+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e82b640 con 0x7ff91405b370 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.834+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94017077551824] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.835+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94017077544432] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.835+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.835+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94017077537184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e82b1a0 con 0x7ff91405b370 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.835+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e82b9a0 con 0x7ff91405b370 2023-12-07T21:09:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.836+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94017077537184] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.837+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94017077547104] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.838+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.838+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94017077553984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e82b640 con 0x7ff91405b370 2023-12-07T21:09:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.838+0000 7ff9222bc800 20 add_watcher() i=0 2023-12-07T21:09:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.838+0000 7ff9222bc800 20 add_watcher() i=1 2023-12-07T21:09:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.838+0000 7ff9222bc800 20 add_watcher() i=2 2023-12-07T21:09:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.838+0000 7ff9222bc800 20 add_watcher() i=3 2023-12-07T21:09:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.838+0000 7ff9222bc800 20 add_watcher() i=4 2023-12-07T21:09:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.838+0000 7ff9222bc800 20 add_watcher() i=5 2023-12-07T21:09:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.838+0000 7ff9222bc800 20 add_watcher() i=6 2023-12-07T21:09:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.841+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94017077553984] v31'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.841+0000 7ff9222bc800 20 add_watcher() i=7 2023-12-07T21:09:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.841+0000 7ff9222bc800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.841+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e82e710 con 0x55820e81b3a0 2023-12-07T21:09:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.841+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.841+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94017077555616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e82ba50 con 0x55820e81b3a0 2023-12-07T21:09:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.843+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94017077555616] v31'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.843+0000 7ff8e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.843+0000 7ff9222bc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.843+0000 7ff9222bc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.843+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e836da0 con 0x55820e81b3a0 2023-12-07T21:09:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.844+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.844+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e837260 con 0x7ff91405b370 2023-12-07T21:09:12.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.845+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'13 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.845+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e837680 con 0x55820e8214c0 2023-12-07T21:09:12.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.848+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.848+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e838050 con 0x55820e81b3a0 2023-12-07T21:09:12.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.849+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'42 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.849+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e834eb0 con 0x55820e74f840 2023-12-07T21:09:12.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.851+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'29 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.851+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e838bc0 con 0x55820e8214c0 2023-12-07T21:09:12.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.852+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.852+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e839590 con 0x55820e81b3a0 2023-12-07T21:09:12.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.853+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.853+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e839590 con 0x7ff91405b370 2023-12-07T21:09:12.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.854+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.854+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e839590 con 0x55820e74f840 2023-12-07T21:09:12.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.857+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.857+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e839f60 con 0x55820e8214c0 2023-12-07T21:09:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.860+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.860+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e838270 con 0x55820e74f840 2023-12-07T21:09:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.861+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'30 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.861+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e838270 con 0x7ff91405b370 2023-12-07T21:09:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.862+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.862+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e838270 con 0x55820e74f840 2023-12-07T21:09:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.863+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.863+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83aad0 con 0x7ff91405b370 2023-12-07T21:09:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.865+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'25 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.865+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83aad0 con 0x55820e81b3a0 2023-12-07T21:09:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.866+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.866+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83aad0 con 0x55820e8214c0 2023-12-07T21:09:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.868+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.868+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e838260 con 0x55820e74f840 2023-12-07T21:09:12.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.869+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'31 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.869+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e8214c0 2023-12-07T21:09:12.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.870+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.870+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e81b3a0 2023-12-07T21:09:12.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.872+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.872+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e81b3a0 2023-12-07T21:09:12.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.873+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'44 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.873+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e8214c0 2023-12-07T21:09:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.875+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.875+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e74f840 2023-12-07T21:09:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.876+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.876+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e8214c0 2023-12-07T21:09:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.878+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.878+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e8214c0 2023-12-07T21:09:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.879+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.879+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e8214c0 2023-12-07T21:09:12.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.879+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.879+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e8214c0 2023-12-07T21:09:12.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.880+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'20 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.880+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x7ff91405b370 2023-12-07T21:09:12.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.882+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.882+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e8214c0 2023-12-07T21:09:12.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.883+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.883+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x7ff91405b370 2023-12-07T21:09:12.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.884+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'20 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.884+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e8214c0 2023-12-07T21:09:12.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.885+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'25 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.885+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x7ff91405b370 2023-12-07T21:09:12.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.886+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'26 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.886+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e83af70 con 0x55820e74f840 2023-12-07T21:09:12.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.887+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.887+0000 7ff8e57e2640 20 reqs_thread_entry: start 2023-12-07T21:09:12.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.887+0000 7ff9222bc800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:12.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.887+0000 7ff9222bc800 20 Filter name: none 2023-12-07T21:09:12.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.887+0000 7ff8de7fc640 20 reqs_thread_entry: start 2023-12-07T21:09:12.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.887+0000 7ff9222bc800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:12.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.887+0000 7ff9222bc800 20 rados->read ofs=0 len=0 2023-12-07T21:09:12.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.887+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e865ee0 con 0x55820e81b3a0 2023-12-07T21:09:12.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.888+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.888+0000 7ff9222bc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:12.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.888+0000 7ff9222bc800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2023-12-07T21:09:12.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.888+0000 7ff9222bc800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:12.881 INFO:teuthology.orchestra.run.smithi121.stderr:could not remove user: unable to remove user, user does not exist 2023-12-07T21:09:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.888+0000 7ff8e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.888+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94017077555616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e835e30 con 0x55820e81b3a0 2023-12-07T21:09:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.889+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94017077555616] v31'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.889+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94017075109712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e835e30 con 0x55820e74f840 2023-12-07T21:09:12.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.890+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94017075109712] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.890+0000 7ff9222bc800 20 remove_watcher() i=0 2023-12-07T21:09:12.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.890+0000 7ff9222bc800 2 removed watcher, disabling cache 2023-12-07T21:09:12.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.890+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94017077531664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e835e30 con 0x55820e81b3a0 2023-12-07T21:09:12.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.892+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94017077531664] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.892+0000 7ff9222bc800 20 remove_watcher() i=1 2023-12-07T21:09:12.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.892+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94017077539728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e835e30 con 0x55820e8214c0 2023-12-07T21:09:12.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.893+0000 7ff91fdbc640 1 -- 172.21.15.121:0/1988564365 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94017077539728] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff91004d040 con 0x55820e8214c0 2023-12-07T21:09:12.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.893+0000 7ff9222bc800 20 remove_watcher() i=2 2023-12-07T21:09:12.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.893+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94017077544432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e835e30 con 0x55820e74f840 2023-12-07T21:09:12.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.894+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94017077544432] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff914071040 con 0x55820e74f840 2023-12-07T21:09:12.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.894+0000 7ff9222bc800 20 remove_watcher() i=3 2023-12-07T21:09:12.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.894+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94017077547104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e835e30 con 0x55820e81b3a0 2023-12-07T21:09:12.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.896+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94017077547104] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x55820e81b3a0 2023-12-07T21:09:12.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.896+0000 7ff9222bc800 20 remove_watcher() i=4 2023-12-07T21:09:12.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.896+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94017077551824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e829060 con 0x7ff91405b370 2023-12-07T21:09:12.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.898+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94017077551824] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.898+0000 7ff9222bc800 20 remove_watcher() i=5 2023-12-07T21:09:12.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.898+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94017077537184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e829060 con 0x7ff91405b370 2023-12-07T21:09:12.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.898+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94017077537184] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.898+0000 7ff9222bc800 20 remove_watcher() i=6 2023-12-07T21:09:12.892 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.899+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94017077553984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55820e829060 con 0x7ff91405b370 2023-12-07T21:09:12.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.899+0000 7ff9205bd640 1 -- 172.21.15.121:0/1988564365 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94017077553984] v31'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff918024070 con 0x7ff91405b370 2023-12-07T21:09:12.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.899+0000 7ff9222bc800 20 remove_watcher() i=7 2023-12-07T21:09:12.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7ff91405b370 msgr2=0x7ff91405b790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7ff91405b370 0x7ff91405b790 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55820e81b3a0 msgr2=0x55820e81d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55820e81b3a0 0x55820e81d860 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x55820e74f840 msgr2=0x7ff910010560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x55820e74f840 0x7ff910010560 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55820e8214c0 msgr2=0x55820e823950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55820e8214c0 0x55820e823950 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8f80360c0 msgr2=0x7ff8f8038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8f80360c0 0x7ff8f8038580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff914054000 tx=0x7ff91404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 msgr2=0x55820e80fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 --2- 172.21.15.121:0/1988564365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e74ea80 0x55820e80fc20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff918010000 tx=0x7ff918002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 reap_dead start 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff91f5bb640 1 -- 172.21.15.121:0/1988564365 reap_dead start 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 shutdown_connections 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 >> 172.21.15.121:0/1988564365 conn(0x55820e8019f0 msgr2=0x55820e8028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 shutdown_connections 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/1988564365 wait complete. 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/604182298 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff90c036110 msgr2=0x7ff90c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 --2- 172.21.15.121:0/604182298 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff90c036110 0x7ff90c0385d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff91001df70 tx=0x7ff91001df00 comp rx=0 tx=0).stop 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/604182298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e7527d0 msgr2=0x55820e7fa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 --2- 172.21.15.121:0/604182298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e7527d0 0x55820e7fa410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55820e7ef380 tx=0x7ff910001250 comp rx=0 tx=0).stop 2023-12-07T21:09:12.895 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/604182298 shutdown_connections 2023-12-07T21:09:12.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 --2- 172.21.15.121:0/604182298 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff90c036110 0x7ff90c0385d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 --2- 172.21.15.121:0/604182298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55820e7527d0 0x55820e7fa410 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/604182298 >> 172.21.15.121:0/604182298 conn(0x55820e747f60 msgr2=0x55820e7f19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/604182298 shutdown_connections 2023-12-07T21:09:12.896 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.900+0000 7ff9222bc800 1 -- 172.21.15.121:0/604182298 wait complete. 2023-12-07T21:09:12.896 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-12-07T21:09:12.897 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-12-07T21:09:12.897 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-12-07T21:09:12.897 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2023-12-07T21:09:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:12.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.989+0000 7f3e7cb20800 1 Processor -- start 2023-12-07T21:09:12.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.989+0000 7f3e7cb20800 1 -- start start 2023-12-07T21:09:12.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.989+0000 7f3e7cb20800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x564cd0e8f270 0x564cd0e8f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.989+0000 7f3e7cb20800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564cd0ddb740 con 0x564cd0e90430 2023-12-07T21:09:12.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.989+0000 7f3e7cb20800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x564cd0da4880 con 0x564cd0e8f270 2023-12-07T21:09:12.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.989+0000 7f3e7887e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x564cd0e8f270 0x564cd0e8f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.989+0000 7f3e7887e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x564cd0e8f270 0x564cd0e8f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:52996/0 (socket says 172.21.15.121:52996) 2023-12-07T21:09:12.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.989+0000 7f3e73fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x564cd0e90430 0x564cd0e908b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37664/0 (socket says 172.21.15.121:37664) 2023-12-07T21:09:12.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.989+0000 7f3e7887e640 1 -- 172.21.15.121:0/4203616346 learned_addr learned my addr 172.21.15.121:0/4203616346 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.989+0000 7f3e7887e640 1 -- 172.21.15.121:0/4203616346 >> v1:172.21.15.89:6789/0 conn(0x564cd0e90430 legacy=0x564cd0e908b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.989+0000 7f3e7887e640 1 -- 172.21.15.121:0/4203616346 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cd0e8fd60 con 0x564cd0e8f270 2023-12-07T21:09:12.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.991+0000 7f3e7887e640 1 --2- 172.21.15.121:0/4203616346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e8f270 0x564cd0e8f690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00a520 tx=0x7f3e6c01cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cbf04a9ceae547 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.991+0000 7f3e737fe640 1 -- 172.21.15.121:0/4203616346 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c04ad50 con 0x564cd0e8f270 2023-12-07T21:09:12.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.991+0000 7f3e737fe640 1 -- 172.21.15.121:0/4203616346 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c052440 con 0x564cd0e8f270 2023-12-07T21:09:12.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.992+0000 7f3e737fe640 1 -- 172.21.15.121:0/4203616346 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c052700 con 0x564cd0e8f270 2023-12-07T21:09:12.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.992+0000 7f3e7cb20800 1 -- 172.21.15.121:0/4203616346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e8f270 msgr2=0x564cd0e8f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.992+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/4203616346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e8f270 0x564cd0e8f690 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00a520 tx=0x7f3e6c01cd10 comp rx=0 tx=0).stop 2023-12-07T21:09:12.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.992+0000 7f3e7cb20800 1 -- 172.21.15.121:0/4203616346 shutdown_connections 2023-12-07T21:09:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.992+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/4203616346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e8f270 0x564cd0e8f690 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.992+0000 7f3e7cb20800 1 -- 172.21.15.121:0/4203616346 >> 172.21.15.121:0/4203616346 conn(0x564cd0e8a9b0 msgr2=0x564cd0e8cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.992+0000 7f3e7cb20800 1 -- 172.21.15.121:0/4203616346 shutdown_connections 2023-12-07T21:09:12.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.992+0000 7f3e7cb20800 1 -- 172.21.15.121:0/4203616346 wait complete. 2023-12-07T21:09:12.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.993+0000 7f3e7cb20800 1 Processor -- start 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.993+0000 7f3e7cb20800 1 -- start start 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.993+0000 7f3e7cb20800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f34460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.993+0000 7f3e7cb20800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cd0da1db0 con 0x564cd0e90430 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.993+0000 7f3e7887e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f34460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.993+0000 7f3e7887e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f34460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53008/0 (socket says 172.21.15.121:53008) 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.993+0000 7f3e7887e640 1 -- 172.21.15.121:0/2578602950 learned_addr learned my addr 172.21.15.121:0/2578602950 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.993+0000 7f3e7887e640 1 -- 172.21.15.121:0/2578602950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c005de0 con 0x564cd0e90430 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.993+0000 7f3e7887e640 1 --2- 172.21.15.121:0/2578602950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f34460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c055040 tx=0x7f3e6c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6618eb1043a8a05 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e72ffd640 1 -- 172.21.15.121:0/2578602950 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c052760 con 0x564cd0e90430 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e72ffd640 1 -- 172.21.15.121:0/2578602950 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c0528c0 con 0x564cd0e90430 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e72ffd640 1 -- 172.21.15.121:0/2578602950 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c052b80 con 0x564cd0e90430 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e7cb20800 1 -- 172.21.15.121:0/2578602950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 msgr2=0x564cd0f34460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/2578602950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f34460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c055040 tx=0x7f3e6c04c000 comp rx=0 tx=0).stop 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e7cb20800 1 -- 172.21.15.121:0/2578602950 shutdown_connections 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/2578602950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f34460 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e7cb20800 1 -- 172.21.15.121:0/2578602950 >> 172.21.15.121:0/2578602950 conn(0x564cd0e8a9b0 msgr2=0x564cd0f30030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e7cb20800 1 -- 172.21.15.121:0/2578602950 shutdown_connections 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e7cb20800 1 -- 172.21.15.121:0/2578602950 wait complete. 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e7cb20800 1 Processor -- start 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e7cb20800 1 -- start start 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e7cb20800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f3b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.994+0000 7f3e7cb20800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cd0d9d6a0 con 0x564cd0e90430 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.995+0000 7f3e7887e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f3b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.995+0000 7f3e7887e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f3b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53014/0 (socket says 172.21.15.121:53014) 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.995+0000 7f3e7887e640 1 -- 172.21.15.121:0/1103233918 learned_addr learned my addr 172.21.15.121:0/1103233918 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.995+0000 7f3e7887e640 1 -- 172.21.15.121:0/1103233918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c04e070 con 0x564cd0e90430 2023-12-07T21:09:12.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.995+0000 7f3e7887e640 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f3b8c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0446c0 tx=0x7f3e6c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.995+0000 7f3e71ffb640 1 -- 172.21.15.121:0/1103233918 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c06c420 con 0x564cd0e90430 2023-12-07T21:09:12.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.995+0000 7f3e71ffb640 1 -- 172.21.15.121:0/1103233918 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c06c580 con 0x564cd0e90430 2023-12-07T21:09:12.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.995+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564cd0f3be00 con 0x564cd0e90430 2023-12-07T21:09:12.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.995+0000 7f3e71ffb640 1 -- 172.21.15.121:0/1103233918 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e6c06c840 con 0x564cd0e90430 2023-12-07T21:09:12.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.995+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564cd0f3c280 con 0x564cd0e90430 2023-12-07T21:09:12.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.996+0000 7f3e7cb20800 1 Processor -- start 2023-12-07T21:09:12.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.996+0000 7f3e7cb20800 1 -- start start 2023-12-07T21:09:12.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.996+0000 7f3e7cb20800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f48660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.996+0000 7f3e7cb20800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cd0d37890 con 0x564cd0f48240 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.996+0000 7f3e71ffb640 1 -- 172.21.15.121:0/1103233918 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3e6c06c9a0 con 0x564cd0e90430 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.996+0000 7f3e7907f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f48660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.996+0000 7f3e71ffb640 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e5c036110 0x7f3e5c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.997+0000 7f3e7907f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f48660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53020/0 (socket says 172.21.15.121:53020) 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.997+0000 7f3e7907f640 1 -- 172.21.15.121:0/825903443 learned_addr learned my addr 172.21.15.121:0/825903443 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.997+0000 7f3e71ffb640 1 -- 172.21.15.121:0/1103233918 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f3e6c000e40 con 0x564cd0e90430 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.997+0000 7f3e7887e640 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e5c036110 0x7f3e5c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.997+0000 7f3e7907f640 1 -- 172.21.15.121:0/825903443 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cd0f48ba0 con 0x564cd0f48240 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.997+0000 7f3e7887e640 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e5c036110 0x7f3e5c0385d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c06e040 tx=0x7f3e6c052f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.997+0000 7f3e7907f640 1 --2- 172.21.15.121:0/825903443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f48660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400a430 tx=0x7f3e7400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fb06c9a70966d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.997+0000 7f3e637fe640 1 -- 172.21.15.121:0/825903443 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e74001650 con 0x564cd0f48240 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.997+0000 7f3e637fe640 1 -- 172.21.15.121:0/825903443 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e740017d0 con 0x564cd0f48240 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.997+0000 7f3e637fe640 1 -- 172.21.15.121:0/825903443 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e74001ab0 con 0x564cd0f48240 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7cb20800 1 -- 172.21.15.121:0/825903443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 msgr2=0x564cd0f48660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:12.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/825903443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f48660 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400a430 tx=0x7f3e7400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7cb20800 1 -- 172.21.15.121:0/825903443 shutdown_connections 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/825903443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f48660 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7cb20800 1 -- 172.21.15.121:0/825903443 >> 172.21.15.121:0/825903443 conn(0x564cd0f42e80 msgr2=0x564cd0f43d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7cb20800 1 -- 172.21.15.121:0/825903443 shutdown_connections 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7cb20800 1 -- 172.21.15.121:0/825903443 wait complete. 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7cb20800 1 Processor -- start 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7cb20800 1 -- start start 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7cb20800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f4edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7cb20800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cd0d37530 con 0x564cd0f48240 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7907f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f4edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7907f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f4edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53022/0 (socket says 172.21.15.121:53022) 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7907f640 1 -- 172.21.15.121:0/1275495852 learned_addr learned my addr 172.21.15.121:0/1275495852 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.998+0000 7f3e7907f640 1 -- 172.21.15.121:0/1275495852 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7400a0e0 con 0x564cd0f48240 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.999+0000 7f3e7907f640 1 --2- 172.21.15.121:0/1275495852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f4edd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400a930 tx=0x7f3e74003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.999+0000 7f3e61ffb640 1 -- 172.21.15.121:0/1275495852 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e74010900 con 0x564cd0f48240 2023-12-07T21:09:12.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.999+0000 7f3e61ffb640 1 -- 172.21.15.121:0/1275495852 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e74010a60 con 0x564cd0f48240 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.999+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1275495852 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564cd0f4f310 con 0x564cd0f48240 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.999+0000 7f3e61ffb640 1 -- 172.21.15.121:0/1275495852 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e74010d20 con 0x564cd0f48240 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:12.999+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1275495852 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564cd0f4f770 con 0x564cd0f48240 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.000+0000 7f3e61ffb640 1 -- 172.21.15.121:0/1275495852 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3e74017030 con 0x564cd0f48240 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.000+0000 7f3e61ffb640 1 --2- 172.21.15.121:0/1275495852 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e50036110 0x7f3e500385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.000+0000 7f3e7cb20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.000+0000 7f3e7cb20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.000+0000 7f3e61ffb640 1 -- 172.21.15.121:0/1275495852 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f3e7404b7a0 con 0x564cd0f48240 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.000+0000 7f3e73fff640 1 --2- 172.21.15.121:0/1275495852 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e50036110 0x7f3e500385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.000+0000 7f3e3e7e4640 20 reqs_thread_entry: start 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.000+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564cd0f647f0 0x564cd0f66be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.000+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564cd0f67120 con 0x564cd0f647f0 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.000+0000 7f3e73fff640 1 --2- 172.21.15.121:0/1275495852 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e50036110 0x7f3e500385d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x564cd0f43ae0 tx=0x7f3e640014a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.000+0000 7f3e7907f640 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564cd0f647f0 0x564cd0f66be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:12.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.001+0000 7f3e7907f640 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564cd0f647f0 0x564cd0f66be0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:12.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.001+0000 7f3e7907f640 1 -- 172.21.15.121:0/1103233918 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3e7402e9d0 con 0x564cd0f647f0 2023-12-07T21:09:12.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.001+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564cd0f68490 con 0x564cd0f647f0 2023-12-07T21:09:12.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.001+0000 7f3e7907f640 1 -- 172.21.15.121:0/1103233918 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f3e7402e9d0 con 0x564cd0f647f0 2023-12-07T21:09:12.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.001+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564cd0f6cd10 con 0x564cd0f647f0 2023-12-07T21:09:12.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.002+0000 7f3e7907f640 1 -- 172.21.15.121:0/1103233918 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [stat,call,call,writefull 0~874] v31'3 uv3 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f3e7402e9d0 con 0x564cd0f647f0 2023-12-07T21:09:13.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1275495852 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e50036110 msgr2=0x7f3e500385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/1275495852 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e50036110 0x7f3e500385d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x564cd0f43ae0 tx=0x7f3e640014a0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1275495852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 msgr2=0x564cd0f4edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/1275495852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f4edd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400a930 tx=0x7f3e74003370 comp rx=0 tx=0).stop 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1275495852 shutdown_connections 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/1275495852 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e50036110 0x7f3e500385d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/1275495852 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0f48240 0x564cd0f4edd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1275495852 >> 172.21.15.121:0/1275495852 conn(0x564cd0f42e80 msgr2=0x564cd0f43d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1275495852 shutdown_connections 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1275495852 wait complete. 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564cd0f647f0 msgr2=0x564cd0f66be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564cd0f647f0 0x564cd0f66be0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e5c036110 msgr2=0x7f3e5c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e5c036110 0x7f3e5c0385d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c06e040 tx=0x7f3e6c052f90 comp rx=0 tx=0).stop 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 msgr2=0x564cd0f3b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f3b8c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0446c0 tx=0x7f3e6c002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 shutdown_connections 2023-12-07T21:09:13.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3e5c036110 0x7f3e5c0385d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564cd0f647f0 0x564cd0f66be0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 --2- 172.21.15.121:0/1103233918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564cd0e90430 0x564cd0f3b8c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.003+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 >> 172.21.15.121:0/1103233918 conn(0x564cd0e8a9b0 msgr2=0x564cd0f33170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.004+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 shutdown_connections 2023-12-07T21:09:13.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.004+0000 7f3e7cb20800 1 -- 172.21.15.121:0/1103233918 wait complete. 2023-12-07T21:09:13.003 INFO:teuthology.orchestra.run.smithi121.stdout:{"id":"ef4a9585-c98e-4264-8c5b-7c4065599143","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-07T21:09:13.005 DEBUG:tasks.util.rgw: json result: {'id': 'ef4a9585-c98e-4264-8c5b-7c4065599143', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-07T21:09:13.007 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2023-12-07T21:09:13.007 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2023-12-07T21:09:13.007 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2023-12-07T21:09:13.047 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:13.047 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.055+0000 7f1d1efaf800 1 Processor -- start 2023-12-07T21:09:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.055+0000 7f1d1efaf800 1 -- start start 2023-12-07T21:09:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.055+0000 7f1d1efaf800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55dcadf53b40 0x55dcadfe41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.055+0000 7f1d1efaf800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dcadf2b790 con 0x55dcadfe4730 2023-12-07T21:09:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.055+0000 7f1d1efaf800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dcadef4880 con 0x55dcadf53b40 2023-12-07T21:09:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.055+0000 7f1d1caaf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55dcadf53b40 0x55dcadfe41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.055+0000 7f1d17fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55dcadfe4730 0x55dcadfe6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37676/0 (socket says 172.21.15.121:37676) 2023-12-07T21:09:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.055+0000 7f1d17fff640 1 -- 172.21.15.121:0/2924641634 learned_addr learned my addr 172.21.15.121:0/2924641634 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.056+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2924641634 >> v1:172.21.15.89:6789/0 conn(0x55dcadfe4730 legacy=0x55dcadfe6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.056+0000 7f1d177fe640 1 -- 172.21.15.121:0/2924641634 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631343253 0 0) 0x55dcadf2b790 con 0x55dcadfe4730 2023-12-07T21:09:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.056+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2924641634 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcadfe9250 con 0x55dcadf53b40 2023-12-07T21:09:13.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.057+0000 7f1d1caaf640 1 --2- 172.21.15.121:0/2924641634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcadfe41f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000a470 tx=0x7f1d1001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c2f59b9c09e44b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.057+0000 7f1d177fe640 1 -- 172.21.15.121:0/2924641634 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d10052570 con 0x55dcadf53b40 2023-12-07T21:09:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.058+0000 7f1d177fe640 1 -- 172.21.15.121:0/2924641634 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d100526d0 con 0x55dcadf53b40 2023-12-07T21:09:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.058+0000 7f1d177fe640 1 -- 172.21.15.121:0/2924641634 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d10052990 con 0x55dcadf53b40 2023-12-07T21:09:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.058+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2924641634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 msgr2=0x55dcadfe41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.058+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/2924641634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcadfe41f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000a470 tx=0x7f1d1001cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.058+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2924641634 shutdown_connections 2023-12-07T21:09:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.058+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/2924641634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcadfe41f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.058+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2924641634 >> 172.21.15.121:0/2924641634 conn(0x55dcadfd9870 msgr2=0x55dcadfdbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.058+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2924641634 shutdown_connections 2023-12-07T21:09:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.058+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2924641634 wait complete. 2023-12-07T21:09:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.059+0000 7f1d1efaf800 1 Processor -- start 2023-12-07T21:09:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.059+0000 7f1d1efaf800 1 -- start start 2023-12-07T21:09:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.059+0000 7f1d1efaf800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae085e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.059+0000 7f1d1efaf800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcadef1db0 con 0x55dcadf53b40 2023-12-07T21:09:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.059+0000 7f1d1caaf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae085e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.059+0000 7f1d1caaf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae085e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53034/0 (socket says 172.21.15.121:53034) 2023-12-07T21:09:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.059+0000 7f1d1caaf640 1 -- 172.21.15.121:0/1781334717 learned_addr learned my addr 172.21.15.121:0/1781334717 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.059+0000 7f1d1caaf640 1 -- 172.21.15.121:0/1781334717 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10005d20 con 0x55dcadf53b40 2023-12-07T21:09:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.060+0000 7f1d1caaf640 1 --2- 172.21.15.121:0/1781334717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae085e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d10055040 tx=0x7f1d1004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ca455eaffa2d66 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.060+0000 7f1d16ffd640 1 -- 172.21.15.121:0/1781334717 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d1000a180 con 0x55dcadf53b40 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.060+0000 7f1d16ffd640 1 -- 172.21.15.121:0/1781334717 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000a2e0 con 0x55dcadf53b40 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.060+0000 7f1d16ffd640 1 -- 172.21.15.121:0/1781334717 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d100529b0 con 0x55dcadf53b40 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.060+0000 7f1d1efaf800 1 -- 172.21.15.121:0/1781334717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 msgr2=0x55dcae085e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.060+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/1781334717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae085e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1d10055040 tx=0x7f1d1004c000 comp rx=0 tx=0).stop 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.060+0000 7f1d1efaf800 1 -- 172.21.15.121:0/1781334717 shutdown_connections 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.060+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/1781334717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae085e50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.060+0000 7f1d1efaf800 1 -- 172.21.15.121:0/1781334717 >> 172.21.15.121:0/1781334717 conn(0x55dcadfd9870 msgr2=0x55dcae081ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.060+0000 7f1d1efaf800 1 -- 172.21.15.121:0/1781334717 shutdown_connections 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.060+0000 7f1d1efaf800 1 -- 172.21.15.121:0/1781334717 wait complete. 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.061+0000 7f1d1efaf800 1 Processor -- start 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.061+0000 7f1d1efaf800 1 -- start start 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.061+0000 7f1d1efaf800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae08d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.061+0000 7f1d1efaf800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcadeed6a0 con 0x55dcadf53b40 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.061+0000 7f1d1caaf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae08d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.061+0000 7f1d1caaf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae08d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53038/0 (socket says 172.21.15.121:53038) 2023-12-07T21:09:13.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.061+0000 7f1d1caaf640 1 -- 172.21.15.121:0/3486948548 learned_addr learned my addr 172.21.15.121:0/3486948548 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.061+0000 7f1d1caaf640 1 -- 172.21.15.121:0/3486948548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcadfe9250 con 0x55dcadf53b40 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.061+0000 7f1d1caaf640 1 --2- 172.21.15.121:0/3486948548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae08d280 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000a470 tx=0x7f1d10002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.061+0000 7f1d15ffb640 1 -- 172.21.15.121:0/3486948548 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d1006a070 con 0x55dcadf53b40 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.062+0000 7f1d15ffb640 1 -- 172.21.15.121:0/3486948548 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1006f550 con 0x55dcadf53b40 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.062+0000 7f1d1efaf800 1 -- 172.21.15.121:0/3486948548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcae08d7c0 con 0x55dcadf53b40 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.062+0000 7f1d15ffb640 1 -- 172.21.15.121:0/3486948548 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d1006f810 con 0x55dcadf53b40 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.062+0000 7f1d1efaf800 1 -- 172.21.15.121:0/3486948548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcae08dd00 con 0x55dcadf53b40 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.062+0000 7f1d1efaf800 1 Processor -- start 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.062+0000 7f1d1efaf800 1 -- start start 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.062+0000 7f1d15ffb640 1 -- 172.21.15.121:0/3486948548 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f1d10059030 con 0x55dcadf53b40 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.062+0000 7f1d1efaf800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 0x55dcae0998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.062+0000 7f1d1efaf800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcade87890 con 0x55dcae099490 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.062+0000 7f1d15ffb640 1 --2- 172.21.15.121:0/3486948548 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1d00036110 0x7f1d000385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.063+0000 7f1d15ffb640 1 -- 172.21.15.121:0/3486948548 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f1d1008d1d0 con 0x55dcadf53b40 2023-12-07T21:09:13.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.063+0000 7f1d1caaf640 1 --2- 172.21.15.121:0/3486948548 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1d00036110 0x7f1d000385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.063+0000 7f1d1d2b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 0x55dcae0998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.063+0000 7f1d1d2b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 0x55dcae0998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53046/0 (socket says 172.21.15.121:53046) 2023-12-07T21:09:13.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.063+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/1717570375 learned_addr learned my addr 172.21.15.121:0/1717570375 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.063+0000 7f1d1caaf640 1 --2- 172.21.15.121:0/3486948548 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1d00036110 0x7f1d000385d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1d10052bb0 tx=0x7f1d10052f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.063+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/1717570375 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcae099df0 con 0x55dcae099490 2023-12-07T21:09:13.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.063+0000 7f1d1d2b0640 1 --2- 172.21.15.121:0/1717570375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 0x55dcae0998b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800a430 tx=0x7f1d1800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e6d5128bc4d285 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.063+0000 7f1d077fe640 1 -- 172.21.15.121:0/1717570375 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d18001650 con 0x55dcae099490 2023-12-07T21:09:13.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.063+0000 7f1d077fe640 1 -- 172.21.15.121:0/1717570375 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d180017d0 con 0x55dcae099490 2023-12-07T21:09:13.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.063+0000 7f1d077fe640 1 -- 172.21.15.121:0/1717570375 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d18001ab0 con 0x55dcae099490 2023-12-07T21:09:13.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1efaf800 1 -- 172.21.15.121:0/1717570375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 msgr2=0x55dcae0998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/1717570375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 0x55dcae0998b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800a430 tx=0x7f1d1800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1efaf800 1 -- 172.21.15.121:0/1717570375 shutdown_connections 2023-12-07T21:09:13.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/1717570375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 0x55dcae0998b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1efaf800 1 -- 172.21.15.121:0/1717570375 >> 172.21.15.121:0/1717570375 conn(0x55dcadfe4730 msgr2=0x55dcae094870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1efaf800 1 -- 172.21.15.121:0/1717570375 shutdown_connections 2023-12-07T21:09:13.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1efaf800 1 -- 172.21.15.121:0/1717570375 wait complete. 2023-12-07T21:09:13.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1efaf800 1 Processor -- start 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1efaf800 1 -- start start 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1efaf800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 0x55dcae0a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1efaf800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcade87530 con 0x55dcae099490 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1d2b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 0x55dcae0a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1d2b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 0x55dcae0a0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53050/0 (socket says 172.21.15.121:53050) 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.064+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 learned_addr learned my addr 172.21.15.121:0/2803071304 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.065+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1800a0e0 con 0x55dcae099490 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.065+0000 7f1d1d2b0640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 0x55dcae0a0550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800a930 tx=0x7f1d18003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.065+0000 7f1d05ffb640 1 -- 172.21.15.121:0/2803071304 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d18010900 con 0x55dcae099490 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.065+0000 7f1d05ffb640 1 -- 172.21.15.121:0/2803071304 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d18010a60 con 0x55dcae099490 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.065+0000 7f1d05ffb640 1 -- 172.21.15.121:0/2803071304 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d18010d20 con 0x55dcae099490 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.065+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcae0a0a90 con 0x55dcae099490 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.065+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcae0a0ef0 con 0x55dcae099490 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.066+0000 7f1d05ffb640 1 -- 172.21.15.121:0/2803071304 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f1d18017030 con 0x55dcae099490 2023-12-07T21:09:13.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.066+0000 7f1d1efaf800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.066+0000 7f1d05ffb640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1cf4036110 0x7f1cf40385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.066+0000 7f1d05ffb640 1 -- 172.21.15.121:0/2803071304 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f1d1804b7d0 con 0x55dcae099490 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.066+0000 7f1d17fff640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1cf4036110 0x7f1cf40385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.066+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55dcae0abc00 0x55dcae0ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.066+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0ae810 con 0x55dcae0abc00 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.066+0000 7f1d1d2b0640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55dcae0abc00 0x55dcae0ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.066+0000 7f1d17fff640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1cf4036110 0x7f1cf40385d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d08000c00 tx=0x7f1d08001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1d2b0640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55dcae0abc00 0x55dcae0ae0c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 20 realm 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0aebe0 con 0x55dcae0abc00 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0af460 con 0x55dcae0abc00 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0af7c0 con 0x55dcae0abc00 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.067+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0af100 con 0x55dcae0abc00 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.068+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.068+0000 7f1d1efaf800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.068+0000 7f1d1efaf800 20 searching for the correct realm 2023-12-07T21:09:13.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.068+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55dcae0b1a10 0x55dcae0b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.068+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0b1a10 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.068+0000 7f1d1caaf640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55dcae0b1a10 0x55dcae0b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.068+0000 7f1d1caaf640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55dcae0b1a10 0x55dcae0b3e00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.068+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.068+0000 7f1d1caaf640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f1d100643f0 0x7f1d1006f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.068+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d100643f0 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.069+0000 7f1d17fff640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f1d100643f0 0x7f1d1006f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.069+0000 7f1d17fff640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f1d100643f0 0x7f1d1006f970 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.069+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.069+0000 7f1d17fff640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f1d0800e8a0 0x7f1d0800d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.069+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d0800e8a0 2023-12-07T21:09:13.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.069+0000 7f1d1d2b0640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f1d0800e8a0 0x7f1d0800d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.070+0000 7f1d1d2b0640 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f1d0800e8a0 0x7f1d0800d2f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.070+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.070+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0abc00 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.070+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.070+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0abc00 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.070+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.070+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d0800e8a0 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.070+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.070+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d0800e8a0 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.071+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.071+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d100643f0 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.071+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.071+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0b1a10 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.071+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.071+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0abc00 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.071+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.071+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d0800e8a0 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.072+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.072+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0abc00 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.072+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.072+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d100643f0 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.072+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.072+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0b1a10 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.072+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.072+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0b1a10 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.073+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.073+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d0800e8a0 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.073+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.073+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0b1a10 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.073+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.073+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0b1a10 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.073+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.073+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0abc00 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.074+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.074+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0abc00 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.074+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.074+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d0800e8a0 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.074+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.074+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0b1a10 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.074+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.074+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d100643f0 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.075+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.075+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0abc00 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.075+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.075+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d0800e8a0 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.075+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.075+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0b1a10 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.075+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.075+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d0800e8a0 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.075+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.076+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d100643f0 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.076+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.076+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0b1a10 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.076+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.076+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x7f1d0800e8a0 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.076+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.076+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4340 con 0x55dcae0abc00 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1d18053080 con 0x7f1d100643f0 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b0690 con 0x55dcae0abc00 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b0310 con 0x55dcae0abc00 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.077+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b0f60 con 0x55dcae0b1a10 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 20 zone default found 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 4 Realm: () 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 20 zonegroup default 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b4780 con 0x7f1d0800e8a0 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b6510 con 0x55dcae0b1a10 2023-12-07T21:09:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b68c0 con 0x55dcae0b1a10 2023-12-07T21:09:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.078+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.079+0000 7f1d1efaf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.079+0000 7f1d1efaf800 20 started sync module instance, tier type = 2023-12-07T21:09:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.079+0000 7f1d1efaf800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.079+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b5df0 con 0x7f1d100643f0 2023-12-07T21:09:13.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.079+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.080+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94406298726224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b61a0 con 0x7f1d100643f0 2023-12-07T21:09:13.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.080+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b7130 con 0x55dcae0abc00 2023-12-07T21:09:13.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.080+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94406298726224] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.081+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.081+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94406301145424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b7170 con 0x55dcae0abc00 2023-12-07T21:09:13.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.081+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b7c10 con 0x55dcae0b1a10 2023-12-07T21:09:13.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.083+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.083+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94406301145424] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.083+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94406301153008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b8460 con 0x55dcae0b1a10 2023-12-07T21:09:13.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.083+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b6c90 con 0x7f1d100643f0 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.086+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94406301153008] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.086+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.086+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94406301155264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b8ea0 con 0x7f1d100643f0 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.086+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0b9950 con 0x55dcae0abc00 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.089+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.089+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94406301160528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0ba1d0 con 0x55dcae0abc00 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.089+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0bab80 con 0x7f1d0800e8a0 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.090+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.090+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94406301165216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0baab0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.090+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0bb9e0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.091+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94406301165216] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.091+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94406301155264] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.092+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94406301160528] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.092+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.092+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94406301157728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0baf30 con 0x7f1d0800e8a0 2023-12-07T21:09:13.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.092+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0bb9e0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.093+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94406301157728] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.094+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.094+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94406301162800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0bb9e0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.094+0000 7f1d1efaf800 20 add_watcher() i=0 2023-12-07T21:09:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.094+0000 7f1d1efaf800 20 add_watcher() i=1 2023-12-07T21:09:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.094+0000 7f1d1efaf800 20 add_watcher() i=2 2023-12-07T21:09:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.094+0000 7f1d1efaf800 20 add_watcher() i=3 2023-12-07T21:09:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.094+0000 7f1d1efaf800 20 add_watcher() i=4 2023-12-07T21:09:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.094+0000 7f1d1efaf800 20 add_watcher() i=5 2023-12-07T21:09:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.094+0000 7f1d1efaf800 20 add_watcher() i=6 2023-12-07T21:09:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.095+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94406301162800] v31'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.095+0000 7f1d1efaf800 20 add_watcher() i=7 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.095+0000 7f1d1efaf800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.095+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0bec50 con 0x55dcae0abc00 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.095+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.095+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94406301169328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0bbf60 con 0x55dcae0abc00 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.096+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94406301169328] v31'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.096+0000 7f1ce2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.096+0000 7f1d1efaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.096+0000 7f1d1efaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.096+0000 7f1d1efaf800 5 note: GC not initialized 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.096+0000 7f1ce1fdb640 20 reqs_thread_entry: start 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.097+0000 7f1d1efaf800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.097+0000 7f1d1efaf800 20 Filter name: none 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.097+0000 7f1c537fe640 20 reqs_thread_entry: start 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.097+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2340 con 0x55dcae0abc00 2023-12-07T21:09:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.097+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.097+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2340 con 0x7f1d100643f0 2023-12-07T21:09:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.097+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.097+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2780 con 0x55dcae0abc00 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.097+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.098+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2780 con 0x55dcae0b1a10 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.098+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.098+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2b80 con 0x55dcae0b1a10 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.098+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.098+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2f30 con 0x55dcae0b1a10 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.098+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.098+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2f30 con 0x55dcae0abc00 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.098+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.098+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2f30 con 0x55dcae0abc00 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.098+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.099+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2f30 con 0x55dcae0b1a10 2023-12-07T21:09:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.099+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.099+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2ee0 con 0x55dcae0b1a10 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.099+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.099+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2ee0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.099+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.099+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2ee0 con 0x55dcae0abc00 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.100+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.100+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f2ee0 con 0x7f1d100643f0 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.100+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.100+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f33c0 con 0x55dcae0b1a10 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.100+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.100+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f33c0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.100+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.100+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3370 con 0x7f1d0800e8a0 2023-12-07T21:09:13.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.101+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.101+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3370 con 0x55dcae0b1a10 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.101+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.101+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3370 con 0x7f1d0800e8a0 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.101+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.101+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3370 con 0x55dcae0abc00 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.101+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.101+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3370 con 0x55dcae0b1a10 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.101+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.101+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3370 con 0x7f1d0800e8a0 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.102+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.102+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3370 con 0x7f1d100643f0 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.102+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.102+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x7f1d0800e8a0 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.102+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.102+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x55dcae0abc00 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.103+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.103+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x55dcae0abc00 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.103+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.103+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x55dcae0b1a10 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.103+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.103+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x55dcae0abc00 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.103+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.103+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x55dcae0abc00 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.103+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.103+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x55dcae0b1a10 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.104+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.104+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x55dcae0b1a10 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.104+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.104+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x55dcae0b1a10 2023-12-07T21:09:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.104+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.104+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x7f1d0800e8a0 2023-12-07T21:09:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.105+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.105+0000 7f1ce2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.105+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94406301169328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x55dcae0abc00 2023-12-07T21:09:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.106+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94406301169328] v31'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.106+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94406298726224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x7f1d100643f0 2023-12-07T21:09:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.107+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94406298726224] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.107+0000 7f1d1efaf800 20 remove_watcher() i=0 2023-12-07T21:09:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.107+0000 7f1d1efaf800 2 removed watcher, disabling cache 2023-12-07T21:09:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.107+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94406301145424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x55dcae0abc00 2023-12-07T21:09:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.108+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94406301145424] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.108+0000 7f1d1efaf800 20 remove_watcher() i=1 2023-12-07T21:09:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.108+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94406301153008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x55dcae0b1a10 2023-12-07T21:09:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.109+0000 7f1d1caaf640 1 -- 172.21.15.121:0/2803071304 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94406301153008] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1008b230 con 0x55dcae0b1a10 2023-12-07T21:09:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.109+0000 7f1d1efaf800 20 remove_watcher() i=2 2023-12-07T21:09:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.109+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94406301155264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f3990 con 0x7f1d100643f0 2023-12-07T21:09:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.110+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94406301155264] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d0800f620 con 0x7f1d100643f0 2023-12-07T21:09:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.110+0000 7f1d1efaf800 20 remove_watcher() i=3 2023-12-07T21:09:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.110+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94406301160528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f38f0 con 0x55dcae0abc00 2023-12-07T21:09:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.112+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94406301160528] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x55dcae0abc00 2023-12-07T21:09:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.112+0000 7f1d1efaf800 20 remove_watcher() i=4 2023-12-07T21:09:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.112+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94406301165216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0f38f0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.113+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94406301165216] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.113+0000 7f1d1efaf800 20 remove_watcher() i=5 2023-12-07T21:09:13.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.113+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94406301157728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0ba6a0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.114+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94406301157728] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.114+0000 7f1d1efaf800 20 remove_watcher() i=6 2023-12-07T21:09:13.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.114+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94406301162800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55dcae0ba6a0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1d2b0640 1 -- 172.21.15.121:0/2803071304 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94406301162800] v31'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1d1802e9d0 con 0x7f1d0800e8a0 2023-12-07T21:09:13.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 20 remove_watcher() i=7 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f1d0800e8a0 msgr2=0x7f1d0800d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f1d0800e8a0 0x7f1d0800d2f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55dcae0abc00 msgr2=0x55dcae0ae0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55dcae0abc00 0x55dcae0ae0c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f1d100643f0 msgr2=0x7f1d1006f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f1d100643f0 0x7f1d1006f970 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55dcae0b1a10 msgr2=0x55dcae0b3e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55dcae0b1a10 0x55dcae0b3e00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1cf4036110 msgr2=0x7f1cf40385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1cf4036110 0x7f1cf40385d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d08000c00 tx=0x7f1d08001330 comp rx=0 tx=0).stop 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 msgr2=0x55dcae0a0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/2803071304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcae099490 0x55dcae0a0550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800a930 tx=0x7f1d18003370 comp rx=0 tx=0).stop 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 reap_dead start 2023-12-07T21:09:13.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 shutdown_connections 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d17fff640 1 -- 172.21.15.121:0/2803071304 reap_dead start 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 >> 172.21.15.121:0/2803071304 conn(0x55dcadfe4730 msgr2=0x55dcae093670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 shutdown_connections 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.115+0000 7f1d1efaf800 1 -- 172.21.15.121:0/2803071304 wait complete. 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.116+0000 7f1d1efaf800 1 -- 172.21.15.121:0/3486948548 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1d00036110 msgr2=0x7f1d000385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.116+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/3486948548 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1d00036110 0x7f1d000385d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1d10052bb0 tx=0x7f1d10052f30 comp rx=0 tx=0).stop 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.116+0000 7f1d1efaf800 1 -- 172.21.15.121:0/3486948548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 msgr2=0x55dcae08d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.116+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/3486948548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae08d280 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000a470 tx=0x7f1d10002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.116+0000 7f1d1efaf800 1 -- 172.21.15.121:0/3486948548 shutdown_connections 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.116+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/3486948548 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1d00036110 0x7f1d000385d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.116+0000 7f1d1efaf800 1 --2- 172.21.15.121:0/3486948548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55dcadf53b40 0x55dcae08d280 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.116+0000 7f1d1efaf800 1 -- 172.21.15.121:0/3486948548 >> 172.21.15.121:0/3486948548 conn(0x55dcadfd9870 msgr2=0x55dcae084b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.116+0000 7f1d1efaf800 1 -- 172.21.15.121:0/3486948548 shutdown_connections 2023-12-07T21:09:13.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.116+0000 7f1d1efaf800 1 -- 172.21.15.121:0/3486948548 wait complete. 2023-12-07T21:09:13.112 INFO:teuthology.orchestra.run.smithi121.stdout:{"entries":[],"summary":[]} 2023-12-07T21:09:13.112 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2023-12-07T21:09:13.112 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-12-07T21:09:13.112 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-12-07T21:09:13.113 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-12-07T21:09:13.195 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:13.195 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:13.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.203+0000 7f53d472c800 1 Processor -- start 2023-12-07T21:09:13.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.203+0000 7f53d472c800 1 -- start start 2023-12-07T21:09:13.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.203+0000 7f53d472c800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x563020bd8d30 0x563020bdb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.203+0000 7f53d472c800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563020b227a0 con 0x563020bd48a0 2023-12-07T21:09:13.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.203+0000 7f53d472c800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x563020aeb880 con 0x563020bd8d30 2023-12-07T21:09:13.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.203+0000 7f53cfcf6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x563020bd8d30 0x563020bdb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.203+0000 7f53d04f7640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x563020bd48a0 0x563020bd4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37686/0 (socket says 172.21.15.121:37686) 2023-12-07T21:09:13.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.203+0000 7f53d04f7640 1 -- 172.21.15.121:0/693246898 learned_addr learned my addr 172.21.15.121:0/693246898 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:13.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.204+0000 7f53cfcf6640 1 -- 172.21.15.121:0/693246898 >> v1:172.21.15.89:6789/0 conn(0x563020bd48a0 legacy=0x563020bd4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.204+0000 7f53cf4f5640 1 -- 172.21.15.121:0/693246898 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652093426 0 0) 0x563020b227a0 con 0x563020bd48a0 2023-12-07T21:09:13.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.204+0000 7f53cfcf6640 1 -- 172.21.15.121:0/693246898 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563020b48de0 con 0x563020bd8d30 2023-12-07T21:09:13.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.205+0000 7f53cfcf6640 1 --2- 172.21.15.121:0/693246898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd8d30 0x563020bdb120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f53c400a470 tx=0x7f53c401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6821e703733daf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.206+0000 7f53cf4f5640 1 -- 172.21.15.121:0/693246898 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53c4052570 con 0x563020bd8d30 2023-12-07T21:09:13.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.206+0000 7f53cf4f5640 1 -- 172.21.15.121:0/693246898 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c40526d0 con 0x563020bd8d30 2023-12-07T21:09:13.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.206+0000 7f53cf4f5640 1 -- 172.21.15.121:0/693246898 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53c4052990 con 0x563020bd8d30 2023-12-07T21:09:13.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.206+0000 7f53d472c800 1 -- 172.21.15.121:0/693246898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd8d30 msgr2=0x563020bdb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.206+0000 7f53d472c800 1 --2- 172.21.15.121:0/693246898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd8d30 0x563020bdb120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f53c400a470 tx=0x7f53c401cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.206+0000 7f53d472c800 1 -- 172.21.15.121:0/693246898 shutdown_connections 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.206+0000 7f53d472c800 1 --2- 172.21.15.121:0/693246898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd8d30 0x563020bdb120 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.206+0000 7f53d472c800 1 -- 172.21.15.121:0/693246898 >> 172.21.15.121:0/693246898 conn(0x563020bcff60 msgr2=0x563020bd2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.206+0000 7f53d472c800 1 -- 172.21.15.121:0/693246898 shutdown_connections 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.206+0000 7f53d472c800 1 -- 172.21.15.121:0/693246898 wait complete. 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.207+0000 7f53d472c800 1 Processor -- start 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.207+0000 7f53d472c800 1 -- start start 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.207+0000 7f53d472c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020c7a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.207+0000 7f53d472c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563020ae8db0 con 0x563020bd48a0 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.207+0000 7f53d04f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020c7a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.207+0000 7f53d04f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020c7a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53058/0 (socket says 172.21.15.121:53058) 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.207+0000 7f53d04f7640 1 -- 172.21.15.121:0/2556290240 learned_addr learned my addr 172.21.15.121:0/2556290240 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.207+0000 7f53d04f7640 1 -- 172.21.15.121:0/2556290240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c4005d20 con 0x563020bd48a0 2023-12-07T21:09:13.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.208+0000 7f53d04f7640 1 --2- 172.21.15.121:0/2556290240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020c7a250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f53c0001660 tx=0x7f53c0001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1356a172ebdc652 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.208+0000 7f53cecf4640 1 -- 172.21.15.121:0/2556290240 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53c0003450 con 0x563020bd48a0 2023-12-07T21:09:13.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.208+0000 7f53cecf4640 1 -- 172.21.15.121:0/2556290240 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c00035d0 con 0x563020bd48a0 2023-12-07T21:09:13.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.208+0000 7f53cecf4640 1 -- 172.21.15.121:0/2556290240 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53c0003930 con 0x563020bd48a0 2023-12-07T21:09:13.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.208+0000 7f53d472c800 1 -- 172.21.15.121:0/2556290240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 msgr2=0x563020c7a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.208+0000 7f53d472c800 1 --2- 172.21.15.121:0/2556290240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020c7a250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f53c0001660 tx=0x7f53c0001b20 comp rx=0 tx=0).stop 2023-12-07T21:09:13.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.208+0000 7f53d472c800 1 -- 172.21.15.121:0/2556290240 shutdown_connections 2023-12-07T21:09:13.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.208+0000 7f53d472c800 1 --2- 172.21.15.121:0/2556290240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020c7a250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.208+0000 7f53d472c800 1 -- 172.21.15.121:0/2556290240 >> 172.21.15.121:0/2556290240 conn(0x563020bcff60 msgr2=0x563020c75ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.208+0000 7f53d472c800 1 -- 172.21.15.121:0/2556290240 shutdown_connections 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.208+0000 7f53d472c800 1 -- 172.21.15.121:0/2556290240 wait complete. 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53d472c800 1 Processor -- start 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53d472c800 1 -- start start 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53d472c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020bdd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53d472c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563020ae46a0 con 0x563020bd48a0 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53d04f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020bdd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53d04f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020bdd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53068/0 (socket says 172.21.15.121:53068) 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53d04f7640 1 -- 172.21.15.121:0/852116209 learned_addr learned my addr 172.21.15.121:0/852116209 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53d04f7640 1 -- 172.21.15.121:0/852116209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c0006ce0 con 0x563020bd48a0 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53d04f7640 1 --2- 172.21.15.121:0/852116209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020bdd2d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x563020c76940 tx=0x7f53c0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53cdcf2640 1 -- 172.21.15.121:0/852116209 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53c0013820 con 0x563020bd48a0 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53cdcf2640 1 -- 172.21.15.121:0/852116209 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0013980 con 0x563020bd48a0 2023-12-07T21:09:13.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53d472c800 1 -- 172.21.15.121:0/852116209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563020c85350 con 0x563020bd48a0 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.209+0000 7f53cdcf2640 1 -- 172.21.15.121:0/852116209 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53c0013c20 con 0x563020bd48a0 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.210+0000 7f53d472c800 1 -- 172.21.15.121:0/852116209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563020c85890 con 0x563020bd48a0 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.210+0000 7f53d472c800 1 Processor -- start 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.210+0000 7f53d472c800 1 -- start start 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.210+0000 7f53d472c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 0x563020c8ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.210+0000 7f53cdcf2640 1 -- 172.21.15.121:0/852116209 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f53c001e3e0 con 0x563020bd48a0 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.210+0000 7f53d472c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563020a7e890 con 0x563020c8ea10 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.210+0000 7f53cdcf2640 1 --2- 172.21.15.121:0/852116209 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53bc036110 0x7f53bc0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.210+0000 7f53d0cf8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 0x563020c8ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.210+0000 7f53cdcf2640 1 -- 172.21.15.121:0/852116209 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f53c004b250 con 0x563020bd48a0 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.210+0000 7f53d0cf8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 0x563020c8ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53070/0 (socket says 172.21.15.121:53070) 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53d0cf8640 1 -- 172.21.15.121:0/2347204039 learned_addr learned my addr 172.21.15.121:0/2347204039 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53d04f7640 1 --2- 172.21.15.121:0/852116209 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53bc036110 0x7f53bc0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53d0cf8640 1 -- 172.21.15.121:0/2347204039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563020c8f370 con 0x563020c8ea10 2023-12-07T21:09:13.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53d04f7640 1 --2- 172.21.15.121:0/852116209 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53bc036110 0x7f53bc0385d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f53c0010520 tx=0x7f53c0017f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53d0cf8640 1 --2- 172.21.15.121:0/2347204039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 0x563020c8ee30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f53c800a400 tx=0x7f53c800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820f64d879104109 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53b77fe640 1 -- 172.21.15.121:0/2347204039 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53c80087e0 con 0x563020c8ea10 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53b77fe640 1 -- 172.21.15.121:0/2347204039 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c8008960 con 0x563020c8ea10 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53b77fe640 1 -- 172.21.15.121:0/2347204039 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53c8008c80 con 0x563020c8ea10 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53d472c800 1 -- 172.21.15.121:0/2347204039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 msgr2=0x563020c8ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53d472c800 1 --2- 172.21.15.121:0/2347204039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 0x563020c8ee30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f53c800a400 tx=0x7f53c800a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53d472c800 1 -- 172.21.15.121:0/2347204039 shutdown_connections 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53d472c800 1 --2- 172.21.15.121:0/2347204039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 0x563020c8ee30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.211+0000 7f53d472c800 1 -- 172.21.15.121:0/2347204039 >> 172.21.15.121:0/2347204039 conn(0x563020bd8d30 msgr2=0x563020c89df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.212+0000 7f53d472c800 1 -- 172.21.15.121:0/2347204039 shutdown_connections 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.212+0000 7f53d472c800 1 -- 172.21.15.121:0/2347204039 wait complete. 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.212+0000 7f53d472c800 1 Processor -- start 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.212+0000 7f53d472c800 1 -- start start 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.212+0000 7f53d472c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 0x563020c82cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.212+0000 7f53d472c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563020a7e530 con 0x563020c8ea10 2023-12-07T21:09:13.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.212+0000 7f53d0cf8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 0x563020c82cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.212+0000 7f53d0cf8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 0x563020c82cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53082/0 (socket says 172.21.15.121:53082) 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.212+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 learned_addr learned my addr 172.21.15.121:0/3414552948 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.212+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c8005c90 con 0x563020c8ea10 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.213+0000 7f53d0cf8640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 0x563020c82cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f53c800a900 tx=0x7f53c8002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.213+0000 7f53b5ffb640 1 -- 172.21.15.121:0/3414552948 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53c8013780 con 0x563020c8ea10 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.213+0000 7f53b5ffb640 1 -- 172.21.15.121:0/3414552948 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c80138e0 con 0x563020c8ea10 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.213+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563020c81370 con 0x563020c8ea10 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.213+0000 7f53b5ffb640 1 -- 172.21.15.121:0/3414552948 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53c8013b80 con 0x563020c8ea10 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.213+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563020c81830 con 0x563020c8ea10 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.213+0000 7f53b5ffb640 1 -- 172.21.15.121:0/3414552948 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f53c8013ce0 con 0x563020c8ea10 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.214+0000 7f53b5ffb640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53a8036110 0x7f53a80385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.214+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.214+0000 7f53b5ffb640 1 -- 172.21.15.121:0/3414552948 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f53c804b690 con 0x563020c8ea10 2023-12-07T21:09:13.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.214+0000 7f53cfcf6640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53a8036110 0x7f53a80385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.214+0000 7f53d472c800 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x563020ca3380 0x563020ca5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.214+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ca5f70 con 0x563020ca3380 2023-12-07T21:09:13.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.214+0000 7f53d0cf8640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x563020ca3380 0x563020ca5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.214+0000 7f53cfcf6640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53a8036110 0x7f53a80385d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53c4054000 tx=0x7f53c404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.214+0000 7f53d0cf8640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x563020ca3380 0x563020ca5820 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 20 realm 2023-12-07T21:09:13.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ca6360 con 0x563020ca3380 2023-12-07T21:09:13.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ca6bb0 con 0x563020ca3380 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ca6f10 con 0x563020ca3380 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ca6850 con 0x563020ca3380 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.215+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.216+0000 7f53d472c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:13.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.216+0000 7f53d472c800 20 searching for the correct realm 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.216+0000 7f53d472c800 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x563020ca9160 0x563020cab550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.216+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca9160 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.216+0000 7f53d04f7640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x563020ca9160 0x563020cab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.216+0000 7f53d04f7640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x563020ca9160 0x563020cab550 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.216+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.216+0000 7f53d04f7640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f53c004aa00 0x7f53c0010590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.216+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c004aa00 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.216+0000 7f53cfcf6640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f53c004aa00 0x7f53c0010590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.217+0000 7f53cfcf6640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f53c004aa00 0x7f53c0010590 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.217+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.217+0000 7f53cfcf6640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f53c405ca90 0x7f53c40673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.217+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c405ca90 2023-12-07T21:09:13.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.217+0000 7f53d0cf8640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f53c405ca90 0x7f53c40673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.217+0000 7f53d0cf8640 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f53c405ca90 0x7f53c40673d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.218+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.218+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca3380 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.218+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.218+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca3380 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.218+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.218+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c405ca90 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.218+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.218+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c405ca90 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.219+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.219+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c004aa00 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.219+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.219+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca9160 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.219+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.219+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca3380 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.219+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.219+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c405ca90 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.220+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.220+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca3380 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.220+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.220+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c004aa00 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.220+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.220+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca9160 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.220+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.220+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca9160 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.220+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.220+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c405ca90 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.221+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.221+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca9160 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.221+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.221+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca9160 2023-12-07T21:09:13.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.221+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.221+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca3380 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.222+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.222+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca3380 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.222+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.222+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c405ca90 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.222+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.222+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca9160 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.222+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.222+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c004aa00 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.223+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.223+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca3380 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.223+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.223+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c405ca90 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.223+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.223+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca9160 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.223+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.223+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c405ca90 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.224+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.224+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c004aa00 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.224+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.224+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca9160 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.224+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.224+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x7f53c405ca90 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.224+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.224+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabae0 con 0x563020ca3380 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f53c8053080 con 0x7f53c004aa00 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:13.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ca7d40 con 0x563020ca3380 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ca7960 con 0x563020ca3380 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.225+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ca8590 con 0x563020ca9160 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:13.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 20 zone default found 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 4 Realm: () 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 20 zonegroup default 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cabf20 con 0x7f53c405ca90 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cadda0 con 0x563020ca9160 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.226+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cae100 con 0x563020ca9160 2023-12-07T21:09:13.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.227+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.227+0000 7f53d472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.227+0000 7f53d472c800 20 started sync module instance, tier type = 2023-12-07T21:09:13.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.227+0000 7f53d472c800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:13.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.227+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cad370 con 0x7f53c004aa00 2023-12-07T21:09:13.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.228+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.228+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94764706160464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cad7c0 con 0x7f53c004aa00 2023-12-07T21:09:13.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.228+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cae900 con 0x563020ca3380 2023-12-07T21:09:13.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.230+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.230+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94764708586592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020caedf0 con 0x563020ca3380 2023-12-07T21:09:13.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.230+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020caf8c0 con 0x563020ca9160 2023-12-07T21:09:13.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.230+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94764706160464] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.233+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94764708586592] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.233+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c001e690 con 0x563020ca9160 2023-12-07T21:09:13.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.233+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94764708590496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cae870 con 0x563020ca9160 2023-12-07T21:09:13.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.233+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb0110 con 0x7f53c004aa00 2023-12-07T21:09:13.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.234+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.234+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94764708594800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb0d20 con 0x7f53c004aa00 2023-12-07T21:09:13.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.234+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb15a0 con 0x563020ca3380 2023-12-07T21:09:13.237 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.234+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94764708590496] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c0054040 con 0x563020ca9160 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.236+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.236+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94764708597888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb1950 con 0x563020ca3380 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.236+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb22c0 con 0x7f53c405ca90 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.238+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94764708594800] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.238+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.238+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94764708595840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb22c0 con 0x7f53c405ca90 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.238+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94764708597888] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.239+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb2b00 con 0x7f53c405ca90 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.240+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94764708595840] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.240+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.240+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94764708601376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb26d0 con 0x7f53c405ca90 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.240+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb2ed0 con 0x7f53c405ca90 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.240+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94764708604080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb3320 con 0x7f53c405ca90 2023-12-07T21:09:13.238 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d472c800 20 add_watcher() i=0 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d472c800 20 add_watcher() i=1 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d472c800 20 add_watcher() i=2 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d472c800 20 add_watcher() i=3 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d472c800 20 add_watcher() i=4 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d472c800 20 add_watcher() i=5 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94764708601376] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d472c800 20 add_watcher() i=6 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94764708604080] v31'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d472c800 20 add_watcher() i=7 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d472c800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.241+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb2230 con 0x563020ca3380 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.242+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.242+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94764708605376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb2230 con 0x563020ca3380 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.243+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94764708605376] v31'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.243+0000 7f53967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.243+0000 7f53d472c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:13.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.243+0000 7f53d472c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:13.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.243+0000 7f53d472c800 5 note: GC not initialized 2023-12-07T21:09:13.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.243+0000 7f53957e2640 20 reqs_thread_entry: start 2023-12-07T21:09:13.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.243+0000 7f53d472c800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:13.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.243+0000 7f53d472c800 20 Filter name: none 2023-12-07T21:09:13.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.244+0000 7f5306ffd640 20 reqs_thread_entry: start 2023-12-07T21:09:13.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.244+0000 7f53d472c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.244+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ce8e60 con 0x563020ca3380 2023-12-07T21:09:13.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.244+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.244+0000 7f53d472c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.240 INFO:teuthology.orchestra.run.smithi121.stderr:could not fetch user info: no user info saved 2023-12-07T21:09:13.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.244+0000 7f53967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.244+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94764708605376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ce8e20 con 0x563020ca3380 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.245+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94764708605376] v31'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.245+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94764706160464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ce8e20 con 0x7f53c004aa00 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.246+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94764706160464] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.246+0000 7f53d472c800 20 remove_watcher() i=0 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.246+0000 7f53d472c800 2 removed watcher, disabling cache 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.246+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94764708586592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ce7630 con 0x563020ca3380 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.247+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94764708586592] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.247+0000 7f53d472c800 20 remove_watcher() i=1 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.247+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94764708590496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ce7630 con 0x563020ca9160 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.248+0000 7f53d04f7640 1 -- 172.21.15.121:0/3414552948 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94764708590496] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c0054040 con 0x563020ca9160 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.248+0000 7f53d472c800 20 remove_watcher() i=2 2023-12-07T21:09:13.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.248+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94764708594800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ce7990 con 0x7f53c004aa00 2023-12-07T21:09:13.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.249+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94764708594800] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c4052840 con 0x7f53c004aa00 2023-12-07T21:09:13.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.249+0000 7f53d472c800 20 remove_watcher() i=3 2023-12-07T21:09:13.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.249+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94764708597888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ce7cf0 con 0x563020ca3380 2023-12-07T21:09:13.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.250+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94764708597888] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x563020ca3380 2023-12-07T21:09:13.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.250+0000 7f53d472c800 20 remove_watcher() i=4 2023-12-07T21:09:13.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.250+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94764708595840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020ce7cf0 con 0x7f53c405ca90 2023-12-07T21:09:13.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.251+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94764708595840] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.251+0000 7f53d472c800 20 remove_watcher() i=5 2023-12-07T21:09:13.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.251+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94764708601376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb0880 con 0x7f53c405ca90 2023-12-07T21:09:13.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.252+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94764708601376] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.252+0000 7f53d472c800 20 remove_watcher() i=6 2023-12-07T21:09:13.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.252+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94764708604080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x563020cb0880 con 0x7f53c405ca90 2023-12-07T21:09:13.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.253+0000 7f53d0cf8640 1 -- 172.21.15.121:0/3414552948 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94764708604080] v31'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53c8024070 con 0x7f53c405ca90 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.253+0000 7f53d472c800 20 remove_watcher() i=7 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.253+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f53c405ca90 msgr2=0x7f53c40673d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.253+0000 7f53d472c800 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f53c405ca90 0x7f53c40673d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.253+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x563020ca3380 msgr2=0x563020ca5820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.253+0000 7f53d472c800 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x563020ca3380 0x563020ca5820 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.253+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f53c004aa00 msgr2=0x7f53c0010590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.253+0000 7f53d472c800 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f53c004aa00 0x7f53c0010590 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.253+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x563020ca9160 msgr2=0x563020cab550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.253+0000 7f53d472c800 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x563020ca9160 0x563020cab550 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53a8036110 msgr2=0x7f53a80385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53a8036110 0x7f53a80385d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53c4054000 tx=0x7f53c404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 msgr2=0x563020c82cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 --2- 172.21.15.121:0/3414552948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020c8ea10 0x563020c82cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f53c800a900 tx=0x7f53c8002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 reap_dead start 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53cfcf6640 1 -- 172.21.15.121:0/3414552948 reap_dead start 2023-12-07T21:09:13.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 shutdown_connections 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 >> 172.21.15.121:0/3414552948 conn(0x563020bd8d30 msgr2=0x563020c88bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 shutdown_connections 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/3414552948 wait complete. 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/852116209 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53bc036110 msgr2=0x7f53bc0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 --2- 172.21.15.121:0/852116209 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53bc036110 0x7f53bc0385d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f53c0010520 tx=0x7f53c0017f90 comp rx=0 tx=0).stop 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/852116209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 msgr2=0x563020bdd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 --2- 172.21.15.121:0/852116209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020bdd2d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x563020c76940 tx=0x7f53c0001250 comp rx=0 tx=0).stop 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/852116209 shutdown_connections 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 --2- 172.21.15.121:0/852116209 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53bc036110 0x7f53bc0385d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 --2- 172.21.15.121:0/852116209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563020bd48a0 0x563020bdd2d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/852116209 >> 172.21.15.121:0/852116209 conn(0x563020bcff60 msgr2=0x563020c78f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/852116209 shutdown_connections 2023-12-07T21:09:13.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.254+0000 7f53d472c800 1 -- 172.21.15.121:0/852116209 wait complete. 2023-12-07T21:09:13.250 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-12-07T21:09:13.250 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2023-12-07T21:09:13.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2023-12-07T21:09:13.250 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2023-12-07T21:09:13.343 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:13.343 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:13.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.351+0000 7f150ad3a800 1 Processor -- start 2023-12-07T21:09:13.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.351+0000 7f150ad3a800 1 -- start start 2023-12-07T21:09:13.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.351+0000 7f150ad3a800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5605375ea7e0 0x5605375eac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.351+0000 7f150ad3a800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560537535740 con 0x5605375eb140 2023-12-07T21:09:13.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.351+0000 7f150ad3a800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5605374fe880 con 0x5605375ea7e0 2023-12-07T21:09:13.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.351+0000 7f1506a0d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5605375ea7e0 0x5605375eac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.351+0000 7f150620c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5605375eb140 0x5605375e7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37694/0 (socket says 172.21.15.121:37694) 2023-12-07T21:09:13.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.351+0000 7f1506a0d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5605375ea7e0 0x5605375eac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53088/0 (socket says 172.21.15.121:53088) 2023-12-07T21:09:13.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.351+0000 7f150620c640 1 -- 172.21.15.121:0/1166749833 learned_addr learned my addr 172.21.15.121:0/1166749833 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:13.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.352+0000 7f1506a0d640 1 -- 172.21.15.121:0/1166749833 >> v1:172.21.15.89:6789/0 conn(0x5605375eb140 legacy=0x5605375e7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.352+0000 7f1506a0d640 1 -- 172.21.15.121:0/1166749833 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605375e7b00 con 0x5605375ea7e0 2023-12-07T21:09:13.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.353+0000 7f1506a0d640 1 --2- 172.21.15.121:0/1166749833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375ea7e0 0x5605375eac00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f14f8005fd0 tx=0x7f14f801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8676053d42ce1019 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.354+0000 7f1505a0b640 1 -- 172.21.15.121:0/1166749833 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f8052560 con 0x5605375ea7e0 2023-12-07T21:09:13.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.354+0000 7f1505a0b640 1 -- 172.21.15.121:0/1166749833 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f80526c0 con 0x5605375ea7e0 2023-12-07T21:09:13.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.354+0000 7f1505a0b640 1 -- 172.21.15.121:0/1166749833 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f80529e0 con 0x5605375ea7e0 2023-12-07T21:09:13.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.354+0000 7f150ad3a800 1 -- 172.21.15.121:0/1166749833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375ea7e0 msgr2=0x5605375eac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.354+0000 7f150ad3a800 1 --2- 172.21.15.121:0/1166749833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375ea7e0 0x5605375eac00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f14f8005fd0 tx=0x7f14f801cb90 comp rx=0 tx=0).stop 2023-12-07T21:09:13.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.354+0000 7f150ad3a800 1 -- 172.21.15.121:0/1166749833 shutdown_connections 2023-12-07T21:09:13.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.354+0000 7f150ad3a800 1 --2- 172.21.15.121:0/1166749833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375ea7e0 0x5605375eac00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.354+0000 7f150ad3a800 1 -- 172.21.15.121:0/1166749833 >> 172.21.15.121:0/1166749833 conn(0x5605375e2f00 msgr2=0x5605375e5320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.354+0000 7f150ad3a800 1 -- 172.21.15.121:0/1166749833 shutdown_connections 2023-12-07T21:09:13.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.354+0000 7f150ad3a800 1 -- 172.21.15.121:0/1166749833 wait complete. 2023-12-07T21:09:13.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.355+0000 7f150ad3a800 1 Processor -- start 2023-12-07T21:09:13.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.355+0000 7f150ad3a800 1 -- start start 2023-12-07T21:09:13.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.355+0000 7f150ad3a800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x56053768e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.355+0000 7f150ad3a800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605374fbdb0 con 0x5605375eb140 2023-12-07T21:09:13.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.355+0000 7f1506a0d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x56053768e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.355+0000 7f1506a0d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x56053768e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53094/0 (socket says 172.21.15.121:53094) 2023-12-07T21:09:13.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.355+0000 7f1506a0d640 1 -- 172.21.15.121:0/1994825469 learned_addr learned my addr 172.21.15.121:0/1994825469 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.355+0000 7f1506a0d640 1 -- 172.21.15.121:0/1994825469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f800a100 con 0x5605375eb140 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f1506a0d640 1 --2- 172.21.15.121:0/1994825469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x56053768e4f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f14f8007000 tx=0x7f14f804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a10be2bda3f91a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150520a640 1 -- 172.21.15.121:0/1994825469 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f8052960 con 0x5605375eb140 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150520a640 1 -- 172.21.15.121:0/1994825469 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f8052ac0 con 0x5605375eb140 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150520a640 1 -- 172.21.15.121:0/1994825469 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f8052da0 con 0x5605375eb140 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150ad3a800 1 -- 172.21.15.121:0/1994825469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 msgr2=0x56053768e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150ad3a800 1 --2- 172.21.15.121:0/1994825469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x56053768e4f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f14f8007000 tx=0x7f14f804c000 comp rx=0 tx=0).stop 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150ad3a800 1 -- 172.21.15.121:0/1994825469 shutdown_connections 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150ad3a800 1 --2- 172.21.15.121:0/1994825469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x56053768e4f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150ad3a800 1 -- 172.21.15.121:0/1994825469 >> 172.21.15.121:0/1994825469 conn(0x5605375e2f00 msgr2=0x56053768a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150ad3a800 1 -- 172.21.15.121:0/1994825469 shutdown_connections 2023-12-07T21:09:13.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150ad3a800 1 -- 172.21.15.121:0/1994825469 wait complete. 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150ad3a800 1 Processor -- start 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.356+0000 7f150ad3a800 1 -- start start 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.357+0000 7f150ad3a800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x5605376959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.357+0000 7f150ad3a800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605374f76a0 con 0x5605375eb140 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.357+0000 7f1506a0d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x5605376959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.357+0000 7f1506a0d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x5605376959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53102/0 (socket says 172.21.15.121:53102) 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.357+0000 7f1506a0d640 1 -- 172.21.15.121:0/4064163138 learned_addr learned my addr 172.21.15.121:0/4064163138 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.357+0000 7f1506a0d640 1 -- 172.21.15.121:0/4064163138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605375e7b00 con 0x5605375eb140 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.357+0000 7f1506a0d640 1 --2- 172.21.15.121:0/4064163138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x5605376959c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f14f801cbd0 tx=0x7f14f8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.358+0000 7f14fffff640 1 -- 172.21.15.121:0/4064163138 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f806c070 con 0x5605375eb140 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.358+0000 7f150ad3a800 1 -- 172.21.15.121:0/4064163138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560537695f00 con 0x5605375eb140 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.358+0000 7f14fffff640 1 -- 172.21.15.121:0/4064163138 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f805c830 con 0x5605375eb140 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.358+0000 7f150ad3a800 1 -- 172.21.15.121:0/4064163138 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605376963e0 con 0x5605375eb140 2023-12-07T21:09:13.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.358+0000 7f14fffff640 1 -- 172.21.15.121:0/4064163138 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f805cad0 con 0x5605375eb140 2023-12-07T21:09:13.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.358+0000 7f150ad3a800 1 Processor -- start 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.358+0000 7f150ad3a800 1 -- start start 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.358+0000 7f14fffff640 1 -- 172.21.15.121:0/4064163138 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f14f805cc30 con 0x5605375eb140 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.358+0000 7f150ad3a800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f150ad3a800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560537491890 con 0x5605376a2320 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f14fffff640 1 --2- 172.21.15.121:0/4064163138 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f14e80360c0 0x7f14e8038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f14fffff640 1 -- 172.21.15.121:0/4064163138 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f14f808d640 con 0x5605375eb140 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f150720e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f150720e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53118/0 (socket says 172.21.15.121:53118) 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f1506a0d640 1 --2- 172.21.15.121:0/4064163138 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f14e80360c0 0x7f14e8038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f150720e640 1 -- 172.21.15.121:0/2736760517 learned_addr learned my addr 172.21.15.121:0/2736760517 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f150720e640 1 -- 172.21.15.121:0/2736760517 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605376a2c80 con 0x5605376a2320 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f1506a0d640 1 --2- 172.21.15.121:0/4064163138 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f14e80360c0 0x7f14e8038580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f14f807e040 tx=0x7f14f805cee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f150720e640 1 --2- 172.21.15.121:0/2736760517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a2740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f150000a400 tx=0x7f150000a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7dcbf0bbbcc9bc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f14fdffb640 1 -- 172.21.15.121:0/2736760517 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15000087e0 con 0x5605376a2320 2023-12-07T21:09:13.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f14fdffb640 1 -- 172.21.15.121:0/2736760517 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1500008960 con 0x5605376a2320 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.359+0000 7f14fdffb640 1 -- 172.21.15.121:0/2736760517 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1500008c80 con 0x5605376a2320 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150ad3a800 1 -- 172.21.15.121:0/2736760517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 msgr2=0x5605376a2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150ad3a800 1 --2- 172.21.15.121:0/2736760517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a2740 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f150000a400 tx=0x7f150000a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150ad3a800 1 -- 172.21.15.121:0/2736760517 shutdown_connections 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150ad3a800 1 --2- 172.21.15.121:0/2736760517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a2740 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150ad3a800 1 -- 172.21.15.121:0/2736760517 >> 172.21.15.121:0/2736760517 conn(0x56053769cf60 msgr2=0x56053769de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150ad3a800 1 -- 172.21.15.121:0/2736760517 shutdown_connections 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150ad3a800 1 -- 172.21.15.121:0/2736760517 wait complete. 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150ad3a800 1 Processor -- start 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150ad3a800 1 -- start start 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150ad3a800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150ad3a800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560537491530 con 0x5605376a2320 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150720e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150720e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53126/0 (socket says 172.21.15.121:53126) 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.360+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 learned_addr learned my addr 172.21.15.121:0/372777676 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.361+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500005c90 con 0x5605376a2320 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.361+0000 7f150720e640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a8f40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f150000c010 tx=0x7f1500002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.361+0000 7f14e7fff640 1 -- 172.21.15.121:0/372777676 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1500013840 con 0x5605376a2320 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.361+0000 7f14e7fff640 1 -- 172.21.15.121:0/372777676 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15000139a0 con 0x5605376a2320 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.361+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5605376a9480 con 0x5605376a2320 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.361+0000 7f14e7fff640 1 -- 172.21.15.121:0/372777676 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1500013c80 con 0x5605376a2320 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.361+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5605376a9940 con 0x5605376a2320 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.362+0000 7f14e7fff640 1 -- 172.21.15.121:0/372777676 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f150001e420 con 0x5605376a2320 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.362+0000 7f14e7fff640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f14e0036110 0x7f14e00385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.362+0000 7f14e7fff640 1 -- 172.21.15.121:0/372777676 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f150004b740 con 0x5605376a2320 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.362+0000 7f150620c640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f14e0036110 0x7f14e00385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.362+0000 7f150620c640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f14e0036110 0x7f14e00385d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f14f0000f60 tx=0x7f14f0001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.362+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.362+0000 7f150ad3a800 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5605376b4690 0x5605376b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.362+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376b72a0 con 0x5605376b4690 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150720e640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5605376b4690 0x5605376b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150720e640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5605376b4690 0x5605376b6b50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150ad3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150ad3a800 20 realm 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376b76b0 con 0x5605376b4690 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150ad3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150ad3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:13.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376b7f30 con 0x5605376b4690 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.363+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150ad3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376b8290 con 0x5605376b4690 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150ad3a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376b8a90 con 0x5605376b4690 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150ad3a800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150ad3a800 20 searching for the correct realm 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150ad3a800 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5605376ba7b0 0x5605376bcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376ba7b0 2023-12-07T21:09:13.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.364+0000 7f1506a0d640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5605376ba7b0 0x5605376bcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.365+0000 7f1506a0d640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5605376ba7b0 0x5605376bcc40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.365+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.365+0000 7f1506a0d640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f14f807b060 0x7f14f808e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.365+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f807b060 2023-12-07T21:09:13.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.365+0000 7f150620c640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f14f807b060 0x7f14f808e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.365+0000 7f150620c640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f14f807b060 0x7f14f808e8e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.365+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f0006070 con 0x7f14f807b060 2023-12-07T21:09:13.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.366+0000 7f150620c640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f14f000d3d0 0x7f14f000d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.366+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f000d3d0 2023-12-07T21:09:13.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.366+0000 7f150720e640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f14f000d3d0 0x7f14f000d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.366+0000 7f150720e640 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f14f000d3d0 0x7f14f000d830 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.366+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.366+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376b4690 2023-12-07T21:09:13.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.367+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.367+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376b4690 2023-12-07T21:09:13.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.367+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.367+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f000d3d0 2023-12-07T21:09:13.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.367+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.367+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f000d3d0 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.367+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.367+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f807b060 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.367+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f0006070 con 0x7f14f807b060 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.368+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376ba7b0 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.368+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.368+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376b4690 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.368+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.368+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f000d3d0 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.368+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.368+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376b4690 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.368+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.368+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f807b060 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.369+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f14f0006070 con 0x7f14f807b060 2023-12-07T21:09:13.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.369+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376ba7b0 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.369+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.369+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376ba7b0 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.369+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.369+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f000d3d0 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.369+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.369+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376ba7b0 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.370+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.370+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376ba7b0 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.370+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.370+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376b4690 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.370+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.370+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376b4690 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.370+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.370+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f000d3d0 2023-12-07T21:09:13.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.371+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.371+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376ba7b0 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.371+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.371+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f807b060 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.371+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f0006070 con 0x7f14f807b060 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.371+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376b4690 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.371+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.371+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f000d3d0 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.372+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.372+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x5605376ba7b0 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.372+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.372+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd310 con 0x7f14f000d3d0 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.372+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.372+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1500053040 con 0x7f14f807b060 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.373+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f0006070 con 0x7f14f807b060 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.373+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1500053040 con 0x5605376ba7b0 2023-12-07T21:09:13.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.373+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.373+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1500053040 con 0x7f14f000d3d0 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.373+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.373+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1500053040 con 0x5605376b4690 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.373+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.373+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f1500053040 con 0x7f14f807b060 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f14f0006070 con 0x7f14f807b060 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376b93f0 con 0x5605376b4690 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376b9c40 con 0x5605376b4690 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376b9c40 con 0x5605376ba7b0 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 zone default found 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 4 Realm: () 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 zonegroup default 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.374+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bd770 con 0x7f14f000d3d0 2023-12-07T21:09:13.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f150ad3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bf550 con 0x5605376ba7b0 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f150ad3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bf8b0 con 0x5605376ba7b0 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f150ad3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f150ad3a800 20 started sync module instance, tier type = 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f150ad3a800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.375+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bee30 con 0x7f14f807b060 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.376+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14f0006070 con 0x7f14f807b060 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.376+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94580402229072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376bf1e0 con 0x7f14f807b060 2023-12-07T21:09:13.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.376+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c0150 con 0x5605376b4690 2023-12-07T21:09:13.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.377+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94580402229072] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14f0006070 con 0x7f14f807b060 2023-12-07T21:09:13.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.378+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.378+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94580404644240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c0150 con 0x5605376b4690 2023-12-07T21:09:13.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.378+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c0c20 con 0x5605376ba7b0 2023-12-07T21:09:13.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.379+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94580404644240] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.379+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.379+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94580404649136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c00c0 con 0x5605376ba7b0 2023-12-07T21:09:13.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.379+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c1910 con 0x7f14f807b060 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.380+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94580404649136] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.380+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14f0026040 con 0x7f14f807b060 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.380+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94580404654304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c2160 con 0x7f14f807b060 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.380+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c2960 con 0x5605376b4690 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.381+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94580404654304] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14f0026040 con 0x7f14f807b060 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.381+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.381+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94580404659392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c2d70 con 0x5605376b4690 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.381+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c35b0 con 0x7f14f000d3d0 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.382+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94580404659392] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.383+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.383+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94580404660432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c3180 con 0x7f14f000d3d0 2023-12-07T21:09:13.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.383+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c3e40 con 0x7f14f000d3d0 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94580404660432] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94580404664592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c4220 con 0x7f14f000d3d0 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c47a0 con 0x7f14f000d3d0 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94580404661472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c4c40 con 0x7f14f000d3d0 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150ad3a800 20 add_watcher() i=0 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150ad3a800 20 add_watcher() i=1 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150ad3a800 20 add_watcher() i=2 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150ad3a800 20 add_watcher() i=3 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150ad3a800 20 add_watcher() i=4 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.384+0000 7f150ad3a800 20 add_watcher() i=5 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.385+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94580404664592] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.385+0000 7f150ad3a800 20 add_watcher() i=6 2023-12-07T21:09:13.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.385+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94580404661472] v31'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.385+0000 7f150ad3a800 20 add_watcher() i=7 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.385+0000 7f150ad3a800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.385+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c3d20 con 0x5605376b4690 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.386+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.386+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94580404668320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c3d20 con 0x5605376b4690 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.386+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94580404668320] v31'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f14ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 5 note: GC not initialized 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f14477fe640 20 reqs_thread_entry: start 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 20 Filter name: none 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f14457fa640 20 reqs_thread_entry: start 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376fac80 con 0x5605376b4690 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.387+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376f9430 con 0x5605376b4690 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376f9430 con 0x7f14f000d3d0 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.388+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376f9d00 con 0x5605376b4690 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.389+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~357] v31'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.389+0000 7f150ad3a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.389+0000 7f150ad3a800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.389+0000 7f150ad3a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.389+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94580404885600 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376f9c70 con 0x5605376b4690 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.389+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== watch-notify(notify (1) cookie 94580404659392 notify 133143986176 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x5605376a9940 con 0x5605376b4690 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.389+0000 7f14fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94580404659392 notifier 4276 bl.length()=533 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.389+0000 7f14fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.389+0000 7f14fdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.389+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(66 notify.4 [notify cookie 94580404885600 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.389+0000 7f14fdffb640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f14dc0042a0 con 0x5605376b4690 2023-12-07T21:09:13.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.390+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.390+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== watch-notify(notify_complete (2) cookie 94580404885600 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5605376a9480 con 0x5605376b4690 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.390+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376f9c70 con 0x5605376b4690 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.391+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.391+0000 7f150ad3a800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.391+0000 7f150ad3a800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.391+0000 7f150ad3a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.391+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94580404885600 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376f9c70 con 0x7f14f807b060 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.391+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== watch-notify(notify (1) cookie 94580404654304 notify 133143986176 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x560537535740 con 0x7f14f807b060 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.391+0000 7f14fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94580404654304 notifier 4276 bl.length()=169 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.391+0000 7f14fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.391+0000 7f14fdffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.391+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(69 notify.3 [notify cookie 94580404885600 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f14f0026040 con 0x7f14f807b060 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.391+0000 7f14fdffb640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f14dc0042a0 con 0x7f14f807b060 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.392+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== watch-notify(notify_complete (2) cookie 94580404885600 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f14f000e570 con 0x7f14f807b060 2023-12-07T21:09:13.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.392+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14f0026040 con 0x7f14f807b060 2023-12-07T21:09:13.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.392+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376fcb00 con 0x7f14f000d3d0 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.393+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.393+0000 7f150ad3a800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.393+0000 7f150ad3a800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.393+0000 7f150ad3a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.394+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94580404885600 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376fe6f0 con 0x7f14f807b060 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.394+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== watch-notify(notify (1) cookie 94580404654304 notify 133143986177 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f14f000e570 con 0x7f14f807b060 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.394+0000 7f14fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94580404654304 notifier 4276 bl.length()=177 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.394+0000 7f14fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.394+0000 7f14fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.394+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(72 notify.3 [notify cookie 94580404885600 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f14f0026040 con 0x7f14f807b060 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.394+0000 7f14fd7fa640 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f144c003400 con 0x7f14f807b060 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.394+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== watch-notify(notify_complete (2) cookie 94580404885600 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f14f000e870 con 0x7f14f807b060 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.394+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14f0026040 con 0x7f14f807b060 2023-12-07T21:09:13.392 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.395+0000 7f14ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.395+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94580404668320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376fb750 con 0x5605376b4690 2023-12-07T21:09:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.396+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94580404668320] v31'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.396+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94580402229072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376fb750 con 0x7f14f807b060 2023-12-07T21:09:13.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.397+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94580402229072] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14f0026040 con 0x7f14f807b060 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.397+0000 7f150ad3a800 20 remove_watcher() i=0 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.397+0000 7f150ad3a800 2 removed watcher, disabling cache 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.397+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94580404644240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376fb750 con 0x5605376b4690 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.398+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94580404644240] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.398+0000 7f150ad3a800 20 remove_watcher() i=1 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.398+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94580404649136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376fb750 con 0x5605376ba7b0 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.399+0000 7f1506a0d640 1 -- 172.21.15.121:0/372777676 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94580404649136] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14f8051db0 con 0x5605376ba7b0 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.399+0000 7f150ad3a800 20 remove_watcher() i=2 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.399+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94580404654304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376fbab0 con 0x7f14f807b060 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.400+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94580404654304] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f14f0026040 con 0x7f14f807b060 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.400+0000 7f150ad3a800 20 remove_watcher() i=3 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.400+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94580404659392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376fbab0 con 0x5605376b4690 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.401+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94580404659392] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x5605376b4690 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.401+0000 7f150ad3a800 20 remove_watcher() i=4 2023-12-07T21:09:13.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.401+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94580404660432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376fbab0 con 0x7f14f000d3d0 2023-12-07T21:09:13.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.402+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94580404660432] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.402+0000 7f150ad3a800 20 remove_watcher() i=5 2023-12-07T21:09:13.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.402+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94580404664592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c28d0 con 0x7f14f000d3d0 2023-12-07T21:09:13.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.403+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94580404664592] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.403+0000 7f150ad3a800 20 remove_watcher() i=6 2023-12-07T21:09:13.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.403+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94580404661472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5605376c28d0 con 0x7f14f000d3d0 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150720e640 1 -- 172.21.15.121:0/372777676 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94580404661472] v31'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1500024070 con 0x7f14f000d3d0 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 20 remove_watcher() i=7 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f14f000d3d0 msgr2=0x7f14f000d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f14f000d3d0 0x7f14f000d830 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5605376b4690 msgr2=0x5605376b6b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5605376b4690 0x5605376b6b50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f14f807b060 msgr2=0x7f14f808e8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f14f807b060 0x7f14f808e8e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5605376ba7b0 msgr2=0x5605376bcc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5605376ba7b0 0x5605376bcc40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f14e0036110 msgr2=0x7f14e00385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f14e0036110 0x7f14e00385d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f14f0000f60 tx=0x7f14f0001230 comp rx=0 tx=0).stop 2023-12-07T21:09:13.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 msgr2=0x5605376a8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a8f40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f150000c010 tx=0x7f1500002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150620c640 1 -- 172.21.15.121:0/372777676 reap_dead start 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 shutdown_connections 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 --2- 172.21.15.121:0/372777676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605376a2320 0x5605376a8f40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.404+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 >> 172.21.15.121:0/372777676 conn(0x56053769cf60 msgr2=0x56053769de40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 shutdown_connections 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 -- 172.21.15.121:0/372777676 wait complete. 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 -- 172.21.15.121:0/4064163138 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f14e80360c0 msgr2=0x7f14e8038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 --2- 172.21.15.121:0/4064163138 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f14e80360c0 0x7f14e8038580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f14f807e040 tx=0x7f14f805cee0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 -- 172.21.15.121:0/4064163138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 msgr2=0x5605376959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 --2- 172.21.15.121:0/4064163138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x5605376959c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f14f801cbd0 tx=0x7f14f8003330 comp rx=0 tx=0).stop 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 -- 172.21.15.121:0/4064163138 shutdown_connections 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 --2- 172.21.15.121:0/4064163138 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f14e80360c0 0x7f14e8038580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 --2- 172.21.15.121:0/4064163138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5605375eb140 0x5605376959c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 -- 172.21.15.121:0/4064163138 >> 172.21.15.121:0/4064163138 conn(0x5605375e2f00 msgr2=0x56053768d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 -- 172.21.15.121:0/4064163138 shutdown_connections 2023-12-07T21:09:13.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.405+0000 7f150ad3a800 1 -- 172.21.15.121:0/4064163138 wait complete. 2023-12-07T21:09:13.401 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:13.401 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2023-12-07T21:09:13.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2023-12-07T21:09:13.402 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2023-12-07T21:09:13.447 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:13.447 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:13.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.455+0000 7fc1db82d800 1 Processor -- start 2023-12-07T21:09:13.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.455+0000 7fc1db82d800 1 -- start start 2023-12-07T21:09:13.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.455+0000 7fc1db82d800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557d24036af0 0x557d240c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.455+0000 7fc1db82d800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557d2400e740 con 0x557d240c76e0 2023-12-07T21:09:13.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.455+0000 7fc1db82d800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x557d23fd7880 con 0x557d24036af0 2023-12-07T21:09:13.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.456+0000 7fc1d6a3c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557d24036af0 0x557d240c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.456+0000 7fc1d623b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x557d240c76e0 0x557d240c9ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37704/0 (socket says 172.21.15.121:37704) 2023-12-07T21:09:13.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.456+0000 7fc1d623b640 1 -- 172.21.15.121:0/93491408 learned_addr learned my addr 172.21.15.121:0/93491408 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:13.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.456+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/93491408 >> v1:172.21.15.89:6789/0 conn(0x557d240c76e0 legacy=0x557d240c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.456+0000 7fc1d5a3a640 1 -- 172.21.15.121:0/93491408 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047567457 0 0) 0x557d2400e740 con 0x557d240c76e0 2023-12-07T21:09:13.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.456+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/93491408 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d240cc200 con 0x557d24036af0 2023-12-07T21:09:13.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.458+0000 7fc1d6a3c640 1 --2- 172.21.15.121:0/93491408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d240c71a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8005fd0 tx=0x7fc1c801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1cccbd1118983b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.458+0000 7fc1d5a3a640 1 -- 172.21.15.121:0/93491408 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1c8052560 con 0x557d24036af0 2023-12-07T21:09:13.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.458+0000 7fc1d5a3a640 1 -- 172.21.15.121:0/93491408 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c80526c0 con 0x557d24036af0 2023-12-07T21:09:13.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.458+0000 7fc1d5a3a640 1 -- 172.21.15.121:0/93491408 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1c8052960 con 0x557d24036af0 2023-12-07T21:09:13.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.458+0000 7fc1db82d800 1 -- 172.21.15.121:0/93491408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 msgr2=0x557d240c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.458+0000 7fc1db82d800 1 --2- 172.21.15.121:0/93491408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d240c71a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8005fd0 tx=0x7fc1c801cb90 comp rx=0 tx=0).stop 2023-12-07T21:09:13.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.458+0000 7fc1db82d800 1 -- 172.21.15.121:0/93491408 shutdown_connections 2023-12-07T21:09:13.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.458+0000 7fc1db82d800 1 --2- 172.21.15.121:0/93491408 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d240c71a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.458+0000 7fc1db82d800 1 -- 172.21.15.121:0/93491408 >> 172.21.15.121:0/93491408 conn(0x557d240bc820 msgr2=0x557d240bec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.458+0000 7fc1db82d800 1 -- 172.21.15.121:0/93491408 shutdown_connections 2023-12-07T21:09:13.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.458+0000 7fc1db82d800 1 -- 172.21.15.121:0/93491408 wait complete. 2023-12-07T21:09:13.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.459+0000 7fc1db82d800 1 Processor -- start 2023-12-07T21:09:13.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.459+0000 7fc1db82d800 1 -- start start 2023-12-07T21:09:13.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.459+0000 7fc1db82d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24168da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.459+0000 7fc1db82d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d23fd4db0 con 0x557d24036af0 2023-12-07T21:09:13.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.460+0000 7fc1d6a3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24168da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.460+0000 7fc1d6a3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24168da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53152/0 (socket says 172.21.15.121:53152) 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.460+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/2046759511 learned_addr learned my addr 172.21.15.121:0/2046759511 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.460+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/2046759511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c800a100 con 0x557d24036af0 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.460+0000 7fc1d6a3c640 1 --2- 172.21.15.121:0/2046759511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24168da0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007000 tx=0x7fc1c804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d09af30d9741d32 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.460+0000 7fc1d5239640 1 -- 172.21.15.121:0/2046759511 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1c8052560 con 0x557d24036af0 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.460+0000 7fc1d5239640 1 -- 172.21.15.121:0/2046759511 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c8052b10 con 0x557d24036af0 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.460+0000 7fc1d5239640 1 -- 172.21.15.121:0/2046759511 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1c8052db0 con 0x557d24036af0 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.460+0000 7fc1db82d800 1 -- 172.21.15.121:0/2046759511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 msgr2=0x557d24168da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.460+0000 7fc1db82d800 1 --2- 172.21.15.121:0/2046759511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24168da0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007000 tx=0x7fc1c804c000 comp rx=0 tx=0).stop 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1db82d800 1 -- 172.21.15.121:0/2046759511 shutdown_connections 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1db82d800 1 --2- 172.21.15.121:0/2046759511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24168da0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1db82d800 1 -- 172.21.15.121:0/2046759511 >> 172.21.15.121:0/2046759511 conn(0x557d240bc820 msgr2=0x557d24164a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1db82d800 1 -- 172.21.15.121:0/2046759511 shutdown_connections 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1db82d800 1 -- 172.21.15.121:0/2046759511 wait complete. 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1db82d800 1 Processor -- start 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1db82d800 1 -- start start 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1db82d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24170250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1db82d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d23fd06a0 con 0x557d24036af0 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1d6a3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24170250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1d6a3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24170250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53158/0 (socket says 172.21.15.121:53158) 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/2547837200 learned_addr learned my addr 172.21.15.121:0/2547837200 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.461+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/2547837200 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d240cc200 con 0x557d24036af0 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.462+0000 7fc1d6a3c640 1 --2- 172.21.15.121:0/2547837200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24170250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007000 tx=0x7fc1c8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.462+0000 7fc1bffff640 1 -- 172.21.15.121:0/2547837200 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1c806c070 con 0x557d24036af0 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.462+0000 7fc1bffff640 1 -- 172.21.15.121:0/2547837200 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c8052430 con 0x557d24036af0 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.462+0000 7fc1db82d800 1 -- 172.21.15.121:0/2547837200 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557d24170790 con 0x557d24036af0 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.462+0000 7fc1bffff640 1 -- 172.21.15.121:0/2547837200 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1c8070580 con 0x557d24036af0 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.462+0000 7fc1db82d800 1 -- 172.21.15.121:0/2547837200 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d24170cd0 con 0x557d24036af0 2023-12-07T21:09:13.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.462+0000 7fc1db82d800 1 Processor -- start 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.462+0000 7fc1db82d800 1 -- start start 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1bffff640 1 -- 172.21.15.121:0/2547837200 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc1c80663f0 con 0x557d24036af0 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1db82d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 0x557d2417c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1db82d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d23f6a890 con 0x557d2417c450 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1bffff640 1 --2- 172.21.15.121:0/2547837200 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc1c4036110 0x7fc1c40385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1bffff640 1 -- 172.21.15.121:0/2547837200 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc1c808d720 con 0x557d24036af0 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1d723d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 0x557d2417c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1d723d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 0x557d2417c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53164/0 (socket says 172.21.15.121:53164) 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1d723d640 1 -- 172.21.15.121:0/155502467 learned_addr learned my addr 172.21.15.121:0/155502467 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1d6a3c640 1 --2- 172.21.15.121:0/2547837200 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc1c4036110 0x7fc1c40385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1d723d640 1 -- 172.21.15.121:0/155502467 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d2417cdb0 con 0x557d2417c450 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1d6a3c640 1 --2- 172.21.15.121:0/2547837200 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc1c4036110 0x7fc1c40385d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8044870 tx=0x7fc1c8066f70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1d723d640 1 --2- 172.21.15.121:0/155502467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 0x557d2417c870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000a400 tx=0x7fc1d000a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a728a8421fee91e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1bdffb640 1 -- 172.21.15.121:0/155502467 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d00087e0 con 0x557d2417c450 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1bdffb640 1 -- 172.21.15.121:0/155502467 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d0008960 con 0x557d2417c450 2023-12-07T21:09:13.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.463+0000 7fc1bdffb640 1 -- 172.21.15.121:0/155502467 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d0008c80 con 0x557d2417c450 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1db82d800 1 -- 172.21.15.121:0/155502467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 msgr2=0x557d2417c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1db82d800 1 --2- 172.21.15.121:0/155502467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 0x557d2417c870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000a400 tx=0x7fc1d000a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1db82d800 1 -- 172.21.15.121:0/155502467 shutdown_connections 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1db82d800 1 --2- 172.21.15.121:0/155502467 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 0x557d2417c870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1db82d800 1 -- 172.21.15.121:0/155502467 >> 172.21.15.121:0/155502467 conn(0x557d240c76e0 msgr2=0x557d24177830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1db82d800 1 -- 172.21.15.121:0/155502467 shutdown_connections 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1db82d800 1 -- 172.21.15.121:0/155502467 wait complete. 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1db82d800 1 Processor -- start 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1db82d800 1 -- start start 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1db82d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 0x557d24183520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1db82d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d23f6a530 con 0x557d2417c450 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1d723d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 0x557d24183520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1d723d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 0x557d24183520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53174/0 (socket says 172.21.15.121:53174) 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.464+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 learned_addr learned my addr 172.21.15.121:0/1984387003 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.465+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0005c90 con 0x557d2417c450 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.465+0000 7fc1d723d640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 0x557d24183520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000a900 tx=0x7fc1d0002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.465+0000 7fc1b7fff640 1 -- 172.21.15.121:0/1984387003 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d0013780 con 0x557d2417c450 2023-12-07T21:09:13.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.465+0000 7fc1b7fff640 1 -- 172.21.15.121:0/1984387003 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d00138e0 con 0x557d2417c450 2023-12-07T21:09:13.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.465+0000 7fc1b7fff640 1 -- 172.21.15.121:0/1984387003 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc1d0013b80 con 0x557d2417c450 2023-12-07T21:09:13.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.465+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557d24183a60 con 0x557d2417c450 2023-12-07T21:09:13.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.465+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d24183f20 con 0x557d2417c450 2023-12-07T21:09:13.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.466+0000 7fc1b7fff640 1 -- 172.21.15.121:0/1984387003 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc1d001e420 con 0x557d2417c450 2023-12-07T21:09:13.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.466+0000 7fc1b7fff640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc1b00360c0 0x7fc1b0038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.466+0000 7fc1b7fff640 1 -- 172.21.15.121:0/1984387003 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc1d004b700 con 0x557d2417c450 2023-12-07T21:09:13.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.466+0000 7fc1d623b640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc1b00360c0 0x7fc1b0038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.466+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.466+0000 7fc1db82d800 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557d2418ec10 0x557d241910d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.466+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24191820 con 0x557d2418ec10 2023-12-07T21:09:13.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.466+0000 7fc1d623b640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc1b00360c0 0x7fc1b0038580 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc000c00 tx=0x7fc1cc001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.466+0000 7fc1d723d640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557d2418ec10 0x557d241910d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1d723d640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557d2418ec10 0x557d241910d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1db82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1db82d800 20 realm 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24191bf0 con 0x557d2418ec10 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1db82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1db82d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24192470 con 0x557d2418ec10 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1db82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.467+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d241927d0 con 0x557d2418ec10 2023-12-07T21:09:13.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.468+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.468+0000 7fc1db82d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.468+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.468+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24192fd0 con 0x557d2418ec10 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.468+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.468+0000 7fc1db82d800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.468+0000 7fc1db82d800 20 searching for the correct realm 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.468+0000 7fc1db82d800 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557d24194cf0 0x557d24197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.468+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d24194cf0 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.468+0000 7fc1d6a3c640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557d24194cf0 0x557d24197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.468+0000 7fc1d6a3c640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557d24194cf0 0x557d24197160 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.469+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.469+0000 7fc1d6a3c640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc1c807a060 0x7fc1c80796f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.469+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1c807a060 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.469+0000 7fc1d623b640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc1c807a060 0x7fc1c80796f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.469+0000 7fc1d623b640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc1c807a060 0x7fc1c80796f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.469+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.469+0000 7fc1d623b640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc1cc00e8a0 0x7fc1cc00d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.469+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.470+0000 7fc1d723d640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc1cc00e8a0 0x7fc1cc00d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.470+0000 7fc1d723d640 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc1cc00e8a0 0x7fc1cc00d2f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.470+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.470+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d2418ec10 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.470+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.471+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d2418ec10 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.471+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.471+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.471+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.471+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.471+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.471+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1c807a060 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.471+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.471+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d24194cf0 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.472+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.472+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d2418ec10 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.472+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.472+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.472+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.472+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d2418ec10 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.472+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.472+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1c807a060 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.473+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.473+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d24194cf0 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.473+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.473+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d24194cf0 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.473+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.473+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.473+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.473+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d24194cf0 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.474+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.474+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d24194cf0 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.474+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.474+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d2418ec10 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.474+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.474+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d2418ec10 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.474+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.474+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.475+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.475+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d24194cf0 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.475+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.475+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1c807a060 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.475+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.475+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d2418ec10 2023-12-07T21:09:13.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.475+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.475+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.476+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.476+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d24194cf0 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.476+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.476+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.476+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.476+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1c807a060 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.476+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.476+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d24194cf0 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197830 con 0x557d2418ec10 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc1d0053080 con 0x7fc1c807a060 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1db82d800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1db82d800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1db82d800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1db82d800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1db82d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1db82d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.477+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24193930 con 0x557d2418ec10 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24194180 con 0x557d2418ec10 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24194180 con 0x557d24194cf0 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 20 zone default found 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 4 Realm: () 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 20 zonegroup default 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.478+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24197c70 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1db82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24199a30 con 0x557d24194cf0 2023-12-07T21:09:13.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1db82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24199dc0 con 0x557d24194cf0 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1db82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1db82d800 20 started sync module instance, tier type = 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1db82d800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.479+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d24199310 con 0x7fc1c807a060 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.480+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.480+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93995962507088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d241996c0 con 0x7fc1c807a060 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.480+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419a660 con 0x557d2418ec10 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.481+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93995962507088] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.481+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.481+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93995964927600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419a660 con 0x557d2418ec10 2023-12-07T21:09:13.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.481+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419b0c0 con 0x557d24194cf0 2023-12-07T21:09:13.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.482+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93995964927600] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.482+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.482+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93995964932544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419a5d0 con 0x557d24194cf0 2023-12-07T21:09:13.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.482+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419bdb0 con 0x7fc1c807a060 2023-12-07T21:09:13.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.483+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.483+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93995964940640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419ca10 con 0x7fc1c807a060 2023-12-07T21:09:13.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.483+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419d3c0 con 0x557d2418ec10 2023-12-07T21:09:13.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.483+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93995964932544] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.484+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.484+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93995964937328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419d770 con 0x557d2418ec10 2023-12-07T21:09:13.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.484+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419e0e0 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.485+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93995964940640] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.485+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93995964937328] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.485+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.486+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93995964944096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419dc40 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.486+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419e440 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.486+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93995964944096] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.487+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.487+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93995964947520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419e4f0 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.488+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419ecf0 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.488+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93995964947520] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.488+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.488+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93995964948832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419eb10 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.489+0000 7fc1db82d800 20 add_watcher() i=0 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.489+0000 7fc1db82d800 20 add_watcher() i=1 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.489+0000 7fc1db82d800 20 add_watcher() i=2 2023-12-07T21:09:13.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.489+0000 7fc1db82d800 20 add_watcher() i=3 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.489+0000 7fc1db82d800 20 add_watcher() i=4 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.489+0000 7fc1db82d800 20 add_watcher() i=5 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.489+0000 7fc1db82d800 20 add_watcher() i=6 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.489+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93995964948832] v31'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.489+0000 7fc1db82d800 20 add_watcher() i=7 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.489+0000 7fc1db82d800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.489+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d241a2010 con 0x557d2418ec10 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.490+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.490+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93995964949936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419f520 con 0x557d2418ec10 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93995964949936] v31'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc19cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc1db82d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc1db82d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:13.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc1db82d800 5 note: GC not initialized 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc1177fe640 20 reqs_thread_entry: start 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc1db82d800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc1db82d800 20 Filter name: none 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc1157fa640 20 reqs_thread_entry: start 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc1db82d800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.491+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d241d5080 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.492+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.492+0000 7fc1db82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.492+0000 7fc1db82d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.492+0000 7fc1db82d800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.492+0000 7fc1db82d800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.492+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.492+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d241d3830 con 0x557d2418ec10 2023-12-07T21:09:13.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+23 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1db82d800 20 rados_obj.operate() r=0 bl.length=7 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1db82d800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1db82d800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1db82d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1db82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d241d3830 con 0x557d2418ec10 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 foo [call out=48b,read 0~357 out=357b] v0'0 uv1 ondisk = 0) v8 ==== 189+0+405 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1db82d800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1db82d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1db82d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.493+0000 7fc1db82d800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.494+0000 7fc19cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.494+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93995964949936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d241d43a0 con 0x557d2418ec10 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.495+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93995964949936] v31'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.495+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93995962507088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d241d43a0 con 0x7fc1c807a060 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.496+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93995962507088] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.496+0000 7fc1db82d800 20 remove_watcher() i=0 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.496+0000 7fc1db82d800 2 removed watcher, disabling cache 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.496+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93995964927600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2418beb0 con 0x557d2418ec10 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.497+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93995964927600] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.497+0000 7fc1db82d800 20 remove_watcher() i=1 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.497+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93995964932544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2418beb0 con 0x557d24194cf0 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.498+0000 7fc1d6a3c640 1 -- 172.21.15.121:0/1984387003 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93995964932544] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1c8080040 con 0x557d24194cf0 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.498+0000 7fc1db82d800 20 remove_watcher() i=2 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.498+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93995964940640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2418c210 con 0x7fc1c807a060 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.499+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93995964940640] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1cc00f620 con 0x7fc1c807a060 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.499+0000 7fc1db82d800 20 remove_watcher() i=3 2023-12-07T21:09:13.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.499+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93995964937328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2418c570 con 0x557d2418ec10 2023-12-07T21:09:13.500 DEBUG:teuthology.orchestra.run:got remote process result: 240 2023-12-07T21:09:13.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.500+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93995964937328] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x557d2418ec10 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.500+0000 7fc1db82d800 20 remove_watcher() i=4 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.500+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93995964944096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2418c570 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.501+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93995964944096] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.501+0000 7fc1db82d800 20 remove_watcher() i=5 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.501+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93995964947520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419cee0 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.502+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93995964947520] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.502+0000 7fc1db82d800 20 remove_watcher() i=6 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.502+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93995964948832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d2419dc40 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1d723d640 1 -- 172.21.15.121:0/1984387003 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93995964948832] v31'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc1d0024070 con 0x7fc1cc00e8a0 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 20 remove_watcher() i=7 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc1cc00e8a0 msgr2=0x7fc1cc00d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc1cc00e8a0 0x7fc1cc00d2f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557d2418ec10 msgr2=0x557d241910d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557d2418ec10 0x557d241910d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc1c807a060 msgr2=0x7fc1c80796f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc1c807a060 0x7fc1c80796f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557d24194cf0 msgr2=0x557d24197160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557d24194cf0 0x557d24197160 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc1b00360c0 msgr2=0x7fc1b0038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc1b00360c0 0x7fc1b0038580 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc000c00 tx=0x7fc1cc001330 comp rx=0 tx=0).stop 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 msgr2=0x557d24183520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 --2- 172.21.15.121:0/1984387003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d2417c450 0x557d24183520 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000a900 tx=0x7fc1d0002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 reap_dead start 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1d623b640 1 -- 172.21.15.121:0/1984387003 reap_dead start 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 shutdown_connections 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 >> 172.21.15.121:0/1984387003 conn(0x557d240c76e0 msgr2=0x557d24176630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 shutdown_connections 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/1984387003 wait complete. 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/2547837200 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc1c4036110 msgr2=0x7fc1c40385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 --2- 172.21.15.121:0/2547837200 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc1c4036110 0x7fc1c40385d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8044870 tx=0x7fc1c8066f70 comp rx=0 tx=0).stop 2023-12-07T21:09:13.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/2547837200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 msgr2=0x557d24170250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 --2- 172.21.15.121:0/2547837200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24170250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8007000 tx=0x7fc1c8003330 comp rx=0 tx=0).stop 2023-12-07T21:09:13.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/2547837200 shutdown_connections 2023-12-07T21:09:13.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 --2- 172.21.15.121:0/2547837200 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc1c4036110 0x7fc1c40385d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 --2- 172.21.15.121:0/2547837200 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d24036af0 0x557d24170250 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/2547837200 >> 172.21.15.121:0/2547837200 conn(0x557d240bc820 msgr2=0x557d24167ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/2547837200 shutdown_connections 2023-12-07T21:09:13.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.503+0000 7fc1db82d800 1 -- 172.21.15.121:0/2547837200 wait complete. 2023-12-07T21:09:13.503 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-12-07T21:09:13.503 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-12-07T21:09:13.503 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-12-07T21:09:13.546 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:13.546 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:13.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.553+0000 7fe0ab20f800 1 Processor -- start 2023-12-07T21:09:13.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.554+0000 7fe0ab20f800 1 -- start start 2023-12-07T21:09:13.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.554+0000 7fe0ab20f800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555e18dbbb50 0x555e18e49e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.554+0000 7fe0ab20f800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555e18d937a0 con 0x555e18e4a340 2023-12-07T21:09:13.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.554+0000 7fe0ab20f800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x555e18d5c880 con 0x555e18dbbb50 2023-12-07T21:09:13.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.554+0000 7fe0a6947640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555e18dbbb50 0x555e18e49e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.554+0000 7fe09e146640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x555e18e4a340 0x555e18e4c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37706/0 (socket says 172.21.15.121:37706) 2023-12-07T21:09:13.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.554+0000 7fe09e146640 1 -- 172.21.15.121:0/2433638041 learned_addr learned my addr 172.21.15.121:0/2433638041 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:13.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.554+0000 7fe0a6947640 1 -- 172.21.15.121:0/2433638041 >> v1:172.21.15.89:6789/0 conn(0x555e18e4a340 legacy=0x555e18e4c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.554+0000 7fe0a6947640 1 -- 172.21.15.121:0/2433638041 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e18e4f050 con 0x555e18dbbb50 2023-12-07T21:09:13.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.554+0000 7fe0a6146640 1 -- 172.21.15.121:0/2433638041 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678326859 0 0) 0x555e18d937a0 con 0x555e18e4a340 2023-12-07T21:09:13.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.556+0000 7fe0a6947640 1 --2- 172.21.15.121:0/2433638041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18e49e00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe09800a470 tx=0x7fe09801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4505c8fde9b89d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.556+0000 7fe0a6146640 1 -- 172.21.15.121:0/2433638041 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe098052570 con 0x555e18dbbb50 2023-12-07T21:09:13.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.556+0000 7fe0a6146640 1 -- 172.21.15.121:0/2433638041 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0980526d0 con 0x555e18dbbb50 2023-12-07T21:09:13.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.556+0000 7fe0a6146640 1 -- 172.21.15.121:0/2433638041 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe098052990 con 0x555e18dbbb50 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.557+0000 7fe0ab20f800 1 -- 172.21.15.121:0/2433638041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 msgr2=0x555e18e49e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.557+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/2433638041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18e49e00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe09800a470 tx=0x7fe09801cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.557+0000 7fe0ab20f800 1 -- 172.21.15.121:0/2433638041 shutdown_connections 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.557+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/2433638041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18e49e00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.557+0000 7fe0ab20f800 1 -- 172.21.15.121:0/2433638041 >> 172.21.15.121:0/2433638041 conn(0x555e18e41880 msgr2=0x555e18e43ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.557+0000 7fe0ab20f800 1 -- 172.21.15.121:0/2433638041 shutdown_connections 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.557+0000 7fe0ab20f800 1 -- 172.21.15.121:0/2433638041 wait complete. 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.557+0000 7fe0ab20f800 1 Processor -- start 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.557+0000 7fe0ab20f800 1 -- start start 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.558+0000 7fe0ab20f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18e47520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.558+0000 7fe0ab20f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e18d59db0 con 0x555e18dbbb50 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.558+0000 7fe0a6947640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18e47520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.558+0000 7fe0a6947640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18e47520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53202/0 (socket says 172.21.15.121:53202) 2023-12-07T21:09:13.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.558+0000 7fe0a6947640 1 -- 172.21.15.121:0/1737482898 learned_addr learned my addr 172.21.15.121:0/1737482898 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.558+0000 7fe0a6947640 1 -- 172.21.15.121:0/1737482898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098005d20 con 0x555e18dbbb50 2023-12-07T21:09:13.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.558+0000 7fe0a6947640 1 --2- 172.21.15.121:0/1737482898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18e47520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe098055040 tx=0x7fe09804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1418d924064c86ac server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.558+0000 7fe0a5945640 1 -- 172.21.15.121:0/1737482898 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe09800a180 con 0x555e18dbbb50 2023-12-07T21:09:13.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.558+0000 7fe0a5945640 1 -- 172.21.15.121:0/1737482898 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09800a2e0 con 0x555e18dbbb50 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.558+0000 7fe0a5945640 1 -- 172.21.15.121:0/1737482898 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0980529b0 con 0x555e18dbbb50 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0ab20f800 1 -- 172.21.15.121:0/1737482898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 msgr2=0x555e18e47520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/1737482898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18e47520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe098055040 tx=0x7fe09804c000 comp rx=0 tx=0).stop 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0ab20f800 1 -- 172.21.15.121:0/1737482898 shutdown_connections 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/1737482898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18e47520 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0ab20f800 1 -- 172.21.15.121:0/1737482898 >> 172.21.15.121:0/1737482898 conn(0x555e18e41880 msgr2=0x555e18ee78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0ab20f800 1 -- 172.21.15.121:0/1737482898 shutdown_connections 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0ab20f800 1 -- 172.21.15.121:0/1737482898 wait complete. 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0ab20f800 1 Processor -- start 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0ab20f800 1 -- start start 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0ab20f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18ef5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0ab20f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e18d556a0 con 0x555e18dbbb50 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0a6947640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18ef5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0a6947640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18ef5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53216/0 (socket says 172.21.15.121:53216) 2023-12-07T21:09:13.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.559+0000 7fe0a6947640 1 -- 172.21.15.121:0/3473705606 learned_addr learned my addr 172.21.15.121:0/3473705606 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.560+0000 7fe0a6947640 1 -- 172.21.15.121:0/3473705606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e18e4f050 con 0x555e18dbbb50 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.560+0000 7fe0a6947640 1 --2- 172.21.15.121:0/3473705606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18ef5270 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe09805e040 tx=0x7fe098002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.560+0000 7fe0a4943640 1 -- 172.21.15.121:0/3473705606 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe09806a070 con 0x555e18dbbb50 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.560+0000 7fe0a4943640 1 -- 172.21.15.121:0/3473705606 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09805c410 con 0x555e18dbbb50 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.560+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3473705606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555e18ef57b0 con 0x555e18dbbb50 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.560+0000 7fe0a4943640 1 -- 172.21.15.121:0/3473705606 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe09805c6b0 con 0x555e18dbbb50 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.560+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3473705606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e18ef5cf0 con 0x555e18dbbb50 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0ab20f800 1 Processor -- start 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0ab20f800 1 -- start start 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0ab20f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 0x555e18f018b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0a4943640 1 -- 172.21.15.121:0/3473705606 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fe098059030 con 0x555e18dbbb50 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0ab20f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e18cef890 con 0x555e18f01490 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0a7148640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 0x555e18f018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0a7148640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 0x555e18f018b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53222/0 (socket says 172.21.15.121:53222) 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0a7148640 1 -- 172.21.15.121:0/688622003 learned_addr learned my addr 172.21.15.121:0/688622003 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0a4943640 1 --2- 172.21.15.121:0/3473705606 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe088036110 0x7fe0880385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0a4943640 1 -- 172.21.15.121:0/3473705606 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fe09808cc40 con 0x555e18dbbb50 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0a6947640 1 --2- 172.21.15.121:0/3473705606 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe088036110 0x7fe0880385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0a7148640 1 -- 172.21.15.121:0/688622003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e18f01df0 con 0x555e18f01490 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0a7148640 1 --2- 172.21.15.121:0/688622003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 0x555e18f018b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000a430 tx=0x7fe0a000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbb62e147c7de8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe0a6947640 1 --2- 172.21.15.121:0/3473705606 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe088036110 0x7fe0880385d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe09800a470 tx=0x7fe09805c890 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe09d945640 1 -- 172.21.15.121:0/688622003 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0a0001650 con 0x555e18f01490 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe09d945640 1 -- 172.21.15.121:0/688622003 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a00017d0 con 0x555e18f01490 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.561+0000 7fe09d945640 1 -- 172.21.15.121:0/688622003 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0a0001ab0 con 0x555e18f01490 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.562+0000 7fe0ab20f800 1 -- 172.21.15.121:0/688622003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 msgr2=0x555e18f018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.562+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/688622003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 0x555e18f018b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000a430 tx=0x7fe0a000a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.562+0000 7fe0ab20f800 1 -- 172.21.15.121:0/688622003 shutdown_connections 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.562+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/688622003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 0x555e18f018b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.562+0000 7fe0ab20f800 1 -- 172.21.15.121:0/688622003 >> 172.21.15.121:0/688622003 conn(0x555e18e4a340 msgr2=0x555e18efc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.562+0000 7fe0ab20f800 1 -- 172.21.15.121:0/688622003 shutdown_connections 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.562+0000 7fe0ab20f800 1 -- 172.21.15.121:0/688622003 wait complete. 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.562+0000 7fe0ab20f800 1 Processor -- start 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.562+0000 7fe0ab20f800 1 -- start start 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.562+0000 7fe0ab20f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 0x555e18f08440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.562+0000 7fe0ab20f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e18cef530 con 0x555e18f01490 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.563+0000 7fe0a7148640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 0x555e18f08440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.563+0000 7fe0a7148640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 0x555e18f08440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53228/0 (socket says 172.21.15.121:53228) 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.563+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 learned_addr learned my addr 172.21.15.121:0/3488662253 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.563+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a000a0e0 con 0x555e18f01490 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.563+0000 7fe0a7148640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 0x555e18f08440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000a930 tx=0x7fe0a0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.563+0000 7fe087fff640 1 -- 172.21.15.121:0/3488662253 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0a0010900 con 0x555e18f01490 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.563+0000 7fe087fff640 1 -- 172.21.15.121:0/3488662253 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a0010a60 con 0x555e18f01490 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.563+0000 7fe087fff640 1 -- 172.21.15.121:0/3488662253 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0a0010d20 con 0x555e18f01490 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.563+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555e18f08980 con 0x555e18f01490 2023-12-07T21:09:13.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.563+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e18f08de0 con 0x555e18f01490 2023-12-07T21:09:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.564+0000 7fe087fff640 1 -- 172.21.15.121:0/3488662253 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fe0a0017030 con 0x555e18f01490 2023-12-07T21:09:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.564+0000 7fe087fff640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe080036110 0x7fe0800385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.564+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.564+0000 7fe087fff640 1 -- 172.21.15.121:0/3488662253 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fe0a004b890 con 0x555e18f01490 2023-12-07T21:09:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.564+0000 7fe09e146640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe080036110 0x7fe0800385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.564+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x555e18f13b60 0x555e18f16020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.564+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f16770 con 0x555e18f13b60 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0a7148640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x555e18f13b60 0x555e18f16020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe09e146640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe080036110 0x7fe0800385d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe090000c00 tx=0x7fe090001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0a7148640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x555e18f13b60 0x555e18f16020 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0ab20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0ab20f800 20 realm 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f16b40 con 0x555e18f13b60 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0ab20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0ab20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f173c0 con 0x555e18f13b60 2023-12-07T21:09:13.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0ab20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.565+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f17720 con 0x555e18f13b60 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0ab20f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f17060 con 0x555e18f13b60 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0ab20f800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0ab20f800 20 searching for the correct realm 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x555e18f19970 0x555e18f1bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f19970 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0a6947640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x555e18f19970 0x555e18f1bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.566+0000 7fe0a6947640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x555e18f19970 0x555e18f1bd60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.567+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.567+0000 7fe0a6947640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe098078060 0x7fe09808c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.567+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe098078060 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.567+0000 7fe09e146640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe098078060 0x7fe09808c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.567+0000 7fe09e146640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe098078060 0x7fe09808c240 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.567+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.567+0000 7fe09e146640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe09000e8a0 0x7fe09000d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.567+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe09000e8a0 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.568+0000 7fe0a7148640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe09000e8a0 0x7fe09000d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.568+0000 7fe0a7148640 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe09000e8a0 0x7fe09000d2f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.568+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.568+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f13b60 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.568+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.568+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f13b60 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.568+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.569+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe09000e8a0 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.569+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.569+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe09000e8a0 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.569+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.569+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe098078060 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.569+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.569+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f19970 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.569+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.569+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f13b60 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.570+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.570+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe09000e8a0 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.570+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.570+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f13b60 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.570+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.570+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe098078060 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.570+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.570+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f19970 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.571+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.571+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f19970 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.571+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.571+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe09000e8a0 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.571+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.571+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f19970 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.571+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.571+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f19970 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.571+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.572+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f13b60 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.572+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.572+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f13b60 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.572+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.572+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe09000e8a0 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.572+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.572+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f19970 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.573+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.573+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe098078060 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.573+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.573+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f13b60 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.573+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.573+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe09000e8a0 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.573+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.573+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f19970 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.574+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.574+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe09000e8a0 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.574+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.574+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe098078060 2023-12-07T21:09:13.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.574+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.574+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f19970 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.574+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.574+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe09000e8a0 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x555e18f13b60 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1c2a0 con 0x7fe098078060 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0ab20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0ab20f800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0ab20f800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0ab20f800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0ab20f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0ab20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f185f0 con 0x555e18f13b60 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0ab20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.575+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f18270 con 0x555e18f13b60 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f18f80 con 0x555e18f19970 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 20 zone default found 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 4 Realm: () 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:13.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 20 zonegroup default 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1cb80 con 0x7fe09000e8a0 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.576+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1e7c0 con 0x555e18f19970 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.577+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.577+0000 7fe0ab20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.577+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.577+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1ec10 con 0x555e18f19970 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.577+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.577+0000 7fe0ab20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.577+0000 7fe0ab20f800 20 started sync module instance, tier type = 2023-12-07T21:09:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.577+0000 7fe0ab20f800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.577+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1daf0 con 0x7fe098078060 2023-12-07T21:09:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.578+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.578+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93862631370576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1dea0 con 0x7fe098078060 2023-12-07T21:09:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.578+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1f4d0 con 0x555e18f13b60 2023-12-07T21:09:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.581+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.581+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93862633795632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1fa20 con 0x555e18f13b60 2023-12-07T21:09:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.581+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f204f0 con 0x555e18f19970 2023-12-07T21:09:13.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.581+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93862631370576] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.582+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93862633795632] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.584+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.584+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93862633799632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f1f480 con 0x555e18f19970 2023-12-07T21:09:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.584+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f20d40 con 0x7fe098078060 2023-12-07T21:09:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.585+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.585+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93862633803936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f21950 con 0x7fe098078060 2023-12-07T21:09:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.585+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f222c0 con 0x555e18f13b60 2023-12-07T21:09:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.585+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93862633799632] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.586+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.586+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93862633807392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f226d0 con 0x555e18f13b60 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.586+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93862633803936] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.586+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f214b0 con 0x7fe09000e8a0 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.587+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.587+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93862633807392] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.587+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93862633809616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f22f80 con 0x7fe09000e8a0 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.587+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f22230 con 0x7fe09000e8a0 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.590+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93862633809616] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.590+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.590+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93862633810656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f23390 con 0x7fe09000e8a0 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.590+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f23b90 con 0x7fe09000e8a0 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.592+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.592+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93862633813360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f23f60 con 0x7fe09000e8a0 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.592+0000 7fe0ab20f800 20 add_watcher() i=0 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.592+0000 7fe0ab20f800 20 add_watcher() i=1 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.592+0000 7fe0ab20f800 20 add_watcher() i=2 2023-12-07T21:09:13.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.592+0000 7fe0ab20f800 20 add_watcher() i=3 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.592+0000 7fe0ab20f800 20 add_watcher() i=4 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.592+0000 7fe0ab20f800 20 add_watcher() i=5 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.592+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93862633810656] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.592+0000 7fe0ab20f800 20 add_watcher() i=6 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.593+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93862633813360] v31'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.593+0000 7fe0ab20f800 20 add_watcher() i=7 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.593+0000 7fe0ab20f800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.593+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f22ef0 con 0x555e18f13b60 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.593+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.593+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93862633814528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f22ef0 con 0x555e18f13b60 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.594+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93862633814528] v31'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.594+0000 7fe06cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.594+0000 7fe0ab20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.594+0000 7fe0ab20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:13.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.594+0000 7fe0ab20f800 5 note: GC not initialized 2023-12-07T21:09:13.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.594+0000 7fdfe77fe640 20 reqs_thread_entry: start 2023-12-07T21:09:13.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.595+0000 7fe0ab20f800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:13.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.595+0000 7fe0ab20f800 20 Filter name: none 2023-12-07T21:09:13.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.595+0000 7fdfe57fa640 20 reqs_thread_entry: start 2023-12-07T21:09:13.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.595+0000 7fe0ab20f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.595+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f59a30 con 0x555e18f13b60 2023-12-07T21:09:13.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.595+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.595+0000 7fe0ab20f800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:13.591 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:13.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.596+0000 7fe06cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.596+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93862633814528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f248a0 con 0x555e18f13b60 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.597+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93862633814528] v31'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.597+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93862631370576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f248a0 con 0x7fe098078060 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.598+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93862631370576] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.598+0000 7fe0ab20f800 20 remove_watcher() i=0 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.598+0000 7fe0ab20f800 2 removed watcher, disabling cache 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.598+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93862633795632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f24c00 con 0x555e18f13b60 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.599+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93862633795632] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.599+0000 7fe0ab20f800 20 remove_watcher() i=1 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.599+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93862633799632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f24c00 con 0x555e18f19970 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.600+0000 7fe0a6947640 1 -- 172.21.15.121:0/3488662253 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93862633799632] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe09805cb90 con 0x555e18f19970 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.600+0000 7fe0ab20f800 20 remove_watcher() i=2 2023-12-07T21:09:13.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.600+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93862633803936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f24f60 con 0x7fe098078060 2023-12-07T21:09:13.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.601+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93862633803936] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe09000f620 con 0x7fe098078060 2023-12-07T21:09:13.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.601+0000 7fe0ab20f800 20 remove_watcher() i=3 2023-12-07T21:09:13.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.601+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93862633807392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f252c0 con 0x555e18f13b60 2023-12-07T21:09:13.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.602+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93862633807392] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x555e18f13b60 2023-12-07T21:09:13.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.602+0000 7fe0ab20f800 20 remove_watcher() i=4 2023-12-07T21:09:13.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.602+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93862633809616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f252c0 con 0x7fe09000e8a0 2023-12-07T21:09:13.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.603+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93862633809616] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.603+0000 7fe0ab20f800 20 remove_watcher() i=5 2023-12-07T21:09:13.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.603+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93862633810656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f226d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.604+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93862633810656] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.604+0000 7fe0ab20f800 20 remove_watcher() i=6 2023-12-07T21:09:13.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.604+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93862633813360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x555e18f226d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.604+0000 7fe0a7148640 1 -- 172.21.15.121:0/3488662253 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93862633813360] v31'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0a002e9d0 con 0x7fe09000e8a0 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.604+0000 7fe0ab20f800 20 remove_watcher() i=7 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe09000e8a0 msgr2=0x7fe09000d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe09000e8a0 0x7fe09000d2f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x555e18f13b60 msgr2=0x555e18f16020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x555e18f13b60 0x555e18f16020 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe098078060 msgr2=0x7fe09808c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe098078060 0x7fe09808c240 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x555e18f19970 msgr2=0x555e18f1bd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x555e18f19970 0x555e18f1bd60 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe080036110 msgr2=0x7fe0800385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe080036110 0x7fe0800385d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe090000c00 tx=0x7fe090001330 comp rx=0 tx=0).stop 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 msgr2=0x555e18f08440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3488662253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18f01490 0x555e18f08440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe0a000a930 tx=0x7fe0a0003370 comp rx=0 tx=0).stop 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 reap_dead start 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe09e146640 1 -- 172.21.15.121:0/3488662253 reap_dead start 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 shutdown_connections 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 >> 172.21.15.121:0/3488662253 conn(0x555e18e4a340 msgr2=0x555e18efb670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 shutdown_connections 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3488662253 wait complete. 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3473705606 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe088036110 msgr2=0x7fe0880385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3473705606 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe088036110 0x7fe0880385d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe09800a470 tx=0x7fe09805c890 comp rx=0 tx=0).stop 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3473705606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 msgr2=0x555e18ef5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3473705606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18ef5270 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe09805e040 tx=0x7fe098002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3473705606 shutdown_connections 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3473705606 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe088036110 0x7fe0880385d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 --2- 172.21.15.121:0/3473705606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555e18dbbb50 0x555e18ef5270 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3473705606 >> 172.21.15.121:0/3473705606 conn(0x555e18e41880 msgr2=0x555e18e45d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3473705606 shutdown_connections 2023-12-07T21:09:13.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.605+0000 7fe0ab20f800 1 -- 172.21.15.121:0/3473705606 wait complete. 2023-12-07T21:09:13.601 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:13.601 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2023-12-07T21:09:13.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2023-12-07T21:09:13.602 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2023-12-07T21:09:13.684 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:13.685 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:13.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.692+0000 7fed04f2c800 1 Processor -- start 2023-12-07T21:09:13.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.692+0000 7fed04f2c800 1 -- start start 2023-12-07T21:09:13.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.692+0000 7fed04f2c800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ba6b83d7d0 0x55ba6b83fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.692+0000 7fed04f2c800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ba6b7857a0 con 0x55ba6b83a840 2023-12-07T21:09:13.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.692+0000 7fed04f2c800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ba6b74e880 con 0x55ba6b83d7d0 2023-12-07T21:09:13.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.693+0000 7fed004ef640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ba6b83d7d0 0x55ba6b83fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.693+0000 7fed00cf0640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55ba6b83a840 0x55ba6b83ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37720/0 (socket says 172.21.15.121:37720) 2023-12-07T21:09:13.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.693+0000 7fed00cf0640 1 -- 172.21.15.121:0/44705732 learned_addr learned my addr 172.21.15.121:0/44705732 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:13.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.693+0000 7fed004ef640 1 -- 172.21.15.121:0/44705732 >> v1:172.21.15.89:6789/0 conn(0x55ba6b83a840 legacy=0x55ba6b83ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.693+0000 7fed004ef640 1 -- 172.21.15.121:0/44705732 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba6b841110 con 0x55ba6b83d7d0 2023-12-07T21:09:13.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.693+0000 7fecffcee640 1 -- 172.21.15.121:0/44705732 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723004103 0 0) 0x55ba6b7857a0 con 0x55ba6b83a840 2023-12-07T21:09:13.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.695+0000 7fed004ef640 1 --2- 172.21.15.121:0/44705732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83d7d0 0x55ba6b83fbc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fecf400a470 tx=0x7fecf401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e3c826c145320d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.695+0000 7fecffcee640 1 -- 172.21.15.121:0/44705732 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf4052570 con 0x55ba6b83d7d0 2023-12-07T21:09:13.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.695+0000 7fecffcee640 1 -- 172.21.15.121:0/44705732 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf40526d0 con 0x55ba6b83d7d0 2023-12-07T21:09:13.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.695+0000 7fecffcee640 1 -- 172.21.15.121:0/44705732 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf4052990 con 0x55ba6b83d7d0 2023-12-07T21:09:13.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.695+0000 7fed04f2c800 1 -- 172.21.15.121:0/44705732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83d7d0 msgr2=0x55ba6b83fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.695+0000 7fed04f2c800 1 --2- 172.21.15.121:0/44705732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83d7d0 0x55ba6b83fbc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fecf400a470 tx=0x7fecf401cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:13.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.695+0000 7fed04f2c800 1 -- 172.21.15.121:0/44705732 shutdown_connections 2023-12-07T21:09:13.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.695+0000 7fed04f2c800 1 --2- 172.21.15.121:0/44705732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83d7d0 0x55ba6b83fbc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.695+0000 7fed04f2c800 1 -- 172.21.15.121:0/44705732 >> 172.21.15.121:0/44705732 conn(0x55ba6b832f60 msgr2=0x55ba6b835380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.695+0000 7fed04f2c800 1 -- 172.21.15.121:0/44705732 shutdown_connections 2023-12-07T21:09:13.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.695+0000 7fed04f2c800 1 -- 172.21.15.121:0/44705732 wait complete. 2023-12-07T21:09:13.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.696+0000 7fed04f2c800 1 Processor -- start 2023-12-07T21:09:13.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.696+0000 7fed04f2c800 1 -- start start 2023-12-07T21:09:13.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.696+0000 7fed04f2c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b839cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.696+0000 7fed04f2c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba6b74bdb0 con 0x55ba6b83a840 2023-12-07T21:09:13.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.696+0000 7fed00cf0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b839cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.696+0000 7fed00cf0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b839cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53238/0 (socket says 172.21.15.121:53238) 2023-12-07T21:09:13.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.696+0000 7fed00cf0640 1 -- 172.21.15.121:0/496878136 learned_addr learned my addr 172.21.15.121:0/496878136 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.697+0000 7fed00cf0640 1 -- 172.21.15.121:0/496878136 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4005d20 con 0x55ba6b83a840 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.697+0000 7fed00cf0640 1 --2- 172.21.15.121:0/496878136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b839cd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fecf000b240 tx=0x7fecf000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e39eeb8421dd6f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.697+0000 7fecff4ed640 1 -- 172.21.15.121:0/496878136 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf0014070 con 0x55ba6b83a840 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.697+0000 7fecff4ed640 1 -- 172.21.15.121:0/496878136 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf000d500 con 0x55ba6b83a840 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.697+0000 7fecff4ed640 1 -- 172.21.15.121:0/496878136 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf000d820 con 0x55ba6b83a840 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.697+0000 7fed04f2c800 1 -- 172.21.15.121:0/496878136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 msgr2=0x55ba6b839cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.697+0000 7fed04f2c800 1 --2- 172.21.15.121:0/496878136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b839cd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fecf000b240 tx=0x7fecf000b700 comp rx=0 tx=0).stop 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.697+0000 7fed04f2c800 1 -- 172.21.15.121:0/496878136 shutdown_connections 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.697+0000 7fed04f2c800 1 --2- 172.21.15.121:0/496878136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b839cd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.698+0000 7fed04f2c800 1 -- 172.21.15.121:0/496878136 >> 172.21.15.121:0/496878136 conn(0x55ba6b832f60 msgr2=0x55ba6b8d99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.698+0000 7fed04f2c800 1 -- 172.21.15.121:0/496878136 shutdown_connections 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.698+0000 7fed04f2c800 1 -- 172.21.15.121:0/496878136 wait complete. 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.698+0000 7fed04f2c800 1 Processor -- start 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.698+0000 7fed04f2c800 1 -- start start 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.698+0000 7fed04f2c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b8e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.698+0000 7fed04f2c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba6b7476a0 con 0x55ba6b83a840 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.698+0000 7fed00cf0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b8e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.698+0000 7fed00cf0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b8e73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53242/0 (socket says 172.21.15.121:53242) 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.698+0000 7fed00cf0640 1 -- 172.21.15.121:0/2119112165 learned_addr learned my addr 172.21.15.121:0/2119112165 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.698+0000 7fed00cf0640 1 -- 172.21.15.121:0/2119112165 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0001ba0 con 0x55ba6b83a840 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.699+0000 7fed00cf0640 1 --2- 172.21.15.121:0/2119112165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b8e73c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55ba6b8da420 tx=0x7fecf0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.699+0000 7fecfe4eb640 1 -- 172.21.15.121:0/2119112165 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf000de10 con 0x55ba6b83a840 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.699+0000 7fecfe4eb640 1 -- 172.21.15.121:0/2119112165 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf0020070 con 0x55ba6b83a840 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.699+0000 7fed04f2c800 1 -- 172.21.15.121:0/2119112165 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ba6b8e7900 con 0x55ba6b83a840 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.699+0000 7fecfe4eb640 1 -- 172.21.15.121:0/2119112165 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf000faf0 con 0x55ba6b83a840 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.699+0000 7fed04f2c800 1 -- 172.21.15.121:0/2119112165 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba6b8e7de0 con 0x55ba6b83a840 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.699+0000 7fed04f2c800 1 Processor -- start 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.699+0000 7fed04f2c800 1 -- start start 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.699+0000 7fecfe4eb640 1 -- 172.21.15.121:0/2119112165 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fecf000d040 con 0x55ba6b83a840 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fed04f2c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 0x55ba6b8f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fed04f2c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba6b6e1890 con 0x55ba6b8f3610 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fecfe4eb640 1 --2- 172.21.15.121:0/2119112165 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fecec036110 0x7fecec0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fed014f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 0x55ba6b8f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fecfe4eb640 1 -- 172.21.15.121:0/2119112165 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fecf000a040 con 0x55ba6b83a840 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fed014f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 0x55ba6b8f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53248/0 (socket says 172.21.15.121:53248) 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fed014f1640 1 -- 172.21.15.121:0/1387674292 learned_addr learned my addr 172.21.15.121:0/1387674292 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fed00cf0640 1 --2- 172.21.15.121:0/2119112165 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fecec036110 0x7fecec0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fed014f1640 1 -- 172.21.15.121:0/1387674292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba6b8f3f70 con 0x55ba6b8f3610 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fed00cf0640 1 --2- 172.21.15.121:0/2119112165 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fecec036110 0x7fecec0385d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fecf001adb0 tx=0x7fecf0043040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fed014f1640 1 --2- 172.21.15.121:0/1387674292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 0x55ba6b8f3a30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fecf800a430 tx=0x7fecf800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a412cd150c840c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fece7fff640 1 -- 172.21.15.121:0/1387674292 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf8001650 con 0x55ba6b8f3610 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fece7fff640 1 -- 172.21.15.121:0/1387674292 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf80017d0 con 0x55ba6b8f3610 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.700+0000 7fece7fff640 1 -- 172.21.15.121:0/1387674292 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf8001ab0 con 0x55ba6b8f3610 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.701+0000 7fed04f2c800 1 -- 172.21.15.121:0/1387674292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 msgr2=0x55ba6b8f3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.701+0000 7fed04f2c800 1 --2- 172.21.15.121:0/1387674292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 0x55ba6b8f3a30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fecf800a430 tx=0x7fecf800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.701+0000 7fed04f2c800 1 -- 172.21.15.121:0/1387674292 shutdown_connections 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.701+0000 7fed04f2c800 1 --2- 172.21.15.121:0/1387674292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 0x55ba6b8f3a30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.701+0000 7fed04f2c800 1 -- 172.21.15.121:0/1387674292 >> 172.21.15.121:0/1387674292 conn(0x55ba6b83d7d0 msgr2=0x55ba6b8ee9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.701+0000 7fed04f2c800 1 -- 172.21.15.121:0/1387674292 shutdown_connections 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.701+0000 7fed04f2c800 1 -- 172.21.15.121:0/1387674292 wait complete. 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.701+0000 7fed04f2c800 1 Processor -- start 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.701+0000 7fed04f2c800 1 -- start start 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.701+0000 7fed04f2c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 0x55ba6b8fa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.701+0000 7fed04f2c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba6b6e1530 con 0x55ba6b8f3610 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.702+0000 7fed014f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 0x55ba6b8fa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.702+0000 7fed014f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 0x55ba6b8fa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53254/0 (socket says 172.21.15.121:53254) 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.702+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 learned_addr learned my addr 172.21.15.121:0/2570035591 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.702+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf800a0e0 con 0x55ba6b8f3610 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.702+0000 7fed014f1640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 0x55ba6b8fa6b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fecf800a930 tx=0x7fecf8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.702+0000 7fece67fc640 1 -- 172.21.15.121:0/2570035591 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf8010900 con 0x55ba6b8f3610 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.702+0000 7fece67fc640 1 -- 172.21.15.121:0/2570035591 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf8010a60 con 0x55ba6b8f3610 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.702+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ba6b8fabf0 con 0x55ba6b8f3610 2023-12-07T21:09:13.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.702+0000 7fece67fc640 1 -- 172.21.15.121:0/2570035591 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecf8010d20 con 0x55ba6b8f3610 2023-12-07T21:09:13.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.702+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba6b8fb050 con 0x55ba6b8f3610 2023-12-07T21:09:13.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.703+0000 7fece67fc640 1 -- 172.21.15.121:0/2570035591 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fecf8017030 con 0x55ba6b8f3610 2023-12-07T21:09:13.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.703+0000 7fece67fc640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fecdc0360c0 0x7fecdc038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.703+0000 7fece67fc640 1 -- 172.21.15.121:0/2570035591 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fecf804b850 con 0x55ba6b8f3610 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.703+0000 7fed004ef640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fecdc0360c0 0x7fecdc038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.704+0000 7fed004ef640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fecdc0360c0 0x7fecdc038580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fecf4054000 tx=0x7fecf404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.704+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.704+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55ba6b905d10 0x55ba6b9081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.704+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b908920 con 0x55ba6b905d10 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.704+0000 7fed014f1640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55ba6b905d10 0x55ba6b9081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.704+0000 7fed014f1640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55ba6b905d10 0x55ba6b9081d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.704+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 20 realm 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b908d30 con 0x55ba6b905d10 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b9095b0 con 0x55ba6b905d10 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b909910 con 0x55ba6b905d10 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90a110 con 0x55ba6b905d10 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 20 searching for the correct realm 2023-12-07T21:09:13.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55ba6b90be30 0x55ba6b90e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.705+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b90be30 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.706+0000 7fed00cf0640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55ba6b90be30 0x55ba6b90e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.706+0000 7fed00cf0640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55ba6b90be30 0x55ba6b90e2a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.706+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.706+0000 7fed00cf0640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fecf0047b80 0x7fecf00183d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.706+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf0047b80 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.706+0000 7fed004ef640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fecf0047b80 0x7fecf00183d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.706+0000 7fed004ef640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fecf0047b80 0x7fecf00183d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.707+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4059040 con 0x7fecf0047b80 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.707+0000 7fed004ef640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fecf405d930 0x7fecf4009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.707+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf405d930 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.707+0000 7fed014f1640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fecf405d930 0x7fecf4009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.707+0000 7fed014f1640 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fecf405d930 0x7fecf4009410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.708+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.708+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b905d10 2023-12-07T21:09:13.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.708+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.708+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b905d10 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.708+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.708+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf405d930 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.708+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.708+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf405d930 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.708+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.708+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf0047b80 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.709+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4059040 con 0x7fecf0047b80 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.709+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b90be30 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.709+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.709+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b905d10 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.709+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.709+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf405d930 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.709+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.709+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b905d10 2023-12-07T21:09:13.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.710+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.710+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf0047b80 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.710+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fecf4059040 con 0x7fecf0047b80 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.710+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b90be30 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.710+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.710+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b90be30 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.710+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.710+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf405d930 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.711+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.711+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b90be30 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.711+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.711+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b90be30 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.711+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.711+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b905d10 2023-12-07T21:09:13.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.711+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.711+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b905d10 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.712+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.712+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf405d930 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.712+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.712+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b90be30 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.712+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.712+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf0047b80 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.712+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4059040 con 0x7fecf0047b80 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.712+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b905d10 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.713+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.713+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf405d930 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.713+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.713+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b90be30 2023-12-07T21:09:13.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.713+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.713+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf405d930 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.713+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.713+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf0047b80 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.714+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4059040 con 0x7fecf0047b80 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.714+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b90be30 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.714+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.714+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x7fecf405d930 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.714+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.714+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90e970 con 0x55ba6b905d10 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecf8053080 con 0x7fecf0047b80 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fecf4059040 con 0x7fecf0047b80 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:13.721 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90aa40 con 0x55ba6b905d10 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90b290 con 0x55ba6b905d10 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.715+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90b290 con 0x55ba6b90be30 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:13.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 20 zone default found 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 4 Realm: () 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 20 zonegroup default 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b90edb0 con 0x7fecf405d930 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b910b40 con 0x55ba6b90be30 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b910ea0 con 0x55ba6b90be30 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.716+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.717+0000 7fed04f2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.717+0000 7fed04f2c800 20 started sync module instance, tier type = 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.717+0000 7fed04f2c800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.717+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b910420 con 0x7fecf0047b80 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.718+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf4059040 con 0x7fecf0047b80 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.718+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94259154521936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b9107d0 con 0x7fecf0047b80 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.718+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b911740 con 0x55ba6b905d10 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.719+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94259154521936] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf4072040 con 0x7fecf0047b80 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.719+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.719+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94259156942720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b911740 con 0x55ba6b905d10 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.719+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b9121e0 con 0x55ba6b90be30 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.720+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.720+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94259156950208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b912a30 con 0x55ba6b90be30 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.720+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b913450 con 0x7fecf0047b80 2023-12-07T21:09:13.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.721+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94259156942720] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.721+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94259156950208] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.721+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf4072040 con 0x7fecf0047b80 2023-12-07T21:09:13.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.721+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94259156954928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b913800 con 0x7fecf0047b80 2023-12-07T21:09:13.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.721+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b914000 con 0x55ba6b905d10 2023-12-07T21:09:13.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.723+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94259156954928] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf4072040 con 0x7fecf0047b80 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.726+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.726+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94259156958048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b914410 con 0x55ba6b905d10 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.726+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b914c10 con 0x7fecf405d930 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.727+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94259156958048] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.727+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.727+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94259156959360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b9149f0 con 0x7fecf405d930 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.727+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b9154c0 con 0x7fecf405d930 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.728+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94259156959360] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.731+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.731+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94259156963232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b915480 con 0x7fecf405d930 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.731+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b915df0 con 0x7fecf405d930 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.733+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.733+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94259156965712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b916200 con 0x7fecf405d930 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed04f2c800 20 add_watcher() i=0 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed04f2c800 20 add_watcher() i=1 2023-12-07T21:09:13.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed04f2c800 20 add_watcher() i=2 2023-12-07T21:09:13.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed04f2c800 20 add_watcher() i=3 2023-12-07T21:09:13.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed04f2c800 20 add_watcher() i=4 2023-12-07T21:09:13.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed04f2c800 20 add_watcher() i=5 2023-12-07T21:09:13.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94259156963232] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed04f2c800 20 add_watcher() i=6 2023-12-07T21:09:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94259156965712] v31'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed04f2c800 20 add_watcher() i=7 2023-12-07T21:09:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed04f2c800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.734+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b916200 con 0x55ba6b905d10 2023-12-07T21:09:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.735+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.735+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94259156966752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b916170 con 0x55ba6b905d10 2023-12-07T21:09:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94259156966752] v31'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fecc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fed04f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fed04f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fed04f2c800 5 note: GC not initialized 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fecc5fe3640 20 reqs_thread_entry: start 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fed04f2c800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fed04f2c800 20 Filter name: none 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fec377fe640 20 reqs_thread_entry: start 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fed04f2c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fed04f2c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.736+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b94c160 con 0x55ba6b905d10 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.737+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.737+0000 7fed04f2c800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.737+0000 7fed04f2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.737+0000 7fed04f2c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.737+0000 7fed04f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.737+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b94e5a0 con 0x7fecf0047b80 2023-12-07T21:09:13.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.737+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fecf4072040 con 0x7fecf0047b80 2023-12-07T21:09:13.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.737+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b952080 con 0x55ba6b905d10 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.738+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v31'2 uv2 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.738+0000 7fed04f2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.738+0000 7fed04f2c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.738+0000 7fed04f2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.738+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94259157212448 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b94eda0 con 0x55ba6b905d10 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.739+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94259156958048 notify 133143986177 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55ba6b8fb050 con 0x55ba6b905d10 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.739+0000 7fece7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94259156958048 notifier 4294 bl.length()=533 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.739+0000 7fece7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.739+0000 7fece7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.739+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(65 notify.4 [notify cookie 94259157212448 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.739+0000 7fece7fff640 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fecd40042a0 con 0x55ba6b905d10 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.739+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.739+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== watch-notify(notify_complete (2) cookie 94259157212448 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ba6b8fabf0 con 0x55ba6b905d10 2023-12-07T21:09:13.734 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:13.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.740+0000 7fecc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.740+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94259156966752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b901e20 con 0x55ba6b905d10 2023-12-07T21:09:13.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.741+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94259156966752] v31'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.741+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94259154521936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b901e20 con 0x7fecf0047b80 2023-12-07T21:09:13.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.742+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94259154521936] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf4072040 con 0x7fecf0047b80 2023-12-07T21:09:13.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.742+0000 7fed04f2c800 20 remove_watcher() i=0 2023-12-07T21:09:13.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.742+0000 7fed04f2c800 2 removed watcher, disabling cache 2023-12-07T21:09:13.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.742+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94259156942720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b902180 con 0x55ba6b905d10 2023-12-07T21:09:13.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.743+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94259156942720] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.743+0000 7fed04f2c800 20 remove_watcher() i=1 2023-12-07T21:09:13.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.743+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94259156950208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b902180 con 0x55ba6b90be30 2023-12-07T21:09:13.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.744+0000 7fed00cf0640 1 -- 172.21.15.121:0/2570035591 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94259156950208] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf0016070 con 0x55ba6b90be30 2023-12-07T21:09:13.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.744+0000 7fed04f2c800 20 remove_watcher() i=2 2023-12-07T21:09:13.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.744+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94259156954928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b902180 con 0x7fecf0047b80 2023-12-07T21:09:13.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.745+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94259156954928] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf4072040 con 0x7fecf0047b80 2023-12-07T21:09:13.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.745+0000 7fed04f2c800 20 remove_watcher() i=3 2023-12-07T21:09:13.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.745+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94259156958048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b9024e0 con 0x55ba6b905d10 2023-12-07T21:09:13.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.746+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94259156958048] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x55ba6b905d10 2023-12-07T21:09:13.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.746+0000 7fed04f2c800 20 remove_watcher() i=4 2023-12-07T21:09:13.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.746+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94259156959360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b9024e0 con 0x7fecf405d930 2023-12-07T21:09:13.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.747+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94259156959360] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.747+0000 7fed04f2c800 20 remove_watcher() i=5 2023-12-07T21:09:13.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.747+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94259156963232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b914080 con 0x7fecf405d930 2023-12-07T21:09:13.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.748+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94259156963232] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.748+0000 7fed04f2c800 20 remove_watcher() i=6 2023-12-07T21:09:13.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.748+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94259156965712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ba6b914080 con 0x7fecf405d930 2023-12-07T21:09:13.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed014f1640 1 -- 172.21.15.121:0/2570035591 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94259156965712] v31'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fecf802ea00 con 0x7fecf405d930 2023-12-07T21:09:13.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 20 remove_watcher() i=7 2023-12-07T21:09:13.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fecf405d930 msgr2=0x7fecf4009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fecf405d930 0x7fecf4009410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55ba6b905d10 msgr2=0x55ba6b9081d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55ba6b905d10 0x55ba6b9081d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fecf0047b80 msgr2=0x7fecf00183d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fecf0047b80 0x7fecf00183d0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55ba6b90be30 msgr2=0x55ba6b90e2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55ba6b90be30 0x55ba6b90e2a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fecdc0360c0 msgr2=0x7fecdc038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fecdc0360c0 0x7fecdc038580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fecf4054000 tx=0x7fecf404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 msgr2=0x55ba6b8fa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2570035591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b8f3610 0x55ba6b8fa6b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fecf800a930 tx=0x7fecf8003370 comp rx=0 tx=0).stop 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 reap_dead start 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed004ef640 1 -- 172.21.15.121:0/2570035591 reap_dead start 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 shutdown_connections 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 >> 172.21.15.121:0/2570035591 conn(0x55ba6b83d7d0 msgr2=0x55ba6b8ed7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 shutdown_connections 2023-12-07T21:09:13.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 -- 172.21.15.121:0/2570035591 wait complete. 2023-12-07T21:09:13.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 -- 172.21.15.121:0/2119112165 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fecec036110 msgr2=0x7fecec0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.749+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2119112165 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fecec036110 0x7fecec0385d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fecf001adb0 tx=0x7fecf0043040 comp rx=0 tx=0).stop 2023-12-07T21:09:13.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.750+0000 7fed04f2c800 1 -- 172.21.15.121:0/2119112165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 msgr2=0x55ba6b8e73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.750+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2119112165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b8e73c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55ba6b8da420 tx=0x7fecf0000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.750+0000 7fed04f2c800 1 -- 172.21.15.121:0/2119112165 shutdown_connections 2023-12-07T21:09:13.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.750+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2119112165 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fecec036110 0x7fecec0385d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.750+0000 7fed04f2c800 1 --2- 172.21.15.121:0/2119112165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ba6b83a840 0x55ba6b8e73c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.750+0000 7fed04f2c800 1 -- 172.21.15.121:0/2119112165 >> 172.21.15.121:0/2119112165 conn(0x55ba6b832f60 msgr2=0x55ba6b838620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.750+0000 7fed04f2c800 1 -- 172.21.15.121:0/2119112165 shutdown_connections 2023-12-07T21:09:13.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.750+0000 7fed04f2c800 1 -- 172.21.15.121:0/2119112165 wait complete. 2023-12-07T21:09:13.746 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:13.746 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-12-07T21:09:13.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-12-07T21:09:13.746 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-12-07T21:09:13.828 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:13.828 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:13.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.836+0000 7f900393d800 1 Processor -- start 2023-12-07T21:09:13.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.836+0000 7f900393d800 1 -- start start 2023-12-07T21:09:13.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.836+0000 7f900393d800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557526b13280 0x557526b136a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.836+0000 7f900393d800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557526a5f7a0 con 0x557526b14440 2023-12-07T21:09:13.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.836+0000 7f900393d800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x557526a28880 con 0x557526b13280 2023-12-07T21:09:13.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.837+0000 7f8ffee9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x557526b14440 0x557526b148c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37736/0 (socket says 172.21.15.121:37736) 2023-12-07T21:09:13.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.837+0000 7f8ffee9b640 1 -- 172.21.15.121:0/1358677187 learned_addr learned my addr 172.21.15.121:0/1358677187 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:13.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.837+0000 7f8fff69c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557526b13280 0x557526b136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.837+0000 7f8fff69c640 1 -- 172.21.15.121:0/1358677187 >> v1:172.21.15.89:6789/0 conn(0x557526b14440 legacy=0x557526b148c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.837+0000 7f8fff69c640 1 -- 172.21.15.121:0/1358677187 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557526b13d70 con 0x557526b13280 2023-12-07T21:09:13.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.837+0000 7f8ffe69a640 1 -- 172.21.15.121:0/1358677187 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615629990 0 0) 0x557526a5f7a0 con 0x557526b14440 2023-12-07T21:09:13.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.839+0000 7f8fff69c640 1 --2- 172.21.15.121:0/1358677187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526b136a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0005fd0 tx=0x7f8ff001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9ecce3f2c09800 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.839+0000 7f8ffe69a640 1 -- 172.21.15.121:0/1358677187 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff0052560 con 0x557526b13280 2023-12-07T21:09:13.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.839+0000 7f8ffe69a640 1 -- 172.21.15.121:0/1358677187 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff00526c0 con 0x557526b13280 2023-12-07T21:09:13.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.839+0000 7f8ffe69a640 1 -- 172.21.15.121:0/1358677187 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff00529a0 con 0x557526b13280 2023-12-07T21:09:13.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.839+0000 7f900393d800 1 -- 172.21.15.121:0/1358677187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 msgr2=0x557526b136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.839+0000 7f900393d800 1 --2- 172.21.15.121:0/1358677187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526b136a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0005fd0 tx=0x7f8ff001cb90 comp rx=0 tx=0).stop 2023-12-07T21:09:13.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.839+0000 7f900393d800 1 -- 172.21.15.121:0/1358677187 shutdown_connections 2023-12-07T21:09:13.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.839+0000 7f900393d800 1 --2- 172.21.15.121:0/1358677187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526b136a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.839+0000 7f900393d800 1 -- 172.21.15.121:0/1358677187 >> 172.21.15.121:0/1358677187 conn(0x557526b0e980 msgr2=0x557526b10da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.839+0000 7f900393d800 1 -- 172.21.15.121:0/1358677187 shutdown_connections 2023-12-07T21:09:13.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.839+0000 7f900393d800 1 -- 172.21.15.121:0/1358677187 wait complete. 2023-12-07T21:09:13.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.840+0000 7f900393d800 1 Processor -- start 2023-12-07T21:09:13.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.840+0000 7f900393d800 1 -- start start 2023-12-07T21:09:13.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.840+0000 7f900393d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bb8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.840+0000 7f900393d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557526a25db0 con 0x557526b13280 2023-12-07T21:09:13.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.840+0000 7f8fff69c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bb8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f8fff69c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bb8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53276/0 (socket says 172.21.15.121:53276) 2023-12-07T21:09:13.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f8fff69c640 1 -- 172.21.15.121:0/2697934849 learned_addr learned my addr 172.21.15.121:0/2697934849 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f8fff69c640 1 -- 172.21.15.121:0/2697934849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff000a100 con 0x557526b13280 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f8fff69c640 1 --2- 172.21.15.121:0/2697934849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bb8080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0054040 tx=0x7f8ff004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e6432360eb9b4f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f8ffde99640 1 -- 172.21.15.121:0/2697934849 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff0052960 con 0x557526b13280 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f8ffde99640 1 -- 172.21.15.121:0/2697934849 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff0052ac0 con 0x557526b13280 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f8ffde99640 1 -- 172.21.15.121:0/2697934849 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff0052d60 con 0x557526b13280 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f900393d800 1 -- 172.21.15.121:0/2697934849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 msgr2=0x557526bb8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f900393d800 1 --2- 172.21.15.121:0/2697934849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bb8080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0054040 tx=0x7f8ff004c000 comp rx=0 tx=0).stop 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f900393d800 1 -- 172.21.15.121:0/2697934849 shutdown_connections 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f900393d800 1 --2- 172.21.15.121:0/2697934849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bb8080 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.841+0000 7f900393d800 1 -- 172.21.15.121:0/2697934849 >> 172.21.15.121:0/2697934849 conn(0x557526b0e980 msgr2=0x557526bb3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.842+0000 7f900393d800 1 -- 172.21.15.121:0/2697934849 shutdown_connections 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.842+0000 7f900393d800 1 -- 172.21.15.121:0/2697934849 wait complete. 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.842+0000 7f900393d800 1 Processor -- start 2023-12-07T21:09:13.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.842+0000 7f900393d800 1 -- start start 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.842+0000 7f900393d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bbf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.842+0000 7f900393d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557526a216a0 con 0x557526b13280 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.842+0000 7f8fff69c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bbf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.842+0000 7f8fff69c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bbf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53282/0 (socket says 172.21.15.121:53282) 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.842+0000 7f8fff69c640 1 -- 172.21.15.121:0/3854756219 learned_addr learned my addr 172.21.15.121:0/3854756219 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.842+0000 7f8fff69c640 1 -- 172.21.15.121:0/3854756219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff004e070 con 0x557526b13280 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.843+0000 7f8fff69c640 1 --2- 172.21.15.121:0/3854756219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bbf400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0052690 tx=0x7f8ff0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.843+0000 7f8ffce97640 1 -- 172.21.15.121:0/3854756219 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff006b070 con 0x557526b13280 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.843+0000 7f8ffce97640 1 -- 172.21.15.121:0/3854756219 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff005cce0 con 0x557526b13280 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.843+0000 7f8ffce97640 1 -- 172.21.15.121:0/3854756219 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff006f430 con 0x557526b13280 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.843+0000 7f900393d800 1 -- 172.21.15.121:0/3854756219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557526bbf940 con 0x557526b13280 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.843+0000 7f900393d800 1 -- 172.21.15.121:0/3854756219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557526bbfe80 con 0x557526b13280 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.843+0000 7f900393d800 1 Processor -- start 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.843+0000 7f8ffce97640 1 -- 172.21.15.121:0/3854756219 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f8ff00663f0 con 0x557526b13280 2023-12-07T21:09:13.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.843+0000 7f900393d800 1 -- start start 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f900393d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526a881f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f900393d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575269bb890 con 0x557526a89ca0 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8ffce97640 1 --2- 172.21.15.121:0/3854756219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8fec036110 0x7f8fec0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8ffce97640 1 -- 172.21.15.121:0/3854756219 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f8ff008d4d0 con 0x557526b13280 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8fff69c640 1 --2- 172.21.15.121:0/3854756219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8fec036110 0x7f8fec0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8fffe9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526a881f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8fffe9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526a881f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53290/0 (socket says 172.21.15.121:53290) 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8fffe9d640 1 -- 172.21.15.121:0/4219028224 learned_addr learned my addr 172.21.15.121:0/4219028224 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8fffe9d640 1 -- 172.21.15.121:0/4219028224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557526a88730 con 0x557526a89ca0 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8fff69c640 1 --2- 172.21.15.121:0/3854756219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8fec036110 0x7f8fec0385d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0052a60 tx=0x7f8ff005bf90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8fffe9d640 1 --2- 172.21.15.121:0/4219028224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526a881f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800a400 tx=0x7f8ff800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0099eb1af006bc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8fe67fc640 1 -- 172.21.15.121:0/4219028224 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff80087e0 con 0x557526a89ca0 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8fe67fc640 1 -- 172.21.15.121:0/4219028224 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff8008960 con 0x557526a89ca0 2023-12-07T21:09:13.842 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.844+0000 7f8fe67fc640 1 -- 172.21.15.121:0/4219028224 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff8008c80 con 0x557526a89ca0 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.845+0000 7f900393d800 1 -- 172.21.15.121:0/4219028224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 msgr2=0x557526a881f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.845+0000 7f900393d800 1 --2- 172.21.15.121:0/4219028224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526a881f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800a400 tx=0x7f8ff800a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.845+0000 7f900393d800 1 -- 172.21.15.121:0/4219028224 shutdown_connections 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.845+0000 7f900393d800 1 --2- 172.21.15.121:0/4219028224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526a881f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.845+0000 7f900393d800 1 -- 172.21.15.121:0/4219028224 >> 172.21.15.121:0/4219028224 conn(0x557526b14440 msgr2=0x557526bc6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.845+0000 7f900393d800 1 -- 172.21.15.121:0/4219028224 shutdown_connections 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.845+0000 7f900393d800 1 -- 172.21.15.121:0/4219028224 wait complete. 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.845+0000 7f900393d800 1 Processor -- start 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.845+0000 7f900393d800 1 -- start start 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.845+0000 7f900393d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526bd46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.845+0000 7f900393d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575269bb530 con 0x557526a89ca0 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.846+0000 7f8fffe9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526bd46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.846+0000 7f8fffe9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526bd46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53298/0 (socket says 172.21.15.121:53298) 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.846+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 learned_addr learned my addr 172.21.15.121:0/978766493 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.846+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8005c90 con 0x557526a89ca0 2023-12-07T21:09:13.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.846+0000 7f8fffe9d640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526bd46e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800a900 tx=0x7f8ff8002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.846+0000 7f8fe4ff9640 1 -- 172.21.15.121:0/978766493 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff8013780 con 0x557526a89ca0 2023-12-07T21:09:13.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.846+0000 7f8fe4ff9640 1 -- 172.21.15.121:0/978766493 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff80138e0 con 0x557526a89ca0 2023-12-07T21:09:13.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.846+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557526bd4c20 con 0x557526a89ca0 2023-12-07T21:09:13.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.846+0000 7f8fe4ff9640 1 -- 172.21.15.121:0/978766493 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ff8013b80 con 0x557526a89ca0 2023-12-07T21:09:13.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.846+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557526bd50e0 con 0x557526a89ca0 2023-12-07T21:09:13.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.847+0000 7f8fe4ff9640 1 -- 172.21.15.121:0/978766493 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f8ff8013ce0 con 0x557526a89ca0 2023-12-07T21:09:13.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.847+0000 7f8fe4ff9640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8fd8036110 0x7f8fd80385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.847+0000 7f8fe4ff9640 1 -- 172.21.15.121:0/978766493 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f8ff804b700 con 0x557526a89ca0 2023-12-07T21:09:13.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.847+0000 7f8ffee9b640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8fd8036110 0x7f8fd80385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f900393d800 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557526bdfe10 0x557526be22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be2a00 con 0x557526bdfe10 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f8ffee9b640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8fd8036110 0x7f8fd80385d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4000c00 tx=0x7f8ff4001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f8fffe9d640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557526bdfe10 0x557526be22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f8fffe9d640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557526bdfe10 0x557526be22b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f900393d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f900393d800 20 realm 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be2df0 con 0x557526bdfe10 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f900393d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f900393d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.848+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be3670 con 0x557526bdfe10 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f900393d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be39d0 con 0x557526bdfe10 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f900393d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be3290 con 0x557526bdfe10 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f900393d800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f900393d800 20 searching for the correct realm 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f900393d800 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557526be5be0 0x557526be7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526be5be0 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.849+0000 7f8fff69c640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557526be5be0 0x557526be7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.850+0000 7f8fff69c640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557526be5be0 0x557526be7fd0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.850+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.850+0000 7f8fff69c640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8ff0079060 0x7f8ff005b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.850+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x7f8ff0079060 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.850+0000 7f8ffee9b640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8ff0079060 0x7f8ff005b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.850+0000 7f8ffee9b640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8ff0079060 0x7f8ff005b390 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.850+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.850+0000 7f8ffee9b640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8ff400e8a0 0x7f8ff400d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.851+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x7f8ff400e8a0 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.851+0000 7f8fffe9d640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8ff400e8a0 0x7f8ff400d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.851+0000 7f8fffe9d640 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8ff400e8a0 0x7f8ff400d2f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.851+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.851+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526bdfe10 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.851+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.851+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526bdfe10 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.852+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.852+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x7f8ff400e8a0 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.852+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.852+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x7f8ff400e8a0 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.852+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.852+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x7f8ff0079060 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.852+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.852+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526be5be0 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.853+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.853+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526bdfe10 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.853+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.853+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x7f8ff400e8a0 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.853+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.853+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526bdfe10 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.853+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.853+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x7f8ff0079060 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.853+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.853+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526be5be0 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.854+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.854+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526be5be0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.854+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.854+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x7f8ff400e8a0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.854+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.854+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526be5be0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.855+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.855+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526be5be0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.855+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.855+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526bdfe10 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.855+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.855+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526bdfe10 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.855+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.855+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x7f8ff400e8a0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.856+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.856+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526be5be0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.856+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.856+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x7f8ff0079060 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.856+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.856+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x557526bdfe10 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.856+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.856+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be8560 con 0x7f8ff400e8a0 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.857+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.857+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ff8053040 con 0x557526be5be0 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.857+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.857+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ff8053040 con 0x7f8ff400e8a0 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.858+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.858+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ff8053040 con 0x7f8ff0079060 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.858+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.858+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ff8053040 con 0x557526be5be0 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.858+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.858+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ff8053040 con 0x7f8ff400e8a0 2023-12-07T21:09:13.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.858+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.858+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ff8053040 con 0x557526bdfe10 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8ff8053040 con 0x7f8ff0079060 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be4860 con 0x557526bdfe10 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be44e0 con 0x557526bdfe10 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.859+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be5130 con 0x557526be5be0 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 20 zone default found 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 4 Realm: () 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 20 zonegroup default 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526be89a0 con 0x7f8ff400e8a0 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bea760 con 0x557526be5be0 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.860+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526beaaf0 con 0x557526be5be0 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.861+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.861+0000 7f900393d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.861+0000 7f900393d800 20 started sync module instance, tier type = 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.861+0000 7f900393d800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.861+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bea040 con 0x7f8ff0079060 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.862+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.862+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93961647140688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bea3f0 con 0x7f8ff0079060 2023-12-07T21:09:13.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.862+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526beb390 con 0x557526bdfe10 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.863+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93961647140688] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.863+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.863+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93961649560480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526beb3f0 con 0x557526bdfe10 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.863+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bebe60 con 0x557526be5be0 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.864+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.864+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93961649568064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bec660 con 0x557526be5be0 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.864+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bed0d0 con 0x7f8ff0079060 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.864+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93961649560480] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.865+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93961649568064] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.865+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.865+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93961649572784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bec2d0 con 0x7f8ff0079060 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.865+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bedba0 con 0x557526bdfe10 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.866+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.866+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93961649575584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bee420 con 0x557526bdfe10 2023-12-07T21:09:13.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.866+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526beedd0 con 0x7f8ff400e8a0 2023-12-07T21:09:13.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.866+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93961649572784] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.867+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93961649575584] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.869+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.869+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93961649565424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bedf30 con 0x7f8ff400e8a0 2023-12-07T21:09:13.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.869+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bef620 con 0x7f8ff400e8a0 2023-12-07T21:09:13.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.871+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93961649565424] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.874+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.874+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93961649580272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bedf30 con 0x7f8ff400e8a0 2023-12-07T21:09:13.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.874+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526befac0 con 0x7f8ff400e8a0 2023-12-07T21:09:13.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.877+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.877+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93961649583648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526beff10 con 0x7f8ff400e8a0 2023-12-07T21:09:13.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.877+0000 7f900393d800 20 add_watcher() i=0 2023-12-07T21:09:13.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.877+0000 7f900393d800 20 add_watcher() i=1 2023-12-07T21:09:13.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.877+0000 7f900393d800 20 add_watcher() i=2 2023-12-07T21:09:13.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.877+0000 7f900393d800 20 add_watcher() i=3 2023-12-07T21:09:13.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.877+0000 7f900393d800 20 add_watcher() i=4 2023-12-07T21:09:13.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.877+0000 7f900393d800 20 add_watcher() i=5 2023-12-07T21:09:13.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.879+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93961649580272] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.879+0000 7f900393d800 20 add_watcher() i=6 2023-12-07T21:09:13.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.879+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93961649583648] v31'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.879+0000 7f900393d800 20 add_watcher() i=7 2023-12-07T21:09:13.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.879+0000 7f900393d800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:13.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.879+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bef180 con 0x557526bdfe10 2023-12-07T21:09:13.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.880+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.880+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93961649584688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bef180 con 0x557526bdfe10 2023-12-07T21:09:13.874 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.881+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93961649584688] v31'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.881+0000 7f8fc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.881+0000 7f900393d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:13.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.881+0000 7f900393d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:13.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.881+0000 7f900393d800 5 note: GC not initialized 2023-12-07T21:09:13.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.881+0000 7f8f3ffff640 20 reqs_thread_entry: start 2023-12-07T21:09:13.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.881+0000 7f900393d800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:13.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.881+0000 7f900393d800 20 Filter name: none 2023-12-07T21:09:13.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.881+0000 7f8f3dffb640 20 reqs_thread_entry: start 2023-12-07T21:09:13.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.882+0000 7f900393d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.875 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.882+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526c25a70 con 0x557526bdfe10 2023-12-07T21:09:13.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.882+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.882+0000 7f900393d800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:13.876 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:13.876 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.883+0000 7f8fc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:13.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.883+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93961649584688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bf0880 con 0x557526bdfe10 2023-12-07T21:09:13.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.884+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93961649584688] v31'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.877 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.884+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93961647140688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bf0880 con 0x7f8ff0079060 2023-12-07T21:09:13.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.885+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93961647140688] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.885+0000 7f900393d800 20 remove_watcher() i=0 2023-12-07T21:09:13.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.885+0000 7f900393d800 2 removed watcher, disabling cache 2023-12-07T21:09:13.878 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.885+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93961649560480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bf0be0 con 0x557526bdfe10 2023-12-07T21:09:13.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.886+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93961649560480] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.886+0000 7f900393d800 20 remove_watcher() i=1 2023-12-07T21:09:13.879 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.886+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93961649568064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bf0be0 con 0x557526be5be0 2023-12-07T21:09:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.887+0000 7f8fff69c640 1 -- 172.21.15.121:0/978766493 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93961649568064] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff007f040 con 0x557526be5be0 2023-12-07T21:09:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.887+0000 7f900393d800 20 remove_watcher() i=2 2023-12-07T21:09:13.880 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.887+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93961649572784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bf0f40 con 0x7f8ff0079060 2023-12-07T21:09:13.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.888+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93961649572784] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff400f620 con 0x7f8ff0079060 2023-12-07T21:09:13.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.888+0000 7f900393d800 20 remove_watcher() i=3 2023-12-07T21:09:13.881 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.888+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93961649575584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bf12a0 con 0x557526bdfe10 2023-12-07T21:09:13.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.889+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93961649575584] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x557526bdfe10 2023-12-07T21:09:13.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.889+0000 7f900393d800 20 remove_watcher() i=4 2023-12-07T21:09:13.882 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.889+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93961649565424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bf12a0 con 0x7f8ff400e8a0 2023-12-07T21:09:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.890+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93961649565424] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.890+0000 7f900393d800 20 remove_watcher() i=5 2023-12-07T21:09:13.883 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.890+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93961649580272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526beaef0 con 0x7f8ff400e8a0 2023-12-07T21:09:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.891+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93961649580272] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.891+0000 7f900393d800 20 remove_watcher() i=6 2023-12-07T21:09:13.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.891+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93961649583648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557526bee8f0 con 0x7f8ff400e8a0 2023-12-07T21:09:13.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f8fffe9d640 1 -- 172.21.15.121:0/978766493 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93961649583648] v31'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ff8024070 con 0x7f8ff400e8a0 2023-12-07T21:09:13.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 20 remove_watcher() i=7 2023-12-07T21:09:13.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8ff400e8a0 msgr2=0x7f8ff400d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8ff400e8a0 0x7f8ff400d2f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557526bdfe10 msgr2=0x557526be22b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.886 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557526bdfe10 0x557526be22b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8ff0079060 msgr2=0x7f8ff005b390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8ff0079060 0x7f8ff005b390 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557526be5be0 msgr2=0x557526be7fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557526be5be0 0x557526be7fd0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8fd8036110 msgr2=0x7f8fd80385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8fd8036110 0x7f8fd80385d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4000c00 tx=0x7f8ff4001330 comp rx=0 tx=0).stop 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 msgr2=0x557526bd46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526bd46e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800a900 tx=0x7f8ff8002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f8ffee9b640 1 -- 172.21.15.121:0/978766493 reap_dead start 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 shutdown_connections 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 --2- 172.21.15.121:0/978766493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526a89ca0 0x557526bd46e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 >> 172.21.15.121:0/978766493 conn(0x557526b14440 msgr2=0x557526bc5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 shutdown_connections 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.892+0000 7f900393d800 1 -- 172.21.15.121:0/978766493 wait complete. 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.893+0000 7f900393d800 1 -- 172.21.15.121:0/3854756219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8fec036110 msgr2=0x7f8fec0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.893+0000 7f900393d800 1 --2- 172.21.15.121:0/3854756219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8fec036110 0x7f8fec0385d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0052a60 tx=0x7f8ff005bf90 comp rx=0 tx=0).stop 2023-12-07T21:09:13.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.893+0000 7f900393d800 1 -- 172.21.15.121:0/3854756219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 msgr2=0x557526bbf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.893+0000 7f900393d800 1 --2- 172.21.15.121:0/3854756219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bbf400 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0052690 tx=0x7f8ff0003330 comp rx=0 tx=0).stop 2023-12-07T21:09:13.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.893+0000 7f900393d800 1 -- 172.21.15.121:0/3854756219 shutdown_connections 2023-12-07T21:09:13.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.893+0000 7f900393d800 1 --2- 172.21.15.121:0/3854756219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8fec036110 0x7f8fec0385d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.893+0000 7f900393d800 1 --2- 172.21.15.121:0/3854756219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557526b13280 0x557526bbf400 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.893+0000 7f900393d800 1 -- 172.21.15.121:0/3854756219 >> 172.21.15.121:0/3854756219 conn(0x557526b0e980 msgr2=0x557526bb6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.893+0000 7f900393d800 1 -- 172.21.15.121:0/3854756219 shutdown_connections 2023-12-07T21:09:13.888 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.893+0000 7f900393d800 1 -- 172.21.15.121:0/3854756219 wait complete. 2023-12-07T21:09:13.889 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:13.889 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2023-12-07T21:09:13.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2023-12-07T21:09:13.889 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2023-12-07T21:09:13.971 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:13.972 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.979+0000 7fc43173b800 1 Processor -- start 2023-12-07T21:09:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.979+0000 7fc43173b800 1 -- start start 2023-12-07T21:09:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.979+0000 7fc43173b800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5561dd351a00 0x5561dd353df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.979+0000 7fc43173b800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5561dd2977a0 con 0x5561dd34b7b0 2023-12-07T21:09:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.979+0000 7fc43173b800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5561dd260880 con 0x5561dd351a00 2023-12-07T21:09:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.980+0000 7fc42cc3f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5561dd351a00 0x5561dd353df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.980+0000 7fc42d440640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5561dd34b7b0 0x5561dd34bbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37744/0 (socket says 172.21.15.121:37744) 2023-12-07T21:09:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.980+0000 7fc42d440640 1 -- 172.21.15.121:0/3674443615 learned_addr learned my addr 172.21.15.121:0/3674443615 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.980+0000 7fc42cc3f640 1 -- 172.21.15.121:0/3674443615 >> v1:172.21.15.89:6789/0 conn(0x5561dd34b7b0 legacy=0x5561dd34bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.980+0000 7fc427fff640 1 -- 172.21.15.121:0/3674443615 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525379130 0 0) 0x5561dd2977a0 con 0x5561dd34b7b0 2023-12-07T21:09:13.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.980+0000 7fc42cc3f640 1 -- 172.21.15.121:0/3674443615 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561dd355340 con 0x5561dd351a00 2023-12-07T21:09:13.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.982+0000 7fc42cc3f640 1 --2- 172.21.15.121:0/3674443615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd351a00 0x5561dd353df0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc41800a470 tx=0x7fc41801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f5d87868d9b5a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.982+0000 7fc427fff640 1 -- 172.21.15.121:0/3674443615 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc418052570 con 0x5561dd351a00 2023-12-07T21:09:13.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.982+0000 7fc427fff640 1 -- 172.21.15.121:0/3674443615 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4180526d0 con 0x5561dd351a00 2023-12-07T21:09:13.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.982+0000 7fc427fff640 1 -- 172.21.15.121:0/3674443615 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc418052990 con 0x5561dd351a00 2023-12-07T21:09:13.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.982+0000 7fc43173b800 1 -- 172.21.15.121:0/3674443615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd351a00 msgr2=0x5561dd353df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.982+0000 7fc43173b800 1 --2- 172.21.15.121:0/3674443615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd351a00 0x5561dd353df0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc41800a470 tx=0x7fc41801cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:13.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.982+0000 7fc43173b800 1 -- 172.21.15.121:0/3674443615 shutdown_connections 2023-12-07T21:09:13.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.982+0000 7fc43173b800 1 --2- 172.21.15.121:0/3674443615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd351a00 0x5561dd353df0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.982+0000 7fc43173b800 1 -- 172.21.15.121:0/3674443615 >> 172.21.15.121:0/3674443615 conn(0x5561dd344f60 msgr2=0x5561dd347380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.982+0000 7fc43173b800 1 -- 172.21.15.121:0/3674443615 shutdown_connections 2023-12-07T21:09:13.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.982+0000 7fc43173b800 1 -- 172.21.15.121:0/3674443615 wait complete. 2023-12-07T21:09:13.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.983+0000 7fc43173b800 1 Processor -- start 2023-12-07T21:09:13.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.983+0000 7fc43173b800 1 -- start start 2023-12-07T21:09:13.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.983+0000 7fc43173b800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.983+0000 7fc43173b800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561dd25ddb0 con 0x5561dd34b7b0 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.984+0000 7fc42d440640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.984+0000 7fc42d440640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53312/0 (socket says 172.21.15.121:53312) 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.984+0000 7fc42d440640 1 -- 172.21.15.121:0/3242426455 learned_addr learned my addr 172.21.15.121:0/3242426455 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.984+0000 7fc42d440640 1 -- 172.21.15.121:0/3242426455 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc418005d20 con 0x5561dd34b7b0 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.984+0000 7fc42d440640 1 --2- 172.21.15.121:0/3242426455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f1ef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc42000b240 tx=0x7fc42000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3459c1b8901421d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.984+0000 7fc4277fe640 1 -- 172.21.15.121:0/3242426455 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc420014070 con 0x5561dd34b7b0 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.984+0000 7fc4277fe640 1 -- 172.21.15.121:0/3242426455 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42000d500 con 0x5561dd34b7b0 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.984+0000 7fc4277fe640 1 -- 172.21.15.121:0/3242426455 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc42000d820 con 0x5561dd34b7b0 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.984+0000 7fc43173b800 1 -- 172.21.15.121:0/3242426455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 msgr2=0x5561dd3f1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.984+0000 7fc43173b800 1 --2- 172.21.15.121:0/3242426455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f1ef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc42000b240 tx=0x7fc42000b700 comp rx=0 tx=0).stop 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc43173b800 1 -- 172.21.15.121:0/3242426455 shutdown_connections 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc43173b800 1 --2- 172.21.15.121:0/3242426455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f1ef0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc43173b800 1 -- 172.21.15.121:0/3242426455 >> 172.21.15.121:0/3242426455 conn(0x5561dd344f60 msgr2=0x5561dd3edb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc43173b800 1 -- 172.21.15.121:0/3242426455 shutdown_connections 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc43173b800 1 -- 172.21.15.121:0/3242426455 wait complete. 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc43173b800 1 Processor -- start 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc43173b800 1 -- start start 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc43173b800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc43173b800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561dd2596a0 con 0x5561dd34b7b0 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc42d440640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc42d440640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53316/0 (socket says 172.21.15.121:53316) 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.985+0000 7fc42d440640 1 -- 172.21.15.121:0/1386200475 learned_addr learned my addr 172.21.15.121:0/1386200475 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.986+0000 7fc42d440640 1 -- 172.21.15.121:0/1386200475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc420001ba0 con 0x5561dd34b7b0 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.986+0000 7fc42d440640 1 --2- 172.21.15.121:0/1386200475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f9390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5561dd3ee5e0 tx=0x7fc420000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.986+0000 7fc4267fc640 1 -- 172.21.15.121:0/1386200475 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc42000de10 con 0x5561dd34b7b0 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.986+0000 7fc4267fc640 1 -- 172.21.15.121:0/1386200475 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc420020070 con 0x5561dd34b7b0 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.986+0000 7fc43173b800 1 -- 172.21.15.121:0/1386200475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561dd3f98d0 con 0x5561dd34b7b0 2023-12-07T21:09:13.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.986+0000 7fc4267fc640 1 -- 172.21.15.121:0/1386200475 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc42000faf0 con 0x5561dd34b7b0 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.986+0000 7fc43173b800 1 -- 172.21.15.121:0/1386200475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561dd3f9db0 con 0x5561dd34b7b0 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.986+0000 7fc43173b800 1 Processor -- start 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc43173b800 1 -- start start 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc43173b800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 0x5561dd405a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc4267fc640 1 -- 172.21.15.121:0/1386200475 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc42000d040 con 0x5561dd34b7b0 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc43173b800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561dd1f3890 con 0x5561dd4055e0 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc4267fc640 1 --2- 172.21.15.121:0/1386200475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc410036110 0x7fc4100385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc4267fc640 1 -- 172.21.15.121:0/1386200475 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc42000a040 con 0x5561dd34b7b0 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc42dc41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 0x5561dd405a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc42d440640 1 --2- 172.21.15.121:0/1386200475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc410036110 0x7fc4100385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc42dc41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 0x5561dd405a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53320/0 (socket says 172.21.15.121:53320) 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc42dc41640 1 -- 172.21.15.121:0/2176262211 learned_addr learned my addr 172.21.15.121:0/2176262211 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc42dc41640 1 -- 172.21.15.121:0/2176262211 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561dd405f40 con 0x5561dd4055e0 2023-12-07T21:09:13.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc42d440640 1 --2- 172.21.15.121:0/1386200475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc410036110 0x7fc4100385d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc42000f640 tx=0x7fc420034040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.987+0000 7fc42dc41640 1 --2- 172.21.15.121:0/2176262211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 0x5561dd405a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc42800a430 tx=0x7fc42800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ede12dbafda869 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc40ffff640 1 -- 172.21.15.121:0/2176262211 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc428001650 con 0x5561dd4055e0 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc40ffff640 1 -- 172.21.15.121:0/2176262211 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4280017d0 con 0x5561dd4055e0 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc40ffff640 1 -- 172.21.15.121:0/2176262211 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc428001ab0 con 0x5561dd4055e0 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc43173b800 1 -- 172.21.15.121:0/2176262211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 msgr2=0x5561dd405a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc43173b800 1 --2- 172.21.15.121:0/2176262211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 0x5561dd405a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc42800a430 tx=0x7fc42800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc43173b800 1 -- 172.21.15.121:0/2176262211 shutdown_connections 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc43173b800 1 --2- 172.21.15.121:0/2176262211 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 0x5561dd405a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc43173b800 1 -- 172.21.15.121:0/2176262211 >> 172.21.15.121:0/2176262211 conn(0x5561dd351a00 msgr2=0x5561dd4009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc43173b800 1 -- 172.21.15.121:0/2176262211 shutdown_connections 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc43173b800 1 -- 172.21.15.121:0/2176262211 wait complete. 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc43173b800 1 Processor -- start 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc43173b800 1 -- start start 2023-12-07T21:09:13.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc43173b800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 0x5561dd40c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.988+0000 7fc43173b800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561dd1f3530 con 0x5561dd4055e0 2023-12-07T21:09:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.989+0000 7fc42dc41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 0x5561dd40c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.989+0000 7fc42dc41640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 0x5561dd40c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53322/0 (socket says 172.21.15.121:53322) 2023-12-07T21:09:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.989+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 learned_addr learned my addr 172.21.15.121:0/101921175 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.989+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42800a0e0 con 0x5561dd4055e0 2023-12-07T21:09:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.989+0000 7fc42dc41640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 0x5561dd40c660 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc42800a930 tx=0x7fc428003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.989+0000 7fc40e7fc640 1 -- 172.21.15.121:0/101921175 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc428010900 con 0x5561dd4055e0 2023-12-07T21:09:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.989+0000 7fc40e7fc640 1 -- 172.21.15.121:0/101921175 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc428010a60 con 0x5561dd4055e0 2023-12-07T21:09:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.989+0000 7fc40e7fc640 1 -- 172.21.15.121:0/101921175 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc428010d20 con 0x5561dd4055e0 2023-12-07T21:09:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.989+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5561dd40cba0 con 0x5561dd4055e0 2023-12-07T21:09:13.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.989+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561dd40d000 con 0x5561dd4055e0 2023-12-07T21:09:13.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.990+0000 7fc40e7fc640 1 -- 172.21.15.121:0/101921175 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc428017030 con 0x5561dd4055e0 2023-12-07T21:09:13.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.990+0000 7fc40e7fc640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4080360c0 0x7fc408038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.990+0000 7fc40e7fc640 1 -- 172.21.15.121:0/101921175 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc42804b910 con 0x5561dd4055e0 2023-12-07T21:09:13.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.990+0000 7fc42cc3f640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4080360c0 0x7fc408038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:13.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.991+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:13.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.991+0000 7fc43173b800 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5561dd417cc0 0x5561dd41a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:13.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.991+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd41a8d0 con 0x5561dd417cc0 2023-12-07T21:09:13.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.991+0000 7fc42cc3f640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4080360c0 0x7fc408038580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc41800a470 tx=0x7fc41804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:13.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.991+0000 7fc42dc41640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5561dd417cc0 0x5561dd41a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.991+0000 7fc42dc41640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5561dd417cc0 0x5561dd41a180 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.991+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.991+0000 7fc43173b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.991+0000 7fc43173b800 20 realm 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.991+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.991+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd41ace0 con 0x5561dd417cc0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd41b560 con 0x5561dd417cc0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd41b8c0 con 0x5561dd417cc0 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd41c0c0 con 0x5561dd417cc0 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 20 searching for the correct realm 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5561dd41dde0 0x5561dd420250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.992+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd41dde0 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.993+0000 7fc42d440640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5561dd41dde0 0x5561dd420250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.993+0000 7fc42d440640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5561dd41dde0 0x5561dd420250 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.993+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc420016070 con 0x5561dd41dde0 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.993+0000 7fc42d440640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc42004b1c0 0x7fc42004b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.993+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc42004b1c0 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.993+0000 7fc42cc3f640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc42004b1c0 0x7fc42004b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.994+0000 7fc42cc3f640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc42004b1c0 0x7fc42004b5e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.994+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4180528c0 con 0x7fc42004b1c0 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.994+0000 7fc42cc3f640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc41805ca90 0x7fc418009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.994+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc41805ca90 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.994+0000 7fc42dc41640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc41805ca90 0x7fc418009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.994+0000 7fc42dc41640 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc41805ca90 0x7fc418009410 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.995+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.995+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd417cc0 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.995+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.995+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd417cc0 2023-12-07T21:09:14.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.995+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.995+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc41805ca90 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.995+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.995+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc41805ca90 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.996+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.996+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc42004b1c0 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.996+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4180528c0 con 0x7fc42004b1c0 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.996+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd41dde0 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.996+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc420016070 con 0x5561dd41dde0 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.996+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd417cc0 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.996+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.996+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc41805ca90 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.997+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.997+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd417cc0 2023-12-07T21:09:14.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.997+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.997+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc42004b1c0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.997+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc4180528c0 con 0x7fc42004b1c0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.997+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd41dde0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.998+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc420016070 con 0x5561dd41dde0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.998+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd41dde0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.998+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc420016070 con 0x5561dd41dde0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.998+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc41805ca90 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.998+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.998+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd41dde0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.998+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc420016070 con 0x5561dd41dde0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.998+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd41dde0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.998+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc420016070 con 0x5561dd41dde0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.998+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd417cc0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.999+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.999+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd417cc0 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.999+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.999+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc41805ca90 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.999+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:13.999+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd41dde0 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.000+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc420016070 con 0x5561dd41dde0 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.000+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc42004b1c0 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.000+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4180528c0 con 0x7fc42004b1c0 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.000+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd417cc0 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.000+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.000+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc41805ca90 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.001+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.001+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x5561dd41dde0 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.001+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc420016070 con 0x5561dd41dde0 2023-12-07T21:09:14.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.001+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420920 con 0x7fc41805ca90 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.001+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.001+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc42805d040 con 0x7fc42004b1c0 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.001+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc4180528c0 con 0x7fc42004b1c0 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.001+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc42805d040 con 0x5561dd41dde0 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc420016070 con 0x5561dd41dde0 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc42805d040 con 0x7fc41805ca90 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc42805d040 con 0x5561dd417cc0 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc42805d040 con 0x7fc42004b1c0 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc41806f040 con 0x7fc42004b1c0 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc43173b800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc43173b800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:14.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc43173b800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc43173b800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc43173b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc43173b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.002+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd41ca20 con 0x5561dd417cc0 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd41c6a0 con 0x5561dd417cc0 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd41d2f0 con 0x5561dd41dde0 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc420016070 con 0x5561dd41dde0 2023-12-07T21:09:14.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 20 zone default found 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 4 Realm: () 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 20 zonegroup default 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.003+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd420d60 con 0x7fc41805ca90 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc43173b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd422b20 con 0x5561dd41dde0 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc420057040 con 0x5561dd41dde0 2023-12-07T21:09:14.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc43173b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd422e80 con 0x5561dd41dde0 2023-12-07T21:09:14.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc420057040 con 0x5561dd41dde0 2023-12-07T21:09:14.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc43173b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc43173b800 20 started sync module instance, tier type = 2023-12-07T21:09:14.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc43173b800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:14.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.004+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd422400 con 0x7fc42004b1c0 2023-12-07T21:09:14.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.005+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc41806f040 con 0x7fc42004b1c0 2023-12-07T21:09:14.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.005+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93878809866064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd423250 con 0x7fc42004b1c0 2023-12-07T21:09:14.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.005+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd423a50 con 0x5561dd417cc0 2023-12-07T21:09:14.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.006+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93878809866064] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc41806f040 con 0x7fc42004b1c0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.006+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.006+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93878812286816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd423a50 con 0x5561dd417cc0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.006+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd424250 con 0x5561dd41dde0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.007+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93878812286816] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.007+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc420057040 con 0x5561dd41dde0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.008+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93878812292800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd4245b0 con 0x5561dd41dde0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.008+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd424f20 con 0x7fc42004b1c0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.008+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93878812292800] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc420057040 con 0x5561dd41dde0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.009+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc41806f040 con 0x7fc42004b1c0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.009+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93878812293904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd425770 con 0x7fc42004b1c0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.009+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd425f70 con 0x5561dd417cc0 2023-12-07T21:09:14.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.009+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93878812293904] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc41806f040 con 0x7fc42004b1c0 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.010+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.010+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93878812302032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd426380 con 0x5561dd417cc0 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.010+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd426b80 con 0x7fc41805ca90 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.011+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.011+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93878812304528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd426f30 con 0x7fc41805ca90 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.011+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd4279e0 con 0x7fc41805ca90 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.011+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93878812302032] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.012+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93878812304528] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.012+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.012+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93878812308704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd4279a0 con 0x7fc41805ca90 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.012+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd427d90 con 0x7fc41805ca90 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.013+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93878812308704] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.013+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.013+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93878812305696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd427bc0 con 0x7fc41805ca90 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.013+0000 7fc43173b800 20 add_watcher() i=0 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.013+0000 7fc43173b800 20 add_watcher() i=1 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.013+0000 7fc43173b800 20 add_watcher() i=2 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.013+0000 7fc43173b800 20 add_watcher() i=3 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.013+0000 7fc43173b800 20 add_watcher() i=4 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.013+0000 7fc43173b800 20 add_watcher() i=5 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.013+0000 7fc43173b800 20 add_watcher() i=6 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.014+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93878812305696] v31'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.014+0000 7fc43173b800 20 add_watcher() i=7 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.014+0000 7fc43173b800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.014+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd42b0f0 con 0x5561dd417cc0 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.014+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.014+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93878812303072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd428530 con 0x5561dd417cc0 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.015+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93878812303072] v31'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.015+0000 7fc3f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.015+0000 7fc43173b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.015+0000 7fc43173b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.015+0000 7fc43173b800 5 note: GC not initialized 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.015+0000 7fc3f1fe3640 20 reqs_thread_entry: start 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.015+0000 7fc43173b800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc43173b800 20 Filter name: none 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc3637fe640 20 reqs_thread_entry: start 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc43173b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc43173b800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd45e0f0 con 0x5561dd417cc0 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc43173b800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc43173b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:14.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc43173b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc43173b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd460530 con 0x7fc42004b1c0 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fc41806f040 con 0x7fc42004b1c0 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.016+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd464010 con 0x5561dd417cc0 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v31'3 uv3 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc43173b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc43173b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc43173b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93878812556464 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd460d30 con 0x5561dd417cc0 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 93878812302032 notify 133143986178 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7fc428062040 con 0x5561dd417cc0 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc40ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 93878812302032 notifier 4306 bl.length()=533 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc40ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc40ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(65 notify.4 [notify cookie 93878812556464 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc40ffff640 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc4000042a0 con 0x5561dd417cc0 2023-12-07T21:09:14.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.018+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== watch-notify(notify_complete (2) cookie 93878812556464 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5561dd40d000 con 0x5561dd417cc0 2023-12-07T21:09:14.020 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:14.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.019+0000 7fc3f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.019+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93878812303072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd414580 con 0x5561dd417cc0 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.020+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93878812303072] v31'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.020+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93878809866064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd414580 con 0x7fc42004b1c0 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.021+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93878809866064] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc41806f040 con 0x7fc42004b1c0 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.021+0000 7fc43173b800 20 remove_watcher() i=0 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.021+0000 7fc43173b800 2 removed watcher, disabling cache 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.021+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93878812286816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd4148e0 con 0x5561dd417cc0 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.022+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93878812286816] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.022+0000 7fc43173b800 20 remove_watcher() i=1 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.022+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93878812292800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd4148e0 con 0x5561dd41dde0 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.023+0000 7fc42d440640 1 -- 172.21.15.121:0/101921175 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93878812292800] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc420057040 con 0x5561dd41dde0 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.023+0000 7fc43173b800 20 remove_watcher() i=2 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.023+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93878812293904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd414c40 con 0x7fc42004b1c0 2023-12-07T21:09:14.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.024+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93878812293904] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc41806f040 con 0x7fc42004b1c0 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.024+0000 7fc43173b800 20 remove_watcher() i=3 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.024+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93878812302032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd414c40 con 0x5561dd417cc0 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.025+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93878812302032] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x5561dd417cc0 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.025+0000 7fc43173b800 20 remove_watcher() i=4 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.025+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93878812304528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd414c40 con 0x7fc41805ca90 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.026+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93878812304528] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.026+0000 7fc43173b800 20 remove_watcher() i=5 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.026+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93878812308704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd426490 con 0x7fc41805ca90 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.027+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93878812308704] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.027+0000 7fc43173b800 20 remove_watcher() i=6 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.027+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93878812305696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5561dd426490 con 0x7fc41805ca90 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc42dc41640 1 -- 172.21.15.121:0/101921175 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93878812305696] v31'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc42802ea00 con 0x7fc41805ca90 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 20 remove_watcher() i=7 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc41805ca90 msgr2=0x7fc418009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc41805ca90 0x7fc418009410 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5561dd417cc0 msgr2=0x5561dd41a180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5561dd417cc0 0x5561dd41a180 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc42004b1c0 msgr2=0x7fc42004b5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc42004b1c0 0x7fc42004b5e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5561dd41dde0 msgr2=0x5561dd420250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5561dd41dde0 0x5561dd420250 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4080360c0 msgr2=0x7fc408038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4080360c0 0x7fc408038580 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc41800a470 tx=0x7fc41804e000 comp rx=0 tx=0).stop 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 msgr2=0x5561dd40c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 --2- 172.21.15.121:0/101921175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd4055e0 0x5561dd40c660 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc42800a930 tx=0x7fc428003370 comp rx=0 tx=0).stop 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 reap_dead start 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc42cc3f640 1 -- 172.21.15.121:0/101921175 reap_dead start 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 shutdown_connections 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.028+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 >> 172.21.15.121:0/101921175 conn(0x5561dd351a00 msgr2=0x5561dd3ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 shutdown_connections 2023-12-07T21:09:14.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 -- 172.21.15.121:0/101921175 wait complete. 2023-12-07T21:09:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 -- 172.21.15.121:0/1386200475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc410036110 msgr2=0x7fc4100385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 --2- 172.21.15.121:0/1386200475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc410036110 0x7fc4100385d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc42000f640 tx=0x7fc420034040 comp rx=0 tx=0).stop 2023-12-07T21:09:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 -- 172.21.15.121:0/1386200475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 msgr2=0x5561dd3f9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 --2- 172.21.15.121:0/1386200475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f9390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5561dd3ee5e0 tx=0x7fc420000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 -- 172.21.15.121:0/1386200475 shutdown_connections 2023-12-07T21:09:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 --2- 172.21.15.121:0/1386200475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc410036110 0x7fc4100385d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 --2- 172.21.15.121:0/1386200475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5561dd34b7b0 0x5561dd3f9390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 -- 172.21.15.121:0/1386200475 >> 172.21.15.121:0/1386200475 conn(0x5561dd344f60 msgr2=0x5561dd3f0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 -- 172.21.15.121:0/1386200475 shutdown_connections 2023-12-07T21:09:14.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.029+0000 7fc43173b800 1 -- 172.21.15.121:0/1386200475 wait complete. 2023-12-07T21:09:14.031 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:14.032 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-12-07T21:09:14.032 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-12-07T21:09:14.032 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-12-07T21:09:14.110 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:14.111 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:14.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.118+0000 7fdae2e12800 1 Processor -- start 2023-12-07T21:09:14.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.118+0000 7fdae2e12800 1 -- start start 2023-12-07T21:09:14.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.118+0000 7fdae2e12800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55797379f630 0x5579737a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.118+0000 7fdae2e12800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5579736e87a0 con 0x55797379c730 2023-12-07T21:09:14.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.119+0000 7fdae2e12800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5579736b1880 con 0x55797379f630 2023-12-07T21:09:14.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.119+0000 7fdaddc4f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55797379f630 0x5579737a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.119+0000 7fdade450640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55797379c730 0x55797379cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37760/0 (socket says 172.21.15.121:37760) 2023-12-07T21:09:14.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.119+0000 7fdade450640 1 -- 172.21.15.121:0/596364275 learned_addr learned my addr 172.21.15.121:0/596364275 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:14.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.119+0000 7fdaddc4f640 1 -- 172.21.15.121:0/596364275 >> v1:172.21.15.89:6789/0 conn(0x55797379c730 legacy=0x55797379cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.119+0000 7fdaddc4f640 1 -- 172.21.15.121:0/596364275 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579737a3000 con 0x55797379f630 2023-12-07T21:09:14.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.119+0000 7fdadd44e640 1 -- 172.21.15.121:0/596364275 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762382244 0 0) 0x5579736e87a0 con 0x55797379c730 2023-12-07T21:09:14.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.121+0000 7fdaddc4f640 1 --2- 172.21.15.121:0/596364275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379f630 0x5579737a1a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdad400a470 tx=0x7fdad401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc81ca0c27f6c36 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.121+0000 7fdadd44e640 1 -- 172.21.15.121:0/596364275 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad4052570 con 0x55797379f630 2023-12-07T21:09:14.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.121+0000 7fdadd44e640 1 -- 172.21.15.121:0/596364275 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad40526d0 con 0x55797379f630 2023-12-07T21:09:14.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.121+0000 7fdadd44e640 1 -- 172.21.15.121:0/596364275 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad4052990 con 0x55797379f630 2023-12-07T21:09:14.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.121+0000 7fdae2e12800 1 -- 172.21.15.121:0/596364275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379f630 msgr2=0x5579737a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.121+0000 7fdae2e12800 1 --2- 172.21.15.121:0/596364275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379f630 0x5579737a1a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdad400a470 tx=0x7fdad401cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:14.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.121+0000 7fdae2e12800 1 -- 172.21.15.121:0/596364275 shutdown_connections 2023-12-07T21:09:14.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.121+0000 7fdae2e12800 1 --2- 172.21.15.121:0/596364275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379f630 0x5579737a1a20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.121+0000 7fdae2e12800 1 -- 172.21.15.121:0/596364275 >> 172.21.15.121:0/596364275 conn(0x557973795f60 msgr2=0x557973798380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.122+0000 7fdae2e12800 1 -- 172.21.15.121:0/596364275 shutdown_connections 2023-12-07T21:09:14.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.122+0000 7fdae2e12800 1 -- 172.21.15.121:0/596364275 wait complete. 2023-12-07T21:09:14.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.122+0000 7fdae2e12800 1 Processor -- start 2023-12-07T21:09:14.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.122+0000 7fdae2e12800 1 -- start start 2023-12-07T21:09:14.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.122+0000 7fdae2e12800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x55797379a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.122+0000 7fdae2e12800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579736aedb0 con 0x55797379c730 2023-12-07T21:09:14.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.123+0000 7fdade450640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x55797379a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.123+0000 7fdade450640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x55797379a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53340/0 (socket says 172.21.15.121:53340) 2023-12-07T21:09:14.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.123+0000 7fdade450640 1 -- 172.21.15.121:0/717502665 learned_addr learned my addr 172.21.15.121:0/717502665 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.123+0000 7fdade450640 1 -- 172.21.15.121:0/717502665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4005d20 con 0x55797379c730 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.123+0000 7fdade450640 1 --2- 172.21.15.121:0/717502665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x55797379a5c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdad000b210 tx=0x7fdad000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2338b2be34155c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.123+0000 7fdadcc4d640 1 -- 172.21.15.121:0/717502665 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad0014070 con 0x55797379c730 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.123+0000 7fdadcc4d640 1 -- 172.21.15.121:0/717502665 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad000d500 con 0x55797379c730 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.123+0000 7fdadcc4d640 1 -- 172.21.15.121:0/717502665 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad000d800 con 0x55797379c730 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdae2e12800 1 -- 172.21.15.121:0/717502665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 msgr2=0x55797379a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdae2e12800 1 --2- 172.21.15.121:0/717502665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x55797379a5c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdad000b210 tx=0x7fdad000b6d0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdae2e12800 1 -- 172.21.15.121:0/717502665 shutdown_connections 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdae2e12800 1 --2- 172.21.15.121:0/717502665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x55797379a5c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdae2e12800 1 -- 172.21.15.121:0/717502665 >> 172.21.15.121:0/717502665 conn(0x557973795f60 msgr2=0x55797383b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdae2e12800 1 -- 172.21.15.121:0/717502665 shutdown_connections 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdae2e12800 1 -- 172.21.15.121:0/717502665 wait complete. 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdae2e12800 1 Processor -- start 2023-12-07T21:09:14.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdae2e12800 1 -- start start 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdae2e12800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x5579738481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdae2e12800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579736aa6a0 con 0x55797379c730 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdade450640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x5579738481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdade450640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x5579738481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53356/0 (socket says 172.21.15.121:53356) 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.124+0000 7fdade450640 1 -- 172.21.15.121:0/1208329118 learned_addr learned my addr 172.21.15.121:0/1208329118 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.125+0000 7fdade450640 1 -- 172.21.15.121:0/1208329118 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad0001b70 con 0x55797379c730 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.125+0000 7fdade450640 1 --2- 172.21.15.121:0/1208329118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x5579738481f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdad000b210 tx=0x7fdad0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.125+0000 7fdacf7fe640 1 -- 172.21.15.121:0/1208329118 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad000de30 con 0x55797379c730 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.125+0000 7fdacf7fe640 1 -- 172.21.15.121:0/1208329118 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad0020070 con 0x55797379c730 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.125+0000 7fdacf7fe640 1 -- 172.21.15.121:0/1208329118 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad000fb00 con 0x55797379c730 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.125+0000 7fdae2e12800 1 -- 172.21.15.121:0/1208329118 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557973848730 con 0x55797379c730 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.125+0000 7fdae2e12800 1 -- 172.21.15.121:0/1208329118 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557973848c10 con 0x55797379c730 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.125+0000 7fdae2e12800 1 Processor -- start 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.125+0000 7fdae2e12800 1 -- start start 2023-12-07T21:09:14.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdae2e12800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x557973854810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdacf7fe640 1 -- 172.21.15.121:0/1208329118 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fdad000d040 con 0x55797379c730 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdae2e12800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557973644890 con 0x5579738543f0 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdacf7fe640 1 --2- 172.21.15.121:0/1208329118 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdac0036110 0x7fdac00385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdadec51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x557973854810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdadec51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x557973854810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53370/0 (socket says 172.21.15.121:53370) 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdadec51640 1 -- 172.21.15.121:0/3749514428 learned_addr learned my addr 172.21.15.121:0/3749514428 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdacf7fe640 1 -- 172.21.15.121:0/1208329118 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fdad000a040 con 0x55797379c730 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdade450640 1 --2- 172.21.15.121:0/1208329118 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdac0036110 0x7fdac00385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdadec51640 1 -- 172.21.15.121:0/3749514428 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557973854d50 con 0x5579738543f0 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdadec51640 1 --2- 172.21.15.121:0/3749514428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x557973854810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdad800a430 tx=0x7fdad800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec46556e4a6526 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdade450640 1 --2- 172.21.15.121:0/1208329118 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdac0036110 0x7fdac00385d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdad000f690 tx=0x7fdad0033040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdacd7fa640 1 -- 172.21.15.121:0/3749514428 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad8001650 con 0x5579738543f0 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdacd7fa640 1 -- 172.21.15.121:0/3749514428 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad80017d0 con 0x5579738543f0 2023-12-07T21:09:14.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.126+0000 7fdacd7fa640 1 -- 172.21.15.121:0/3749514428 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad8001ab0 con 0x5579738543f0 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdae2e12800 1 -- 172.21.15.121:0/3749514428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 msgr2=0x557973854810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdae2e12800 1 --2- 172.21.15.121:0/3749514428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x557973854810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdad800a430 tx=0x7fdad800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdae2e12800 1 -- 172.21.15.121:0/3749514428 shutdown_connections 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdae2e12800 1 --2- 172.21.15.121:0/3749514428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x557973854810 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdae2e12800 1 -- 172.21.15.121:0/3749514428 >> 172.21.15.121:0/3749514428 conn(0x55797379f630 msgr2=0x55797384f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdae2e12800 1 -- 172.21.15.121:0/3749514428 shutdown_connections 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdae2e12800 1 -- 172.21.15.121:0/3749514428 wait complete. 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdae2e12800 1 Processor -- start 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdae2e12800 1 -- start start 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdae2e12800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x55797385b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdae2e12800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557973644530 con 0x5579738543f0 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdadec51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x55797385b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdadec51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x55797385b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53378/0 (socket says 172.21.15.121:53378) 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.127+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 learned_addr learned my addr 172.21.15.121:0/3004379313 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.128+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad800a0e0 con 0x5579738543f0 2023-12-07T21:09:14.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.128+0000 7fdadec51640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x55797385b3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdad800ae40 tx=0x7fdad8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.128+0000 7fdabf7fe640 1 -- 172.21.15.121:0/3004379313 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad80109e0 con 0x5579738543f0 2023-12-07T21:09:14.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.128+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55797385b900 con 0x5579738543f0 2023-12-07T21:09:14.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.128+0000 7fdabf7fe640 1 -- 172.21.15.121:0/3004379313 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad8010b40 con 0x5579738543f0 2023-12-07T21:09:14.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.128+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55797385bd60 con 0x5579738543f0 2023-12-07T21:09:14.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.128+0000 7fdabf7fe640 1 -- 172.21.15.121:0/3004379313 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdad8010de0 con 0x5579738543f0 2023-12-07T21:09:14.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.129+0000 7fdabf7fe640 1 -- 172.21.15.121:0/3004379313 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fdad8017070 con 0x5579738543f0 2023-12-07T21:09:14.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.129+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.129+0000 7fdabf7fe640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdab80360c0 0x7fdab8038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.129+0000 7fdabf7fe640 1 -- 172.21.15.121:0/3004379313 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fdad804bb70 con 0x5579738543f0 2023-12-07T21:09:14.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.129+0000 7fdaddc4f640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdab80360c0 0x7fdab8038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.129+0000 7fdae2e12800 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557973866b50 0x557973868fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.129+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973869730 con 0x557973866b50 2023-12-07T21:09:14.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdadec51640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557973866b50 0x557973868fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdaddc4f640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdab80360c0 0x7fdab8038580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdad4054000 tx=0x7fdad404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdadec51640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557973866b50 0x557973868fe0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdad8018c20 con 0x557973866b50 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdae2e12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdae2e12800 20 realm 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973869b20 con 0x557973866b50 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdad8018c20 con 0x557973866b50 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdae2e12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdae2e12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.130+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386a370 con 0x557973866b50 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdad8018c20 con 0x557973866b50 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdae2e12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386a6d0 con 0x557973866b50 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdad8018c20 con 0x557973866b50 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdae2e12800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386a010 con 0x557973866b50 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fdad8018c20 con 0x557973866b50 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdae2e12800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdae2e12800 20 searching for the correct realm 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdae2e12800 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55797386c920 0x55797386ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x55797386c920 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdade450640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55797386c920 0x55797386ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.131+0000 7fdade450640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55797386c920 0x55797386ed10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.132+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.132+0000 7fdade450640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fdad003d040 0x7fdad00477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.132+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad003d040 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.132+0000 7fdaddc4f640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fdad003d040 0x7fdad00477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.132+0000 7fdaddc4f640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fdad003d040 0x7fdad00477c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.132+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.132+0000 7fdaddc4f640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fdad405ca90 0x7fdad40673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.132+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad405ca90 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.133+0000 7fdadec51640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fdad405ca90 0x7fdad40673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.133+0000 7fdadec51640 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fdad405ca90 0x7fdad40673d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.133+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad8018c20 con 0x7fdad405ca90 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.133+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x557973866b50 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.133+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad8018c20 con 0x557973866b50 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.133+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x557973866b50 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.134+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad8018c20 con 0x557973866b50 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.134+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad405ca90 2023-12-07T21:09:14.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.134+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.134+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad405ca90 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.134+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.134+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad003d040 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.134+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.134+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x55797386c920 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.135+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.135+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x557973866b50 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.135+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.135+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad405ca90 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.135+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.135+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x557973866b50 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.135+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.135+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad003d040 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.136+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.136+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x55797386c920 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.136+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.136+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x55797386c920 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.136+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.136+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad405ca90 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.136+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.136+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x55797386c920 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.136+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.137+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x55797386c920 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.137+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.137+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x557973866b50 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.137+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.137+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x557973866b50 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.137+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.137+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad405ca90 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.137+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.137+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x55797386c920 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.138+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.138+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad003d040 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.138+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.138+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x557973866b50 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.138+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.138+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad405ca90 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.139+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.139+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x55797386c920 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.139+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.139+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad405ca90 2023-12-07T21:09:14.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.139+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.139+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad003d040 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.139+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.139+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x55797386c920 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad405ca90 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x557973866b50 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f2a0 con 0x7fdad003d040 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdae2e12800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdae2e12800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdae2e12800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdae2e12800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdae2e12800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:14.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdae2e12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.140+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386b500 con 0x557973866b50 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386b120 con 0x557973866b50 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386bd50 con 0x55797386c920 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:14.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 20 zone default found 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 4 Realm: () 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 20 zonegroup default 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.141+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55797386f6e0 con 0x7fdad405ca90 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdae2e12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973871560 con 0x55797386c920 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdae2e12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738718c0 con 0x55797386c920 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdae2e12800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdae2e12800 20 started sync module instance, tier type = 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdae2e12800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.142+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973870b30 con 0x7fdad003d040 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.143+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.143+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93980115222352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973870f60 con 0x7fdad003d040 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.143+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738720c0 con 0x557973866b50 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.144+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93980115222352] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.144+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.144+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93980117632656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738720c0 con 0x557973866b50 2023-12-07T21:09:14.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.145+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973872af0 con 0x55797386c920 2023-12-07T21:09:14.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.146+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93980117632656] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.146+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.146+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93980117638176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973872030 con 0x55797386c920 2023-12-07T21:09:14.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.146+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738737e0 con 0x7fdad003d040 2023-12-07T21:09:14.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.147+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93980117638176] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.147+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.147+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93980117643184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973874030 con 0x7fdad003d040 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.147+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973874830 con 0x557973866b50 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.148+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93980117643184] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.148+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.148+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93980117648272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973874c40 con 0x557973866b50 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.148+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973875440 con 0x7fdad405ca90 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.149+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.149+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93980117650800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738757f0 con 0x7fdad405ca90 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.149+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93980117648272] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.149+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738762c0 con 0x7fdad405ca90 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.150+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93980117650800] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.150+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.150+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93980117654944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973876280 con 0x7fdad405ca90 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.150+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738766e0 con 0x7fdad405ca90 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.151+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.151+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93980117657312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973876280 con 0x7fdad405ca90 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.151+0000 7fdae2e12800 20 add_watcher() i=0 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.151+0000 7fdae2e12800 20 add_watcher() i=1 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.151+0000 7fdae2e12800 20 add_watcher() i=2 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.151+0000 7fdae2e12800 20 add_watcher() i=3 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.151+0000 7fdae2e12800 20 add_watcher() i=4 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.151+0000 7fdae2e12800 20 add_watcher() i=5 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.151+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93980117654944] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.151+0000 7fdae2e12800 20 add_watcher() i=6 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.152+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93980117657312] v31'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.152+0000 7fdae2e12800 20 add_watcher() i=7 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.152+0000 7fdae2e12800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.152+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738747a0 con 0x557973866b50 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.152+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.152+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93980117658352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738747a0 con 0x557973866b50 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.153+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93980117658352] v31'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.153+0000 7fda9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.153+0000 7fdae2e12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.153+0000 7fdae2e12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.153+0000 7fdae2e12800 5 note: GC not initialized 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.153+0000 7fda9e7fc640 20 reqs_thread_entry: start 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.154+0000 7fdae2e12800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.154+0000 7fdae2e12800 20 Filter name: none 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.154+0000 7fda0ffff640 20 reqs_thread_entry: start 2023-12-07T21:09:14.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.154+0000 7fdae2e12800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.154+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738ac660 con 0x557973866b50 2023-12-07T21:09:14.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.154+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.154+0000 7fdae2e12800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:14.156 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.155+0000 7fda9f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.155+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93980117658352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738774c0 con 0x557973866b50 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.156+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93980117658352] v31'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.156+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93980115222352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5579738774c0 con 0x7fdad003d040 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.157+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93980115222352] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.157+0000 7fdae2e12800 20 remove_watcher() i=0 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.157+0000 7fdae2e12800 2 removed watcher, disabling cache 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.157+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93980117632656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973877820 con 0x557973866b50 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.158+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93980117632656] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.158+0000 7fdae2e12800 20 remove_watcher() i=1 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.158+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93980117638176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973877820 con 0x55797386c920 2023-12-07T21:09:14.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.159+0000 7fdade450640 1 -- 172.21.15.121:0/3004379313 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93980117638176] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad0016070 con 0x55797386c920 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.159+0000 7fdae2e12800 20 remove_watcher() i=2 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.159+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93980117643184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973877820 con 0x7fdad003d040 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.160+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93980117643184] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad4052840 con 0x7fdad003d040 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.160+0000 7fdae2e12800 20 remove_watcher() i=3 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.160+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93980117648272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973877b80 con 0x557973866b50 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.161+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93980117648272] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x557973866b50 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.161+0000 7fdae2e12800 20 remove_watcher() i=4 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.161+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93980117650800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973877b80 con 0x7fdad405ca90 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.162+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93980117650800] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.162+0000 7fdae2e12800 20 remove_watcher() i=5 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.162+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93980117654944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973874d70 con 0x7fdad405ca90 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.163+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93980117654944] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.163+0000 7fdae2e12800 20 remove_watcher() i=6 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.163+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93980117657312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557973874d70 con 0x7fdad405ca90 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdadec51640 1 -- 172.21.15.121:0/3004379313 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93980117657312] v31'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdad803c040 con 0x7fdad405ca90 2023-12-07T21:09:14.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 20 remove_watcher() i=7 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fdad405ca90 msgr2=0x7fdad40673d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fdad405ca90 0x7fdad40673d0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557973866b50 msgr2=0x557973868fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557973866b50 0x557973868fe0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fdad003d040 msgr2=0x7fdad00477c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fdad003d040 0x7fdad00477c0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55797386c920 msgr2=0x55797386ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55797386c920 0x55797386ed10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdab80360c0 msgr2=0x7fdab8038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdab80360c0 0x7fdab8038580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdad4054000 tx=0x7fdad404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 msgr2=0x55797385b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x55797385b3c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdad800ae40 tx=0x7fdad8003370 comp rx=0 tx=0).stop 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdaddc4f640 1 -- 172.21.15.121:0/3004379313 reap_dead start 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 shutdown_connections 2023-12-07T21:09:14.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 --2- 172.21.15.121:0/3004379313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5579738543f0 0x55797385b3c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.164+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 >> 172.21.15.121:0/3004379313 conn(0x55797379f630 msgr2=0x55797384e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 shutdown_connections 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 -- 172.21.15.121:0/3004379313 wait complete. 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 -- 172.21.15.121:0/1208329118 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdac0036110 msgr2=0x7fdac00385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 --2- 172.21.15.121:0/1208329118 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdac0036110 0x7fdac00385d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdad000f690 tx=0x7fdad0033040 comp rx=0 tx=0).stop 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 -- 172.21.15.121:0/1208329118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 msgr2=0x5579738481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 --2- 172.21.15.121:0/1208329118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x5579738481f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdad000b210 tx=0x7fdad0000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 -- 172.21.15.121:0/1208329118 shutdown_connections 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 --2- 172.21.15.121:0/1208329118 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdac0036110 0x7fdac00385d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 --2- 172.21.15.121:0/1208329118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55797379c730 0x5579738481f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 -- 172.21.15.121:0/1208329118 >> 172.21.15.121:0/1208329118 conn(0x557973795f60 msgr2=0x55797383e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 -- 172.21.15.121:0/1208329118 shutdown_connections 2023-12-07T21:09:14.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.165+0000 7fdae2e12800 1 -- 172.21.15.121:0/1208329118 wait complete. 2023-12-07T21:09:14.164 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:14.164 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2023-12-07T21:09:14.164 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2023-12-07T21:09:14.164 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2023-12-07T21:09:14.250 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:14.251 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:14.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.258+0000 7f5d31ae4800 1 Processor -- start 2023-12-07T21:09:14.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.258+0000 7f5d31ae4800 1 -- start start 2023-12-07T21:09:14.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.258+0000 7f5d31ae4800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5583830a2610 0x5583830a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.258+0000 7f5d31ae4800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558382feb740 con 0x55838309f6c0 2023-12-07T21:09:14.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.258+0000 7f5d31ae4800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x558382fb4880 con 0x5583830a2610 2023-12-07T21:09:14.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.259+0000 7f5d2ede3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5583830a2610 0x5583830a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.259+0000 7f5d2f5e4640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55838309f6c0 0x55838309fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37768/0 (socket says 172.21.15.121:37768) 2023-12-07T21:09:14.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.259+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/3566434390 learned_addr learned my addr 172.21.15.121:0/3566434390 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:14.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.259+0000 7f5d2ede3640 1 -- 172.21.15.121:0/3566434390 >> v1:172.21.15.89:6789/0 conn(0x55838309f6c0 legacy=0x55838309fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.259+0000 7f5d2ede3640 1 -- 172.21.15.121:0/3566434390 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583830a5f80 con 0x5583830a2610 2023-12-07T21:09:14.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.259+0000 7f5d2e5e2640 1 -- 172.21.15.121:0/3566434390 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870357875 0 0) 0x558382feb740 con 0x55838309f6c0 2023-12-07T21:09:14.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.261+0000 7f5d2ede3640 1 --2- 172.21.15.121:0/3566434390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5583830a2610 0x5583830a4a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400a470 tx=0x7f5d2401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422b804463372a20 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.261+0000 7f5d2e5e2640 1 -- 172.21.15.121:0/3566434390 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d24052570 con 0x5583830a2610 2023-12-07T21:09:14.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.261+0000 7f5d2e5e2640 1 -- 172.21.15.121:0/3566434390 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d240526d0 con 0x5583830a2610 2023-12-07T21:09:14.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.261+0000 7f5d2e5e2640 1 -- 172.21.15.121:0/3566434390 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d24052990 con 0x5583830a2610 2023-12-07T21:09:14.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.261+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3566434390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5583830a2610 msgr2=0x5583830a4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.261+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/3566434390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5583830a2610 0x5583830a4a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400a470 tx=0x7f5d2401cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:14.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.261+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3566434390 shutdown_connections 2023-12-07T21:09:14.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.261+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/3566434390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5583830a2610 0x5583830a4a00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.261+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3566434390 >> 172.21.15.121:0/3566434390 conn(0x558383098f00 msgr2=0x55838309b320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.262+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3566434390 shutdown_connections 2023-12-07T21:09:14.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.262+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3566434390 wait complete. 2023-12-07T21:09:14.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.262+0000 7f5d31ae4800 1 Processor -- start 2023-12-07T21:09:14.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.262+0000 7f5d31ae4800 1 -- start start 2023-12-07T21:09:14.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.262+0000 7f5d31ae4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838309d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.262+0000 7f5d31ae4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558382fb1db0 con 0x55838309f6c0 2023-12-07T21:09:14.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.263+0000 7f5d2f5e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838309d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.263+0000 7f5d2f5e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838309d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53402/0 (socket says 172.21.15.121:53402) 2023-12-07T21:09:14.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.263+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/164456073 learned_addr learned my addr 172.21.15.121:0/164456073 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.263+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/164456073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d24005d20 con 0x55838309f6c0 2023-12-07T21:09:14.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.263+0000 7f5d2f5e4640 1 --2- 172.21.15.121:0/164456073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838309d5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5d20001660 tx=0x7f5d20001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7ff46bad10ab8d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.263+0000 7f5d2dde1640 1 -- 172.21.15.121:0/164456073 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d20003450 con 0x55838309f6c0 2023-12-07T21:09:14.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.263+0000 7f5d2dde1640 1 -- 172.21.15.121:0/164456073 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d200035d0 con 0x55838309f6c0 2023-12-07T21:09:14.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.263+0000 7f5d2dde1640 1 -- 172.21.15.121:0/164456073 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d20003930 con 0x55838309f6c0 2023-12-07T21:09:14.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d31ae4800 1 -- 172.21.15.121:0/164456073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 msgr2=0x55838309d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/164456073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838309d5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5d20001660 tx=0x7f5d20001b20 comp rx=0 tx=0).stop 2023-12-07T21:09:14.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d31ae4800 1 -- 172.21.15.121:0/164456073 shutdown_connections 2023-12-07T21:09:14.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/164456073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838309d5a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d31ae4800 1 -- 172.21.15.121:0/164456073 >> 172.21.15.121:0/164456073 conn(0x558383098f00 msgr2=0x55838313e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d31ae4800 1 -- 172.21.15.121:0/164456073 shutdown_connections 2023-12-07T21:09:14.262 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d31ae4800 1 -- 172.21.15.121:0/164456073 wait complete. 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d31ae4800 1 Processor -- start 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d31ae4800 1 -- start start 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d31ae4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838314b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d31ae4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558382fad6a0 con 0x55838309f6c0 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d2f5e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838314b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d2f5e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838314b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53410/0 (socket says 172.21.15.121:53410) 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.264+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/3156890476 learned_addr learned my addr 172.21.15.121:0/3156890476 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.265+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/3156890476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20006ce0 con 0x55838309f6c0 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.265+0000 7f5d2f5e4640 1 --2- 172.21.15.121:0/3156890476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838314b270 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55838313f350 tx=0x7f5d20001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.265+0000 7f5d2cddf640 1 -- 172.21.15.121:0/3156890476 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d20013820 con 0x55838309f6c0 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.265+0000 7f5d2cddf640 1 -- 172.21.15.121:0/3156890476 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d20013980 con 0x55838309f6c0 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.265+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3156890476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55838314b7b0 con 0x55838309f6c0 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.265+0000 7f5d2cddf640 1 -- 172.21.15.121:0/3156890476 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d20013c20 con 0x55838309f6c0 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.265+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3156890476 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55838314bcf0 con 0x55838309f6c0 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.265+0000 7f5d31ae4800 1 Processor -- start 2023-12-07T21:09:14.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d31ae4800 1 -- start start 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d2cddf640 1 -- 172.21.15.121:0/3156890476 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f5d2001e3e0 con 0x55838309f6c0 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d31ae4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 0x558383157890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d31ae4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558382f47890 con 0x558383157470 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d2cddf640 1 --2- 172.21.15.121:0/3156890476 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5d1c036110 0x7f5d1c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d2cddf640 1 -- 172.21.15.121:0/3156890476 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f5d2004b120 con 0x55838309f6c0 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d2fde5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 0x558383157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d2f5e4640 1 --2- 172.21.15.121:0/3156890476 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5d1c036110 0x7f5d1c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d2fde5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 0x558383157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53412/0 (socket says 172.21.15.121:53412) 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1591717386 learned_addr learned my addr 172.21.15.121:0/1591717386 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1591717386 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558383157dd0 con 0x558383157470 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d2f5e4640 1 --2- 172.21.15.121:0/3156890476 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5d1c036110 0x7f5d1c0385d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d20011ff0 tx=0x7f5d20011f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.266+0000 7f5d2fde5640 1 --2- 172.21.15.121:0/1591717386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 0x558383157890 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800a400 tx=0x7f5d2800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b429e04b81efc88 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d167fc640 1 -- 172.21.15.121:0/1591717386 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d280087e0 con 0x558383157470 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d167fc640 1 -- 172.21.15.121:0/1591717386 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d28008960 con 0x558383157470 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d167fc640 1 -- 172.21.15.121:0/1591717386 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d28008c80 con 0x558383157470 2023-12-07T21:09:14.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1591717386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 msgr2=0x558383157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/1591717386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 0x558383157890 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800a400 tx=0x7f5d2800a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1591717386 shutdown_connections 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/1591717386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 0x558383157890 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1591717386 >> 172.21.15.121:0/1591717386 conn(0x5583830a2610 msgr2=0x558383152850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1591717386 shutdown_connections 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1591717386 wait complete. 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d31ae4800 1 Processor -- start 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.267+0000 7f5d31ae4800 1 -- start start 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d31ae4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 0x55838315e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d31ae4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558382f47530 con 0x558383157470 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d2fde5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 0x55838315e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d2fde5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 0x55838315e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53414/0 (socket says 172.21.15.121:53414) 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 learned_addr learned my addr 172.21.15.121:0/1752997804 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d28005c90 con 0x558383157470 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d2fde5640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 0x55838315e4e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800a900 tx=0x7f5d28002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d14ff9640 1 -- 172.21.15.121:0/1752997804 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d28013780 con 0x558383157470 2023-12-07T21:09:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d14ff9640 1 -- 172.21.15.121:0/1752997804 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d280138e0 con 0x558383157470 2023-12-07T21:09:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55838315ea20 con 0x558383157470 2023-12-07T21:09:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d14ff9640 1 -- 172.21.15.121:0/1752997804 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d28013b80 con 0x558383157470 2023-12-07T21:09:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.268+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55838315eee0 con 0x558383157470 2023-12-07T21:09:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.269+0000 7f5d14ff9640 1 -- 172.21.15.121:0/1752997804 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f5d2801e420 con 0x558383157470 2023-12-07T21:09:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.269+0000 7f5d14ff9640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5d080360c0 0x7f5d08038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.269+0000 7f5d14ff9640 1 -- 172.21.15.121:0/1752997804 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f5d2804b7c0 con 0x558383157470 2023-12-07T21:09:14.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.269+0000 7f5d2ede3640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5d080360c0 0x7f5d08038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.270+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.270+0000 7f5d2ede3640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5d080360c0 0x7f5d08038580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d24054000 tx=0x7f5d2404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.270+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558383169bd0 0x55838316c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.270+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55838316c7e0 con 0x558383169bd0 2023-12-07T21:09:14.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.270+0000 7f5d2fde5640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558383169bd0 0x55838316c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.270+0000 7f5d2fde5640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558383169bd0 0x55838316c090 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.270+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.270+0000 7f5d31ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.270+0000 7f5d31ae4800 20 realm 2023-12-07T21:09:14.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.270+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.270+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55838316cbf0 con 0x558383169bd0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55838316d470 con 0x558383169bd0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55838316d7d0 con 0x558383169bd0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55838316dfd0 con 0x558383169bd0 2023-12-07T21:09:14.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.271+0000 7f5d31ae4800 20 searching for the correct realm 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.272+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55838316fcf0 0x558383172160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.272+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x55838316fcf0 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.272+0000 7f5d2f5e4640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55838316fcf0 0x558383172160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.272+0000 7f5d2f5e4640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55838316fcf0 0x558383172160 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.272+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d2002f040 con 0x55838316fcf0 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.272+0000 7f5d2f5e4640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f5d2004abd0 0x7f5d20010590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.272+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2004abd0 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.272+0000 7f5d2ede3640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f5d2004abd0 0x7f5d20010590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.273+0000 7f5d2ede3640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f5d2004abd0 0x7f5d20010590 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.273+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d24052840 con 0x7f5d2004abd0 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.273+0000 7f5d2ede3640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f5d2405c920 0x7f5d24009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.273+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2405c920 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.273+0000 7f5d2fde5640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f5d2405c920 0x7f5d24009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.273+0000 7f5d2fde5640 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f5d2405c920 0x7f5d24009410 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.273+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.274+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x558383169bd0 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.274+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.274+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x558383169bd0 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.274+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.274+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2405c920 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.274+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.274+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2405c920 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.274+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.274+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2004abd0 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.275+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d24052840 con 0x7f5d2004abd0 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.275+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x55838316fcf0 2023-12-07T21:09:14.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.275+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d2002f040 con 0x55838316fcf0 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.275+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x558383169bd0 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.275+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.275+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2405c920 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.275+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.275+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x558383169bd0 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.275+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.275+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2004abd0 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.276+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5d24052840 con 0x7f5d2004abd0 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.276+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x55838316fcf0 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.276+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d2002f040 con 0x55838316fcf0 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.276+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x55838316fcf0 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.276+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d2002f040 con 0x55838316fcf0 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.276+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2405c920 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.277+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.277+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x55838316fcf0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.277+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d2002f040 con 0x55838316fcf0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.277+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x55838316fcf0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.277+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d2002f040 con 0x55838316fcf0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.277+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x558383169bd0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.277+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.277+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x558383169bd0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.278+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.278+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2405c920 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.278+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.278+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x55838316fcf0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.278+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5d2002f040 con 0x55838316fcf0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.278+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2004abd0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.278+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d24052840 con 0x7f5d2004abd0 2023-12-07T21:09:14.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.278+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x558383169bd0 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.279+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.279+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2405c920 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.279+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.279+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x55838316fcf0 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.279+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d2002f040 con 0x55838316fcf0 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.279+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2405c920 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.279+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.280+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2004abd0 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.280+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d24052840 con 0x7f5d2004abd0 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.280+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x55838316fcf0 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.280+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d2002f040 con 0x55838316fcf0 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.280+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x7f5d2405c920 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.280+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.280+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172830 con 0x558383169bd0 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.280+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5d28054080 con 0x7f5d2004abd0 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d24052840 con 0x7f5d2004abd0 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55838316e8d0 con 0x558383169bd0 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55838316f120 con 0x558383169bd0 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55838316e550 con 0x55838316fcf0 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5d2002f040 con 0x55838316fcf0 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.281+0000 7f5d31ae4800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 20 zone default found 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 4 Realm: () 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 20 zonegroup default 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383172c70 con 0x7f5d2405c920 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383174a00 con 0x55838316fcf0 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5d2002f040 con 0x55838316fcf0 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383174d60 con 0x55838316fcf0 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.282+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5d20052040 con 0x55838316fcf0 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.283+0000 7f5d31ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.283+0000 7f5d31ae4800 20 started sync module instance, tier type = 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.283+0000 7f5d31ae4800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.283+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831742e0 con 0x7f5d2004abd0 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.284+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d24052840 con 0x7f5d2004abd0 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.284+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94023326003024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383175180 con 0x7f5d2004abd0 2023-12-07T21:09:14.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.284+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383175980 con 0x558383169bd0 2023-12-07T21:09:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.285+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94023326003024] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d24071040 con 0x7f5d2004abd0 2023-12-07T21:09:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.285+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.285+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94023328415296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383175980 con 0x558383169bd0 2023-12-07T21:09:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.285+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383176180 con 0x55838316fcf0 2023-12-07T21:09:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.286+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94023328415296] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.286+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d20052040 con 0x55838316fcf0 2023-12-07T21:09:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.286+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94023328421360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831764e0 con 0x55838316fcf0 2023-12-07T21:09:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.286+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383176e50 con 0x7f5d2004abd0 2023-12-07T21:09:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.287+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d24071040 con 0x7f5d2004abd0 2023-12-07T21:09:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.287+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94023328428544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383177ab0 con 0x7f5d2004abd0 2023-12-07T21:09:14.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.287+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383178420 con 0x558383169bd0 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.287+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94023328421360] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d20052040 con 0x55838316fcf0 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.288+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.288+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94023328432000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383178830 con 0x558383169bd0 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.288+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383179030 con 0x7f5d2405c920 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.288+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94023328428544] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d24071040 con 0x7f5d2004abd0 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.289+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.289+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94023328432000] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.289+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94023328434224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383177720 con 0x7f5d2405c920 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.289+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383179550 con 0x7f5d2405c920 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.290+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94023328434224] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.290+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.290+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94023328433040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383177720 con 0x7f5d2405c920 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.290+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383179c00 con 0x7f5d2405c920 2023-12-07T21:09:14.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.291+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.291+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94023328437952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55838317a060 con 0x7f5d2405c920 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.291+0000 7f5d31ae4800 20 add_watcher() i=0 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.291+0000 7f5d31ae4800 20 add_watcher() i=1 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.291+0000 7f5d31ae4800 20 add_watcher() i=2 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.291+0000 7f5d31ae4800 20 add_watcher() i=3 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.291+0000 7f5d31ae4800 20 add_watcher() i=4 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.291+0000 7f5d31ae4800 20 add_watcher() i=5 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.291+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94023328433040] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.291+0000 7f5d31ae4800 20 add_watcher() i=6 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.292+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94023328437952] v31'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.292+0000 7f5d31ae4800 20 add_watcher() i=7 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.292+0000 7f5d31ae4800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.292+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55838317a060 con 0x558383169bd0 2023-12-07T21:09:14.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.292+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.292+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94023328439232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383179fd0 con 0x558383169bd0 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.293+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94023328439232] v31'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.293+0000 7f5cf57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 5 note: GC not initialized 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5c6ffff640 20 reqs_thread_entry: start 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 20 Filter name: none 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5c6dffb640 20 reqs_thread_entry: start 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b00c0 con 0x558383169bd0 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.294+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b04e0 con 0x7f5d2405c920 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.295+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.295+0000 7f5d31ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.295+0000 7f5d31ae4800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.295+0000 7f5d31ae4800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.295+0000 7f5d31ae4800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.295+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~459 in=459b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b5e10 con 0x558383169bd0 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.296+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~459] v31'4 uv4 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.296+0000 7f5d31ae4800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.296+0000 7f5d31ae4800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.296+0000 7f5d31ae4800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.296+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94023328667856 in=647b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b3190 con 0x558383169bd0 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.296+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94023328432000 notify 133143986179 ret 0) v3 ==== 677+0+0 (crc 0 0 0) 0x55838315eee0 con 0x558383169bd0 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.296+0000 7f5d167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94023328432000 notifier 4318 bl.length()=635 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.296+0000 7f5d167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.296+0000 7f5d167fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.296+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(65 notify.4 [notify cookie 94023328667856 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.296+0000 7f5d167fc640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5d040042a0 con 0x558383169bd0 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.297+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.297+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== watch-notify(notify_complete (2) cookie 94023328667856 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55838315ea20 con 0x558383169bd0 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.297+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b0c70 con 0x7f5d2405c920 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.298+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.298+0000 7f5d31ae4800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.298+0000 7f5d31ae4800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:09:14.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.298+0000 7f5d31ae4800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-12-07T21:09:14.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.298+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94023328667856 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b2cf0 con 0x55838316fcf0 2023-12-07T21:09:14.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.298+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== watch-notify(notify (1) cookie 94023328421360 notify 133143986176 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55838314bcf0 con 0x55838316fcf0 2023-12-07T21:09:14.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.298+0000 7f5d15ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94023328421360 notifier 4318 bl.length()=177 2023-12-07T21:09:14.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.298+0000 7f5d15ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-12-07T21:09:14.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.298+0000 7f5d15ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:09:14.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.298+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(68 notify.2 [notify cookie 94023328667856 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5d20052040 con 0x55838316fcf0 2023-12-07T21:09:14.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.298+0000 7f5d15ffb640 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5c74003400 con 0x55838316fcf0 2023-12-07T21:09:14.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.299+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d20052040 con 0x55838316fcf0 2023-12-07T21:09:14.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.299+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== watch-notify(notify_complete (2) cookie 94023328667856 notify 133143986176 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55838314b7b0 con 0x55838316fcf0 2023-12-07T21:09:14.299 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:14.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.300+0000 7f5cf57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.300+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94023328439232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b1010 con 0x558383169bd0 2023-12-07T21:09:14.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.300+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94023328439232] v31'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.300+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94023326003024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383198eb0 con 0x7f5d2004abd0 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.301+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94023326003024] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d24071040 con 0x7f5d2004abd0 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.301+0000 7f5d31ae4800 20 remove_watcher() i=0 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.301+0000 7f5d31ae4800 2 removed watcher, disabling cache 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.301+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94023328415296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b1010 con 0x558383169bd0 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.302+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94023328415296] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.302+0000 7f5d31ae4800 20 remove_watcher() i=1 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.302+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94023328421360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b1010 con 0x55838316fcf0 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.303+0000 7f5d2f5e4640 1 -- 172.21.15.121:0/1752997804 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94023328421360] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d20052040 con 0x55838316fcf0 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.303+0000 7f5d31ae4800 20 remove_watcher() i=2 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.303+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94023328428544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b1010 con 0x7f5d2004abd0 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.304+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94023328428544] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d24071040 con 0x7f5d2004abd0 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.304+0000 7f5d31ae4800 20 remove_watcher() i=3 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.304+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94023328432000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b1370 con 0x558383169bd0 2023-12-07T21:09:14.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.305+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94023328432000] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x558383169bd0 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.305+0000 7f5d31ae4800 20 remove_watcher() i=4 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.305+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94023328434224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5583831b1370 con 0x7f5d2405c920 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.306+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94023328434224] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.306+0000 7f5d31ae4800 20 remove_watcher() i=5 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.306+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94023328433040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383178830 con 0x7f5d2405c920 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.307+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94023328433040] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.307+0000 7f5d31ae4800 20 remove_watcher() i=6 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.307+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94023328437952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558383178830 con 0x7f5d2405c920 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.308+0000 7f5d2fde5640 1 -- 172.21.15.121:0/1752997804 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94023328437952] v31'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d28024070 con 0x7f5d2405c920 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.308+0000 7f5d31ae4800 20 remove_watcher() i=7 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.308+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f5d2405c920 msgr2=0x7f5d24009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.308+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f5d2405c920 0x7f5d24009410 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.308+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558383169bd0 msgr2=0x55838316c090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.308+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558383169bd0 0x55838316c090 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.308+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f5d2004abd0 msgr2=0x7f5d20010590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.308+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f5d2004abd0 0x7f5d20010590 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.308+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55838316fcf0 msgr2=0x558383172160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.308+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55838316fcf0 0x558383172160 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5d080360c0 msgr2=0x7f5d08038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5d080360c0 0x7f5d08038580 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5d24054000 tx=0x7f5d2404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 msgr2=0x55838315e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/1752997804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558383157470 0x55838315e4e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800a900 tx=0x7f5d28002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 reap_dead start 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d2ede3640 1 -- 172.21.15.121:0/1752997804 reap_dead start 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 shutdown_connections 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 >> 172.21.15.121:0/1752997804 conn(0x5583830a2610 msgr2=0x558383151650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 shutdown_connections 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/1752997804 wait complete. 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3156890476 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5d1c036110 msgr2=0x7f5d1c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/3156890476 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5d1c036110 0x7f5d1c0385d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d20011ff0 tx=0x7f5d20011f60 comp rx=0 tx=0).stop 2023-12-07T21:09:14.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3156890476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 msgr2=0x55838314b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/3156890476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838314b270 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55838313f350 tx=0x7f5d20001250 comp rx=0 tx=0).stop 2023-12-07T21:09:14.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3156890476 shutdown_connections 2023-12-07T21:09:14.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/3156890476 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5d1c036110 0x7f5d1c0385d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 --2- 172.21.15.121:0/3156890476 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55838309f6c0 0x55838314b270 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3156890476 >> 172.21.15.121:0/3156890476 conn(0x558383098f00 msgr2=0x558383141970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3156890476 shutdown_connections 2023-12-07T21:09:14.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.309+0000 7f5d31ae4800 1 -- 172.21.15.121:0/3156890476 wait complete. 2023-12-07T21:09:14.308 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:14.308 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-12-07T21:09:14.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-12-07T21:09:14.308 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-12-07T21:09:14.350 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:14.350 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:14.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.358+0000 7f46b4233800 1 Processor -- start 2023-12-07T21:09:14.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.358+0000 7f46b4233800 1 -- start start 2023-12-07T21:09:14.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.358+0000 7f46b4233800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558d2582f540 0x558d25831930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.358+0000 7f46b4233800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558d257787a0 con 0x558d2582b100 2023-12-07T21:09:14.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.358+0000 7f46b4233800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x558d25741880 con 0x558d2582f540 2023-12-07T21:09:14.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.358+0000 7f46b1532640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558d2582f540 0x558d25831930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.358+0000 7f46b1d33640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x558d2582b100 0x558d2582b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37780/0 (socket says 172.21.15.121:37780) 2023-12-07T21:09:14.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.358+0000 7f46b1d33640 1 -- 172.21.15.121:0/1249722787 learned_addr learned my addr 172.21.15.121:0/1249722787 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:14.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.358+0000 7f46b1532640 1 -- 172.21.15.121:0/1249722787 >> v1:172.21.15.89:6789/0 conn(0x558d2582b100 legacy=0x558d2582b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.358+0000 7f46b1532640 1 -- 172.21.15.121:0/1249722787 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d25832f60 con 0x558d2582f540 2023-12-07T21:09:14.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.360+0000 7f46b1532640 1 --2- 172.21.15.121:0/1249722787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582f540 0x558d25831930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f46a800a470 tx=0x7f46a801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb380f93ce300a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.360+0000 7f46b0d31640 1 -- 172.21.15.121:0/1249722787 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46a8052570 con 0x558d2582f540 2023-12-07T21:09:14.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.360+0000 7f46b0d31640 1 -- 172.21.15.121:0/1249722787 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a80526d0 con 0x558d2582f540 2023-12-07T21:09:14.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.360+0000 7f46b0d31640 1 -- 172.21.15.121:0/1249722787 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46a8052990 con 0x558d2582f540 2023-12-07T21:09:14.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.361+0000 7f46b4233800 1 -- 172.21.15.121:0/1249722787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582f540 msgr2=0x558d25831930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.361+0000 7f46b4233800 1 --2- 172.21.15.121:0/1249722787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582f540 0x558d25831930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f46a800a470 tx=0x7f46a801cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:14.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.361+0000 7f46b4233800 1 -- 172.21.15.121:0/1249722787 shutdown_connections 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.361+0000 7f46b4233800 1 --2- 172.21.15.121:0/1249722787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582f540 0x558d25831930 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.361+0000 7f46b4233800 1 -- 172.21.15.121:0/1249722787 >> 172.21.15.121:0/1249722787 conn(0x558d25826880 msgr2=0x558d25828ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.361+0000 7f46b4233800 1 -- 172.21.15.121:0/1249722787 shutdown_connections 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.361+0000 7f46b4233800 1 -- 172.21.15.121:0/1249722787 wait complete. 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.362+0000 7f46b4233800 1 Processor -- start 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.362+0000 7f46b4233800 1 -- start start 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.362+0000 7f46b4233800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.362+0000 7f46b4233800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2573edb0 con 0x558d2582b100 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.362+0000 7f46b1d33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.362+0000 7f46b1d33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53428/0 (socket says 172.21.15.121:53428) 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.362+0000 7f46b1d33640 1 -- 172.21.15.121:0/1223113625 learned_addr learned my addr 172.21.15.121:0/1223113625 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.362+0000 7f46b1d33640 1 -- 172.21.15.121:0/1223113625 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a8005d20 con 0x558d2582b100 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.362+0000 7f46b1d33640 1 --2- 172.21.15.121:0/1223113625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258cfd00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46a4001c80 tx=0x7f46a400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa04e9aec93e226 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.362+0000 7f46a3fff640 1 -- 172.21.15.121:0/1223113625 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46a400e470 con 0x558d2582b100 2023-12-07T21:09:14.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46a3fff640 1 -- 172.21.15.121:0/1223113625 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a400e5d0 con 0x558d2582b100 2023-12-07T21:09:14.357 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46a3fff640 1 -- 172.21.15.121:0/1223113625 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46a400e8d0 con 0x558d2582b100 2023-12-07T21:09:14.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46b4233800 1 -- 172.21.15.121:0/1223113625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 msgr2=0x558d258cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46b4233800 1 --2- 172.21.15.121:0/1223113625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258cfd00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46a4001c80 tx=0x7f46a400b6c0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46b4233800 1 -- 172.21.15.121:0/1223113625 shutdown_connections 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46b4233800 1 --2- 172.21.15.121:0/1223113625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258cfd00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46b4233800 1 -- 172.21.15.121:0/1223113625 >> 172.21.15.121:0/1223113625 conn(0x558d25826880 msgr2=0x558d258cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46b4233800 1 -- 172.21.15.121:0/1223113625 shutdown_connections 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46b4233800 1 -- 172.21.15.121:0/1223113625 wait complete. 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46b4233800 1 Processor -- start 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46b4233800 1 -- start start 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46b4233800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258d4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.363+0000 7f46b4233800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d2573a6a0 con 0x558d2582b100 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.364+0000 7f46b1d33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258d4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.364+0000 7f46b1d33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258d4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53442/0 (socket says 172.21.15.121:53442) 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.364+0000 7f46b1d33640 1 -- 172.21.15.121:0/2979851543 learned_addr learned my addr 172.21.15.121:0/2979851543 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.364+0000 7f46b1d33640 1 -- 172.21.15.121:0/2979851543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d257787a0 con 0x558d2582b100 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.364+0000 7f46b1d33640 1 --2- 172.21.15.121:0/2979851543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258d4a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f46a4001ed0 tx=0x7f46a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.364+0000 7f46a2ffd640 1 -- 172.21.15.121:0/2979851543 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46a401f070 con 0x558d2582b100 2023-12-07T21:09:14.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.364+0000 7f46a2ffd640 1 -- 172.21.15.121:0/2979851543 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a4018640 con 0x558d2582b100 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.364+0000 7f46b4233800 1 -- 172.21.15.121:0/2979851543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d258d4fb0 con 0x558d2582b100 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.364+0000 7f46a2ffd640 1 -- 172.21.15.121:0/2979851543 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46a40188e0 con 0x558d2582b100 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.364+0000 7f46b4233800 1 -- 172.21.15.121:0/2979851543 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d258d34e0 con 0x558d2582b100 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46b4233800 1 Processor -- start 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46b4233800 1 -- start start 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46a2ffd640 1 -- 172.21.15.121:0/2979851543 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f46a4018a40 con 0x558d2582b100 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46b4233800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258e6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46b4233800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d256d4890 con 0x558d258e66c0 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46a2ffd640 1 --2- 172.21.15.121:0/2979851543 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4694036110 0x7f46940385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46a2ffd640 1 -- 172.21.15.121:0/2979851543 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f46a404b930 con 0x558d2582b100 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46b2534640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258e6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46b2534640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258e6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53452/0 (socket says 172.21.15.121:53452) 2023-12-07T21:09:14.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46b2534640 1 -- 172.21.15.121:0/3668438898 learned_addr learned my addr 172.21.15.121:0/3668438898 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46b1d33640 1 --2- 172.21.15.121:0/2979851543 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4694036110 0x7f46940385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.365+0000 7f46b2534640 1 -- 172.21.15.121:0/3668438898 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d258e7020 con 0x558d258e66c0 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46b1d33640 1 --2- 172.21.15.121:0/2979851543 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4694036110 0x7f46940385d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f46a400dfd0 tx=0x7f46a400df20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46b2534640 1 --2- 172.21.15.121:0/3668438898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258e6ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00a430 tx=0x7f46ac00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdcc16606c753cfb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46a0ff9640 1 -- 172.21.15.121:0/3668438898 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46ac001650 con 0x558d258e66c0 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46a0ff9640 1 -- 172.21.15.121:0/3668438898 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac0017d0 con 0x558d258e66c0 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46a0ff9640 1 -- 172.21.15.121:0/3668438898 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46ac001ab0 con 0x558d258e66c0 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46b4233800 1 -- 172.21.15.121:0/3668438898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 msgr2=0x558d258e6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46b4233800 1 --2- 172.21.15.121:0/3668438898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258e6ae0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00a430 tx=0x7f46ac00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46b4233800 1 -- 172.21.15.121:0/3668438898 shutdown_connections 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46b4233800 1 --2- 172.21.15.121:0/3668438898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258e6ae0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46b4233800 1 -- 172.21.15.121:0/3668438898 >> 172.21.15.121:0/3668438898 conn(0x558d2582f540 msgr2=0x558d258e1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46b4233800 1 -- 172.21.15.121:0/3668438898 shutdown_connections 2023-12-07T21:09:14.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46b4233800 1 -- 172.21.15.121:0/3668438898 wait complete. 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.366+0000 7f46b4233800 1 Processor -- start 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f46b4233800 1 -- start start 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f46b4233800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f46b4233800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d256d4530 con 0x558d258e66c0 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f46b2534640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f46b2534640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258ed6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53464/0 (socket says 172.21.15.121:53464) 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 learned_addr learned my addr 172.21.15.121:0/4241559498 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac00a0e0 con 0x558d258e66c0 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f46b2534640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258ed6f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00a930 tx=0x7f46ac003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f4692ffd640 1 -- 172.21.15.121:0/4241559498 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46ac010900 con 0x558d258e66c0 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f4692ffd640 1 -- 172.21.15.121:0/4241559498 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac010a60 con 0x558d258e66c0 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d258edc30 con 0x558d258e66c0 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f4692ffd640 1 -- 172.21.15.121:0/4241559498 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46ac010d20 con 0x558d258e66c0 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.367+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d258ee090 con 0x558d258e66c0 2023-12-07T21:09:14.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.368+0000 7f4692ffd640 1 -- 172.21.15.121:0/4241559498 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f46ac017030 con 0x558d258e66c0 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.368+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.368+0000 7f4692ffd640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f468c036110 0x7f468c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.368+0000 7f4692ffd640 1 -- 172.21.15.121:0/4241559498 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f46ac04b850 con 0x558d258e66c0 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.368+0000 7f46b1532640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f468c036110 0x7f468c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b4233800 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558d258f8e50 0x558d258fb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d258fba30 con 0x558d258f8e50 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b2534640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558d258f8e50 0x558d258fb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b1532640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f468c036110 0x7f468c0385d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46a8054000 tx=0x7f46a804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b2534640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558d258f8e50 0x558d258fb2e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b4233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b4233800 20 realm 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d258fbe20 con 0x558d258f8e50 2023-12-07T21:09:14.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b4233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b4233800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.369+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d258fc670 con 0x558d258f8e50 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b4233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d258fc9d0 con 0x558d258f8e50 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b4233800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d258fc310 con 0x558d258f8e50 2023-12-07T21:09:14.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b4233800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b4233800 20 searching for the correct realm 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b4233800 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558d258fec20 0x558d25901010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258fec20 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b1d33640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558d258fec20 0x558d25901010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.370+0000 7f46b1d33640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558d258fec20 0x558d25901010 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.371+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a4014070 con 0x558d258fec20 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.371+0000 7f46b1d33640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f46a4017050 0x7f46a40269d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.371+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a4017050 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.371+0000 7f46b1532640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f46a4017050 0x7f46a40269d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.371+0000 7f46b1532640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f46a4017050 0x7f46a40269d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.371+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a8052840 con 0x7f46a4017050 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.371+0000 7f46b1532640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f46a805c920 0x7f46a8009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.371+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a805c920 2023-12-07T21:09:14.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.372+0000 7f46b2534640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f46a805c920 0x7f46a8009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.372+0000 7f46b2534640 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f46a805c920 0x7f46a8009410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.372+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.372+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258f8e50 2023-12-07T21:09:14.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.372+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.372+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258f8e50 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.373+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.373+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a805c920 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.373+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.373+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a805c920 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.373+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.373+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a4017050 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.373+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a8052840 con 0x7f46a4017050 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.373+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258fec20 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.374+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.374+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258f8e50 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.374+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.374+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a805c920 2023-12-07T21:09:14.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.374+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.374+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258f8e50 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.374+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.374+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a4017050 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.374+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f46a8052840 con 0x7f46a4017050 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.374+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258fec20 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.375+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.375+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258fec20 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.375+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.375+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a805c920 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.375+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.375+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258fec20 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.375+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.375+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258fec20 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.375+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.375+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258f8e50 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.376+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.376+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258f8e50 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.376+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.376+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a805c920 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.376+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.376+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258fec20 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.376+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.376+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a4017050 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.377+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a8052840 con 0x7f46a4017050 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.377+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258f8e50 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.377+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.377+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a805c920 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.377+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.377+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258fec20 2023-12-07T21:09:14.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.377+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.377+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a805c920 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.378+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.378+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a4017050 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.378+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a8052840 con 0x7f46a4017050 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.378+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258fec20 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.378+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.378+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x7f46a805c920 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.378+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.378+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259015f0 con 0x558d258f8e50 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f46ac053080 con 0x7f46a4017050 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f46a8052840 con 0x7f46a4017050 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:14.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d258fd830 con 0x558d258f8e50 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d258fd480 con 0x558d258f8e50 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.379+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d258fd4d0 con 0x558d258fec20 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.386 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 20 zone default found 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 4 Realm: () 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 20 zonegroup default 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25901a10 con 0x7f46a805c920 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25903890 con 0x558d258fec20 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25903bf0 con 0x558d258fec20 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.380+0000 7f46b4233800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.381+0000 7f46b4233800 20 started sync module instance, tier type = 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.381+0000 7f46b4233800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.381+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25902e60 con 0x7f46a4017050 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.381+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46a8052840 con 0x7f46a4017050 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.381+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94064706535248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25903250 con 0x7f46a4017050 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.382+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259043f0 con 0x558d258f8e50 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.382+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94064706535248] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46a8071040 con 0x7f46a4017050 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.383+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.383+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94064708954560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259043f0 con 0x558d258f8e50 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.383+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25904dc0 con 0x558d258fec20 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.383+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94064708954560] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.384+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.384+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94064708960080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25904360 con 0x558d258fec20 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.384+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25905ab0 con 0x7f46a4017050 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.385+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46a8071040 con 0x7f46a4017050 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.385+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94064708968032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25906710 con 0x7f46a4017050 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.385+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25907080 con 0x558d258f8e50 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.385+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94064708960080] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.386+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.386+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94064708971488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25906ff0 con 0x558d258f8e50 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.386+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25907d70 con 0x7f46a805c920 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.386+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94064708968032] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46a8071040 con 0x7f46a4017050 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.387+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94064708971488] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.387+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.387+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94064708969072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25907880 con 0x7f46a805c920 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.387+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25908080 con 0x7f46a805c920 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.388+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94064708969072] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.388+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.388+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94064708974016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25907f10 con 0x7f46a805c920 2023-12-07T21:09:14.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.388+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259089e0 con 0x7f46a805c920 2023-12-07T21:09:14.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.389+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.389+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94064708977856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25908e40 con 0x7f46a805c920 2023-12-07T21:09:14.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.389+0000 7f46b4233800 20 add_watcher() i=0 2023-12-07T21:09:14.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.389+0000 7f46b4233800 20 add_watcher() i=1 2023-12-07T21:09:14.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.389+0000 7f46b4233800 20 add_watcher() i=2 2023-12-07T21:09:14.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.389+0000 7f46b4233800 20 add_watcher() i=3 2023-12-07T21:09:14.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.389+0000 7f46b4233800 20 add_watcher() i=4 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.389+0000 7f46b4233800 20 add_watcher() i=5 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.389+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94064708974016] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.389+0000 7f46b4233800 20 add_watcher() i=6 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.392+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94064708977856] v31'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.392+0000 7f46b4233800 20 add_watcher() i=7 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.392+0000 7f46b4233800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.392+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25908e40 con 0x558d258f8e50 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.392+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.392+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94064708979104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25908db0 con 0x558d258f8e50 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.393+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94064708979104] v31'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.393+0000 7f46777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.393+0000 7f46b4233800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.393+0000 7f46b4233800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.393+0000 7f46b4233800 5 note: GC not initialized 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.393+0000 7f46767e4640 20 reqs_thread_entry: start 2023-12-07T21:09:14.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.393+0000 7f46b4233800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:14.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.394+0000 7f46b4233800 20 Filter name: none 2023-12-07T21:09:14.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.394+0000 7f45e7fff640 20 reqs_thread_entry: start 2023-12-07T21:09:14.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.394+0000 7f46b4233800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.394+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d2593e900 con 0x558d258f8e50 2023-12-07T21:09:14.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.394+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.394+0000 7f46b4233800 20 rados_obj.operate() r=0 bl.length=459 2023-12-07T21:09:14.394 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:14.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.395+0000 7f46777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.395+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94064708979104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d2593d840 con 0x558d258f8e50 2023-12-07T21:09:14.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.396+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94064708979104] v31'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.396+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94064706535248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d2593d840 con 0x7f46a4017050 2023-12-07T21:09:14.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.397+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94064706535248] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46a8071040 con 0x7f46a4017050 2023-12-07T21:09:14.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.397+0000 7f46b4233800 20 remove_watcher() i=0 2023-12-07T21:09:14.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.397+0000 7f46b4233800 2 removed watcher, disabling cache 2023-12-07T21:09:14.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.397+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94064708954560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d2593dba0 con 0x558d258f8e50 2023-12-07T21:09:14.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.398+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94064708954560] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.398+0000 7f46b4233800 20 remove_watcher() i=1 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.398+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94064708960080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d2593dba0 con 0x558d258fec20 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.399+0000 7f46b1d33640 1 -- 172.21.15.121:0/4241559498 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94064708960080] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46a4042040 con 0x558d258fec20 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.399+0000 7f46b4233800 20 remove_watcher() i=2 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.399+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94064708968032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d259092e0 con 0x7f46a4017050 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.400+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94064708968032] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46a8071040 con 0x7f46a4017050 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.400+0000 7f46b4233800 20 remove_watcher() i=3 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.400+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94064708971488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25909640 con 0x558d258f8e50 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.401+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94064708971488] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x558d258f8e50 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.401+0000 7f46b4233800 20 remove_watcher() i=4 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.401+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94064708969072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25909640 con 0x7f46a805c920 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.402+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94064708969072] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.402+0000 7f46b4233800 20 remove_watcher() i=5 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.402+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94064708974016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25906270 con 0x7f46a805c920 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.403+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94064708974016] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.403+0000 7f46b4233800 20 remove_watcher() i=6 2023-12-07T21:09:14.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.403+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94064708977856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558d25906270 con 0x7f46a805c920 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b2534640 1 -- 172.21.15.121:0/4241559498 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94064708977856] v31'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f46ac02e9d0 con 0x7f46a805c920 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 20 remove_watcher() i=7 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f46a805c920 msgr2=0x7f46a8009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f46a805c920 0x7f46a8009410 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558d258f8e50 msgr2=0x558d258fb2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558d258f8e50 0x558d258fb2e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f46a4017050 msgr2=0x7f46a40269d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f46a4017050 0x7f46a40269d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558d258fec20 msgr2=0x558d25901010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558d258fec20 0x558d25901010 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f468c036110 msgr2=0x7f468c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f468c036110 0x7f468c0385d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46a8054000 tx=0x7f46a804e000 comp rx=0 tx=0).stop 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 msgr2=0x558d258ed6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258ed6f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00a930 tx=0x7f46ac003370 comp rx=0 tx=0).stop 2023-12-07T21:09:14.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b1532640 1 -- 172.21.15.121:0/4241559498 reap_dead start 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 shutdown_connections 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 --2- 172.21.15.121:0/4241559498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d258e66c0 0x558d258ed6f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 >> 172.21.15.121:0/4241559498 conn(0x558d2582f540 msgr2=0x558d258e08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 shutdown_connections 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.404+0000 7f46b4233800 1 -- 172.21.15.121:0/4241559498 wait complete. 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.405+0000 7f46b4233800 1 -- 172.21.15.121:0/2979851543 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4694036110 msgr2=0x7f46940385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.405+0000 7f46b4233800 1 --2- 172.21.15.121:0/2979851543 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4694036110 0x7f46940385d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f46a400dfd0 tx=0x7f46a400df20 comp rx=0 tx=0).stop 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.405+0000 7f46b4233800 1 -- 172.21.15.121:0/2979851543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 msgr2=0x558d258d4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.405+0000 7f46b4233800 1 --2- 172.21.15.121:0/2979851543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258d4a70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f46a4001ed0 tx=0x7f46a4000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.405+0000 7f46b4233800 1 -- 172.21.15.121:0/2979851543 shutdown_connections 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.405+0000 7f46b4233800 1 --2- 172.21.15.121:0/2979851543 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4694036110 0x7f46940385d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.405+0000 7f46b4233800 1 --2- 172.21.15.121:0/2979851543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558d2582b100 0x558d258d4a70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.405+0000 7f46b4233800 1 -- 172.21.15.121:0/2979851543 >> 172.21.15.121:0/2979851543 conn(0x558d25826880 msgr2=0x558d258ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.405+0000 7f46b4233800 1 -- 172.21.15.121:0/2979851543 shutdown_connections 2023-12-07T21:09:14.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.405+0000 7f46b4233800 1 -- 172.21.15.121:0/2979851543 wait complete. 2023-12-07T21:09:14.402 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:14.402 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2023-12-07T21:09:14.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2023-12-07T21:09:14.403 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2023-12-07T21:09:14.487 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:14.487 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:14.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.495+0000 7f7594f20800 1 Processor -- start 2023-12-07T21:09:14.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.495+0000 7f7594f20800 1 -- start start 2023-12-07T21:09:14.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.495+0000 7f7594f20800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d44a27d780 0x55d44a27dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.495+0000 7f7594f20800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d44a1c9740 con 0x55d44a27e0e0 2023-12-07T21:09:14.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.495+0000 7f7594f20800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d44a192880 con 0x55d44a27d780 2023-12-07T21:09:14.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.495+0000 7f7590bc9640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d44a27d780 0x55d44a27dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.495+0000 7f75903c8640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55d44a27e0e0 0x55d44a284a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37790/0 (socket says 172.21.15.121:37790) 2023-12-07T21:09:14.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.496+0000 7f75903c8640 1 -- 172.21.15.121:0/4094764086 learned_addr learned my addr 172.21.15.121:0/4094764086 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:14.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.496+0000 7f758fbc7640 1 -- 172.21.15.121:0/4094764086 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851073276 0 0) 0x55d44a1c9740 con 0x55d44a27e0e0 2023-12-07T21:09:14.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.496+0000 7f758fbc7640 1 -- 172.21.15.121:0/4094764086 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7578001e10 con 0x55d44a27e0e0 2023-12-07T21:09:14.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.496+0000 7f7590bc9640 1 -- 172.21.15.121:0/4094764086 >> v1:172.21.15.89:6789/0 conn(0x55d44a27e0e0 legacy=0x55d44a284a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.496+0000 7f7590bc9640 1 -- 172.21.15.121:0/4094764086 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d44a2872f0 con 0x55d44a27d780 2023-12-07T21:09:14.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.498+0000 7f7590bc9640 1 --2- 172.21.15.121:0/4094764086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a27dba0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f758000a470 tx=0x7f758001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce49ac9954ceb57 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.498+0000 7f758fbc7640 1 -- 172.21.15.121:0/4094764086 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f758004ad60 con 0x55d44a27d780 2023-12-07T21:09:14.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.498+0000 7f758fbc7640 1 -- 172.21.15.121:0/4094764086 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7580052440 con 0x55d44a27d780 2023-12-07T21:09:14.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.498+0000 7f758fbc7640 1 -- 172.21.15.121:0/4094764086 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7580052700 con 0x55d44a27d780 2023-12-07T21:09:14.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.498+0000 7f7594f20800 1 -- 172.21.15.121:0/4094764086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 msgr2=0x55d44a27dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.498+0000 7f7594f20800 1 --2- 172.21.15.121:0/4094764086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a27dba0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f758000a470 tx=0x7f758001cc80 comp rx=0 tx=0).stop 2023-12-07T21:09:14.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.498+0000 7f7594f20800 1 -- 172.21.15.121:0/4094764086 shutdown_connections 2023-12-07T21:09:14.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.498+0000 7f7594f20800 1 --2- 172.21.15.121:0/4094764086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a27dba0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.498+0000 7f7594f20800 1 -- 172.21.15.121:0/4094764086 >> 172.21.15.121:0/4094764086 conn(0x55d44a276f70 msgr2=0x55d44a279390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.498+0000 7f7594f20800 1 -- 172.21.15.121:0/4094764086 shutdown_connections 2023-12-07T21:09:14.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.498+0000 7f7594f20800 1 -- 172.21.15.121:0/4094764086 wait complete. 2023-12-07T21:09:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.499+0000 7f7594f20800 1 Processor -- start 2023-12-07T21:09:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.499+0000 7f7594f20800 1 -- start start 2023-12-07T21:09:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.499+0000 7f7594f20800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a323f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.499+0000 7f7594f20800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d44a18fdb0 con 0x55d44a27d780 2023-12-07T21:09:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.499+0000 7f7590bc9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a323f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.499+0000 7f7590bc9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a323f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53478/0 (socket says 172.21.15.121:53478) 2023-12-07T21:09:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.499+0000 7f7590bc9640 1 -- 172.21.15.121:0/3060154740 learned_addr learned my addr 172.21.15.121:0/3060154740 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f7590bc9640 1 -- 172.21.15.121:0/3060154740 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7580005d20 con 0x55d44a27d780 2023-12-07T21:09:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f7590bc9640 1 --2- 172.21.15.121:0/3060154740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a323f60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7580055040 tx=0x7f758004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c46e201123e2ce server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f758f3c6640 1 -- 172.21.15.121:0/3060154740 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f758000a050 con 0x55d44a27d780 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f758f3c6640 1 -- 172.21.15.121:0/3060154740 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758000a1b0 con 0x55d44a27d780 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f758f3c6640 1 -- 172.21.15.121:0/3060154740 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75800525b0 con 0x55d44a27d780 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f7594f20800 1 -- 172.21.15.121:0/3060154740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 msgr2=0x55d44a323f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f7594f20800 1 --2- 172.21.15.121:0/3060154740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a323f60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7580055040 tx=0x7f758004c000 comp rx=0 tx=0).stop 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f7594f20800 1 -- 172.21.15.121:0/3060154740 shutdown_connections 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f7594f20800 1 --2- 172.21.15.121:0/3060154740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a323f60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f7594f20800 1 -- 172.21.15.121:0/3060154740 >> 172.21.15.121:0/3060154740 conn(0x55d44a276f70 msgr2=0x55d44a31fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f7594f20800 1 -- 172.21.15.121:0/3060154740 shutdown_connections 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.500+0000 7f7594f20800 1 -- 172.21.15.121:0/3060154740 wait complete. 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.501+0000 7f7594f20800 1 Processor -- start 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.501+0000 7f7594f20800 1 -- start start 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.501+0000 7f7594f20800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a32b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.501+0000 7f7594f20800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d44a18b6a0 con 0x55d44a27d780 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.501+0000 7f7590bc9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a32b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.501+0000 7f7590bc9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a32b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53492/0 (socket says 172.21.15.121:53492) 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.501+0000 7f7590bc9640 1 -- 172.21.15.121:0/4236340127 learned_addr learned my addr 172.21.15.121:0/4236340127 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.501+0000 7f7590bc9640 1 -- 172.21.15.121:0/4236340127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d44a2872f0 con 0x55d44a27d780 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.501+0000 7f7590bc9640 1 --2- 172.21.15.121:0/4236340127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a32b330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f758005f040 tx=0x7f7580003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f758e3c4640 1 -- 172.21.15.121:0/4236340127 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7580052b90 con 0x55d44a27d780 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f758e3c4640 1 -- 172.21.15.121:0/4236340127 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7580052cf0 con 0x55d44a27d780 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f758e3c4640 1 -- 172.21.15.121:0/4236340127 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7580065450 con 0x55d44a27d780 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f7594f20800 1 -- 172.21.15.121:0/4236340127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d44a32b870 con 0x55d44a27d780 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f7594f20800 1 -- 172.21.15.121:0/4236340127 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d44a32bdb0 con 0x55d44a27d780 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f7594f20800 1 Processor -- start 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f7594f20800 1 -- start start 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f758e3c4640 1 -- 172.21.15.121:0/4236340127 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7580059070 con 0x55d44a27d780 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f7594f20800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 0x55d44a337950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f7594f20800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d44a125890 con 0x55d44a337530 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f758e3c4640 1 --2- 172.21.15.121:0/4236340127 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f757c036110 0x7f757c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f75913ca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 0x55d44a337950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f75913ca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 0x55d44a337950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53498/0 (socket says 172.21.15.121:53498) 2023-12-07T21:09:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f75913ca640 1 -- 172.21.15.121:0/1073522406 learned_addr learned my addr 172.21.15.121:0/1073522406 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.502+0000 7f758e3c4640 1 -- 172.21.15.121:0/4236340127 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f758008cbd0 con 0x55d44a27d780 2023-12-07T21:09:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7590bc9640 1 --2- 172.21.15.121:0/4236340127 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f757c036110 0x7f757c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f75913ca640 1 -- 172.21.15.121:0/1073522406 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d44a337e90 con 0x55d44a337530 2023-12-07T21:09:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f75913ca640 1 --2- 172.21.15.121:0/1073522406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 0x55d44a337950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f758800a430 tx=0x7f758800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158e3fa685b0f164 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7590bc9640 1 --2- 172.21.15.121:0/4236340127 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f757c036110 0x7f757c0385d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f758006cf30 tx=0x7f758004c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7577fff640 1 -- 172.21.15.121:0/1073522406 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7588001650 con 0x55d44a337530 2023-12-07T21:09:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7577fff640 1 -- 172.21.15.121:0/1073522406 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75880017d0 con 0x55d44a337530 2023-12-07T21:09:14.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7577fff640 1 -- 172.21.15.121:0/1073522406 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7588001ab0 con 0x55d44a337530 2023-12-07T21:09:14.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7594f20800 1 -- 172.21.15.121:0/1073522406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 msgr2=0x55d44a337950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7594f20800 1 --2- 172.21.15.121:0/1073522406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 0x55d44a337950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f758800a430 tx=0x7f758800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7594f20800 1 -- 172.21.15.121:0/1073522406 shutdown_connections 2023-12-07T21:09:14.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7594f20800 1 --2- 172.21.15.121:0/1073522406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 0x55d44a337950 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7594f20800 1 -- 172.21.15.121:0/1073522406 >> 172.21.15.121:0/1073522406 conn(0x55d44a27e0e0 msgr2=0x55d44a332910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7594f20800 1 -- 172.21.15.121:0/1073522406 shutdown_connections 2023-12-07T21:09:14.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.503+0000 7f7594f20800 1 -- 172.21.15.121:0/1073522406 wait complete. 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.504+0000 7f7594f20800 1 Processor -- start 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.504+0000 7f7594f20800 1 -- start start 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.504+0000 7f7594f20800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 0x55d44a33e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.504+0000 7f7594f20800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d44a125530 con 0x55d44a337530 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.504+0000 7f75913ca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 0x55d44a33e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.504+0000 7f75913ca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 0x55d44a33e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53502/0 (socket says 172.21.15.121:53502) 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.504+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 learned_addr learned my addr 172.21.15.121:0/1532469997 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.504+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758800a0e0 con 0x55d44a337530 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.504+0000 7f75913ca640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 0x55d44a33e570 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f758800a930 tx=0x7f7588003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.505+0000 7f75767fc640 1 -- 172.21.15.121:0/1532469997 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7588010900 con 0x55d44a337530 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.505+0000 7f75767fc640 1 -- 172.21.15.121:0/1532469997 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7588010a60 con 0x55d44a337530 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.505+0000 7f75767fc640 1 -- 172.21.15.121:0/1532469997 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7588010d20 con 0x55d44a337530 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.505+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d44a33eab0 con 0x55d44a337530 2023-12-07T21:09:14.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.505+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d44a33ef10 con 0x55d44a337530 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.505+0000 7f75767fc640 1 -- 172.21.15.121:0/1532469997 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7588017030 con 0x55d44a337530 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.506+0000 7f75767fc640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f756c036110 0x7f756c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.506+0000 7f75767fc640 1 -- 172.21.15.121:0/1532469997 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f758804b830 con 0x55d44a337530 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.506+0000 7f75903c8640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f756c036110 0x7f756c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.506+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.506+0000 7f7594f20800 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d44a349ce0 0x55d44a34c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.506+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a34c8f0 con 0x55d44a349ce0 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.506+0000 7f75903c8640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f756c036110 0x7f756c0385d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7584000f60 tx=0x7f75840010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.506+0000 7f75913ca640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d44a349ce0 0x55d44a34c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.506+0000 7f75913ca640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d44a349ce0 0x55d44a34c1a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 20 realm 2023-12-07T21:09:14.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a34cce0 con 0x55d44a349ce0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a34d560 con 0x55d44a349ce0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a34d8c0 con 0x55d44a349ce0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.507+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a34e0c0 con 0x55d44a349ce0 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.508+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.508+0000 7f7594f20800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.508+0000 7f7594f20800 20 searching for the correct realm 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.508+0000 7f7594f20800 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d44a34fde0 0x55d44a352280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.508+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a34fde0 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.508+0000 7f7590bc9640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d44a34fde0 0x55d44a352280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.508+0000 7f7590bc9640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d44a34fde0 0x55d44a352280 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.508+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.508+0000 7f7590bc9640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7580077060 0x7f758008c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.508+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f7580077060 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.508+0000 7f75903c8640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7580077060 0x7f758008c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.509+0000 7f75903c8640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7580077060 0x7f758008c1e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.509+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.509+0000 7f75903c8640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f758400d3d0 0x7f758400d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.509+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f758400d3d0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.509+0000 7f75913ca640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f758400d3d0 0x7f758400d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.510+0000 7f75913ca640 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f758400d3d0 0x7f758400d830 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.510+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.510+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a349ce0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.510+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.510+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a349ce0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.510+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.510+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f758400d3d0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.510+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.510+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f758400d3d0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.511+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.511+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f7580077060 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.511+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.511+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a34fde0 2023-12-07T21:09:14.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.511+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.511+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a349ce0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.511+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.511+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f758400d3d0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.512+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.512+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a349ce0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.512+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.512+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f7580077060 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.512+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.512+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a34fde0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.512+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.512+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a34fde0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.512+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.512+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f758400d3d0 2023-12-07T21:09:14.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.513+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.513+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a34fde0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.513+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.513+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a34fde0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.513+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.513+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a349ce0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.513+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.513+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a349ce0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.514+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.514+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f758400d3d0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.514+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.514+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a34fde0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.514+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.514+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f7580077060 2023-12-07T21:09:14.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.515+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.515+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a349ce0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.515+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.515+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f758400d3d0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.515+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.515+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a34fde0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.515+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.515+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f758400d3d0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.515+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.516+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f7580077060 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.516+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.516+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a34fde0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.516+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.516+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f758400d3d0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.516+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.516+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x55d44a349ce0 2023-12-07T21:09:14.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352900 con 0x7f7580077060 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a34ea20 con 0x55d44a349ce0 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a34f270 con 0x55d44a349ce0 2023-12-07T21:09:14.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.517+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a34f270 con 0x55d44a34fde0 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 20 zone default found 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 4 Realm: () 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 20 zonegroup default 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a352d70 con 0x7f758400d3d0 2023-12-07T21:09:14.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a354b50 con 0x55d44a34fde0 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.518+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a354eb0 con 0x55d44a34fde0 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.519+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.519+0000 7f7594f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.519+0000 7f7594f20800 20 started sync module instance, tier type = 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.519+0000 7f7594f20800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:14.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.519+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a354430 con 0x7f7580077060 2023-12-07T21:09:14.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.519+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.520+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94370264010576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a3552a0 con 0x7f7580077060 2023-12-07T21:09:14.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.520+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a355aa0 con 0x55d44a349ce0 2023-12-07T21:09:14.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.520+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94370264010576] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.521+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.521+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94370266431376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a355aa0 con 0x55d44a349ce0 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.521+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a3562a0 con 0x55d44a34fde0 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.522+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94370266431376] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.522+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.522+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94370266437392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a356650 con 0x55d44a34fde0 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.522+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a356fc0 con 0x7f7580077060 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.523+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.523+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94370266437392] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.523+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94370266438560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a357810 con 0x7f7580077060 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.523+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a358010 con 0x55d44a349ce0 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.524+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.524+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94370266446976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a358890 con 0x55d44a349ce0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.524+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a359200 con 0x7f758400d3d0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.524+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94370266438560] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.525+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.525+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94370266444656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a359200 con 0x7f758400d3d0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.525+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a359b00 con 0x7f758400d3d0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.525+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94370266446976] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.526+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94370266444656] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.526+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.526+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94370266453472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a358d60 con 0x7f758400d3d0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.526+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a35a0b0 con 0x7f758400d3d0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.527+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.527+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94370266455056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a35a4c0 con 0x7f758400d3d0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.527+0000 7f7594f20800 20 add_watcher() i=0 2023-12-07T21:09:14.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.527+0000 7f7594f20800 20 add_watcher() i=1 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.527+0000 7f7594f20800 20 add_watcher() i=2 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.527+0000 7f7594f20800 20 add_watcher() i=3 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.527+0000 7f7594f20800 20 add_watcher() i=4 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.527+0000 7f7594f20800 20 add_watcher() i=5 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.527+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94370266453472] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.527+0000 7f7594f20800 20 add_watcher() i=6 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.528+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94370266455056] v31'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.528+0000 7f7594f20800 20 add_watcher() i=7 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.528+0000 7f7594f20800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.528+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a35d4f0 con 0x55d44a349ce0 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.528+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.528+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94370266456096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a35a8d0 con 0x55d44a349ce0 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.529+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94370266456096] v31'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.529+0000 7f7556fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.529+0000 7f7594f20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.529+0000 7f7594f20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.529+0000 7f7594f20800 5 note: GC not initialized 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.529+0000 7f7555fe3640 20 reqs_thread_entry: start 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.529+0000 7f7594f20800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.530+0000 7f7594f20800 20 Filter name: none 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.530+0000 7f74c77fe640 20 reqs_thread_entry: start 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.530+0000 7f7594f20800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.530+0000 7f7594f20800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.530+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a3902a0 con 0x55d44a349ce0 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.530+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.530+0000 7f7594f20800 20 rados_obj.operate() r=0 bl.length=459 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.530+0000 7f7594f20800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.530+0000 7f7594f20800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.530+0000 7f7594f20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:14.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.530+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a395e60 con 0x55d44a349ce0 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.531+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v31'5 uv5 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.531+0000 7f7594f20800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.531+0000 7f7594f20800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.531+0000 7f7594f20800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.531+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94370266700544 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a392b80 con 0x55d44a349ce0 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94370266446976 notify 133143986180 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55d44a33ef10 con 0x55d44a349ce0 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f7577fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94370266446976 notifier 4330 bl.length()=533 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f7577fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f7577fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(64 notify.4 [notify cookie 94370266700544 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f7577fff640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f75640042a0 con 0x55d44a349ce0 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== watch-notify(notify_complete (2) cookie 94370266700544 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d44a33eab0 con 0x55d44a349ce0 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f7594f20800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-12-07T21:09:14.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify cookie 94370266700544 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a390670 con 0x55d44a34fde0 2023-12-07T21:09:14.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== watch-notify(notify (1) cookie 94370266437392 notify 133143986177 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f758009c040 con 0x55d44a34fde0 2023-12-07T21:09:14.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f7577fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94370266437392 notifier 4330 bl.length()=170 2023-12-07T21:09:14.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(66 notify.2 [notify cookie 94370266700544 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.532+0000 7f7577fff640 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f75640042a0 con 0x55d44a34fde0 2023-12-07T21:09:14.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.533+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(67 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.533+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== watch-notify(notify_complete (2) cookie 94370266700544 notify 133143986177 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f758008c050 con 0x55d44a34fde0 2023-12-07T21:09:14.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.533+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:68 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a390ec0 con 0x7f758400d3d0 2023-12-07T21:09:14.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.534+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(68 p5YnriCv1nAtykxBrupQ [delete] v31'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.535 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:14.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.535+0000 7f7556fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.535+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94370266456096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a379150 con 0x55d44a349ce0 2023-12-07T21:09:14.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.536+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94370266456096] v31'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.536+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94370264010576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a38f0f0 con 0x7f7580077060 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.537+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94370264010576] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.537+0000 7f7594f20800 20 remove_watcher() i=0 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.537+0000 7f7594f20800 2 removed watcher, disabling cache 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.537+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94370266431376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a38f450 con 0x55d44a349ce0 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.538+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94370266431376] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.538+0000 7f7594f20800 20 remove_watcher() i=1 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.538+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94370266437392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a38f450 con 0x55d44a34fde0 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.539+0000 7f7590bc9640 1 -- 172.21.15.121:0/1532469997 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94370266437392] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7580065930 con 0x55d44a34fde0 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.539+0000 7f7594f20800 20 remove_watcher() i=2 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.539+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94370266438560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a38f450 con 0x7f7580077060 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.540+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94370266438560] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7584006070 con 0x7f7580077060 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.540+0000 7f7594f20800 20 remove_watcher() i=3 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.540+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94370266446976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a38f7b0 con 0x55d44a349ce0 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.541+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94370266446976] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x55d44a349ce0 2023-12-07T21:09:14.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.541+0000 7f7594f20800 20 remove_watcher() i=4 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.541+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94370266444656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a38f7b0 con 0x7f758400d3d0 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.542+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94370266444656] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.542+0000 7f7594f20800 20 remove_watcher() i=5 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.542+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94370266453472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a38f7b0 con 0x7f758400d3d0 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.543+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94370266453472] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.543+0000 7f7594f20800 20 remove_watcher() i=6 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.543+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94370266455056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d44a38f7b0 con 0x7f758400d3d0 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f75913ca640 1 -- 172.21.15.121:0/1532469997 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94370266455056] v31'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f758801a9e0 con 0x7f758400d3d0 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 20 remove_watcher() i=7 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f758400d3d0 msgr2=0x7f758400d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f758400d3d0 0x7f758400d830 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d44a349ce0 msgr2=0x55d44a34c1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d44a349ce0 0x55d44a34c1a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7580077060 msgr2=0x7f758008c1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7580077060 0x7f758008c1e0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d44a34fde0 msgr2=0x55d44a352280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d44a34fde0 0x55d44a352280 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f756c036110 msgr2=0x7f756c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f756c036110 0x7f756c0385d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7584000f60 tx=0x7f75840010a0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 msgr2=0x55d44a33e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 --2- 172.21.15.121:0/1532469997 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a337530 0x55d44a33e570 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f758800a930 tx=0x7f7588003370 comp rx=0 tx=0).stop 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 reap_dead start 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f75903c8640 1 -- 172.21.15.121:0/1532469997 reap_dead start 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 shutdown_connections 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 >> 172.21.15.121:0/1532469997 conn(0x55d44a27e0e0 msgr2=0x55d44a331710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 shutdown_connections 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/1532469997 wait complete. 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/4236340127 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f757c036110 msgr2=0x7f757c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 --2- 172.21.15.121:0/4236340127 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f757c036110 0x7f757c0385d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f758006cf30 tx=0x7f758004c000 comp rx=0 tx=0).stop 2023-12-07T21:09:14.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/4236340127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 msgr2=0x55d44a32b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 --2- 172.21.15.121:0/4236340127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a32b330 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f758005f040 tx=0x7f7580003020 comp rx=0 tx=0).stop 2023-12-07T21:09:14.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/4236340127 shutdown_connections 2023-12-07T21:09:14.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 --2- 172.21.15.121:0/4236340127 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f757c036110 0x7f757c0385d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 --2- 172.21.15.121:0/4236340127 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d44a27d780 0x55d44a32b330 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/4236340127 >> 172.21.15.121:0/4236340127 conn(0x55d44a276f70 msgr2=0x55d44a322c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/4236340127 shutdown_connections 2023-12-07T21:09:14.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.544+0000 7f7594f20800 1 -- 172.21.15.121:0/4236340127 wait complete. 2023-12-07T21:09:14.544 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:14.544 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2023-12-07T21:09:14.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2023-12-07T21:09:14.544 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2023-12-07T21:09:14.589 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:14.589 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:14.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.597+0000 7f6af4133800 1 Processor -- start 2023-12-07T21:09:14.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.597+0000 7f6af4133800 1 -- start start 2023-12-07T21:09:14.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.597+0000 7f6af4133800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5599924de550 0x5599924e0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.597+0000 7f6af4133800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559992427740 con 0x5599924da110 2023-12-07T21:09:14.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.597+0000 7f6af4133800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5599923f0880 con 0x5599924de550 2023-12-07T21:09:14.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.598+0000 7f6aef5d6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5599924de550 0x5599924e0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.598+0000 7f6aefdd7640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5599924da110 0x5599924da530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37798/0 (socket says 172.21.15.121:37798) 2023-12-07T21:09:14.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.598+0000 7f6aefdd7640 1 -- 172.21.15.121:0/3513118028 learned_addr learned my addr 172.21.15.121:0/3513118028 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:14.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.598+0000 7f6aef5d6640 1 -- 172.21.15.121:0/3513118028 >> v1:172.21.15.89:6789/0 conn(0x5599924da110 legacy=0x5599924da530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.598+0000 7f6aef5d6640 1 -- 172.21.15.121:0/3513118028 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599924e1f70 con 0x5599924de550 2023-12-07T21:09:14.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.600+0000 7f6aef5d6640 1 --2- 172.21.15.121:0/3513118028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924de550 0x5599924e0940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400a470 tx=0x7f6ae401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcc889c470b06bd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.600+0000 7f6aeedd5640 1 -- 172.21.15.121:0/3513118028 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ae4052570 con 0x5599924de550 2023-12-07T21:09:14.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.600+0000 7f6aeedd5640 1 -- 172.21.15.121:0/3513118028 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae40526d0 con 0x5599924de550 2023-12-07T21:09:14.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.600+0000 7f6aeedd5640 1 -- 172.21.15.121:0/3513118028 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ae4052990 con 0x5599924de550 2023-12-07T21:09:14.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.600+0000 7f6af4133800 1 -- 172.21.15.121:0/3513118028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924de550 msgr2=0x5599924e0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.600+0000 7f6af4133800 1 --2- 172.21.15.121:0/3513118028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924de550 0x5599924e0940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400a470 tx=0x7f6ae401cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:14.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.600+0000 7f6af4133800 1 -- 172.21.15.121:0/3513118028 shutdown_connections 2023-12-07T21:09:14.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.600+0000 7f6af4133800 1 --2- 172.21.15.121:0/3513118028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924de550 0x5599924e0940 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.600+0000 7f6af4133800 1 -- 172.21.15.121:0/3513118028 >> 172.21.15.121:0/3513118028 conn(0x5599924d5890 msgr2=0x5599924d7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.600+0000 7f6af4133800 1 -- 172.21.15.121:0/3513118028 shutdown_connections 2023-12-07T21:09:14.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.600+0000 7f6af4133800 1 -- 172.21.15.121:0/3513118028 wait complete. 2023-12-07T21:09:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.601+0000 7f6af4133800 1 Processor -- start 2023-12-07T21:09:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.601+0000 7f6af4133800 1 -- start start 2023-12-07T21:09:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.601+0000 7f6af4133800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x55999244f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.601+0000 7f6af4133800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599923eddb0 con 0x5599924da110 2023-12-07T21:09:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.602+0000 7f6aefdd7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x55999244f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.602+0000 7f6aefdd7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x55999244f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53518/0 (socket says 172.21.15.121:53518) 2023-12-07T21:09:14.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.602+0000 7f6aefdd7640 1 -- 172.21.15.121:0/2505861116 learned_addr learned my addr 172.21.15.121:0/2505861116 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.602+0000 7f6aefdd7640 1 -- 172.21.15.121:0/2505861116 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4005d20 con 0x5599924da110 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.602+0000 7f6aefdd7640 1 --2- 172.21.15.121:0/2505861116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x55999244f1c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0001c80 tx=0x7f6ae000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e33a8fb8aa6f0f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.602+0000 7f6aee5d4640 1 -- 172.21.15.121:0/2505861116 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ae000e470 con 0x5599924da110 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.602+0000 7f6aee5d4640 1 -- 172.21.15.121:0/2505861116 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae000e5d0 con 0x5599924da110 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.602+0000 7f6aee5d4640 1 -- 172.21.15.121:0/2505861116 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ae000e8d0 con 0x5599924da110 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6af4133800 1 -- 172.21.15.121:0/2505861116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 msgr2=0x55999244f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6af4133800 1 --2- 172.21.15.121:0/2505861116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x55999244f1c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0001c80 tx=0x7f6ae000b6c0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6af4133800 1 -- 172.21.15.121:0/2505861116 shutdown_connections 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6af4133800 1 --2- 172.21.15.121:0/2505861116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x55999244f1c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6af4133800 1 -- 172.21.15.121:0/2505861116 >> 172.21.15.121:0/2505861116 conn(0x5599924d5890 msgr2=0x55999257a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6af4133800 1 -- 172.21.15.121:0/2505861116 shutdown_connections 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6af4133800 1 -- 172.21.15.121:0/2505861116 wait complete. 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6af4133800 1 Processor -- start 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6af4133800 1 -- start start 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6af4133800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x559992587320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6af4133800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599923e96a0 con 0x5599924da110 2023-12-07T21:09:14.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6aefdd7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x559992587320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6aefdd7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x559992587320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53526/0 (socket says 172.21.15.121:53526) 2023-12-07T21:09:14.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.603+0000 7f6aefdd7640 1 -- 172.21.15.121:0/2904924802 learned_addr learned my addr 172.21.15.121:0/2904924802 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.604+0000 7f6aefdd7640 1 -- 172.21.15.121:0/2904924802 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559992427740 con 0x5599924da110 2023-12-07T21:09:14.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.604+0000 7f6aefdd7640 1 --2- 172.21.15.121:0/2904924802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x559992587320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0001ed0 tx=0x7f6ae0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.604+0000 7f6aed5d2640 1 -- 172.21.15.121:0/2904924802 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ae001f070 con 0x5599924da110 2023-12-07T21:09:14.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.604+0000 7f6aed5d2640 1 -- 172.21.15.121:0/2904924802 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae0018640 con 0x5599924da110 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.604+0000 7f6af4133800 1 -- 172.21.15.121:0/2904924802 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559992587860 con 0x5599924da110 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.604+0000 7f6aed5d2640 1 -- 172.21.15.121:0/2904924802 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ae00188e0 con 0x5599924da110 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.604+0000 7f6af4133800 1 -- 172.21.15.121:0/2904924802 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559992587d40 con 0x5599924da110 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6af4133800 1 Processor -- start 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6af4133800 1 -- start start 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6af4133800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x5599925938f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6aed5d2640 1 -- 172.21.15.121:0/2904924802 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f6ae0018a40 con 0x5599924da110 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6af4133800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559992383890 con 0x5599925934d0 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6aed5d2640 1 --2- 172.21.15.121:0/2904924802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6adc036110 0x7f6adc0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6af05d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x5599925938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6aed5d2640 1 -- 172.21.15.121:0/2904924802 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f6ae004b8b0 con 0x5599924da110 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6af05d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x5599925938f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53532/0 (socket says 172.21.15.121:53532) 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6af05d8640 1 -- 172.21.15.121:0/4177138773 learned_addr learned my addr 172.21.15.121:0/4177138773 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6aefdd7640 1 --2- 172.21.15.121:0/2904924802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6adc036110 0x7f6adc0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6af05d8640 1 -- 172.21.15.121:0/4177138773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559992593e30 con 0x5599925934d0 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.605+0000 7f6aefdd7640 1 --2- 172.21.15.121:0/2904924802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6adc036110 0x7f6adc0385d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000dfd0 tx=0x7f6ae000df20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6af05d8640 1 --2- 172.21.15.121:0/4177138773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x5599925938f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800a430 tx=0x7f6ae800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5d30666cb639f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6ad6ffd640 1 -- 172.21.15.121:0/4177138773 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ae8001650 con 0x5599925934d0 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6ad6ffd640 1 -- 172.21.15.121:0/4177138773 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae80017d0 con 0x5599925934d0 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6ad6ffd640 1 -- 172.21.15.121:0/4177138773 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ae8001ab0 con 0x5599925934d0 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6af4133800 1 -- 172.21.15.121:0/4177138773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 msgr2=0x5599925938f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6af4133800 1 --2- 172.21.15.121:0/4177138773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x5599925938f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800a430 tx=0x7f6ae800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6af4133800 1 -- 172.21.15.121:0/4177138773 shutdown_connections 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6af4133800 1 --2- 172.21.15.121:0/4177138773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x5599925938f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6af4133800 1 -- 172.21.15.121:0/4177138773 >> 172.21.15.121:0/4177138773 conn(0x5599924de550 msgr2=0x55999258e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6af4133800 1 -- 172.21.15.121:0/4177138773 shutdown_connections 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6af4133800 1 -- 172.21.15.121:0/4177138773 wait complete. 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6af4133800 1 Processor -- start 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.606+0000 7f6af4133800 1 -- start start 2023-12-07T21:09:14.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6af4133800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x55999259a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6af4133800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559992383530 con 0x5599925934d0 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6af05d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x55999259a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6af05d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x55999259a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53540/0 (socket says 172.21.15.121:53540) 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 learned_addr learned my addr 172.21.15.121:0/245612479 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae800a0e0 con 0x5599925934d0 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6af05d8640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x55999259a440 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800ae40 tx=0x7f6ae8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6ad57fa640 1 -- 172.21.15.121:0/245612479 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ae80109e0 con 0x5599925934d0 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6ad57fa640 1 -- 172.21.15.121:0/245612479 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae8010b40 con 0x5599925934d0 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55999259a980 con 0x5599925934d0 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6ad57fa640 1 -- 172.21.15.121:0/245612479 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ae8010e20 con 0x5599925934d0 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.607+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55999259ade0 con 0x5599925934d0 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.608+0000 7f6ad57fa640 1 -- 172.21.15.121:0/245612479 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f6ae8017070 con 0x5599925934d0 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.608+0000 7f6ad57fa640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6ac80360c0 0x7f6ac8038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.608+0000 7f6ad57fa640 1 -- 172.21.15.121:0/245612479 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f6ae804b970 con 0x5599925934d0 2023-12-07T21:09:14.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.608+0000 7f6aef5d6640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6ac80360c0 0x7f6ac8038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.609+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.609+0000 7f6aef5d6640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6ac80360c0 0x7f6ac8038580 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4054000 tx=0x7f6ae404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.609+0000 7f6af4133800 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5599925a5b60 0x5599925a8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.609+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925a8770 con 0x5599925a5b60 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.609+0000 7f6af05d8640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5599925a5b60 0x5599925a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.609+0000 7f6af05d8640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5599925a5b60 0x5599925a8020 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.609+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.609+0000 7f6af4133800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.609+0000 7f6af4133800 20 realm 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.609+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.609+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925a8b80 con 0x5599925a5b60 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925a9400 con 0x5599925a5b60 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925a9760 con 0x5599925a5b60 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925a9f60 con 0x5599925a5b60 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 20 searching for the correct realm 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5599925abc80 0x5599925ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.610+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925abc80 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.611+0000 7f6aefdd7640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5599925abc80 0x5599925ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.611+0000 7f6aefdd7640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5599925abc80 0x5599925ae0f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.611+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.611+0000 7f6aefdd7640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6ae0017050 0x7f6ae00260c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.611+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x7f6ae0017050 2023-12-07T21:09:14.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.611+0000 7f6aef5d6640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6ae0017050 0x7f6ae00260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.611+0000 7f6aef5d6640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6ae0017050 0x7f6ae00260c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.612+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae4052840 con 0x7f6ae0017050 2023-12-07T21:09:14.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.612+0000 7f6aef5d6640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f6ae405c920 0x7f6ae4009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.612+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x7f6ae405c920 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.612+0000 7f6af05d8640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f6ae405c920 0x7f6ae4009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.612+0000 7f6af05d8640 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f6ae405c920 0x7f6ae4009410 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.613+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.613+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925a5b60 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.613+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.613+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925a5b60 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.613+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.613+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x7f6ae405c920 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.613+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.613+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x7f6ae405c920 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.614+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.614+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x7f6ae0017050 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.614+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae4052840 con 0x7f6ae0017050 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.614+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925abc80 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.614+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.614+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925a5b60 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.614+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.614+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x7f6ae405c920 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.614+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.615+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925a5b60 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.615+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.615+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x7f6ae0017050 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.615+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6ae4052840 con 0x7f6ae0017050 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.615+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925abc80 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.615+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.615+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925abc80 2023-12-07T21:09:14.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.615+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.615+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x7f6ae405c920 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.616+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.616+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925abc80 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.616+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.616+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925abc80 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.616+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.616+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925a5b60 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.616+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.616+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x5599925a5b60 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.617+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.617+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ae7c0 con 0x7f6ae405c920 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.617+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.617+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ae8053040 con 0x5599925abc80 2023-12-07T21:09:14.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.617+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.617+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ae8053040 con 0x7f6ae0017050 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.617+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae4052840 con 0x7f6ae0017050 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.617+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ae8053040 con 0x5599925a5b60 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.618+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.618+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ae8053040 con 0x7f6ae405c920 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.618+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.618+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ae8053040 con 0x5599925abc80 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.618+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.618+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ae8053040 con 0x7f6ae405c920 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.618+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.618+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ae8053040 con 0x7f6ae0017050 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.619+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae4052840 con 0x7f6ae0017050 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.619+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ae8053040 con 0x5599925abc80 2023-12-07T21:09:14.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.619+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.619+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ae8053040 con 0x7f6ae405c920 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.619+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.619+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ae8053040 con 0x5599925a5b60 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.619+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ae8053040 con 0x7f6ae0017050 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ae4052840 con 0x7f6ae0017050 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925aa890 con 0x5599925a5b60 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ab0e0 con 0x5599925a5b60 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ab0e0 con 0x5599925abc80 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.620+0000 7f6af4133800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 20 zone default found 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 4 Realm: () 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:14.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 20 zonegroup default 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925aec00 con 0x7f6ae405c920 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b09c0 con 0x5599925abc80 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b0d20 con 0x5599925abc80 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 20 started sync module instance, tier type = 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.621+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b02a0 con 0x7f6ae0017050 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.622+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae4052840 con 0x7f6ae0017050 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.622+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94118071381840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b10f0 con 0x7f6ae0017050 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.622+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b18f0 con 0x5599925a5b60 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.623+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94118071381840] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae4071040 con 0x7f6ae0017050 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.623+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.623+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94118073794048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b18f0 con 0x5599925a5b60 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.623+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b20f0 con 0x5599925abc80 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.624+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94118073794048] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.625+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.625+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94118073800032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b2450 con 0x5599925abc80 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.625+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b2dc0 con 0x7f6ae0017050 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.625+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94118073800032] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.626+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae4071040 con 0x7f6ae0017050 2023-12-07T21:09:14.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.626+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94118073801136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b3610 con 0x7f6ae0017050 2023-12-07T21:09:14.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.626+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b3e10 con 0x5599925a5b60 2023-12-07T21:09:14.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.627+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94118073801136] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae4071040 con 0x7f6ae0017050 2023-12-07T21:09:14.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.627+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.627+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94118073809264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b3d80 con 0x5599925a5b60 2023-12-07T21:09:14.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.627+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b4b00 con 0x7f6ae405c920 2023-12-07T21:09:14.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.628+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.628+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94118073812576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b4a70 con 0x7f6ae405c920 2023-12-07T21:09:14.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.628+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b5960 con 0x7f6ae405c920 2023-12-07T21:09:14.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.628+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94118073809264] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.629+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.629+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94118073811392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b5960 con 0x7f6ae405c920 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.629+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b62d0 con 0x7f6ae405c920 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.629+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94118073812576] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.630+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.630+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94118073814704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b62d0 con 0x7f6ae405c920 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.630+0000 7f6af4133800 20 add_watcher() i=0 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.630+0000 7f6af4133800 20 add_watcher() i=1 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.630+0000 7f6af4133800 20 add_watcher() i=2 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.630+0000 7f6af4133800 20 add_watcher() i=3 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.630+0000 7f6af4133800 20 add_watcher() i=4 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.630+0000 7f6af4133800 20 add_watcher() i=5 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.631+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94118073811392] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.631+0000 7f6af4133800 20 add_watcher() i=6 2023-12-07T21:09:14.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.631+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94118073814704] v31'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.631+0000 7f6af4133800 20 add_watcher() i=7 2023-12-07T21:09:14.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.631+0000 7f6af4133800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:14.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.631+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b9300 con 0x5599925a5b60 2023-12-07T21:09:14.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.631+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.631+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94118073818672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b66e0 con 0x5599925a5b60 2023-12-07T21:09:14.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.632+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94118073818672] v31'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.632+0000 7f6ab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.632+0000 7f6af4133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.633+0000 7f6af4133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.633+0000 7f6af4133800 5 note: GC not initialized 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.633+0000 7f6ab4fe1640 20 reqs_thread_entry: start 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.633+0000 7f6af4133800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.633+0000 7f6af4133800 20 Filter name: none 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.633+0000 7f6a2e7fc640 20 reqs_thread_entry: start 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.633+0000 7f6af4133800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.633+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.633+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ec050 con 0x5599925a5b60 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:14.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ec470 con 0x5599925a5b60 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.634+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925f1df0 con 0x5599925a5b60 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.635+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~513] v31'6 uv6 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.635+0000 7f6af4133800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:14.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.635+0000 7f6af4133800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.635+0000 7f6af4133800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.635+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94118074062960 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ed920 con 0x5599925a5b60 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.635+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== watch-notify(notify (1) cookie 94118073809264 notify 133143986181 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x55999259ade0 con 0x5599925a5b60 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.635+0000 7f6ad6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94118073809264 notifier 4336 bl.length()=689 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.635+0000 7f6ad6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.635+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(65 notify.4 [notify cookie 94118074062960 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.635+0000 7f6ad6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.635+0000 7f6ad6ffd640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ac40042a0 con 0x5599925a5b60 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.636+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.636+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== watch-notify(notify_complete (2) cookie 94118074062960 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55999259a980 con 0x5599925a5b60 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.636+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ec910 con 0x5599925a5b60 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.637+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.637+0000 7f6af4133800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.637+0000 7f6af4133800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2023-12-07T21:09:14.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.637+0000 7f6af4133800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2023-12-07T21:09:14.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.637+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94118074062960 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ec910 con 0x7f6ae0017050 2023-12-07T21:09:14.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.637+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== watch-notify(notify (1) cookie 94118071381840 notify 133143986178 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x5599924e1f70 con 0x7f6ae0017050 2023-12-07T21:09:14.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.637+0000 7f6ad6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94118071381840 notifier 4336 bl.length()=166 2023-12-07T21:09:14.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.637+0000 7f6ad6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2023-12-07T21:09:14.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.637+0000 7f6ad6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2023-12-07T21:09:14.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.637+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(68 notify.0 [notify cookie 94118074062960 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6ae4071040 con 0x7f6ae0017050 2023-12-07T21:09:14.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.637+0000 7f6ad6ffd640 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f6ac40042a0 con 0x7f6ae0017050 2023-12-07T21:09:14.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.638+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== watch-notify(notify_complete (2) cookie 94118074062960 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f6ae404e070 con 0x7f6ae0017050 2023-12-07T21:09:14.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.638+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae4071040 con 0x7f6ae0017050 2023-12-07T21:09:14.640 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"yPDN1b0b7W0RSucr39CMBO4bEj0kkzEIJfpRjlAH"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:14.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.638+0000 7f6ab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.638+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94118073818672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ed270 con 0x5599925a5b60 2023-12-07T21:09:14.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.639+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94118073818672] v31'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.639+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94118071381840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ed270 con 0x7f6ae0017050 2023-12-07T21:09:14.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.640+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94118071381840] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae4071040 con 0x7f6ae0017050 2023-12-07T21:09:14.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.640+0000 7f6af4133800 20 remove_watcher() i=0 2023-12-07T21:09:14.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.640+0000 7f6af4133800 2 removed watcher, disabling cache 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.640+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94118073794048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ed270 con 0x5599925a5b60 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.641+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94118073794048] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.641+0000 7f6af4133800 20 remove_watcher() i=1 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.641+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94118073800032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ed270 con 0x5599925abc80 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.642+0000 7f6aefdd7640 1 -- 172.21.15.121:0/245612479 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94118073800032] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae0014070 con 0x5599925abc80 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.642+0000 7f6af4133800 20 remove_watcher() i=2 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.642+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94118073801136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ed5d0 con 0x7f6ae0017050 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.643+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94118073801136] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae4071040 con 0x7f6ae0017050 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.643+0000 7f6af4133800 20 remove_watcher() i=3 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.643+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94118073809264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ed5d0 con 0x5599925a5b60 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.645+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94118073809264] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x5599925a5b60 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.645+0000 7f6af4133800 20 remove_watcher() i=4 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.645+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94118073812576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925ed5d0 con 0x7f6ae405c920 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.645+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94118073812576] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.645+0000 7f6af4133800 20 remove_watcher() i=5 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.645+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94118073811392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b4610 con 0x7f6ae405c920 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.646+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94118073811392] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.646+0000 7f6af4133800 20 remove_watcher() i=6 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.646+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94118073814704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599925b41c0 con 0x7f6ae405c920 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af05d8640 1 -- 172.21.15.121:0/245612479 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94118073814704] v31'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ae800fc50 con 0x7f6ae405c920 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 20 remove_watcher() i=7 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f6ae405c920 msgr2=0x7f6ae4009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f6ae405c920 0x7f6ae4009410 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5599925a5b60 msgr2=0x5599925a8020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5599925a5b60 0x5599925a8020 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6ae0017050 msgr2=0x7f6ae00260c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6ae0017050 0x7f6ae00260c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5599925abc80 msgr2=0x5599925ae0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5599925abc80 0x5599925ae0f0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6ac80360c0 msgr2=0x7f6ac8038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6ac80360c0 0x7f6ac8038580 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4054000 tx=0x7f6ae404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 msgr2=0x55999259a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x55999259a440 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6ae800ae40 tx=0x7f6ae8003370 comp rx=0 tx=0).stop 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6aef5d6640 1 -- 172.21.15.121:0/245612479 reap_dead start 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 shutdown_connections 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 --2- 172.21.15.121:0/245612479 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599925934d0 0x55999259a440 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 >> 172.21.15.121:0/245612479 conn(0x5599924de550 msgr2=0x55999258d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 shutdown_connections 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/245612479 wait complete. 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/2904924802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6adc036110 msgr2=0x7f6adc0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 --2- 172.21.15.121:0/2904924802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6adc036110 0x7f6adc0385d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000dfd0 tx=0x7f6ae000df20 comp rx=0 tx=0).stop 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/2904924802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 msgr2=0x559992587320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 --2- 172.21.15.121:0/2904924802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x559992587320 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0001ed0 tx=0x7f6ae0000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/2904924802 shutdown_connections 2023-12-07T21:09:14.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 --2- 172.21.15.121:0/2904924802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6adc036110 0x7f6adc0385d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 --2- 172.21.15.121:0/2904924802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599924da110 0x559992587320 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/2904924802 >> 172.21.15.121:0/2904924802 conn(0x5599924d5890 msgr2=0x55999257da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/2904924802 shutdown_connections 2023-12-07T21:09:14.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.648+0000 7f6af4133800 1 -- 172.21.15.121:0/2904924802 wait complete. 2023-12-07T21:09:14.649 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'yPDN1b0b7W0RSucr39CMBO4bEj0kkzEIJfpRjlAH'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:14.649 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2023-12-07T21:09:14.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2023-12-07T21:09:14.649 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2023-12-07T21:09:14.696 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:14.696 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:14.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f070eb2f800 1 Processor -- start 2023-12-07T21:09:14.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f070eb2f800 1 -- start start 2023-12-07T21:09:14.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f070eb2f800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55cff2ffa9a0 0x55cff2ffcd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f070eb2f800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55cff2f40740 con 0x55cff2ff4750 2023-12-07T21:09:14.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f070eb2f800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55cff2f09880 con 0x55cff2ffa9a0 2023-12-07T21:09:14.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f0701f7d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55cff2ffa9a0 0x55cff2ffcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f070a77e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55cff2ff4750 0x55cff2ff4b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37802/0 (socket says 172.21.15.121:37802) 2023-12-07T21:09:14.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f0701f7d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55cff2ffa9a0 0x55cff2ffcd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53544/0 (socket says 172.21.15.121:53544) 2023-12-07T21:09:14.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f070a77e640 1 -- 172.21.15.121:0/878136264 learned_addr learned my addr 172.21.15.121:0/878136264 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:14.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f0701f7d640 1 -- 172.21.15.121:0/878136264 >> v1:172.21.15.89:6789/0 conn(0x55cff2ff4750 legacy=0x55cff2ff4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f0701f7d640 1 -- 172.21.15.121:0/878136264 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cff2ffe2e0 con 0x55cff2ffa9a0 2023-12-07T21:09:14.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.704+0000 7f0709f7d640 1 -- 172.21.15.121:0/878136264 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339859875 0 0) 0x55cff2f40740 con 0x55cff2ff4750 2023-12-07T21:09:14.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.706+0000 7f0701f7d640 1 --2- 172.21.15.121:0/878136264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ffa9a0 0x55cff2ffcd90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f06f400a470 tx=0x7f06f401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dadc5cd80753ff server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.706+0000 7f0709f7d640 1 -- 172.21.15.121:0/878136264 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06f4052570 con 0x55cff2ffa9a0 2023-12-07T21:09:14.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.706+0000 7f0709f7d640 1 -- 172.21.15.121:0/878136264 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f40526d0 con 0x55cff2ffa9a0 2023-12-07T21:09:14.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.706+0000 7f0709f7d640 1 -- 172.21.15.121:0/878136264 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06f4052990 con 0x55cff2ffa9a0 2023-12-07T21:09:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.707+0000 7f070eb2f800 1 -- 172.21.15.121:0/878136264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ffa9a0 msgr2=0x55cff2ffcd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.707+0000 7f070eb2f800 1 --2- 172.21.15.121:0/878136264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ffa9a0 0x55cff2ffcd90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f06f400a470 tx=0x7f06f401cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.707+0000 7f070eb2f800 1 -- 172.21.15.121:0/878136264 shutdown_connections 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.707+0000 7f070eb2f800 1 --2- 172.21.15.121:0/878136264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ffa9a0 0x55cff2ffcd90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.707+0000 7f070eb2f800 1 -- 172.21.15.121:0/878136264 >> 172.21.15.121:0/878136264 conn(0x55cff2fedf00 msgr2=0x55cff2ff0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.707+0000 7f070eb2f800 1 -- 172.21.15.121:0/878136264 shutdown_connections 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.707+0000 7f070eb2f800 1 -- 172.21.15.121:0/878136264 wait complete. 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070eb2f800 1 Processor -- start 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070eb2f800 1 -- start start 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070eb2f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff309aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070eb2f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff2f06db0 con 0x55cff2ff4750 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070a77e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff309aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070a77e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff309aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53548/0 (socket says 172.21.15.121:53548) 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070a77e640 1 -- 172.21.15.121:0/241351935 learned_addr learned my addr 172.21.15.121:0/241351935 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070a77e640 1 -- 172.21.15.121:0/241351935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f4005d20 con 0x55cff2ff4750 2023-12-07T21:09:14.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070a77e640 1 --2- 172.21.15.121:0/241351935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff309aee0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00b240 tx=0x7f06fc00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62f7e92778255ea server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070977c640 1 -- 172.21.15.121:0/241351935 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06fc014070 con 0x55cff2ff4750 2023-12-07T21:09:14.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070977c640 1 -- 172.21.15.121:0/241351935 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc00d500 con 0x55cff2ff4750 2023-12-07T21:09:14.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.708+0000 7f070977c640 1 -- 172.21.15.121:0/241351935 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06fc00d820 con 0x55cff2ff4750 2023-12-07T21:09:14.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.709+0000 7f070eb2f800 1 -- 172.21.15.121:0/241351935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 msgr2=0x55cff309aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.709+0000 7f070eb2f800 1 --2- 172.21.15.121:0/241351935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff309aee0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00b240 tx=0x7f06fc00b700 comp rx=0 tx=0).stop 2023-12-07T21:09:14.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.709+0000 7f070eb2f800 1 -- 172.21.15.121:0/241351935 shutdown_connections 2023-12-07T21:09:14.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.709+0000 7f070eb2f800 1 --2- 172.21.15.121:0/241351935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff309aee0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.709+0000 7f070eb2f800 1 -- 172.21.15.121:0/241351935 >> 172.21.15.121:0/241351935 conn(0x55cff2fedf00 msgr2=0x55cff3096b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.709+0000 7f070eb2f800 1 -- 172.21.15.121:0/241351935 shutdown_connections 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.709+0000 7f070eb2f800 1 -- 172.21.15.121:0/241351935 wait complete. 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.709+0000 7f070eb2f800 1 Processor -- start 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.709+0000 7f070eb2f800 1 -- start start 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.709+0000 7f070eb2f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff30a2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.709+0000 7f070eb2f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff2f026a0 con 0x55cff2ff4750 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.710+0000 7f070a77e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff30a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.710+0000 7f070a77e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff30a2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53560/0 (socket says 172.21.15.121:53560) 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.710+0000 7f070a77e640 1 -- 172.21.15.121:0/1686205300 learned_addr learned my addr 172.21.15.121:0/1686205300 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.710+0000 7f070a77e640 1 -- 172.21.15.121:0/1686205300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc001ba0 con 0x55cff2ff4750 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.710+0000 7f070a77e640 1 --2- 172.21.15.121:0/1686205300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff30a2470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55cff30975d0 tx=0x7f06fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.710+0000 7f0703fff640 1 -- 172.21.15.121:0/1686205300 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06fc00de10 con 0x55cff2ff4750 2023-12-07T21:09:14.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.710+0000 7f0703fff640 1 -- 172.21.15.121:0/1686205300 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc020070 con 0x55cff2ff4750 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.710+0000 7f070eb2f800 1 -- 172.21.15.121:0/1686205300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cff30a29b0 con 0x55cff2ff4750 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.710+0000 7f0703fff640 1 -- 172.21.15.121:0/1686205300 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06fc00faf0 con 0x55cff2ff4750 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.710+0000 7f070eb2f800 1 -- 172.21.15.121:0/1686205300 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cff30a2e90 con 0x55cff2ff4750 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.711+0000 7f070eb2f800 1 Processor -- start 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.711+0000 7f070eb2f800 1 -- start start 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.711+0000 7f070eb2f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 0x55cff30aea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.711+0000 7f070eb2f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff2e9c890 con 0x55cff30ae670 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.711+0000 7f0703fff640 1 -- 172.21.15.121:0/1686205300 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f06fc00d040 con 0x55cff2ff4750 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.711+0000 7f070af7f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 0x55cff30aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.711+0000 7f070af7f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 0x55cff30aea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53568/0 (socket says 172.21.15.121:53568) 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.711+0000 7f070af7f640 1 -- 172.21.15.121:0/987500455 learned_addr learned my addr 172.21.15.121:0/987500455 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.711+0000 7f0703fff640 1 --2- 172.21.15.121:0/1686205300 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f06ec036110 0x7f06ec0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.711+0000 7f0703fff640 1 -- 172.21.15.121:0/1686205300 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f06fc00a040 con 0x55cff2ff4750 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.711+0000 7f070a77e640 1 --2- 172.21.15.121:0/1686205300 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f06ec036110 0x7f06ec0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070af7f640 1 -- 172.21.15.121:0/987500455 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cff30aefd0 con 0x55cff30ae670 2023-12-07T21:09:14.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070af7f640 1 --2- 172.21.15.121:0/987500455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 0x55cff30aea90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f070400a430 tx=0x7f070400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121d880c59280d59 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070a77e640 1 --2- 172.21.15.121:0/1686205300 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f06ec036110 0x7f06ec0385d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06fc01bfd0 tx=0x7f06fc01cf90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070177c640 1 -- 172.21.15.121:0/987500455 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0704001650 con 0x55cff30ae670 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070177c640 1 -- 172.21.15.121:0/987500455 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07040017d0 con 0x55cff30ae670 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070177c640 1 -- 172.21.15.121:0/987500455 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0704001ab0 con 0x55cff30ae670 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070eb2f800 1 -- 172.21.15.121:0/987500455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 msgr2=0x55cff30aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070eb2f800 1 --2- 172.21.15.121:0/987500455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 0x55cff30aea90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f070400a430 tx=0x7f070400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070eb2f800 1 -- 172.21.15.121:0/987500455 shutdown_connections 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070eb2f800 1 --2- 172.21.15.121:0/987500455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 0x55cff30aea90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070eb2f800 1 -- 172.21.15.121:0/987500455 >> 172.21.15.121:0/987500455 conn(0x55cff2ffa9a0 msgr2=0x55cff30a9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070eb2f800 1 -- 172.21.15.121:0/987500455 shutdown_connections 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.712+0000 7f070eb2f800 1 -- 172.21.15.121:0/987500455 wait complete. 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f070eb2f800 1 Processor -- start 2023-12-07T21:09:14.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f070eb2f800 1 -- start start 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f070eb2f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 0x55cff30b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f070eb2f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cff2e9c530 con 0x55cff30ae670 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f070af7f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 0x55cff30b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f070af7f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 0x55cff30b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53570/0 (socket says 172.21.15.121:53570) 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 learned_addr learned my addr 172.21.15.121:0/2483260684 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070400a0e0 con 0x55cff30ae670 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f070af7f640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 0x55cff30b56f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f070400a930 tx=0x7f0704003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f06eb7fe640 1 -- 172.21.15.121:0/2483260684 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0704010900 con 0x55cff30ae670 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f06eb7fe640 1 -- 172.21.15.121:0/2483260684 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0704010a60 con 0x55cff30ae670 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.713+0000 7f06eb7fe640 1 -- 172.21.15.121:0/2483260684 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0704010d20 con 0x55cff30ae670 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.714+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cff30b5c30 con 0x55cff30ae670 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.714+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cff30b6090 con 0x55cff30ae670 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.714+0000 7f06eb7fe640 1 -- 172.21.15.121:0/2483260684 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0704017030 con 0x55cff30ae670 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.714+0000 7f06eb7fe640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f06e40360c0 0x7f06e4038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.714+0000 7f06eb7fe640 1 -- 172.21.15.121:0/2483260684 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f070404b850 con 0x55cff30ae670 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.715+0000 7f0701f7d640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f06e40360c0 0x7f06e4038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.715+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.715+0000 7f0701f7d640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f06e40360c0 0x7f06e4038580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f06f400a470 tx=0x7f06f404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.715+0000 7f070eb2f800 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55cff30c0d50 0x55cff30c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.715+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c3960 con 0x55cff30c0d50 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.715+0000 7f070af7f640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55cff30c0d50 0x55cff30c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.715+0000 7f070af7f640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55cff30c0d50 0x55cff30c3210 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 20 realm 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c3d70 con 0x55cff30c0d50 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:14.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c45f0 con 0x55cff30c0d50 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c4950 con 0x55cff30c0d50 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.716+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c5150 con 0x55cff30c0d50 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.717+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.717+0000 7f070eb2f800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.717+0000 7f070eb2f800 20 searching for the correct realm 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.717+0000 7f070eb2f800 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55cff30c6e70 0x55cff30c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.717+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c6e70 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.717+0000 7f070a77e640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55cff30c6e70 0x55cff30c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.717+0000 7f070a77e640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55cff30c6e70 0x55cff30c92e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.717+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.717+0000 7f070a77e640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f06fc03d040 0x7f06fc02e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.717+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06fc03d040 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.717+0000 7f0701f7d640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f06fc03d040 0x7f06fc02e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.718+0000 7f0701f7d640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f06fc03d040 0x7f06fc02e350 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.718+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06f40528c0 con 0x7f06fc03d040 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.718+0000 7f0701f7d640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f06f405ca90 0x7f06f4009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.718+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06f405ca90 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.718+0000 7f070af7f640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f06f405ca90 0x7f06f4009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.718+0000 7f070af7f640 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f06f405ca90 0x7f06f4009410 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.719+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.719+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c0d50 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.719+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.719+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c0d50 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.719+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.719+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06f405ca90 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.719+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.719+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06f405ca90 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.720+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.720+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06fc03d040 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.720+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06f40528c0 con 0x7f06fc03d040 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.720+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c6e70 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.720+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.720+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c0d50 2023-12-07T21:09:14.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.720+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.720+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06f405ca90 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.721+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.721+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c0d50 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.721+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.721+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06fc03d040 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.721+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f06f40528c0 con 0x7f06fc03d040 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.721+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c6e70 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.721+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.721+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c6e70 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.721+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.722+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06f405ca90 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.722+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.722+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c6e70 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.722+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.722+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c6e70 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.722+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.722+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c0d50 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.722+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.722+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c0d50 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.723+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.723+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06f405ca90 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.723+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.723+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c6e70 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.723+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.723+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06fc03d040 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.723+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06f40528c0 con 0x7f06fc03d040 2023-12-07T21:09:14.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.723+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c0d50 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.724+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.724+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06f405ca90 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.724+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.724+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c6e70 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.724+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.724+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06f405ca90 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.724+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.724+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06fc03d040 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.725+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06f40528c0 con 0x7f06fc03d040 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.725+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c6e70 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.725+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.725+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x7f06f405ca90 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.725+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.725+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c99b0 con 0x55cff30c0d50 2023-12-07T21:09:14.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.725+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.725+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0704053080 con 0x7f06fc03d040 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f06f406f040 con 0x7f06fc03d040 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c5a80 con 0x55cff30c0d50 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c5700 con 0x55cff30c0d50 2023-12-07T21:09:14.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c6350 con 0x55cff30c6e70 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.726+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 20 zone default found 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 4 Realm: () 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 20 zonegroup default 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30c9df0 con 0x7f06f405ca90 2023-12-07T21:09:14.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cbc70 con 0x55cff30c6e70 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cbfd0 con 0x55cff30c6e70 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.727+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.728+0000 7f070eb2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.728+0000 7f070eb2f800 20 started sync module instance, tier type = 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.728+0000 7f070eb2f800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.728+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cb240 con 0x7f06fc03d040 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.729+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f06f406f040 con 0x7f06fc03d040 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.729+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94351621865296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cb620 con 0x7f06fc03d040 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.729+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cc7d0 con 0x55cff30c0d50 2023-12-07T21:09:14.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.730+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94351621865296] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f06f406f040 con 0x7f06fc03d040 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.730+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.730+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94351624285600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cc7d0 con 0x55cff30c0d50 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.730+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cd1a0 con 0x55cff30c6e70 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.731+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94351624285600] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.731+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.731+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94351624293536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cd500 con 0x55cff30c6e70 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.731+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cde70 con 0x7f06fc03d040 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.732+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94351624293536] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.732+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f06f406f040 con 0x7f06fc03d040 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.732+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94351624291120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30ce6c0 con 0x7f06fc03d040 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.732+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cef00 con 0x55cff30c0d50 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.733+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.733+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94351624301088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cf750 con 0x55cff30c0d50 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.733+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30d0120 con 0x7f06f405ca90 2023-12-07T21:09:14.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.733+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94351624291120] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f06f406f040 con 0x7f06fc03d040 2023-12-07T21:09:14.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.734+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.734+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94351624305696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30d00e0 con 0x7f06f405ca90 2023-12-07T21:09:14.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.734+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30d0ae0 con 0x7f06f405ca90 2023-12-07T21:09:14.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.734+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94351624301088] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.735+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94351624305696] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.735+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.735+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94351624299040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30d0640 con 0x7f06f405ca90 2023-12-07T21:09:14.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.735+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30d0e40 con 0x7f06f405ca90 2023-12-07T21:09:14.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.736+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.736+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94351624308768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30d11f0 con 0x7f06f405ca90 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.736+0000 7f070eb2f800 20 add_watcher() i=0 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.736+0000 7f070eb2f800 20 add_watcher() i=1 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.736+0000 7f070eb2f800 20 add_watcher() i=2 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.736+0000 7f070eb2f800 20 add_watcher() i=3 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.736+0000 7f070eb2f800 20 add_watcher() i=4 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.736+0000 7f070eb2f800 20 add_watcher() i=5 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.736+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94351624299040] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.736+0000 7f070eb2f800 20 add_watcher() i=6 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.737+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94351624308768] v31'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.737+0000 7f070eb2f800 20 add_watcher() i=7 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.737+0000 7f070eb2f800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.737+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cf2b0 con 0x55cff30c0d50 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.737+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.737+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94351624309936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cf2b0 con 0x55cff30c0d50 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.738+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94351624309936] v31'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.738+0000 7f06cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.738+0000 7f070eb2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.738+0000 7f070eb2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070eb2f800 5 note: GC not initialized 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f06ca7fc640 20 reqs_thread_entry: start 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070eb2f800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070eb2f800 20 Filter name: none 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f063bfff640 20 reqs_thread_entry: start 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070eb2f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070eb2f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff31072a0 con 0x55cff30c0d50 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070eb2f800 20 rados_obj.operate() r=0 bl.length=513 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070eb2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070eb2f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070eb2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.739+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff310d140 con 0x55cff30c0d50 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v31'7 uv7 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070eb2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070eb2f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070eb2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94351624555456 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff310bcd0 con 0x55cff30c0d50 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94351624301088 notify 133143986182 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x55cff30b6090 con 0x55cff30c0d50 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070177c640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 94351624301088 notifier 4342 bl.length()=689 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070177c640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070177c640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(64 notify.4 [notify cookie 94351624555456 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070177c640 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f06dc0042a0 con 0x55cff30c0d50 2023-12-07T21:09:14.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.741+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== watch-notify(notify_complete (2) cookie 94351624555456 notify 133143986182 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55cff30b5c30 con 0x55cff30c0d50 2023-12-07T21:09:14.744 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:14.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.742+0000 7f06cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.742+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94351624309936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff310b800 con 0x55cff30c0d50 2023-12-07T21:09:14.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.743+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94351624309936] v31'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.743+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94351621865296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff310b800 con 0x7f06fc03d040 2023-12-07T21:09:14.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.744+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94351621865296] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f06f406f040 con 0x7f06fc03d040 2023-12-07T21:09:14.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.744+0000 7f070eb2f800 20 remove_watcher() i=0 2023-12-07T21:09:14.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.744+0000 7f070eb2f800 2 removed watcher, disabling cache 2023-12-07T21:09:14.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.744+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94351624285600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff310bb60 con 0x55cff30c0d50 2023-12-07T21:09:14.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.746+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94351624285600] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.746+0000 7f070eb2f800 20 remove_watcher() i=1 2023-12-07T21:09:14.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.746+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94351624293536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff310bb60 con 0x55cff30c6e70 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.747+0000 7f070a77e640 1 -- 172.21.15.121:0/2483260684 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94351624293536] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f06fc016070 con 0x55cff30c6e70 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.747+0000 7f070eb2f800 20 remove_watcher() i=2 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.747+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94351624291120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff3105990 con 0x7f06fc03d040 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.748+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94351624291120] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f06f406f040 con 0x7f06fc03d040 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.748+0000 7f070eb2f800 20 remove_watcher() i=3 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.748+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94351624301088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff3105cf0 con 0x55cff30c0d50 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.749+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94351624301088] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x55cff30c0d50 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.749+0000 7f070eb2f800 20 remove_watcher() i=4 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.749+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94351624305696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff3105cf0 con 0x7f06f405ca90 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.750+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94351624305696] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.750+0000 7f070eb2f800 20 remove_watcher() i=5 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.750+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94351624299040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30cfc20 con 0x7f06f405ca90 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.751+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94351624299040] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.751+0000 7f070eb2f800 20 remove_watcher() i=6 2023-12-07T21:09:14.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.751+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94351624308768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55cff30ce220 con 0x7f06f405ca90 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070af7f640 1 -- 172.21.15.121:0/2483260684 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94351624308768] v31'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f070402ea00 con 0x7f06f405ca90 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 20 remove_watcher() i=7 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f06f405ca90 msgr2=0x7f06f4009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f06f405ca90 0x7f06f4009410 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55cff30c0d50 msgr2=0x55cff30c3210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55cff30c0d50 0x55cff30c3210 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f06fc03d040 msgr2=0x7f06fc02e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f06fc03d040 0x7f06fc02e350 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55cff30c6e70 msgr2=0x55cff30c92e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55cff30c6e70 0x55cff30c92e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f06e40360c0 msgr2=0x7f06e4038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f06e40360c0 0x7f06e4038580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f06f400a470 tx=0x7f06f404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 msgr2=0x55cff30b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 --2- 172.21.15.121:0/2483260684 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff30ae670 0x55cff30b56f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f070400a930 tx=0x7f0704003370 comp rx=0 tx=0).stop 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 reap_dead start 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f0701f7d640 1 -- 172.21.15.121:0/2483260684 reap_dead start 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 shutdown_connections 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 >> 172.21.15.121:0/2483260684 conn(0x55cff2ffa9a0 msgr2=0x55cff30a8850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 shutdown_connections 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.752+0000 7f070eb2f800 1 -- 172.21.15.121:0/2483260684 wait complete. 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.753+0000 7f070eb2f800 1 -- 172.21.15.121:0/1686205300 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f06ec036110 msgr2=0x7f06ec0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.753+0000 7f070eb2f800 1 --2- 172.21.15.121:0/1686205300 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f06ec036110 0x7f06ec0385d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06fc01bfd0 tx=0x7f06fc01cf90 comp rx=0 tx=0).stop 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.753+0000 7f070eb2f800 1 -- 172.21.15.121:0/1686205300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 msgr2=0x55cff30a2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.753+0000 7f070eb2f800 1 --2- 172.21.15.121:0/1686205300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff30a2470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55cff30975d0 tx=0x7f06fc000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.753+0000 7f070eb2f800 1 -- 172.21.15.121:0/1686205300 shutdown_connections 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.753+0000 7f070eb2f800 1 --2- 172.21.15.121:0/1686205300 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f06ec036110 0x7f06ec0385d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.753+0000 7f070eb2f800 1 --2- 172.21.15.121:0/1686205300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55cff2ff4750 0x55cff30a2470 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.753+0000 7f070eb2f800 1 -- 172.21.15.121:0/1686205300 >> 172.21.15.121:0/1686205300 conn(0x55cff2fedf00 msgr2=0x55cff3099bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.753+0000 7f070eb2f800 1 -- 172.21.15.121:0/1686205300 shutdown_connections 2023-12-07T21:09:14.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.753+0000 7f070eb2f800 1 -- 172.21.15.121:0/1686205300 wait complete. 2023-12-07T21:09:14.753 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:14.753 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-12-07T21:09:14.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-12-07T21:09:14.753 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-12-07T21:09:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:14.795 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.802+0000 7f3dcd42f800 1 Processor -- start 2023-12-07T21:09:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.803+0000 7f3dcd42f800 1 -- start start 2023-12-07T21:09:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.803+0000 7f3dcd42f800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5591475687b0 0x559147568bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.803+0000 7f3dcd42f800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5591474b47a0 con 0x559147569110 2023-12-07T21:09:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.803+0000 7f3dcd42f800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55914747d880 con 0x5591475687b0 2023-12-07T21:09:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.803+0000 7f3dc86fa640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5591475687b0 0x559147568bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.803+0000 7f3dbfef9640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x559147569110 0x55914756fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37804/0 (socket says 172.21.15.121:37804) 2023-12-07T21:09:14.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.803+0000 7f3dbfef9640 1 -- 172.21.15.121:0/2274893890 learned_addr learned my addr 172.21.15.121:0/2274893890 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.803+0000 7f3dc86fa640 1 -- 172.21.15.121:0/2274893890 >> v1:172.21.15.89:6789/0 conn(0x559147569110 legacy=0x55914756fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.803+0000 7f3dc86fa640 1 -- 172.21.15.121:0/2274893890 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559147572320 con 0x5591475687b0 2023-12-07T21:09:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.805+0000 7f3dc86fa640 1 --2- 172.21.15.121:0/2274893890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x559147568bd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3db800a470 tx=0x7f3db801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5888cd081877bdb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.805+0000 7f3dc7ef9640 1 -- 172.21.15.121:0/2274893890 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3db8052570 con 0x5591475687b0 2023-12-07T21:09:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.805+0000 7f3dc7ef9640 1 -- 172.21.15.121:0/2274893890 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db80526d0 con 0x5591475687b0 2023-12-07T21:09:14.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.805+0000 7f3dc7ef9640 1 -- 172.21.15.121:0/2274893890 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3db8052990 con 0x5591475687b0 2023-12-07T21:09:14.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.806+0000 7f3dcd42f800 1 -- 172.21.15.121:0/2274893890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 msgr2=0x559147568bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.806+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/2274893890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x559147568bd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3db800a470 tx=0x7f3db801cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.806+0000 7f3dcd42f800 1 -- 172.21.15.121:0/2274893890 shutdown_connections 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.806+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/2274893890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x559147568bd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.806+0000 7f3dcd42f800 1 -- 172.21.15.121:0/2274893890 >> 172.21.15.121:0/2274893890 conn(0x559147561f60 msgr2=0x559147564380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.806+0000 7f3dcd42f800 1 -- 172.21.15.121:0/2274893890 shutdown_connections 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.806+0000 7f3dcd42f800 1 -- 172.21.15.121:0/2274893890 wait complete. 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.806+0000 7f3dcd42f800 1 Processor -- start 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.806+0000 7f3dcd42f800 1 -- start start 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.807+0000 7f3dcd42f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x55914760f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.807+0000 7f3dcd42f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55914747adb0 con 0x5591475687b0 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.807+0000 7f3dc86fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x55914760f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.807+0000 7f3dc86fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x55914760f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53588/0 (socket says 172.21.15.121:53588) 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.807+0000 7f3dc86fa640 1 -- 172.21.15.121:0/385109420 learned_addr learned my addr 172.21.15.121:0/385109420 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.807+0000 7f3dc86fa640 1 -- 172.21.15.121:0/385109420 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db8005d20 con 0x5591475687b0 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.807+0000 7f3dc86fa640 1 --2- 172.21.15.121:0/385109420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x55914760f070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3db8055040 tx=0x7f3db804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63195e6420a422cd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.807+0000 7f3dc76f8640 1 -- 172.21.15.121:0/385109420 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3db800a180 con 0x5591475687b0 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.807+0000 7f3dc76f8640 1 -- 172.21.15.121:0/385109420 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db800a2e0 con 0x5591475687b0 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.807+0000 7f3dc76f8640 1 -- 172.21.15.121:0/385109420 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3db80529b0 con 0x5591475687b0 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dcd42f800 1 -- 172.21.15.121:0/385109420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 msgr2=0x55914760f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/385109420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x55914760f070 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3db8055040 tx=0x7f3db804c000 comp rx=0 tx=0).stop 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dcd42f800 1 -- 172.21.15.121:0/385109420 shutdown_connections 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/385109420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x55914760f070 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dcd42f800 1 -- 172.21.15.121:0/385109420 >> 172.21.15.121:0/385109420 conn(0x559147561f60 msgr2=0x55914760ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dcd42f800 1 -- 172.21.15.121:0/385109420 shutdown_connections 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dcd42f800 1 -- 172.21.15.121:0/385109420 wait complete. 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dcd42f800 1 Processor -- start 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dcd42f800 1 -- start start 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dcd42f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x5591476164a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dcd42f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591474766a0 con 0x5591475687b0 2023-12-07T21:09:14.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dc86fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x5591476164a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dc86fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x5591476164a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53604/0 (socket says 172.21.15.121:53604) 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.808+0000 7f3dc86fa640 1 -- 172.21.15.121:0/1003154931 learned_addr learned my addr 172.21.15.121:0/1003154931 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.809+0000 7f3dc86fa640 1 -- 172.21.15.121:0/1003154931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559147572320 con 0x5591475687b0 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.809+0000 7f3dc86fa640 1 --2- 172.21.15.121:0/1003154931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x5591476164a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3db805e040 tx=0x7f3db8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.809+0000 7f3dc66f6640 1 -- 172.21.15.121:0/1003154931 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3db806a070 con 0x5591475687b0 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.809+0000 7f3dc66f6640 1 -- 172.21.15.121:0/1003154931 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db805c410 con 0x5591475687b0 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.809+0000 7f3dc66f6640 1 -- 172.21.15.121:0/1003154931 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3db805c6b0 con 0x5591475687b0 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.809+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1003154931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5591476169e0 con 0x5591475687b0 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.809+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1003154931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559147616f20 con 0x5591475687b0 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.809+0000 7f3dcd42f800 1 Processor -- start 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dcd42f800 1 -- start start 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dcd42f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 0x559147622ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dcd42f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559147410890 con 0x5591476226a0 2023-12-07T21:09:14.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dc66f6640 1 -- 172.21.15.121:0/1003154931 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3db8059030 con 0x5591475687b0 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dc66f6640 1 --2- 172.21.15.121:0/1003154931 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3da8036110 0x7f3da80385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dc8efb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 0x559147622ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dc8efb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 0x559147622ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53616/0 (socket says 172.21.15.121:53616) 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dc8efb640 1 -- 172.21.15.121:0/1251930055 learned_addr learned my addr 172.21.15.121:0/1251930055 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dc66f6640 1 -- 172.21.15.121:0/1003154931 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f3db808cc40 con 0x5591475687b0 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dc86fa640 1 --2- 172.21.15.121:0/1003154931 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3da8036110 0x7f3da80385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dc8efb640 1 -- 172.21.15.121:0/1251930055 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559147623000 con 0x5591476226a0 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dc86fa640 1 --2- 172.21.15.121:0/1003154931 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3da8036110 0x7f3da80385d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3db805b8f0 tx=0x7f3db807a040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.810+0000 7f3dc8efb640 1 --2- 172.21.15.121:0/1251930055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 0x559147622ac0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000a430 tx=0x7f3dc000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565667d52c1da360 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dbf6f8640 1 -- 172.21.15.121:0/1251930055 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dc0001650 con 0x5591476226a0 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dbf6f8640 1 -- 172.21.15.121:0/1251930055 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc00017d0 con 0x5591476226a0 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dbf6f8640 1 -- 172.21.15.121:0/1251930055 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dc0001ab0 con 0x5591476226a0 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1251930055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 msgr2=0x559147622ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/1251930055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 0x559147622ac0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000a430 tx=0x7f3dc000a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1251930055 shutdown_connections 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/1251930055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 0x559147622ac0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1251930055 >> 172.21.15.121:0/1251930055 conn(0x559147569110 msgr2=0x55914761da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1251930055 shutdown_connections 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1251930055 wait complete. 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dcd42f800 1 Processor -- start 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dcd42f800 1 -- start start 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dcd42f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 0x559147629650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.811+0000 7f3dcd42f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x559147410530 con 0x5591476226a0 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.812+0000 7f3dc8efb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 0x559147629650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.812+0000 7f3dc8efb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 0x559147629650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53630/0 (socket says 172.21.15.121:53630) 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.812+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 learned_addr learned my addr 172.21.15.121:0/3856653133 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.812+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc000a0e0 con 0x5591476226a0 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.812+0000 7f3dc8efb640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 0x559147629650 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000a930 tx=0x7f3dc0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.812+0000 7f3dbdef5640 1 -- 172.21.15.121:0/3856653133 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dc0010900 con 0x5591476226a0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.812+0000 7f3dbdef5640 1 -- 172.21.15.121:0/3856653133 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc0010a60 con 0x5591476226a0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.812+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559147629b90 con 0x5591476226a0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.812+0000 7f3dbdef5640 1 -- 172.21.15.121:0/3856653133 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3dc0010d20 con 0x5591476226a0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.812+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559147629ff0 con 0x5591476226a0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.813+0000 7f3dbdef5640 1 -- 172.21.15.121:0/3856653133 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3dc0017030 con 0x5591476226a0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.813+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.813+0000 7f3dbdef5640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3da0036110 0x7f3da00385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.813+0000 7f3dbdef5640 1 -- 172.21.15.121:0/3856653133 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f3dc004b850 con 0x5591476226a0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.813+0000 7f3dbfef9640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3da0036110 0x7f3da00385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.813+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x559147634db0 0x559147637270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.813+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5591476379c0 con 0x559147634db0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dc8efb640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x559147634db0 0x559147637270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dbfef9640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3da0036110 0x7f3da00385d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3db0000f60 tx=0x7f3db0001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dc8efb640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x559147634db0 0x559147637270 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dcd42f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dcd42f800 20 realm 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147637d90 con 0x559147634db0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dcd42f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dcd42f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5591476385e0 con 0x559147634db0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dcd42f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.814+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147638940 con 0x559147634db0 2023-12-07T21:09:14.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.815+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.815+0000 7f3dcd42f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.815+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.815+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147638280 con 0x559147634db0 2023-12-07T21:09:14.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.815+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.815+0000 7f3dcd42f800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:14.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.815+0000 7f3dcd42f800 20 searching for the correct realm 2023-12-07T21:09:14.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.815+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55914763ab90 0x55914763cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.815+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x55914763ab90 2023-12-07T21:09:14.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.815+0000 7f3dc86fa640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55914763ab90 0x55914763cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.816+0000 7f3dc86fa640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55914763ab90 0x55914763cf80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.816+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.816+0000 7f3dc86fa640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3db8078060 0x7f3db808c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.816+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db8078060 2023-12-07T21:09:14.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.816+0000 7f3dbfef9640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3db8078060 0x7f3db808c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.816+0000 7f3dbfef9640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3db8078060 0x7f3db808c240 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.816+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db0006070 con 0x7f3db8078060 2023-12-07T21:09:14.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.817+0000 7f3dbfef9640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f3db000d3d0 0x7f3db000d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.817+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db000d3d0 2023-12-07T21:09:14.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.817+0000 7f3dc8efb640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f3db000d3d0 0x7f3db000d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.817+0000 7f3dc8efb640 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f3db000d3d0 0x7f3db000d830 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.817+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.817+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x559147634db0 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.818+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.818+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x559147634db0 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.818+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.818+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db000d3d0 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.818+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.818+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db000d3d0 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.818+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.818+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db8078060 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.819+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db0006070 con 0x7f3db8078060 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.819+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x55914763ab90 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.819+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.819+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x559147634db0 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.819+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.819+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db000d3d0 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.819+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.819+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x559147634db0 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.819+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.819+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db8078060 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.820+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3db0006070 con 0x7f3db8078060 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.820+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x55914763ab90 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.820+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.820+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x55914763ab90 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.820+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.820+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db000d3d0 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.821+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.821+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x55914763ab90 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.821+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.821+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x55914763ab90 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.821+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.821+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x559147634db0 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.822+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.822+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x559147634db0 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.822+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.822+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db000d3d0 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.822+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.822+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x55914763ab90 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.822+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.822+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db8078060 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.823+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db0006070 con 0x7f3db8078060 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.823+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x559147634db0 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.823+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.823+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db000d3d0 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.823+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.823+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x55914763ab90 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.824+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.824+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db000d3d0 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.824+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.824+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db8078060 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.824+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db0006070 con 0x7f3db8078060 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.824+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x55914763ab90 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.824+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.824+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x7f3db000d3d0 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d560 con 0x559147634db0 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3dc0053080 con 0x7f3db8078060 2023-12-07T21:09:14.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3db0006070 con 0x7f3db8078060 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dcd42f800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dcd42f800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dcd42f800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dcd42f800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dcd42f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dcd42f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5591476397d0 con 0x559147634db0 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dcd42f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.825+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147639420 con 0x559147634db0 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147639470 con 0x55914763ab90 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 20 zone default found 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 4 Realm: () 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 20 zonegroup default 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763d980 con 0x7f3db000d3d0 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.826+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763f800 con 0x55914763ab90 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.827+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.827+0000 7f3dcd42f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.827+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.827+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763fb60 con 0x55914763ab90 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.827+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.827+0000 7f3dcd42f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.827+0000 7f3dcd42f800 20 started sync module instance, tier type = 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.827+0000 7f3dcd42f800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.827+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763edd0 con 0x7f3db8078060 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.828+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db0006070 con 0x7f3db8078060 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.828+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94082453929808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914763e9b0 con 0x7f3db8078060 2023-12-07T21:09:14.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.828+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147640360 con 0x559147634db0 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.829+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94082453929808] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db0006070 con 0x7f3db8078060 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.829+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.829+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94082456351104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147640360 con 0x559147634db0 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.829+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147640e00 con 0x55914763ab90 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.830+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94082456351104] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.830+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.830+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94082456354496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5591476402d0 con 0x55914763ab90 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.830+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147641af0 con 0x7f3db8078060 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.831+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94082456354496] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.831+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db0026040 con 0x7f3db8078060 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.831+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94082456359616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147642340 con 0x7f3db8078060 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.831+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147642b40 con 0x559147634db0 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.832+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.832+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94082456364976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147643240 con 0x559147634db0 2023-12-07T21:09:14.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.832+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147643d10 con 0x7f3db000d3d0 2023-12-07T21:09:14.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.833+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94082456359616] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db0026040 con 0x7f3db8078060 2023-12-07T21:09:14.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.833+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.833+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94082456369136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147643cd0 con 0x7f3db000d3d0 2023-12-07T21:09:14.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.833+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5591476446d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.834+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94082456364976] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.834+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94082456369136] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94082456362656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147644230 con 0x7f3db000d3d0 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147644a70 con 0x7f3db000d3d0 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94082456371760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5591476450f0 con 0x7f3db000d3d0 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dcd42f800 20 add_watcher() i=0 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dcd42f800 20 add_watcher() i=1 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dcd42f800 20 add_watcher() i=2 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dcd42f800 20 add_watcher() i=3 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dcd42f800 20 add_watcher() i=4 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dcd42f800 20 add_watcher() i=5 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94082456362656] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.835+0000 7f3dcd42f800 20 add_watcher() i=6 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.836+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94082456371760] v31'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.836+0000 7f3dcd42f800 20 add_watcher() i=7 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.836+0000 7f3dcd42f800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.836+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147648010 con 0x559147634db0 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.837+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.837+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94082456374080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5591476453f0 con 0x559147634db0 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.838+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94082456374080] v31'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.838+0000 7f3d8e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.838+0000 7f3dcd42f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.838+0000 7f3dcd42f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.838+0000 7f3dcd42f800 5 note: GC not initialized 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.838+0000 7f3d8d7e2640 20 reqs_thread_entry: start 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.838+0000 7f3dcd42f800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.838+0000 7f3dcd42f800 20 Filter name: none 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.839+0000 7f3cfeffd640 20 reqs_thread_entry: start 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.839+0000 7f3dcd42f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.839+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55914767a940 con 0x559147634db0 2023-12-07T21:09:14.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.839+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.841 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.839+0000 7f3dcd42f800 20 rados_obj.operate() r=0 bl.length=513 2023-12-07T21:09:14.841 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:14.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.840+0000 7f3d8e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.840+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94082456374080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147679870 con 0x559147634db0 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.841+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94082456374080] v31'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.841+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94082453929808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147679870 con 0x7f3db8078060 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.842+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94082453929808] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db0026040 con 0x7f3db8078060 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.842+0000 7f3dcd42f800 20 remove_watcher() i=0 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.842+0000 7f3dcd42f800 2 removed watcher, disabling cache 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.842+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94082456351104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147679bd0 con 0x559147634db0 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.843+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94082456351104] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.843+0000 7f3dcd42f800 20 remove_watcher() i=1 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.843+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94082456354496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147679bd0 con 0x55914763ab90 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.844+0000 7f3dc86fa640 1 -- 172.21.15.121:0/3856653133 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94082456354496] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db8083070 con 0x55914763ab90 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.844+0000 7f3dcd42f800 20 remove_watcher() i=2 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.844+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94082456359616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147644f50 con 0x7f3db8078060 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.845+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94082456359616] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3db0026040 con 0x7f3db8078060 2023-12-07T21:09:14.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.845+0000 7f3dcd42f800 20 remove_watcher() i=3 2023-12-07T21:09:14.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.845+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94082456364976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5591476452b0 con 0x559147634db0 2023-12-07T21:09:14.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.846+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94082456364976] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x559147634db0 2023-12-07T21:09:14.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.846+0000 7f3dcd42f800 20 remove_watcher() i=4 2023-12-07T21:09:14.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.846+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94082456369136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5591476452b0 con 0x7f3db000d3d0 2023-12-07T21:09:14.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.847+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94082456369136] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.847+0000 7f3dcd42f800 20 remove_watcher() i=5 2023-12-07T21:09:14.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.847+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94082456362656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5591476437f0 con 0x7f3db000d3d0 2023-12-07T21:09:14.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.848+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94082456362656] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.848+0000 7f3dcd42f800 20 remove_watcher() i=6 2023-12-07T21:09:14.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.848+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94082456371760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x559147641ea0 con 0x7f3db000d3d0 2023-12-07T21:09:14.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dc8efb640 1 -- 172.21.15.121:0/3856653133 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94082456371760] v31'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3dc002e9d0 con 0x7f3db000d3d0 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 20 remove_watcher() i=7 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f3db000d3d0 msgr2=0x7f3db000d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f3db000d3d0 0x7f3db000d830 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x559147634db0 msgr2=0x559147637270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x559147634db0 0x559147637270 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3db8078060 msgr2=0x7f3db808c240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3db8078060 0x7f3db808c240 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55914763ab90 msgr2=0x55914763cf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55914763ab90 0x55914763cf80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3da0036110 msgr2=0x7f3da00385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3da0036110 0x7f3da00385d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3db0000f60 tx=0x7f3db0001230 comp rx=0 tx=0).stop 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 msgr2=0x559147629650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/3856653133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591476226a0 0x559147629650 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000a930 tx=0x7f3dc0003370 comp rx=0 tx=0).stop 2023-12-07T21:09:14.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 reap_dead start 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.849+0000 7f3dbfef9640 1 -- 172.21.15.121:0/3856653133 reap_dead start 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 shutdown_connections 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 >> 172.21.15.121:0/3856653133 conn(0x559147569110 msgr2=0x55914761c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 shutdown_connections 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 -- 172.21.15.121:0/3856653133 wait complete. 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1003154931 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3da8036110 msgr2=0x7f3da80385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/1003154931 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3da8036110 0x7f3da80385d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3db805b8f0 tx=0x7f3db807a040 comp rx=0 tx=0).stop 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1003154931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 msgr2=0x5591476164a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/1003154931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x5591476164a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3db805e040 tx=0x7f3db8002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1003154931 shutdown_connections 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/1003154931 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3da8036110 0x7f3da80385d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 --2- 172.21.15.121:0/1003154931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5591475687b0 0x5591476164a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1003154931 >> 172.21.15.121:0/1003154931 conn(0x559147561f60 msgr2=0x55914760dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1003154931 shutdown_connections 2023-12-07T21:09:14.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.850+0000 7f3dcd42f800 1 -- 172.21.15.121:0/1003154931 wait complete. 2023-12-07T21:09:14.851 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:14.851 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-12-07T21:09:14.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-12-07T21:09:14.851 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-12-07T21:09:14.929 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:14.929 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.937+0000 7fc5226ba800 1 Processor -- start 2023-12-07T21:09:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.937+0000 7fc5226ba800 1 -- start start 2023-12-07T21:09:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.937+0000 7fc5226ba800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55922aadb100 0x55922aadb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.937+0000 7fc5226ba800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55922aa287a0 con 0x55922aadc310 2023-12-07T21:09:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.937+0000 7fc5226ba800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55922a9f1880 con 0x55922aadb100 2023-12-07T21:09:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.937+0000 7fc5201ba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55922aadb100 0x55922aadb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.937+0000 7fc5201ba640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55922aadb100 0x55922aadb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53634/0 (socket says 172.21.15.121:53634) 2023-12-07T21:09:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.937+0000 7fc51f9b9640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55922aadc310 0x55922aadc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37812/0 (socket says 172.21.15.121:37812) 2023-12-07T21:09:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.937+0000 7fc5201ba640 1 -- 172.21.15.121:0/1474503947 learned_addr learned my addr 172.21.15.121:0/1474503947 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.938+0000 7fc5201ba640 1 -- 172.21.15.121:0/1474503947 >> v1:172.21.15.89:6789/0 conn(0x55922aadc310 legacy=0x55922aadc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.938+0000 7fc51f1b8640 1 -- 172.21.15.121:0/1474503947 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593543418 0 0) 0x55922aa287a0 con 0x55922aadc310 2023-12-07T21:09:14.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.938+0000 7fc5201ba640 1 -- 172.21.15.121:0/1474503947 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55922aadbbf0 con 0x55922aadb100 2023-12-07T21:09:14.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.939+0000 7fc5201ba640 1 --2- 172.21.15.121:0/1474503947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922aadb520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc51000a520 tx=0x7fc51001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485ddf19744ddab3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.939+0000 7fc51f1b8640 1 -- 172.21.15.121:0/1474503947 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc510052570 con 0x55922aadb100 2023-12-07T21:09:14.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.940+0000 7fc51f1b8640 1 -- 172.21.15.121:0/1474503947 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5100526d0 con 0x55922aadb100 2023-12-07T21:09:14.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.940+0000 7fc51f1b8640 1 -- 172.21.15.121:0/1474503947 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc510052990 con 0x55922aadb100 2023-12-07T21:09:14.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.940+0000 7fc5226ba800 1 -- 172.21.15.121:0/1474503947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 msgr2=0x55922aadb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.940+0000 7fc5226ba800 1 --2- 172.21.15.121:0/1474503947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922aadb520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc51000a520 tx=0x7fc51001cee0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.940+0000 7fc5226ba800 1 -- 172.21.15.121:0/1474503947 shutdown_connections 2023-12-07T21:09:14.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.940+0000 7fc5226ba800 1 --2- 172.21.15.121:0/1474503947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922aadb520 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.940+0000 7fc5226ba800 1 -- 172.21.15.121:0/1474503947 >> 172.21.15.121:0/1474503947 conn(0x55922aad6880 msgr2=0x55922aad8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.940+0000 7fc5226ba800 1 -- 172.21.15.121:0/1474503947 shutdown_connections 2023-12-07T21:09:14.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.940+0000 7fc5226ba800 1 -- 172.21.15.121:0/1474503947 wait complete. 2023-12-07T21:09:14.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.941+0000 7fc5226ba800 1 Processor -- start 2023-12-07T21:09:14.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.941+0000 7fc5226ba800 1 -- start start 2023-12-07T21:09:14.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.941+0000 7fc5226ba800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab7ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.941+0000 7fc5226ba800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55922a9eedb0 con 0x55922aadb100 2023-12-07T21:09:14.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.941+0000 7fc5201ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab7ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.941+0000 7fc5201ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab7ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53636/0 (socket says 172.21.15.121:53636) 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.941+0000 7fc5201ba640 1 -- 172.21.15.121:0/2422176904 learned_addr learned my addr 172.21.15.121:0/2422176904 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.941+0000 7fc5201ba640 1 -- 172.21.15.121:0/2422176904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc510005de0 con 0x55922aadb100 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.941+0000 7fc5201ba640 1 --2- 172.21.15.121:0/2422176904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab7ff50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc510000c00 tx=0x7fc51004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d12161328890a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc51e9b7640 1 -- 172.21.15.121:0/2422176904 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc51005e070 con 0x55922aadb100 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc51e9b7640 1 -- 172.21.15.121:0/2422176904 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc510052840 con 0x55922aadb100 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc51e9b7640 1 -- 172.21.15.121:0/2422176904 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc510052570 con 0x55922aadb100 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc5226ba800 1 -- 172.21.15.121:0/2422176904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 msgr2=0x55922ab7ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc5226ba800 1 --2- 172.21.15.121:0/2422176904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab7ff50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc510000c00 tx=0x7fc51004c000 comp rx=0 tx=0).stop 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc5226ba800 1 -- 172.21.15.121:0/2422176904 shutdown_connections 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc5226ba800 1 --2- 172.21.15.121:0/2422176904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab7ff50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc5226ba800 1 -- 172.21.15.121:0/2422176904 >> 172.21.15.121:0/2422176904 conn(0x55922aad6880 msgr2=0x55922ab7bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc5226ba800 1 -- 172.21.15.121:0/2422176904 shutdown_connections 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc5226ba800 1 -- 172.21.15.121:0/2422176904 wait complete. 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc5226ba800 1 Processor -- start 2023-12-07T21:09:14.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.942+0000 7fc5226ba800 1 -- start start 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc5226ba800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab861f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc5226ba800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55922a9ea6a0 con 0x55922aadb100 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc5201ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab861f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc5201ba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab861f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53644/0 (socket says 172.21.15.121:53644) 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc5201ba640 1 -- 172.21.15.121:0/3492255591 learned_addr learned my addr 172.21.15.121:0/3492255591 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc5201ba640 1 -- 172.21.15.121:0/3492255591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51004e070 con 0x55922aadb100 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc5201ba640 1 --2- 172.21.15.121:0/3492255591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab861f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc510044940 tx=0x7fc510002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc51d9b5640 1 -- 172.21.15.121:0/3492255591 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc510052e80 con 0x55922aadb100 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc51d9b5640 1 -- 172.21.15.121:0/3492255591 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51006b480 con 0x55922aadb100 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc51d9b5640 1 -- 172.21.15.121:0/3492255591 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc51006b740 con 0x55922aadb100 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc5226ba800 1 -- 172.21.15.121:0/3492255591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55922ab86730 con 0x55922aadb100 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.943+0000 7fc5226ba800 1 -- 172.21.15.121:0/3492255591 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55922ab86c10 con 0x55922aadb100 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.944+0000 7fc5226ba800 1 Processor -- start 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.944+0000 7fc5226ba800 1 -- start start 2023-12-07T21:09:14.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.944+0000 7fc51d9b5640 1 -- 172.21.15.121:0/3492255591 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc51006b8f0 con 0x55922aadb100 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.944+0000 7fc5226ba800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 0x55922ab92790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.944+0000 7fc5226ba800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55922a984890 con 0x55922ab92370 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.944+0000 7fc51d9b5640 1 --2- 172.21.15.121:0/3492255591 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc50c0360c0 0x7fc50c038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.944+0000 7fc51d9b5640 1 -- 172.21.15.121:0/3492255591 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc51008e8a0 con 0x55922aadb100 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.944+0000 7fc5209bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 0x55922ab92790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.944+0000 7fc5209bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 0x55922ab92790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53650/0 (socket says 172.21.15.121:53650) 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.944+0000 7fc5201ba640 1 --2- 172.21.15.121:0/3492255591 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc50c0360c0 0x7fc50c038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.944+0000 7fc5209bb640 1 -- 172.21.15.121:0/2052931275 learned_addr learned my addr 172.21.15.121:0/2052931275 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5209bb640 1 -- 172.21.15.121:0/2052931275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55922ab92cd0 con 0x55922ab92370 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5201ba640 1 --2- 172.21.15.121:0/3492255591 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc50c0360c0 0x7fc50c038580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc510061b10 tx=0x7fc51008e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5209bb640 1 --2- 172.21.15.121:0/2052931275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 0x55922ab92790 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc51800a430 tx=0x7fc51800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae6d39ce505f369 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5077fe640 1 -- 172.21.15.121:0/2052931275 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc518001650 con 0x55922ab92370 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5077fe640 1 -- 172.21.15.121:0/2052931275 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5180017d0 con 0x55922ab92370 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5077fe640 1 -- 172.21.15.121:0/2052931275 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc518001ab0 con 0x55922ab92370 2023-12-07T21:09:14.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5226ba800 1 -- 172.21.15.121:0/2052931275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 msgr2=0x55922ab92790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5226ba800 1 --2- 172.21.15.121:0/2052931275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 0x55922ab92790 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc51800a430 tx=0x7fc51800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5226ba800 1 -- 172.21.15.121:0/2052931275 shutdown_connections 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5226ba800 1 --2- 172.21.15.121:0/2052931275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 0x55922ab92790 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5226ba800 1 -- 172.21.15.121:0/2052931275 >> 172.21.15.121:0/2052931275 conn(0x55922aadc310 msgr2=0x55922ab8d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5226ba800 1 -- 172.21.15.121:0/2052931275 shutdown_connections 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.945+0000 7fc5226ba800 1 -- 172.21.15.121:0/2052931275 wait complete. 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.946+0000 7fc5226ba800 1 Processor -- start 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.946+0000 7fc5226ba800 1 -- start start 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.946+0000 7fc5226ba800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 0x55922ab9d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.946+0000 7fc5226ba800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55922a984530 con 0x55922ab92370 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.946+0000 7fc5209bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 0x55922ab9d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.946+0000 7fc5209bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 0x55922ab9d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53662/0 (socket says 172.21.15.121:53662) 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.946+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 learned_addr learned my addr 172.21.15.121:0/4250782226 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:14.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.946+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51800a0e0 con 0x55922ab92370 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.947+0000 7fc5209bb640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 0x55922ab9d6b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc51800a930 tx=0x7fc518003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.947+0000 7fc505ffb640 1 -- 172.21.15.121:0/4250782226 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc518010900 con 0x55922ab92370 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.947+0000 7fc505ffb640 1 -- 172.21.15.121:0/4250782226 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc518010a60 con 0x55922ab92370 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.947+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55922ab9dbf0 con 0x55922ab92370 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.947+0000 7fc505ffb640 1 -- 172.21.15.121:0/4250782226 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc518010d20 con 0x55922ab92370 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.947+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55922ab9e050 con 0x55922ab92370 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.948+0000 7fc505ffb640 1 -- 172.21.15.121:0/4250782226 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc518017030 con 0x55922ab92370 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.948+0000 7fc505ffb640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4fc036110 0x7fc4fc0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.948+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.948+0000 7fc505ffb640 1 -- 172.21.15.121:0/4250782226 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc51804b890 con 0x55922ab92370 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.948+0000 7fc51f9b9640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4fc036110 0x7fc4fc0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.948+0000 7fc5226ba800 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55922aba8e10 0x55922abab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.948+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922ababa20 con 0x55922aba8e10 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.948+0000 7fc5209bb640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55922aba8e10 0x55922abab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.948+0000 7fc51f9b9640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4fc036110 0x7fc4fc0385d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc514000c00 tx=0x7fc514001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.948+0000 7fc5209bb640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55922aba8e10 0x55922abab2d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 20 realm 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922ababdf0 con 0x55922aba8e10 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abac640 con 0x55922aba8e10 2023-12-07T21:09:14.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abac9a0 con 0x55922aba8e10 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.949+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abac2e0 con 0x55922aba8e10 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.950+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.950+0000 7fc5226ba800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.950+0000 7fc5226ba800 20 searching for the correct realm 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.950+0000 7fc5226ba800 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55922abaebf0 0x55922abb0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.950+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922abaebf0 2023-12-07T21:09:14.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.950+0000 7fc5201ba640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55922abaebf0 0x55922abb0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.950+0000 7fc5201ba640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55922abaebf0 0x55922abb0fe0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.950+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.950+0000 7fc5201ba640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc510074020 0x7fc5100067e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.950+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc510074020 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.950+0000 7fc51f9b9640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc510074020 0x7fc5100067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.951+0000 7fc51f9b9640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc510074020 0x7fc5100067e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.951+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.951+0000 7fc51f9b9640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc51400e8a0 0x7fc51400d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.951+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc51400e8a0 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.951+0000 7fc5209bb640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc51400e8a0 0x7fc51400d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.951+0000 7fc5209bb640 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc51400e8a0 0x7fc51400d2f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.952+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.952+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922aba8e10 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.952+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.952+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922aba8e10 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.952+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.952+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc51400e8a0 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.952+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.952+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc51400e8a0 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.952+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.953+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc510074020 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.953+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.953+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922abaebf0 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.953+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.953+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922aba8e10 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.953+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.953+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc51400e8a0 2023-12-07T21:09:14.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.953+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.953+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922aba8e10 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.954+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.954+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc510074020 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.954+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.954+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922abaebf0 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.954+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.954+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922abaebf0 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.954+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.954+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc51400e8a0 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.955+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.955+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922abaebf0 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.955+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.955+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922abaebf0 2023-12-07T21:09:14.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.955+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.955+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922aba8e10 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.955+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.955+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922aba8e10 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.956+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.956+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc51400e8a0 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.956+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.956+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922abaebf0 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.956+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.956+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc510074020 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.956+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.956+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922aba8e10 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.957+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.957+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc51400e8a0 2023-12-07T21:09:14.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.957+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.957+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922abaebf0 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.957+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.957+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc51400e8a0 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.957+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.957+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc510074020 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.958+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.958+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922abaebf0 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.958+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.958+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc51400e8a0 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.958+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.958+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x55922aba8e10 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.958+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.958+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1570 con 0x7fc510074020 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abad800 con 0x55922aba8e10 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abad480 con 0x55922aba8e10 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abae190 con 0x55922abaebf0 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 zone default found 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 4 Realm: () 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 zonegroup default 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.959+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb1e30 con 0x7fc51400e8a0 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5226ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb3980 con 0x55922abaebf0 2023-12-07T21:09:14.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5226ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb3dd0 con 0x55922abaebf0 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5226ba800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5226ba800 20 started sync module instance, tier type = 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5226ba800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.960+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb2cb0 con 0x7fc510074020 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.962+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.962+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94086268075856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb3060 con 0x7fc510074020 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.962+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb4690 con 0x55922aba8e10 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.963+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94086268075856] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.963+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.963+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94086270494736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb46d0 con 0x55922aba8e10 2023-12-07T21:09:14.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.963+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb5170 con 0x55922abaebf0 2023-12-07T21:09:14.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.964+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94086270494736] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.964+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.964+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94086270504016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb5520 con 0x55922abaebf0 2023-12-07T21:09:14.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.964+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb5e90 con 0x7fc510074020 2023-12-07T21:09:14.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.965+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94086270504016] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.965+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.965+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94086270501360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb6690 con 0x7fc510074020 2023-12-07T21:09:14.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.965+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb6e90 con 0x55922aba8e10 2023-12-07T21:09:14.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.966+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.966+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94086270511904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb76e0 con 0x55922aba8e10 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.966+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb8090 con 0x7fc51400e8a0 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.966+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94086270501360] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.967+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94086270511904] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.967+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.967+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94086270509552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb71d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.967+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb88e0 con 0x7fc51400e8a0 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.968+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.968+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94086270518336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb71d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.968+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb9300 con 0x7fc51400e8a0 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.968+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94086270509552] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.969+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94086270518336] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.969+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.969+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94086270519376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb8e60 con 0x7fc51400e8a0 2023-12-07T21:09:14.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.969+0000 7fc5226ba800 20 add_watcher() i=0 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.969+0000 7fc5226ba800 20 add_watcher() i=1 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.969+0000 7fc5226ba800 20 add_watcher() i=2 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.969+0000 7fc5226ba800 20 add_watcher() i=3 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.969+0000 7fc5226ba800 20 add_watcher() i=4 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.969+0000 7fc5226ba800 20 add_watcher() i=5 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.969+0000 7fc5226ba800 20 add_watcher() i=6 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.970+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94086270519376] v31'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.970+0000 7fc5226ba800 20 add_watcher() i=7 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.970+0000 7fc5226ba800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.970+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb92e0 con 0x55922aba8e10 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.970+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.970+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94086270516144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb9780 con 0x55922aba8e10 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.971+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94086270516144] v31'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.971+0000 7fc4e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.971+0000 7fc5226ba800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:14.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.971+0000 7fc5226ba800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:14.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.971+0000 7fc5226ba800 5 note: GC not initialized 2023-12-07T21:09:14.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.971+0000 7fc4e57e2640 20 reqs_thread_entry: start 2023-12-07T21:09:14.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.971+0000 7fc5226ba800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:14.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.972+0000 7fc5226ba800 20 Filter name: none 2023-12-07T21:09:14.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.972+0000 7fc456ffd640 20 reqs_thread_entry: start 2023-12-07T21:09:14.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.972+0000 7fc5226ba800 20 rados->read ofs=0 len=0 2023-12-07T21:09:14.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.972+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abeecf0 con 0x55922aba8e10 2023-12-07T21:09:14.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.972+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.972+0000 7fc5226ba800 20 rados_obj.operate() r=0 bl.length=513 2023-12-07T21:09:14.974 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:14.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.973+0000 7fc4e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:14.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.973+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94086270516144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abedc40 con 0x55922aba8e10 2023-12-07T21:09:14.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.974+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94086270516144] v31'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.974+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94086268075856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abedc40 con 0x7fc510074020 2023-12-07T21:09:14.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.975+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94086268075856] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.975+0000 7fc5226ba800 20 remove_watcher() i=0 2023-12-07T21:09:14.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.975+0000 7fc5226ba800 2 removed watcher, disabling cache 2023-12-07T21:09:14.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.975+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94086270494736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abedfa0 con 0x55922aba8e10 2023-12-07T21:09:14.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.976+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94086270494736] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.976+0000 7fc5226ba800 20 remove_watcher() i=1 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.976+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94086270504016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abedfa0 con 0x55922abaebf0 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.977+0000 7fc5201ba640 1 -- 172.21.15.121:0/4250782226 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94086270504016] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc510071070 con 0x55922abaebf0 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.977+0000 7fc5226ba800 20 remove_watcher() i=2 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.977+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94086270501360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb92e0 con 0x7fc510074020 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.978+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94086270501360] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51400f620 con 0x7fc510074020 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.978+0000 7fc5226ba800 20 remove_watcher() i=3 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.978+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94086270511904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb9640 con 0x55922aba8e10 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.979+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94086270511904] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x55922aba8e10 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.979+0000 7fc5226ba800 20 remove_watcher() i=4 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.979+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94086270509552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb9640 con 0x7fc51400e8a0 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.980+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94086270509552] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.980+0000 7fc5226ba800 20 remove_watcher() i=5 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.980+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94086270518336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abed7a0 con 0x7fc51400e8a0 2023-12-07T21:09:14.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.981+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94086270518336] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.981+0000 7fc5226ba800 20 remove_watcher() i=6 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.981+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94086270519376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55922abb8410 con 0x7fc51400e8a0 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5209bb640 1 -- 172.21.15.121:0/4250782226 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94086270519376] v31'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc51802e9d0 con 0x7fc51400e8a0 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 20 remove_watcher() i=7 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc51400e8a0 msgr2=0x7fc51400d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc51400e8a0 0x7fc51400d2f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55922aba8e10 msgr2=0x55922abab2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55922aba8e10 0x55922abab2d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc510074020 msgr2=0x7fc5100067e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc510074020 0x7fc5100067e0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55922abaebf0 msgr2=0x55922abb0fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55922abaebf0 0x55922abb0fe0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4fc036110 msgr2=0x7fc4fc0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4fc036110 0x7fc4fc0385d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc514000c00 tx=0x7fc514001330 comp rx=0 tx=0).stop 2023-12-07T21:09:14.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 msgr2=0x55922ab9d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 --2- 172.21.15.121:0/4250782226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922ab92370 0x55922ab9d6b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc51800a930 tx=0x7fc518003370 comp rx=0 tx=0).stop 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 reap_dead start 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc51f9b9640 1 -- 172.21.15.121:0/4250782226 reap_dead start 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 shutdown_connections 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 >> 172.21.15.121:0/4250782226 conn(0x55922aadc310 msgr2=0x55922ab8c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 shutdown_connections 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/4250782226 wait complete. 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/3492255591 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc50c0360c0 msgr2=0x7fc50c038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 --2- 172.21.15.121:0/3492255591 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc50c0360c0 0x7fc50c038580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc510061b10 tx=0x7fc51008e040 comp rx=0 tx=0).stop 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/3492255591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 msgr2=0x55922ab861f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 --2- 172.21.15.121:0/3492255591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab861f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc510044940 tx=0x7fc510002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/3492255591 shutdown_connections 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 --2- 172.21.15.121:0/3492255591 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc50c0360c0 0x7fc50c038580 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 --2- 172.21.15.121:0/3492255591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55922aadb100 0x55922ab861f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:14.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.982+0000 7fc5226ba800 1 -- 172.21.15.121:0/3492255591 >> 172.21.15.121:0/3492255591 conn(0x55922aad6880 msgr2=0x55922ab7ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:14.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.983+0000 7fc5226ba800 1 -- 172.21.15.121:0/3492255591 shutdown_connections 2023-12-07T21:09:14.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:14.983+0000 7fc5226ba800 1 -- 172.21.15.121:0/3492255591 wait complete. 2023-12-07T21:09:14.983 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:14.983 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2023-12-07T21:09:14.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2023-12-07T21:09:14.983 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2023-12-07T21:09:15.065 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:15.066 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:15.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.073+0000 7fb9e3737800 1 Processor -- start 2023-12-07T21:09:15.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.073+0000 7fb9e3737800 1 -- start start 2023-12-07T21:09:15.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.073+0000 7fb9e3737800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x564366d6c690 0x564366d6cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.073+0000 7fb9e3737800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564366cb9740 con 0x564366d6cff0 2023-12-07T21:09:15.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.073+0000 7fb9e3737800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x564366c82880 con 0x564366d6c690 2023-12-07T21:09:15.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.073+0000 7fb9df4cd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x564366d6c690 0x564366d6cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.073+0000 7fb9d6ccc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x564366d6cff0 0x564366d6d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37822/0 (socket says 172.21.15.121:37822) 2023-12-07T21:09:15.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.074+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/880216348 learned_addr learned my addr 172.21.15.121:0/880216348 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:15.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.074+0000 7fb9df4cd640 1 -- 172.21.15.121:0/880216348 >> v1:172.21.15.89:6789/0 conn(0x564366d6cff0 legacy=0x564366d6d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.074+0000 7fb9df4cd640 1 -- 172.21.15.121:0/880216348 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564366d6dd10 con 0x564366d6c690 2023-12-07T21:09:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.076+0000 7fb9df4cd640 1 --2- 172.21.15.121:0/880216348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366d6cab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000a600 tx=0x7fb9d001ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5defd921e37290c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.076+0000 7fb9deccc640 1 -- 172.21.15.121:0/880216348 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9d000a200 con 0x564366d6c690 2023-12-07T21:09:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.076+0000 7fb9deccc640 1 -- 172.21.15.121:0/880216348 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d000a360 con 0x564366d6c690 2023-12-07T21:09:15.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.076+0000 7fb9deccc640 1 -- 172.21.15.121:0/880216348 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9d00086e0 con 0x564366d6c690 2023-12-07T21:09:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.076+0000 7fb9e3737800 1 -- 172.21.15.121:0/880216348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 msgr2=0x564366d6cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.076+0000 7fb9e3737800 1 --2- 172.21.15.121:0/880216348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366d6cab0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000a600 tx=0x7fb9d001ec40 comp rx=0 tx=0).stop 2023-12-07T21:09:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.076+0000 7fb9e3737800 1 -- 172.21.15.121:0/880216348 shutdown_connections 2023-12-07T21:09:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.076+0000 7fb9e3737800 1 --2- 172.21.15.121:0/880216348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366d6cab0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.076+0000 7fb9e3737800 1 -- 172.21.15.121:0/880216348 >> 172.21.15.121:0/880216348 conn(0x564366d66f00 msgr2=0x564366d69320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.076+0000 7fb9e3737800 1 -- 172.21.15.121:0/880216348 shutdown_connections 2023-12-07T21:09:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.076+0000 7fb9e3737800 1 -- 172.21.15.121:0/880216348 wait complete. 2023-12-07T21:09:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.077+0000 7fb9e3737800 1 Processor -- start 2023-12-07T21:09:15.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.077+0000 7fb9e3737800 1 -- start start 2023-12-07T21:09:15.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.077+0000 7fb9e3737800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e10170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.077+0000 7fb9e3737800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564366c7fdb0 con 0x564366d6c690 2023-12-07T21:09:15.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.077+0000 7fb9df4cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e10170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.077+0000 7fb9df4cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e10170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53682/0 (socket says 172.21.15.121:53682) 2023-12-07T21:09:15.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.077+0000 7fb9df4cd640 1 -- 172.21.15.121:0/1928001509 learned_addr learned my addr 172.21.15.121:0/1928001509 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.076 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9df4cd640 1 -- 172.21.15.121:0/1928001509 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d0005d20 con 0x564366d6c690 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9df4cd640 1 --2- 172.21.15.121:0/1928001509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e10170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0056040 tx=0x7fb9d004e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f794f204c8ea548a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9de4cb640 1 -- 172.21.15.121:0/1928001509 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9d0008590 con 0x564366d6c690 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9de4cb640 1 -- 172.21.15.121:0/1928001509 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d00086f0 con 0x564366d6c690 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9de4cb640 1 -- 172.21.15.121:0/1928001509 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9d00089d0 con 0x564366d6c690 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9e3737800 1 -- 172.21.15.121:0/1928001509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 msgr2=0x564366e10170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9e3737800 1 --2- 172.21.15.121:0/1928001509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e10170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0056040 tx=0x7fb9d004e000 comp rx=0 tx=0).stop 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9e3737800 1 -- 172.21.15.121:0/1928001509 shutdown_connections 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9e3737800 1 --2- 172.21.15.121:0/1928001509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e10170 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9e3737800 1 -- 172.21.15.121:0/1928001509 >> 172.21.15.121:0/1928001509 conn(0x564366d66f00 msgr2=0x564366e0bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9e3737800 1 -- 172.21.15.121:0/1928001509 shutdown_connections 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.078+0000 7fb9e3737800 1 -- 172.21.15.121:0/1928001509 wait complete. 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.079+0000 7fb9e3737800 1 Processor -- start 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.079+0000 7fb9e3737800 1 -- start start 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.079+0000 7fb9e3737800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e1ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.079+0000 7fb9e3737800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564366c7b6a0 con 0x564366d6c690 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.079+0000 7fb9df4cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e1ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.079+0000 7fb9df4cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e1ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53692/0 (socket says 172.21.15.121:53692) 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.079+0000 7fb9df4cd640 1 -- 172.21.15.121:0/2290023781 learned_addr learned my addr 172.21.15.121:0/2290023781 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.079+0000 7fb9df4cd640 1 -- 172.21.15.121:0/2290023781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564366d6dd10 con 0x564366d6c690 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.079+0000 7fb9df4cd640 1 --2- 172.21.15.121:0/2290023781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e1ba20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb9d001f4b0 tx=0x7fb9d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.079+0000 7fb9dd4c9640 1 -- 172.21.15.121:0/2290023781 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9d000a1d0 con 0x564366d6c690 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.079+0000 7fb9dd4c9640 1 -- 172.21.15.121:0/2290023781 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d0060470 con 0x564366d6c690 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.080+0000 7fb9dd4c9640 1 -- 172.21.15.121:0/2290023781 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9d0060750 con 0x564366d6c690 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.080+0000 7fb9e3737800 1 -- 172.21.15.121:0/2290023781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564366e1bf60 con 0x564366d6c690 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.080+0000 7fb9e3737800 1 -- 172.21.15.121:0/2290023781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564366e1c440 con 0x564366d6c690 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.080+0000 7fb9e3737800 1 Processor -- start 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.080+0000 7fb9e3737800 1 -- start start 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.080+0000 7fb9dd4c9640 1 -- 172.21.15.121:0/2290023781 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fb9d0005030 con 0x564366d6c690 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.080+0000 7fb9e3737800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e27ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.080+0000 7fb9e3737800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564366c15890 con 0x564366e27bd0 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.080+0000 7fb9dd4c9640 1 --2- 172.21.15.121:0/2290023781 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb9c0036110 0x7fb9c00385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.080+0000 7fb9dd4c9640 1 -- 172.21.15.121:0/2290023781 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fb9d008cc10 con 0x564366d6c690 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9dfcce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e27ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9dfcce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e27ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53696/0 (socket says 172.21.15.121:53696) 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9dfcce640 1 -- 172.21.15.121:0/785082592 learned_addr learned my addr 172.21.15.121:0/785082592 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9df4cd640 1 --2- 172.21.15.121:0/2290023781 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb9c0036110 0x7fb9c00385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9dfcce640 1 -- 172.21.15.121:0/785082592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564366e28530 con 0x564366e27bd0 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9df4cd640 1 --2- 172.21.15.121:0/2290023781 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb9c0036110 0x7fb9c00385d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0060f90 tx=0x7fb9d0007a10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9dfcce640 1 --2- 172.21.15.121:0/785082592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e27ff0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800a430 tx=0x7fb9d800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c43b63e51d71566 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9d64cb640 1 -- 172.21.15.121:0/785082592 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9d8001650 con 0x564366e27bd0 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9d64cb640 1 -- 172.21.15.121:0/785082592 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d80017d0 con 0x564366e27bd0 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9d64cb640 1 -- 172.21.15.121:0/785082592 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9d8001ab0 con 0x564366e27bd0 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9e3737800 1 -- 172.21.15.121:0/785082592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 msgr2=0x564366e27ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.081+0000 7fb9e3737800 1 --2- 172.21.15.121:0/785082592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e27ff0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800a430 tx=0x7fb9d800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9e3737800 1 -- 172.21.15.121:0/785082592 shutdown_connections 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9e3737800 1 --2- 172.21.15.121:0/785082592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e27ff0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9e3737800 1 -- 172.21.15.121:0/785082592 >> 172.21.15.121:0/785082592 conn(0x564366d6cff0 msgr2=0x564366e22fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9e3737800 1 -- 172.21.15.121:0/785082592 shutdown_connections 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9e3737800 1 -- 172.21.15.121:0/785082592 wait complete. 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9e3737800 1 Processor -- start 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9e3737800 1 -- start start 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9e3737800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e2ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9e3737800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564366c15530 con 0x564366e27bd0 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9dfcce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e2ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9dfcce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e2ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53700/0 (socket says 172.21.15.121:53700) 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.082+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 learned_addr learned my addr 172.21.15.121:0/691100176 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.083+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d800a0e0 con 0x564366e27bd0 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.083+0000 7fb9dfcce640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e2ec80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800a930 tx=0x7fb9d8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.083+0000 7fb9d4cc8640 1 -- 172.21.15.121:0/691100176 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9d8010900 con 0x564366e27bd0 2023-12-07T21:09:15.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.083+0000 7fb9d4cc8640 1 -- 172.21.15.121:0/691100176 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8010a60 con 0x564366e27bd0 2023-12-07T21:09:15.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.083+0000 7fb9d4cc8640 1 -- 172.21.15.121:0/691100176 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9d8010d20 con 0x564366e27bd0 2023-12-07T21:09:15.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.083+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564366e2f1c0 con 0x564366e27bd0 2023-12-07T21:09:15.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.083+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564366e2f620 con 0x564366e27bd0 2023-12-07T21:09:15.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.084+0000 7fb9d4cc8640 1 -- 172.21.15.121:0/691100176 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fb9d8017030 con 0x564366e27bd0 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.084+0000 7fb9d4cc8640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb9b8036110 0x7fb9b80385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.084+0000 7fb9d4cc8640 1 -- 172.21.15.121:0/691100176 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fb9d804b7d0 con 0x564366e27bd0 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.084+0000 7fb9d6ccc640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb9b8036110 0x7fb9b80385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.084+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.084+0000 7fb9e3737800 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564366e3a3d0 0x564366e3c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.084+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e3cfe0 con 0x564366e3a3d0 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.084+0000 7fb9d6ccc640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb9b8036110 0x7fb9b80385d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8000f60 tx=0x7fb9c8001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9dfcce640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564366e3a3d0 0x564366e3c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9dfcce640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564366e3a3d0 0x564366e3c890 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9e3737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9e3737800 20 realm 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e3d3f0 con 0x564366e3a3d0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9e3737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9e3737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e3dc70 con 0x564366e3a3d0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9e3737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.085+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e3dfd0 con 0x564366e3a3d0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.086+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.086+0000 7fb9e3737800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.086+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.086+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e3e7d0 con 0x564366e3a3d0 2023-12-07T21:09:15.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.086+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.086+0000 7fb9e3737800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.086+0000 7fb9e3737800 20 searching for the correct realm 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.086+0000 7fb9e3737800 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x564366e404f0 0x564366e42980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.086+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e404f0 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.086+0000 7fb9df4cd640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x564366e404f0 0x564366e42980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.086+0000 7fb9df4cd640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x564366e404f0 0x564366e42980 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.087+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.087+0000 7fb9df4cd640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb9d0072020 0x7fb9d0068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.087+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9d0072020 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.087+0000 7fb9d6ccc640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb9d0072020 0x7fb9d0068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.087+0000 7fb9d6ccc640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb9d0072020 0x7fb9d0068a50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.087+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c8006070 con 0x7fb9d0072020 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.087+0000 7fb9d6ccc640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb9c800d3d0 0x7fb9c800d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.087+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9c800d3d0 2023-12-07T21:09:15.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.087+0000 7fb9dfcce640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb9c800d3d0 0x7fb9c800d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.088+0000 7fb9dfcce640 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb9c800d3d0 0x7fb9c800d830 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.088+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.088+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e3a3d0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.088+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.088+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e3a3d0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.088+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.088+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9c800d3d0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.089+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.089+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9c800d3d0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.089+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.089+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9d0072020 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.089+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c8006070 con 0x7fb9d0072020 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.089+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e404f0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.089+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.089+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e3a3d0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.090+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.090+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9c800d3d0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.090+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.090+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e3a3d0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.090+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.090+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9d0072020 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.090+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb9c8006070 con 0x7fb9d0072020 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.090+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e404f0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.091+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.091+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e404f0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.091+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.091+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9c800d3d0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.091+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.091+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e404f0 2023-12-07T21:09:15.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.091+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.091+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e404f0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.091+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.091+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e3a3d0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.092+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.092+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e3a3d0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.092+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.092+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9c800d3d0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.092+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.092+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e404f0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.092+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.092+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9d0072020 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.093+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c8006070 con 0x7fb9d0072020 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.093+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e3a3d0 2023-12-07T21:09:15.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.093+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.093+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9c800d3d0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.093+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.093+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e404f0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.093+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.093+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9c800d3d0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.094+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.094+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9d0072020 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.094+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c8006070 con 0x7fb9d0072020 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.094+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e404f0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.094+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.094+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x7fb9c800d3d0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e43050 con 0x564366e3a3d0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb9d8053080 con 0x7fb9d0072020 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9c8006070 con 0x7fb9d0072020 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9e3737800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9e3737800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9e3737800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9e3737800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9e3737800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9e3737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e3f130 con 0x564366e3a3d0 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9e3737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.095+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e3f980 con 0x564366e3a3d0 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e3f980 con 0x564366e404f0 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 20 zone default found 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 4 Realm: () 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 20 zonegroup default 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e434b0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.096+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e45290 con 0x564366e404f0 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.097+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.097+0000 7fb9e3737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.097+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.097+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e455f0 con 0x564366e404f0 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.097+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.097+0000 7fb9e3737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.097+0000 7fb9e3737800 20 started sync module instance, tier type = 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.097+0000 7fb9e3737800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.097+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e44b70 con 0x7fb9d0072020 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.098+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c8006070 con 0x7fb9d0072020 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.098+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94847486611280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e459c0 con 0x7fb9d0072020 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.098+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e461c0 con 0x564366e3a3d0 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.099+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.099+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94847489039648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e465d0 con 0x564366e3a3d0 2023-12-07T21:09:15.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.099+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94847486611280] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c8006070 con 0x7fb9d0072020 2023-12-07T21:09:15.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.099+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e446d0 con 0x564366e404f0 2023-12-07T21:09:15.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.100+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94847489039648] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.100+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.100+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94847489040688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e46540 con 0x564366e404f0 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.100+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e475f0 con 0x7fb9d0072020 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.101+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c8026040 con 0x7fb9d0072020 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.101+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94847489040688] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.101+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94847489046992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e48280 con 0x7fb9d0072020 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.101+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e46aa0 con 0x564366e3a3d0 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.102+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.102+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94847489050448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e49000 con 0x564366e3a3d0 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.102+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e49860 con 0x7fb9c800d3d0 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.102+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94847489046992] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c8026040 con 0x7fb9d0072020 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.103+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94847489050448] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.103+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.103+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94847489048032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e49000 con 0x7fb9c800d3d0 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.103+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4a0b0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.104+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94847489048032] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.104+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.104+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94847489051488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e48f70 con 0x7fb9c800d3d0 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.104+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4a420 con 0x7fb9c800d3d0 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.105+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94847489051488] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.105+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.105+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94847489055088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4a420 con 0x7fb9c800d3d0 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.105+0000 7fb9e3737800 20 add_watcher() i=0 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.105+0000 7fb9e3737800 20 add_watcher() i=1 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.105+0000 7fb9e3737800 20 add_watcher() i=2 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.105+0000 7fb9e3737800 20 add_watcher() i=3 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.105+0000 7fb9e3737800 20 add_watcher() i=4 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.105+0000 7fb9e3737800 20 add_watcher() i=5 2023-12-07T21:09:15.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.105+0000 7fb9e3737800 20 add_watcher() i=6 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.106+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94847489055088] v31'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.106+0000 7fb9e3737800 20 add_watcher() i=7 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.106+0000 7fb9e3737800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.106+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4d8f0 con 0x564366e3a3d0 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.107+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.107+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94847489057264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4acb0 con 0x564366e3a3d0 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94847489057264] v31'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb9a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb9e3737800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb9e3737800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb9e3737800 5 note: GC not initialized 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb91ffff640 20 reqs_thread_entry: start 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb9e3737800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb9e3737800 20 Filter name: none 2023-12-07T21:09:15.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb91dffb640 20 reqs_thread_entry: start 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb9e3737800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.108+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e80880 con 0x564366e3a3d0 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 20 rados_obj.operate() r=0 bl.length=513 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e81140 con 0x7fb9d0072020 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7fb9c8026040 con 0x7fb9d0072020 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2023-12-07T21:09:15.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.109+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~621 in=621b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e86ea0 con 0x564366e3a3d0 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.110+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~621] v31'8 uv8 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.110+0000 7fb9e3737800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.110+0000 7fb9e3737800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.110+0000 7fb9e3737800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.110+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94847489304864 in=809b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e829d0 con 0x564366e3a3d0 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.111+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94847489050448 notify 133143986183 ret 0) v3 ==== 839+0+0 (crc 0 0 0) 0x564366e2f620 con 0x564366e3a3d0 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.111+0000 7fb9d64cb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94847489050448 notifier 4360 bl.length()=797 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.111+0000 7fb9d64cb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.111+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(65 notify.4 [notify cookie 94847489304864 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.111+0000 7fb9d64cb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.111+0000 7fb9d64cb640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb9b40042a0 con 0x564366e3a3d0 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.111+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.111+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== watch-notify(notify_complete (2) cookie 94847489304864 notify 133143986183 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564366e2f1c0 con 0x564366e3a3d0 2023-12-07T21:09:15.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.111+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e819c0 con 0x7fb9d0072020 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.112+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7fb9c8026040 con 0x7fb9d0072020 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9e3737800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9e3737800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9e3737800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94847489304864 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e83dd0 con 0x7fb9d0072020 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== watch-notify(notify (1) cookie 94847486611280 notify 133143986179 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x564366cb9740 con 0x7fb9d0072020 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9d64cb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94847486611280 notifier 4360 bl.length()=166 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9d64cb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9d64cb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(68 notify.0 [notify cookie 94847489304864 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb9c8026040 con 0x7fb9d0072020 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9d64cb640 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb9b40042a0 con 0x7fb9d0072020 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c8026040 con 0x7fb9d0072020 2023-12-07T21:09:15.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.113+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== watch-notify(notify_complete (2) cookie 94847489304864 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fb9c800e770 con 0x7fb9d0072020 2023-12-07T21:09:15.115 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.114+0000 7fb9a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.114+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94847489057264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4d000 con 0x564366e3a3d0 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.115+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94847489057264] v31'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.115+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94847486611280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4d000 con 0x7fb9d0072020 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.116+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94847486611280] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c8026040 con 0x7fb9d0072020 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.116+0000 7fb9e3737800 20 remove_watcher() i=0 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.116+0000 7fb9e3737800 2 removed watcher, disabling cache 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.116+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94847489039648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4d000 con 0x564366e3a3d0 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.117+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94847489039648] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.117+0000 7fb9e3737800 20 remove_watcher() i=1 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.117+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94847489040688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4d000 con 0x564366e404f0 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.119+0000 7fb9df4cd640 1 -- 172.21.15.121:0/691100176 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94847489040688] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d004cdb0 con 0x564366e404f0 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.119+0000 7fb9e3737800 20 remove_watcher() i=2 2023-12-07T21:09:15.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.119+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94847489046992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4d360 con 0x7fb9d0072020 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.119+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94847489046992] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9c8026040 con 0x7fb9d0072020 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.120+0000 7fb9e3737800 20 remove_watcher() i=3 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.120+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94847489050448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4d360 con 0x564366e3a3d0 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.121+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94847489050448] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x564366e3a3d0 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.121+0000 7fb9e3737800 20 remove_watcher() i=4 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.121+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94847489048032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e4d360 con 0x7fb9c800d3d0 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.122+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94847489048032] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.122+0000 7fb9e3737800 20 remove_watcher() i=5 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.122+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94847489051488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e47de0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.123+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94847489051488] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.123+0000 7fb9e3737800 20 remove_watcher() i=6 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.123+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94847489055088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564366e47de0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9dfcce640 1 -- 172.21.15.121:0/691100176 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94847489055088] v31'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9d802e9d0 con 0x7fb9c800d3d0 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 20 remove_watcher() i=7 2023-12-07T21:09:15.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb9c800d3d0 msgr2=0x7fb9c800d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb9c800d3d0 0x7fb9c800d830 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564366e3a3d0 msgr2=0x564366e3c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564366e3a3d0 0x564366e3c890 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb9d0072020 msgr2=0x7fb9d0068a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb9d0072020 0x7fb9d0068a50 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x564366e404f0 msgr2=0x564366e42980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x564366e404f0 0x564366e42980 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb9b8036110 msgr2=0x7fb9b80385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb9b8036110 0x7fb9b80385d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8000f60 tx=0x7fb9c8001230 comp rx=0 tx=0).stop 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 msgr2=0x564366e2ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e2ec80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800a930 tx=0x7fb9d8003370 comp rx=0 tx=0).stop 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9d6ccc640 1 -- 172.21.15.121:0/691100176 reap_dead start 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 shutdown_connections 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 --2- 172.21.15.121:0/691100176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366e27bd0 0x564366e2ec80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 >> 172.21.15.121:0/691100176 conn(0x564366d6cff0 msgr2=0x564366e21db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 shutdown_connections 2023-12-07T21:09:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/691100176 wait complete. 2023-12-07T21:09:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/2290023781 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb9c0036110 msgr2=0x7fb9c00385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 --2- 172.21.15.121:0/2290023781 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb9c0036110 0x7fb9c00385d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0060f90 tx=0x7fb9d0007a10 comp rx=0 tx=0).stop 2023-12-07T21:09:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/2290023781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 msgr2=0x564366e1ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 --2- 172.21.15.121:0/2290023781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e1ba20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb9d001f4b0 tx=0x7fb9d0002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/2290023781 shutdown_connections 2023-12-07T21:09:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 --2- 172.21.15.121:0/2290023781 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb9c0036110 0x7fb9c00385d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 --2- 172.21.15.121:0/2290023781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564366d6c690 0x564366e1ba20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/2290023781 >> 172.21.15.121:0/2290023781 conn(0x564366d66f00 msgr2=0x564366e0ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/2290023781 shutdown_connections 2023-12-07T21:09:15.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.124+0000 7fb9e3737800 1 -- 172.21.15.121:0/2290023781 wait complete. 2023-12-07T21:09:15.123 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:15.123 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-12-07T21:09:15.123 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-12-07T21:09:15.123 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-12-07T21:09:15.165 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:15.166 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:15.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.173+0000 7f59c1522800 1 Processor -- start 2023-12-07T21:09:15.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.173+0000 7f59c1522800 1 -- start start 2023-12-07T21:09:15.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.173+0000 7f59c1522800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5599b7b3f100 0x5599b7b3f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.173+0000 7f59c1522800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5599b7a8c7a0 con 0x5599b7b40310 2023-12-07T21:09:15.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.173+0000 7f59c1522800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5599b7a55880 con 0x5599b7b3f100 2023-12-07T21:09:15.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.174+0000 7f59bd1a6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5599b7b3f100 0x5599b7b3f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.174+0000 7f59b49a5640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5599b7b40310 0x5599b7b40790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37832/0 (socket says 172.21.15.121:37832) 2023-12-07T21:09:15.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.174+0000 7f59b49a5640 1 -- 172.21.15.121:0/4276914620 learned_addr learned my addr 172.21.15.121:0/4276914620 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:15.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.174+0000 7f59bd1a6640 1 -- 172.21.15.121:0/4276914620 >> v1:172.21.15.89:6789/0 conn(0x5599b7b40310 legacy=0x5599b7b40790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.174+0000 7f59bd1a6640 1 -- 172.21.15.121:0/4276914620 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599b7b3fbf0 con 0x5599b7b3f100 2023-12-07T21:09:15.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.176+0000 7f59bd1a6640 1 --2- 172.21.15.121:0/4276914620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7b3f520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f59b000a470 tx=0x7f59b001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169cf4c8daa54b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.176+0000 7f59bc9a5640 1 -- 172.21.15.121:0/4276914620 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b0052570 con 0x5599b7b3f100 2023-12-07T21:09:15.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.176+0000 7f59bc9a5640 1 -- 172.21.15.121:0/4276914620 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b00526d0 con 0x5599b7b3f100 2023-12-07T21:09:15.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.176+0000 7f59bc9a5640 1 -- 172.21.15.121:0/4276914620 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b0052990 con 0x5599b7b3f100 2023-12-07T21:09:15.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.176+0000 7f59c1522800 1 -- 172.21.15.121:0/4276914620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 msgr2=0x5599b7b3f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.176+0000 7f59c1522800 1 --2- 172.21.15.121:0/4276914620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7b3f520 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f59b000a470 tx=0x7f59b001cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:15.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.176+0000 7f59c1522800 1 -- 172.21.15.121:0/4276914620 shutdown_connections 2023-12-07T21:09:15.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.176+0000 7f59c1522800 1 --2- 172.21.15.121:0/4276914620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7b3f520 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.176+0000 7f59c1522800 1 -- 172.21.15.121:0/4276914620 >> 172.21.15.121:0/4276914620 conn(0x5599b7b3a880 msgr2=0x5599b7b3cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.176+0000 7f59c1522800 1 -- 172.21.15.121:0/4276914620 shutdown_connections 2023-12-07T21:09:15.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.176+0000 7f59c1522800 1 -- 172.21.15.121:0/4276914620 wait complete. 2023-12-07T21:09:15.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.177+0000 7f59c1522800 1 Processor -- start 2023-12-07T21:09:15.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.177+0000 7f59c1522800 1 -- start start 2023-12-07T21:09:15.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.177+0000 7f59c1522800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7ab41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.177+0000 7f59c1522800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599b7a52db0 con 0x5599b7b3f100 2023-12-07T21:09:15.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.177+0000 7f59bd1a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7ab41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.178+0000 7f59bd1a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7ab41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53716/0 (socket says 172.21.15.121:53716) 2023-12-07T21:09:15.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.178+0000 7f59bd1a6640 1 -- 172.21.15.121:0/764639354 learned_addr learned my addr 172.21.15.121:0/764639354 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.178+0000 7f59bd1a6640 1 -- 172.21.15.121:0/764639354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0005d20 con 0x5599b7b3f100 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.178+0000 7f59bd1a6640 1 --2- 172.21.15.121:0/764639354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7ab41b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f59b0055040 tx=0x7f59b004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb6bc7939482bf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.178+0000 7f59b7fff640 1 -- 172.21.15.121:0/764639354 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b000a180 con 0x5599b7b3f100 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.178+0000 7f59b7fff640 1 -- 172.21.15.121:0/764639354 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b000a2e0 con 0x5599b7b3f100 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.178+0000 7f59b7fff640 1 -- 172.21.15.121:0/764639354 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b00529b0 con 0x5599b7b3f100 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.178+0000 7f59c1522800 1 -- 172.21.15.121:0/764639354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 msgr2=0x5599b7ab41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.178+0000 7f59c1522800 1 --2- 172.21.15.121:0/764639354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7ab41b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f59b0055040 tx=0x7f59b004c000 comp rx=0 tx=0).stop 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59c1522800 1 -- 172.21.15.121:0/764639354 shutdown_connections 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59c1522800 1 --2- 172.21.15.121:0/764639354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7ab41b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59c1522800 1 -- 172.21.15.121:0/764639354 >> 172.21.15.121:0/764639354 conn(0x5599b7b3a880 msgr2=0x5599b7bdfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59c1522800 1 -- 172.21.15.121:0/764639354 shutdown_connections 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59c1522800 1 -- 172.21.15.121:0/764639354 wait complete. 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59c1522800 1 Processor -- start 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59c1522800 1 -- start start 2023-12-07T21:09:15.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59c1522800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7bee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59c1522800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599b7a4e6a0 con 0x5599b7b3f100 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59bd1a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7bee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59bd1a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7bee7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53720/0 (socket says 172.21.15.121:53720) 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.179+0000 7f59bd1a6640 1 -- 172.21.15.121:0/3621874519 learned_addr learned my addr 172.21.15.121:0/3621874519 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.180+0000 7f59bd1a6640 1 -- 172.21.15.121:0/3621874519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b004e070 con 0x5599b7b3f100 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.180+0000 7f59bd1a6640 1 --2- 172.21.15.121:0/3621874519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7bee7c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f59b005e040 tx=0x7f59b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.180+0000 7f59b6ffd640 1 -- 172.21.15.121:0/3621874519 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b006a070 con 0x5599b7b3f100 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.180+0000 7f59b6ffd640 1 -- 172.21.15.121:0/3621874519 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b0052d90 con 0x5599b7b3f100 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.180+0000 7f59b6ffd640 1 -- 172.21.15.121:0/3621874519 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b005c540 con 0x5599b7b3f100 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.180+0000 7f59c1522800 1 -- 172.21.15.121:0/3621874519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599b7beed00 con 0x5599b7b3f100 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.180+0000 7f59c1522800 1 -- 172.21.15.121:0/3621874519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599b7bef240 con 0x5599b7b3f100 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.180+0000 7f59c1522800 1 Processor -- start 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.180+0000 7f59c1522800 1 -- start start 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59c1522800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 0x5599b7bfae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59c1522800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599b79e8890 con 0x5599b7bfaa30 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59b6ffd640 1 -- 172.21.15.121:0/3621874519 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f59b0059030 con 0x5599b7b3f100 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59bd9a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 0x5599b7bfae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59bd9a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 0x5599b7bfae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53722/0 (socket says 172.21.15.121:53722) 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59bd9a7640 1 -- 172.21.15.121:0/1218304952 learned_addr learned my addr 172.21.15.121:0/1218304952 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59b6ffd640 1 --2- 172.21.15.121:0/3621874519 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59a0036110 0x7f59a00385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59b6ffd640 1 -- 172.21.15.121:0/3621874519 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f59b008c8b0 con 0x5599b7b3f100 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59bd1a6640 1 --2- 172.21.15.121:0/3621874519 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59a0036110 0x7f59a00385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59bd9a7640 1 -- 172.21.15.121:0/1218304952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599b7bfb390 con 0x5599b7bfaa30 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59bd9a7640 1 --2- 172.21.15.121:0/1218304952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 0x5599b7bfae50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f59b800a430 tx=0x7f59b800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0b4159a7b45ea6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f599ffff640 1 -- 172.21.15.121:0/1218304952 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b8001650 con 0x5599b7bfaa30 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f599ffff640 1 -- 172.21.15.121:0/1218304952 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b80017d0 con 0x5599b7bfaa30 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f599ffff640 1 -- 172.21.15.121:0/1218304952 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b8001ab0 con 0x5599b7bfaa30 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.181+0000 7f59bd1a6640 1 --2- 172.21.15.121:0/3621874519 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59a0036110 0x7f59a00385d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59b00529a0 tx=0x7f59b007a040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59c1522800 1 -- 172.21.15.121:0/1218304952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 msgr2=0x5599b7bfae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59c1522800 1 --2- 172.21.15.121:0/1218304952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 0x5599b7bfae50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f59b800a430 tx=0x7f59b800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59c1522800 1 -- 172.21.15.121:0/1218304952 shutdown_connections 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59c1522800 1 --2- 172.21.15.121:0/1218304952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 0x5599b7bfae50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59c1522800 1 -- 172.21.15.121:0/1218304952 >> 172.21.15.121:0/1218304952 conn(0x5599b7b40310 msgr2=0x5599b7bf5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59c1522800 1 -- 172.21.15.121:0/1218304952 shutdown_connections 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59c1522800 1 -- 172.21.15.121:0/1218304952 wait complete. 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59c1522800 1 Processor -- start 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59c1522800 1 -- start start 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59c1522800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 0x5599b7c01850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59c1522800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599b79e8530 con 0x5599b7bfaa30 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59bd9a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 0x5599b7c01850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59bd9a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 0x5599b7c01850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53728/0 (socket says 172.21.15.121:53728) 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.182+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 learned_addr learned my addr 172.21.15.121:0/2693229160 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.183+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b800a0e0 con 0x5599b7bfaa30 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.183+0000 7f59bd9a7640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 0x5599b7c01850 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f59b800a930 tx=0x7f59b8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.183+0000 7f599e7fc640 1 -- 172.21.15.121:0/2693229160 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b8010900 con 0x5599b7bfaa30 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.183+0000 7f599e7fc640 1 -- 172.21.15.121:0/2693229160 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8010a60 con 0x5599b7bfaa30 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.183+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599b7c01d90 con 0x5599b7bfaa30 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.183+0000 7f599e7fc640 1 -- 172.21.15.121:0/2693229160 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59b8010d20 con 0x5599b7bfaa30 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.183+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599b7c021f0 con 0x5599b7bfaa30 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.184+0000 7f599e7fc640 1 -- 172.21.15.121:0/2693229160 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f59b8017030 con 0x5599b7bfaa30 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.184+0000 7f599e7fc640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5998036110 0x7f59980385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.184+0000 7f599e7fc640 1 -- 172.21.15.121:0/2693229160 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f59b804b890 con 0x5599b7bfaa30 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.184+0000 7f59b49a5640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5998036110 0x7f59980385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.184+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.184+0000 7f59c1522800 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5599b7c0cf70 0x5599b7c0f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.184+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c0fb80 con 0x5599b7c0cf70 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.184+0000 7f59bd9a7640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5599b7c0cf70 0x5599b7c0f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.184+0000 7f59b49a5640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5998036110 0x7f59980385d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f59a8000f60 tx=0x7f59a8001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59bd9a7640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5599b7c0cf70 0x5599b7c0f430 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59c1522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59c1522800 20 realm 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c0ff70 con 0x5599b7c0cf70 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59c1522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59c1522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c107f0 con 0x5599b7c0cf70 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59c1522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.185+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c10b50 con 0x5599b7c0cf70 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.186+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.186+0000 7f59c1522800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.186+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.186+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c10450 con 0x5599b7c0cf70 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.186+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.186+0000 7f59c1522800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.186+0000 7f59c1522800 20 searching for the correct realm 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.186+0000 7f59c1522800 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5599b7c12d60 0x5599b7c15150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.186+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c12d60 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.186+0000 7f59bd1a6640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5599b7c12d60 0x5599b7c15150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.186+0000 7f59bd1a6640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5599b7c12d60 0x5599b7c15150 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.187+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.187+0000 7f59bd1a6640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f59b0078060 0x7f59b008beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.187+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59b0078060 2023-12-07T21:09:15.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.187+0000 7f59b49a5640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f59b0078060 0x7f59b008beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.187+0000 7f59b49a5640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f59b0078060 0x7f59b008beb0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.187+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59a8006070 con 0x7f59b0078060 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.187+0000 7f59b49a5640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f59a800d3d0 0x7f59a800d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.187+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59a800d3d0 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.188+0000 7f59bd9a7640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f59a800d3d0 0x7f59a800d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.188+0000 7f59bd9a7640 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f59a800d3d0 0x7f59a800d830 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.188+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.188+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c0cf70 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.188+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.188+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c0cf70 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.188+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.189+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59a800d3d0 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.189+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.196 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.189+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59a800d3d0 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.189+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.189+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59b0078060 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.189+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59a8006070 con 0x7f59b0078060 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.189+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c12d60 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.189+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.189+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c0cf70 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.190+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.190+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59a800d3d0 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.190+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.190+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c0cf70 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.190+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.190+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59b0078060 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.190+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f59a8006070 con 0x7f59b0078060 2023-12-07T21:09:15.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.190+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c12d60 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.191+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.191+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c12d60 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.191+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.191+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59a800d3d0 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.191+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.191+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c12d60 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.191+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.191+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c12d60 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.191+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.191+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c0cf70 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.192+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.192+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c0cf70 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.192+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.192+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59a800d3d0 2023-12-07T21:09:15.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.192+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.192+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c12d60 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.192+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.192+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59b0078060 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.193+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59a8006070 con 0x7f59b0078060 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.193+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c0cf70 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.193+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.193+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59a800d3d0 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.193+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.193+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c12d60 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.193+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.193+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59a800d3d0 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.194+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.194+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59b0078060 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.194+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59a8006070 con 0x7f59b0078060 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.194+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c12d60 2023-12-07T21:09:15.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.194+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.194+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59a800d3d0 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.194+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.194+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x5599b7c0cf70 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.194+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c156e0 con 0x7f59b0078060 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59a8006070 con 0x7f59b0078060 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c119e0 con 0x5599b7c0cf70 2023-12-07T21:09:15.200 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c11660 con 0x5599b7c0cf70 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c12370 con 0x5599b7c12d60 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.195+0000 7f59c1522800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 20 zone default found 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 4 Realm: () 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:15.201 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 20 zonegroup default 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c15fc0 con 0x7f59a800d3d0 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c17c00 con 0x5599b7c12d60 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c18050 con 0x5599b7c12d60 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 20 started sync module instance, tier type = 2023-12-07T21:09:15.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.196+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c16f30 con 0x7f59b0078060 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.197+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59a8006070 con 0x7f59b0078060 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.197+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94118698843984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c172e0 con 0x7f59b0078060 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.198+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c18910 con 0x5599b7c0cf70 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.198+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94118698843984] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59a8006070 con 0x7f59b0078060 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.199+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.199+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94118701263504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c18910 con 0x5599b7c0cf70 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.199+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c193a0 con 0x5599b7c12d60 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.200+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94118701263504] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.200+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.200+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94118701270128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c18880 con 0x5599b7c12d60 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.200+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1a0d0 con 0x7f59b0078060 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.201+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94118701270128] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.201+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59a8026040 con 0x7f59b0078060 2023-12-07T21:09:15.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.201+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94118701275232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1a920 con 0x7f59b0078060 2023-12-07T21:09:15.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.201+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1b120 con 0x5599b7c0cf70 2023-12-07T21:09:15.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.202+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.202+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94118701280688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1b970 con 0x5599b7c0cf70 2023-12-07T21:09:15.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.202+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1c320 con 0x7f59a800d3d0 2023-12-07T21:09:15.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.203+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94118701275232] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59a8026040 con 0x7f59b0078060 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.203+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94118701280688] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.203+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.204+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94118701278336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1b480 con 0x7f59a800d3d0 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.204+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1cb70 con 0x7f59a800d3d0 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.204+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94118701278336] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.205+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.205+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94118701284928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1b480 con 0x7f59a800d3d0 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.205+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1d010 con 0x7f59a800d3d0 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.206+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94118701284928] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.206+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.206+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94118701287040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1cf30 con 0x7f59a800d3d0 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.206+0000 7f59c1522800 20 add_watcher() i=0 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.206+0000 7f59c1522800 20 add_watcher() i=1 2023-12-07T21:09:15.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.206+0000 7f59c1522800 20 add_watcher() i=2 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.206+0000 7f59c1522800 20 add_watcher() i=3 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.206+0000 7f59c1522800 20 add_watcher() i=4 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.206+0000 7f59c1522800 20 add_watcher() i=5 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.206+0000 7f59c1522800 20 add_watcher() i=6 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.206+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94118701287040] v31'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.207+0000 7f59c1522800 20 add_watcher() i=7 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.207+0000 7f59c1522800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.207+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c203e0 con 0x5599b7c0cf70 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.207+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.207+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94118701288544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1d820 con 0x5599b7c0cf70 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.208+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94118701288544] v31'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.208+0000 7f5982fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.208+0000 7f59c1522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.208+0000 7f59c1522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:15.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.208+0000 7f59c1522800 5 note: GC not initialized 2023-12-07T21:09:15.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.208+0000 7f5981fe3640 20 reqs_thread_entry: start 2023-12-07T21:09:15.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.208+0000 7f59c1522800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:15.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.208+0000 7f59c1522800 20 Filter name: none 2023-12-07T21:09:15.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.208+0000 7f58f37fe640 20 reqs_thread_entry: start 2023-12-07T21:09:15.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.208+0000 7f59c1522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.208+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c52ed0 con 0x5599b7c0cf70 2023-12-07T21:09:15.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.209+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.209+0000 7f59c1522800 20 rados_obj.operate() r=0 bl.length=621 2023-12-07T21:09:15.209 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.210+0000 7f5982fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.210+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94118701288544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c51f50 con 0x5599b7c0cf70 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.211+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94118701288544] v31'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.211+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94118698843984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c51f50 con 0x7f59b0078060 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.212+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94118698843984] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59a8026040 con 0x7f59b0078060 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.212+0000 7f59c1522800 20 remove_watcher() i=0 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.212+0000 7f59c1522800 2 removed watcher, disabling cache 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.212+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94118701263504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c522b0 con 0x5599b7c0cf70 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.213+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94118701263504] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.213+0000 7f59c1522800 20 remove_watcher() i=1 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.213+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94118701270128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c522b0 con 0x5599b7c12d60 2023-12-07T21:09:15.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.214+0000 7f59bd1a6640 1 -- 172.21.15.121:0/2693229160 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94118701270128] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b0083070 con 0x5599b7c12d60 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.214+0000 7f59c1522800 20 remove_watcher() i=2 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.214+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94118701275232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1d380 con 0x7f59b0078060 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.215+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94118701275232] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59a8026040 con 0x7f59b0078060 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.215+0000 7f59c1522800 20 remove_watcher() i=3 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.215+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94118701280688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1d6e0 con 0x5599b7c0cf70 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.216+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94118701280688] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x5599b7c0cf70 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.216+0000 7f59c1522800 20 remove_watcher() i=4 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.216+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94118701278336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1d6e0 con 0x7f59a800d3d0 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.217+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94118701278336] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.217+0000 7f59c1522800 20 remove_watcher() i=5 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.217+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94118701284928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1a480 con 0x7f59a800d3d0 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.218+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94118701284928] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.218+0000 7f59c1522800 20 remove_watcher() i=6 2023-12-07T21:09:15.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.218+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94118701287040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5599b7c1a480 con 0x7f59a800d3d0 2023-12-07T21:09:15.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59bd9a7640 1 -- 172.21.15.121:0/2693229160 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94118701287040] v31'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59b802e9d0 con 0x7f59a800d3d0 2023-12-07T21:09:15.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 20 remove_watcher() i=7 2023-12-07T21:09:15.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f59a800d3d0 msgr2=0x7f59a800d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f59a800d3d0 0x7f59a800d830 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5599b7c0cf70 msgr2=0x5599b7c0f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5599b7c0cf70 0x5599b7c0f430 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f59b0078060 msgr2=0x7f59b008beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f59b0078060 0x7f59b008beb0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5599b7c12d60 msgr2=0x5599b7c15150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5599b7c12d60 0x5599b7c15150 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5998036110 msgr2=0x7f59980385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5998036110 0x7f59980385d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f59a8000f60 tx=0x7f59a8001230 comp rx=0 tx=0).stop 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 msgr2=0x5599b7c01850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 --2- 172.21.15.121:0/2693229160 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7bfaa30 0x5599b7c01850 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f59b800a930 tx=0x7f59b8003370 comp rx=0 tx=0).stop 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 reap_dead start 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59b49a5640 1 -- 172.21.15.121:0/2693229160 reap_dead start 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 shutdown_connections 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.219+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 >> 172.21.15.121:0/2693229160 conn(0x5599b7b40310 msgr2=0x5599b7bf4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 shutdown_connections 2023-12-07T21:09:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 -- 172.21.15.121:0/2693229160 wait complete. 2023-12-07T21:09:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 -- 172.21.15.121:0/3621874519 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59a0036110 msgr2=0x7f59a00385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 --2- 172.21.15.121:0/3621874519 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59a0036110 0x7f59a00385d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59b00529a0 tx=0x7f59b007a040 comp rx=0 tx=0).stop 2023-12-07T21:09:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 -- 172.21.15.121:0/3621874519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 msgr2=0x5599b7bee7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 --2- 172.21.15.121:0/3621874519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7bee7c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f59b005e040 tx=0x7f59b0002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 -- 172.21.15.121:0/3621874519 shutdown_connections 2023-12-07T21:09:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 --2- 172.21.15.121:0/3621874519 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59a0036110 0x7f59a00385d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 --2- 172.21.15.121:0/3621874519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5599b7b3f100 0x5599b7bee7c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 -- 172.21.15.121:0/3621874519 >> 172.21.15.121:0/3621874519 conn(0x5599b7b3a880 msgr2=0x5599b7be2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 -- 172.21.15.121:0/3621874519 shutdown_connections 2023-12-07T21:09:15.217 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.220+0000 7f59c1522800 1 -- 172.21.15.121:0/3621874519 wait complete. 2023-12-07T21:09:15.218 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:15.218 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2023-12-07T21:09:15.218 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2023-12-07T21:09:15.218 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2023-12-07T21:09:15.303 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:15.303 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:15.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.311+0000 7fc499128800 1 Processor -- start 2023-12-07T21:09:15.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.311+0000 7fc499128800 1 -- start start 2023-12-07T21:09:15.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.311+0000 7fc499128800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d543174920 0x55d543208130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.311+0000 7fc499128800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d54314b740 con 0x55d543175cb0 2023-12-07T21:09:15.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.311+0000 7fc499128800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d543114880 con 0x55d543174920 2023-12-07T21:09:15.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.311+0000 7fc48c660640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d543174920 0x55d543208130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.311+0000 7fc494e61640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55d543175cb0 0x55d543174210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37842/0 (socket says 172.21.15.121:37842) 2023-12-07T21:09:15.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.311+0000 7fc494e61640 1 -- 172.21.15.121:0/2641863936 learned_addr learned my addr 172.21.15.121:0/2641863936 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:15.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.311+0000 7fc48c660640 1 -- 172.21.15.121:0/2641863936 >> v1:172.21.15.89:6789/0 conn(0x55d543175cb0 legacy=0x55d543174210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.311+0000 7fc48c660640 1 -- 172.21.15.121:0/2641863936 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d543174e60 con 0x55d543174920 2023-12-07T21:09:15.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.311+0000 7fc48ffff640 1 -- 172.21.15.121:0/2641863936 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464711406 0 0) 0x55d54314b740 con 0x55d543175cb0 2023-12-07T21:09:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.313+0000 7fc48c660640 1 --2- 172.21.15.121:0/2641863936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d543208130 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00a470 tx=0x7fc47c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1f033b7da2291d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.314+0000 7fc48ffff640 1 -- 172.21.15.121:0/2641863936 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc47c04ad40 con 0x55d543174920 2023-12-07T21:09:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.314+0000 7fc48ffff640 1 -- 172.21.15.121:0/2641863936 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c052440 con 0x55d543174920 2023-12-07T21:09:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.314+0000 7fc48ffff640 1 -- 172.21.15.121:0/2641863936 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc47c04aea0 con 0x55d543174920 2023-12-07T21:09:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.314+0000 7fc499128800 1 -- 172.21.15.121:0/2641863936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 msgr2=0x55d543208130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.314+0000 7fc499128800 1 --2- 172.21.15.121:0/2641863936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d543208130 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00a470 tx=0x7fc47c01cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:15.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.314+0000 7fc499128800 1 -- 172.21.15.121:0/2641863936 shutdown_connections 2023-12-07T21:09:15.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.314+0000 7fc499128800 1 --2- 172.21.15.121:0/2641863936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d543208130 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.314+0000 7fc499128800 1 -- 172.21.15.121:0/2641863936 >> 172.21.15.121:0/2641863936 conn(0x55d5431fa990 msgr2=0x55d5431fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.314+0000 7fc499128800 1 -- 172.21.15.121:0/2641863936 shutdown_connections 2023-12-07T21:09:15.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.314+0000 7fc499128800 1 -- 172.21.15.121:0/2641863936 wait complete. 2023-12-07T21:09:15.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.315+0000 7fc499128800 1 Processor -- start 2023-12-07T21:09:15.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.315+0000 7fc499128800 1 -- start start 2023-12-07T21:09:15.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.315+0000 7fc499128800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.315+0000 7fc499128800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d543111db0 con 0x55d543174920 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.315+0000 7fc494e61640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.315+0000 7fc494e61640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432a5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53732/0 (socket says 172.21.15.121:53732) 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.315+0000 7fc494e61640 1 -- 172.21.15.121:0/526262556 learned_addr learned my addr 172.21.15.121:0/526262556 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.316+0000 7fc494e61640 1 -- 172.21.15.121:0/526262556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c005d20 con 0x55d543174920 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.316+0000 7fc494e61640 1 --2- 172.21.15.121:0/526262556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432a5ff0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc484001e00 tx=0x7fc48400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f110f3935edc6a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.316+0000 7fc48f7fe640 1 -- 172.21.15.121:0/526262556 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc48400e5a0 con 0x55d543174920 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.316+0000 7fc48f7fe640 1 -- 172.21.15.121:0/526262556 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48400e720 con 0x55d543174920 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.316+0000 7fc48f7fe640 1 -- 172.21.15.121:0/526262556 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc48400ea00 con 0x55d543174920 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.316+0000 7fc499128800 1 -- 172.21.15.121:0/526262556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 msgr2=0x55d5432a5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.316+0000 7fc499128800 1 --2- 172.21.15.121:0/526262556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432a5ff0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc484001e00 tx=0x7fc48400b780 comp rx=0 tx=0).stop 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.316+0000 7fc499128800 1 -- 172.21.15.121:0/526262556 shutdown_connections 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.316+0000 7fc499128800 1 --2- 172.21.15.121:0/526262556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432a5ff0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.316+0000 7fc499128800 1 -- 172.21.15.121:0/526262556 >> 172.21.15.121:0/526262556 conn(0x55d5431fa990 msgr2=0x55d5432a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.317+0000 7fc499128800 1 -- 172.21.15.121:0/526262556 shutdown_connections 2023-12-07T21:09:15.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.317+0000 7fc499128800 1 -- 172.21.15.121:0/526262556 wait complete. 2023-12-07T21:09:15.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.317+0000 7fc499128800 1 Processor -- start 2023-12-07T21:09:15.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.317+0000 7fc499128800 1 -- start start 2023-12-07T21:09:15.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.317+0000 7fc499128800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.317+0000 7fc499128800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d54310d6a0 con 0x55d543174920 2023-12-07T21:09:15.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.317+0000 7fc494e61640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.317+0000 7fc494e61640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53736/0 (socket says 172.21.15.121:53736) 2023-12-07T21:09:15.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.317+0000 7fc494e61640 1 -- 172.21.15.121:0/3022658629 learned_addr learned my addr 172.21.15.121:0/3022658629 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.317+0000 7fc494e61640 1 -- 172.21.15.121:0/3022658629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484001ab0 con 0x55d543174920 2023-12-07T21:09:15.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.318+0000 7fc494e61640 1 --2- 172.21.15.121:0/3022658629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432ad550 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc484001ed0 tx=0x7fc484000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.318+0000 7fc48e7fc640 1 -- 172.21.15.121:0/3022658629 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc48401f070 con 0x55d543174920 2023-12-07T21:09:15.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.318+0000 7fc499128800 1 -- 172.21.15.121:0/3022658629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5432ada90 con 0x55d543174920 2023-12-07T21:09:15.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.318+0000 7fc48e7fc640 1 -- 172.21.15.121:0/3022658629 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc484018830 con 0x55d543174920 2023-12-07T21:09:15.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.318+0000 7fc48e7fc640 1 -- 172.21.15.121:0/3022658629 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc484018ad0 con 0x55d543174920 2023-12-07T21:09:15.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.318+0000 7fc499128800 1 -- 172.21.15.121:0/3022658629 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5432adf70 con 0x55d543174920 2023-12-07T21:09:15.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.318+0000 7fc499128800 1 Processor -- start 2023-12-07T21:09:15.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.318+0000 7fc499128800 1 -- start start 2023-12-07T21:09:15.322 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc499128800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc499128800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5430a7890 con 0x55d5432b9650 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc48e7fc640 1 -- 172.21.15.121:0/3022658629 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc484018c30 con 0x55d543174920 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc495662640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc48e7fc640 1 --2- 172.21.15.121:0/3022658629 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4740360c0 0x7fc474038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc495662640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432b9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53742/0 (socket says 172.21.15.121:53742) 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc495662640 1 -- 172.21.15.121:0/4213159241 learned_addr learned my addr 172.21.15.121:0/4213159241 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc48e7fc640 1 -- 172.21.15.121:0/3022658629 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc48404bcc0 con 0x55d543174920 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc494e61640 1 --2- 172.21.15.121:0/3022658629 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4740360c0 0x7fc474038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc495662640 1 -- 172.21.15.121:0/4213159241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5432b9fb0 con 0x55d5432b9650 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc495662640 1 --2- 172.21.15.121:0/4213159241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432b9a70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc49000a430 tx=0x7fc49000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4848ae5a166f0e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc494e61640 1 --2- 172.21.15.121:0/3022658629 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4740360c0 0x7fc474038580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc48400e6c0 tx=0x7fc484018ee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc48be5f640 1 -- 172.21.15.121:0/4213159241 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc490001650 con 0x55d5432b9650 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc48be5f640 1 -- 172.21.15.121:0/4213159241 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4900017d0 con 0x55d5432b9650 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.319+0000 7fc48be5f640 1 -- 172.21.15.121:0/4213159241 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc490001ab0 con 0x55d5432b9650 2023-12-07T21:09:15.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc499128800 1 -- 172.21.15.121:0/4213159241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 msgr2=0x55d5432b9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc499128800 1 --2- 172.21.15.121:0/4213159241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432b9a70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc49000a430 tx=0x7fc49000a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc499128800 1 -- 172.21.15.121:0/4213159241 shutdown_connections 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc499128800 1 --2- 172.21.15.121:0/4213159241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432b9a70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc499128800 1 -- 172.21.15.121:0/4213159241 >> 172.21.15.121:0/4213159241 conn(0x55d543175cb0 msgr2=0x55d5432b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc499128800 1 -- 172.21.15.121:0/4213159241 shutdown_connections 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc499128800 1 -- 172.21.15.121:0/4213159241 wait complete. 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc499128800 1 Processor -- start 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc499128800 1 -- start start 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc499128800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc499128800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5430a7530 con 0x55d5432b9650 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc495662640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.320+0000 7fc495662640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432c06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53744/0 (socket says 172.21.15.121:53744) 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.321+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 learned_addr learned my addr 172.21.15.121:0/3465207784 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.321+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49000a0e0 con 0x55d5432b9650 2023-12-07T21:09:15.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.321+0000 7fc495662640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432c06e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc49000a3d0 tx=0x7fc490003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.321+0000 7fc48a65c640 1 -- 172.21.15.121:0/3465207784 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc490010900 con 0x55d5432b9650 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.321+0000 7fc48a65c640 1 -- 172.21.15.121:0/3465207784 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc490010a60 con 0x55d5432b9650 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.321+0000 7fc48a65c640 1 -- 172.21.15.121:0/3465207784 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc490010d40 con 0x55d5432b9650 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.321+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5432c0c20 con 0x55d5432b9650 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.321+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5432c1080 con 0x55d5432b9650 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.322+0000 7fc48a65c640 1 -- 172.21.15.121:0/3465207784 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc490017070 con 0x55d5432b9650 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.322+0000 7fc48a65c640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc46c036110 0x7fc46c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.322+0000 7fc48a65c640 1 -- 172.21.15.121:0/3465207784 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc49004b7e0 con 0x55d5432b9650 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.322+0000 7fc48c660640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc46c036110 0x7fc46c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.322+0000 7fc48c660640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc46c036110 0x7fc46c0385d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc47c054000 tx=0x7fc47c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc499128800 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d5432cbdd0 0x55d5432ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432ce9e0 con 0x55d5432cbdd0 2023-12-07T21:09:15.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc495662640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d5432cbdd0 0x55d5432ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc495662640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d5432cbdd0 0x55d5432ce290 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc499128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc499128800 20 realm 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432cedf0 con 0x55d5432cbdd0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc499128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc499128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.323+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432cf670 con 0x55d5432cbdd0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc499128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.326 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432cf9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc499128800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d01d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc499128800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc499128800 20 searching for the correct realm 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc499128800 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d5432d1ef0 0x55d5432d4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432d1ef0 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.324+0000 7fc494e61640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d5432d1ef0 0x55d5432d4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.325+0000 7fc494e61640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d5432d1ef0 0x55d5432d4360 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.325+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.325+0000 7fc494e61640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc484017050 0x7fc48400d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.325+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc484017050 2023-12-07T21:09:15.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.325+0000 7fc48c660640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc484017050 0x7fc48400d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.325+0000 7fc48c660640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc484017050 0x7fc48400d570 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.326+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc47c0525b0 con 0x7fc484017050 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.326+0000 7fc48c660640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc47c05c920 0x7fc47c009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.326+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc47c05c920 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.326+0000 7fc495662640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc47c05c920 0x7fc47c009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.326+0000 7fc495662640 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc47c05c920 0x7fc47c009410 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.326+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.326+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432cbdd0 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.327+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.327+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432cbdd0 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.327+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.327+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc47c05c920 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.327+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.327+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc47c05c920 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.327+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.327+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc484017050 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.328+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc47c0525b0 con 0x7fc484017050 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.328+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432d1ef0 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.328+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.328+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432cbdd0 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.328+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.328+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc47c05c920 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.328+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.328+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432cbdd0 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.328+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.328+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc484017050 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.329+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc47c0525b0 con 0x7fc484017050 2023-12-07T21:09:15.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.329+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432d1ef0 2023-12-07T21:09:15.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.329+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.329+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432d1ef0 2023-12-07T21:09:15.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.329+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.329+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc47c05c920 2023-12-07T21:09:15.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.330+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.330+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432d1ef0 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.330+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.330+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432d1ef0 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.330+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.330+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432cbdd0 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.330+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.330+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432cbdd0 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.331+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.331+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc47c05c920 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.331+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.331+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432d1ef0 2023-12-07T21:09:15.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.331+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.331+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc484017050 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.331+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc47c0525b0 con 0x7fc484017050 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.331+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432cbdd0 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.332+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.332+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc47c05c920 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.332+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.332+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432d1ef0 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.332+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.332+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc47c05c920 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.333+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.333+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc484017050 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.333+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc47c0525b0 con 0x7fc484017050 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.333+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432d1ef0 2023-12-07T21:09:15.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.333+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.333+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x7fc47c05c920 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.333+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.333+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4a30 con 0x55d5432cbdd0 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc490053080 con 0x7fc484017050 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc47c06f040 con 0x7fc484017050 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d0ad0 con 0x55d5432cbdd0 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d1320 con 0x55d5432cbdd0 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.334+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d1320 con 0x55d5432d1ef0 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 20 zone default found 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 4 Realm: () 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:15.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 20 zonegroup default 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d4e70 con 0x7fc47c05c920 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d6c00 con 0x55d5432d1ef0 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d6fb0 con 0x55d5432d1ef0 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.335+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.336+0000 7fc499128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.336+0000 7fc499128800 20 started sync module instance, tier type = 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.336+0000 7fc499128800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.336+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d64e0 con 0x7fc484017050 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.337+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc47c06f040 con 0x7fc484017050 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.337+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94374441021264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d6890 con 0x7fc484017050 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.337+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d78a0 con 0x55d5432cbdd0 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.338+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94374441021264] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc47c06f040 con 0x7fc484017050 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.338+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.338+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94374443442240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d78a0 con 0x55d5432cbdd0 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.338+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d8320 con 0x55d5432d1ef0 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.339+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94374443442240] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.339+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.339+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94374443447296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d7810 con 0x55d5432d1ef0 2023-12-07T21:09:15.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.339+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d9010 con 0x7fc484017050 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.340+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc47c06f040 con 0x7fc484017050 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.340+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94374443447296] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.340+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94374443455424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d9c70 con 0x7fc484017050 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.340+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432da140 con 0x55d5432cbdd0 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.341+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94374443455424] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc47c06f040 con 0x7fc484017050 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.341+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.341+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94374443456464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d87e0 con 0x55d5432cbdd0 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.341+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432dac90 con 0x7fc47c05c920 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.342+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94374443456464] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.342+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.342+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94374443458880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432dac90 con 0x7fc47c05c920 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.342+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432db560 con 0x7fc47c05c920 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.343+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.343+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94374443462720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432db9c0 con 0x7fc47c05c920 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.343+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432dc3b0 con 0x7fc47c05c920 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.343+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94374443458880] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.344+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.344+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94374443462720] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.344+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94374443466384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432da780 con 0x7fc47c05c920 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.344+0000 7fc499128800 20 add_watcher() i=0 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.344+0000 7fc499128800 20 add_watcher() i=1 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.344+0000 7fc499128800 20 add_watcher() i=2 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.344+0000 7fc499128800 20 add_watcher() i=3 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.344+0000 7fc499128800 20 add_watcher() i=4 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.344+0000 7fc499128800 20 add_watcher() i=5 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.344+0000 7fc499128800 20 add_watcher() i=6 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.345+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94374443466384] v31'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.345+0000 7fc499128800 20 add_watcher() i=7 2023-12-07T21:09:15.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.345+0000 7fc499128800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:15.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.345+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432df3a0 con 0x55d5432cbdd0 2023-12-07T21:09:15.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.345+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.345+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94374443463968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432dc810 con 0x55d5432cbdd0 2023-12-07T21:09:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.346+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94374443463968] v31'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.346+0000 7fc45b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.346+0000 7fc499128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.346+0000 7fc499128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.346+0000 7fc499128800 5 note: GC not initialized 2023-12-07T21:09:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc45a7dc640 20 reqs_thread_entry: start 2023-12-07T21:09:15.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc499128800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc499128800 20 Filter name: none 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc3cbfff640 20 reqs_thread_entry: start 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc499128800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc499128800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d543312200 con 0x55d5432cbdd0 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc499128800 20 rados_obj.operate() r=0 bl.length=621 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc499128800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc499128800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc499128800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.347+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~539 in=539b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d543318530 con 0x55d5432cbdd0 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.348+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~539] v31'9 uv9 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.348+0000 7fc499128800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:15.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.348+0000 7fc499128800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.348+0000 7fc499128800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.348+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94374443712496 in=727b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d543313f90 con 0x55d5432cbdd0 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94374443456464 notify 133143986184 ret 0) v3 ==== 757+0+0 (crc 0 0 0) 0x55d5432c1080 con 0x55d5432cbdd0 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc48be5f640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94374443456464 notifier 4372 bl.length()=715 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc48be5f640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc48be5f640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(64 notify.4 [notify cookie 94374443712496 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc48be5f640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc4700042a0 con 0x55d5432cbdd0 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== watch-notify(notify_complete (2) cookie 94374443712496 notify 133143986184 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d5432c0c20 con 0x55d5432cbdd0 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc499128800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94374443712496 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d543313f90 con 0x7fc484017050 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== watch-notify(notify (1) cookie 94374441021264 notify 133143986180 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x55d543174e60 con 0x7fc484017050 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc48be5f640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94374441021264 notifier 4372 bl.length()=159 2023-12-07T21:09:15.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(66 notify.0 [notify cookie 94374443712496 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc47c06f040 con 0x7fc484017050 2023-12-07T21:09:15.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.349+0000 7fc48be5f640 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc470004600 con 0x7fc484017050 2023-12-07T21:09:15.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.350+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc47c06f040 con 0x7fc484017050 2023-12-07T21:09:15.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.350+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== watch-notify(notify_complete (2) cookie 94374443712496 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc47c04e070 con 0x7fc484017050 2023-12-07T21:09:15.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.350+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d543316c30 con 0x55d5432cbdd0 2023-12-07T21:09:15.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.351+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(68 foo:foo1 [delete] v31'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.353 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.351+0000 7fc45b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.351+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94374443463968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d543316c30 con 0x55d5432cbdd0 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.352+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94374443463968] v31'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.352+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94374441021264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d543316c30 con 0x7fc484017050 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.353+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94374441021264] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc47c06f040 con 0x7fc484017050 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.353+0000 7fc499128800 20 remove_watcher() i=0 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.353+0000 7fc499128800 2 removed watcher, disabling cache 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.353+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94374443442240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d0ad0 con 0x55d5432cbdd0 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.354+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94374443442240] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.354+0000 7fc499128800 20 remove_watcher() i=1 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.354+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94374443447296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432d0ad0 con 0x55d5432d1ef0 2023-12-07T21:09:15.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.355+0000 7fc494e61640 1 -- 172.21.15.121:0/3465207784 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94374443447296] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc484014070 con 0x55d5432d1ef0 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.355+0000 7fc499128800 20 remove_watcher() i=2 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.355+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94374443455424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d543316c30 con 0x7fc484017050 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.356+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94374443455424] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc47c06f040 con 0x7fc484017050 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.357+0000 7fc499128800 20 remove_watcher() i=3 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.357+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94374443456464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d543316c30 con 0x55d5432cbdd0 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.357+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94374443456464] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x55d5432cbdd0 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.357+0000 7fc499128800 20 remove_watcher() i=4 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.357+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94374443458880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d543316c30 con 0x7fc47c05c920 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.359+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94374443458880] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.359+0000 7fc499128800 20 remove_watcher() i=5 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.359+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94374443462720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432da140 con 0x7fc47c05c920 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.360+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94374443462720] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.360+0000 7fc499128800 20 remove_watcher() i=6 2023-12-07T21:09:15.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.360+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94374443466384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55d5432da140 con 0x7fc47c05c920 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.360+0000 7fc495662640 1 -- 172.21.15.121:0/3465207784 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94374443466384] v31'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc49002e9d0 con 0x7fc47c05c920 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.360+0000 7fc499128800 20 remove_watcher() i=7 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc47c05c920 msgr2=0x7fc47c009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc47c05c920 0x7fc47c009410 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d5432cbdd0 msgr2=0x55d5432ce290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d5432cbdd0 0x55d5432ce290 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc484017050 msgr2=0x7fc48400d570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc484017050 0x7fc48400d570 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d5432d1ef0 msgr2=0x55d5432d4360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d5432d1ef0 0x55d5432d4360 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc46c036110 msgr2=0x7fc46c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc46c036110 0x7fc46c0385d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc47c054000 tx=0x7fc47c04e000 comp rx=0 tx=0).stop 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 msgr2=0x55d5432c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432c06e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc49000a3d0 tx=0x7fc490003370 comp rx=0 tx=0).stop 2023-12-07T21:09:15.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc48c660640 1 -- 172.21.15.121:0/3465207784 reap_dead start 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 shutdown_connections 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 --2- 172.21.15.121:0/3465207784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5432b9650 0x55d5432c06e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 >> 172.21.15.121:0/3465207784 conn(0x55d543175cb0 msgr2=0x55d5432b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 shutdown_connections 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3465207784 wait complete. 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3022658629 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4740360c0 msgr2=0x7fc474038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 --2- 172.21.15.121:0/3022658629 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4740360c0 0x7fc474038580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc48400e6c0 tx=0x7fc484018ee0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3022658629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 msgr2=0x55d5432ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 --2- 172.21.15.121:0/3022658629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432ad550 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc484001ed0 tx=0x7fc484000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3022658629 shutdown_connections 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 --2- 172.21.15.121:0/3022658629 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc4740360c0 0x7fc474038580 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 --2- 172.21.15.121:0/3022658629 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d543174920 0x55d5432ad550 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3022658629 >> 172.21.15.121:0/3022658629 conn(0x55d5431fa990 msgr2=0x55d5432a4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3022658629 shutdown_connections 2023-12-07T21:09:15.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.361+0000 7fc499128800 1 -- 172.21.15.121:0/3022658629 wait complete. 2023-12-07T21:09:15.362 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:15.362 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2023-12-07T21:09:15.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2023-12-07T21:09:15.362 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2023-12-07T21:09:15.404 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:15.405 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:15.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.412+0000 7f01f851f800 1 Processor -- start 2023-12-07T21:09:15.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.412+0000 7f01f851f800 1 -- start start 2023-12-07T21:09:15.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.412+0000 7f01f851f800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558e19fc9720 0x558e19fc9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.412+0000 7f01f851f800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558e19f157a0 con 0x558e19fc8430 2023-12-07T21:09:15.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.412+0000 7f01f851f800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x558e19ede880 con 0x558e19fc9720 2023-12-07T21:09:15.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.412+0000 7f01f414d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558e19fc9720 0x558e19fc9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.412+0000 7f01f394c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x558e19fc8430 0x558e19fc88e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:37850/0 (socket says 172.21.15.121:37850) 2023-12-07T21:09:15.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.412+0000 7f01f394c640 1 -- 172.21.15.121:0/3374110958 learned_addr learned my addr 172.21.15.121:0/3374110958 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:15.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.413+0000 7f01f414d640 1 -- 172.21.15.121:0/3374110958 >> v1:172.21.15.89:6789/0 conn(0x558e19fc8430 legacy=0x558e19fc88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.413+0000 7f01f414d640 1 -- 172.21.15.121:0/3374110958 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e19fca1c0 con 0x558e19fc9720 2023-12-07T21:09:15.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.413+0000 7f01f314b640 1 -- 172.21.15.121:0/3374110958 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104392444 0 0) 0x558e19f157a0 con 0x558e19fc8430 2023-12-07T21:09:15.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.415+0000 7f01f414d640 1 --2- 172.21.15.121:0/3374110958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc9720 0x558e19fc9b40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f01e4005fd0 tx=0x7f01e401cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336f46ad4f55eeb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.415+0000 7f01f314b640 1 -- 172.21.15.121:0/3374110958 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01e4052560 con 0x558e19fc9720 2023-12-07T21:09:15.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.415+0000 7f01f314b640 1 -- 172.21.15.121:0/3374110958 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e40526c0 con 0x558e19fc9720 2023-12-07T21:09:15.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.415+0000 7f01f314b640 1 -- 172.21.15.121:0/3374110958 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01e40529a0 con 0x558e19fc9720 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.415+0000 7f01f851f800 1 -- 172.21.15.121:0/3374110958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc9720 msgr2=0x558e19fc9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.415+0000 7f01f851f800 1 --2- 172.21.15.121:0/3374110958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc9720 0x558e19fc9b40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f01e4005fd0 tx=0x7f01e401cb90 comp rx=0 tx=0).stop 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.415+0000 7f01f851f800 1 -- 172.21.15.121:0/3374110958 shutdown_connections 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.415+0000 7f01f851f800 1 --2- 172.21.15.121:0/3374110958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc9720 0x558e19fc9b40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.415+0000 7f01f851f800 1 -- 172.21.15.121:0/3374110958 >> 172.21.15.121:0/3374110958 conn(0x558e19fc2f60 msgr2=0x558e19fc5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.415+0000 7f01f851f800 1 -- 172.21.15.121:0/3374110958 shutdown_connections 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.415+0000 7f01f851f800 1 -- 172.21.15.121:0/3374110958 wait complete. 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.416+0000 7f01f851f800 1 Processor -- start 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.416+0000 7f01f851f800 1 -- start start 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.416+0000 7f01f851f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e19fc7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.416+0000 7f01f851f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e19edbdb0 con 0x558e19fc8430 2023-12-07T21:09:15.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.416+0000 7f01f414d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e19fc7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.416+0000 7f01f414d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e19fc7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53752/0 (socket says 172.21.15.121:53752) 2023-12-07T21:09:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.416+0000 7f01f414d640 1 -- 172.21.15.121:0/541477201 learned_addr learned my addr 172.21.15.121:0/541477201 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f414d640 1 -- 172.21.15.121:0/541477201 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e400a100 con 0x558e19fc8430 2023-12-07T21:09:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f414d640 1 --2- 172.21.15.121:0/541477201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e19fc7600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f01e400a3f0 tx=0x7f01e404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa79e9e3c9f11af8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f294a640 1 -- 172.21.15.121:0/541477201 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01e4052960 con 0x558e19fc8430 2023-12-07T21:09:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f294a640 1 -- 172.21.15.121:0/541477201 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e4052ac0 con 0x558e19fc8430 2023-12-07T21:09:15.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f294a640 1 -- 172.21.15.121:0/541477201 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01e4052d60 con 0x558e19fc8430 2023-12-07T21:09:15.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f851f800 1 -- 172.21.15.121:0/541477201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 msgr2=0x558e19fc7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f851f800 1 --2- 172.21.15.121:0/541477201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e19fc7600 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f01e400a3f0 tx=0x7f01e404c000 comp rx=0 tx=0).stop 2023-12-07T21:09:15.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f851f800 1 -- 172.21.15.121:0/541477201 shutdown_connections 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f851f800 1 --2- 172.21.15.121:0/541477201 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e19fc7600 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f851f800 1 -- 172.21.15.121:0/541477201 >> 172.21.15.121:0/541477201 conn(0x558e19fc2f60 msgr2=0x558e1a068c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f851f800 1 -- 172.21.15.121:0/541477201 shutdown_connections 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.417+0000 7f01f851f800 1 -- 172.21.15.121:0/541477201 wait complete. 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.418+0000 7f01f851f800 1 Processor -- start 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.418+0000 7f01f851f800 1 -- start start 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.418+0000 7f01f851f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e1a075440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.418+0000 7f01f851f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e19ed76a0 con 0x558e19fc8430 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.418+0000 7f01f414d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e1a075440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.418+0000 7f01f414d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e1a075440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53756/0 (socket says 172.21.15.121:53756) 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.418+0000 7f01f414d640 1 -- 172.21.15.121:0/884031245 learned_addr learned my addr 172.21.15.121:0/884031245 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.418+0000 7f01f414d640 1 -- 172.21.15.121:0/884031245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e19fca1c0 con 0x558e19fc8430 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.418+0000 7f01f414d640 1 --2- 172.21.15.121:0/884031245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e1a075440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f01e4052690 tx=0x7f01e4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.418+0000 7f01f1948640 1 -- 172.21.15.121:0/884031245 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01e405c560 con 0x558e19fc8430 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f1948640 1 -- 172.21.15.121:0/884031245 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e405c6e0 con 0x558e19fc8430 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f851f800 1 -- 172.21.15.121:0/884031245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e1a075980 con 0x558e19fc8430 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f1948640 1 -- 172.21.15.121:0/884031245 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01e405c9c0 con 0x558e19fc8430 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f851f800 1 -- 172.21.15.121:0/884031245 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e1a075ec0 con 0x558e19fc8430 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f851f800 1 Processor -- start 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f851f800 1 -- start start 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f1948640 1 -- 172.21.15.121:0/884031245 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f01e405cb20 con 0x558e19fc8430 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f851f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 0x558e1a06ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f851f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e19e71890 con 0x558e1a06e980 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f1948640 1 --2- 172.21.15.121:0/884031245 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e00360c0 0x7f01e0038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f494e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 0x558e1a06ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f494e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 0x558e1a06ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53760/0 (socket says 172.21.15.121:53760) 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f494e640 1 -- 172.21.15.121:0/1950459456 learned_addr learned my addr 172.21.15.121:0/1950459456 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.419+0000 7f01f1948640 1 -- 172.21.15.121:0/884031245 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f01e408da50 con 0x558e19fc8430 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01f414d640 1 --2- 172.21.15.121:0/884031245 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e00360c0 0x7f01e0038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01f494e640 1 -- 172.21.15.121:0/1950459456 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e1a06d410 con 0x558e1a06e980 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01f494e640 1 --2- 172.21.15.121:0/1950459456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 0x558e1a06ced0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00a400 tx=0x7f01ec00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59219b8df6520312 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01f414d640 1 --2- 172.21.15.121:0/884031245 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e00360c0 0x7f01e0038580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01e4054010 tx=0x7f01e4066fb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01db7fe640 1 -- 172.21.15.121:0/1950459456 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01ec0087e0 con 0x558e1a06e980 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01db7fe640 1 -- 172.21.15.121:0/1950459456 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec008960 con 0x558e1a06e980 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01db7fe640 1 -- 172.21.15.121:0/1950459456 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01ec008c80 con 0x558e1a06e980 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01f851f800 1 -- 172.21.15.121:0/1950459456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 msgr2=0x558e1a06ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01f851f800 1 --2- 172.21.15.121:0/1950459456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 0x558e1a06ced0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00a400 tx=0x7f01ec00a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01f851f800 1 -- 172.21.15.121:0/1950459456 shutdown_connections 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01f851f800 1 --2- 172.21.15.121:0/1950459456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 0x558e1a06ced0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01f851f800 1 -- 172.21.15.121:0/1950459456 >> 172.21.15.121:0/1950459456 conn(0x558e19fc9720 msgr2=0x558e1a07ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01f851f800 1 -- 172.21.15.121:0/1950459456 shutdown_connections 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.420+0000 7f01f851f800 1 -- 172.21.15.121:0/1950459456 wait complete. 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.421+0000 7f01f851f800 1 Processor -- start 2023-12-07T21:09:15.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.421+0000 7f01f851f800 1 -- start start 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.421+0000 7f01f851f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 0x558e1a08a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.421+0000 7f01f851f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e19e71530 con 0x558e1a06e980 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.421+0000 7f01f494e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 0x558e1a08a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.421+0000 7f01f494e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 0x558e1a08a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:53774/0 (socket says 172.21.15.121:53774) 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.421+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 learned_addr learned my addr 172.21.15.121:0/2412002126 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.421+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec005c90 con 0x558e1a06e980 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.422+0000 7f01f494e640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 0x558e1a08a8f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00a900 tx=0x7f01ec002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.422+0000 7f01d9ffb640 1 -- 172.21.15.121:0/2412002126 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01ec013780 con 0x558e1a06e980 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.422+0000 7f01d9ffb640 1 -- 172.21.15.121:0/2412002126 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec0138e0 con 0x558e1a06e980 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.422+0000 7f01d9ffb640 1 -- 172.21.15.121:0/2412002126 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01ec013b80 con 0x558e1a06e980 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.422+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e1a08ae30 con 0x558e1a06e980 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.422+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e1a08b2f0 con 0x558e1a06e980 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.422+0000 7f01d9ffb640 1 -- 172.21.15.121:0/2412002126 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f01ec013ce0 con 0x558e1a06e980 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.423+0000 7f01d9ffb640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01cc036110 0x7f01cc0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.423+0000 7f01d9ffb640 1 -- 172.21.15.121:0/2412002126 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f01ec04b640 con 0x558e1a06e980 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.423+0000 7f01f394c640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01cc036110 0x7f01cc0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.423+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.423+0000 7f01f851f800 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558e1a096050 0x558e1a098510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.423+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a098c60 con 0x558e1a096050 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.423+0000 7f01f394c640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01cc036110 0x7f01cc0385d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01e8000c00 tx=0x7f01e8001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.423+0000 7f01f494e640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558e1a096050 0x558e1a098510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.423+0000 7f01f494e640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558e1a096050 0x558e1a098510 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 20 realm 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a099050 con 0x558e1a096050 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:15.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0998d0 con 0x558e1a096050 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a099c30 con 0x558e1a096050 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.424+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09a430 con 0x558e1a096050 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.425+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.425+0000 7f01f851f800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.425+0000 7f01f851f800 20 searching for the correct realm 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.425+0000 7f01f851f800 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558e1a09c150 0x558e1a09e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.425+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a09c150 2023-12-07T21:09:15.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.425+0000 7f01f414d640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558e1a09c150 0x558e1a09e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.425+0000 7f01f414d640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558e1a09c150 0x558e1a09e5e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.425+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.425+0000 7f01f414d640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f01e4085040 0x7f01e4069050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.425+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e4085040 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.425+0000 7f01f394c640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f01e4085040 0x7f01e4069050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.426+0000 7f01f394c640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f01e4085040 0x7f01e4069050 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.426+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.426+0000 7f01f394c640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f01e800e8a0 0x7f01e800d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.426+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e800e8a0 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.426+0000 7f01f494e640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f01e800e8a0 0x7f01e800d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.426+0000 7f01f494e640 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f01e800e8a0 0x7f01e800d2f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.427+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.427+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a096050 2023-12-07T21:09:15.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.427+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.427+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a096050 2023-12-07T21:09:15.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.427+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.427+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e800e8a0 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.427+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.427+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e800e8a0 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.427+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.427+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e4085040 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.428+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.428+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a09c150 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.428+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.428+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a096050 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.428+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.428+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e800e8a0 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.429+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.429+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a096050 2023-12-07T21:09:15.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.429+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.429+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e4085040 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.429+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.429+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a09c150 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.429+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.429+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a09c150 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.429+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.429+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e800e8a0 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.430+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.430+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a09c150 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.430+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.430+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a09c150 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.430+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.430+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a096050 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.430+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.430+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a096050 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.431+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.431+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e800e8a0 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.431+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.431+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a09c150 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.431+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.431+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e4085040 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.432+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.432+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a096050 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.432+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.432+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e800e8a0 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.432+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.432+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a09c150 2023-12-07T21:09:15.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.432+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.433+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e800e8a0 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.433+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.433+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e4085040 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.433+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.433+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a09c150 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.433+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.433+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x7f01e800e8a0 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ec60 con 0x558e1a096050 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f01ec053080 con 0x7f01e4085040 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:15.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09ad60 con 0x558e1a096050 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09b5b0 con 0x558e1a096050 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.434+0000 7f01f851f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09b5b0 con 0x558e1a09c150 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 20 zone default found 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 4 Realm: () 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 20 zonegroup default 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a09f0e0 con 0x7f01e800e8a0 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a0ec0 con 0x558e1a09c150 2023-12-07T21:09:15.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.435+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a1220 con 0x558e1a09c150 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.436+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.436+0000 7f01f851f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.436+0000 7f01f851f800 20 started sync module instance, tier type = 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.436+0000 7f01f851f800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.436+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a07a0 con 0x7f01e4085040 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.437+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.437+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94068808159056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a15f0 con 0x7f01e4085040 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.437+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a1df0 con 0x558e1a096050 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.438+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94068808159056] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.438+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.438+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94068810580736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a1df0 con 0x558e1a096050 2023-12-07T21:09:15.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.438+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a25f0 con 0x558e1a09c150 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.439+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.439+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94068810587904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a2e40 con 0x558e1a09c150 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.439+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a37f0 con 0x7f01e4085040 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.439+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94068810580736] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.440+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94068810587904] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.440+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.440+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94068810586448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a2ab0 con 0x7f01e4085040 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.440+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a4240 con 0x558e1a096050 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.441+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.441+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94068810595648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a4ac0 con 0x558e1a096050 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.442+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a5470 con 0x7f01e800e8a0 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.442+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94068810586448] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.442+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.442+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94068810593040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a5430 con 0x7f01e800e8a0 2023-12-07T21:09:15.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.442+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a5e30 con 0x7f01e800e8a0 2023-12-07T21:09:15.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.443+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94068810595648] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.443+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94068810593040] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.443+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.443+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94068810600336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a4750 con 0x7f01e800e8a0 2023-12-07T21:09:15.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.444+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a62d0 con 0x7f01e800e8a0 2023-12-07T21:09:15.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.444+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.444+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94068810600336] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.444+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94068810604080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a6880 con 0x7f01e800e8a0 2023-12-07T21:09:15.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.444+0000 7f01f851f800 20 add_watcher() i=0 2023-12-07T21:09:15.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.444+0000 7f01f851f800 20 add_watcher() i=1 2023-12-07T21:09:15.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.444+0000 7f01f851f800 20 add_watcher() i=2 2023-12-07T21:09:15.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.444+0000 7f01f851f800 20 add_watcher() i=3 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.444+0000 7f01f851f800 20 add_watcher() i=4 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.444+0000 7f01f851f800 20 add_watcher() i=5 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.444+0000 7f01f851f800 20 add_watcher() i=6 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.445+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94068810604080] v31'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.445+0000 7f01f851f800 20 add_watcher() i=7 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.445+0000 7f01f851f800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.445+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a5a80 con 0x558e1a096050 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.446+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.446+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94068810605344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a5a80 con 0x558e1a096050 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94068810605344] v31'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f01bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f01f851f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f01f851f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f01f851f800 5 note: GC not initialized 2023-12-07T21:09:15.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f01b9fdb640 20 reqs_thread_entry: start 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f01f851f800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f01f851f800 20 Filter name: none 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f012b7fe640 20 reqs_thread_entry: start 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f01f851f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f01f851f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.447+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0dc860 con 0x558e1a096050 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.448+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~539 out=539b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+662 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.448+0000 7f01f851f800 20 rados_obj.operate() r=0 bl.length=539 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.448+0000 7f01f851f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.448+0000 7f01f851f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.448+0000 7f01f851f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.448+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0e28e0 con 0x558e1a096050 2023-12-07T21:09:15.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.449+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v31'10 uv10 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.449+0000 7f01f851f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:15.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.449+0000 7f01f851f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.449+0000 7f01f851f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:15.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.449+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94068810851168 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0e1430 con 0x558e1a096050 2023-12-07T21:09:15.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.449+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94068810595648 notify 133143986185 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x558e1a08b2f0 con 0x558e1a096050 2023-12-07T21:09:15.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.449+0000 7f01db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94068810595648 notifier 4378 bl.length()=689 2023-12-07T21:09:15.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.449+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(64 notify.4 [notify cookie 94068810851168 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.449+0000 7f01db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:15.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.449+0000 7f01db7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.449+0000 7f01db7fe640 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f01d00042a0 con 0x558e1a096050 2023-12-07T21:09:15.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.450+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== watch-notify(notify_complete (2) cookie 94068810851168 notify 133143986185 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558e1a08ae30 con 0x558e1a096050 2023-12-07T21:09:15.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.450+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.453 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.451+0000 7f01bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.451+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94068810605344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0e0f60 con 0x558e1a096050 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.451+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94068810605344] v31'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.451+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94068808159056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0e0f60 con 0x7f01e4085040 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.452+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94068808159056] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.452+0000 7f01f851f800 20 remove_watcher() i=0 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.452+0000 7f01f851f800 2 removed watcher, disabling cache 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.452+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94068810580736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0e12c0 con 0x558e1a096050 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.453+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94068810580736] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.453+0000 7f01f851f800 20 remove_watcher() i=1 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.454+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94068810587904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0e12c0 con 0x558e1a09c150 2023-12-07T21:09:15.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.454+0000 7f01f414d640 1 -- 172.21.15.121:0/2412002126 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94068810587904] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01e4066a50 con 0x558e1a09c150 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.454+0000 7f01f851f800 20 remove_watcher() i=2 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.454+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94068810586448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0dcbc0 con 0x7f01e4085040 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.455+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94068810586448] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01e800f620 con 0x7f01e4085040 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.455+0000 7f01f851f800 20 remove_watcher() i=3 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.455+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94068810595648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0dcf20 con 0x558e1a096050 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.456+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94068810595648] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x558e1a096050 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.456+0000 7f01f851f800 20 remove_watcher() i=4 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.456+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94068810593040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0dcf20 con 0x7f01e800e8a0 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.457+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94068810593040] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.457+0000 7f01f851f800 20 remove_watcher() i=5 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.457+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94068810600336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a3310 con 0x7f01e800e8a0 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.458+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94068810600336] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.458+0000 7f01f851f800 20 remove_watcher() i=6 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.458+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94068810604080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558e1a0a3310 con 0x7f01e800e8a0 2023-12-07T21:09:15.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f494e640 1 -- 172.21.15.121:0/2412002126 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94068810604080] v31'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec024070 con 0x7f01e800e8a0 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 20 remove_watcher() i=7 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f01e800e8a0 msgr2=0x7f01e800d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f01e800e8a0 0x7f01e800d2f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558e1a096050 msgr2=0x558e1a098510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558e1a096050 0x558e1a098510 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f01e4085040 msgr2=0x7f01e4069050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f01e4085040 0x7f01e4069050 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558e1a09c150 msgr2=0x558e1a09e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558e1a09c150 0x558e1a09e5e0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01cc036110 msgr2=0x7f01cc0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01cc036110 0x7f01cc0385d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01e8000c00 tx=0x7f01e8001330 comp rx=0 tx=0).stop 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 msgr2=0x558e1a08a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 --2- 172.21.15.121:0/2412002126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e1a06e980 0x558e1a08a8f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00a900 tx=0x7f01ec002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 reap_dead start 2023-12-07T21:09:15.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f394c640 1 -- 172.21.15.121:0/2412002126 reap_dead start 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 shutdown_connections 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 >> 172.21.15.121:0/2412002126 conn(0x558e19fc9720 msgr2=0x558e1a07b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.459+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 shutdown_connections 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.460+0000 7f01f851f800 1 -- 172.21.15.121:0/2412002126 wait complete. 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.460+0000 7f01f851f800 1 -- 172.21.15.121:0/884031245 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e00360c0 msgr2=0x7f01e0038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.460+0000 7f01f851f800 1 --2- 172.21.15.121:0/884031245 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e00360c0 0x7f01e0038580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f01e4054010 tx=0x7f01e4066fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.460+0000 7f01f851f800 1 -- 172.21.15.121:0/884031245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 msgr2=0x558e1a075440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.460+0000 7f01f851f800 1 --2- 172.21.15.121:0/884031245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e1a075440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f01e4052690 tx=0x7f01e4003330 comp rx=0 tx=0).stop 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.460+0000 7f01f851f800 1 -- 172.21.15.121:0/884031245 shutdown_connections 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.460+0000 7f01f851f800 1 --2- 172.21.15.121:0/884031245 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e00360c0 0x7f01e0038580 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.460+0000 7f01f851f800 1 --2- 172.21.15.121:0/884031245 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558e19fc8430 0x558e1a075440 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.460+0000 7f01f851f800 1 -- 172.21.15.121:0/884031245 >> 172.21.15.121:0/884031245 conn(0x558e19fc2f60 msgr2=0x558e1a06bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.460+0000 7f01f851f800 1 -- 172.21.15.121:0/884031245 shutdown_connections 2023-12-07T21:09:15.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.460+0000 7f01f851f800 1 -- 172.21.15.121:0/884031245 wait complete. 2023-12-07T21:09:15.462 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:15.462 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2023-12-07T21:09:15.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2023-12-07T21:09:15.462 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2023-12-07T21:09:15.543 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:15.543 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:15.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.551+0000 7fbf13e85800 1 Processor -- start 2023-12-07T21:09:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.551+0000 7fbf13e85800 1 -- start start 2023-12-07T21:09:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.551+0000 7fbf13e85800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56467dbbc7e0 0x56467dbbcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.551+0000 7fbf13e85800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56467db07740 con 0x56467dbbd140 2023-12-07T21:09:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.551+0000 7fbf13e85800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x56467dad0880 con 0x56467dbbc7e0 2023-12-07T21:09:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.551+0000 7fbf11184640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x56467dbbd140 0x56467dbb9260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55694/0 (socket says 172.21.15.121:55694) 2023-12-07T21:09:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.551+0000 7fbf11985640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56467dbbc7e0 0x56467dbbcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.551+0000 7fbf11184640 1 -- 172.21.15.121:0/1807212313 learned_addr learned my addr 172.21.15.121:0/1807212313 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.551+0000 7fbf11985640 1 -- 172.21.15.121:0/1807212313 >> v1:172.21.15.89:6789/0 conn(0x56467dbbd140 legacy=0x56467dbb9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.551+0000 7fbf11985640 1 -- 172.21.15.121:0/1807212313 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56467dbb9b00 con 0x56467dbbc7e0 2023-12-07T21:09:15.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.551+0000 7fbf10983640 1 -- 172.21.15.121:0/1807212313 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849711704 0 0) 0x56467db07740 con 0x56467dbbd140 2023-12-07T21:09:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.553+0000 7fbf11985640 1 --2- 172.21.15.121:0/1807212313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dbbcc00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400a470 tx=0x7fbf0401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949e180e5c04c3ae server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.553+0000 7fbf10983640 1 -- 172.21.15.121:0/1807212313 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf04052570 con 0x56467dbbc7e0 2023-12-07T21:09:15.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.553+0000 7fbf10983640 1 -- 172.21.15.121:0/1807212313 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf040526d0 con 0x56467dbbc7e0 2023-12-07T21:09:15.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.553+0000 7fbf10983640 1 -- 172.21.15.121:0/1807212313 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf04052990 con 0x56467dbbc7e0 2023-12-07T21:09:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.554+0000 7fbf13e85800 1 -- 172.21.15.121:0/1807212313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 msgr2=0x56467dbbcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.554+0000 7fbf13e85800 1 --2- 172.21.15.121:0/1807212313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dbbcc00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400a470 tx=0x7fbf0401cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.554+0000 7fbf13e85800 1 -- 172.21.15.121:0/1807212313 shutdown_connections 2023-12-07T21:09:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.554+0000 7fbf13e85800 1 --2- 172.21.15.121:0/1807212313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dbbcc00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.554+0000 7fbf13e85800 1 -- 172.21.15.121:0/1807212313 >> 172.21.15.121:0/1807212313 conn(0x56467dbb4f00 msgr2=0x56467dbb7320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.554+0000 7fbf13e85800 1 -- 172.21.15.121:0/1807212313 shutdown_connections 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.554+0000 7fbf13e85800 1 -- 172.21.15.121:0/1807212313 wait complete. 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.555+0000 7fbf13e85800 1 Processor -- start 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.555+0000 7fbf13e85800 1 -- start start 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.555+0000 7fbf13e85800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dc60180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.555+0000 7fbf13e85800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467dacddb0 con 0x56467dbbc7e0 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.555+0000 7fbf11985640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dc60180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.555+0000 7fbf11985640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dc60180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54208/0 (socket says 172.21.15.121:54208) 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.555+0000 7fbf11985640 1 -- 172.21.15.121:0/3758008296 learned_addr learned my addr 172.21.15.121:0/3758008296 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.555+0000 7fbf11985640 1 -- 172.21.15.121:0/3758008296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf04005d20 con 0x56467dbbc7e0 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.555+0000 7fbf11985640 1 --2- 172.21.15.121:0/3758008296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dc60180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbf04000c00 tx=0x7fbf0404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f8acbb70499db4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf03fff640 1 -- 172.21.15.121:0/3758008296 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf0400a180 con 0x56467dbbc7e0 2023-12-07T21:09:15.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf03fff640 1 -- 172.21.15.121:0/3758008296 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400a2e0 con 0x56467dbbc7e0 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf03fff640 1 -- 172.21.15.121:0/3758008296 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf04052990 con 0x56467dbbc7e0 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf13e85800 1 -- 172.21.15.121:0/3758008296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 msgr2=0x56467dc60180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf13e85800 1 --2- 172.21.15.121:0/3758008296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dc60180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbf04000c00 tx=0x7fbf0404c000 comp rx=0 tx=0).stop 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf13e85800 1 -- 172.21.15.121:0/3758008296 shutdown_connections 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf13e85800 1 --2- 172.21.15.121:0/3758008296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dc60180 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf13e85800 1 -- 172.21.15.121:0/3758008296 >> 172.21.15.121:0/3758008296 conn(0x56467dbb4f00 msgr2=0x56467dc5bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf13e85800 1 -- 172.21.15.121:0/3758008296 shutdown_connections 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf13e85800 1 -- 172.21.15.121:0/3758008296 wait complete. 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf13e85800 1 Processor -- start 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.556+0000 7fbf13e85800 1 -- start start 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf13e85800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dbbbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf13e85800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467dac96a0 con 0x56467dbbc7e0 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf11985640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dbbbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf11985640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dbbbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54212/0 (socket says 172.21.15.121:54212) 2023-12-07T21:09:15.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf11985640 1 -- 172.21.15.121:0/94214050 learned_addr learned my addr 172.21.15.121:0/94214050 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf11985640 1 -- 172.21.15.121:0/94214050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56467dbb9b00 con 0x56467dbbc7e0 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf11985640 1 --2- 172.21.15.121:0/94214050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dbbbd90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbf0405f040 tx=0x7fbf04002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf02ffd640 1 -- 172.21.15.121:0/94214050 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf0406b070 con 0x56467dbbc7e0 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf02ffd640 1 -- 172.21.15.121:0/94214050 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf04052cc0 con 0x56467dbbc7e0 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf02ffd640 1 -- 172.21.15.121:0/94214050 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf0405d420 con 0x56467dbbc7e0 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf13e85800 1 -- 172.21.15.121:0/94214050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56467dbbc2d0 con 0x56467dbbc7e0 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.557+0000 7fbf13e85800 1 -- 172.21.15.121:0/94214050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56467dbba860 con 0x56467dbbc7e0 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf13e85800 1 Processor -- start 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf13e85800 1 -- start start 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf13e85800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 0x56467dc75de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf13e85800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467da63890 con 0x56467dc759c0 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf02ffd640 1 -- 172.21.15.121:0/94214050 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fbf0405d580 con 0x56467dbbc7e0 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf12186640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 0x56467dc75de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf12186640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 0x56467dc75de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54214/0 (socket says 172.21.15.121:54214) 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf12186640 1 -- 172.21.15.121:0/3900344871 learned_addr learned my addr 172.21.15.121:0/3900344871 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf02ffd640 1 --2- 172.21.15.121:0/94214050 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbef4036110 0x7fbef40385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf02ffd640 1 -- 172.21.15.121:0/94214050 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fbf0408ced0 con 0x56467dbbc7e0 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf11985640 1 --2- 172.21.15.121:0/94214050 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbef4036110 0x7fbef40385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.558+0000 7fbf12186640 1 -- 172.21.15.121:0/3900344871 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56467dc76320 con 0x56467dc759c0 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf12186640 1 --2- 172.21.15.121:0/3900344871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 0x56467dc75de0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00a430 tx=0x7fbf0c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97407d03b89f95d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf00ff9640 1 -- 172.21.15.121:0/3900344871 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c001650 con 0x56467dc759c0 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf11985640 1 --2- 172.21.15.121:0/94214050 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbef4036110 0x7fbef40385d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf0406e710 tx=0x7fbf0405cf40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf00ff9640 1 -- 172.21.15.121:0/3900344871 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0017d0 con 0x56467dc759c0 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf00ff9640 1 -- 172.21.15.121:0/3900344871 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c001ab0 con 0x56467dc759c0 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf13e85800 1 -- 172.21.15.121:0/3900344871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 msgr2=0x56467dc75de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf13e85800 1 --2- 172.21.15.121:0/3900344871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 0x56467dc75de0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00a430 tx=0x7fbf0c00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf13e85800 1 -- 172.21.15.121:0/3900344871 shutdown_connections 2023-12-07T21:09:15.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf13e85800 1 --2- 172.21.15.121:0/3900344871 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 0x56467dc75de0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf13e85800 1 -- 172.21.15.121:0/3900344871 >> 172.21.15.121:0/3900344871 conn(0x56467dbbd140 msgr2=0x56467dc70da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf13e85800 1 -- 172.21.15.121:0/3900344871 shutdown_connections 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf13e85800 1 -- 172.21.15.121:0/3900344871 wait complete. 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf13e85800 1 Processor -- start 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.559+0000 7fbf13e85800 1 -- start start 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbf13e85800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 0x56467dc7c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbf13e85800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467da63530 con 0x56467dc759c0 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbf12186640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 0x56467dc7c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbf12186640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 0x56467dc7c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54218/0 (socket says 172.21.15.121:54218) 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 learned_addr learned my addr 172.21.15.121:0/1902423500 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c00a0e0 con 0x56467dc759c0 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbf12186640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 0x56467dc7c9f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00a930 tx=0x7fbf0c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbef2ffd640 1 -- 172.21.15.121:0/1902423500 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c010900 con 0x56467dc759c0 2023-12-07T21:09:15.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbef2ffd640 1 -- 172.21.15.121:0/1902423500 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c010a60 con 0x56467dc759c0 2023-12-07T21:09:15.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56467dc7cf30 con 0x56467dc759c0 2023-12-07T21:09:15.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbef2ffd640 1 -- 172.21.15.121:0/1902423500 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbf0c010d20 con 0x56467dc759c0 2023-12-07T21:09:15.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.560+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56467dc7d390 con 0x56467dc759c0 2023-12-07T21:09:15.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.561+0000 7fbef2ffd640 1 -- 172.21.15.121:0/1902423500 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fbf0c017030 con 0x56467dc759c0 2023-12-07T21:09:15.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.561+0000 7fbef2ffd640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbeec036110 0x7fbeec0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.561+0000 7fbef2ffd640 1 -- 172.21.15.121:0/1902423500 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fbf0c04b890 con 0x56467dc759c0 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.561+0000 7fbf11184640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbeec036110 0x7fbeec0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.562+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.562+0000 7fbf11184640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbeec036110 0x7fbeec0385d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbf08000c00 tx=0x7fbf08001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.562+0000 7fbf13e85800 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56467dc88070 0x56467dc8a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.562+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc8ac80 con 0x56467dc88070 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.562+0000 7fbf12186640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56467dc88070 0x56467dc8a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.562+0000 7fbf12186640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56467dc88070 0x56467dc8a530 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.562+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.562+0000 7fbf13e85800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.562+0000 7fbf13e85800 20 realm 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.562+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.562+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc8b090 con 0x56467dc88070 2023-12-07T21:09:15.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc8b910 con 0x56467dc88070 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc8bc70 con 0x56467dc88070 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc8c470 con 0x56467dc88070 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 20 searching for the correct realm 2023-12-07T21:09:15.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56467dc8e190 0x56467dc90620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc8e190 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.563+0000 7fbf11985640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56467dc8e190 0x56467dc90620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.564+0000 7fbf11985640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56467dc8e190 0x56467dc90620 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.564+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.564+0000 7fbf11985640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fbf04079060 0x7fbf0406e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.564+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf04079060 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.564+0000 7fbf11184640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fbf04079060 0x7fbf0406e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.564+0000 7fbf11184640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fbf04079060 0x7fbf0406e9b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.565+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.565+0000 7fbf11184640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fbf0800e8a0 0x7fbf0800d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.565+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.565+0000 7fbf12186640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fbf0800e8a0 0x7fbf0800d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.565+0000 7fbf12186640 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fbf0800e8a0 0x7fbf0800d2f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.565+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.566+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc88070 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.566+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.566+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc88070 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.566+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.566+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.566+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.566+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.566+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.566+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf04079060 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.567+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.567+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc8e190 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.567+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.567+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc88070 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.567+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.567+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.567+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.567+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc88070 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.568+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.568+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf04079060 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.568+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.568+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc8e190 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.568+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.568+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc8e190 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.568+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.568+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.569+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.569+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc8e190 2023-12-07T21:09:15.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.569+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.569+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc8e190 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.569+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.569+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc88070 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.570+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.570+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc88070 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.570+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.570+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.570+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.570+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc8e190 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.570+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.570+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf04079060 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.571+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.571+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc88070 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.571+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.571+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.571+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.571+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc8e190 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.571+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.571+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.572+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.572+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf04079060 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.572+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.572+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc8e190 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.572+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.572+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.572+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.572+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x56467dc88070 2023-12-07T21:09:15.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc90cf0 con 0x7fbf04079060 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc8cdd0 con 0x56467dc88070 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc8d620 con 0x56467dc88070 2023-12-07T21:09:15.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.573+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc91130 con 0x56467dc8e190 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 20 zone default found 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 4 Realm: () 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 20 zonegroup default 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc91490 con 0x7fbf0800e8a0 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc93250 con 0x56467dc8e190 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc935b0 con 0x56467dc8e190 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.574+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.575+0000 7fbf13e85800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.575+0000 7fbf13e85800 20 started sync module instance, tier type = 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.575+0000 7fbf13e85800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.575+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc92b30 con 0x7fbf04079060 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.576+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.576+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94860755611472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc92ee0 con 0x7fbf04079060 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.576+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc93e40 con 0x56467dc88070 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.577+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94860755611472] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.577+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.577+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94860758034064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc93e40 con 0x56467dc88070 2023-12-07T21:09:15.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.577+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc94890 con 0x56467dc8e190 2023-12-07T21:09:15.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.578+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94860758034064] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.578+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.578+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94860758038944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc93db0 con 0x56467dc8e190 2023-12-07T21:09:15.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.578+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc955b0 con 0x7fbf04079060 2023-12-07T21:09:15.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.579+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94860758038944] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.579+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.579+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94860758044064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc95e00 con 0x7fbf04079060 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.579+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc96660 con 0x56467dc88070 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.580+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94860758044064] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.581+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.581+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94860758049120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc96a10 con 0x56467dc88070 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.581+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc97380 con 0x7fbf0800e8a0 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.582+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94860758049120] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.582+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.582+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94860758047072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc97380 con 0x7fbf0800e8a0 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.582+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc97b80 con 0x7fbf0800e8a0 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.583+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94860758047072] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.583+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.583+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94860758052848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc97980 con 0x7fbf0800e8a0 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.583+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc98420 con 0x7fbf0800e8a0 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.584+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94860758052848] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.584+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.584+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94860758056704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc983e0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.584+0000 7fbf13e85800 20 add_watcher() i=0 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.584+0000 7fbf13e85800 20 add_watcher() i=1 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.584+0000 7fbf13e85800 20 add_watcher() i=2 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.584+0000 7fbf13e85800 20 add_watcher() i=3 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.584+0000 7fbf13e85800 20 add_watcher() i=4 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.584+0000 7fbf13e85800 20 add_watcher() i=5 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.584+0000 7fbf13e85800 20 add_watcher() i=6 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.585+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94860758056704] v31'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.585+0000 7fbf13e85800 20 add_watcher() i=7 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.585+0000 7fbf13e85800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:15.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.585+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc9b800 con 0x56467dc88070 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.585+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.585+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94860758053888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc98d40 con 0x56467dc88070 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.586+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94860758053888] v31'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.587+0000 7fbed77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.587+0000 7fbf13e85800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.587+0000 7fbf13e85800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.587+0000 7fbf13e85800 5 note: GC not initialized 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.587+0000 7fbed67e4640 20 reqs_thread_entry: start 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.587+0000 7fbf13e85800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.587+0000 7fbf13e85800 20 Filter name: none 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.587+0000 7fbe47fff640 20 reqs_thread_entry: start 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.587+0000 7fbf13e85800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:15.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.587+0000 7fbf13e85800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.587+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dcce8a0 con 0x56467dc88070 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.588+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.588+0000 7fbf13e85800 20 rados_obj.operate() r=0 bl.length=513 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.588+0000 7fbf13e85800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.588+0000 7fbf13e85800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.588+0000 7fbf13e85800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.588+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dcd46f0 con 0x56467dc88070 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.589+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v31'11 uv11 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.589+0000 7fbf13e85800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.589+0000 7fbf13e85800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.589+0000 7fbf13e85800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.589+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94860758303088 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dcd3280 con 0x56467dc88070 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.589+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94860758049120 notify 133143986186 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x56467dc7d390 con 0x56467dc88070 2023-12-07T21:09:15.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.589+0000 7fbf00ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94860758049120 notifier 4384 bl.length()=533 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.589+0000 7fbf00ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.589+0000 7fbf00ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.589+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(64 notify.4 [notify cookie 94860758303088 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.589+0000 7fbf00ff9640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbee40042a0 con 0x56467dc88070 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.590+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== watch-notify(notify_complete (2) cookie 94860758303088 notify 133143986186 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56467dc7cf30 con 0x56467dc88070 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.590+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.590+0000 7fbf13e85800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.590+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94860758303088 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dcd2db0 con 0x7fbf04079060 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.590+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== watch-notify(notify (1) cookie 94860755611472 notify 133143986181 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x7fbf0800fd50 con 0x7fbf04079060 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.590+0000 7fbf00ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94860755611472 notifier 4384 bl.length()=159 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.590+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(66 notify.0 [notify cookie 94860758303088 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.590+0000 7fbf00ff9640 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbee40042a0 con 0x7fbf04079060 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.590+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== watch-notify(notify_complete (2) cookie 94860758303088 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbf0800ecc0 con 0x7fbf04079060 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.590+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.590+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dcd3670 con 0x7fbf04079060 2023-12-07T21:09:15.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.591+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(68 foo:foo2 [delete] v31'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.593 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:15.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.592+0000 7fbed77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.592+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94860758053888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc84ba0 con 0x56467dc88070 2023-12-07T21:09:15.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.593+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94860758053888] v31'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.593+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94860755611472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dcb7740 con 0x7fbf04079060 2023-12-07T21:09:15.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.594+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94860755611472] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.594+0000 7fbf13e85800 20 remove_watcher() i=0 2023-12-07T21:09:15.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.594+0000 7fbf13e85800 2 removed watcher, disabling cache 2023-12-07T21:09:15.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.594+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94860758034064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc84ba0 con 0x56467dc88070 2023-12-07T21:09:15.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.595+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94860758034064] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.595+0000 7fbf13e85800 20 remove_watcher() i=1 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.595+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94860758038944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc84ba0 con 0x56467dc8e190 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.596+0000 7fbf11985640 1 -- 172.21.15.121:0/1902423500 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94860758038944] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf04059040 con 0x56467dc8e190 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.596+0000 7fbf13e85800 20 remove_watcher() i=2 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.596+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94860758044064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc84f00 con 0x7fbf04079060 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.597+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94860758044064] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0800f620 con 0x7fbf04079060 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.597+0000 7fbf13e85800 20 remove_watcher() i=3 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.597+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94860758049120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc84f00 con 0x56467dc88070 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.598+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94860758049120] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x56467dc88070 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.598+0000 7fbf13e85800 20 remove_watcher() i=4 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.598+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94860758047072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc84f00 con 0x7fbf0800e8a0 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.599+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94860758047072] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.599+0000 7fbf13e85800 20 remove_watcher() i=5 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.599+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94860758052848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc95960 con 0x7fbf0800e8a0 2023-12-07T21:09:15.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.600+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94860758052848] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.600+0000 7fbf13e85800 20 remove_watcher() i=6 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.600+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94860758056704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56467dc95960 con 0x7fbf0800e8a0 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf12186640 1 -- 172.21.15.121:0/1902423500 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94860758056704] v31'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbf0c02e9d0 con 0x7fbf0800e8a0 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 20 remove_watcher() i=7 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fbf0800e8a0 msgr2=0x7fbf0800d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fbf0800e8a0 0x7fbf0800d2f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56467dc88070 msgr2=0x56467dc8a530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56467dc88070 0x56467dc8a530 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fbf04079060 msgr2=0x7fbf0406e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fbf04079060 0x7fbf0406e9b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56467dc8e190 msgr2=0x56467dc90620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56467dc8e190 0x56467dc90620 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbeec036110 msgr2=0x7fbeec0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbeec036110 0x7fbeec0385d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbf08000c00 tx=0x7fbf08001330 comp rx=0 tx=0).stop 2023-12-07T21:09:15.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 msgr2=0x56467dc7c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 --2- 172.21.15.121:0/1902423500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dc759c0 0x56467dc7c9f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c00a930 tx=0x7fbf0c003370 comp rx=0 tx=0).stop 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 reap_dead start 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf11184640 1 -- 172.21.15.121:0/1902423500 reap_dead start 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 shutdown_connections 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 >> 172.21.15.121:0/1902423500 conn(0x56467dbbd140 msgr2=0x56467dc70970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 shutdown_connections 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.601+0000 7fbf13e85800 1 -- 172.21.15.121:0/1902423500 wait complete. 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.602+0000 7fbf13e85800 1 -- 172.21.15.121:0/94214050 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbef4036110 msgr2=0x7fbef40385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.602+0000 7fbf13e85800 1 --2- 172.21.15.121:0/94214050 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbef4036110 0x7fbef40385d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf0406e710 tx=0x7fbf0405cf40 comp rx=0 tx=0).stop 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.602+0000 7fbf13e85800 1 -- 172.21.15.121:0/94214050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 msgr2=0x56467dbbbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.602+0000 7fbf13e85800 1 --2- 172.21.15.121:0/94214050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dbbbd90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbf0405f040 tx=0x7fbf04002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.602+0000 7fbf13e85800 1 -- 172.21.15.121:0/94214050 shutdown_connections 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.602+0000 7fbf13e85800 1 --2- 172.21.15.121:0/94214050 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbef4036110 0x7fbef40385d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.602+0000 7fbf13e85800 1 --2- 172.21.15.121:0/94214050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56467dbbc7e0 0x56467dbbbd90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.602+0000 7fbf13e85800 1 -- 172.21.15.121:0/94214050 >> 172.21.15.121:0/94214050 conn(0x56467dbb4f00 msgr2=0x56467dc5ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.602+0000 7fbf13e85800 1 -- 172.21.15.121:0/94214050 shutdown_connections 2023-12-07T21:09:15.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.602+0000 7fbf13e85800 1 -- 172.21.15.121:0/94214050 wait complete. 2023-12-07T21:09:15.601 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:15.601 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2023-12-07T21:09:15.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2023-12-07T21:09:15.602 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2023-12-07T21:09:15.644 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:15.644 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:15.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.652+0000 7fb488522800 1 Processor -- start 2023-12-07T21:09:15.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.652+0000 7fb488522800 1 -- start start 2023-12-07T21:09:15.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.652+0000 7fb488522800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558a6ca3c6d0 0x558a6ca3caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.652+0000 7fb488522800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558a6c9887a0 con 0x558a6ca3b390 2023-12-07T21:09:15.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.652+0000 7fb488522800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x558a6c951880 con 0x558a6ca3c6d0 2023-12-07T21:09:15.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.652+0000 7fb48427e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558a6ca3c6d0 0x558a6ca3caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.652+0000 7fb483a7d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x558a6ca3b390 0x558a6ca3b840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55704/0 (socket says 172.21.15.121:55704) 2023-12-07T21:09:15.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.652+0000 7fb483a7d640 1 -- 172.21.15.121:0/3962946346 learned_addr learned my addr 172.21.15.121:0/3962946346 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:15.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.652+0000 7fb48427e640 1 -- 172.21.15.121:0/3962946346 >> v1:172.21.15.89:6789/0 conn(0x558a6ca3b390 legacy=0x558a6ca3b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.652+0000 7fb48427e640 1 -- 172.21.15.121:0/3962946346 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a6ca3d1c0 con 0x558a6ca3c6d0 2023-12-07T21:09:15.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.652+0000 7fb48327c640 1 -- 172.21.15.121:0/3962946346 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963131444 0 0) 0x558a6c9887a0 con 0x558a6ca3b390 2023-12-07T21:09:15.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.654+0000 7fb48427e640 1 --2- 172.21.15.121:0/3962946346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3c6d0 0x558a6ca3caf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb47400a470 tx=0x7fb47401cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879ce6837d524329 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.654+0000 7fb48327c640 1 -- 172.21.15.121:0/3962946346 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb47404ac60 con 0x558a6ca3c6d0 2023-12-07T21:09:15.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.654+0000 7fb48327c640 1 -- 172.21.15.121:0/3962946346 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47404adc0 con 0x558a6ca3c6d0 2023-12-07T21:09:15.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.654+0000 7fb48327c640 1 -- 172.21.15.121:0/3962946346 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb474052590 con 0x558a6ca3c6d0 2023-12-07T21:09:15.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.655+0000 7fb488522800 1 -- 172.21.15.121:0/3962946346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3c6d0 msgr2=0x558a6ca3caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.655+0000 7fb488522800 1 --2- 172.21.15.121:0/3962946346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3c6d0 0x558a6ca3caf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb47400a470 tx=0x7fb47401cb80 comp rx=0 tx=0).stop 2023-12-07T21:09:15.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.655+0000 7fb488522800 1 -- 172.21.15.121:0/3962946346 shutdown_connections 2023-12-07T21:09:15.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.655+0000 7fb488522800 1 --2- 172.21.15.121:0/3962946346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3c6d0 0x558a6ca3caf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.655+0000 7fb488522800 1 -- 172.21.15.121:0/3962946346 >> 172.21.15.121:0/3962946346 conn(0x558a6ca35f60 msgr2=0x558a6ca38380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.655+0000 7fb488522800 1 -- 172.21.15.121:0/3962946346 shutdown_connections 2023-12-07T21:09:15.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.655+0000 7fb488522800 1 -- 172.21.15.121:0/3962946346 wait complete. 2023-12-07T21:09:15.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.656+0000 7fb488522800 1 Processor -- start 2023-12-07T21:09:15.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.656+0000 7fb488522800 1 -- start start 2023-12-07T21:09:15.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.656+0000 7fb488522800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6cadeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.656+0000 7fb488522800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c94edb0 con 0x558a6ca3b390 2023-12-07T21:09:15.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.656+0000 7fb48427e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6cadeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.656+0000 7fb48427e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6cadeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54232/0 (socket says 172.21.15.121:54232) 2023-12-07T21:09:15.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.656+0000 7fb48427e640 1 -- 172.21.15.121:0/642744196 learned_addr learned my addr 172.21.15.121:0/642744196 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.656+0000 7fb48427e640 1 -- 172.21.15.121:0/642744196 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474005d20 con 0x558a6ca3b390 2023-12-07T21:09:15.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.656+0000 7fb48427e640 1 --2- 172.21.15.121:0/642744196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6cadeee0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb474000c00 tx=0x7fb47404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bea50aeb90b030 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.657+0000 7fb482a7b640 1 -- 172.21.15.121:0/642744196 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb47400a180 con 0x558a6ca3b390 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.657+0000 7fb482a7b640 1 -- 172.21.15.121:0/642744196 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47400a2e0 con 0x558a6ca3b390 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.657+0000 7fb482a7b640 1 -- 172.21.15.121:0/642744196 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb47405c590 con 0x558a6ca3b390 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.657+0000 7fb488522800 1 -- 172.21.15.121:0/642744196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 msgr2=0x558a6cadeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.657+0000 7fb488522800 1 --2- 172.21.15.121:0/642744196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6cadeee0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb474000c00 tx=0x7fb47404c000 comp rx=0 tx=0).stop 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.657+0000 7fb488522800 1 -- 172.21.15.121:0/642744196 shutdown_connections 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.657+0000 7fb488522800 1 --2- 172.21.15.121:0/642744196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6cadeee0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.657+0000 7fb488522800 1 -- 172.21.15.121:0/642744196 >> 172.21.15.121:0/642744196 conn(0x558a6ca35f60 msgr2=0x558a6cadab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.657+0000 7fb488522800 1 -- 172.21.15.121:0/642744196 shutdown_connections 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.657+0000 7fb488522800 1 -- 172.21.15.121:0/642744196 wait complete. 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.657+0000 7fb488522800 1 Processor -- start 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.658+0000 7fb488522800 1 -- start start 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.658+0000 7fb488522800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6caea660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.658+0000 7fb488522800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c94a6a0 con 0x558a6ca3b390 2023-12-07T21:09:15.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.658+0000 7fb48427e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6caea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.658+0000 7fb48427e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6caea660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54244/0 (socket says 172.21.15.121:54244) 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.658+0000 7fb48427e640 1 -- 172.21.15.121:0/3595139456 learned_addr learned my addr 172.21.15.121:0/3595139456 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.658+0000 7fb48427e640 1 -- 172.21.15.121:0/3595139456 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a6ca3d1c0 con 0x558a6ca3b390 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.658+0000 7fb48427e640 1 --2- 172.21.15.121:0/3595139456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6caea660 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb474000c00 tx=0x7fb474002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.658+0000 7fb481a79640 1 -- 172.21.15.121:0/3595139456 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb47405c880 con 0x558a6ca3b390 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.658+0000 7fb481a79640 1 -- 172.21.15.121:0/3595139456 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47405c9e0 con 0x558a6ca3b390 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.658+0000 7fb488522800 1 -- 172.21.15.121:0/3595139456 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a6caeaba0 con 0x558a6ca3b390 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.659+0000 7fb481a79640 1 -- 172.21.15.121:0/3595139456 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb47405cca0 con 0x558a6ca3b390 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.659+0000 7fb488522800 1 -- 172.21.15.121:0/3595139456 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a6caeb080 con 0x558a6ca3b390 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.659+0000 7fb488522800 1 Processor -- start 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.659+0000 7fb488522800 1 -- start start 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.659+0000 7fb488522800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6caf6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.659+0000 7fb488522800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c8e4890 con 0x558a6caf68b0 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.659+0000 7fb481a79640 1 -- 172.21.15.121:0/3595139456 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fb47406d070 con 0x558a6ca3b390 2023-12-07T21:09:15.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.659+0000 7fb484a7f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6caf6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb484a7f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6caf6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54246/0 (socket says 172.21.15.121:54246) 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb484a7f640 1 -- 172.21.15.121:0/1906977247 learned_addr learned my addr 172.21.15.121:0/1906977247 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb481a79640 1 --2- 172.21.15.121:0/3595139456 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb470036110 0x7fb4700385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb481a79640 1 -- 172.21.15.121:0/3595139456 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fb47408d050 con 0x558a6ca3b390 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb48427e640 1 --2- 172.21.15.121:0/3595139456 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb470036110 0x7fb4700385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb484a7f640 1 -- 172.21.15.121:0/1906977247 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a6caf7210 con 0x558a6caf68b0 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb484a7f640 1 --2- 172.21.15.121:0/1906977247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6caf6cd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00a430 tx=0x7fb47c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9a1118317e20 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb48427e640 1 --2- 172.21.15.121:0/3595139456 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb470036110 0x7fb4700385d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb47405cf70 tx=0x7fb47405cee0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb46b7fe640 1 -- 172.21.15.121:0/1906977247 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb47c001650 con 0x558a6caf68b0 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb46b7fe640 1 -- 172.21.15.121:0/1906977247 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c0017d0 con 0x558a6caf68b0 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb46b7fe640 1 -- 172.21.15.121:0/1906977247 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb47c001ab0 con 0x558a6caf68b0 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb488522800 1 -- 172.21.15.121:0/1906977247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 msgr2=0x558a6caf6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.660+0000 7fb488522800 1 --2- 172.21.15.121:0/1906977247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6caf6cd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00a430 tx=0x7fb47c00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb488522800 1 -- 172.21.15.121:0/1906977247 shutdown_connections 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb488522800 1 --2- 172.21.15.121:0/1906977247 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6caf6cd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb488522800 1 -- 172.21.15.121:0/1906977247 >> 172.21.15.121:0/1906977247 conn(0x558a6ca3c6d0 msgr2=0x558a6caf1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb488522800 1 -- 172.21.15.121:0/1906977247 shutdown_connections 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb488522800 1 -- 172.21.15.121:0/1906977247 wait complete. 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb488522800 1 Processor -- start 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb488522800 1 -- start start 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb488522800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6cafd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb488522800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c8e4530 con 0x558a6caf68b0 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb484a7f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6cafd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb484a7f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6cafd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54262/0 (socket says 172.21.15.121:54262) 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.661+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 learned_addr learned my addr 172.21.15.121:0/1774624478 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.662+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c00a0e0 con 0x558a6caf68b0 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.662+0000 7fb484a7f640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6cafd8c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00a930 tx=0x7fb47c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.662+0000 7fb469ffb640 1 -- 172.21.15.121:0/1774624478 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb47c010900 con 0x558a6caf68b0 2023-12-07T21:09:15.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.662+0000 7fb469ffb640 1 -- 172.21.15.121:0/1774624478 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c010a60 con 0x558a6caf68b0 2023-12-07T21:09:15.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.662+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558a6cafde00 con 0x558a6caf68b0 2023-12-07T21:09:15.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.662+0000 7fb469ffb640 1 -- 172.21.15.121:0/1774624478 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb47c010d20 con 0x558a6caf68b0 2023-12-07T21:09:15.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.662+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a6cafe260 con 0x558a6caf68b0 2023-12-07T21:09:15.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.663+0000 7fb469ffb640 1 -- 172.21.15.121:0/1774624478 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fb47c017030 con 0x558a6caf68b0 2023-12-07T21:09:15.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.663+0000 7fb469ffb640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb45c036110 0x7fb45c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.663+0000 7fb469ffb640 1 -- 172.21.15.121:0/1774624478 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fb47c04b7d0 con 0x558a6caf68b0 2023-12-07T21:09:15.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.663+0000 7fb483a7d640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb45c036110 0x7fb45c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.663+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.663+0000 7fb488522800 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558a6cb08fa0 0x558a6cb0b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.663+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb0bbb0 con 0x558a6cb08fa0 2023-12-07T21:09:15.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.663+0000 7fb483a7d640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb45c036110 0x7fb45c0385d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb478000c00 tx=0x7fb478001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.663+0000 7fb484a7f640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558a6cb08fa0 0x558a6cb0b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb484a7f640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558a6cb08fa0 0x558a6cb0b460 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb488522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb488522800 20 realm 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb0bfa0 con 0x558a6cb08fa0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb488522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb488522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb0c820 con 0x558a6cb08fa0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb488522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.664+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb0cb80 con 0x558a6cb08fa0 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.665+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.665+0000 7fb488522800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.665+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.665+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb0c480 con 0x558a6cb08fa0 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.665+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.665+0000 7fb488522800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.665+0000 7fb488522800 20 searching for the correct realm 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.665+0000 7fb488522800 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558a6cb0ed90 0x558a6cb11180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.665+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb0ed90 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.665+0000 7fb48427e640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558a6cb0ed90 0x558a6cb11180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.665+0000 7fb48427e640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558a6cb0ed90 0x558a6cb11180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.666+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.666+0000 7fb48427e640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb474009410 0x7fb4740720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.666+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb474009410 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.666+0000 7fb483a7d640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb474009410 0x7fb4740720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.666+0000 7fb483a7d640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb474009410 0x7fb4740720c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.666+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.666+0000 7fb483a7d640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb47800e8a0 0x7fb47800d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.666+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb47800e8a0 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.667+0000 7fb484a7f640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb47800e8a0 0x7fb47800d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.667+0000 7fb484a7f640 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb47800e8a0 0x7fb47800d2f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.667+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.667+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb08fa0 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.667+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.667+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb08fa0 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.667+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.667+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb47800e8a0 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.668+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.668+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb47800e8a0 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.668+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.668+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb474009410 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.668+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.668+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb0ed90 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.668+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.668+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb08fa0 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.669+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.669+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb47800e8a0 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.669+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.669+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb08fa0 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.669+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.669+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb474009410 2023-12-07T21:09:15.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.669+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.669+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb0ed90 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.670+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.670+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb0ed90 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.670+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.670+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb47800e8a0 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.670+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.670+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb0ed90 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.670+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.670+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb0ed90 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.670+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.670+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb08fa0 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.671+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.671+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb08fa0 2023-12-07T21:09:15.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.671+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.671+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb47800e8a0 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.671+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.671+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb0ed90 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.671+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.671+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb474009410 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.672+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.672+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb08fa0 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.672+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.672+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb47800e8a0 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.672+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.672+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb0ed90 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.672+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.672+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb47800e8a0 2023-12-07T21:09:15.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.673+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.673+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb474009410 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.673+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.673+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb0ed90 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.673+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.673+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x7fb47800e8a0 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11710 con 0x558a6cb08fa0 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb47c053080 con 0x7fb474009410 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb488522800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb488522800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb488522800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:15.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb488522800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb488522800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb488522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb0da10 con 0x558a6cb08fa0 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb488522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.674+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb0d690 con 0x558a6cb08fa0 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb0e2e0 con 0x558a6cb0ed90 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:15.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 20 zone default found 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 4 Realm: () 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 20 zonegroup default 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb11b50 con 0x7fb47800e8a0 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.675+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb13910 con 0x558a6cb0ed90 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.676+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.676+0000 7fb488522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.676+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.676+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb13c70 con 0x558a6cb0ed90 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.676+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.676+0000 7fb488522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.676+0000 7fb488522800 20 started sync module instance, tier type = 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.676+0000 7fb488522800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.676+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb131f0 con 0x7fb474009410 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.677+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.677+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94053014978384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb135a0 con 0x7fb474009410 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.677+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb14500 con 0x558a6cb08fa0 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.678+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94053014978384] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.679+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.679+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94053017398608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb14540 con 0x558a6cb08fa0 2023-12-07T21:09:15.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.679+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb15000 con 0x558a6cb0ed90 2023-12-07T21:09:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.680+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.680+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94053017406144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb15850 con 0x558a6cb0ed90 2023-12-07T21:09:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.680+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb16230 con 0x7fb474009410 2023-12-07T21:09:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.680+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94053017398608] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.681+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94053017406144] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.681+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.681+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94053017403488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb16610 con 0x7fb474009410 2023-12-07T21:09:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.681+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb16e10 con 0x558a6cb08fa0 2023-12-07T21:09:15.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.682+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.682+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94053017414272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb17470 con 0x558a6cb08fa0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.682+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb17f40 con 0x7fb47800e8a0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.682+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94053017403488] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.683+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.683+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94053017414272] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.683+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94053017418272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb17f00 con 0x7fb47800e8a0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.683+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb16f30 con 0x7fb47800e8a0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.684+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94053017418272] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.684+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.684+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94053017415472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb182f0 con 0x7fb47800e8a0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.684+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb18c60 con 0x7fb47800e8a0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.685+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.685+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94053017415472] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.685+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94053017421760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb19070 con 0x7fb47800e8a0 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.685+0000 7fb488522800 20 add_watcher() i=0 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.685+0000 7fb488522800 20 add_watcher() i=1 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.685+0000 7fb488522800 20 add_watcher() i=2 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.685+0000 7fb488522800 20 add_watcher() i=3 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.685+0000 7fb488522800 20 add_watcher() i=4 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.685+0000 7fb488522800 20 add_watcher() i=5 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.685+0000 7fb488522800 20 add_watcher() i=6 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.686+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94053017421760] v31'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.686+0000 7fb488522800 20 add_watcher() i=7 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.686+0000 7fb488522800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.686+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb19070 con 0x558a6cb08fa0 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.686+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.686+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94053017422800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb18fe0 con 0x558a6cb08fa0 2023-12-07T21:09:15.689 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.687+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94053017422800] v31'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.687+0000 7fb44a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.688+0000 7fb488522800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.688+0000 7fb488522800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.688+0000 7fb488522800 5 note: GC not initialized 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.688+0000 7fb4497e2640 20 reqs_thread_entry: start 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.688+0000 7fb488522800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.688+0000 7fb488522800 20 Filter name: none 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.688+0000 7fb3baffd640 20 reqs_thread_entry: start 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.688+0000 7fb488522800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.688+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb4ebd0 con 0x558a6cb08fa0 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.690+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.690+0000 7fb488522800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.690+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb4ebd0 con 0x7fb474009410 2023-12-07T21:09:15.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.691+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.691+0000 7fb44a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.691+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94053017422800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb06520 con 0x558a6cb08fa0 2023-12-07T21:09:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.692+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94053017422800] v31'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.692+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94053014978384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb06520 con 0x7fb474009410 2023-12-07T21:09:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.693+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94053014978384] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.693+0000 7fb488522800 20 remove_watcher() i=0 2023-12-07T21:09:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.693+0000 7fb488522800 2 removed watcher, disabling cache 2023-12-07T21:09:15.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.693+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94053017398608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb06880 con 0x558a6cb08fa0 2023-12-07T21:09:15.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.694+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94053017398608] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.694+0000 7fb488522800 20 remove_watcher() i=1 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.694+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94053017406144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb06880 con 0x558a6cb0ed90 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.695+0000 7fb48427e640 1 -- 172.21.15.121:0/1774624478 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94053017406144] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47406c030 con 0x558a6cb0ed90 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.695+0000 7fb488522800 20 remove_watcher() i=2 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.695+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94053017403488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb06be0 con 0x7fb474009410 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.696+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94053017403488] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47800f620 con 0x7fb474009410 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.696+0000 7fb488522800 20 remove_watcher() i=3 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.696+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94053017414272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb4d340 con 0x558a6cb08fa0 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.698+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94053017414272] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x558a6cb08fa0 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.698+0000 7fb488522800 20 remove_watcher() i=4 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.698+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94053017418272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb4d340 con 0x7fb47800e8a0 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.699+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94053017418272] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.699+0000 7fb488522800 20 remove_watcher() i=5 2023-12-07T21:09:15.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.699+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94053017415472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb17a20 con 0x7fb47800e8a0 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.699+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94053017415472] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.699+0000 7fb488522800 20 remove_watcher() i=6 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.699+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94053017421760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558a6cb16f30 con 0x7fb47800e8a0 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.700+0000 7fb484a7f640 1 -- 172.21.15.121:0/1774624478 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94053017421760] v31'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb47c02e9d0 con 0x7fb47800e8a0 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.700+0000 7fb488522800 20 remove_watcher() i=7 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.700+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb47800e8a0 msgr2=0x7fb47800d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.700+0000 7fb488522800 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb47800e8a0 0x7fb47800d2f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.700+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558a6cb08fa0 msgr2=0x558a6cb0b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.700+0000 7fb488522800 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558a6cb08fa0 0x558a6cb0b460 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.700+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb474009410 msgr2=0x7fb4740720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.700+0000 7fb488522800 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb474009410 0x7fb4740720c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.700+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558a6cb0ed90 msgr2=0x558a6cb11180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.700+0000 7fb488522800 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558a6cb0ed90 0x558a6cb11180 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb45c036110 msgr2=0x7fb45c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb45c036110 0x7fb45c0385d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb478000c00 tx=0x7fb478001330 comp rx=0 tx=0).stop 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 msgr2=0x558a6cafd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6cafd8c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00a930 tx=0x7fb47c003370 comp rx=0 tx=0).stop 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb483a7d640 1 -- 172.21.15.121:0/1774624478 reap_dead start 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 shutdown_connections 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 --2- 172.21.15.121:0/1774624478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6caf68b0 0x558a6cafd8c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 >> 172.21.15.121:0/1774624478 conn(0x558a6ca3c6d0 msgr2=0x558a6caf0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 shutdown_connections 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/1774624478 wait complete. 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/3595139456 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb470036110 msgr2=0x7fb4700385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 --2- 172.21.15.121:0/3595139456 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb470036110 0x7fb4700385d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb47405cf70 tx=0x7fb47405cee0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/3595139456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 msgr2=0x558a6caea660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 --2- 172.21.15.121:0/3595139456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6caea660 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb474000c00 tx=0x7fb474002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/3595139456 shutdown_connections 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 --2- 172.21.15.121:0/3595139456 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb470036110 0x7fb4700385d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 --2- 172.21.15.121:0/3595139456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558a6ca3b390 0x558a6caea660 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/3595139456 >> 172.21.15.121:0/3595139456 conn(0x558a6ca35f60 msgr2=0x558a6caddbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/3595139456 shutdown_connections 2023-12-07T21:09:15.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.701+0000 7fb488522800 1 -- 172.21.15.121:0/3595139456 wait complete. 2023-12-07T21:09:15.698 INFO:teuthology.orchestra.run.smithi121.stdout:[] 2023-12-07T21:09:15.699 DEBUG:tasks.util.rgw: json result: [] 2023-12-07T21:09:15.699 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2023-12-07T21:09:15.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2023-12-07T21:09:15.699 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2023-12-07T21:09:15.781 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:15.781 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:15.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.789+0000 7f952d22e800 1 Processor -- start 2023-12-07T21:09:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.789+0000 7f952d22e800 1 -- start start 2023-12-07T21:09:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.789+0000 7f952d22e800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558cd180e840 0x558cd180ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.789+0000 7f952d22e800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558cd17597a0 con 0x558cd180f1a0 2023-12-07T21:09:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.789+0000 7f952d22e800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x558cd1722880 con 0x558cd180e840 2023-12-07T21:09:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.789+0000 7f952845c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558cd180e840 0x558cd180ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.789+0000 7f952845c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558cd180e840 0x558cd180ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54270/0 (socket says 172.21.15.121:54270) 2023-12-07T21:09:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.789+0000 7f9527c5b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x558cd180f1a0 0x558cd180b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55716/0 (socket says 172.21.15.121:55716) 2023-12-07T21:09:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.789+0000 7f952845c640 1 -- 172.21.15.121:0/3735422162 learned_addr learned my addr 172.21.15.121:0/3735422162 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.790+0000 7f952845c640 1 -- 172.21.15.121:0/3735422162 >> v1:172.21.15.89:6789/0 conn(0x558cd180f1a0 legacy=0x558cd180b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.790+0000 7f952745a640 1 -- 172.21.15.121:0/3735422162 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540783663 0 0) 0x558cd17597a0 con 0x558cd180f1a0 2023-12-07T21:09:15.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.790+0000 7f952845c640 1 -- 172.21.15.121:0/3735422162 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cd180bb60 con 0x558cd180e840 2023-12-07T21:09:15.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.792+0000 7f952845c640 1 --2- 172.21.15.121:0/3735422162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd180ec60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f952000a520 tx=0x7f952001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe4624c0e540b7a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.792+0000 7f952745a640 1 -- 172.21.15.121:0/3735422162 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9520052570 con 0x558cd180e840 2023-12-07T21:09:15.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.792+0000 7f952745a640 1 -- 172.21.15.121:0/3735422162 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95200526d0 con 0x558cd180e840 2023-12-07T21:09:15.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.792+0000 7f952745a640 1 -- 172.21.15.121:0/3735422162 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9520052990 con 0x558cd180e840 2023-12-07T21:09:15.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.793+0000 7f952d22e800 1 -- 172.21.15.121:0/3735422162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 msgr2=0x558cd180ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.793+0000 7f952d22e800 1 --2- 172.21.15.121:0/3735422162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd180ec60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f952000a520 tx=0x7f952001cee0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.793+0000 7f952d22e800 1 -- 172.21.15.121:0/3735422162 shutdown_connections 2023-12-07T21:09:15.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.793+0000 7f952d22e800 1 --2- 172.21.15.121:0/3735422162 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd180ec60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.793+0000 7f952d22e800 1 -- 172.21.15.121:0/3735422162 >> 172.21.15.121:0/3735422162 conn(0x558cd1806f60 msgr2=0x558cd1809380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.793+0000 7f952d22e800 1 -- 172.21.15.121:0/3735422162 shutdown_connections 2023-12-07T21:09:15.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.793+0000 7f952d22e800 1 -- 172.21.15.121:0/3735422162 wait complete. 2023-12-07T21:09:15.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.793+0000 7f952d22e800 1 Processor -- start 2023-12-07T21:09:15.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.793+0000 7f952d22e800 1 -- start start 2023-12-07T21:09:15.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.794+0000 7f952d22e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.794+0000 7f952d22e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd171fdb0 con 0x558cd180e840 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.794+0000 7f952845c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.794+0000 7f952845c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54286/0 (socket says 172.21.15.121:54286) 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.794+0000 7f952845c640 1 -- 172.21.15.121:0/2068542905 learned_addr learned my addr 172.21.15.121:0/2068542905 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.794+0000 7f952845c640 1 -- 172.21.15.121:0/2068542905 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9520005de0 con 0x558cd180e840 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.794+0000 7f952845c640 1 --2- 172.21.15.121:0/2068542905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b21e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9520000c00 tx=0x7f952004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4f6170b9cf5a4e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.794+0000 7f9526c59640 1 -- 172.21.15.121:0/2068542905 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9520052840 con 0x558cd180e840 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.794+0000 7f9526c59640 1 -- 172.21.15.121:0/2068542905 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95200529a0 con 0x558cd180e840 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.794+0000 7f9526c59640 1 -- 172.21.15.121:0/2068542905 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9520052c80 con 0x558cd180e840 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952d22e800 1 -- 172.21.15.121:0/2068542905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 msgr2=0x558cd18b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952d22e800 1 --2- 172.21.15.121:0/2068542905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b21e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9520000c00 tx=0x7f952004c000 comp rx=0 tx=0).stop 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952d22e800 1 -- 172.21.15.121:0/2068542905 shutdown_connections 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952d22e800 1 --2- 172.21.15.121:0/2068542905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b21e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952d22e800 1 -- 172.21.15.121:0/2068542905 >> 172.21.15.121:0/2068542905 conn(0x558cd1806f60 msgr2=0x558cd18ade50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952d22e800 1 -- 172.21.15.121:0/2068542905 shutdown_connections 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952d22e800 1 -- 172.21.15.121:0/2068542905 wait complete. 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952d22e800 1 Processor -- start 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952d22e800 1 -- start start 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952d22e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952d22e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd171b6a0 con 0x558cd180e840 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952845c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952845c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54290/0 (socket says 172.21.15.121:54290) 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.795+0000 7f952845c640 1 -- 172.21.15.121:0/1397414404 learned_addr learned my addr 172.21.15.121:0/1397414404 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.796+0000 7f952845c640 1 -- 172.21.15.121:0/1397414404 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cd180bb60 con 0x558cd180e840 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.796+0000 7f952845c640 1 --2- 172.21.15.121:0/1397414404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b9500 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f952001ceb0 tx=0x7f9520002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.796+0000 7f9525c57640 1 -- 172.21.15.121:0/1397414404 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f952006d070 con 0x558cd180e840 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.796+0000 7f9525c57640 1 -- 172.21.15.121:0/1397414404 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520052e70 con 0x558cd180e840 2023-12-07T21:09:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.796+0000 7f952d22e800 1 -- 172.21.15.121:0/1397414404 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558cd18b9a40 con 0x558cd180e840 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.796+0000 7f9525c57640 1 -- 172.21.15.121:0/1397414404 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f952005d5d0 con 0x558cd180e840 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.796+0000 7f952d22e800 1 -- 172.21.15.121:0/1397414404 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cd18b9f80 con 0x558cd180e840 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.796+0000 7f952d22e800 1 Processor -- start 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.796+0000 7f952d22e800 1 -- start start 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f9525c57640 1 -- 172.21.15.121:0/1397414404 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f9520059040 con 0x558cd180e840 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f952d22e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 0x558cd180c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f952d22e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd16b5890 con 0x558cd180e030 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f9525c57640 1 --2- 172.21.15.121:0/1397414404 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9508036110 0x7f95080385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f9525c57640 1 -- 172.21.15.121:0/1397414404 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f952008cc80 con 0x558cd180e840 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f9528c5d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 0x558cd180c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f9528c5d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 0x558cd180c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54296/0 (socket says 172.21.15.121:54296) 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f9528c5d640 1 -- 172.21.15.121:0/2521043647 learned_addr learned my addr 172.21.15.121:0/2521043647 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f952845c640 1 --2- 172.21.15.121:0/1397414404 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9508036110 0x7f95080385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f9528c5d640 1 -- 172.21.15.121:0/2521043647 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cd180cac0 con 0x558cd180e030 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f952845c640 1 --2- 172.21.15.121:0/1397414404 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9508036110 0x7f95080385d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9520052950 tx=0x7f9520079770 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f9528c5d640 1 --2- 172.21.15.121:0/2521043647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 0x558cd180c580 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f951800a430 tx=0x7f951800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f22c4b44ab59b44 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f951f7fe640 1 -- 172.21.15.121:0/2521043647 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9518001650 con 0x558cd180e030 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f951f7fe640 1 -- 172.21.15.121:0/2521043647 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95180017d0 con 0x558cd180e030 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.797+0000 7f951f7fe640 1 -- 172.21.15.121:0/2521043647 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9518001ab0 con 0x558cd180e030 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f952d22e800 1 -- 172.21.15.121:0/2521043647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 msgr2=0x558cd180c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f952d22e800 1 --2- 172.21.15.121:0/2521043647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 0x558cd180c580 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f951800a430 tx=0x7f951800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f952d22e800 1 -- 172.21.15.121:0/2521043647 shutdown_connections 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f952d22e800 1 --2- 172.21.15.121:0/2521043647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 0x558cd180c580 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f952d22e800 1 -- 172.21.15.121:0/2521043647 >> 172.21.15.121:0/2521043647 conn(0x558cd180f1a0 msgr2=0x558cd18c0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f952d22e800 1 -- 172.21.15.121:0/2521043647 shutdown_connections 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f952d22e800 1 -- 172.21.15.121:0/2521043647 wait complete. 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f952d22e800 1 Processor -- start 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f952d22e800 1 -- start start 2023-12-07T21:09:15.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f952d22e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 0x558cd18ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f952d22e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cd16b5530 con 0x558cd180e030 2023-12-07T21:09:15.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.798+0000 7f9528c5d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 0x558cd18ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.799+0000 7f9528c5d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 0x558cd18ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54302/0 (socket says 172.21.15.121:54302) 2023-12-07T21:09:15.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.799+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 learned_addr learned my addr 172.21.15.121:0/3456134903 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.799+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951800a0e0 con 0x558cd180e030 2023-12-07T21:09:15.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.799+0000 7f9528c5d640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 0x558cd18ce9d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f951800a930 tx=0x7f9518003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.799+0000 7f951dffb640 1 -- 172.21.15.121:0/3456134903 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9518010900 con 0x558cd180e030 2023-12-07T21:09:15.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.799+0000 7f951dffb640 1 -- 172.21.15.121:0/3456134903 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518010a60 con 0x558cd180e030 2023-12-07T21:09:15.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.799+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558cd18cef10 con 0x558cd180e030 2023-12-07T21:09:15.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.799+0000 7f951dffb640 1 -- 172.21.15.121:0/3456134903 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9518010d20 con 0x558cd180e030 2023-12-07T21:09:15.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.799+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cd18cf370 con 0x558cd180e030 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.800+0000 7f951dffb640 1 -- 172.21.15.121:0/3456134903 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f9518017030 con 0x558cd180e030 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.800+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.800+0000 7f951dffb640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9500036110 0x7f95000385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.800+0000 7f951dffb640 1 -- 172.21.15.121:0/3456134903 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f951804b7a0 con 0x558cd180e030 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.800+0000 7f9527c5b640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9500036110 0x7f95000385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.800+0000 7f952d22e800 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558cd18da160 0x558cd18dc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.800+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18dcd70 con 0x558cd18da160 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.800+0000 7f9528c5d640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558cd18da160 0x558cd18dc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f9527c5b640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9500036110 0x7f95000385d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9510000c00 tx=0x7f9510001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f9528c5d640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558cd18da160 0x558cd18dc620 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f952d22e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f952d22e800 20 realm 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18dd140 con 0x558cd18da160 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f952d22e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f952d22e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18dd990 con 0x558cd18da160 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f952d22e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.801+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18ddcf0 con 0x558cd18da160 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.802+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.802+0000 7f952d22e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.802+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.802+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18dd630 con 0x558cd18da160 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.802+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.802+0000 7f952d22e800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.802+0000 7f952d22e800 20 searching for the correct realm 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.802+0000 7f952d22e800 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558cd18dff40 0x558cd18e2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.802+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18dff40 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.802+0000 7f952845c640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558cd18dff40 0x558cd18e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.802+0000 7f952845c640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558cd18dff40 0x558cd18e2330 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.803+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.803+0000 7f952845c640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f952007b060 0x7f952007a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.803+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f952007b060 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.803+0000 7f9527c5b640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f952007b060 0x7f952007a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.803+0000 7f9527c5b640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f952007b060 0x7f952007a810 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.803+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.803+0000 7f9527c5b640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f951000e8a0 0x7f951000d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.803+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f951000e8a0 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.804+0000 7f9528c5d640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f951000e8a0 0x7f951000d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.804+0000 7f9528c5d640 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f951000e8a0 0x7f951000d2f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.804+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.804+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18da160 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.804+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.804+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18da160 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.805+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.805+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f951000e8a0 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.805+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.805+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f951000e8a0 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.805+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.805+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f952007b060 2023-12-07T21:09:15.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.805+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.805+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18dff40 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.806+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.806+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18da160 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.806+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.806+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f951000e8a0 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.806+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.806+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18da160 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.806+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.806+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f952007b060 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.807+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.807+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18dff40 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.807+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.807+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18dff40 2023-12-07T21:09:15.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.807+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.807+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f951000e8a0 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.807+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.807+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18dff40 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.807+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.808+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18dff40 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.808+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.808+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18da160 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.808+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.808+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18da160 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.808+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.808+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f951000e8a0 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.809+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.809+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18dff40 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.809+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.809+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f952007b060 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.809+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.809+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18da160 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.809+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.809+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f951000e8a0 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.810+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.810+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18dff40 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.810+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.810+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f951000e8a0 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.810+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.810+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f952007b060 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.810+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.810+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18dff40 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.811+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.811+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x7f951000e8a0 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.811+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.811+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e28c0 con 0x558cd18da160 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.811+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.811+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f9518053080 con 0x7f952007b060 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18deb80 con 0x558cd18da160 2023-12-07T21:09:15.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18de800 con 0x558cd18da160 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18df450 con 0x558cd18dff40 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 zone default found 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 4 Realm: () 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:15.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 zonegroup default 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.812+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e2d00 con 0x7f951000e8a0 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952d22e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e4b80 con 0x558cd18dff40 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952d22e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e4ee0 con 0x558cd18dff40 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952d22e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952d22e800 20 started sync module instance, tier type = 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952d22e800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.813+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e4150 con 0x7f952007b060 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.814+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.814+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94063297122128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e45c0 con 0x7f952007b060 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.814+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e56e0 con 0x558cd18da160 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.815+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94063297122128] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.815+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.815+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94063299542192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e56e0 con 0x558cd18da160 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.816+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e6160 con 0x558cd18dff40 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.816+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94063299542192] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.817+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.817+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94063299550304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e64c0 con 0x558cd18dff40 2023-12-07T21:09:15.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.817+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e6e30 con 0x7f952007b060 2023-12-07T21:09:15.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.818+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.818+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94063299555856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e7ac0 con 0x7f952007b060 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.818+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94063299550304] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.818+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e8430 con 0x558cd18da160 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.819+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94063299555856] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.819+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.819+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94063299547712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e8430 con 0x558cd18da160 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.819+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e8c80 con 0x7f951000e8a0 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.820+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.820+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94063299547712] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.820+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94063299560768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e8f10 con 0x7f951000e8a0 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.820+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e7fd0 con 0x7f951000e8a0 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.821+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94063299560768] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.822+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.822+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94063299559376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e94c0 con 0x7f951000e8a0 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.822+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e9e30 con 0x7f951000e8a0 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.823+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.823+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94063299559376] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.823+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94063299565968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18e9da0 con 0x7f951000e8a0 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.823+0000 7f952d22e800 20 add_watcher() i=0 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.823+0000 7f952d22e800 20 add_watcher() i=1 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.823+0000 7f952d22e800 20 add_watcher() i=2 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.823+0000 7f952d22e800 20 add_watcher() i=3 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.823+0000 7f952d22e800 20 add_watcher() i=4 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.823+0000 7f952d22e800 20 add_watcher() i=5 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.823+0000 7f952d22e800 20 add_watcher() i=6 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.824+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94063299565968] v31'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.824+0000 7f952d22e800 20 add_watcher() i=7 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.824+0000 7f952d22e800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.824+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18ed1f0 con 0x558cd18da160 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.824+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.824+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94063299561872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd18ea700 con 0x558cd18da160 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.825+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94063299561872] v31'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.825+0000 7f94ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.825+0000 7f952d22e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.825+0000 7f952d22e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.825+0000 7f952d22e800 5 note: GC not initialized 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.825+0000 7f94ed7e2640 20 reqs_thread_entry: start 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.825+0000 7f952d22e800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.825+0000 7f952d22e800 20 Filter name: none 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.826+0000 7f945effd640 20 reqs_thread_entry: start 2023-12-07T21:09:15.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.826+0000 7f952d22e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.826+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd191fda0 con 0x558cd18da160 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.826+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.826+0000 7f952d22e800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.826+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd1921150 con 0x7f952007b060 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.826+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.827+0000 7f94ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.827+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94063299561872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd191e570 con 0x558cd18da160 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.828+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94063299561872] v31'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.828+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94063297122128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd191e570 con 0x7f952007b060 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.829+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94063297122128] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.829+0000 7f952d22e800 20 remove_watcher() i=0 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.829+0000 7f952d22e800 2 removed watcher, disabling cache 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.829+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94063299542192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd191e8d0 con 0x558cd18da160 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.830+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94063299542192] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.830+0000 7f952d22e800 20 remove_watcher() i=1 2023-12-07T21:09:15.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.830+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94063299550304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd191e8d0 con 0x558cd18dff40 2023-12-07T21:09:15.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.831+0000 7f952845c640 1 -- 172.21.15.121:0/3456134903 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94063299550304] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9520081070 con 0x558cd18dff40 2023-12-07T21:09:15.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.831+0000 7f952d22e800 20 remove_watcher() i=2 2023-12-07T21:09:15.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.831+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94063299555856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd191ec30 con 0x7f952007b060 2023-12-07T21:09:15.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.832+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94063299555856] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951000f620 con 0x7f952007b060 2023-12-07T21:09:15.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.832+0000 7f952d22e800 20 remove_watcher() i=3 2023-12-07T21:09:15.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.832+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94063299547712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd191fd60 con 0x558cd18da160 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.833+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94063299547712] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x558cd18da160 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.833+0000 7f952d22e800 20 remove_watcher() i=4 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.833+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94063299560768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd191fd60 con 0x7f951000e8a0 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.834+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94063299560768] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.834+0000 7f952d22e800 20 remove_watcher() i=5 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.834+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94063299559376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd191fd60 con 0x7f951000e8a0 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.835+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94063299559376] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.835+0000 7f952d22e800 20 remove_watcher() i=6 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.835+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94063299565968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558cd191fd60 con 0x7f951000e8a0 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f9528c5d640 1 -- 172.21.15.121:0/3456134903 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94063299565968] v31'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f951802e9d0 con 0x7f951000e8a0 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 20 remove_watcher() i=7 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f951000e8a0 msgr2=0x7f951000d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f951000e8a0 0x7f951000d2f0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558cd18da160 msgr2=0x558cd18dc620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558cd18da160 0x558cd18dc620 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f952007b060 msgr2=0x7f952007a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f952007b060 0x7f952007a810 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558cd18dff40 msgr2=0x558cd18e2330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558cd18dff40 0x558cd18e2330 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9500036110 msgr2=0x7f95000385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9500036110 0x7f95000385d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9510000c00 tx=0x7f9510001330 comp rx=0 tx=0).stop 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 msgr2=0x558cd18ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 --2- 172.21.15.121:0/3456134903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e030 0x558cd18ce9d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f951800a930 tx=0x7f9518003370 comp rx=0 tx=0).stop 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 reap_dead start 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f9527c5b640 1 -- 172.21.15.121:0/3456134903 reap_dead start 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 shutdown_connections 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 >> 172.21.15.121:0/3456134903 conn(0x558cd180f1a0 msgr2=0x558cd18bf950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 shutdown_connections 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.836+0000 7f952d22e800 1 -- 172.21.15.121:0/3456134903 wait complete. 2023-12-07T21:09:15.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.837+0000 7f952d22e800 1 -- 172.21.15.121:0/1397414404 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9508036110 msgr2=0x7f95080385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.837+0000 7f952d22e800 1 --2- 172.21.15.121:0/1397414404 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9508036110 0x7f95080385d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9520052950 tx=0x7f9520079770 comp rx=0 tx=0).stop 2023-12-07T21:09:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.837+0000 7f952d22e800 1 -- 172.21.15.121:0/1397414404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 msgr2=0x558cd18b9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.837+0000 7f952d22e800 1 --2- 172.21.15.121:0/1397414404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b9500 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f952001ceb0 tx=0x7f9520002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.837+0000 7f952d22e800 1 -- 172.21.15.121:0/1397414404 shutdown_connections 2023-12-07T21:09:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.837+0000 7f952d22e800 1 --2- 172.21.15.121:0/1397414404 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9508036110 0x7f95080385d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.837+0000 7f952d22e800 1 --2- 172.21.15.121:0/1397414404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558cd180e840 0x558cd18b9500 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.837+0000 7f952d22e800 1 -- 172.21.15.121:0/1397414404 >> 172.21.15.121:0/1397414404 conn(0x558cd1806f60 msgr2=0x558cd18b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.837+0000 7f952d22e800 1 -- 172.21.15.121:0/1397414404 shutdown_connections 2023-12-07T21:09:15.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.837+0000 7f952d22e800 1 -- 172.21.15.121:0/1397414404 wait complete. 2023-12-07T21:09:15.836 INFO:teuthology.orchestra.run.smithi121.stdout:[] 2023-12-07T21:09:15.836 DEBUG:tasks.util.rgw: json result: [] 2023-12-07T21:09:15.866 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:15.866 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2023-12-07T21:09:15.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2023-12-07T21:09:15.867 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2023-12-07T21:09:15.918 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:15.918 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:15.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.926+0000 7f25bf140800 1 Processor -- start 2023-12-07T21:09:15.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.926+0000 7f25bf140800 1 -- start start 2023-12-07T21:09:15.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.926+0000 7f25bf140800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56236cdb84e0 0x56236cdba970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.926+0000 7f25bf140800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56236cd007a0 con 0x56236cd28b90 2023-12-07T21:09:15.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.926+0000 7f25bf140800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x56236ccc9880 con 0x56236cdb84e0 2023-12-07T21:09:15.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.926+0000 7f25b2644640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56236cdb84e0 0x56236cdba970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.926+0000 7f25bae45640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x56236cd28b90 0x56236cdb6dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55726/0 (socket says 172.21.15.121:55726) 2023-12-07T21:09:15.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.926+0000 7f25bae45640 1 -- 172.21.15.121:0/3633635986 learned_addr learned my addr 172.21.15.121:0/3633635986 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:15.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.926+0000 7f25b2644640 1 -- 172.21.15.121:0/3633635986 >> v1:172.21.15.89:6789/0 conn(0x56236cd28b90 legacy=0x56236cdb6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.926+0000 7f25b2644640 1 -- 172.21.15.121:0/3633635986 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56236cdbc050 con 0x56236cdb84e0 2023-12-07T21:09:15.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.928+0000 7f25b2644640 1 --2- 172.21.15.121:0/3633635986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cdb84e0 0x56236cdba970 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f25a400a470 tx=0x7f25a401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7018ef0c2989f8b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.928+0000 7f25ba644640 1 -- 172.21.15.121:0/3633635986 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a4052570 con 0x56236cdb84e0 2023-12-07T21:09:15.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.928+0000 7f25ba644640 1 -- 172.21.15.121:0/3633635986 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a40526d0 con 0x56236cdb84e0 2023-12-07T21:09:15.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.928+0000 7f25ba644640 1 -- 172.21.15.121:0/3633635986 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a4052990 con 0x56236cdb84e0 2023-12-07T21:09:15.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.929+0000 7f25bf140800 1 -- 172.21.15.121:0/3633635986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cdb84e0 msgr2=0x56236cdba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.929+0000 7f25bf140800 1 --2- 172.21.15.121:0/3633635986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cdb84e0 0x56236cdba970 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f25a400a470 tx=0x7f25a401cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:15.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.929+0000 7f25bf140800 1 -- 172.21.15.121:0/3633635986 shutdown_connections 2023-12-07T21:09:15.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.929+0000 7f25bf140800 1 --2- 172.21.15.121:0/3633635986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cdb84e0 0x56236cdba970 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.929+0000 7f25bf140800 1 -- 172.21.15.121:0/3633635986 >> 172.21.15.121:0/3633635986 conn(0x56236cdae880 msgr2=0x56236cdb0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.929+0000 7f25bf140800 1 -- 172.21.15.121:0/3633635986 shutdown_connections 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.929+0000 7f25bf140800 1 -- 172.21.15.121:0/3633635986 wait complete. 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.930+0000 7f25bf140800 1 Processor -- start 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.930+0000 7f25bf140800 1 -- start start 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.930+0000 7f25bf140800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236cdb44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.930+0000 7f25bf140800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56236ccc6db0 con 0x56236cd28b90 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.930+0000 7f25bae45640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236cdb44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.930+0000 7f25bae45640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236cdb44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54312/0 (socket says 172.21.15.121:54312) 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.930+0000 7f25bae45640 1 -- 172.21.15.121:0/1447793280 learned_addr learned my addr 172.21.15.121:0/1447793280 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.930+0000 7f25bae45640 1 -- 172.21.15.121:0/1447793280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4005d20 con 0x56236cd28b90 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.930+0000 7f25bae45640 1 --2- 172.21.15.121:0/1447793280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236cdb44e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f25ac001c50 tx=0x7f25ac00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2debcaf5ef053f83 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.930+0000 7f25b9e43640 1 -- 172.21.15.121:0/1447793280 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25ac00e470 con 0x56236cd28b90 2023-12-07T21:09:15.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.931+0000 7f25b9e43640 1 -- 172.21.15.121:0/1447793280 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac00e5d0 con 0x56236cd28b90 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.931+0000 7f25b9e43640 1 -- 172.21.15.121:0/1447793280 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25ac00e8d0 con 0x56236cd28b90 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.931+0000 7f25bf140800 1 -- 172.21.15.121:0/1447793280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 msgr2=0x56236cdb44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.931+0000 7f25bf140800 1 --2- 172.21.15.121:0/1447793280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236cdb44e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f25ac001c50 tx=0x7f25ac00b6c0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.931+0000 7f25bf140800 1 -- 172.21.15.121:0/1447793280 shutdown_connections 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.931+0000 7f25bf140800 1 --2- 172.21.15.121:0/1447793280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236cdb44e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.931+0000 7f25bf140800 1 -- 172.21.15.121:0/1447793280 >> 172.21.15.121:0/1447793280 conn(0x56236cdae880 msgr2=0x56236ce54a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.931+0000 7f25bf140800 1 -- 172.21.15.121:0/1447793280 shutdown_connections 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.931+0000 7f25bf140800 1 -- 172.21.15.121:0/1447793280 wait complete. 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.931+0000 7f25bf140800 1 Processor -- start 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.931+0000 7f25bf140800 1 -- start start 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25bf140800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236ce625e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25bf140800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56236ccc26a0 con 0x56236cd28b90 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25bae45640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236ce625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25bae45640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236ce625e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54324/0 (socket says 172.21.15.121:54324) 2023-12-07T21:09:15.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25bae45640 1 -- 172.21.15.121:0/537194612 learned_addr learned my addr 172.21.15.121:0/537194612 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25bae45640 1 -- 172.21.15.121:0/537194612 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56236cd007a0 con 0x56236cd28b90 2023-12-07T21:09:15.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25bae45640 1 --2- 172.21.15.121:0/537194612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236ce625e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f25ac000c00 tx=0x7f25ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25b8e41640 1 -- 172.21.15.121:0/537194612 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25ac01f070 con 0x56236cd28b90 2023-12-07T21:09:15.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25b8e41640 1 -- 172.21.15.121:0/537194612 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac018770 con 0x56236cd28b90 2023-12-07T21:09:15.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25bf140800 1 -- 172.21.15.121:0/537194612 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56236ce62b80 con 0x56236cd28b90 2023-12-07T21:09:15.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25b8e41640 1 -- 172.21.15.121:0/537194612 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25ac018a30 con 0x56236cd28b90 2023-12-07T21:09:15.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.932+0000 7f25bf140800 1 -- 172.21.15.121:0/537194612 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56236ce63060 con 0x56236cd28b90 2023-12-07T21:09:15.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25bf140800 1 Processor -- start 2023-12-07T21:09:15.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25bf140800 1 -- start start 2023-12-07T21:09:15.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25b8e41640 1 -- 172.21.15.121:0/537194612 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f25ac018b90 con 0x56236cd28b90 2023-12-07T21:09:15.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25bf140800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 0x56236ce6ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25bf140800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56236cc5c890 con 0x56236ce6e670 2023-12-07T21:09:15.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25b8e41640 1 --2- 172.21.15.121:0/537194612 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f259c036110 0x7f259c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25bb646640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 0x56236ce6ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25bb646640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 0x56236ce6ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54328/0 (socket says 172.21.15.121:54328) 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25bb646640 1 -- 172.21.15.121:0/2943094599 learned_addr learned my addr 172.21.15.121:0/2943094599 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25b8e41640 1 -- 172.21.15.121:0/537194612 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f25ac04b8f0 con 0x56236cd28b90 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25bae45640 1 --2- 172.21.15.121:0/537194612 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f259c036110 0x7f259c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.933+0000 7f25bb646640 1 -- 172.21.15.121:0/2943094599 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56236ce6efd0 con 0x56236ce6e670 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25bae45640 1 --2- 172.21.15.121:0/537194612 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f259c036110 0x7f259c0385d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f25ac001ed0 tx=0x7f25ac001e60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25bb646640 1 --2- 172.21.15.121:0/2943094599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 0x56236ce6ea90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f25b400a430 tx=0x7f25b400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c87adf64d4ec8f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25b1e43640 1 -- 172.21.15.121:0/2943094599 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b4001650 con 0x56236ce6e670 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25b1e43640 1 -- 172.21.15.121:0/2943094599 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b40017d0 con 0x56236ce6e670 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25b1e43640 1 -- 172.21.15.121:0/2943094599 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b4001ab0 con 0x56236ce6e670 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25bf140800 1 -- 172.21.15.121:0/2943094599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 msgr2=0x56236ce6ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25bf140800 1 --2- 172.21.15.121:0/2943094599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 0x56236ce6ea90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f25b400a430 tx=0x7f25b400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25bf140800 1 -- 172.21.15.121:0/2943094599 shutdown_connections 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25bf140800 1 --2- 172.21.15.121:0/2943094599 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 0x56236ce6ea90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25bf140800 1 -- 172.21.15.121:0/2943094599 >> 172.21.15.121:0/2943094599 conn(0x56236cdb84e0 msgr2=0x56236ce69a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25bf140800 1 -- 172.21.15.121:0/2943094599 shutdown_connections 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.934+0000 7f25bf140800 1 -- 172.21.15.121:0/2943094599 wait complete. 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.935+0000 7f25bf140800 1 Processor -- start 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.935+0000 7f25bf140800 1 -- start start 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.935+0000 7f25bf140800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 0x56236ce75640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.935+0000 7f25bf140800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56236cc5c530 con 0x56236ce6e670 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.935+0000 7f25bb646640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 0x56236ce75640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.935+0000 7f25bb646640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 0x56236ce75640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54338/0 (socket says 172.21.15.121:54338) 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.935+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 learned_addr learned my addr 172.21.15.121:0/1514911904 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.935+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b400a0e0 con 0x56236ce6e670 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.935+0000 7f25bb646640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 0x56236ce75640 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f25b400a930 tx=0x7f25b4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.936+0000 7f259bfff640 1 -- 172.21.15.121:0/1514911904 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b4010900 con 0x56236ce6e670 2023-12-07T21:09:15.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.936+0000 7f259bfff640 1 -- 172.21.15.121:0/1514911904 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4010a60 con 0x56236ce6e670 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.936+0000 7f259bfff640 1 -- 172.21.15.121:0/1514911904 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25b4010d20 con 0x56236ce6e670 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.936+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56236ce75b80 con 0x56236ce6e670 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.936+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56236ce75fe0 con 0x56236ce6e670 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.936+0000 7f259bfff640 1 -- 172.21.15.121:0/1514911904 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f25b4017030 con 0x56236ce6e670 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.937+0000 7f259bfff640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2594036110 0x7f25940385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.937+0000 7f259bfff640 1 -- 172.21.15.121:0/1514911904 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f25b404b7d0 con 0x56236ce6e670 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.937+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.937+0000 7f25b2644640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2594036110 0x7f25940385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.937+0000 7f25bf140800 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56236ce80db0 0x56236ce83240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.937+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce83990 con 0x56236ce80db0 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.937+0000 7f25bb646640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56236ce80db0 0x56236ce83240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.937+0000 7f25b2644640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2594036110 0x7f25940385d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f25a4054000 tx=0x7f25a404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.937+0000 7f25bb646640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56236ce80db0 0x56236ce83240 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 20 realm 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce83d80 con 0x56236ce80db0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce845d0 con 0x56236ce80db0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce84930 con 0x56236ce80db0 2023-12-07T21:09:15.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.938+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce84270 con 0x56236ce80db0 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.939+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.939+0000 7f25bf140800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.939+0000 7f25bf140800 20 searching for the correct realm 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.939+0000 7f25bf140800 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56236ce86b80 0x56236ce88f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.939+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce86b80 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.939+0000 7f25bae45640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56236ce86b80 0x56236ce88f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.939+0000 7f25bae45640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56236ce86b80 0x56236ce88f70 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.939+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.939+0000 7f25bae45640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f25ac017050 0x7f25ac0225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.939+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25ac017050 2023-12-07T21:09:15.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.939+0000 7f25b2644640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f25ac017050 0x7f25ac0225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.940+0000 7f25b2644640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f25ac017050 0x7f25ac0225a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.940+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.940+0000 7f25b2644640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f25a405c920 0x7f25a40673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.940+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25a405c920 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.940+0000 7f25bb646640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f25a405c920 0x7f25a40673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.941+0000 7f25bb646640 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f25a405c920 0x7f25a40673d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.941+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.941+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce80db0 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.941+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.941+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce80db0 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.941+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.941+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25a405c920 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.942+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.942+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25a405c920 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.942+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.942+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25ac017050 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.942+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.942+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce86b80 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.942+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.942+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce80db0 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.943+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.943+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25a405c920 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.943+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.943+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce80db0 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.943+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.943+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25ac017050 2023-12-07T21:09:15.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.943+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.943+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce86b80 2023-12-07T21:09:15.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.943+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.943+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce86b80 2023-12-07T21:09:15.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.944+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.944+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25a405c920 2023-12-07T21:09:15.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.944+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.944+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce86b80 2023-12-07T21:09:15.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.944+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.944+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce86b80 2023-12-07T21:09:15.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.944+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.944+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce80db0 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.945+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.945+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce80db0 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.945+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.945+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25a405c920 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.945+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.945+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce86b80 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.945+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.945+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25ac017050 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.946+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.946+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce80db0 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.946+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.946+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25a405c920 2023-12-07T21:09:15.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.946+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.946+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce86b80 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.946+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.946+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25a405c920 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.946+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.946+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25ac017050 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.947+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.947+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce86b80 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.947+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.947+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x7f25a405c920 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.947+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.947+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89550 con 0x56236ce80db0 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.947+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.947+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f25b4053080 con 0x7f25ac017050 2023-12-07T21:09:15.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:15.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce85760 con 0x56236ce80db0 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce85ba0 con 0x56236ce80db0 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:15.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce85f80 con 0x56236ce86b80 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 zone default found 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 4 Realm: () 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 zonegroup default 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.948+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce89970 con 0x7f25a405c920 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bf140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8b7f0 con 0x56236ce86b80 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bf140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8bb50 con 0x56236ce86b80 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bf140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bf140800 20 started sync module instance, tier type = 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bf140800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.949+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8ac30 con 0x7f25ac017050 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.950+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.950+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94710148611920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8a8b0 con 0x7f25ac017050 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.950+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8c350 con 0x56236ce80db0 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.951+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94710148611920] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.951+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.951+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94710151032800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8c350 con 0x56236ce80db0 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.951+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8cd00 con 0x56236ce86b80 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.952+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94710151032800] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.952+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.952+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94710151036592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8c2c0 con 0x56236ce86b80 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.952+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8da20 con 0x7f25ac017050 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.953+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94710151036592] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.953+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.953+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94710151041520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8e270 con 0x7f25ac017050 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.954+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8ea70 con 0x56236ce80db0 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.954+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94710151041520] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.955+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.955+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94710151046608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8e9e0 con 0x56236ce80db0 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.955+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8f760 con 0x7f25a405c920 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.956+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.956+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94710151049920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8f6d0 con 0x7f25a405c920 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.956+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94710151046608] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.956+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8ee20 con 0x7f25a405c920 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.957+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94710151049920] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.957+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.957+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94710151048736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce90120 con 0x7f25a405c920 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.957+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce90a90 con 0x7f25a405c920 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.958+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94710151048736] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.958+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.958+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94710151051968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce90a90 con 0x7f25a405c920 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.958+0000 7f25bf140800 20 add_watcher() i=0 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.958+0000 7f25bf140800 20 add_watcher() i=1 2023-12-07T21:09:15.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.958+0000 7f25bf140800 20 add_watcher() i=2 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.958+0000 7f25bf140800 20 add_watcher() i=3 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.958+0000 7f25bf140800 20 add_watcher() i=4 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.958+0000 7f25bf140800 20 add_watcher() i=5 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.958+0000 7f25bf140800 20 add_watcher() i=6 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.958+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94710151051968] v31'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.959+0000 7f25bf140800 20 add_watcher() i=7 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.959+0000 7f25bf140800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.959+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce93da0 con 0x56236ce80db0 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.959+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.959+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94710151067648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce90c00 con 0x56236ce80db0 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.960+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94710151067648] v31'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.960+0000 7f2580fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.960+0000 7f25bf140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.960+0000 7f25bf140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:15.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.960+0000 7f25bf140800 5 note: GC not initialized 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.960+0000 7f24fb7fe640 20 reqs_thread_entry: start 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.960+0000 7f25bf140800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.960+0000 7f25bf140800 20 Filter name: none 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.960+0000 7f24f97fa640 20 reqs_thread_entry: start 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.960+0000 7f25bf140800 20 rados->read ofs=0 len=0 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.960+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236cec6950 con 0x56236ce80db0 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.961+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.961+0000 7f25bf140800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.961+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236cec7d00 con 0x7f25ac017050 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.961+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.962+0000 7f2580fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.962+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94710151067648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce929a0 con 0x56236ce80db0 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.963+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94710151067648] v31'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.963+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94710148611920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce929a0 con 0x7f25ac017050 2023-12-07T21:09:15.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.964+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94710148611920] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.964+0000 7f25bf140800 20 remove_watcher() i=0 2023-12-07T21:09:15.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.964+0000 7f25bf140800 2 removed watcher, disabling cache 2023-12-07T21:09:15.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.964+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94710151032800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce92d00 con 0x56236ce80db0 2023-12-07T21:09:15.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.965+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94710151032800] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.965+0000 7f25bf140800 20 remove_watcher() i=1 2023-12-07T21:09:15.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.965+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94710151036592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce92d00 con 0x56236ce86b80 2023-12-07T21:09:15.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.966+0000 7f25bae45640 1 -- 172.21.15.121:0/1514911904 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94710151036592] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25ac014070 con 0x56236ce86b80 2023-12-07T21:09:15.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.966+0000 7f25bf140800 20 remove_watcher() i=2 2023-12-07T21:09:15.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.966+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94710151041520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce93060 con 0x7f25ac017050 2023-12-07T21:09:15.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.967+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94710151041520] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a4052840 con 0x7f25ac017050 2023-12-07T21:09:15.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.967+0000 7f25bf140800 20 remove_watcher() i=3 2023-12-07T21:09:15.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.967+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94710151046608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce93060 con 0x56236ce80db0 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.968+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94710151046608] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x56236ce80db0 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.968+0000 7f25bf140800 20 remove_watcher() i=4 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.968+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94710151049920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce93060 con 0x7f25a405c920 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.969+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94710151049920] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.969+0000 7f25bf140800 20 remove_watcher() i=5 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.969+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94710151048736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8f2c0 con 0x7f25a405c920 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.970+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94710151048736] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.970+0000 7f25bf140800 20 remove_watcher() i=6 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.970+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94710151051968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56236ce8f2c0 con 0x7f25a405c920 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bb646640 1 -- 172.21.15.121:0/1514911904 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94710151051968] v31'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b402e9d0 con 0x7f25a405c920 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 20 remove_watcher() i=7 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f25a405c920 msgr2=0x7f25a40673d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f25a405c920 0x7f25a40673d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56236ce80db0 msgr2=0x56236ce83240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56236ce80db0 0x56236ce83240 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f25ac017050 msgr2=0x7f25ac0225a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f25ac017050 0x7f25ac0225a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56236ce86b80 msgr2=0x56236ce88f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56236ce86b80 0x56236ce88f70 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2594036110 msgr2=0x7f25940385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2594036110 0x7f25940385d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f25a4054000 tx=0x7f25a404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 msgr2=0x56236ce75640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 --2- 172.21.15.121:0/1514911904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236ce6e670 0x56236ce75640 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f25b400a930 tx=0x7f25b4003370 comp rx=0 tx=0).stop 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 reap_dead start 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25b2644640 1 -- 172.21.15.121:0/1514911904 reap_dead start 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 shutdown_connections 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 >> 172.21.15.121:0/1514911904 conn(0x56236cdb84e0 msgr2=0x56236ce68850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 shutdown_connections 2023-12-07T21:09:15.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.971+0000 7f25bf140800 1 -- 172.21.15.121:0/1514911904 wait complete. 2023-12-07T21:09:15.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.972+0000 7f25bf140800 1 -- 172.21.15.121:0/537194612 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f259c036110 msgr2=0x7f259c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.972+0000 7f25bf140800 1 --2- 172.21.15.121:0/537194612 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f259c036110 0x7f259c0385d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f25ac001ed0 tx=0x7f25ac001e60 comp rx=0 tx=0).stop 2023-12-07T21:09:15.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.972+0000 7f25bf140800 1 -- 172.21.15.121:0/537194612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 msgr2=0x56236ce625e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:15.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.972+0000 7f25bf140800 1 --2- 172.21.15.121:0/537194612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236ce625e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f25ac000c00 tx=0x7f25ac000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.972+0000 7f25bf140800 1 -- 172.21.15.121:0/537194612 shutdown_connections 2023-12-07T21:09:15.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.972+0000 7f25bf140800 1 --2- 172.21.15.121:0/537194612 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f259c036110 0x7f259c0385d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.972+0000 7f25bf140800 1 --2- 172.21.15.121:0/537194612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56236cd28b90 0x56236ce625e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:15.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.972+0000 7f25bf140800 1 -- 172.21.15.121:0/537194612 >> 172.21.15.121:0/537194612 conn(0x56236cdae880 msgr2=0x56236cdb2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:15.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.972+0000 7f25bf140800 1 -- 172.21.15.121:0/537194612 shutdown_connections 2023-12-07T21:09:15.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:15.972+0000 7f25bf140800 1 -- 172.21.15.121:0/537194612 wait complete. 2023-12-07T21:09:15.973 INFO:teuthology.orchestra.run.smithi121.stdout:["myfoo"] 2023-12-07T21:09:15.973 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2023-12-07T21:09:15.976 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:15.976 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2023-12-07T21:09:15.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2023-12-07T21:09:15.977 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2023-12-07T21:09:16.054 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:16.054 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.062+0000 7f3177933800 1 Processor -- start 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.062+0000 7f3177933800 1 -- start start 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.062+0000 7f3177933800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b611f6b0f0 0x55b611f6b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.062+0000 7f3177933800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b611eb8790 con 0x55b611f6c300 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.062+0000 7f3177933800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b611e81880 con 0x55b611f6b0f0 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.062+0000 7f31735d7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b611f6b0f0 0x55b611f6b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.062+0000 7f31735d7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b611f6b0f0 0x55b611f6b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54346/0 (socket says 172.21.15.121:54346) 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.062+0000 7f31735d7640 1 -- 172.21.15.121:0/1592552980 learned_addr learned my addr 172.21.15.121:0/1592552980 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.062+0000 7f3172dd6640 1 --1- 172.21.15.121:0/1592552980 >> v1:172.21.15.89:6789/0 conn(0x55b611f6c300 0x55b611f6c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55728/0 (socket says 172.21.15.121:55728) 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.063+0000 7f31735d7640 1 -- 172.21.15.121:0/1592552980 >> v1:172.21.15.89:6789/0 conn(0x55b611f6c300 legacy=0x55b611f6c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.063+0000 7f31725d5640 1 -- 172.21.15.121:0/1592552980 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845567890 0 0) 0x55b611eb8790 con 0x55b611f6c300 2023-12-07T21:09:16.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.063+0000 7f31735d7640 1 -- 172.21.15.121:0/1592552980 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b611f6bbe0 con 0x55b611f6b0f0 2023-12-07T21:09:16.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.064+0000 7f31735d7640 1 --2- 172.21.15.121:0/1592552980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b611f6b510 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f316400a6b0 tx=0x7f316401eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b45ca22b89cc528 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.065+0000 7f31725d5640 1 -- 172.21.15.121:0/1592552980 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316400a200 con 0x55b611f6b0f0 2023-12-07T21:09:16.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.065+0000 7f31725d5640 1 -- 172.21.15.121:0/1592552980 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316400a360 con 0x55b611f6b0f0 2023-12-07T21:09:16.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.065+0000 7f31725d5640 1 -- 172.21.15.121:0/1592552980 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31640086e0 con 0x55b611f6b0f0 2023-12-07T21:09:16.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.065+0000 7f3177933800 1 -- 172.21.15.121:0/1592552980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 msgr2=0x55b611f6b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.065+0000 7f3177933800 1 --2- 172.21.15.121:0/1592552980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b611f6b510 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f316400a6b0 tx=0x7f316401eda0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.065+0000 7f3177933800 1 -- 172.21.15.121:0/1592552980 shutdown_connections 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.065+0000 7f3177933800 1 --2- 172.21.15.121:0/1592552980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b611f6b510 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.065+0000 7f3177933800 1 -- 172.21.15.121:0/1592552980 >> 172.21.15.121:0/1592552980 conn(0x55b611f66870 msgr2=0x55b611f68c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.065+0000 7f3177933800 1 -- 172.21.15.121:0/1592552980 shutdown_connections 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.065+0000 7f3177933800 1 -- 172.21.15.121:0/1592552980 wait complete. 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.066+0000 7f3177933800 1 Processor -- start 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.066+0000 7f3177933800 1 -- start start 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.066+0000 7f3177933800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b61200eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.066+0000 7f3177933800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b611e7edb0 con 0x55b611f6b0f0 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.066+0000 7f31735d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b61200eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.066+0000 7f31735d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b61200eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54356/0 (socket says 172.21.15.121:54356) 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.066+0000 7f31735d7640 1 -- 172.21.15.121:0/590321861 learned_addr learned my addr 172.21.15.121:0/590321861 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.066+0000 7f31735d7640 1 -- 172.21.15.121:0/590321861 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3164005de0 con 0x55b611f6b0f0 2023-12-07T21:09:16.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f31735d7640 1 --2- 172.21.15.121:0/590321861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b61200eeb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3164056040 tx=0x7f316404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f6bc2c719eda2c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3171dd4640 1 -- 172.21.15.121:0/590321861 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3164008590 con 0x55b611f6b0f0 2023-12-07T21:09:16.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3171dd4640 1 -- 172.21.15.121:0/590321861 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3164008730 con 0x55b611f6b0f0 2023-12-07T21:09:16.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3171dd4640 1 -- 172.21.15.121:0/590321861 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3164008a10 con 0x55b611f6b0f0 2023-12-07T21:09:16.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3177933800 1 -- 172.21.15.121:0/590321861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 msgr2=0x55b61200eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3177933800 1 --2- 172.21.15.121:0/590321861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b61200eeb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3164056040 tx=0x7f316404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3177933800 1 -- 172.21.15.121:0/590321861 shutdown_connections 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3177933800 1 --2- 172.21.15.121:0/590321861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b61200eeb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3177933800 1 -- 172.21.15.121:0/590321861 >> 172.21.15.121:0/590321861 conn(0x55b611f66870 msgr2=0x55b61200ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3177933800 1 -- 172.21.15.121:0/590321861 shutdown_connections 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3177933800 1 -- 172.21.15.121:0/590321861 wait complete. 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3177933800 1 Processor -- start 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.067+0000 7f3177933800 1 -- start start 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f3177933800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b6120162b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f3177933800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b611e7a6a0 con 0x55b611f6b0f0 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f31735d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b6120162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f31735d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b6120162b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54360/0 (socket says 172.21.15.121:54360) 2023-12-07T21:09:16.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f31735d7640 1 -- 172.21.15.121:0/1006023023 learned_addr learned my addr 172.21.15.121:0/1006023023 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f31735d7640 1 -- 172.21.15.121:0/1006023023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3164050070 con 0x55b611f6b0f0 2023-12-07T21:09:16.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f31735d7640 1 --2- 172.21.15.121:0/1006023023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b6120162b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3164005570 tx=0x7f3164002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f3170dd2640 1 -- 172.21.15.121:0/1006023023 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316400a190 con 0x55b611f6b0f0 2023-12-07T21:09:16.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f3170dd2640 1 -- 172.21.15.121:0/1006023023 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3164060680 con 0x55b611f6b0f0 2023-12-07T21:09:16.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f3177933800 1 -- 172.21.15.121:0/1006023023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b6120167f0 con 0x55b611f6b0f0 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f3170dd2640 1 -- 172.21.15.121:0/1006023023 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3164060940 con 0x55b611f6b0f0 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.068+0000 7f3177933800 1 -- 172.21.15.121:0/1006023023 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b612016d30 con 0x55b611f6b0f0 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.069+0000 7f3177933800 1 Processor -- start 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.069+0000 7f3177933800 1 -- start start 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.069+0000 7f3177933800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 0x55b612022920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.069+0000 7f3177933800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b611e14890 con 0x55b612022500 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.069+0000 7f3170dd2640 1 -- 172.21.15.121:0/1006023023 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3164005020 con 0x55b611f6b0f0 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.069+0000 7f3170dd2640 1 --2- 172.21.15.121:0/1006023023 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3160036110 0x7f31600385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.069+0000 7f3173dd8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 0x55b612022920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.069+0000 7f3173dd8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 0x55b612022920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54374/0 (socket says 172.21.15.121:54374) 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.069+0000 7f3173dd8640 1 -- 172.21.15.121:0/4119573036 learned_addr learned my addr 172.21.15.121:0/4119573036 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.069+0000 7f3170dd2640 1 -- 172.21.15.121:0/1006023023 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f316408ef10 con 0x55b611f6b0f0 2023-12-07T21:09:16.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.069+0000 7f31735d7640 1 --2- 172.21.15.121:0/1006023023 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3160036110 0x7f31600385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f3173dd8640 1 -- 172.21.15.121:0/4119573036 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b612022e60 con 0x55b612022500 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f31735d7640 1 --2- 172.21.15.121:0/1006023023 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3160036110 0x7f31600385d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3164009fd0 tx=0x7f31640058c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f3173dd8640 1 --2- 172.21.15.121:0/4119573036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 0x55b612022920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f316c00a430 tx=0x7f316c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84700d9e1f5e1d10 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f315a7fc640 1 -- 172.21.15.121:0/4119573036 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c001650 con 0x55b612022500 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f315a7fc640 1 -- 172.21.15.121:0/4119573036 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c0017d0 con 0x55b612022500 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f315a7fc640 1 -- 172.21.15.121:0/4119573036 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c001ab0 con 0x55b612022500 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f3177933800 1 -- 172.21.15.121:0/4119573036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 msgr2=0x55b612022920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f3177933800 1 --2- 172.21.15.121:0/4119573036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 0x55b612022920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f316c00a430 tx=0x7f316c00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f3177933800 1 -- 172.21.15.121:0/4119573036 shutdown_connections 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f3177933800 1 --2- 172.21.15.121:0/4119573036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 0x55b612022920 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f3177933800 1 -- 172.21.15.121:0/4119573036 >> 172.21.15.121:0/4119573036 conn(0x55b611f6c300 msgr2=0x55b61201d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f3177933800 1 -- 172.21.15.121:0/4119573036 shutdown_connections 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.070+0000 7f3177933800 1 -- 172.21.15.121:0/4119573036 wait complete. 2023-12-07T21:09:16.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.071+0000 7f3177933800 1 Processor -- start 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.071+0000 7f3177933800 1 -- start start 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.071+0000 7f3177933800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 0x55b61202d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.071+0000 7f3177933800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b611e14530 con 0x55b612022500 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.071+0000 7f3173dd8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 0x55b61202d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.071+0000 7f3173dd8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 0x55b61202d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54376/0 (socket says 172.21.15.121:54376) 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.071+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 learned_addr learned my addr 172.21.15.121:0/161453555 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.072+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c00a0e0 con 0x55b612022500 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.072+0000 7f3173dd8640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 0x55b61202d840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f316c00a930 tx=0x7f316c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.072+0000 7f3158ff9640 1 -- 172.21.15.121:0/161453555 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c010900 con 0x55b612022500 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.072+0000 7f3158ff9640 1 -- 172.21.15.121:0/161453555 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c010a60 con 0x55b612022500 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.072+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b61202dd80 con 0x55b612022500 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.072+0000 7f3158ff9640 1 -- 172.21.15.121:0/161453555 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c010d20 con 0x55b612022500 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.072+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b61202e1e0 con 0x55b612022500 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.073+0000 7f3158ff9640 1 -- 172.21.15.121:0/161453555 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f316c017030 con 0x55b612022500 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.073+0000 7f3177933800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.072 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.073+0000 7f3158ff9640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f314c036110 0x7f314c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.073+0000 7f3158ff9640 1 -- 172.21.15.121:0/161453555 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f316c04b7d0 con 0x55b612022500 2023-12-07T21:09:16.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.073+0000 7f3172dd6640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f314c036110 0x7f314c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.073+0000 7f3177933800 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b612038f60 0x55b61203b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.073+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203bb70 con 0x55b612038f60 2023-12-07T21:09:16.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.073+0000 7f3173dd8640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b612038f60 0x55b61203b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.073+0000 7f3172dd6640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f314c036110 0x7f314c0385d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3168000c00 tx=0x7f3168001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.073+0000 7f3173dd8640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b612038f60 0x55b61203b420 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 20 realm 2023-12-07T21:09:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203bf40 con 0x55b612038f60 2023-12-07T21:09:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203c7c0 con 0x55b612038f60 2023-12-07T21:09:16.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203cb20 con 0x55b612038f60 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.074+0000 7f3177933800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.075+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203c460 con 0x55b612038f60 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.075+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.075+0000 7f3177933800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.075+0000 7f3177933800 20 searching for the correct realm 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.075+0000 7f3177933800 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b61203ed70 0x55b612041160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.075+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b61203ed70 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.075+0000 7f31735d7640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b61203ed70 0x55b612041160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.075+0000 7f31735d7640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b61203ed70 0x55b612041160 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.075+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.075+0000 7f31735d7640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3164073070 0x7f3164064170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.075+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f3164073070 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.076+0000 7f3172dd6640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3164073070 0x7f3164064170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.076+0000 7f3172dd6640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3164073070 0x7f3164064170 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.076+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.076+0000 7f3172dd6640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f316800e8a0 0x7f316800d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.076+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f316800e8a0 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.076+0000 7f3173dd8640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f316800e8a0 0x7f316800d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.077+0000 7f3173dd8640 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f316800e8a0 0x7f316800d2f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.077+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.077+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b612038f60 2023-12-07T21:09:16.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.077+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.077+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b612038f60 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.077+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.077+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f316800e8a0 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.077+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.077+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f316800e8a0 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.078+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.078+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f3164073070 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.078+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.078+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b61203ed70 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.078+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.078+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b612038f60 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.078+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.078+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f316800e8a0 2023-12-07T21:09:16.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.079+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.079+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b612038f60 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.079+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.079+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f3164073070 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.079+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.079+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b61203ed70 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.079+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.079+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b61203ed70 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.079+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.079+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f316800e8a0 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.080+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.080+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b61203ed70 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.080+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.080+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b61203ed70 2023-12-07T21:09:16.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.080+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.080+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b612038f60 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.080+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.080+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b612038f60 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.081+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.081+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f316800e8a0 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.081+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.081+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b61203ed70 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.081+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.081+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f3164073070 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.081+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.081+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b612038f60 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.082+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.082+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f316800e8a0 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.082+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.092 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.082+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b61203ed70 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.082+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.082+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f316800e8a0 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.082+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.082+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f3164073070 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.083+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.083+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b61203ed70 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.083+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.083+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x7f316800e8a0 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.083+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.083+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120416a0 con 0x55b612038f60 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.083+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.083+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f316c053080 con 0x7f3164073070 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b612038f60 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d670 con 0x55b612038f60 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203e2c0 con 0x55b61203ed70 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 zone default found 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 4 Realm: () 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 zonegroup default 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.084+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612041ae0 con 0x7f316800e8a0 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f3177933800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f3177933800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612043870 con 0x55b61203ed70 2023-12-07T21:09:16.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f3177933800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f3177933800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612043c20 con 0x55b61203ed70 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f3177933800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f3177933800 20 started sync module instance, tier type = 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f3177933800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.085+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612043150 con 0x7f3164073070 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.086+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.086+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94240472252240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612043500 con 0x7f3164073070 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.086+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120444c0 con 0x55b612038f60 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.087+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94240472252240] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.087+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.087+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94240474672304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120444c0 con 0x55b612038f60 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.087+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612044f30 con 0x55b61203ed70 2023-12-07T21:09:16.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.088+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.088+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94240474679792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612045780 con 0x55b61203ed70 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.088+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612046170 con 0x7f3164073070 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.089+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94240474672304] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.090+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94240474679792] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.090+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.090+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94240474684496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120453f0 con 0x7f3164073070 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.090+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612046c20 con 0x55b612038f60 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.091+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.091+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94240474687200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612047470 con 0x55b612038f60 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.091+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612047e20 con 0x7f316800e8a0 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.091+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94240474684496] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.091+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.092+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94240474677280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612047de0 con 0x7f316800e8a0 2023-12-07T21:09:16.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.092+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120487e0 con 0x7f316800e8a0 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.092+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94240474687200] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.092+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94240474677280] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.093+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.093+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94240474691904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120470d0 con 0x7f316800e8a0 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.093+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612048c80 con 0x7f316800e8a0 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.094+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94240474691904] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.094+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.094+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94240474694464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612048bf0 con 0x7f316800e8a0 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.094+0000 7f3177933800 20 add_watcher() i=0 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.094+0000 7f3177933800 20 add_watcher() i=1 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.094+0000 7f3177933800 20 add_watcher() i=2 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.094+0000 7f3177933800 20 add_watcher() i=3 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.094+0000 7f3177933800 20 add_watcher() i=4 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.094+0000 7f3177933800 20 add_watcher() i=5 2023-12-07T21:09:16.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.094+0000 7f3177933800 20 add_watcher() i=6 2023-12-07T21:09:16.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.095+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94240474694464] v31'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.095+0000 7f3177933800 20 add_watcher() i=7 2023-12-07T21:09:16.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.095+0000 7f3177933800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:16.109 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.095+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61204be90 con 0x55b612038f60 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.095+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.095+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94240474695872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612049170 con 0x55b612038f60 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.096+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94240474695872] v31'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.096+0000 7f31397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.096+0000 7f3177933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.096+0000 7f3177933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.096+0000 7f3177933800 5 note: GC not initialized 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.096+0000 7f30b3fff640 20 reqs_thread_entry: start 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.096+0000 7f3177933800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.097+0000 7f3177933800 20 Filter name: none 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.097+0000 7f30b1ffb640 20 reqs_thread_entry: start 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.097+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61207e6c0 con 0x55b61203ed70 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.097+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.097+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61207e6c0 con 0x55b61203ed70 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.097+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.097+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61207e6c0 con 0x55b612038f60 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.097+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.097+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b612038f60 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.098+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v31'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.098+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f3164073070 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.098+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.098+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b61203ed70 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.098+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.098+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b612038f60 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.098+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.098+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b61203ed70 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.099+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.099+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f3164073070 2023-12-07T21:09:16.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.099+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.099+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b61203ed70 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.099+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.099+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b612038f60 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.099+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.099+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f316800e8a0 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.100+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.100+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f316800e8a0 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.100+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.100+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b61203ed70 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.100+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.100+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f316800e8a0 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.100+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.100+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f316800e8a0 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.101+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.101+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f316800e8a0 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.101+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.101+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b61203ed70 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.101+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.101+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f3164073070 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.102+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(80 [pgnls start_epoch 31 out=148b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+148 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.102+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b612038f60 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.102+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.102+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b612038f60 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.102+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.102+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b61203ed70 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.102+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.102+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f3164073070 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.103+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.103+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f316800e8a0 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.103+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.103+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b612038f60 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.103+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.103+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f316800e8a0 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.103+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.103+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b61203ed70 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.104+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.104+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f3164073070 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.104+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.104+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f316800e8a0 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.104+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.104+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b612038f60 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.105+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.105+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x55b61203ed70 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.105+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.105+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61203d9f0 con 0x7f3164073070 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.105+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.105+0000 7f3177933800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.105+0000 7f3177933800 20 RGWRados::pool_iterate: got myfoo 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.106+0000 7f31397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.106+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94240474695872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61204afc0 con 0x55b612038f60 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.107+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94240474695872] v31'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.107+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94240472252240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61204b320 con 0x7f3164073070 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.108+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94240472252240] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.108+0000 7f3177933800 20 remove_watcher() i=0 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.108+0000 7f3177933800 2 removed watcher, disabling cache 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.108+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94240474672304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61204b680 con 0x55b612038f60 2023-12-07T21:09:16.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.109+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94240474672304] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.109+0000 7f3177933800 20 remove_watcher() i=1 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.109+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94240474679792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b61204b680 con 0x55b61203ed70 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.110+0000 7f31735d7640 1 -- 172.21.15.121:0/161453555 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94240474679792] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3164082040 con 0x55b61203ed70 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.110+0000 7f3177933800 20 remove_watcher() i=2 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.110+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94240474684496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612032d70 con 0x7f3164073070 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.111+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94240474684496] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316800f620 con 0x7f3164073070 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.111+0000 7f3177933800 20 remove_watcher() i=3 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.111+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94240474687200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120330d0 con 0x55b612038f60 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.112+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94240474687200] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x55b612038f60 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.112+0000 7f3177933800 20 remove_watcher() i=4 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.112+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94240474677280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b6120330d0 con 0x7f316800e8a0 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.113+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94240474677280] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.113+0000 7f3177933800 20 remove_watcher() i=5 2023-12-07T21:09:16.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.113+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94240474691904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612044020 con 0x7f316800e8a0 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.114+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94240474691904] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.114+0000 7f3177933800 20 remove_watcher() i=6 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.114+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94240474694464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b612044020 con 0x7f316800e8a0 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3173dd8640 1 -- 172.21.15.121:0/161453555 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94240474694464] v31'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f316c02e9d0 con 0x7f316800e8a0 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 20 remove_watcher() i=7 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f316800e8a0 msgr2=0x7f316800d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f316800e8a0 0x7f316800d2f0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b612038f60 msgr2=0x55b61203b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b612038f60 0x55b61203b420 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3164073070 msgr2=0x7f3164064170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3164073070 0x7f3164064170 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b61203ed70 msgr2=0x55b612041160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b61203ed70 0x55b612041160 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f314c036110 msgr2=0x7f314c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f314c036110 0x7f314c0385d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3168000c00 tx=0x7f3168001330 comp rx=0 tx=0).stop 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 msgr2=0x55b61202d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 --2- 172.21.15.121:0/161453555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b612022500 0x55b61202d840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f316c00a930 tx=0x7f316c003370 comp rx=0 tx=0).stop 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 reap_dead start 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3172dd6640 1 -- 172.21.15.121:0/161453555 reap_dead start 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 shutdown_connections 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 >> 172.21.15.121:0/161453555 conn(0x55b611f6c300 msgr2=0x55b61201c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 shutdown_connections 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.115+0000 7f3177933800 1 -- 172.21.15.121:0/161453555 wait complete. 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.116+0000 7f3177933800 1 -- 172.21.15.121:0/1006023023 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3160036110 msgr2=0x7f31600385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.116+0000 7f3177933800 1 --2- 172.21.15.121:0/1006023023 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3160036110 0x7f31600385d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3164009fd0 tx=0x7f31640058c0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.116+0000 7f3177933800 1 -- 172.21.15.121:0/1006023023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 msgr2=0x55b6120162b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.116+0000 7f3177933800 1 --2- 172.21.15.121:0/1006023023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b6120162b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3164005570 tx=0x7f3164002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.116+0000 7f3177933800 1 -- 172.21.15.121:0/1006023023 shutdown_connections 2023-12-07T21:09:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.116+0000 7f3177933800 1 --2- 172.21.15.121:0/1006023023 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3160036110 0x7f31600385d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.116+0000 7f3177933800 1 --2- 172.21.15.121:0/1006023023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b611f6b0f0 0x55b6120162b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.116+0000 7f3177933800 1 -- 172.21.15.121:0/1006023023 >> 172.21.15.121:0/1006023023 conn(0x55b611f66870 msgr2=0x55b61200dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.116+0000 7f3177933800 1 -- 172.21.15.121:0/1006023023 shutdown_connections 2023-12-07T21:09:16.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.116+0000 7f3177933800 1 -- 172.21.15.121:0/1006023023 wait complete. 2023-12-07T21:09:16.120 INFO:teuthology.orchestra.run.smithi121.stdout:["myfoo"] 2023-12-07T21:09:16.120 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2023-12-07T21:09:16.130 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:16.140 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:16.153 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:16.198 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2023-12-07T21:09:16.227 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:16.255 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:16.283 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:16.283 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2023-12-07T21:09:16.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2023-12-07T21:09:16.284 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2023-12-07T21:09:16.326 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:16.326 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:16.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.333+0000 7fd501412800 1 Processor -- start 2023-12-07T21:09:16.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.333+0000 7fd501412800 1 -- start start 2023-12-07T21:09:16.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.334+0000 7fd501412800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f113844280 0x55f1138446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.334+0000 7fd501412800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f1137907a0 con 0x55f113845440 2023-12-07T21:09:16.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.334+0000 7fd501412800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f113759880 con 0x55f113844280 2023-12-07T21:09:16.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.334+0000 7fd4fca50640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f113844280 0x55f1138446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.327 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.334+0000 7fd4fca50640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f113844280 0x55f1138446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54378/0 (socket says 172.21.15.121:54378) 2023-12-07T21:09:16.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.334+0000 7fd4fc24f640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55f113845440 0x55f1138458c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55740/0 (socket says 172.21.15.121:55740) 2023-12-07T21:09:16.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.334+0000 7fd4fca50640 1 -- 172.21.15.121:0/3127520336 learned_addr learned my addr 172.21.15.121:0/3127520336 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.334+0000 7fd4fca50640 1 -- 172.21.15.121:0/3127520336 >> v1:172.21.15.89:6789/0 conn(0x55f113845440 legacy=0x55f1138458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.328 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.334+0000 7fd4fca50640 1 -- 172.21.15.121:0/3127520336 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f113844d70 con 0x55f113844280 2023-12-07T21:09:16.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.336+0000 7fd4fca50640 1 --2- 172.21.15.121:0/3127520336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1138446a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00a520 tx=0x7fd4ec01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2db9ad9d3bbb9cb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.336+0000 7fd4fba4e640 1 -- 172.21.15.121:0/3127520336 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec052570 con 0x55f113844280 2023-12-07T21:09:16.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.336+0000 7fd4fba4e640 1 -- 172.21.15.121:0/3127520336 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec0526d0 con 0x55f113844280 2023-12-07T21:09:16.329 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.336+0000 7fd4fba4e640 1 -- 172.21.15.121:0/3127520336 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec052990 con 0x55f113844280 2023-12-07T21:09:16.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.337+0000 7fd501412800 1 -- 172.21.15.121:0/3127520336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 msgr2=0x55f1138446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.337+0000 7fd501412800 1 --2- 172.21.15.121:0/3127520336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1138446a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00a520 tx=0x7fd4ec01cee0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.337+0000 7fd501412800 1 -- 172.21.15.121:0/3127520336 shutdown_connections 2023-12-07T21:09:16.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.337+0000 7fd501412800 1 --2- 172.21.15.121:0/3127520336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1138446a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.337+0000 7fd501412800 1 -- 172.21.15.121:0/3127520336 >> 172.21.15.121:0/3127520336 conn(0x55f11383f980 msgr2=0x55f113841da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.337+0000 7fd501412800 1 -- 172.21.15.121:0/3127520336 shutdown_connections 2023-12-07T21:09:16.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.337+0000 7fd501412800 1 -- 172.21.15.121:0/3127520336 wait complete. 2023-12-07T21:09:16.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.338+0000 7fd501412800 1 Processor -- start 2023-12-07T21:09:16.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.338+0000 7fd501412800 1 -- start start 2023-12-07T21:09:16.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.338+0000 7fd501412800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1138e9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.338+0000 7fd501412800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f113756db0 con 0x55f113844280 2023-12-07T21:09:16.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.338+0000 7fd4fca50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1138e9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.338+0000 7fd4fca50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1138e9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54394/0 (socket says 172.21.15.121:54394) 2023-12-07T21:09:16.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.338+0000 7fd4fca50640 1 -- 172.21.15.121:0/3909963738 learned_addr learned my addr 172.21.15.121:0/3909963738 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.338+0000 7fd4fca50640 1 -- 172.21.15.121:0/3909963738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec005de0 con 0x55f113844280 2023-12-07T21:09:16.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.338+0000 7fd4fca50640 1 --2- 172.21.15.121:0/3909963738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1138e9240 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec000c00 tx=0x7fd4ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d838c64390bf78 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.338+0000 7fd4fb24d640 1 -- 172.21.15.121:0/3909963738 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec052840 con 0x55f113844280 2023-12-07T21:09:16.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.339+0000 7fd4fb24d640 1 -- 172.21.15.121:0/3909963738 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec0529a0 con 0x55f113844280 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.339+0000 7fd4fb24d640 1 -- 172.21.15.121:0/3909963738 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec052c80 con 0x55f113844280 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.339+0000 7fd501412800 1 -- 172.21.15.121:0/3909963738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 msgr2=0x55f1138e9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.339+0000 7fd501412800 1 --2- 172.21.15.121:0/3909963738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1138e9240 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec000c00 tx=0x7fd4ec04c000 comp rx=0 tx=0).stop 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.339+0000 7fd501412800 1 -- 172.21.15.121:0/3909963738 shutdown_connections 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.339+0000 7fd501412800 1 --2- 172.21.15.121:0/3909963738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1138e9240 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.339+0000 7fd501412800 1 -- 172.21.15.121:0/3909963738 >> 172.21.15.121:0/3909963738 conn(0x55f11383f980 msgr2=0x55f1138e4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.339+0000 7fd501412800 1 -- 172.21.15.121:0/3909963738 shutdown_connections 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.339+0000 7fd501412800 1 -- 172.21.15.121:0/3909963738 wait complete. 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.339+0000 7fd501412800 1 Processor -- start 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.339+0000 7fd501412800 1 -- start start 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.340+0000 7fd501412800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1137baa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.340+0000 7fd501412800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1137526a0 con 0x55f113844280 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.340+0000 7fd4fca50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1137baa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.340+0000 7fd4fca50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1137baa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54396/0 (socket says 172.21.15.121:54396) 2023-12-07T21:09:16.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.340+0000 7fd4fca50640 1 -- 172.21.15.121:0/1526276634 learned_addr learned my addr 172.21.15.121:0/1526276634 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.340+0000 7fd4fca50640 1 -- 172.21.15.121:0/1526276634 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec04e070 con 0x55f113844280 2023-12-07T21:09:16.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.340+0000 7fd4fca50640 1 --2- 172.21.15.121:0/1526276634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1137baa40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec01ceb0 tx=0x7fd4ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.340+0000 7fd4fa24b640 1 -- 172.21.15.121:0/1526276634 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec06a070 con 0x55f113844280 2023-12-07T21:09:16.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.340+0000 7fd4fa24b640 1 -- 172.21.15.121:0/1526276634 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ec052e50 con 0x55f113844280 2023-12-07T21:09:16.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.340+0000 7fd501412800 1 -- 172.21.15.121:0/1526276634 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f1137baf80 con 0x55f113844280 2023-12-07T21:09:16.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.340+0000 7fd4fa24b640 1 -- 172.21.15.121:0/1526276634 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec0655c0 con 0x55f113844280 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.341+0000 7fd501412800 1 -- 172.21.15.121:0/1526276634 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1137b9510 con 0x55f113844280 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.341+0000 7fd501412800 1 Processor -- start 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.341+0000 7fd501412800 1 -- start start 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.341+0000 7fd4fa24b640 1 -- 172.21.15.121:0/1526276634 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fd4ec059070 con 0x55f113844280 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.341+0000 7fd501412800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1138fee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.341+0000 7fd501412800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1136ec890 con 0x55f1138fea40 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4fa24b640 1 --2- 172.21.15.121:0/1526276634 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4e8036110 0x7fd4e80385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4fd251640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1138fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4fa24b640 1 -- 172.21.15.121:0/1526276634 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fd4ec08cc70 con 0x55f113844280 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4fd251640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1138fee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54402/0 (socket says 172.21.15.121:54402) 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4fd251640 1 -- 172.21.15.121:0/507380786 learned_addr learned my addr 172.21.15.121:0/507380786 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4fca50640 1 --2- 172.21.15.121:0/1526276634 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4e8036110 0x7fd4e80385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4fd251640 1 -- 172.21.15.121:0/507380786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1138ff3a0 con 0x55f1138fea40 2023-12-07T21:09:16.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4fd251640 1 --2- 172.21.15.121:0/507380786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1138fee60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400a430 tx=0x7fd4f400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3d52c5a919172f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4fca50640 1 --2- 172.21.15.121:0/1526276634 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4e8036110 0x7fd4e80385d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec044870 tx=0x7fd4ec079040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4e3fff640 1 -- 172.21.15.121:0/507380786 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f4001650 con 0x55f1138fea40 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4e3fff640 1 -- 172.21.15.121:0/507380786 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f40017d0 con 0x55f1138fea40 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd4e3fff640 1 -- 172.21.15.121:0/507380786 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f4001ab0 con 0x55f1138fea40 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd501412800 1 -- 172.21.15.121:0/507380786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 msgr2=0x55f1138fee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd501412800 1 --2- 172.21.15.121:0/507380786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1138fee60 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400a430 tx=0x7fd4f400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd501412800 1 -- 172.21.15.121:0/507380786 shutdown_connections 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.342+0000 7fd501412800 1 --2- 172.21.15.121:0/507380786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1138fee60 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.343+0000 7fd501412800 1 -- 172.21.15.121:0/507380786 >> 172.21.15.121:0/507380786 conn(0x55f113845440 msgr2=0x55f1138f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.343+0000 7fd501412800 1 -- 172.21.15.121:0/507380786 shutdown_connections 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.343+0000 7fd501412800 1 -- 172.21.15.121:0/507380786 wait complete. 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.343+0000 7fd501412800 1 Processor -- start 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.343+0000 7fd501412800 1 -- start start 2023-12-07T21:09:16.346 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.343+0000 7fd501412800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1139058b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.343+0000 7fd501412800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1136ec530 con 0x55f1138fea40 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.343+0000 7fd4fd251640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1139058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.343+0000 7fd4fd251640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1139058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54404/0 (socket says 172.21.15.121:54404) 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.343+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 learned_addr learned my addr 172.21.15.121:0/3656358697 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.343+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f400a0e0 con 0x55f1138fea40 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.344+0000 7fd4fd251640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1139058b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400a930 tx=0x7fd4f4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.344+0000 7fd4e27fc640 1 -- 172.21.15.121:0/3656358697 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f4010900 con 0x55f1138fea40 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.344+0000 7fd4e27fc640 1 -- 172.21.15.121:0/3656358697 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f4010a60 con 0x55f1138fea40 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.344+0000 7fd4e27fc640 1 -- 172.21.15.121:0/3656358697 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd4f4010d20 con 0x55f1138fea40 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.344+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f113905df0 con 0x55f1138fea40 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.344+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f113906250 con 0x55f1138fea40 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.344+0000 7fd4e27fc640 1 -- 172.21.15.121:0/3656358697 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fd4f4017030 con 0x55f1138fea40 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.345+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.345+0000 7fd4e27fc640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4d8036110 0x7fd4d80385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.345+0000 7fd4e27fc640 1 -- 172.21.15.121:0/3656358697 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fd4f404b7d0 con 0x55f1138fea40 2023-12-07T21:09:16.347 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.345+0000 7fd4fc24f640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4d8036110 0x7fd4d80385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.345+0000 7fd501412800 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f113911010 0x55f1139134a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.345+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113913bf0 con 0x55f113911010 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.345+0000 7fd4fd251640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f113911010 0x55f1139134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.345+0000 7fd4fc24f640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4d8036110 0x7fd4d80385d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0000f60 tx=0x7fd4f00012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.345+0000 7fd4fd251640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f113911010 0x55f1139134a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 20 realm 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113913fe0 con 0x55f113911010 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113914830 con 0x55f113911010 2023-12-07T21:09:16.348 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113914b90 con 0x55f113911010 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.346+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139144d0 con 0x55f113911010 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.347+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.347+0000 7fd501412800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.347+0000 7fd501412800 20 searching for the correct realm 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.347+0000 7fd501412800 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f113916de0 0x55f1139191d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.347+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113916de0 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.347+0000 7fd4fca50640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f113916de0 0x55f1139191d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.347+0000 7fd4fca50640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f113916de0 0x55f1139191d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.347+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4ec0777d0 con 0x55f113916de0 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.347+0000 7fd4fca50640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd4ec065070 0x7fd4ec05b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.347+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4ec065070 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.347+0000 7fd4fc24f640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd4ec065070 0x7fd4ec05b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.348+0000 7fd4fc24f640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd4ec065070 0x7fd4ec05b5a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.348+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.348+0000 7fd4fc24f640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd4f000f070 0x7fd4f000e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.348+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4f000f070 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.348+0000 7fd4fd251640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd4f000f070 0x7fd4f000e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.348+0000 7fd4fd251640 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd4f000f070 0x7fd4f000e8c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.349+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.349+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113911010 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.349+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.349+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113911010 2023-12-07T21:09:16.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.349+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.349+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4f000f070 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.349+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.349+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4f000f070 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.350+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.350+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4ec065070 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.350+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.350+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113916de0 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.350+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05ade0 con 0x55f113916de0 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.350+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113911010 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.350+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.350+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4f000f070 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.350+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.350+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113911010 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.351+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.351+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4ec065070 2023-12-07T21:09:16.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.351+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.351+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113916de0 2023-12-07T21:09:16.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.351+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.351+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113916de0 2023-12-07T21:09:16.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.351+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.351+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4f000f070 2023-12-07T21:09:16.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.352+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.352+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113916de0 2023-12-07T21:09:16.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.352+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.352+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113916de0 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.352+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.352+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113911010 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.352+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.352+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113911010 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.353+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.353+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4f000f070 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.353+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.353+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113916de0 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.353+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.353+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4ec065070 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.353+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.353+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113911010 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.354+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.354+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4f000f070 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.354+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.354+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113916de0 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.354+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.354+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4f000f070 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.354+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.354+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4ec065070 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.355+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.355+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113916de0 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.355+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.355+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x7fd4f000f070 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.355+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.355+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139197b0 con 0x55f113911010 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.355+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.355+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd4f4053080 con 0x7fd4ec065070 2023-12-07T21:09:16.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113915a20 con 0x55f113911010 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139156a0 con 0x55f113911010 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139162f0 con 0x55f113916de0 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 zone default found 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 4 Realm: () 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 zonegroup default 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.356+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113919bd0 con 0x7fd4f000f070 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd501412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391b940 con 0x55f113916de0 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd501412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391bcf0 con 0x55f113916de0 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd501412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd501412800 20 started sync module instance, tier type = 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd501412800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.357+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391b220 con 0x7fd4ec065070 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.358+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.358+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94493901373264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391b5d0 con 0x7fd4ec065070 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.358+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391c5e0 con 0x55f113911010 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.359+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94493901373264] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.360+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.360+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94493903793536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391c5e0 con 0x55f113911010 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.360+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391cfb0 con 0x55f113916de0 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.361+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.361+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94493903801008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391d830 con 0x55f113916de0 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.361+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391e220 con 0x7fd4ec065070 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.361+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94493903793536] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.362+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.362+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94493903798592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391ea70 con 0x7fd4ec065070 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.362+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391f270 con 0x55f113911010 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.362+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94493903801008] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.363+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.363+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94493903798592] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.363+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94493903803280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391f270 con 0x55f113911010 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.363+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391fac0 con 0x7fd4f000f070 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.364+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.366 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.364+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94493903811456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391fd90 con 0x7fd4f000f070 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.364+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113920860 con 0x7fd4f000f070 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.364+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94493903803280] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.365+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94493903811456] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.365+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.365+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94493903815488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391f7f0 con 0x7fd4f000f070 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.365+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113920cc0 con 0x7fd4f000f070 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.366+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94493903815488] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.366+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.366+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94493903810000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113920cc0 con 0x7fd4f000f070 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.366+0000 7fd501412800 20 add_watcher() i=0 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.366+0000 7fd501412800 20 add_watcher() i=1 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.366+0000 7fd501412800 20 add_watcher() i=2 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.366+0000 7fd501412800 20 add_watcher() i=3 2023-12-07T21:09:16.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.366+0000 7fd501412800 20 add_watcher() i=4 2023-12-07T21:09:16.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.366+0000 7fd501412800 20 add_watcher() i=5 2023-12-07T21:09:16.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.366+0000 7fd501412800 20 add_watcher() i=6 2023-12-07T21:09:16.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.367+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94493903810000] v31'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.367+0000 7fd501412800 20 add_watcher() i=7 2023-12-07T21:09:16.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.367+0000 7fd501412800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:16.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.367+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113924080 con 0x55f113911010 2023-12-07T21:09:16.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.367+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.368 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.367+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94493903817200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139215c0 con 0x55f113911010 2023-12-07T21:09:16.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.368+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94493903817200] v31'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.368+0000 7fd4c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.368+0000 7fd501412800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.368+0000 7fd501412800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.368+0000 7fd501412800 5 note: GC not initialized 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.369+0000 7fd4c1fe3640 20 reqs_thread_entry: start 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.369+0000 7fd501412800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.369+0000 7fd501412800 20 Filter name: none 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.369+0000 7fd4337fe640 20 reqs_thread_entry: start 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.369+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.369+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113957180 con 0x7fd4ec065070 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.369+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.369+0000 7fd501412800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.369+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.369+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113957b00 con 0x7fd4ec065070 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(63 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-07T21:09:16.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139566e0 con 0x7fd4ec065070 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139595f0 con 0x7fd4ec065070 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(65 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 4.e 4:719083e2:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113958fb0 con 0x7fd4ec065070 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 4.37 4:efedcd12:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11395e160 con 0x7fd4f000f070 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 4.27 4:e642d40c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113960bf0 con 0x55f113911010 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.370+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 4.27 4:e4a2f79e:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f1139635b0 con 0x55f113911010 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 4.18 4:1bea850c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113965f50 con 0x7fd4ec065070 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 4.9 4:933a13f7:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113965f50 con 0x55f113911010 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 4.26 4:658aa6de:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11396ad50 con 0x7fd4f000f070 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:73 4.3e 4:7c54f31d:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11396d530 con 0x7fd4ec065070 2023-12-07T21:09:16.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(66 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(70 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(68 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:74 4.9 4:93faacf1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113970360 con 0x55f113911010 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(71 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(69 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:75 4.34 4:2d01635f:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113960710 con 0x7fd4ec065070 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(67 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(72 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:76 4.3f 4:fca757fe:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113960820 con 0x7fd4ec065070 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(73 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(75 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.371+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(76 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.372+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(74 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.372+0000 7fd501412800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.372+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.b 6:d2b92e8e:::pubsub..bucket.myfoo%2fef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11396ceb0 con 0x55f113916de0 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.372+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(77 pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.372+0000 7fd501412800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.372+0000 7fd4c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.373+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94493903817200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11393fc90 con 0x55f113911010 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.374+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94493903817200] v31'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.374+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94493901373264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11393fc90 con 0x7fd4ec065070 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.374+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94493901373264] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.374+0000 7fd501412800 20 remove_watcher() i=0 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.374+0000 7fd501412800 2 removed watcher, disabling cache 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.374+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94493903793536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11393fc90 con 0x55f113911010 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.376+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94493903793536] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.376+0000 7fd501412800 20 remove_watcher() i=1 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.376+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94493903801008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11393fc90 con 0x55f113916de0 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.377+0000 7fd4fca50640 1 -- 172.21.15.121:0/3656358697 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94493903801008] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4ec05bae0 con 0x55f113916de0 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.377+0000 7fd501412800 20 remove_watcher() i=2 2023-12-07T21:09:16.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.377+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94493903798592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113956090 con 0x7fd4ec065070 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.378+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94493903798592] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f000f5f0 con 0x7fd4ec065070 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.378+0000 7fd501412800 20 remove_watcher() i=3 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.378+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94493903803280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113956090 con 0x55f113911010 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.379+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94493903803280] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x55f113911010 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.379+0000 7fd501412800 20 remove_watcher() i=4 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.379+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94493903811456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f113956090 con 0x7fd4f000f070 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.380+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94493903811456] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.380+0000 7fd501412800 20 remove_watcher() i=5 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.380+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94493903815488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391f380 con 0x7fd4f000f070 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.381+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94493903815488] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.381+0000 7fd501412800 20 remove_watcher() i=6 2023-12-07T21:09:16.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.381+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94493903810000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f11391f380 con 0x7fd4f000f070 2023-12-07T21:09:16.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd4fd251640 1 -- 172.21.15.121:0/3656358697 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94493903810000] v31'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd4f402e9d0 con 0x7fd4f000f070 2023-12-07T21:09:16.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 20 remove_watcher() i=7 2023-12-07T21:09:16.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd4f000f070 msgr2=0x7fd4f000e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd4f000f070 0x7fd4f000e8c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f113911010 msgr2=0x55f1139134a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f113911010 0x55f1139134a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd4ec065070 msgr2=0x7fd4ec05b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd4ec065070 0x7fd4ec05b5a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f113916de0 msgr2=0x55f1139191d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f113916de0 0x55f1139191d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4d8036110 msgr2=0x7fd4d80385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4d8036110 0x7fd4d80385d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0000f60 tx=0x7fd4f00012f0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 msgr2=0x55f1139058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd4fc24f640 1 -- 172.21.15.121:0/3656358697 reap_dead start 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1139058b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400a930 tx=0x7fd4f4003370 comp rx=0 tx=0).stop 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 shutdown_connections 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 --2- 172.21.15.121:0/3656358697 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f1138fea40 0x55f1139058b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 >> 172.21.15.121:0/3656358697 conn(0x55f113845440 msgr2=0x55f1138f99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 shutdown_connections 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.382+0000 7fd501412800 1 -- 172.21.15.121:0/3656358697 wait complete. 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.383+0000 7fd501412800 1 -- 172.21.15.121:0/1526276634 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4e8036110 msgr2=0x7fd4e80385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.383+0000 7fd501412800 1 --2- 172.21.15.121:0/1526276634 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4e8036110 0x7fd4e80385d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec044870 tx=0x7fd4ec079040 comp rx=0 tx=0).stop 2023-12-07T21:09:16.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.383+0000 7fd501412800 1 -- 172.21.15.121:0/1526276634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 msgr2=0x55f1137baa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.383+0000 7fd501412800 1 --2- 172.21.15.121:0/1526276634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1137baa40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec01ceb0 tx=0x7fd4ec002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.383+0000 7fd501412800 1 -- 172.21.15.121:0/1526276634 shutdown_connections 2023-12-07T21:09:16.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.383+0000 7fd501412800 1 --2- 172.21.15.121:0/1526276634 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd4e8036110 0x7fd4e80385d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.383+0000 7fd501412800 1 --2- 172.21.15.121:0/1526276634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f113844280 0x55f1137baa40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.383+0000 7fd501412800 1 -- 172.21.15.121:0/1526276634 >> 172.21.15.121:0/1526276634 conn(0x55f11383f980 msgr2=0x55f1138e7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.383+0000 7fd501412800 1 -- 172.21.15.121:0/1526276634 shutdown_connections 2023-12-07T21:09:16.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.383+0000 7fd501412800 1 -- 172.21.15.121:0/1526276634 wait complete. 2023-12-07T21:09:16.384 INFO:teuthology.orchestra.run.smithi121.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"209e4ade-356c-43a0-a93d-cc9500dad162","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","marker":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2023-12-07T21:09:15.868775Z","creation_time":"2023-12-07T21:09:15.863874Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2023-12-07T21:09:16.384 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '209e4ade-356c-43a0-a93d-cc9500dad162', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'marker': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-12-07T21:09:15.868775Z', 'creation_time': '2023-12-07T21:09:15.863874Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2023-12-07T21:09:16.384 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2023-12-07T21:09:16.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2023-12-07T21:09:16.384 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2023-12-07T21:09:16.466 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:16.466 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:16.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.474+0000 7f030f924800 1 Processor -- start 2023-12-07T21:09:16.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.474+0000 7f030f924800 1 -- start start 2023-12-07T21:09:16.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.474+0000 7f030f924800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f46296a520 0x55f46296c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.474+0000 7f030f924800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f4628b27a0 con 0x55f4628dab50 2023-12-07T21:09:16.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.474+0000 7f030f924800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f46287b880 con 0x55f46296a520 2023-12-07T21:09:16.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.474+0000 7f030b51c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55f4628dab50 0x55f462968e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55746/0 (socket says 172.21.15.121:55746) 2023-12-07T21:09:16.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.474+0000 7f030b51c640 1 -- 172.21.15.121:0/2901108440 learned_addr learned my addr 172.21.15.121:0/2901108440 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:16.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.474+0000 7f030ad1b640 1 --2- 172.21.15.121:0/2901108440 >> v2:172.21.15.89:3300/0 conn(0x55f46296a520 0x55f46296c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.474+0000 7f030a51a640 1 -- 172.21.15.121:0/2901108440 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573127555 0 0) 0x55f4628b27a0 con 0x55f4628dab50 2023-12-07T21:09:16.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.474+0000 7f030a51a640 1 -- 172.21.15.121:0/2901108440 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02f4001e10 con 0x55f4628dab50 2023-12-07T21:09:16.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.474+0000 7f030ad1b640 1 -- 172.21.15.121:0/2901108440 >> v1:172.21.15.89:6789/0 conn(0x55f4628dab50 legacy=0x55f462968e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.475+0000 7f030ad1b640 1 -- 172.21.15.121:0/2901108440 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f46296e050 con 0x55f46296a520 2023-12-07T21:09:16.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.476+0000 7f030ad1b640 1 --2- 172.21.15.121:0/2901108440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f46296a520 0x55f46296c970 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f030000a470 tx=0x7f030001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b54346efd48c9c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.477+0000 7f030a51a640 1 -- 172.21.15.121:0/2901108440 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f030004ad60 con 0x55f46296a520 2023-12-07T21:09:16.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.477+0000 7f030a51a640 1 -- 172.21.15.121:0/2901108440 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0300052440 con 0x55f46296a520 2023-12-07T21:09:16.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.477+0000 7f030a51a640 1 -- 172.21.15.121:0/2901108440 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03000526e0 con 0x55f46296a520 2023-12-07T21:09:16.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.477+0000 7f030f924800 1 -- 172.21.15.121:0/2901108440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f46296a520 msgr2=0x55f46296c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.477+0000 7f030f924800 1 --2- 172.21.15.121:0/2901108440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f46296a520 0x55f46296c970 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f030000a470 tx=0x7f030001cc80 comp rx=0 tx=0).stop 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.477+0000 7f030f924800 1 -- 172.21.15.121:0/2901108440 shutdown_connections 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.477+0000 7f030f924800 1 --2- 172.21.15.121:0/2901108440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f46296a520 0x55f46296c970 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.477+0000 7f030f924800 1 -- 172.21.15.121:0/2901108440 >> 172.21.15.121:0/2901108440 conn(0x55f462960880 msgr2=0x55f462962ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.477+0000 7f030f924800 1 -- 172.21.15.121:0/2901108440 shutdown_connections 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.477+0000 7f030f924800 1 -- 172.21.15.121:0/2901108440 wait complete. 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.478+0000 7f030f924800 1 Processor -- start 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.478+0000 7f030f924800 1 -- start start 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.478+0000 7f030f924800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462966520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.478+0000 7f030f924800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f462878db0 con 0x55f4628dab50 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.478+0000 7f030b51c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462966520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.478+0000 7f030b51c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462966520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54422/0 (socket says 172.21.15.121:54422) 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.478+0000 7f030b51c640 1 -- 172.21.15.121:0/1610161743 learned_addr learned my addr 172.21.15.121:0/1610161743 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.478+0000 7f030b51c640 1 -- 172.21.15.121:0/1610161743 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0300005d20 con 0x55f4628dab50 2023-12-07T21:09:16.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.479+0000 7f030b51c640 1 --2- 172.21.15.121:0/1610161743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462966520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02fc001bd0 tx=0x7f02fc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d397f5d7ecc5b37 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.479+0000 7f0309d19640 1 -- 172.21.15.121:0/1610161743 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02fc00e470 con 0x55f4628dab50 2023-12-07T21:09:16.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.479+0000 7f0309d19640 1 -- 172.21.15.121:0/1610161743 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc00e5f0 con 0x55f4628dab50 2023-12-07T21:09:16.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.479+0000 7f0309d19640 1 -- 172.21.15.121:0/1610161743 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02fc00e950 con 0x55f4628dab50 2023-12-07T21:09:16.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.479+0000 7f030f924800 1 -- 172.21.15.121:0/1610161743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 msgr2=0x55f462966520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.479+0000 7f030f924800 1 --2- 172.21.15.121:0/1610161743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462966520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f02fc001bd0 tx=0x7f02fc00b6c0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.479+0000 7f030f924800 1 -- 172.21.15.121:0/1610161743 shutdown_connections 2023-12-07T21:09:16.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.479+0000 7f030f924800 1 --2- 172.21.15.121:0/1610161743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462966520 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.479+0000 7f030f924800 1 -- 172.21.15.121:0/1610161743 >> 172.21.15.121:0/1610161743 conn(0x55f462960880 msgr2=0x55f462a068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.479+0000 7f030f924800 1 -- 172.21.15.121:0/1610161743 shutdown_connections 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.479+0000 7f030f924800 1 -- 172.21.15.121:0/1610161743 wait complete. 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f030f924800 1 Processor -- start 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f030f924800 1 -- start start 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f030f924800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462a14280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f030f924800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4628746a0 con 0x55f4628dab50 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f030b51c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462a14280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f030b51c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462a14280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54438/0 (socket says 172.21.15.121:54438) 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f030b51c640 1 -- 172.21.15.121:0/3746142615 learned_addr learned my addr 172.21.15.121:0/3746142615 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f030b51c640 1 -- 172.21.15.121:0/3746142615 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f4001e10 con 0x55f4628dab50 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f030b51c640 1 --2- 172.21.15.121:0/3746142615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462a14280 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00b700 tx=0x7f02fc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f0308d17640 1 -- 172.21.15.121:0/3746142615 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02fc01f070 con 0x55f4628dab50 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f0308d17640 1 -- 172.21.15.121:0/3746142615 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc018790 con 0x55f4628dab50 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f030f924800 1 -- 172.21.15.121:0/3746142615 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f462a147c0 con 0x55f4628dab50 2023-12-07T21:09:16.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.480+0000 7f0308d17640 1 -- 172.21.15.121:0/3746142615 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02fc018a70 con 0x55f4628dab50 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.481+0000 7f030f924800 1 -- 172.21.15.121:0/3746142615 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f462a14ca0 con 0x55f4628dab50 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.481+0000 7f030f924800 1 Processor -- start 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.481+0000 7f030f924800 1 -- start start 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.481+0000 7f030f924800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 0x55f462a208f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.481+0000 7f030f924800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46280e890 con 0x55f462a204d0 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.481+0000 7f0308d17640 1 -- 172.21.15.121:0/3746142615 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f02fc018bd0 con 0x55f4628dab50 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.481+0000 7f0308d17640 1 --2- 172.21.15.121:0/3746142615 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f02f8036110 0x7f02f80385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.481+0000 7f030bd1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 0x55f462a208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.481+0000 7f030bd1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 0x55f462a208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54444/0 (socket says 172.21.15.121:54444) 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.481+0000 7f030bd1d640 1 -- 172.21.15.121:0/657950461 learned_addr learned my addr 172.21.15.121:0/657950461 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.481+0000 7f0308d17640 1 -- 172.21.15.121:0/3746142615 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f02fc04ba40 con 0x55f4628dab50 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f030b51c640 1 --2- 172.21.15.121:0/3746142615 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f02f8036110 0x7f02f80385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f030bd1d640 1 -- 172.21.15.121:0/657950461 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f462a20e30 con 0x55f462a204d0 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f030bd1d640 1 --2- 172.21.15.121:0/657950461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 0x55f462a208f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f030400a430 tx=0x7f030400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d503909c660b4dba server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f030b51c640 1 --2- 172.21.15.121:0/3746142615 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f02f8036110 0x7f02f80385d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f02fc017fd0 tx=0x7f02fc001970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f02f27fc640 1 -- 172.21.15.121:0/657950461 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0304001650 con 0x55f462a204d0 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f02f27fc640 1 -- 172.21.15.121:0/657950461 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03040017d0 con 0x55f462a204d0 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f02f27fc640 1 -- 172.21.15.121:0/657950461 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0304001ab0 con 0x55f462a204d0 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f030f924800 1 -- 172.21.15.121:0/657950461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 msgr2=0x55f462a208f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f030f924800 1 --2- 172.21.15.121:0/657950461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 0x55f462a208f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f030400a430 tx=0x7f030400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f030f924800 1 -- 172.21.15.121:0/657950461 shutdown_connections 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f030f924800 1 --2- 172.21.15.121:0/657950461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 0x55f462a208f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f030f924800 1 -- 172.21.15.121:0/657950461 >> 172.21.15.121:0/657950461 conn(0x55f46296a520 msgr2=0x55f462a1b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f030f924800 1 -- 172.21.15.121:0/657950461 shutdown_connections 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.482+0000 7f030f924800 1 -- 172.21.15.121:0/657950461 wait complete. 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.483+0000 7f030f924800 1 Processor -- start 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.483+0000 7f030f924800 1 -- start start 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.483+0000 7f030f924800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 0x55f462a274d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.483+0000 7f030f924800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46280e530 con 0x55f462a204d0 2023-12-07T21:09:16.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.483+0000 7f030bd1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 0x55f462a274d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.483+0000 7f030bd1d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 0x55f462a274d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54456/0 (socket says 172.21.15.121:54456) 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.483+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 learned_addr learned my addr 172.21.15.121:0/680044343 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.483+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030400a0e0 con 0x55f462a204d0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.483+0000 7f030bd1d640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 0x55f462a274d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f030400a930 tx=0x7f0304003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.484+0000 7f02f0ff9640 1 -- 172.21.15.121:0/680044343 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0304010900 con 0x55f462a204d0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.484+0000 7f02f0ff9640 1 -- 172.21.15.121:0/680044343 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0304010a60 con 0x55f462a204d0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.484+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f462a27a10 con 0x55f462a204d0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.484+0000 7f02f0ff9640 1 -- 172.21.15.121:0/680044343 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0304010d20 con 0x55f462a204d0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.484+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f462a27e70 con 0x55f462a204d0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.484+0000 7f02f0ff9640 1 -- 172.21.15.121:0/680044343 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0304017030 con 0x55f462a204d0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.485+0000 7f02f0ff9640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f02e4036110 0x7f02e40385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.485+0000 7f02f0ff9640 1 -- 172.21.15.121:0/680044343 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f030404b7d0 con 0x55f462a204d0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.485+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.485+0000 7f030ad1b640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f02e4036110 0x7f02e40385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.485+0000 7f030f924800 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f462a32c40 0x55f462a35100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.485+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a35830 con 0x55f462a32c40 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.485+0000 7f030bd1d640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f462a32c40 0x55f462a35100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.485+0000 7f030ad1b640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f02e4036110 0x7f02e40385d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0300054000 tx=0x7f030004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.485+0000 7f030bd1d640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f462a32c40 0x55f462a35100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 20 realm 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a35c20 con 0x55f462a32c40 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a36470 con 0x55f462a32c40 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a367d0 con 0x55f462a32c40 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a36110 con 0x55f462a32c40 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.486+0000 7f030f924800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.487+0000 7f030f924800 20 searching for the correct realm 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.487+0000 7f030f924800 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f462a38a20 0x55f462a3ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.487+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a38a20 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.487+0000 7f030b51c640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f462a38a20 0x55f462a3ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.487+0000 7f030b51c640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f462a38a20 0x55f462a3ae10 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.487+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.487+0000 7f030b51c640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f02fc017050 0x7f02fc02d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.487+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f02fc017050 2023-12-07T21:09:16.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.487+0000 7f030ad1b640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f02fc017050 0x7f02fc02d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.488+0000 7f030ad1b640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f02fc017050 0x7f02fc02d440 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.488+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0300059040 con 0x7f02fc017050 2023-12-07T21:09:16.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.488+0000 7f030ad1b640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f030005c950 0x7f0300009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.488+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f030005c950 2023-12-07T21:09:16.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.488+0000 7f030bd1d640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f030005c950 0x7f0300009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.488+0000 7f030bd1d640 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f030005c950 0x7f0300009410 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.489+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.489+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a32c40 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.489+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.489+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a32c40 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.489+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.489+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f030005c950 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.489+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.489+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f030005c950 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.489+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.489+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f02fc017050 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.490+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0300059040 con 0x7f02fc017050 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.490+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a38a20 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.490+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.490+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a32c40 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.490+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.490+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f030005c950 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.490+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.490+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a32c40 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.491+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.491+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f02fc017050 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.491+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0300059040 con 0x7f02fc017050 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.491+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a38a20 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.491+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.491+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a38a20 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.491+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.491+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f030005c950 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.491+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.491+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a38a20 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.492+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.492+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a38a20 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.492+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.492+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a32c40 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.492+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.492+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a32c40 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.492+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.492+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f030005c950 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.493+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.493+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a38a20 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.493+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.493+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f02fc017050 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.493+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0300059040 con 0x7f02fc017050 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.493+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a32c40 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.493+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.493+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f030005c950 2023-12-07T21:09:16.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.494+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.494+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a38a20 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.494+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.494+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f030005c950 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.494+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.494+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f02fc017050 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.495+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0300059040 con 0x7f02fc017050 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.495+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a38a20 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.495+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.495+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x7f030005c950 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.495+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.495+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b3f0 con 0x55f462a32c40 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.495+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.495+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0304053080 con 0x7f02fc017050 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:16.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a37660 con 0x55f462a32c40 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a37aa0 con 0x55f462a32c40 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a37e80 con 0x55f462a38a20 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:16.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 zone default found 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 4 Realm: () 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 zonegroup default 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.496+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3b810 con 0x7f030005c950 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030f924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3d690 con 0x55f462a38a20 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030f924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3d9f0 con 0x55f462a38a20 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030f924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030f924800 20 started sync module instance, tier type = 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030f924800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.497+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3cc60 con 0x7f02fc017050 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.498+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.498+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94508112863056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3d050 con 0x7f02fc017050 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.498+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3e1f0 con 0x55f462a32c40 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.499+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94508112863056] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.500+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.500+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94508115281856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3e1f0 con 0x55f462a32c40 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.500+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3ebc0 con 0x55f462a38a20 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.501+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94508115281856] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.501+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.501+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94508115287376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3e160 con 0x55f462a38a20 2023-12-07T21:09:16.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.501+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a3f8e0 con 0x7f02fc017050 2023-12-07T21:09:16.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.502+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94508115287376] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.502+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.502+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94508115292400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a400e0 con 0x7f02fc017050 2023-12-07T21:09:16.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.502+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a408e0 con 0x55f462a32c40 2023-12-07T21:09:16.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.503+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94508115292400] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.503+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.503+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94508115297344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a40850 con 0x55f462a32c40 2023-12-07T21:09:16.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.503+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a41600 con 0x7f030005c950 2023-12-07T21:09:16.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.504+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.504+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94508115300704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a41a10 con 0x7f030005c950 2023-12-07T21:09:16.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.504+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a423c0 con 0x7f030005c950 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.504+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94508115297344] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.505+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94508115300704] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.505+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.505+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94508115299440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a41a10 con 0x7f030005c950 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.505+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a427d0 con 0x7f030005c950 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94508115305136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a42790 con 0x7f030005c950 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030f924800 20 add_watcher() i=0 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030f924800 20 add_watcher() i=1 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030f924800 20 add_watcher() i=2 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030f924800 20 add_watcher() i=3 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030f924800 20 add_watcher() i=4 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030f924800 20 add_watcher() i=5 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94508115299440] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030f924800 20 add_watcher() i=6 2023-12-07T21:09:16.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94508115305136] v31'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030f924800 20 add_watcher() i=7 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030f924800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.507+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a41570 con 0x55f462a32c40 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.508+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.508+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94508115307136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a41570 con 0x55f462a32c40 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.509+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94508115307136] v31'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.509+0000 7f02d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.509+0000 7f030f924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.509+0000 7f030f924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.509+0000 7f030f924800 5 note: GC not initialized 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.509+0000 7f024bfff640 20 reqs_thread_entry: start 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.509+0000 7f030f924800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.509+0000 7f030f924800 20 Filter name: none 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.509+0000 7f0249ffb640 20 reqs_thread_entry: start 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.510+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.510+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a78700 con 0x55f462a32c40 2023-12-07T21:09:16.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.510+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.510+0000 7f030f924800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.510+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a79ab0 con 0x7f02fc017050 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.510+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv15 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.510+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.510+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a77520 con 0x7f02fc017050 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.510+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.510+0000 7f030f924800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a79e10 con 0x7f02fc017050 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(65 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 4.e 4:719083e2:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a79190 con 0x7f02fc017050 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 4.37 4:efedcd12:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a7e710 con 0x7f030005c950 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 4.27 4:e642d40c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a80f30 con 0x55f462a32c40 2023-12-07T21:09:16.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 4.27 4:e4a2f79e:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a837f0 con 0x55f462a32c40 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 4.18 4:1bea850c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a86280 con 0x7f02fc017050 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 4.9 4:933a13f7:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a88c80 con 0x55f462a32c40 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 4.26 4:658aa6de:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a8b670 con 0x7f030005c950 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:73 4.3e 4:7c54f31d:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a8e070 con 0x7f02fc017050 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:74 4.9 4:93faacf1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a90a70 con 0x55f462a32c40 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:75 4.34 4:2d01635f:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a938c0 con 0x7f02fc017050 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:76 4.3f 4:fca757fe:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a96190 con 0x7f02fc017050 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.511+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(66 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(68 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(71 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(70 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(74 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(73 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(69 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(75 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(67 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(72 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(76 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030f924800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.b 6:d2b92e8e:::pubsub..bucket.myfoo%2fef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a83ff0 con 0x55f462a38a20 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(77 pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.512+0000 7f030f924800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.513+0000 7f02d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.513+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94508115307136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a85360 con 0x55f462a32c40 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.514+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94508115307136] v31'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.514+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94508112863056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a79e10 con 0x7f02fc017050 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.515+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94508112863056] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.515+0000 7f030f924800 20 remove_watcher() i=0 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.515+0000 7f030f924800 2 removed watcher, disabling cache 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.515+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94508115281856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a79e10 con 0x55f462a32c40 2023-12-07T21:09:16.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.516+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94508115281856] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.516+0000 7f030f924800 20 remove_watcher() i=1 2023-12-07T21:09:16.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.516+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94508115287376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a79e10 con 0x55f462a38a20 2023-12-07T21:09:16.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.517+0000 7f030b51c640 1 -- 172.21.15.121:0/680044343 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94508115287376] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f02fc014070 con 0x55f462a38a20 2023-12-07T21:09:16.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.517+0000 7f030f924800 20 remove_watcher() i=2 2023-12-07T21:09:16.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.517+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94508115292400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a85360 con 0x7f02fc017050 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.518+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94508115292400] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0300070040 con 0x7f02fc017050 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.518+0000 7f030f924800 20 remove_watcher() i=3 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.518+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94508115297344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a85360 con 0x55f462a32c40 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.519+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94508115297344] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x55f462a32c40 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.519+0000 7f030f924800 20 remove_watcher() i=4 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.519+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94508115300704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a85360 con 0x7f030005c950 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.520+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94508115300704] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.520+0000 7f030f924800 20 remove_watcher() i=5 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.520+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94508115299440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a41160 con 0x7f030005c950 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.520+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94508115299440] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.521+0000 7f030f924800 20 remove_watcher() i=6 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.521+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94508115305136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f462a41160 con 0x7f030005c950 2023-12-07T21:09:16.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030bd1d640 1 -- 172.21.15.121:0/680044343 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94508115305136] v31'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f030402e9d0 con 0x7f030005c950 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 20 remove_watcher() i=7 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f030005c950 msgr2=0x7f0300009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f030005c950 0x7f0300009410 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f462a32c40 msgr2=0x55f462a35100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f462a32c40 0x55f462a35100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f02fc017050 msgr2=0x7f02fc02d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f02fc017050 0x7f02fc02d440 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f462a38a20 msgr2=0x55f462a3ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f462a38a20 0x55f462a3ae10 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f02e4036110 msgr2=0x7f02e40385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f02e4036110 0x7f02e40385d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0300054000 tx=0x7f030004e000 comp rx=0 tx=0).stop 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 msgr2=0x55f462a274d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 --2- 172.21.15.121:0/680044343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f462a204d0 0x55f462a274d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f030400a930 tx=0x7f0304003370 comp rx=0 tx=0).stop 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 reap_dead start 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030ad1b640 1 -- 172.21.15.121:0/680044343 reap_dead start 2023-12-07T21:09:16.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 shutdown_connections 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 >> 172.21.15.121:0/680044343 conn(0x55f46296a520 msgr2=0x55f462a1a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 shutdown_connections 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/680044343 wait complete. 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/3746142615 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f02f8036110 msgr2=0x7f02f80385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 --2- 172.21.15.121:0/3746142615 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f02f8036110 0x7f02f80385d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f02fc017fd0 tx=0x7f02fc001970 comp rx=0 tx=0).stop 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/3746142615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 msgr2=0x55f462a14280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 --2- 172.21.15.121:0/3746142615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462a14280 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00b700 tx=0x7f02fc000bc0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/3746142615 shutdown_connections 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 --2- 172.21.15.121:0/3746142615 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f02f8036110 0x7f02f80385d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 --2- 172.21.15.121:0/3746142615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f4628dab50 0x55f462a14280 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/3746142615 >> 172.21.15.121:0/3746142615 conn(0x55f462960880 msgr2=0x55f462964e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/3746142615 shutdown_connections 2023-12-07T21:09:16.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.522+0000 7f030f924800 1 -- 172.21.15.121:0/3746142615 wait complete. 2023-12-07T21:09:16.522 INFO:teuthology.orchestra.run.smithi121.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"209e4ade-356c-43a0-a93d-cc9500dad162","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","marker":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2023-12-07T21:09:15.868775Z","creation_time":"2023-12-07T21:09:15.863874Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]}] 2023-12-07T21:09:16.522 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '209e4ade-356c-43a0-a93d-cc9500dad162', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'marker': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-12-07T21:09:15.868775Z', 'creation_time': '2023-12-07T21:09:15.863874Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []}] 2023-12-07T21:09:16.528 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-12-07T21:09:16.528 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2023-12-07T21:09:16.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2023-12-07T21:09:16.528 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2023-12-07T21:09:16.604 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.612+0000 7f3770537800 1 Processor -- start 2023-12-07T21:09:16.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.612+0000 7f3770537800 1 -- start start 2023-12-07T21:09:16.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.613+0000 7f3770537800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557fd3b56830 0x557fd3b58c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.613+0000 7f3770537800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557fd3a9e7a0 con 0x557fd3b538a0 2023-12-07T21:09:16.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.613+0000 7f3770537800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x557fd3a67880 con 0x557fd3b56830 2023-12-07T21:09:16.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.613+0000 7f3763acc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557fd3b56830 0x557fd3b58c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.613+0000 7f376c2cd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x557fd3b538a0 0x557fd3b53cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55750/0 (socket says 172.21.15.121:55750) 2023-12-07T21:09:16.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.613+0000 7f376c2cd640 1 -- 172.21.15.121:0/1655207685 learned_addr learned my addr 172.21.15.121:0/1655207685 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:16.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.613+0000 7f3763acc640 1 -- 172.21.15.121:0/1655207685 >> v1:172.21.15.89:6789/0 conn(0x557fd3b538a0 legacy=0x557fd3b53cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.613+0000 7f376bacc640 1 -- 172.21.15.121:0/1655207685 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694293931 0 0) 0x557fd3a9e7a0 con 0x557fd3b538a0 2023-12-07T21:09:16.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.613+0000 7f3763acc640 1 -- 172.21.15.121:0/1655207685 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fd3b5a170 con 0x557fd3b56830 2023-12-07T21:09:16.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.615+0000 7f3763acc640 1 --2- 172.21.15.121:0/1655207685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b56830 0x557fd3b58c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f375400a470 tx=0x7f375401cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea514b3bd502f42f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.615+0000 7f376bacc640 1 -- 172.21.15.121:0/1655207685 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3754052570 con 0x557fd3b56830 2023-12-07T21:09:16.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.615+0000 7f376bacc640 1 -- 172.21.15.121:0/1655207685 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37540526d0 con 0x557fd3b56830 2023-12-07T21:09:16.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.615+0000 7f376bacc640 1 -- 172.21.15.121:0/1655207685 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3754052990 con 0x557fd3b56830 2023-12-07T21:09:16.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.616+0000 7f3770537800 1 -- 172.21.15.121:0/1655207685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b56830 msgr2=0x557fd3b58c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.616+0000 7f3770537800 1 --2- 172.21.15.121:0/1655207685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b56830 0x557fd3b58c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f375400a470 tx=0x7f375401cdf0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.616+0000 7f3770537800 1 -- 172.21.15.121:0/1655207685 shutdown_connections 2023-12-07T21:09:16.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.616+0000 7f3770537800 1 --2- 172.21.15.121:0/1655207685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b56830 0x557fd3b58c20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.616+0000 7f3770537800 1 -- 172.21.15.121:0/1655207685 >> 172.21.15.121:0/1655207685 conn(0x557fd3b4bf60 msgr2=0x557fd3b4e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.616+0000 7f3770537800 1 -- 172.21.15.121:0/1655207685 shutdown_connections 2023-12-07T21:09:16.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.616+0000 7f3770537800 1 -- 172.21.15.121:0/1655207685 wait complete. 2023-12-07T21:09:16.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.616+0000 7f3770537800 1 Processor -- start 2023-12-07T21:09:16.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.616+0000 7f3770537800 1 -- start start 2023-12-07T21:09:16.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.616+0000 7f3770537800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bf6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.616+0000 7f3770537800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd3a64db0 con 0x557fd3b538a0 2023-12-07T21:09:16.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.617+0000 7f376c2cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bf6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.617+0000 7f376c2cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bf6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54462/0 (socket says 172.21.15.121:54462) 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.617+0000 7f376c2cd640 1 -- 172.21.15.121:0/3892231491 learned_addr learned my addr 172.21.15.121:0/3892231491 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.617+0000 7f376c2cd640 1 -- 172.21.15.121:0/3892231491 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754005d20 con 0x557fd3b538a0 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.617+0000 7f376c2cd640 1 --2- 172.21.15.121:0/3892231491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bf6d30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f375c00b240 tx=0x7f375c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7615a32534bf1ab6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.617+0000 7f376b2cb640 1 -- 172.21.15.121:0/3892231491 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f375c014070 con 0x557fd3b538a0 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.617+0000 7f376b2cb640 1 -- 172.21.15.121:0/3892231491 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c00d500 con 0x557fd3b538a0 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.617+0000 7f376b2cb640 1 -- 172.21.15.121:0/3892231491 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f375c00d820 con 0x557fd3b538a0 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.618+0000 7f3770537800 1 -- 172.21.15.121:0/3892231491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 msgr2=0x557fd3bf6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.618+0000 7f3770537800 1 --2- 172.21.15.121:0/3892231491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bf6d30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f375c00b240 tx=0x7f375c00b700 comp rx=0 tx=0).stop 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.618+0000 7f3770537800 1 -- 172.21.15.121:0/3892231491 shutdown_connections 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.618+0000 7f3770537800 1 --2- 172.21.15.121:0/3892231491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bf6d30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.618+0000 7f3770537800 1 -- 172.21.15.121:0/3892231491 >> 172.21.15.121:0/3892231491 conn(0x557fd3b4bf60 msgr2=0x557fd3bf29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.618+0000 7f3770537800 1 -- 172.21.15.121:0/3892231491 shutdown_connections 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.618+0000 7f3770537800 1 -- 172.21.15.121:0/3892231491 wait complete. 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.618+0000 7f3770537800 1 Processor -- start 2023-12-07T21:09:16.613 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.618+0000 7f3770537800 1 -- start start 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.618+0000 7f3770537800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bfe1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.618+0000 7f3770537800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd3a606a0 con 0x557fd3b538a0 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f376c2cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bfe1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f376c2cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bfe1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54476/0 (socket says 172.21.15.121:54476) 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f376c2cd640 1 -- 172.21.15.121:0/103331865 learned_addr learned my addr 172.21.15.121:0/103331865 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f376c2cd640 1 -- 172.21.15.121:0/103331865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c001ba0 con 0x557fd3b538a0 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f376c2cd640 1 --2- 172.21.15.121:0/103331865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bfe1d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x557fd3bf3420 tx=0x7f375c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f376a2c9640 1 -- 172.21.15.121:0/103331865 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f375c00de10 con 0x557fd3b538a0 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f3770537800 1 -- 172.21.15.121:0/103331865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557fd3bfe710 con 0x557fd3b538a0 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f3770537800 1 -- 172.21.15.121:0/103331865 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557fd3bfebf0 con 0x557fd3b538a0 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f3770537800 1 Processor -- start 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f376a2c9640 1 -- 172.21.15.121:0/103331865 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c020070 con 0x557fd3b538a0 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f376a2c9640 1 -- 172.21.15.121:0/103331865 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f375c00fab0 con 0x557fd3b538a0 2023-12-07T21:09:16.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.619+0000 7f3770537800 1 -- start start 2023-12-07T21:09:16.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.620+0000 7f3770537800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 0x557fd3c0a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.620+0000 7f3770537800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd39fa890 con 0x557fd3c0a430 2023-12-07T21:09:16.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.620+0000 7f376a2c9640 1 -- 172.21.15.121:0/103331865 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f375c00d040 con 0x557fd3b538a0 2023-12-07T21:09:16.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.620+0000 7f376cace640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 0x557fd3c0a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.620+0000 7f376cace640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 0x557fd3c0a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54478/0 (socket says 172.21.15.121:54478) 2023-12-07T21:09:16.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.620+0000 7f376cace640 1 -- 172.21.15.121:0/3415112013 learned_addr learned my addr 172.21.15.121:0/3415112013 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.620+0000 7f376a2c9640 1 --2- 172.21.15.121:0/103331865 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f374c0360c0 0x7f374c038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.620+0000 7f376a2c9640 1 -- 172.21.15.121:0/103331865 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f375c00a040 con 0x557fd3b538a0 2023-12-07T21:09:16.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.620+0000 7f376cace640 1 -- 172.21.15.121:0/3415112013 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fd3c0ad90 con 0x557fd3c0a430 2023-12-07T21:09:16.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.620+0000 7f376c2cd640 1 --2- 172.21.15.121:0/103331865 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f374c0360c0 0x7f374c038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f376cace640 1 --2- 172.21.15.121:0/3415112013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 0x557fd3c0a850 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f376400a430 tx=0x7f376400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84157cafad062c42 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f37632cb640 1 -- 172.21.15.121:0/3415112013 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3764001650 con 0x557fd3c0a430 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f37632cb640 1 -- 172.21.15.121:0/3415112013 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37640017d0 con 0x557fd3c0a430 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f37632cb640 1 -- 172.21.15.121:0/3415112013 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3764001ab0 con 0x557fd3c0a430 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f3770537800 1 -- 172.21.15.121:0/3415112013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 msgr2=0x557fd3c0a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f376c2cd640 1 --2- 172.21.15.121:0/103331865 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f374c0360c0 0x7f374c038580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f375c00f640 tx=0x7f375c01af10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f3770537800 1 --2- 172.21.15.121:0/3415112013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 0x557fd3c0a850 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f376400a430 tx=0x7f376400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f3770537800 1 -- 172.21.15.121:0/3415112013 shutdown_connections 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f3770537800 1 --2- 172.21.15.121:0/3415112013 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 0x557fd3c0a850 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f3770537800 1 -- 172.21.15.121:0/3415112013 >> 172.21.15.121:0/3415112013 conn(0x557fd3b56830 msgr2=0x557fd3c05810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f3770537800 1 -- 172.21.15.121:0/3415112013 shutdown_connections 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f3770537800 1 -- 172.21.15.121:0/3415112013 wait complete. 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.621+0000 7f3770537800 1 Processor -- start 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f3770537800 1 -- start start 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f3770537800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 0x557fd3c11590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f3770537800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fd39fa530 con 0x557fd3c0a430 2023-12-07T21:09:16.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f376cace640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 0x557fd3c11590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f376cace640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 0x557fd3c11590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54494/0 (socket says 172.21.15.121:54494) 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 learned_addr learned my addr 172.21.15.121:0/1048086250 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376400a0e0 con 0x557fd3c0a430 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f376cace640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 0x557fd3c11590 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f376400a3d0 tx=0x7f3764003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f3761ac8640 1 -- 172.21.15.121:0/1048086250 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3764010900 con 0x557fd3c0a430 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f3761ac8640 1 -- 172.21.15.121:0/1048086250 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3764010a60 con 0x557fd3c0a430 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557fd3c11ad0 con 0x557fd3c0a430 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f3761ac8640 1 -- 172.21.15.121:0/1048086250 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3764010d40 con 0x557fd3c0a430 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.622+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557fd3c11f30 con 0x557fd3c0a430 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.623+0000 7f3761ac8640 1 -- 172.21.15.121:0/1048086250 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3764017070 con 0x557fd3c0a430 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f3761ac8640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3744036110 0x7f37440385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f3761ac8640 1 -- 172.21.15.121:0/1048086250 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f376404b7e0 con 0x557fd3c0a430 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f3763acc640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3744036110 0x7f37440385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f3770537800 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557fd3c1cc20 0x557fd3c1f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c1f7e0 con 0x557fd3c1cc20 2023-12-07T21:09:16.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f376cace640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557fd3c1cc20 0x557fd3c1f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f3763acc640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3744036110 0x7f37440385d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3754054000 tx=0x7f375404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f376cace640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557fd3c1cc20 0x557fd3c1f090 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f3770537800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f3770537800 20 realm 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.624+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c1fbd0 con 0x557fd3c1cc20 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c20420 con 0x557fd3c1cc20 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c20780 con 0x557fd3c1cc20 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c200c0 con 0x557fd3c1cc20 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 20 searching for the correct realm 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557fd3c229d0 0x557fd3c24dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c229d0 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.625+0000 7f376c2cd640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557fd3c229d0 0x557fd3c24dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.626+0000 7f376c2cd640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557fd3c229d0 0x557fd3c24dc0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.626+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.626+0000 7f376c2cd640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f375c04b220 0x7f375c04b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.626+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375c04b220 2023-12-07T21:09:16.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.626+0000 7f3763acc640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f375c04b220 0x7f375c04b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.626+0000 7f3763acc640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f375c04b220 0x7f375c04b600 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.627+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3754052840 con 0x7f375c04b220 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.627+0000 7f3763acc640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f375405c920 0x7f3754009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.627+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375405c920 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.627+0000 7f376cace640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f375405c920 0x7f3754009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.627+0000 7f376cace640 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f375405c920 0x7f3754009410 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.627+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.627+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c1cc20 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.628+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.628+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c1cc20 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.628+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.628+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375405c920 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.628+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.628+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375405c920 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.628+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.628+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375c04b220 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.628+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3754052840 con 0x7f375c04b220 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.628+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c229d0 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.629+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.629+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c1cc20 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.629+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.629+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375405c920 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.629+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.629+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c1cc20 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.629+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.629+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375c04b220 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.630+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3754052840 con 0x7f375c04b220 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.630+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c229d0 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.630+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.630+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c229d0 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.630+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.630+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375405c920 2023-12-07T21:09:16.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.630+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.630+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c229d0 2023-12-07T21:09:16.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.630+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.631+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c229d0 2023-12-07T21:09:16.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.631+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.631+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c1cc20 2023-12-07T21:09:16.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.631+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.631+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c1cc20 2023-12-07T21:09:16.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.631+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.631+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375405c920 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.632+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.632+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c229d0 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.632+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.632+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375c04b220 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.632+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3754052840 con 0x7f375c04b220 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.632+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c1cc20 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.632+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.632+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375405c920 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.633+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.633+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c229d0 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.633+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.633+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375405c920 2023-12-07T21:09:16.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.633+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.633+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375c04b220 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.634+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3754052840 con 0x7f375c04b220 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.634+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c229d0 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.634+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.634+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x7f375405c920 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.634+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.634+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25350 con 0x557fd3c1cc20 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3764053080 con 0x7f375c04b220 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3754052840 con 0x7f375c04b220 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:16.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c215e0 con 0x557fd3c1cc20 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c21260 con 0x557fd3c1cc20 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.635+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c21eb0 con 0x557fd3c229d0 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 20 zone default found 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 4 Realm: () 2023-12-07T21:09:16.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 20 zonegroup default 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c25790 con 0x7f375405c920 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c27610 con 0x557fd3c229d0 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c27970 con 0x557fd3c229d0 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.636+0000 7f3770537800 20 started sync module instance, tier type = 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.637+0000 7f3770537800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.637+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c26be0 con 0x7f375c04b220 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.637+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3754052840 con 0x7f375c04b220 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.637+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94007499530064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c267c0 con 0x7f375c04b220 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.637+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c28170 con 0x557fd3c1cc20 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.638+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94007499530064] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.639+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.639+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94007501942672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c281d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.639+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c28c60 con 0x557fd3c229d0 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.640+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94007501942672] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.640+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.642 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.640+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94007501948704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c29010 con 0x557fd3c229d0 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.640+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c29980 con 0x7f375c04b220 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.641+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.641+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94007501948704] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.641+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94007501954352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c2a140 con 0x7f375c04b220 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.641+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c2aab0 con 0x557fd3c1cc20 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.642+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.642+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94007501956896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c2b0f0 con 0x557fd3c1cc20 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.642+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c2bbc0 con 0x7f375405c920 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.642+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94007501954352] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.643+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.643+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94007501960864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c2bb80 con 0x7f375405c920 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.643+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c2c580 con 0x7f375405c920 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.643+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94007501956896] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.644+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94007501960864] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.644+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.644+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94007501946064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c2c0e0 con 0x7f375405c920 2023-12-07T21:09:16.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.644+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c2c8e0 con 0x7f375405c920 2023-12-07T21:09:16.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.645+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94007501946064] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.645+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.645+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94007501963488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c2c990 con 0x7f375405c920 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.645+0000 7f3770537800 20 add_watcher() i=0 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.645+0000 7f3770537800 20 add_watcher() i=1 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.645+0000 7f3770537800 20 add_watcher() i=2 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.645+0000 7f3770537800 20 add_watcher() i=3 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.645+0000 7f3770537800 20 add_watcher() i=4 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.645+0000 7f3770537800 20 add_watcher() i=5 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.645+0000 7f3770537800 20 add_watcher() i=6 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.646+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94007501963488] v31'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.646+0000 7f3770537800 20 add_watcher() i=7 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.646+0000 7f3770537800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.646+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c2fbc0 con 0x557fd3c1cc20 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.646+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.646+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94007501964896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c2cf10 con 0x557fd3c1cc20 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.647+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94007501964896] v31'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.647+0000 7f37327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.647+0000 7f3770537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.647+0000 7f3770537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.647+0000 7f3770537800 5 note: GC not initialized 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.648+0000 7f37317e2640 20 reqs_thread_entry: start 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.648+0000 7f3770537800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.648+0000 7f3770537800 20 Filter name: none 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.648+0000 7f36a2ffd640 20 reqs_thread_entry: start 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.648+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.648+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c62c90 con 0x7f375c04b220 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.648+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.648+0000 7f3770537800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.648+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.648+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c63610 con 0x7f375c04b220 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.648+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(63 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c621d0 con 0x7f375c04b220 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c63120 con 0x7f375c04b220 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(65 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 4.e 4:719083e2:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c647b0 con 0x7f375c04b220 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 4.37 4:efedcd12:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c69890 con 0x7f375405c920 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 4.27 4:e642d40c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c6c0b0 con 0x557fd3c1cc20 2023-12-07T21:09:16.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 4.27 4:e4a2f79e:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c6ea80 con 0x557fd3c1cc20 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 4.18 4:1bea850c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c71460 con 0x7f375c04b220 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 4.9 4:933a13f7:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c73d00 con 0x557fd3c1cc20 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 4.26 4:658aa6de:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c76520 con 0x7f375405c920 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:73 4.3e 4:7c54f31d:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c79230 con 0x7f375c04b220 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:74 4.9 4:93faacf1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c7c060 con 0x557fd3c1cc20 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:75 4.34 4:2d01635f:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c79230 con 0x7f375c04b220 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.649+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:76 4.3f 4:fca757fe:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c7c060 con 0x7f375c04b220 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(68 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(71 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.5 [call out=124b] v0'0 uv8 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(67 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(72 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(66 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(70 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(69 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(73 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(75 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(74 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(76 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f3770537800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.b 6:d2b92e8e:::pubsub..bucket.myfoo%2fef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c7c060 con 0x557fd3c229d0 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(77 pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.650+0000 7f3770537800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.651+0000 7f37327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.651+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94007501964896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c60de0 con 0x557fd3c1cc20 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.652+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94007501964896] v31'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.652+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94007499530064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c60de0 con 0x7f375c04b220 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.653+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94007499530064] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.653+0000 7f3770537800 20 remove_watcher() i=0 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.653+0000 7f3770537800 2 removed watcher, disabling cache 2023-12-07T21:09:16.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.653+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94007501942672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c60de0 con 0x557fd3c1cc20 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.654+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94007501942672] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.654+0000 7f3770537800 20 remove_watcher() i=1 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.654+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94007501948704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c60de0 con 0x557fd3c229d0 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.655+0000 7f376c2cd640 1 -- 172.21.15.121:0/1048086250 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94007501948704] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f375c035040 con 0x557fd3c229d0 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.655+0000 7f3770537800 20 remove_watcher() i=2 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.655+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94007501954352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c60de0 con 0x7f375c04b220 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.656+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94007501954352] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3754071040 con 0x7f375c04b220 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.656+0000 7f3770537800 20 remove_watcher() i=3 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.656+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94007501956896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c60de0 con 0x557fd3c1cc20 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.657+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94007501956896] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x557fd3c1cc20 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.657+0000 7f3770537800 20 remove_watcher() i=4 2023-12-07T21:09:16.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.657+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94007501960864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c630e0 con 0x7f375405c920 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.658+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94007501960864] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.658+0000 7f3770537800 20 remove_watcher() i=5 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.658+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94007501946064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c630e0 con 0x7f375405c920 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.659+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94007501946064] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.659+0000 7f3770537800 20 remove_watcher() i=6 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.659+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94007501963488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557fd3c630e0 con 0x7f375405c920 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.660+0000 7f376cace640 1 -- 172.21.15.121:0/1048086250 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94007501963488] v31'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376402e9d0 con 0x7f375405c920 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.660+0000 7f3770537800 20 remove_watcher() i=7 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.660+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f375405c920 msgr2=0x7f3754009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.660+0000 7f3770537800 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f375405c920 0x7f3754009410 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.660+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557fd3c1cc20 msgr2=0x557fd3c1f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.660+0000 7f3770537800 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557fd3c1cc20 0x557fd3c1f090 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.660+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f375c04b220 msgr2=0x7f375c04b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.660+0000 7f3770537800 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f375c04b220 0x7f375c04b600 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.660+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557fd3c229d0 msgr2=0x557fd3c24dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.660+0000 7f3770537800 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557fd3c229d0 0x557fd3c24dc0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3744036110 msgr2=0x7f37440385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3744036110 0x7f37440385d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3754054000 tx=0x7f375404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 msgr2=0x557fd3c11590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 --2- 172.21.15.121:0/1048086250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3c0a430 0x557fd3c11590 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f376400a3d0 tx=0x7f3764003370 comp rx=0 tx=0).stop 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 reap_dead start 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3763acc640 1 -- 172.21.15.121:0/1048086250 reap_dead start 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 shutdown_connections 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 >> 172.21.15.121:0/1048086250 conn(0x557fd3b56830 msgr2=0x557fd3c053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 shutdown_connections 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/1048086250 wait complete. 2023-12-07T21:09:16.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/103331865 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f374c0360c0 msgr2=0x7f374c038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 --2- 172.21.15.121:0/103331865 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f374c0360c0 0x7f374c038580 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f375c00f640 tx=0x7f375c01af10 comp rx=0 tx=0).stop 2023-12-07T21:09:16.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/103331865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 msgr2=0x557fd3bfe1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 --2- 172.21.15.121:0/103331865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bfe1d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x557fd3bf3420 tx=0x7f375c000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/103331865 shutdown_connections 2023-12-07T21:09:16.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 --2- 172.21.15.121:0/103331865 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f374c0360c0 0x7f374c038580 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 --2- 172.21.15.121:0/103331865 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557fd3b538a0 0x557fd3bfe1d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/103331865 >> 172.21.15.121:0/103331865 conn(0x557fd3b4bf60 msgr2=0x557fd3bf5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/103331865 shutdown_connections 2023-12-07T21:09:16.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.661+0000 7f3770537800 1 -- 172.21.15.121:0/103331865 wait complete. 2023-12-07T21:09:16.662 INFO:teuthology.orchestra.run.smithi121.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"209e4ade-356c-43a0-a93d-cc9500dad162","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","marker":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2023-12-07T21:09:15.868775Z","creation_time":"2023-12-07T21:09:15.863874Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2023-12-07T21:09:16.662 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '209e4ade-356c-43a0-a93d-cc9500dad162', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'marker': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-12-07T21:09:15.868775Z', 'creation_time': '2023-12-07T21:09:15.863874Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2023-12-07T21:09:16.662 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2023-12-07T21:09:16.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2023-12-07T21:09:16.662 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2023-12-07T21:09:16.745 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:16.745 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:16.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.752+0000 7f3a38931800 1 Processor -- start 2023-12-07T21:09:16.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.752+0000 7f3a38931800 1 -- start start 2023-12-07T21:09:16.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.753+0000 7f3a38931800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557d4d8cc550 0x557d4d8ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.753+0000 7f3a38931800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557d4d815740 con 0x557d4d8c8110 2023-12-07T21:09:16.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.753+0000 7f3a38931800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x557d4d7de880 con 0x557d4d8cc550 2023-12-07T21:09:16.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.753+0000 7f3a33dd6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557d4d8cc550 0x557d4d8ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.753+0000 7f3a345d7640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x557d4d8c8110 0x557d4d8c8530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55752/0 (socket says 172.21.15.121:55752) 2023-12-07T21:09:16.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.753+0000 7f3a345d7640 1 -- 172.21.15.121:0/80291409 learned_addr learned my addr 172.21.15.121:0/80291409 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:16.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.753+0000 7f3a33dd6640 1 -- 172.21.15.121:0/80291409 >> v1:172.21.15.89:6789/0 conn(0x557d4d8c8110 legacy=0x557d4d8c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.753+0000 7f3a33dd6640 1 -- 172.21.15.121:0/80291409 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d4d8cff70 con 0x557d4d8cc550 2023-12-07T21:09:16.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.753+0000 7f3a335d5640 1 -- 172.21.15.121:0/80291409 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072979898 0 0) 0x557d4d815740 con 0x557d4d8c8110 2023-12-07T21:09:16.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.755+0000 7f3a33dd6640 1 --2- 172.21.15.121:0/80291409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8cc550 0x557d4d8ce940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800a600 tx=0x7f3a2801ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08808c4a3d1d891 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.755+0000 7f3a335d5640 1 -- 172.21.15.121:0/80291409 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a2800a200 con 0x557d4d8cc550 2023-12-07T21:09:16.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.755+0000 7f3a335d5640 1 -- 172.21.15.121:0/80291409 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2800a360 con 0x557d4d8cc550 2023-12-07T21:09:16.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.755+0000 7f3a335d5640 1 -- 172.21.15.121:0/80291409 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a280086e0 con 0x557d4d8cc550 2023-12-07T21:09:16.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.756+0000 7f3a38931800 1 -- 172.21.15.121:0/80291409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8cc550 msgr2=0x557d4d8ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.756+0000 7f3a38931800 1 --2- 172.21.15.121:0/80291409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8cc550 0x557d4d8ce940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800a600 tx=0x7f3a2801ec40 comp rx=0 tx=0).stop 2023-12-07T21:09:16.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.756+0000 7f3a38931800 1 -- 172.21.15.121:0/80291409 shutdown_connections 2023-12-07T21:09:16.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.756+0000 7f3a38931800 1 --2- 172.21.15.121:0/80291409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8cc550 0x557d4d8ce940 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.756+0000 7f3a38931800 1 -- 172.21.15.121:0/80291409 >> 172.21.15.121:0/80291409 conn(0x557d4d8c3890 msgr2=0x557d4d8c5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.756+0000 7f3a38931800 1 -- 172.21.15.121:0/80291409 shutdown_connections 2023-12-07T21:09:16.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.756+0000 7f3a38931800 1 -- 172.21.15.121:0/80291409 wait complete. 2023-12-07T21:09:16.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.757+0000 7f3a38931800 1 Processor -- start 2023-12-07T21:09:16.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.757+0000 7f3a38931800 1 -- start start 2023-12-07T21:09:16.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.757+0000 7f3a38931800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d96fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.757+0000 7f3a38931800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d4d7dbdb0 con 0x557d4d8c8110 2023-12-07T21:09:16.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.757+0000 7f3a345d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d96fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.757+0000 7f3a345d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d96fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54514/0 (socket says 172.21.15.121:54514) 2023-12-07T21:09:16.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.757+0000 7f3a345d7640 1 -- 172.21.15.121:0/405684541 learned_addr learned my addr 172.21.15.121:0/405684541 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.757+0000 7f3a345d7640 1 -- 172.21.15.121:0/405684541 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a28005d20 con 0x557d4d8c8110 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.757+0000 7f3a345d7640 1 --2- 172.21.15.121:0/405684541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d96fdd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3a24001660 tx=0x7f3a24001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f4e75e2930a87b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a32dd4640 1 -- 172.21.15.121:0/405684541 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a24003450 con 0x557d4d8c8110 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a32dd4640 1 -- 172.21.15.121:0/405684541 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a240035d0 con 0x557d4d8c8110 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a32dd4640 1 -- 172.21.15.121:0/405684541 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a24003930 con 0x557d4d8c8110 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a38931800 1 -- 172.21.15.121:0/405684541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 msgr2=0x557d4d96fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a38931800 1 --2- 172.21.15.121:0/405684541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d96fdd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3a24001660 tx=0x7f3a24001b20 comp rx=0 tx=0).stop 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a38931800 1 -- 172.21.15.121:0/405684541 shutdown_connections 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a38931800 1 --2- 172.21.15.121:0/405684541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d96fdd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a38931800 1 -- 172.21.15.121:0/405684541 >> 172.21.15.121:0/405684541 conn(0x557d4d8c3890 msgr2=0x557d4d967630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a38931800 1 -- 172.21.15.121:0/405684541 shutdown_connections 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a38931800 1 -- 172.21.15.121:0/405684541 wait complete. 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a38931800 1 Processor -- start 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.758+0000 7f3a38931800 1 -- start start 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a38931800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d977280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a38931800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d4d7d76a0 con 0x557d4d8c8110 2023-12-07T21:09:16.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a345d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d977280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a345d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d977280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54528/0 (socket says 172.21.15.121:54528) 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a345d7640 1 -- 172.21.15.121:0/3197560171 learned_addr learned my addr 172.21.15.121:0/3197560171 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a345d7640 1 -- 172.21.15.121:0/3197560171 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a24006ce0 con 0x557d4d8c8110 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a345d7640 1 --2- 172.21.15.121:0/3197560171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d977280 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x557d4d9680b0 tx=0x7f3a24001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a31dd2640 1 -- 172.21.15.121:0/3197560171 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a24013820 con 0x557d4d8c8110 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a31dd2640 1 -- 172.21.15.121:0/3197560171 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24013980 con 0x557d4d8c8110 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a31dd2640 1 -- 172.21.15.121:0/3197560171 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a24013c20 con 0x557d4d8c8110 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a38931800 1 -- 172.21.15.121:0/3197560171 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557d4d9777c0 con 0x557d4d8c8110 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.759+0000 7f3a38931800 1 -- 172.21.15.121:0/3197560171 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d4d977d00 con 0x557d4d8c8110 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.760+0000 7f3a38931800 1 Processor -- start 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.760+0000 7f3a38931800 1 -- start start 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.760+0000 7f3a31dd2640 1 -- 172.21.15.121:0/3197560171 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3a2401e3e0 con 0x557d4d8c8110 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.760+0000 7f3a38931800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d983880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.760+0000 7f3a38931800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d4d771890 con 0x557d4d983460 2023-12-07T21:09:16.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.760+0000 7f3a31dd2640 1 --2- 172.21.15.121:0/3197560171 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3a200360c0 0x7f3a20038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.760+0000 7f3a31dd2640 1 -- 172.21.15.121:0/3197560171 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f3a2404b180 con 0x557d4d8c8110 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.760+0000 7f3a34dd8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d983880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.760+0000 7f3a34dd8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d983880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54540/0 (socket says 172.21.15.121:54540) 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.760+0000 7f3a345d7640 1 --2- 172.21.15.121:0/3197560171 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3a200360c0 0x7f3a20038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.760+0000 7f3a34dd8640 1 -- 172.21.15.121:0/2484156232 learned_addr learned my addr 172.21.15.121:0/2484156232 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a34dd8640 1 -- 172.21.15.121:0/2484156232 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d4d983dc0 con 0x557d4d983460 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a345d7640 1 --2- 172.21.15.121:0/3197560171 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3a200360c0 0x7f3a20038580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a24028e90 tx=0x7f3a2404b050 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a34dd8640 1 --2- 172.21.15.121:0/2484156232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d983880 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00a400 tx=0x7f3a2c00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a96ac49c9b80851 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a1b7fe640 1 -- 172.21.15.121:0/2484156232 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a2c0087e0 con 0x557d4d983460 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a1b7fe640 1 -- 172.21.15.121:0/2484156232 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c008960 con 0x557d4d983460 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a1b7fe640 1 -- 172.21.15.121:0/2484156232 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a2c008c80 con 0x557d4d983460 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a38931800 1 -- 172.21.15.121:0/2484156232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 msgr2=0x557d4d983880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a38931800 1 --2- 172.21.15.121:0/2484156232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d983880 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00a400 tx=0x7f3a2c00a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a38931800 1 -- 172.21.15.121:0/2484156232 shutdown_connections 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a38931800 1 --2- 172.21.15.121:0/2484156232 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d983880 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a38931800 1 -- 172.21.15.121:0/2484156232 >> 172.21.15.121:0/2484156232 conn(0x557d4d8cc550 msgr2=0x557d4d97e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a38931800 1 -- 172.21.15.121:0/2484156232 shutdown_connections 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.761+0000 7f3a38931800 1 -- 172.21.15.121:0/2484156232 wait complete. 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.762+0000 7f3a38931800 1 Processor -- start 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.762+0000 7f3a38931800 1 -- start start 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.762+0000 7f3a38931800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d98a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.762+0000 7f3a38931800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d4d771530 con 0x557d4d983460 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.762+0000 7f3a34dd8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d98a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.762+0000 7f3a34dd8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d98a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54550/0 (socket says 172.21.15.121:54550) 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.762+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 learned_addr learned my addr 172.21.15.121:0/630271556 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.762+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c005c90 con 0x557d4d983460 2023-12-07T21:09:16.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.762+0000 7f3a34dd8640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d98a400 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00c010 tx=0x7f3a2c002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.763+0000 7f3a19ffb640 1 -- 172.21.15.121:0/630271556 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a2c013840 con 0x557d4d983460 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.763+0000 7f3a19ffb640 1 -- 172.21.15.121:0/630271556 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c0139a0 con 0x557d4d983460 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.763+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557d4d98a940 con 0x557d4d983460 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.763+0000 7f3a19ffb640 1 -- 172.21.15.121:0/630271556 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a2c013c80 con 0x557d4d983460 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.763+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d4d98ae00 con 0x557d4d983460 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.763+0000 7f3a19ffb640 1 -- 172.21.15.121:0/630271556 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3a2c01e420 con 0x557d4d983460 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.764+0000 7f3a19ffb640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3a10036110 0x7f3a100385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.764+0000 7f3a19ffb640 1 -- 172.21.15.121:0/630271556 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f3a2c04b6c0 con 0x557d4d983460 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.764+0000 7f3a33dd6640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3a10036110 0x7f3a100385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.764+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.764+0000 7f3a38931800 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557d4d995b90 0x557d4d998020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.764+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d998770 con 0x557d4d995b90 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.764+0000 7f3a34dd8640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557d4d995b90 0x557d4d998020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.764+0000 7f3a33dd6640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3a10036110 0x7f3a100385d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3a28055000 tx=0x7f3a28050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.764+0000 7f3a34dd8640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557d4d995b90 0x557d4d998020 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 20 realm 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d998b60 con 0x557d4d995b90 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9993b0 con 0x557d4d995b90 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d999710 con 0x557d4d995b90 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d999050 con 0x557d4d995b90 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 20 searching for the correct realm 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557d4d99b960 0x557d4d99dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.765+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e2e0 con 0x557d4d99b960 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.766+0000 7f3a345d7640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557d4d99b960 0x557d4d99dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.766+0000 7f3a345d7640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557d4d99b960 0x557d4d99dd50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.766+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2402f040 con 0x557d4d99b960 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.766+0000 7f3a345d7640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3a24049c20 0x7f3a24010590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.766+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e2e0 con 0x7f3a24049c20 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.766+0000 7f3a33dd6640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3a24049c20 0x7f3a24010590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.767+0000 7f3a33dd6640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3a24049c20 0x7f3a24010590 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.767+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.767+0000 7f3a33dd6640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f3a2805d440 0x7f3a2805d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.767+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e2e0 con 0x7f3a2805d440 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.767+0000 7f3a34dd8640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f3a2805d440 0x7f3a2805d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.767+0000 7f3a34dd8640 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f3a2805d440 0x7f3a2805d880 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.767+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.767+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e2e0 con 0x557d4d995b90 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.768+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.768+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e2e0 con 0x557d4d995b90 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.768+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.768+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e2e0 con 0x7f3a2805d440 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.768+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.768+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e2e0 con 0x7f3a2805d440 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.768+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.768+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e2e0 con 0x7f3a24049c20 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.769+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.769+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e2e0 con 0x557d4d99b960 2023-12-07T21:09:16.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.769+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2402f040 con 0x557d4d99b960 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.769+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e2e0 con 0x557d4d995b90 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.769+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.769+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e2e0 con 0x7f3a2805d440 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.769+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.769+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d995b90 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.770+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.770+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x7f3a24049c20 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.770+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.770+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d99b960 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.770+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2402f040 con 0x557d4d99b960 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.770+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d99b960 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.770+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2402f040 con 0x557d4d99b960 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.770+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x7f3a2805d440 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.771+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.771+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d99b960 2023-12-07T21:09:16.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.771+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2402f040 con 0x557d4d99b960 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.771+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d99b960 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.771+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2402f040 con 0x557d4d99b960 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.771+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d995b90 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.771+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.771+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d995b90 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.772+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.772+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x7f3a2805d440 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.772+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.772+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d99b960 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.772+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3a2402f040 con 0x557d4d99b960 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.772+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x7f3a24049c20 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.772+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.772+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d995b90 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.773+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.773+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x7f3a2805d440 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.773+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.773+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d99b960 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.773+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2402f040 con 0x557d4d99b960 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.773+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x7f3a2805d440 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.773+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.773+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x7f3a24049c20 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.774+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.774+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d99b960 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.774+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a24049040 con 0x557d4d99b960 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.774+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x7f3a2805d440 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.774+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.774+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x557d4d995b90 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.774+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.774+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f3a2c041040 con 0x7f3a24049c20 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.774+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:16.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99a5a0 con 0x557d4d995b90 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99a1c0 con 0x557d4d995b90 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99adf0 con 0x557d4d99b960 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3a24049040 con 0x557d4d99b960 2023-12-07T21:09:16.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 zone default found 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 4 Realm: () 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 zonegroup default 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.775+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99e720 con 0x7f3a2805d440 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a38931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a05a0 con 0x557d4d99b960 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3a24049040 con 0x557d4d99b960 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a38931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a0900 con 0x557d4d99b960 2023-12-07T21:09:16.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3a24049040 con 0x557d4d99b960 2023-12-07T21:09:16.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a38931800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a38931800 20 started sync module instance, tier type = 2023-12-07T21:09:16.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a38931800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:16.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.776+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99fb70 con 0x7f3a24049c20 2023-12-07T21:09:16.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.777+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.777+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93996658790224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d99f750 con 0x7f3a24049c20 2023-12-07T21:09:16.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.777+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a1100 con 0x557d4d995b90 2023-12-07T21:09:16.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.778+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93996658790224] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.778+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.778+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93996661210912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a1100 con 0x557d4d995b90 2023-12-07T21:09:16.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.778+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a1b50 con 0x557d4d99b960 2023-12-07T21:09:16.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.780+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93996661210912] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.780+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a24049040 con 0x557d4d99b960 2023-12-07T21:09:16.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.780+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93996661214304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a1070 con 0x557d4d99b960 2023-12-07T21:09:16.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.780+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a2840 con 0x7f3a24049c20 2023-12-07T21:09:16.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.781+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93996661214304] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a24049040 con 0x557d4d99b960 2023-12-07T21:09:16.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.781+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.781+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93996661219344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a3090 con 0x7f3a24049c20 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.781+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a3890 con 0x557d4d995b90 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.782+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.782+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93996661224736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a40e0 con 0x557d4d995b90 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.782+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a4a90 con 0x7f3a2805d440 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.782+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93996661219344] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.783+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.783+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93996661224736] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.783+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93996661222384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a4a50 con 0x7f3a2805d440 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.783+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a4fb0 con 0x7f3a2805d440 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.784+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93996661222384] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.784+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.784+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93996661228976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a49c0 con 0x7f3a2805d440 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.784+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a58f0 con 0x7f3a2805d440 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.785+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.785+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93996661232720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a5d00 con 0x7f3a2805d440 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.785+0000 7f3a38931800 20 add_watcher() i=0 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.785+0000 7f3a38931800 20 add_watcher() i=1 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.785+0000 7f3a38931800 20 add_watcher() i=2 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.785+0000 7f3a38931800 20 add_watcher() i=3 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.785+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93996661228976] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.785+0000 7f3a38931800 20 add_watcher() i=4 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.785+0000 7f3a38931800 20 add_watcher() i=5 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.785+0000 7f3a38931800 20 add_watcher() i=6 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.786+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93996661232720] v31'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.786+0000 7f3a38931800 20 add_watcher() i=7 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.786+0000 7f3a38931800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.786+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a5d00 con 0x557d4d995b90 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.786+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.786+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93996661233760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9a5c70 con 0x557d4d995b90 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.787+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93996661233760] v31'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.787+0000 7f39fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.787+0000 7f3a38931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.787+0000 7f3a38931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.787+0000 7f3a38931800 5 note: GC not initialized 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.787+0000 7f39f97e2640 20 reqs_thread_entry: start 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.788+0000 7f3a38931800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.788+0000 7f3a38931800 20 Filter name: none 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.788+0000 7f396affd640 20 reqs_thread_entry: start 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.788+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.788+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9db6e0 con 0x557d4d995b90 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.788+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.788+0000 7f3a38931800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:16.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.788+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9db6e0 con 0x7f3a24049c20 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.788+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv15 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.788+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.788+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9dab10 con 0x7f3a24049c20 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(64 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 4.e 4:719083e2:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9dc3e0 con 0x7f3a24049c20 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:66 4.37 4:efedcd12:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e1390 con 0x7f3a2805d440 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 4.27 4:e642d40c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e3ed0 con 0x557d4d995b90 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 4.27 4:e4a2f79e:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e6800 con 0x557d4d995b90 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:69 4.18 4:1bea850c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e90c0 con 0x7f3a24049c20 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(65 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(66 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(67 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(69 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 4.9 4:933a13f7:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e90c0 con 0x557d4d995b90 2023-12-07T21:09:16.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 4.26 4:658aa6de:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e39f0 con 0x7f3a2805d440 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 4.3e 4:7c54f31d:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9dce30 con 0x7f3a24049c20 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:73 4.9 4:93faacf1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9df6b0 con 0x557d4d995b90 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.789+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 4.34 4:2d01635f:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9dce30 con 0x7f3a24049c20 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.790+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:75 4.3f 4:fca757fe:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9df6b0 con 0x7f3a24049c20 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.790+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.790+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(71 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.790+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(72 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.790+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(70 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.5 [call out=124b] v0'0 uv8 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.790+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(75 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.790+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(74 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.790+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(73 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.8 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.790+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9dba40 con 0x7f3a24049c20 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.792+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(76 foo.buckets [call] v31'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.792+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e6360 con 0x7f3a24049c20 2023-12-07T21:09:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.793+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(77 foo.buckets [call] v31'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.793+0000 7f3a38931800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.793+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e8c00 con 0x557d4d995b90 2023-12-07T21:09:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.793+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(78 foo [stat out=16b,read 0~357 out=357b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+373 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.793+0000 7f3a38931800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.793+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e8c00 con 0x7f3a24049c20 2023-12-07T21:09:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.793+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv17 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.794+0000 7f39fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.794+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93996661233760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9c46d0 con 0x557d4d995b90 2023-12-07T21:09:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.795+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 93996661233760] v31'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.795+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93996658790224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9c46d0 con 0x7f3a24049c20 2023-12-07T21:09:16.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.796+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 93996658790224] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.796+0000 7f3a38931800 20 remove_watcher() i=0 2023-12-07T21:09:16.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.796+0000 7f3a38931800 2 removed watcher, disabling cache 2023-12-07T21:09:16.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.796+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93996661210912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9c46d0 con 0x557d4d995b90 2023-12-07T21:09:16.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.797+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 93996661210912] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.797+0000 7f3a38931800 20 remove_watcher() i=1 2023-12-07T21:09:16.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.797+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93996661214304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9c46d0 con 0x557d4d99b960 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.798+0000 7f3a345d7640 1 -- 172.21.15.121:0/630271556 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 93996661214304] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a24049040 con 0x557d4d99b960 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.798+0000 7f3a38931800 20 remove_watcher() i=2 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.798+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93996661219344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e8c00 con 0x7f3a24049c20 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.799+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 <== osd.2 v2:172.21.15.121:6816/2557538450 22 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 93996661219344] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a28067040 con 0x7f3a24049c20 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.799+0000 7f3a38931800 20 remove_watcher() i=3 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.799+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93996661224736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e8c00 con 0x557d4d995b90 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.800+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 93996661224736] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x557d4d995b90 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.800+0000 7f3a38931800 20 remove_watcher() i=4 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.800+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93996661222384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e8c00 con 0x7f3a2805d440 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.801+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 93996661222384] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.801+0000 7f3a38931800 20 remove_watcher() i=5 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.801+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93996661228976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e8c00 con 0x7f3a2805d440 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.802+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 93996661228976] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.802+0000 7f3a38931800 20 remove_watcher() i=6 2023-12-07T21:09:16.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.802+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93996661232720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557d4d9e8c00 con 0x7f3a2805d440 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a34dd8640 1 -- 172.21.15.121:0/630271556 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 93996661232720] v31'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a2c024070 con 0x7f3a2805d440 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 20 remove_watcher() i=7 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f3a2805d440 msgr2=0x7f3a2805d880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f3a2805d440 0x7f3a2805d880 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557d4d995b90 msgr2=0x557d4d998020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557d4d995b90 0x557d4d998020 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3a24049c20 msgr2=0x7f3a24010590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3a24049c20 0x7f3a24010590 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557d4d99b960 msgr2=0x557d4d99dd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557d4d99b960 0x557d4d99dd50 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3a10036110 msgr2=0x7f3a100385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3a10036110 0x7f3a100385d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3a28055000 tx=0x7f3a28050000 comp rx=0 tx=0).stop 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 msgr2=0x557d4d98a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a33dd6640 1 -- 172.21.15.121:0/630271556 reap_dead start 2023-12-07T21:09:16.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d98a400 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00c010 tx=0x7f3a2c002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 shutdown_connections 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 --2- 172.21.15.121:0/630271556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d983460 0x557d4d98a400 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 >> 172.21.15.121:0/630271556 conn(0x557d4d8cc550 msgr2=0x557d4d97d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 shutdown_connections 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/630271556 wait complete. 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/3197560171 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3a200360c0 msgr2=0x7f3a20038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 --2- 172.21.15.121:0/3197560171 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3a200360c0 0x7f3a20038580 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a24028e90 tx=0x7f3a2404b050 comp rx=0 tx=0).stop 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/3197560171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 msgr2=0x557d4d977280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 --2- 172.21.15.121:0/3197560171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d977280 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x557d4d9680b0 tx=0x7f3a24001250 comp rx=0 tx=0).stop 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/3197560171 shutdown_connections 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 --2- 172.21.15.121:0/3197560171 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3a200360c0 0x7f3a20038580 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 --2- 172.21.15.121:0/3197560171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557d4d8c8110 0x557d4d977280 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.803+0000 7f3a38931800 1 -- 172.21.15.121:0/3197560171 >> 172.21.15.121:0/3197560171 conn(0x557d4d8c3890 msgr2=0x557d4d96a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.804+0000 7f3a38931800 1 -- 172.21.15.121:0/3197560171 shutdown_connections 2023-12-07T21:09:16.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.804+0000 7f3a38931800 1 -- 172.21.15.121:0/3197560171 wait complete. 2023-12-07T21:09:16.802 INFO:teuthology.orchestra.run.smithi121.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2023-12-07T21:09:16.792850Z","last_stats_update":"2023-12-07T21:09:16.791268Z"} 2023-12-07T21:09:16.802 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2023-12-07T21:09:16.792850Z', 'last_stats_update': '2023-12-07T21:09:16.791268Z'} 2023-12-07T21:09:16.807 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:16.807 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2023-12-07T21:09:16.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2023-12-07T21:09:16.807 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2023-12-07T21:09:16.888 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:16.888 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:16.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.895+0000 7fb4b580f800 1 Processor -- start 2023-12-07T21:09:16.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.896+0000 7fb4b580f800 1 -- start start 2023-12-07T21:09:16.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.896+0000 7fb4b580f800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c9fafbc110 0x55c9fafbc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.896+0000 7fb4b580f800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c9faf09740 con 0x55c9fafbd320 2023-12-07T21:09:16.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.896+0000 7fb4b580f800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c9faed2880 con 0x55c9fafbc110 2023-12-07T21:09:16.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.896+0000 7fb4b0e8c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c9fafbc110 0x55c9fafbc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.896+0000 7fb4abfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55c9fafbd320 0x55c9fafbd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55760/0 (socket says 172.21.15.121:55760) 2023-12-07T21:09:16.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.896+0000 7fb4abfff640 1 -- 172.21.15.121:0/1824274980 learned_addr learned my addr 172.21.15.121:0/1824274980 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:16.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.896+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/1824274980 >> v1:172.21.15.89:6789/0 conn(0x55c9fafbd320 legacy=0x55c9fafbd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.896+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/1824274980 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9fafbcc00 con 0x55c9fafbc110 2023-12-07T21:09:16.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.896+0000 7fb4ab7fe640 1 -- 172.21.15.121:0/1824274980 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639534215 0 0) 0x55c9faf09740 con 0x55c9fafbd320 2023-12-07T21:09:16.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.898+0000 7fb4b0e8c640 1 --2- 172.21.15.121:0/1824274980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fafbc530 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400a470 tx=0x7fb4a401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80dbc251b420b44 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.898+0000 7fb4ab7fe640 1 -- 172.21.15.121:0/1824274980 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4a4052570 con 0x55c9fafbc110 2023-12-07T21:09:16.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.898+0000 7fb4ab7fe640 1 -- 172.21.15.121:0/1824274980 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a40526d0 con 0x55c9fafbc110 2023-12-07T21:09:16.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.898+0000 7fb4ab7fe640 1 -- 172.21.15.121:0/1824274980 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4a4052990 con 0x55c9fafbc110 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.899+0000 7fb4b580f800 1 -- 172.21.15.121:0/1824274980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 msgr2=0x55c9fafbc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.899+0000 7fb4b580f800 1 --2- 172.21.15.121:0/1824274980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fafbc530 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400a470 tx=0x7fb4a401cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.899+0000 7fb4b580f800 1 -- 172.21.15.121:0/1824274980 shutdown_connections 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.899+0000 7fb4b580f800 1 --2- 172.21.15.121:0/1824274980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fafbc530 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.899+0000 7fb4b580f800 1 -- 172.21.15.121:0/1824274980 >> 172.21.15.121:0/1824274980 conn(0x55c9fafb7890 msgr2=0x55c9fafb9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.899+0000 7fb4b580f800 1 -- 172.21.15.121:0/1824274980 shutdown_connections 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.899+0000 7fb4b580f800 1 -- 172.21.15.121:0/1824274980 wait complete. 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.899+0000 7fb4b580f800 1 Processor -- start 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.899+0000 7fb4b580f800 1 -- start start 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.899+0000 7fb4b580f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb0634f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.900+0000 7fb4b580f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9faecfdb0 con 0x55c9fafbc110 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.900+0000 7fb4b0e8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb0634f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.893 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.900+0000 7fb4b0e8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb0634f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54564/0 (socket says 172.21.15.121:54564) 2023-12-07T21:09:16.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.900+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/1602023969 learned_addr learned my addr 172.21.15.121:0/1602023969 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.900+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/1602023969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4005d20 con 0x55c9fafbc110 2023-12-07T21:09:16.894 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.900+0000 7fb4b0e8c640 1 --2- 172.21.15.121:0/1602023969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb0634f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4000c00 tx=0x7fb4a404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b7eb0d8e7536ba server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.900+0000 7fb4aaffd640 1 -- 172.21.15.121:0/1602023969 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4a400a180 con 0x55c9fafbc110 2023-12-07T21:09:16.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.900+0000 7fb4aaffd640 1 -- 172.21.15.121:0/1602023969 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a400a2e0 con 0x55c9fafbc110 2023-12-07T21:09:16.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.900+0000 7fb4aaffd640 1 -- 172.21.15.121:0/1602023969 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4a4052990 con 0x55c9fafbc110 2023-12-07T21:09:16.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b580f800 1 -- 172.21.15.121:0/1602023969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 msgr2=0x55c9fb0634f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b580f800 1 --2- 172.21.15.121:0/1602023969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb0634f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4000c00 tx=0x7fb4a404c000 comp rx=0 tx=0).stop 2023-12-07T21:09:16.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b580f800 1 -- 172.21.15.121:0/1602023969 shutdown_connections 2023-12-07T21:09:16.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b580f800 1 --2- 172.21.15.121:0/1602023969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb0634f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.899 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b580f800 1 -- 172.21.15.121:0/1602023969 >> 172.21.15.121:0/1602023969 conn(0x55c9fafb7890 msgr2=0x55c9fb060760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b580f800 1 -- 172.21.15.121:0/1602023969 shutdown_connections 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b580f800 1 -- 172.21.15.121:0/1602023969 wait complete. 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b580f800 1 Processor -- start 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b580f800 1 -- start start 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b580f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb05dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b580f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9faecb6a0 con 0x55c9fafbc110 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b0e8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb05dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b0e8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb05dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54580/0 (socket says 172.21.15.121:54580) 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.901+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/1560746005 learned_addr learned my addr 172.21.15.121:0/1560746005 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.902+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/1560746005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a404e070 con 0x55c9fafbc110 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.902+0000 7fb4b0e8c640 1 --2- 172.21.15.121:0/1560746005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb05dfa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb4a405e040 tx=0x7fb4a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.902+0000 7fb4a9ffb640 1 -- 172.21.15.121:0/1560746005 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4a406a070 con 0x55c9fafbc110 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.902+0000 7fb4a9ffb640 1 -- 172.21.15.121:0/1560746005 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a4052cc0 con 0x55c9fafbc110 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.902+0000 7fb4a9ffb640 1 -- 172.21.15.121:0/1560746005 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4a405c410 con 0x55c9fafbc110 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.902+0000 7fb4b580f800 1 -- 172.21.15.121:0/1560746005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c9fb05e4e0 con 0x55c9fafbc110 2023-12-07T21:09:16.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.902+0000 7fb4b580f800 1 -- 172.21.15.121:0/1560746005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9fb05c990 con 0x55c9fafbc110 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4b580f800 1 Processor -- start 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4b580f800 1 -- start start 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4a9ffb640 1 -- 172.21.15.121:0/1560746005 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fb4a4059030 con 0x55c9fafbc110 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4b580f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb077b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4b580f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9fae65890 con 0x55c9fb077770 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4a9ffb640 1 --2- 172.21.15.121:0/1560746005 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb494036110 0x7fb4940385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4b168d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb077b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4b168d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb077b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54594/0 (socket says 172.21.15.121:54594) 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4b168d640 1 -- 172.21.15.121:0/3042088229 learned_addr learned my addr 172.21.15.121:0/3042088229 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4a9ffb640 1 -- 172.21.15.121:0/1560746005 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fb4a408c840 con 0x55c9fafbc110 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4b0e8c640 1 --2- 172.21.15.121:0/1560746005 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb494036110 0x7fb4940385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4b168d640 1 -- 172.21.15.121:0/3042088229 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9fb0780d0 con 0x55c9fb077770 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4b0e8c640 1 --2- 172.21.15.121:0/1560746005 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb494036110 0x7fb4940385d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4064fd0 tx=0x7fb4a4064f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.903+0000 7fb4b168d640 1 --2- 172.21.15.121:0/3042088229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb077b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00a430 tx=0x7fb4ac00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9da7acbc6165a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4937fe640 1 -- 172.21.15.121:0/3042088229 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4ac001650 con 0x55c9fb077770 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4937fe640 1 -- 172.21.15.121:0/3042088229 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac0017d0 con 0x55c9fb077770 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4937fe640 1 -- 172.21.15.121:0/3042088229 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4ac001ab0 con 0x55c9fb077770 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4b580f800 1 -- 172.21.15.121:0/3042088229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 msgr2=0x55c9fb077b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4b580f800 1 --2- 172.21.15.121:0/3042088229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb077b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00a430 tx=0x7fb4ac00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4b580f800 1 -- 172.21.15.121:0/3042088229 shutdown_connections 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4b580f800 1 --2- 172.21.15.121:0/3042088229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb077b90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4b580f800 1 -- 172.21.15.121:0/3042088229 >> 172.21.15.121:0/3042088229 conn(0x55c9fafbd320 msgr2=0x55c9fb072b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4b580f800 1 -- 172.21.15.121:0/3042088229 shutdown_connections 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4b580f800 1 -- 172.21.15.121:0/3042088229 wait complete. 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4b580f800 1 Processor -- start 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4b580f800 1 -- start start 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4b580f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb07e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.904+0000 7fb4b580f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9fae65530 con 0x55c9fb077770 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.905+0000 7fb4b168d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb07e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.905+0000 7fb4b168d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb07e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54606/0 (socket says 172.21.15.121:54606) 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.905+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 learned_addr learned my addr 172.21.15.121:0/279228215 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.905+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac00a0e0 con 0x55c9fb077770 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.905+0000 7fb4b168d640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb07e5c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00a930 tx=0x7fb4ac003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.905+0000 7fb491ffb640 1 -- 172.21.15.121:0/279228215 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4ac010900 con 0x55c9fb077770 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.905+0000 7fb491ffb640 1 -- 172.21.15.121:0/279228215 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ac010a60 con 0x55c9fb077770 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.905+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c9fb07eb00 con 0x55c9fb077770 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.905+0000 7fb491ffb640 1 -- 172.21.15.121:0/279228215 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4ac010d20 con 0x55c9fb077770 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.905+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9fb07ef60 con 0x55c9fb077770 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.906+0000 7fb491ffb640 1 -- 172.21.15.121:0/279228215 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fb4ac017030 con 0x55c9fb077770 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.906+0000 7fb491ffb640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb48c036110 0x7fb48c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.906+0000 7fb491ffb640 1 -- 172.21.15.121:0/279228215 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fb4ac04b7d0 con 0x55c9fb077770 2023-12-07T21:09:16.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.906+0000 7fb4abfff640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb48c036110 0x7fb48c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4abfff640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb48c036110 0x7fb48c0385d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb49c000c00 tx=0x7fb49c001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b580f800 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55c9fb089cd0 0x55c9fb08c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb08c8e0 con 0x55c9fb089cd0 2023-12-07T21:09:16.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b168d640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55c9fb089cd0 0x55c9fb08c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b168d640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55c9fb089cd0 0x55c9fb08c190 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b580f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b580f800 20 realm 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb08ccf0 con 0x55c9fb089cd0 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.907+0000 7fb4b580f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb08d570 con 0x55c9fb089cd0 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb08d8d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb08e0d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 20 searching for the correct realm 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55c9fb08fdf0 0x55c9fb092280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb08fdf0 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.908+0000 7fb4b0e8c640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55c9fb08fdf0 0x55c9fb092280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.909+0000 7fb4b0e8c640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55c9fb08fdf0 0x55c9fb092280 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.909+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.909+0000 7fb4b0e8c640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb4a4078060 0x7fb4a405b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.909+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb4a4078060 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.909+0000 7fb4abfff640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb4a4078060 0x7fb4a405b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.909+0000 7fb4abfff640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb4a4078060 0x7fb4a405b5a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.910+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.910+0000 7fb4abfff640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb49c00e8a0 0x7fb49c00d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.910+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb49c00e8a0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.910+0000 7fb4b168d640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb49c00e8a0 0x7fb49c00d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.910+0000 7fb4b168d640 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb49c00e8a0 0x7fb49c00d2f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.910+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.910+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb089cd0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.911+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.911+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb089cd0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.911+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.911+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb49c00e8a0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.911+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.911+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb49c00e8a0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.911+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.911+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb4a4078060 2023-12-07T21:09:16.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.912+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.912+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb08fdf0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.912+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.912+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb089cd0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.912+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.912+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb49c00e8a0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.913+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.913+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb089cd0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.913+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.913+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb4a4078060 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.913+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.913+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb08fdf0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.913+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.913+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb08fdf0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.913+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.913+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb49c00e8a0 2023-12-07T21:09:16.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.914+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.914+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb08fdf0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.914+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.914+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb08fdf0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.914+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.914+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb089cd0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.915+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.915+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb089cd0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.915+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.915+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb49c00e8a0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.915+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.915+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb08fdf0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.915+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.915+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb4a4078060 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.915+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.915+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb089cd0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.916+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.916+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb49c00e8a0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.916+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.916+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb08fdf0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.916+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.916+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb49c00e8a0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.916+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.916+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb4a4078060 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.917+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.917+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb08fdf0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.917+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.917+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x7fb49c00e8a0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.917+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092950 con 0x55c9fb089cd0 2023-12-07T21:09:16.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb4ac053080 con 0x7fb4a4078060 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb08ea30 con 0x55c9fb089cd0 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb08f280 con 0x55c9fb089cd0 2023-12-07T21:09:16.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.918+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb08f280 con 0x55c9fb08fdf0 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 20 zone default found 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 4 Realm: () 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 20 zonegroup default 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb092d90 con 0x7fb49c00e8a0 2023-12-07T21:09:16.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb094b50 con 0x55c9fb08fdf0 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.919+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb094eb0 con 0x55c9fb08fdf0 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.920+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.920+0000 7fb4b580f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.920+0000 7fb4b580f800 20 started sync module instance, tier type = 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.920+0000 7fb4b580f800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.920+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb094430 con 0x7fb4a4078060 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.921+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.921+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94325986053968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb095280 con 0x7fb4a4078060 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.921+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb095a80 con 0x55c9fb089cd0 2023-12-07T21:09:16.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.922+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94325986053968] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.922+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.922+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94325988474768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb095a80 con 0x55c9fb089cd0 2023-12-07T21:09:16.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.922+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb096280 con 0x55c9fb08fdf0 2023-12-07T21:09:16.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.923+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94325988474768] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.923+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.923+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94325988480752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0965e0 con 0x55c9fb08fdf0 2023-12-07T21:09:16.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.923+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb096f50 con 0x7fb4a4078060 2023-12-07T21:09:16.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.924+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94325988480752] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.924+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.924+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94325988481792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb097750 con 0x7fb4a4078060 2023-12-07T21:09:16.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.924+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb097f50 con 0x55c9fb089cd0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.925+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94325988481792] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.925+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.925+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94325988489904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb098360 con 0x55c9fb089cd0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.925+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb098b60 con 0x7fb49c00e8a0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.926+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.926+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94325988492400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb098f10 con 0x7fb49c00e8a0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.926+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0999a0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.926+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94325988489904] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.927+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94325988492400] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.927+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.927+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94325988496576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0988e0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.927+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb099e40 con 0x7fb49c00e8a0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.928+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.928+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94325988497824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb09a250 con 0x7fb49c00e8a0 2023-12-07T21:09:16.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.928+0000 7fb4b580f800 20 add_watcher() i=0 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.928+0000 7fb4b580f800 20 add_watcher() i=1 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.928+0000 7fb4b580f800 20 add_watcher() i=2 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.928+0000 7fb4b580f800 20 add_watcher() i=3 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.928+0000 7fb4b580f800 20 add_watcher() i=4 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.928+0000 7fb4b580f800 20 add_watcher() i=5 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.930+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94325988496576] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.930+0000 7fb4b580f800 20 add_watcher() i=6 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.930+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94325988497824] v31'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.930+0000 7fb4b580f800 20 add_watcher() i=7 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.930+0000 7fb4b580f800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.930+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb09d280 con 0x55c9fb089cd0 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.930+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.930+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94325988498864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb09a660 con 0x55c9fb089cd0 2023-12-07T21:09:16.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.931+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94325988498864] v31'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.931+0000 7fb4767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.931+0000 7fb4b580f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.931+0000 7fb4b580f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.931+0000 7fb4b580f800 5 note: GC not initialized 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.931+0000 7fb4757e2640 20 reqs_thread_entry: start 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.931+0000 7fb4b580f800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 20 Filter name: none 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb3e6ffd640 20 reqs_thread_entry: start 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d00f0 con 0x55c9fb089cd0 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:16.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d1b70 con 0x7fb4a4078060 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv2 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 : miss 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.932+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d36d0 con 0x7fb4a4078060 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.933+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(64 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.933+0000 7fb4b580f800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.933+0000 7fb4b580f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.933+0000 7fb4b580f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:16.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.933+0000 7fb4b580f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.933+0000 7fb4b580f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.933+0000 7fb4b580f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.933+0000 7fb4b580f800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.933+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d6f50 con 0x7fb4a4078060 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.934+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(65 foo.buckets [call] v31'18 uv18 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.934+0000 7fb4b580f800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.934+0000 7fb4b580f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.934+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d60e0 con 0x7fb4a4078060 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.934+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.934+0000 7fb4b580f800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.934+0000 7fb4b580f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.934+0000 7fb4b580f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.934+0000 7fb4b580f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.934+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d6ec0 con 0x7fb4a4078060 2023-12-07T21:09:16.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'19 uv19 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4b580f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4b580f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4b580f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94325988747680 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d6ef0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== watch-notify(notify (1) cookie 94325988496576 notify 133143986181 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x55c9fb07ef60 con 0x7fb49c00e8a0 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94325988496576 notifier 4438 bl.length()=338 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(68 notify.6 [notify cookie 94325988747680 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4937fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4937fe640 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fb4840042a0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.936+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== watch-notify(notify_complete (2) cookie 94325988747680 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c9fb07eb00 con 0x7fb49c00e8a0 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.937+0000 7fb4767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:16.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.937+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94325988498864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0b8fd0 con 0x55c9fb089cd0 2023-12-07T21:09:16.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.938+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94325988498864] v31'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.938+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94325986053968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d4a10 con 0x7fb4a4078060 2023-12-07T21:09:16.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.939+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94325986053968] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.939+0000 7fb4b580f800 20 remove_watcher() i=0 2023-12-07T21:09:16.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.939+0000 7fb4b580f800 2 removed watcher, disabling cache 2023-12-07T21:09:16.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.939+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94325988474768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d3d10 con 0x55c9fb089cd0 2023-12-07T21:09:16.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.940+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94325988474768] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.940+0000 7fb4b580f800 20 remove_watcher() i=1 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.940+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94325988480752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d3d10 con 0x55c9fb08fdf0 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.941+0000 7fb4b0e8c640 1 -- 172.21.15.121:0/279228215 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94325988480752] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4a407e040 con 0x55c9fb08fdf0 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.941+0000 7fb4b580f800 20 remove_watcher() i=2 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.941+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94325988481792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d1ed0 con 0x7fb4a4078060 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.942+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94325988481792] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb49c00f620 con 0x7fb4a4078060 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.942+0000 7fb4b580f800 20 remove_watcher() i=3 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.942+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94325988489904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb0d1ed0 con 0x55c9fb089cd0 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.943+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94325988489904] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x55c9fb089cd0 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.943+0000 7fb4b580f800 20 remove_watcher() i=4 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.943+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94325988492400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb097ab0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.944+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94325988492400] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.944+0000 7fb4b580f800 20 remove_watcher() i=5 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.944+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94325988496576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb097ab0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.945+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94325988496576] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.945+0000 7fb4b580f800 20 remove_watcher() i=6 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.945+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94325988497824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c9fb098470 con 0x7fb49c00e8a0 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.946+0000 7fb4b168d640 1 -- 172.21.15.121:0/279228215 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94325988497824] v31'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb4ac02e9d0 con 0x7fb49c00e8a0 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.946+0000 7fb4b580f800 20 remove_watcher() i=7 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb49c00e8a0 msgr2=0x7fb49c00d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fb49c00e8a0 0x7fb49c00d2f0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55c9fb089cd0 msgr2=0x55c9fb08c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55c9fb089cd0 0x55c9fb08c190 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb4a4078060 msgr2=0x7fb4a405b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fb4a4078060 0x7fb4a405b5a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55c9fb08fdf0 msgr2=0x55c9fb092280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55c9fb08fdf0 0x55c9fb092280 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb48c036110 msgr2=0x7fb48c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb48c036110 0x7fb48c0385d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb49c000c00 tx=0x7fb49c001330 comp rx=0 tx=0).stop 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 msgr2=0x55c9fb07e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb07e5c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00a930 tx=0x7fb4ac003370 comp rx=0 tx=0).stop 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4abfff640 1 -- 172.21.15.121:0/279228215 reap_dead start 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 shutdown_connections 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 --2- 172.21.15.121:0/279228215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fb077770 0x55c9fb07e5c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 >> 172.21.15.121:0/279228215 conn(0x55c9fafbd320 msgr2=0x55c9fb072720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 shutdown_connections 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/279228215 wait complete. 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/1560746005 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb494036110 msgr2=0x7fb4940385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 --2- 172.21.15.121:0/1560746005 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb494036110 0x7fb4940385d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4064fd0 tx=0x7fb4a4064f00 comp rx=0 tx=0).stop 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/1560746005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 msgr2=0x55c9fb05dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 --2- 172.21.15.121:0/1560746005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb05dfa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb4a405e040 tx=0x7fb4a4002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/1560746005 shutdown_connections 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 --2- 172.21.15.121:0/1560746005 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb494036110 0x7fb4940385d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 --2- 172.21.15.121:0/1560746005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c9fafbc110 0x55c9fb05dfa0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/1560746005 >> 172.21.15.121:0/1560746005 conn(0x55c9fafb7890 msgr2=0x55c9fb05be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/1560746005 shutdown_connections 2023-12-07T21:09:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:16.947+0000 7fb4b580f800 1 -- 172.21.15.121:0/1560746005 wait complete. 2023-12-07T21:09:16.946 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-12-07T21:09:16.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-12-07T21:09:16.947 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2023-12-07T21:09:16.996 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:16.996 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.004+0000 7f7f7e413800 1 Processor -- start 2023-12-07T21:09:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.004+0000 7f7f7e413800 1 -- start start 2023-12-07T21:09:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.004+0000 7f7f7e413800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ab5d147810 0x55ab5d149c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.004+0000 7f7f7e413800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ab5d08f740 con 0x55ab5d144880 2023-12-07T21:09:16.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.004+0000 7f7f7e413800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ab5d058880 con 0x55ab5d147810 2023-12-07T21:09:16.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.005+0000 7f7f7b712640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55ab5d147810 0x55ab5d149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:16.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.005+0000 7f7f7bf13640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55ab5d144880 0x55ab5d144ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55774/0 (socket says 172.21.15.121:55774) 2023-12-07T21:09:16.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.005+0000 7f7f7bf13640 1 -- 172.21.15.121:0/1687402317 learned_addr learned my addr 172.21.15.121:0/1687402317 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:16.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.005+0000 7f7f7b712640 1 -- 172.21.15.121:0/1687402317 >> v1:172.21.15.89:6789/0 conn(0x55ab5d144880 legacy=0x55ab5d144ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:16.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.005+0000 7f7f7b712640 1 -- 172.21.15.121:0/1687402317 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab5d14b150 con 0x55ab5d147810 2023-12-07T21:09:17.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.007+0000 7f7f7b712640 1 --2- 172.21.15.121:0/1687402317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d147810 0x55ab5d149c00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000a470 tx=0x7f7f7001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6987dd8f07a7ecd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.007+0000 7f7f7af11640 1 -- 172.21.15.121:0/1687402317 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f70052570 con 0x55ab5d147810 2023-12-07T21:09:17.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.007+0000 7f7f7af11640 1 -- 172.21.15.121:0/1687402317 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f700526d0 con 0x55ab5d147810 2023-12-07T21:09:17.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.007+0000 7f7f7af11640 1 -- 172.21.15.121:0/1687402317 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f70052990 con 0x55ab5d147810 2023-12-07T21:09:17.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.007+0000 7f7f7e413800 1 -- 172.21.15.121:0/1687402317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d147810 msgr2=0x55ab5d149c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.007+0000 7f7f7e413800 1 --2- 172.21.15.121:0/1687402317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d147810 0x55ab5d149c00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000a470 tx=0x7f7f7001cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.007+0000 7f7f7e413800 1 -- 172.21.15.121:0/1687402317 shutdown_connections 2023-12-07T21:09:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.007+0000 7f7f7e413800 1 --2- 172.21.15.121:0/1687402317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d147810 0x55ab5d149c00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.007+0000 7f7f7e413800 1 -- 172.21.15.121:0/1687402317 >> 172.21.15.121:0/1687402317 conn(0x55ab5d13cfa0 msgr2=0x55ab5d13f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.007+0000 7f7f7e413800 1 -- 172.21.15.121:0/1687402317 shutdown_connections 2023-12-07T21:09:17.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.007+0000 7f7f7e413800 1 -- 172.21.15.121:0/1687402317 wait complete. 2023-12-07T21:09:17.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.008+0000 7f7f7e413800 1 Processor -- start 2023-12-07T21:09:17.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.008+0000 7f7f7e413800 1 -- start start 2023-12-07T21:09:17.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.008+0000 7f7f7e413800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1e7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.008+0000 7f7f7e413800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab5d055db0 con 0x55ab5d144880 2023-12-07T21:09:17.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.008+0000 7f7f7bf13640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1e7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.008+0000 7f7f7bf13640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1e7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54628/0 (socket says 172.21.15.121:54628) 2023-12-07T21:09:17.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.008+0000 7f7f7bf13640 1 -- 172.21.15.121:0/4076396315 learned_addr learned my addr 172.21.15.121:0/4076396315 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7bf13640 1 -- 172.21.15.121:0/4076396315 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70005d20 con 0x55ab5d144880 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7bf13640 1 --2- 172.21.15.121:0/4076396315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1e7f60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0014d0 tx=0x7f7f6c001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125b781f1ce8ea71 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7a710640 1 -- 172.21.15.121:0/4076396315 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c004520 con 0x55ab5d144880 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7a710640 1 -- 172.21.15.121:0/4076396315 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c004680 con 0x55ab5d144880 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7a710640 1 -- 172.21.15.121:0/4076396315 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c004980 con 0x55ab5d144880 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7e413800 1 -- 172.21.15.121:0/4076396315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 msgr2=0x55ab5d1e7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7e413800 1 --2- 172.21.15.121:0/4076396315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1e7f60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0014d0 tx=0x7f7f6c001990 comp rx=0 tx=0).stop 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7e413800 1 -- 172.21.15.121:0/4076396315 shutdown_connections 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7e413800 1 --2- 172.21.15.121:0/4076396315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1e7f60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7e413800 1 -- 172.21.15.121:0/4076396315 >> 172.21.15.121:0/4076396315 conn(0x55ab5d13cfa0 msgr2=0x55ab5d1e3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7e413800 1 -- 172.21.15.121:0/4076396315 shutdown_connections 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.009+0000 7f7f7e413800 1 -- 172.21.15.121:0/4076396315 wait complete. 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.010+0000 7f7f7e413800 1 Processor -- start 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.010+0000 7f7f7e413800 1 -- start start 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.010+0000 7f7f7e413800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.010+0000 7f7f7e413800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab5d0516a0 con 0x55ab5d144880 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.010+0000 7f7f7bf13640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.010+0000 7f7f7bf13640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1ef490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54630/0 (socket says 172.21.15.121:54630) 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.010+0000 7f7f7bf13640 1 -- 172.21.15.121:0/4081370003 learned_addr learned my addr 172.21.15.121:0/4081370003 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.010+0000 7f7f7bf13640 1 -- 172.21.15.121:0/4081370003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab5d08f740 con 0x55ab5d144880 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.011+0000 7f7f7bf13640 1 --2- 172.21.15.121:0/4081370003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1ef490 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c000f80 tx=0x7f7f6c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.011+0000 7f7f7970e640 1 -- 172.21.15.121:0/4081370003 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c023030 con 0x55ab5d144880 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.011+0000 7f7f7970e640 1 -- 172.21.15.121:0/4081370003 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c013760 con 0x55ab5d144880 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.011+0000 7f7f7e413800 1 -- 172.21.15.121:0/4081370003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ab5d1ef9d0 con 0x55ab5d144880 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.011+0000 7f7f7970e640 1 -- 172.21.15.121:0/4081370003 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f6c013a80 con 0x55ab5d144880 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.011+0000 7f7f7e413800 1 -- 172.21.15.121:0/4081370003 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab5d1efe50 con 0x55ab5d144880 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.011+0000 7f7f7e413800 1 Processor -- start 2023-12-07T21:09:17.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.011+0000 7f7f7e413800 1 -- start start 2023-12-07T21:09:17.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7e413800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 0x55ab5d1fb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7e413800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab5cfeb890 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7970e640 1 -- 172.21.15.121:0/4081370003 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7f6c026070 con 0x55ab5d144880 2023-12-07T21:09:17.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7c714640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 0x55ab5d1fb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7c714640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 0x55ab5d1fb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54644/0 (socket says 172.21.15.121:54644) 2023-12-07T21:09:17.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7c714640 1 -- 172.21.15.121:0/1674777187 learned_addr learned my addr 172.21.15.121:0/1674777187 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7970e640 1 --2- 172.21.15.121:0/4081370003 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7f68036110 0x7f7f680385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7970e640 1 -- 172.21.15.121:0/4081370003 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f7f6c024070 con 0x55ab5d144880 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7bf13640 1 --2- 172.21.15.121:0/4081370003 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7f68036110 0x7f7f680385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7c714640 1 -- 172.21.15.121:0/1674777187 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab5d1fbf00 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7c714640 1 --2- 172.21.15.121:0/1674777187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 0x55ab5d1fb9c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400a400 tx=0x7f7f7400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88445f0e60a4b4e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f7bf13640 1 --2- 172.21.15.121:0/4081370003 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7f68036110 0x7f7f680385d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c006a60 tx=0x7f7f6c028ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f62ffd640 1 -- 172.21.15.121:0/1674777187 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f740087e0 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f62ffd640 1 -- 172.21.15.121:0/1674777187 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f74008960 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.012+0000 7f7f62ffd640 1 -- 172.21.15.121:0/1674777187 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f74008c80 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7e413800 1 -- 172.21.15.121:0/1674777187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 msgr2=0x55ab5d1fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7e413800 1 --2- 172.21.15.121:0/1674777187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 0x55ab5d1fb9c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400a400 tx=0x7f7f7400a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7e413800 1 -- 172.21.15.121:0/1674777187 shutdown_connections 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7e413800 1 --2- 172.21.15.121:0/1674777187 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 0x55ab5d1fb9c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7e413800 1 -- 172.21.15.121:0/1674777187 >> 172.21.15.121:0/1674777187 conn(0x55ab5d147810 msgr2=0x55ab5d1f6980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7e413800 1 -- 172.21.15.121:0/1674777187 shutdown_connections 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7e413800 1 -- 172.21.15.121:0/1674777187 wait complete. 2023-12-07T21:09:17.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7e413800 1 Processor -- start 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7e413800 1 -- start start 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7e413800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 0x55ab5d202500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7e413800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab5cfeb530 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7c714640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 0x55ab5d202500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7c714640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 0x55ab5d202500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54656/0 (socket says 172.21.15.121:54656) 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.013+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 learned_addr learned my addr 172.21.15.121:0/3599972589 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.014+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f74005c90 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.014+0000 7f7f7c714640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 0x55ab5d202500 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c010 tx=0x7f7f74002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.014+0000 7f7f617fa640 1 -- 172.21.15.121:0/3599972589 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f74013840 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.014+0000 7f7f617fa640 1 -- 172.21.15.121:0/3599972589 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f740139a0 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.014+0000 7f7f617fa640 1 -- 172.21.15.121:0/3599972589 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f74013c80 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.014+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ab5d202a40 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.014+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab5d202f00 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.015+0000 7f7f617fa640 1 -- 172.21.15.121:0/3599972589 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7f7401e420 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.015+0000 7f7f617fa640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7f54036110 0x7f7f540385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.015+0000 7f7f617fa640 1 -- 172.21.15.121:0/3599972589 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f7f7404b6c0 con 0x55ab5d1fb5a0 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.015+0000 7f7f7b712640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7f54036110 0x7f7f540385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.015+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.015+0000 7f7f7b712640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7f54036110 0x7f7f540385d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7f70054000 tx=0x7f7f7004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.015+0000 7f7f7e413800 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55ab5d20dc80 0x55ab5d210140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.015+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d210890 con 0x55ab5d20dc80 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.015+0000 7f7f7c714640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55ab5d20dc80 0x55ab5d210140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7c714640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55ab5d20dc80 0x55ab5d210140 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7e413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7e413800 20 realm 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d210ca0 con 0x55ab5d20dc80 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7e413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7e413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d211520 con 0x55ab5d20dc80 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7e413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.016+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d211880 con 0x55ab5d20dc80 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.017+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.017+0000 7f7f7e413800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.017+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.017+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d212080 con 0x55ab5d20dc80 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.017+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.017+0000 7f7f7e413800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.017+0000 7f7f7e413800 20 searching for the correct realm 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.017+0000 7f7f7e413800 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55ab5d213da0 0x55ab5d216210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.017+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d213da0 2023-12-07T21:09:17.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.017+0000 7f7f7bf13640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55ab5d213da0 0x55ab5d216210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.017+0000 7f7f7bf13640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55ab5d213da0 0x55ab5d216210 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.018+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.018+0000 7f7f7bf13640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7f6c035450 0x7f7f6c035870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.018+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f6c035450 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.018+0000 7f7f7b712640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7f6c035450 0x7f7f6c035870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.018+0000 7f7f7b712640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7f6c035450 0x7f7f6c035870 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.018+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.018+0000 7f7f7b712640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7f7005d930 0x7f7f700683d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.018+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f7005d930 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.018+0000 7f7f7c714640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7f7005d930 0x7f7f700683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.019+0000 7f7f7c714640 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7f7005d930 0x7f7f700683d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.019+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x7f7f7005d930 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.019+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d20dc80 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.019+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.019+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d20dc80 2023-12-07T21:09:17.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.019+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.019+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f7005d930 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.020+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x7f7f7005d930 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.020+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f7005d930 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.020+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x7f7f7005d930 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.020+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f6c035450 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.020+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.020+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d213da0 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.020+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.020+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d20dc80 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.021+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.021+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f7005d930 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.021+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x7f7f7005d930 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.021+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d20dc80 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.021+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.021+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f6c035450 2023-12-07T21:09:17.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.021+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.021+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d213da0 2023-12-07T21:09:17.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.021+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.021+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d213da0 2023-12-07T21:09:17.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.022+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.022+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f7005d930 2023-12-07T21:09:17.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.022+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x7f7f7005d930 2023-12-07T21:09:17.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.022+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d213da0 2023-12-07T21:09:17.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.022+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.022+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d213da0 2023-12-07T21:09:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.022+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.022+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d20dc80 2023-12-07T21:09:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.023+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.023+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d20dc80 2023-12-07T21:09:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.023+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.023+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f7005d930 2023-12-07T21:09:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.023+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x7f7f7005d930 2023-12-07T21:09:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.023+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d213da0 2023-12-07T21:09:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.023+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.023+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f6c035450 2023-12-07T21:09:17.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.024+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.024+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d20dc80 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.024+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74024070 con 0x55ab5d20dc80 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.024+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f7005d930 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.024+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.024+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d213da0 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.024+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.024+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f7005d930 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.025+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.025+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f6c035450 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.025+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.025+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d213da0 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.025+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.025+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f7005d930 2023-12-07T21:09:17.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x55ab5d20dc80 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2168e0 con 0x7f7f6c035450 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7e413800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7e413800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7e413800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7e413800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7e413800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7e413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d212980 con 0x55ab5d20dc80 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7e413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.026+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d212600 con 0x55ab5d20dc80 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d213250 con 0x55ab5d213da0 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 20 zone default found 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 4 Realm: () 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 20 zonegroup default 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d216d20 con 0x7f7f7005d930 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d218ba0 con 0x55ab5d213da0 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.027+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d218f00 con 0x55ab5d213da0 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.028+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.028+0000 7f7f7e413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.028+0000 7f7f7e413800 20 started sync module instance, tier type = 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.028+0000 7f7f7e413800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.028+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d218170 con 0x7f7f6c035450 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.029+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.029+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94194487832400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d218550 con 0x7f7f6c035450 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.029+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d219700 con 0x55ab5d20dc80 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.030+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94194487832400] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.030+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.030+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94194490244304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d219700 con 0x55ab5d20dc80 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.030+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21a150 con 0x55ab5d213da0 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.031+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94194490244304] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.031+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.031+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94194490249824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d219670 con 0x55ab5d213da0 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.031+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21ae40 con 0x7f7f6c035450 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.032+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94194490249824] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.032+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.033+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94194490254864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21b690 con 0x7f7f6c035450 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.033+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21be90 con 0x55ab5d20dc80 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.034+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94194490254864] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.034+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.034+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94194490259952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21c2a0 con 0x55ab5d20dc80 2023-12-07T21:09:17.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.034+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21caa0 con 0x7f7f7005d930 2023-12-07T21:09:17.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.035+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94194490259952] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.035+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.035+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94194490261264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21c8a0 con 0x7f7f7005d930 2023-12-07T21:09:17.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.035+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21d2f0 con 0x7f7f7005d930 2023-12-07T21:09:17.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.036+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94194490261264] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.036+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.036+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94194490262304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21d2f0 con 0x7f7f7005d930 2023-12-07T21:09:17.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.036+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21dc60 con 0x7f7f7005d930 2023-12-07T21:09:17.039 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.037+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94194490262304] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.037+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.037+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94194490265648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21dc60 con 0x7f7f7005d930 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.037+0000 7f7f7e413800 20 add_watcher() i=0 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.037+0000 7f7f7e413800 20 add_watcher() i=1 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.037+0000 7f7f7e413800 20 add_watcher() i=2 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.037+0000 7f7f7e413800 20 add_watcher() i=3 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.037+0000 7f7f7e413800 20 add_watcher() i=4 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.037+0000 7f7f7e413800 20 add_watcher() i=5 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.037+0000 7f7f7e413800 20 add_watcher() i=6 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.038+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94194490265648] v31'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.038+0000 7f7f7e413800 20 add_watcher() i=7 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.038+0000 7f7f7e413800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.038+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d221020 con 0x55ab5d20dc80 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.038+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.040 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.038+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94194490268048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21e4c0 con 0x55ab5d20dc80 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.039+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94194490268048] v31'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.039+0000 7f7f41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.039+0000 7f7f7e413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.039+0000 7f7f7e413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.039+0000 7f7f7e413800 5 note: GC not initialized 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.039+0000 7f7f40fe1640 20 reqs_thread_entry: start 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.039+0000 7f7f7e413800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 20 Filter name: none 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7eba7fc640 20 reqs_thread_entry: start 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2540b0 con 0x7f7f7005d930 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-12-07T21:09:17.041 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d252860 con 0x7f7f7005d930 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.040+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d252c60 con 0x7f7f7005d930 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v31'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f7e413800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f7e413800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f7e413800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-12-07T21:09:17.042 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94194490489616 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d257500 con 0x7f7f7005d930 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== watch-notify(notify (1) cookie 94194490261264 notify 133143986182 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x55ab5d202f00 con 0x7f7f7005d930 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 94194490261264 notifier 4444 bl.length()=522 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(65 notify.5 [notify cookie 94194490489616 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f62ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f62ffd640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7f500042a0 con 0x7f7f7005d930 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== watch-notify(notify_complete (2) cookie 94194490489616 notify 133143986182 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ab5d202a40 con 0x7f7f7005d930 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.042+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d2554e0 con 0x7f7f7005d930 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f7e413800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f7e413800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f7e413800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94194490489616 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d257500 con 0x55ab5d213da0 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== watch-notify(notify (1) cookie 94194490249824 notify 133143986178 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f7f6c029e70 con 0x55ab5d213da0 2023-12-07T21:09:17.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(68 notify.2 [notify cookie 94194490489616 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94194490249824 notifier 4444 bl.length()=177 2023-12-07T21:09:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-12-07T21:09:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f62ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:09:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f62ffd640 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7f500042a0 con 0x55ab5d213da0 2023-12-07T21:09:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== watch-notify(notify_complete (2) cookie 94194490489616 notify 133143986178 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55ab5d1efe50 con 0x55ab5d213da0 2023-12-07T21:09:17.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.044+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.044 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:17.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.045+0000 7f7f41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.045+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94194490268048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d20ac10 con 0x55ab5d20dc80 2023-12-07T21:09:17.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.046+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94194490268048] v31'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.046+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94194487832400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d253470 con 0x7f7f6c035450 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.047+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94194487832400] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.047+0000 7f7f7e413800 20 remove_watcher() i=0 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.047+0000 7f7f7e413800 2 removed watcher, disabling cache 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.047+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94194490244304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d20ac10 con 0x55ab5d20dc80 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.048+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94194490244304] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.049+0000 7f7f7e413800 20 remove_watcher() i=1 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.049+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94194490249824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d20ac10 con 0x55ab5d213da0 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.050+0000 7f7f7bf13640 1 -- 172.21.15.121:0/3599972589 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94194490249824] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f6c03a040 con 0x55ab5d213da0 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.050+0000 7f7f7e413800 20 remove_watcher() i=2 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.050+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94194490254864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d20ac10 con 0x7f7f6c035450 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.050+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94194490254864] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f70059040 con 0x7f7f6c035450 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.051+0000 7f7f7e413800 20 remove_watcher() i=3 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.051+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94194490259952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d20af70 con 0x55ab5d20dc80 2023-12-07T21:09:17.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.052+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94194490259952] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x55ab5d20dc80 2023-12-07T21:09:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.052+0000 7f7f7e413800 20 remove_watcher() i=4 2023-12-07T21:09:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.052+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94194490261264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d20af70 con 0x7f7f7005d930 2023-12-07T21:09:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.053+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94194490261264] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.053+0000 7f7f7e413800 20 remove_watcher() i=5 2023-12-07T21:09:17.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.053+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94194490262304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21bf10 con 0x7f7f7005d930 2023-12-07T21:09:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.054+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94194490262304] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.054+0000 7f7f7e413800 20 remove_watcher() i=6 2023-12-07T21:09:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.054+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94194490265648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55ab5d21bf10 con 0x7f7f7005d930 2023-12-07T21:09:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7c714640 1 -- 172.21.15.121:0/3599972589 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94194490265648] v31'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f74053040 con 0x7f7f7005d930 2023-12-07T21:09:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 20 remove_watcher() i=7 2023-12-07T21:09:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7f7005d930 msgr2=0x7f7f700683d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7f7005d930 0x7f7f700683d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55ab5d20dc80 msgr2=0x55ab5d210140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55ab5d20dc80 0x55ab5d210140 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7f6c035450 msgr2=0x7f7f6c035870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7f6c035450 0x7f7f6c035870 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55ab5d213da0 msgr2=0x55ab5d216210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55ab5d213da0 0x55ab5d216210 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7f54036110 msgr2=0x7f7f540385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7f54036110 0x7f7f540385d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7f70054000 tx=0x7f7f7004e000 comp rx=0 tx=0).stop 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 msgr2=0x55ab5d202500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 --2- 172.21.15.121:0/3599972589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d1fb5a0 0x55ab5d202500 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400c010 tx=0x7f7f74002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 reap_dead start 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 shutdown_connections 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7b712640 1 -- 172.21.15.121:0/3599972589 reap_dead start 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 >> 172.21.15.121:0/3599972589 conn(0x55ab5d147810 msgr2=0x55ab5d1f6550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 shutdown_connections 2023-12-07T21:09:17.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.055+0000 7f7f7e413800 1 -- 172.21.15.121:0/3599972589 wait complete. 2023-12-07T21:09:17.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.056+0000 7f7f7e413800 1 -- 172.21.15.121:0/4081370003 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7f68036110 msgr2=0x7f7f680385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.056+0000 7f7f7e413800 1 --2- 172.21.15.121:0/4081370003 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7f68036110 0x7f7f680385d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c006a60 tx=0x7f7f6c028ef0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.056+0000 7f7f7e413800 1 -- 172.21.15.121:0/4081370003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 msgr2=0x55ab5d1ef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.056+0000 7f7f7e413800 1 --2- 172.21.15.121:0/4081370003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1ef490 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c000f80 tx=0x7f7f6c001250 comp rx=0 tx=0).stop 2023-12-07T21:09:17.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.056+0000 7f7f7e413800 1 -- 172.21.15.121:0/4081370003 shutdown_connections 2023-12-07T21:09:17.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.056+0000 7f7f7e413800 1 --2- 172.21.15.121:0/4081370003 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7f68036110 0x7f7f680385d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.056+0000 7f7f7e413800 1 --2- 172.21.15.121:0/4081370003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55ab5d144880 0x55ab5d1ef490 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.056+0000 7f7f7e413800 1 -- 172.21.15.121:0/4081370003 >> 172.21.15.121:0/4081370003 conn(0x55ab5d13cfa0 msgr2=0x55ab5d1e6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.056+0000 7f7f7e413800 1 -- 172.21.15.121:0/4081370003 shutdown_connections 2023-12-07T21:09:17.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.056+0000 7f7f7e413800 1 -- 172.21.15.121:0/4081370003 wait complete. 2023-12-07T21:09:17.053 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:17.058 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-12-07T21:09:17.062 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:17.062 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2023-12-07T21:09:17.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2023-12-07T21:09:17.062 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2023-12-07T21:09:17.103 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:17.103 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:17.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.111+0000 7f0f5dd26800 1 Processor -- start 2023-12-07T21:09:17.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.111+0000 7f0f5dd26800 1 -- start start 2023-12-07T21:09:17.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.111+0000 7f0f5dd26800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55eafed3b5d0 0x55eafed3d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.111+0000 7f0f5dd26800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55eafec847a0 con 0x55eafed386d0 2023-12-07T21:09:17.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.111+0000 7f0f5dd26800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55eafec4d880 con 0x55eafed3b5d0 2023-12-07T21:09:17.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.111+0000 7f0f59284640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55eafed3b5d0 0x55eafed3d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.111+0000 7f0f59a85640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55eafed386d0 0x55eafed38af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55790/0 (socket says 172.21.15.121:55790) 2023-12-07T21:09:17.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.111+0000 7f0f59a85640 1 -- 172.21.15.121:0/4249775887 learned_addr learned my addr 172.21.15.121:0/4249775887 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:17.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.112+0000 7f0f59284640 1 -- 172.21.15.121:0/4249775887 >> v1:172.21.15.89:6789/0 conn(0x55eafed386d0 legacy=0x55eafed38af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.112+0000 7f0f58a83640 1 -- 172.21.15.121:0/4249775887 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296734855 0 0) 0x55eafec847a0 con 0x55eafed386d0 2023-12-07T21:09:17.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.112+0000 7f0f59284640 1 -- 172.21.15.121:0/4249775887 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eafed3efa0 con 0x55eafed3b5d0 2023-12-07T21:09:17.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.113+0000 7f0f59284640 1 --2- 172.21.15.121:0/4249775887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed3b5d0 0x55eafed3d9c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000a470 tx=0x7f0f5001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdd784c62965709 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.114+0000 7f0f58a83640 1 -- 172.21.15.121:0/4249775887 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f50052570 con 0x55eafed3b5d0 2023-12-07T21:09:17.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.114+0000 7f0f58a83640 1 -- 172.21.15.121:0/4249775887 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f500526d0 con 0x55eafed3b5d0 2023-12-07T21:09:17.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.114+0000 7f0f58a83640 1 -- 172.21.15.121:0/4249775887 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f50052990 con 0x55eafed3b5d0 2023-12-07T21:09:17.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.114+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4249775887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed3b5d0 msgr2=0x55eafed3d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.114+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/4249775887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed3b5d0 0x55eafed3d9c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000a470 tx=0x7f0f5001cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:17.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.114+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4249775887 shutdown_connections 2023-12-07T21:09:17.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.114+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/4249775887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed3b5d0 0x55eafed3d9c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.114+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4249775887 >> 172.21.15.121:0/4249775887 conn(0x55eafed31f60 msgr2=0x55eafed34380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.114+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4249775887 shutdown_connections 2023-12-07T21:09:17.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.114+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4249775887 wait complete. 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.115+0000 7f0f5dd26800 1 Processor -- start 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.115+0000 7f0f5dd26800 1 -- start start 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.115+0000 7f0f5dd26800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafed36560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.115+0000 7f0f5dd26800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafec4adb0 con 0x55eafed386d0 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.115+0000 7f0f59a85640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafed36560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.115+0000 7f0f59a85640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafed36560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54676/0 (socket says 172.21.15.121:54676) 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.115+0000 7f0f59a85640 1 -- 172.21.15.121:0/89463260 learned_addr learned my addr 172.21.15.121:0/89463260 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f59a85640 1 -- 172.21.15.121:0/89463260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f50005d20 con 0x55eafed386d0 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f59a85640 1 --2- 172.21.15.121:0/89463260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafed36560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00b210 tx=0x7f0f4c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fb5782ba72ce2f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f4bfff640 1 -- 172.21.15.121:0/89463260 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c014070 con 0x55eafed386d0 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f4bfff640 1 -- 172.21.15.121:0/89463260 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00d500 con 0x55eafed386d0 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f4bfff640 1 -- 172.21.15.121:0/89463260 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c00d800 con 0x55eafed386d0 2023-12-07T21:09:17.111 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f5dd26800 1 -- 172.21.15.121:0/89463260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 msgr2=0x55eafed36560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/89463260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafed36560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00b210 tx=0x7f0f4c00b6d0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f5dd26800 1 -- 172.21.15.121:0/89463260 shutdown_connections 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/89463260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafed36560 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f5dd26800 1 -- 172.21.15.121:0/89463260 >> 172.21.15.121:0/89463260 conn(0x55eafed31f60 msgr2=0x55eafedd78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f5dd26800 1 -- 172.21.15.121:0/89463260 shutdown_connections 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.116+0000 7f0f5dd26800 1 -- 172.21.15.121:0/89463260 wait complete. 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.117+0000 7f0f5dd26800 1 Processor -- start 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.117+0000 7f0f5dd26800 1 -- start start 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.117+0000 7f0f5dd26800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafede4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.117+0000 7f0f5dd26800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafec466a0 con 0x55eafed386d0 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.117+0000 7f0f59a85640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafede4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.117+0000 7f0f59a85640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafede4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54692/0 (socket says 172.21.15.121:54692) 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.117+0000 7f0f59a85640 1 -- 172.21.15.121:0/4049525773 learned_addr learned my addr 172.21.15.121:0/4049525773 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.117+0000 7f0f59a85640 1 -- 172.21.15.121:0/4049525773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c001b70 con 0x55eafed386d0 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.118+0000 7f0f59a85640 1 --2- 172.21.15.121:0/4049525773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafede4220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00b210 tx=0x7f0f4c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.118+0000 7f0f4affd640 1 -- 172.21.15.121:0/4049525773 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c00de30 con 0x55eafed386d0 2023-12-07T21:09:17.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.118+0000 7f0f4affd640 1 -- 172.21.15.121:0/4049525773 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c020070 con 0x55eafed386d0 2023-12-07T21:09:17.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.118+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4049525773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eafede4760 con 0x55eafed386d0 2023-12-07T21:09:17.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.118+0000 7f0f4affd640 1 -- 172.21.15.121:0/4049525773 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c00fb00 con 0x55eafed386d0 2023-12-07T21:09:17.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.118+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4049525773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eafede4c40 con 0x55eafed386d0 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.118+0000 7f0f5dd26800 1 Processor -- start 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.118+0000 7f0f5dd26800 1 -- start start 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.118+0000 7f0f5dd26800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 0x55eafedf0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.118+0000 7f0f5dd26800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafebe0890 con 0x55eafedf0470 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f4affd640 1 -- 172.21.15.121:0/4049525773 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0f4c00d040 con 0x55eafed386d0 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f5a286640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 0x55eafedf0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f5a286640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 0x55eafedf0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54702/0 (socket says 172.21.15.121:54702) 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f5a286640 1 -- 172.21.15.121:0/2529606943 learned_addr learned my addr 172.21.15.121:0/2529606943 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f4affd640 1 --2- 172.21.15.121:0/4049525773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0f3c036110 0x7f0f3c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f4affd640 1 -- 172.21.15.121:0/4049525773 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f0f4c00a040 con 0x55eafed386d0 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f59a85640 1 --2- 172.21.15.121:0/4049525773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0f3c036110 0x7f0f3c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f5a286640 1 -- 172.21.15.121:0/2529606943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eafedf0dd0 con 0x55eafedf0470 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f5a286640 1 --2- 172.21.15.121:0/2529606943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 0x55eafedf0890 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400a430 tx=0x7f0f5400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ba0c59481b6f63 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f59a85640 1 --2- 172.21.15.121:0/4049525773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0f3c036110 0x7f0f3c0385d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00dfb0 tx=0x7f0f4c0013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f48ff9640 1 -- 172.21.15.121:0/2529606943 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f54001650 con 0x55eafedf0470 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f48ff9640 1 -- 172.21.15.121:0/2529606943 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f540017d0 con 0x55eafedf0470 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.119+0000 7f0f48ff9640 1 -- 172.21.15.121:0/2529606943 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f54001ab0 con 0x55eafedf0470 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5dd26800 1 -- 172.21.15.121:0/2529606943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 msgr2=0x55eafedf0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/2529606943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 0x55eafedf0890 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400a430 tx=0x7f0f5400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5dd26800 1 -- 172.21.15.121:0/2529606943 shutdown_connections 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/2529606943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 0x55eafedf0890 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5dd26800 1 -- 172.21.15.121:0/2529606943 >> 172.21.15.121:0/2529606943 conn(0x55eafed3b5d0 msgr2=0x55eafedeb850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5dd26800 1 -- 172.21.15.121:0/2529606943 shutdown_connections 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5dd26800 1 -- 172.21.15.121:0/2529606943 wait complete. 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5dd26800 1 Processor -- start 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5dd26800 1 -- start start 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5dd26800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 0x55eafeddd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5dd26800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eafebe0530 con 0x55eafedf0470 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5a286640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 0x55eafeddd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5a286640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 0x55eafeddd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54706/0 (socket says 172.21.15.121:54706) 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.120+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 learned_addr learned my addr 172.21.15.121:0/1318197498 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.121+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5400a0e0 con 0x55eafedf0470 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.121+0000 7f0f5a286640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 0x55eafeddd530 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400a930 tx=0x7f0f54003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.121+0000 7f0f3affd640 1 -- 172.21.15.121:0/1318197498 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f54010900 con 0x55eafedf0470 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.121+0000 7f0f3affd640 1 -- 172.21.15.121:0/1318197498 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f54010a60 con 0x55eafedf0470 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.121+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eafeddbbb0 con 0x55eafedf0470 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.121+0000 7f0f3affd640 1 -- 172.21.15.121:0/1318197498 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f54010d20 con 0x55eafedf0470 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.121+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eafeddc010 con 0x55eafedf0470 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.122+0000 7f0f3affd640 1 -- 172.21.15.121:0/1318197498 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0f54017030 con 0x55eafedf0470 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.122+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.122+0000 7f0f3affd640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0f34036110 0x7f0f340385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.122+0000 7f0f3affd640 1 -- 172.21.15.121:0/1318197498 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f0f5404b7d0 con 0x55eafedf0470 2023-12-07T21:09:17.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.122+0000 7f0f59284640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0f34036110 0x7f0f340385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.122+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55eafee04e30 0x55eafee072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.122+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee07a20 con 0x55eafee04e30 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.122+0000 7f0f5a286640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55eafee04e30 0x55eafee072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f59284640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0f34036110 0x7f0f340385d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0f50054000 tx=0x7f0f5004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5a286640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55eafee04e30 0x55eafee072f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5dd26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5dd26800 20 realm 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee07e10 con 0x55eafee04e30 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5dd26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5dd26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee08660 con 0x55eafee04e30 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5dd26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.123+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee089c0 con 0x55eafee04e30 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.124+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.124+0000 7f0f5dd26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.124+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.124+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee08300 con 0x55eafee04e30 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.124+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.124+0000 7f0f5dd26800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.124+0000 7f0f5dd26800 20 searching for the correct realm 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.124+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55eafee0ac10 0x55eafee0d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.124+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee0ac10 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.124+0000 7f0f59a85640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55eafee0ac10 0x55eafee0d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.124+0000 7f0f59a85640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55eafee0ac10 0x55eafee0d000 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.125+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.125+0000 7f0f59a85640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0f4c04b1c0 0x7f0f4c04b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.125+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.125+0000 7f0f59284640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0f4c04b1c0 0x7f0f4c04b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.125+0000 7f0f59284640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0f4c04b1c0 0x7f0f4c04b5c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.125+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.125+0000 7f0f59284640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0f5005ca90 0x7f0f500673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.125+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f5005ca90 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.125+0000 7f0f5a286640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0f5005ca90 0x7f0f500673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.126+0000 7f0f5a286640 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0f5005ca90 0x7f0f500673d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.126+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.126+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee04e30 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.126+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.126+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee04e30 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.127+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.127+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f5005ca90 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.127+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.127+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f5005ca90 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.127+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.127+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.127+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.127+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee0ac10 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.127+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.127+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee04e30 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.128+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.128+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f5005ca90 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.128+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.128+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee04e30 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.128+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.128+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.128+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.128+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee0ac10 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.129+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.129+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee0ac10 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.129+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.129+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f5005ca90 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.129+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.129+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee0ac10 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.129+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.129+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee0ac10 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.130+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.130+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee04e30 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.130+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.130+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee04e30 2023-12-07T21:09:17.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.130+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.130+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f5005ca90 2023-12-07T21:09:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.131+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.131+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee0ac10 2023-12-07T21:09:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.131+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.131+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.131+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.131+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee04e30 2023-12-07T21:09:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.131+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.131+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f5005ca90 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.132+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.132+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee0ac10 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.132+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.132+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f5005ca90 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.132+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.132+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.132+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.132+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee0ac10 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.132+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.132+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x7f0f5005ca90 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0d5e0 con 0x55eafee04e30 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0f54053080 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5dd26800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5dd26800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5dd26800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5dd26800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5dd26800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5dd26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee09820 con 0x55eafee04e30 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5dd26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.133+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee09c60 con 0x55eafee04e30 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0a040 con 0x55eafee0ac10 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 20 zone default found 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 4 Realm: () 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 20 zonegroup default 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.134+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0da00 con 0x7f0f5005ca90 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f5dd26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0f880 con 0x55eafee0ac10 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f5dd26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0fbe0 con 0x55eafee0ac10 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f5dd26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f5dd26800 20 started sync module instance, tier type = 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f5dd26800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.135+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0ee50 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.136+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.136+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94467784441680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee0f240 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.136+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee103e0 con 0x55eafee04e30 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.137+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94467784441680] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.137+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.137+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94467786860976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee103e0 con 0x55eafee04e30 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.137+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee10d90 con 0x55eafee0ac10 2023-12-07T21:09:17.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.138+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94467786860976] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.139+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.139+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94467786866496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee10350 con 0x55eafee0ac10 2023-12-07T21:09:17.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.139+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee11a80 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.140+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.140+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94467786874416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee126e0 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.140+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee13050 con 0x55eafee04e30 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.146+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.146+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94467786866496] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.146+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94467786878176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee138a0 con 0x55eafee04e30 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.146+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee11140 con 0x7f0f5005ca90 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.146+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94467786874416] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.147+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94467786878176] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.147+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.147+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94467786875456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee13850 con 0x7f0f5005ca90 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.147+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee14210 con 0x7f0f5005ca90 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.148+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94467786875456] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.148+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.148+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94467786880192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee14210 con 0x7f0f5005ca90 2023-12-07T21:09:17.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.148+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee14a10 con 0x7f0f5005ca90 2023-12-07T21:09:17.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.149+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94467786880192] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.149+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.149+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94467786882896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee14860 con 0x7f0f5005ca90 2023-12-07T21:09:17.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.150+0000 7f0f5dd26800 20 add_watcher() i=0 2023-12-07T21:09:17.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.150+0000 7f0f5dd26800 20 add_watcher() i=1 2023-12-07T21:09:17.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.150+0000 7f0f5dd26800 20 add_watcher() i=2 2023-12-07T21:09:17.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.150+0000 7f0f5dd26800 20 add_watcher() i=3 2023-12-07T21:09:17.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.150+0000 7f0f5dd26800 20 add_watcher() i=4 2023-12-07T21:09:17.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.150+0000 7f0f5dd26800 20 add_watcher() i=5 2023-12-07T21:09:17.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.150+0000 7f0f5dd26800 20 add_watcher() i=6 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.150+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94467786882896] v31'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.150+0000 7f0f5dd26800 20 add_watcher() i=7 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.150+0000 7f0f5dd26800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.150+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee17d60 con 0x55eafee04e30 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.151+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.151+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94467786883936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee15270 con 0x55eafee04e30 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.152+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94467786883936] v31'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.152+0000 7f0f1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.152+0000 7f0f5dd26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.152+0000 7f0f5dd26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.152+0000 7f0f5dd26800 5 note: GC not initialized 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.152+0000 7f0f1e7e4640 20 reqs_thread_entry: start 2023-12-07T21:09:17.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.152+0000 7f0f5dd26800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:17.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.152+0000 7f0f5dd26800 20 Filter name: none 2023-12-07T21:09:17.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.152+0000 7f0e8ffff640 20 reqs_thread_entry: start 2023-12-07T21:09:17.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.153+0000 7f0f5dd26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.153+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee4a6f0 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.153+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv19 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.153+0000 7f0f5dd26800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:17.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.154+0000 7f0f1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.154+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94467786883936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee156a0 con 0x55eafee04e30 2023-12-07T21:09:17.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.155+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94467786883936] v31'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.155+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94467784441680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee15670 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.156+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94467784441680] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.156+0000 7f0f5dd26800 20 remove_watcher() i=0 2023-12-07T21:09:17.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.156+0000 7f0f5dd26800 2 removed watcher, disabling cache 2023-12-07T21:09:17.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.156+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94467786860976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee159d0 con 0x55eafee04e30 2023-12-07T21:09:17.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.157+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94467786860976] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.157+0000 7f0f5dd26800 20 remove_watcher() i=1 2023-12-07T21:09:17.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.157+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94467786866496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee159d0 con 0x55eafee0ac10 2023-12-07T21:09:17.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.158+0000 7f0f59a85640 1 -- 172.21.15.121:0/1318197498 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94467786866496] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f4c016070 con 0x55eafee0ac10 2023-12-07T21:09:17.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.158+0000 7f0f5dd26800 20 remove_watcher() i=2 2023-12-07T21:09:17.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.158+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94467786874416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee159d0 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.159+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94467786874416] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f50052840 con 0x7f0f4c04b1c0 2023-12-07T21:09:17.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.159+0000 7f0f5dd26800 20 remove_watcher() i=3 2023-12-07T21:09:17.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.159+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94467786878176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee159d0 con 0x55eafee04e30 2023-12-07T21:09:17.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.160+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94467786878176] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x55eafee04e30 2023-12-07T21:09:17.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.160+0000 7f0f5dd26800 20 remove_watcher() i=4 2023-12-07T21:09:17.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.160+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94467786875456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee159d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.161+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94467786875456] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.161+0000 7f0f5dd26800 20 remove_watcher() i=5 2023-12-07T21:09:17.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.161+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94467786880192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee12240 con 0x7f0f5005ca90 2023-12-07T21:09:17.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.162+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94467786880192] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.162+0000 7f0f5dd26800 20 remove_watcher() i=6 2023-12-07T21:09:17.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.162+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94467786882896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55eafee12240 con 0x7f0f5005ca90 2023-12-07T21:09:17.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5a286640 1 -- 172.21.15.121:0/1318197498 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94467786882896] v31'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0f5402e9d0 con 0x7f0f5005ca90 2023-12-07T21:09:17.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 20 remove_watcher() i=7 2023-12-07T21:09:17.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0f5005ca90 msgr2=0x7f0f500673d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0f5005ca90 0x7f0f500673d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55eafee04e30 msgr2=0x55eafee072f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55eafee04e30 0x55eafee072f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0f4c04b1c0 msgr2=0x7f0f4c04b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0f4c04b1c0 0x7f0f4c04b5c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55eafee0ac10 msgr2=0x55eafee0d000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55eafee0ac10 0x55eafee0d000 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0f34036110 msgr2=0x7f0f340385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0f34036110 0x7f0f340385d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0f50054000 tx=0x7f0f5004e000 comp rx=0 tx=0).stop 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 msgr2=0x55eafeddd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/1318197498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafedf0470 0x55eafeddd530 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400a930 tx=0x7f0f54003370 comp rx=0 tx=0).stop 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 reap_dead start 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 shutdown_connections 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f59284640 1 -- 172.21.15.121:0/1318197498 reap_dead start 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 >> 172.21.15.121:0/1318197498 conn(0x55eafed3b5d0 msgr2=0x55eafedea650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 shutdown_connections 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.163+0000 7f0f5dd26800 1 -- 172.21.15.121:0/1318197498 wait complete. 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.164+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4049525773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0f3c036110 msgr2=0x7f0f3c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.164+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/4049525773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0f3c036110 0x7f0f3c0385d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00dfb0 tx=0x7f0f4c0013e0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.164+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4049525773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 msgr2=0x55eafede4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.158 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.164+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/4049525773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafede4220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00b210 tx=0x7f0f4c000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.164+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4049525773 shutdown_connections 2023-12-07T21:09:17.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.164+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/4049525773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0f3c036110 0x7f0f3c0385d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.164+0000 7f0f5dd26800 1 --2- 172.21.15.121:0/4049525773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55eafed386d0 0x55eafede4220 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.164+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4049525773 >> 172.21.15.121:0/4049525773 conn(0x55eafed31f60 msgr2=0x55eafedda980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.164+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4049525773 shutdown_connections 2023-12-07T21:09:17.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.164+0000 7f0f5dd26800 1 -- 172.21.15.121:0/4049525773 wait complete. 2023-12-07T21:09:17.160 INFO:teuthology.orchestra.run.smithi121.stdout:{"key":"bucket:myfoo","ver":{"tag":"_lfBca3vGcwXYXlztZ5NfSjG","ver":2},"mtime":"2023-12-07T21:09:16.935666Z","data":{"bucket":{"name":"myfoo","marker":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","bucket_id":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2023-12-07T21:09:15.863874Z","linked":false,"has_bucket_info":false}} 2023-12-07T21:09:17.160 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_lfBca3vGcwXYXlztZ5NfSjG', 'ver': 2}, 'mtime': '2023-12-07T21:09:16.935666Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'bucket_id': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2023-12-07T21:09:15.863874Z', 'linked': False, 'has_bucket_info': False}} 2023-12-07T21:09:17.160 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1'] 2023-12-07T21:09:17.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1'] 2023-12-07T21:09:17.160 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:17.245 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:17.246 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:17.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.252+0000 7f2927b40800 1 Processor -- start 2023-12-07T21:09:17.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.252+0000 7f2927b40800 1 -- start start 2023-12-07T21:09:17.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.253+0000 7f2927b40800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5634adff68c0 0x5634adff8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.253+0000 7f2927b40800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5634adf3c740 con 0x5634adf64af0 2023-12-07T21:09:17.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.253+0000 7f2927b40800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5634adf05880 con 0x5634adff68c0 2023-12-07T21:09:17.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.253+0000 7f2923102640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5634adff68c0 0x5634adff8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.253+0000 7f2923903640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5634adf64af0 0x5634adff51a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55806/0 (socket says 172.21.15.121:55806) 2023-12-07T21:09:17.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.253+0000 7f2923903640 1 -- 172.21.15.121:0/1205064017 learned_addr learned my addr 172.21.15.121:0/1205064017 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:17.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.253+0000 7f2923102640 1 -- 172.21.15.121:0/1205064017 >> v1:172.21.15.89:6789/0 conn(0x5634adf64af0 legacy=0x5634adff51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.247 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.253+0000 7f2922901640 1 -- 172.21.15.121:0/1205064017 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800086420 0 0) 0x5634adf3c740 con 0x5634adf64af0 2023-12-07T21:09:17.248 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.253+0000 7f2923102640 1 -- 172.21.15.121:0/1205064017 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634adffa200 con 0x5634adff68c0 2023-12-07T21:09:17.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.255+0000 7f2923102640 1 --2- 172.21.15.121:0/1205064017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adff68c0 0x5634adff8cb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f291800a470 tx=0x7f291801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e492ecc641a57fd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.255+0000 7f2922901640 1 -- 172.21.15.121:0/1205064017 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2918052570 con 0x5634adff68c0 2023-12-07T21:09:17.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.255+0000 7f2922901640 1 -- 172.21.15.121:0/1205064017 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29180526d0 con 0x5634adff68c0 2023-12-07T21:09:17.249 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.255+0000 7f2922901640 1 -- 172.21.15.121:0/1205064017 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2918052990 con 0x5634adff68c0 2023-12-07T21:09:17.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.256+0000 7f2927b40800 1 -- 172.21.15.121:0/1205064017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adff68c0 msgr2=0x5634adff8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.256+0000 7f2927b40800 1 --2- 172.21.15.121:0/1205064017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adff68c0 0x5634adff8cb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f291800a470 tx=0x7f291801cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:17.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.256+0000 7f2927b40800 1 -- 172.21.15.121:0/1205064017 shutdown_connections 2023-12-07T21:09:17.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.256+0000 7f2927b40800 1 --2- 172.21.15.121:0/1205064017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adff68c0 0x5634adff8cb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.256+0000 7f2927b40800 1 -- 172.21.15.121:0/1205064017 >> 172.21.15.121:0/1205064017 conn(0x5634adfea820 msgr2=0x5634adfecc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.256+0000 7f2927b40800 1 -- 172.21.15.121:0/1205064017 shutdown_connections 2023-12-07T21:09:17.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.256+0000 7f2927b40800 1 -- 172.21.15.121:0/1205064017 wait complete. 2023-12-07T21:09:17.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.257+0000 7f2927b40800 1 Processor -- start 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.257+0000 7f2927b40800 1 -- start start 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.257+0000 7f2927b40800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae096ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.257+0000 7f2927b40800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634adf02db0 con 0x5634adf64af0 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.257+0000 7f2923903640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae096ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.257+0000 7f2923903640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae096ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54720/0 (socket says 172.21.15.121:54720) 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.257+0000 7f2923903640 1 -- 172.21.15.121:0/1856155323 learned_addr learned my addr 172.21.15.121:0/1856155323 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.257+0000 7f2923903640 1 -- 172.21.15.121:0/1856155323 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2918005d20 con 0x5634adf64af0 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2923903640 1 --2- 172.21.15.121:0/1856155323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae096ee0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f291400b210 tx=0x7f291400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f83649e587aa07b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2922100640 1 -- 172.21.15.121:0/1856155323 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2914014070 con 0x5634adf64af0 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2922100640 1 -- 172.21.15.121:0/1856155323 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291400d500 con 0x5634adf64af0 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2922100640 1 -- 172.21.15.121:0/1856155323 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291400d800 con 0x5634adf64af0 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2927b40800 1 -- 172.21.15.121:0/1856155323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 msgr2=0x5634ae096ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2927b40800 1 --2- 172.21.15.121:0/1856155323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae096ee0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f291400b210 tx=0x7f291400b6d0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2927b40800 1 -- 172.21.15.121:0/1856155323 shutdown_connections 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2927b40800 1 --2- 172.21.15.121:0/1856155323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae096ee0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2927b40800 1 -- 172.21.15.121:0/1856155323 >> 172.21.15.121:0/1856155323 conn(0x5634adfea820 msgr2=0x5634ae092b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2927b40800 1 -- 172.21.15.121:0/1856155323 shutdown_connections 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2927b40800 1 -- 172.21.15.121:0/1856155323 wait complete. 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.258+0000 7f2927b40800 1 Processor -- start 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.259+0000 7f2927b40800 1 -- start start 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.259+0000 7f2927b40800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae09e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.259+0000 7f2927b40800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634adefe6a0 con 0x5634adf64af0 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.259+0000 7f2923903640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae09e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.259+0000 7f2923903640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae09e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54736/0 (socket says 172.21.15.121:54736) 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.259+0000 7f2923903640 1 -- 172.21.15.121:0/2542322835 learned_addr learned my addr 172.21.15.121:0/2542322835 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.259+0000 7f2923903640 1 -- 172.21.15.121:0/2542322835 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914001b70 con 0x5634adf64af0 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.259+0000 7f2923903640 1 --2- 172.21.15.121:0/2542322835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae09e470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f291400b210 tx=0x7f2914000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.260+0000 7f29210fe640 1 -- 172.21.15.121:0/2542322835 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291400de30 con 0x5634adf64af0 2023-12-07T21:09:17.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.260+0000 7f29210fe640 1 -- 172.21.15.121:0/2542322835 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2914020070 con 0x5634adf64af0 2023-12-07T21:09:17.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.260+0000 7f2927b40800 1 -- 172.21.15.121:0/2542322835 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5634ae09e9b0 con 0x5634adf64af0 2023-12-07T21:09:17.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.260+0000 7f29210fe640 1 -- 172.21.15.121:0/2542322835 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291400fb00 con 0x5634adf64af0 2023-12-07T21:09:17.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.260+0000 7f2927b40800 1 -- 172.21.15.121:0/2542322835 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634ae09ee90 con 0x5634adf64af0 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.260+0000 7f2927b40800 1 Processor -- start 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.260+0000 7f2927b40800 1 -- start start 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.260+0000 7f2927b40800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 0x5634ae0aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.260+0000 7f2927b40800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634ade98890 con 0x5634ae0aa650 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.260+0000 7f29210fe640 1 -- 172.21.15.121:0/2542322835 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f291400d040 con 0x5634adf64af0 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2924104640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 0x5634ae0aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2924104640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 0x5634ae0aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54752/0 (socket says 172.21.15.121:54752) 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2924104640 1 -- 172.21.15.121:0/661236152 learned_addr learned my addr 172.21.15.121:0/661236152 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f29210fe640 1 --2- 172.21.15.121:0/2542322835 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2910036110 0x7f29100385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f29210fe640 1 -- 172.21.15.121:0/2542322835 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f291400a040 con 0x5634adf64af0 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2923903640 1 --2- 172.21.15.121:0/2542322835 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2910036110 0x7f29100385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2924104640 1 -- 172.21.15.121:0/661236152 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634ae0aafb0 con 0x5634ae0aa650 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2924104640 1 --2- 172.21.15.121:0/661236152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 0x5634ae0aaa70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f291c00a430 tx=0x7f291c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd5f1abfa864358 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f290affd640 1 -- 172.21.15.121:0/661236152 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291c001650 con 0x5634ae0aa650 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2923903640 1 --2- 172.21.15.121:0/2542322835 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2910036110 0x7f29100385d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f291401bfd0 tx=0x7f29140013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f290affd640 1 -- 172.21.15.121:0/661236152 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c0017d0 con 0x5634ae0aa650 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f290affd640 1 -- 172.21.15.121:0/661236152 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291c001ab0 con 0x5634ae0aa650 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2927b40800 1 -- 172.21.15.121:0/661236152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 msgr2=0x5634ae0aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2927b40800 1 --2- 172.21.15.121:0/661236152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 0x5634ae0aaa70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f291c00a430 tx=0x7f291c00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2927b40800 1 -- 172.21.15.121:0/661236152 shutdown_connections 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2927b40800 1 --2- 172.21.15.121:0/661236152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 0x5634ae0aaa70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.261+0000 7f2927b40800 1 -- 172.21.15.121:0/661236152 >> 172.21.15.121:0/661236152 conn(0x5634adff68c0 msgr2=0x5634ae0a5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.262+0000 7f2927b40800 1 -- 172.21.15.121:0/661236152 shutdown_connections 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.262+0000 7f2927b40800 1 -- 172.21.15.121:0/661236152 wait complete. 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.262+0000 7f2927b40800 1 Processor -- start 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.262+0000 7f2927b40800 1 -- start start 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.262+0000 7f2927b40800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 0x5634ae0b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.262+0000 7f2927b40800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634ade98530 con 0x5634ae0aa650 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.262+0000 7f2924104640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 0x5634ae0b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.262+0000 7f2924104640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 0x5634ae0b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54760/0 (socket says 172.21.15.121:54760) 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.262+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 learned_addr learned my addr 172.21.15.121:0/2459581810 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.262+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c00a0e0 con 0x5634ae0aa650 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.263+0000 7f2924104640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 0x5634ae0b16c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f291c00a930 tx=0x7f291c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.263+0000 7f29097fa640 1 -- 172.21.15.121:0/2459581810 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291c010900 con 0x5634ae0aa650 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.263+0000 7f29097fa640 1 -- 172.21.15.121:0/2459581810 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c010a60 con 0x5634ae0aa650 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.263+0000 7f29097fa640 1 -- 172.21.15.121:0/2459581810 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291c010d20 con 0x5634ae0aa650 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.263+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5634ae0b1c00 con 0x5634ae0aa650 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.263+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634ae0b2060 con 0x5634ae0aa650 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.263+0000 7f29097fa640 1 -- 172.21.15.121:0/2459581810 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f291c017030 con 0x5634ae0aa650 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.264+0000 7f29097fa640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f28fc036110 0x7f28fc0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.264+0000 7f29097fa640 1 -- 172.21.15.121:0/2459581810 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f291c04b850 con 0x5634ae0aa650 2023-12-07T21:09:17.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.264+0000 7f2923102640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f28fc036110 0x7f28fc0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.264+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.264+0000 7f2927b40800 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5634ae0bce10 0x5634ae0bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.264+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0bfa20 con 0x5634ae0bce10 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.264+0000 7f2923102640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f28fc036110 0x7f28fc0385d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f291800a470 tx=0x7f291804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.264+0000 7f2924104640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5634ae0bce10 0x5634ae0bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2924104640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5634ae0bce10 0x5634ae0bf2d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 20 realm 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0bfe30 con 0x5634ae0bce10 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:17.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c06b0 con 0x5634ae0bce10 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c0a10 con 0x5634ae0bce10 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.265+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c1210 con 0x5634ae0bce10 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.266+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.266+0000 7f2927b40800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.266+0000 7f2927b40800 20 searching for the correct realm 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.266+0000 7f2927b40800 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5634ae0c2f30 0x5634ae0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.266+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0c2f30 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.266+0000 7f2923903640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5634ae0c2f30 0x5634ae0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.266+0000 7f2923903640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5634ae0c2f30 0x5634ae0c53c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.266+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2914016070 con 0x5634ae0c2f30 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.266+0000 7f2923903640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f2914018c20 0x7f2914006250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.266+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f2914018c20 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.267+0000 7f2923102640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f2914018c20 0x7f2914006250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.267+0000 7f2923102640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f2914018c20 0x7f2914006250 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.267+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29180528c0 con 0x7f2914018c20 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.267+0000 7f2923102640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f291805ca90 0x7f2918009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.267+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f291805ca90 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.267+0000 7f2924104640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f291805ca90 0x7f2918009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.268+0000 7f2924104640 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f291805ca90 0x7f2918009410 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.268+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.268+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0bce10 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.268+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.268+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0bce10 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.268+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.268+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f291805ca90 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.269+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.269+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f291805ca90 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.269+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.269+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f2914018c20 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.269+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29180528c0 con 0x7f2914018c20 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.269+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0c2f30 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.269+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2914016070 con 0x5634ae0c2f30 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.269+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0bce10 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.269+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.269+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f291805ca90 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.270+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.270+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0bce10 2023-12-07T21:09:17.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.270+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.271 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.270+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f2914018c20 2023-12-07T21:09:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.270+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f29180528c0 con 0x7f2914018c20 2023-12-07T21:09:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.270+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0c2f30 2023-12-07T21:09:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.270+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2914016070 con 0x5634ae0c2f30 2023-12-07T21:09:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.270+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0c2f30 2023-12-07T21:09:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.271+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2914016070 con 0x5634ae0c2f30 2023-12-07T21:09:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.271+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f291805ca90 2023-12-07T21:09:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.271+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.271+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0c2f30 2023-12-07T21:09:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.271+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2914048040 con 0x5634ae0c2f30 2023-12-07T21:09:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.271+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0c2f30 2023-12-07T21:09:17.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.271+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2914048040 con 0x5634ae0c2f30 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.271+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0bce10 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.272+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.272+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0bce10 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.272+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.272+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f291805ca90 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.272+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.272+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0c2f30 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.272+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2914048040 con 0x5634ae0c2f30 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.272+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f2914018c20 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.273+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29180528c0 con 0x7f2914018c20 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.273+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0bce10 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.273+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.273+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f291805ca90 2023-12-07T21:09:17.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.273+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.273+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0c2f30 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.273+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2914048040 con 0x5634ae0c2f30 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.273+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f291805ca90 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.274+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.274+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f2914018c20 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.274+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29180528c0 con 0x7f2914018c20 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.274+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0c2f30 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.274+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2914048040 con 0x5634ae0c2f30 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.274+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x7f291805ca90 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5a90 con 0x5634ae0bce10 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f291c053080 con 0x7f2914018c20 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2927b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:17.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2927b40800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2927b40800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2927b40800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2927b40800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2927b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.275+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c1b40 con 0x5634ae0bce10 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c17c0 con 0x5634ae0bce10 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c2410 con 0x5634ae0c2f30 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2914048040 con 0x5634ae0c2f30 2023-12-07T21:09:17.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 20 zone default found 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 4 Realm: () 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 20 zonegroup default 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.276+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c5ed0 con 0x7f291805ca90 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2927b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c7d50 con 0x5634ae0c2f30 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2914057040 con 0x5634ae0c2f30 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2927b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c80b0 con 0x5634ae0c2f30 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2914057040 con 0x5634ae0c2f30 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2927b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2927b40800 20 started sync module instance, tier type = 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2927b40800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.277+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c7320 con 0x7f2914018c20 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.278+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.278+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94784255917904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c7700 con 0x7f2914018c20 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.278+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c88b0 con 0x5634ae0bce10 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.279+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94784255917904] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.280+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.280+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94784258338432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c88b0 con 0x5634ae0bce10 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.280+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c9300 con 0x5634ae0c2f30 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.281+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94784258338432] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.281+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2914057040 con 0x5634ae0c2f30 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.281+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94784258343952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c8820 con 0x5634ae0c2f30 2023-12-07T21:09:17.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.281+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c9ff0 con 0x7f2914018c20 2023-12-07T21:09:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.282+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.282+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94784258352032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0cac50 con 0x7f2914018c20 2023-12-07T21:09:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.282+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0cb5c0 con 0x5634ae0bce10 2023-12-07T21:09:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.282+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94784258343952] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2914057040 con 0x5634ae0c2f30 2023-12-07T21:09:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.283+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.283+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94784258355488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0cb530 con 0x5634ae0bce10 2023-12-07T21:09:17.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.283+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0cc2b0 con 0x7f291805ca90 2023-12-07T21:09:17.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.285+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.285+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94784258352032] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.286+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94784258355488] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.286+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94784258353072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0cbdc0 con 0x7f291805ca90 2023-12-07T21:09:17.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.286+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0ccb00 con 0x7f291805ca90 2023-12-07T21:09:17.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.286+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94784258353072] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.286+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.286+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94784258357536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0cbd30 con 0x7f291805ca90 2023-12-07T21:09:17.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.286+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0ccfa0 con 0x7f291805ca90 2023-12-07T21:09:17.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.287+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.287+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94784258362112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0cd3b0 con 0x7f291805ca90 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.287+0000 7f2927b40800 20 add_watcher() i=0 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.287+0000 7f2927b40800 20 add_watcher() i=1 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.287+0000 7f2927b40800 20 add_watcher() i=2 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.287+0000 7f2927b40800 20 add_watcher() i=3 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.287+0000 7f2927b40800 20 add_watcher() i=4 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.287+0000 7f2927b40800 20 add_watcher() i=5 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.287+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94784258357536] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.287+0000 7f2927b40800 20 add_watcher() i=6 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.288+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94784258362112] v31'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.288+0000 7f2927b40800 20 add_watcher() i=7 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.288+0000 7f2927b40800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.288+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0cd3b0 con 0x5634ae0bce10 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.289+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.289+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94784258363152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0cd320 con 0x5634ae0bce10 2023-12-07T21:09:17.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94784258363152] v31'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f28e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f2927b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f2927b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f2927b40800 5 note: GC not initialized 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f28e8fe1640 20 reqs_thread_entry: start 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f2927b40800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f2927b40800 20 Filter name: none 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f28627fc640 20 reqs_thread_entry: start 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f2927b40800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.290+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae1032c0 con 0x7f291805ca90 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 20 rados_obj.operate() r=0 bl.length=346 2023-12-07T21:09:17.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae104d40 con 0x7f2914018c20 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv19 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 : miss 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.291+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae106870 con 0x7f2914018c20 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.292+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(64 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.292+0000 7f2927b40800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:17.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.292+0000 7f2927b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:17.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.292+0000 7f2927b40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:17.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.292+0000 7f2927b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:17.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.292+0000 7f2927b40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:17.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.292+0000 7f2927b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:17.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.292+0000 7f2927b40800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2023-12-07T21:09:17.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.292+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae10b070 con 0x7f2914018c20 2023-12-07T21:09:17.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.293+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(65 foo.buckets [call] v31'20 uv18 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.293+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae111070 con 0x7f2914018c20 2023-12-07T21:09:17.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(66 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'21 uv21 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2927b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:17.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2927b40800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:17.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2927b40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:17.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2927b40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1, ofs0, ns] 2023-12-07T21:09:17.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94784258600624 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae10b460 con 0x7f291805ca90 2023-12-07T21:09:17.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== watch-notify(notify (1) cookie 94784258353072 notify 133143986183 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x5634ae0b2060 con 0x7f291805ca90 2023-12-07T21:09:17.295 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f290affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94784258353072 notifier 4456 bl.length()=725 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(67 notify.5 [notify cookie 94784258600624 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f290affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f290affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f290affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f290affd640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f28f80042a0 con 0x7f291805ca90 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== watch-notify(notify_complete (2) cookie 94784258600624 notify 133143986183 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5634ae0b1c00 con 0x7f291805ca90 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2927b40800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_sources= new_sources= 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2927b40800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential sources added=[] removed=[] 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2927b40800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_dests= new_dests= 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2927b40800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential dests added=[] removed=[] 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.295+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae10fcc0 con 0x7f291805ca90 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.297+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(69 fud.buckets [call] v31'3 uv3 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.297+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae10b440 con 0x7f2914018c20 2023-12-07T21:09:17.296 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'22 uv22 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f2927b40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f2927b40800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f2927b40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94784258600624 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae10b440 con 0x7f291805ca90 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== watch-notify(notify (1) cookie 94784258357536 notify 133143986184 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x5634ae0b1c00 con 0x7f291805ca90 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f290affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94784258357536 notifier 4456 bl.length()=314 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f290affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f290affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(71 notify.6 [notify cookie 94784258600624 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f290affd640 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f28f8004600 con 0x7f291805ca90 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.298+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== watch-notify(notify_complete (2) cookie 94784258600624 notify 133143986184 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f291c00a0e0 con 0x7f291805ca90 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.299+0000 7f28e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.299+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94784258363152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae10b440 con 0x5634ae0bce10 2023-12-07T21:09:17.297 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.300+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94784258363152] v31'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.300+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94784255917904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae10b440 con 0x7f2914018c20 2023-12-07T21:09:17.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.301+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94784255917904] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.301+0000 7f2927b40800 20 remove_watcher() i=0 2023-12-07T21:09:17.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.301+0000 7f2927b40800 2 removed watcher, disabling cache 2023-12-07T21:09:17.298 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.301+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94784258338432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c1b40 con 0x5634ae0bce10 2023-12-07T21:09:17.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.302+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94784258338432] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.302+0000 7f2927b40800 20 remove_watcher() i=1 2023-12-07T21:09:17.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.302+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94784258343952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0ec180 con 0x5634ae0c2f30 2023-12-07T21:09:17.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.303+0000 7f2923903640 1 -- 172.21.15.121:0/2459581810 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94784258343952] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2914057040 con 0x5634ae0c2f30 2023-12-07T21:09:17.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.303+0000 7f2927b40800 20 remove_watcher() i=2 2023-12-07T21:09:17.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.303+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94784258352032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c1b00 con 0x7f2914018c20 2023-12-07T21:09:17.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.304+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94784258352032] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291806f040 con 0x7f2914018c20 2023-12-07T21:09:17.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.304+0000 7f2927b40800 20 remove_watcher() i=3 2023-12-07T21:09:17.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.304+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94784258355488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c1b00 con 0x5634ae0bce10 2023-12-07T21:09:17.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.305+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94784258355488] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x5634ae0bce10 2023-12-07T21:09:17.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.305+0000 7f2927b40800 20 remove_watcher() i=4 2023-12-07T21:09:17.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.305+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94784258353072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c1b00 con 0x7f291805ca90 2023-12-07T21:09:17.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.306+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94784258353072] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.306+0000 7f2927b40800 20 remove_watcher() i=5 2023-12-07T21:09:17.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.306+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94784258357536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c1b00 con 0x7f291805ca90 2023-12-07T21:09:17.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.307+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94784258357536] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.307+0000 7f2927b40800 20 remove_watcher() i=6 2023-12-07T21:09:17.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.307+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94784258362112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5634ae0c1b00 con 0x7f291805ca90 2023-12-07T21:09:17.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2924104640 1 -- 172.21.15.121:0/2459581810 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94784258362112] v31'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c02e9d0 con 0x7f291805ca90 2023-12-07T21:09:17.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 20 remove_watcher() i=7 2023-12-07T21:09:17.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f291805ca90 msgr2=0x7f2918009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f291805ca90 0x7f2918009410 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5634ae0bce10 msgr2=0x5634ae0bf2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5634ae0bce10 0x5634ae0bf2d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f2914018c20 msgr2=0x7f2914006250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f2914018c20 0x7f2914006250 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5634ae0c2f30 msgr2=0x5634ae0c53c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5634ae0c2f30 0x5634ae0c53c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f28fc036110 msgr2=0x7f28fc0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f28fc036110 0x7f28fc0385d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f291800a470 tx=0x7f291804e000 comp rx=0 tx=0).stop 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 msgr2=0x5634ae0b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 --2- 172.21.15.121:0/2459581810 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634ae0aa650 0x5634ae0b16c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f291c00a930 tx=0x7f291c003370 comp rx=0 tx=0).stop 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 reap_dead start 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2923102640 1 -- 172.21.15.121:0/2459581810 reap_dead start 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 shutdown_connections 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.308+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 >> 172.21.15.121:0/2459581810 conn(0x5634adff68c0 msgr2=0x5634ae0a4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 shutdown_connections 2023-12-07T21:09:17.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 -- 172.21.15.121:0/2459581810 wait complete. 2023-12-07T21:09:17.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 -- 172.21.15.121:0/2542322835 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2910036110 msgr2=0x7f29100385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 --2- 172.21.15.121:0/2542322835 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2910036110 0x7f29100385d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f291401bfd0 tx=0x7f29140013e0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 -- 172.21.15.121:0/2542322835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 msgr2=0x5634ae09e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 --2- 172.21.15.121:0/2542322835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae09e470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f291400b210 tx=0x7f2914000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 -- 172.21.15.121:0/2542322835 shutdown_connections 2023-12-07T21:09:17.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 --2- 172.21.15.121:0/2542322835 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2910036110 0x7f29100385d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 --2- 172.21.15.121:0/2542322835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5634adf64af0 0x5634ae09e470 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 -- 172.21.15.121:0/2542322835 >> 172.21.15.121:0/2542322835 conn(0x5634adfea820 msgr2=0x5634ae095bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 -- 172.21.15.121:0/2542322835 shutdown_connections 2023-12-07T21:09:17.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.309+0000 7f2927b40800 1 -- 172.21.15.121:0/2542322835 wait complete. 2023-12-07T21:09:17.306 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2023-12-07T21:09:17.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2023-12-07T21:09:17.306 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2023-12-07T21:09:17.348 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:17.348 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:17.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.355+0000 7f98d962d800 1 Processor -- start 2023-12-07T21:09:17.349 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.355+0000 7f98d962d800 1 -- start start 2023-12-07T21:09:17.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.355+0000 7f98d962d800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5588b65f6650 0x5588b65f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.355+0000 7f98d962d800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5588b653f7a0 con 0x5588b65f3700 2023-12-07T21:09:17.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.355+0000 7f98d962d800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5588b6508880 con 0x5588b65f6650 2023-12-07T21:09:17.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.356+0000 7f98d48fa640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5588b65f3700 0x5588b65f3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55820/0 (socket says 172.21.15.121:55820) 2023-12-07T21:09:17.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.356+0000 7f98d48fa640 1 -- 172.21.15.121:0/2918600825 learned_addr learned my addr 172.21.15.121:0/2918600825 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:17.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.356+0000 7f98cffff640 1 --2- 172.21.15.121:0/2918600825 >> v2:172.21.15.89:3300/0 conn(0x5588b65f6650 0x5588b65f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.356+0000 7f98cffff640 1 -- 172.21.15.121:0/2918600825 >> v1:172.21.15.89:6789/0 conn(0x5588b65f3700 legacy=0x5588b65f3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.350 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.356+0000 7f98cffff640 1 -- 172.21.15.121:0/2918600825 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588b65f9fc0 con 0x5588b65f6650 2023-12-07T21:09:17.351 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.356+0000 7f98cf7fe640 1 -- 172.21.15.121:0/2918600825 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580504349 0 0) 0x5588b653f7a0 con 0x5588b65f3700 2023-12-07T21:09:17.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.358+0000 7f98cffff640 1 --2- 172.21.15.121:0/2918600825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f6650 0x5588b65f8a40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f98c000a470 tx=0x7f98c001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa0756820798d86 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.358+0000 7f98cf7fe640 1 -- 172.21.15.121:0/2918600825 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98c0052570 con 0x5588b65f6650 2023-12-07T21:09:17.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.358+0000 7f98cf7fe640 1 -- 172.21.15.121:0/2918600825 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c00526d0 con 0x5588b65f6650 2023-12-07T21:09:17.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.358+0000 7f98cf7fe640 1 -- 172.21.15.121:0/2918600825 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98c0052990 con 0x5588b65f6650 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.358+0000 7f98d962d800 1 -- 172.21.15.121:0/2918600825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f6650 msgr2=0x5588b65f8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.358+0000 7f98d962d800 1 --2- 172.21.15.121:0/2918600825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f6650 0x5588b65f8a40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f98c000a470 tx=0x7f98c001cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.358+0000 7f98d962d800 1 -- 172.21.15.121:0/2918600825 shutdown_connections 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.358+0000 7f98d962d800 1 --2- 172.21.15.121:0/2918600825 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f6650 0x5588b65f8a40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.358+0000 7f98d962d800 1 -- 172.21.15.121:0/2918600825 >> 172.21.15.121:0/2918600825 conn(0x5588b65ecf60 msgr2=0x5588b65ef380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.359+0000 7f98d962d800 1 -- 172.21.15.121:0/2918600825 shutdown_connections 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.359+0000 7f98d962d800 1 -- 172.21.15.121:0/2918600825 wait complete. 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.359+0000 7f98d962d800 1 Processor -- start 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.359+0000 7f98d962d800 1 -- start start 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.359+0000 7f98d962d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b6696c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.359+0000 7f98d962d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588b6505db0 con 0x5588b65f3700 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.360+0000 7f98d48fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b6696c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.360+0000 7f98d48fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b6696c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54772/0 (socket says 172.21.15.121:54772) 2023-12-07T21:09:17.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.360+0000 7f98d48fa640 1 -- 172.21.15.121:0/4111909977 learned_addr learned my addr 172.21.15.121:0/4111909977 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.360+0000 7f98d48fa640 1 -- 172.21.15.121:0/4111909977 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c0005d20 con 0x5588b65f3700 2023-12-07T21:09:17.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.360+0000 7f98d48fa640 1 --2- 172.21.15.121:0/4111909977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b6696c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f98c800b240 tx=0x7f98c800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa82e18f43441c6d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.360+0000 7f98ceffd640 1 -- 172.21.15.121:0/4111909977 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98c8014070 con 0x5588b65f3700 2023-12-07T21:09:17.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.360+0000 7f98ceffd640 1 -- 172.21.15.121:0/4111909977 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c800d500 con 0x5588b65f3700 2023-12-07T21:09:17.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.360+0000 7f98ceffd640 1 -- 172.21.15.121:0/4111909977 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98c800d820 con 0x5588b65f3700 2023-12-07T21:09:17.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d962d800 1 -- 172.21.15.121:0/4111909977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 msgr2=0x5588b6696c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d962d800 1 --2- 172.21.15.121:0/4111909977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b6696c40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f98c800b240 tx=0x7f98c800b700 comp rx=0 tx=0).stop 2023-12-07T21:09:17.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d962d800 1 -- 172.21.15.121:0/4111909977 shutdown_connections 2023-12-07T21:09:17.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d962d800 1 --2- 172.21.15.121:0/4111909977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b6696c40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d962d800 1 -- 172.21.15.121:0/4111909977 >> 172.21.15.121:0/4111909977 conn(0x5588b65ecf60 msgr2=0x5588b66928b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d962d800 1 -- 172.21.15.121:0/4111909977 shutdown_connections 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d962d800 1 -- 172.21.15.121:0/4111909977 wait complete. 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d962d800 1 Processor -- start 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d962d800 1 -- start start 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d962d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b65f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d962d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588b65016a0 con 0x5588b65f3700 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d48fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b65f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d48fa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b65f1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54774/0 (socket says 172.21.15.121:54774) 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.361+0000 7f98d48fa640 1 -- 172.21.15.121:0/3589923475 learned_addr learned my addr 172.21.15.121:0/3589923475 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.362+0000 7f98d48fa640 1 -- 172.21.15.121:0/3589923475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8001ba0 con 0x5588b65f3700 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.362+0000 7f98d48fa640 1 --2- 172.21.15.121:0/3589923475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b65f1e60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x5588b6693330 tx=0x7f98c8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.362+0000 7f98cdffb640 1 -- 172.21.15.121:0/3589923475 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98c800de10 con 0x5588b65f3700 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.362+0000 7f98cdffb640 1 -- 172.21.15.121:0/3589923475 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c8020070 con 0x5588b65f3700 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.362+0000 7f98d962d800 1 -- 172.21.15.121:0/3589923475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588b66a1e10 con 0x5588b65f3700 2023-12-07T21:09:17.361 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.362+0000 7f98cdffb640 1 -- 172.21.15.121:0/3589923475 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98c800fc10 con 0x5588b65f3700 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.362+0000 7f98d962d800 1 -- 172.21.15.121:0/3589923475 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588b66a22f0 con 0x5588b65f3700 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98d962d800 1 Processor -- start 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98d962d800 1 -- start start 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98d962d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 0x5588b669dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98cdffb640 1 -- 172.21.15.121:0/3589923475 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f98c800d040 con 0x5588b65f3700 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98d962d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588b649b890 con 0x5588b669f890 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98d50fb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 0x5588b669dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98d50fb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 0x5588b669dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54778/0 (socket says 172.21.15.121:54778) 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98d50fb640 1 -- 172.21.15.121:0/4065622824 learned_addr learned my addr 172.21.15.121:0/4065622824 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98cdffb640 1 --2- 172.21.15.121:0/3589923475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f98b80360c0 0x7f98b8038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98cdffb640 1 -- 172.21.15.121:0/3589923475 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f98c800a040 con 0x5588b65f3700 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98d48fa640 1 --2- 172.21.15.121:0/3589923475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f98b80360c0 0x7f98b8038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98d50fb640 1 -- 172.21.15.121:0/4065622824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588b669e320 con 0x5588b669f890 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98d50fb640 1 --2- 172.21.15.121:0/4065622824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 0x5588b669dde0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f98d000a430 tx=0x7f98d000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f2de61f6021e1f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.362 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98d48fa640 1 --2- 172.21.15.121:0/3589923475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f98b80360c0 0x7f98b8038580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f98c8001600 tx=0x7f98c8049040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98bf7fe640 1 -- 172.21.15.121:0/4065622824 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98d0001650 con 0x5588b669f890 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98bf7fe640 1 -- 172.21.15.121:0/4065622824 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d00017d0 con 0x5588b669f890 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.363+0000 7f98bf7fe640 1 -- 172.21.15.121:0/4065622824 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98d0001ab0 con 0x5588b669f890 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d962d800 1 -- 172.21.15.121:0/4065622824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 msgr2=0x5588b669dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d962d800 1 --2- 172.21.15.121:0/4065622824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 0x5588b669dde0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f98d000a430 tx=0x7f98d000a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d962d800 1 -- 172.21.15.121:0/4065622824 shutdown_connections 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d962d800 1 --2- 172.21.15.121:0/4065622824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 0x5588b669dde0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d962d800 1 -- 172.21.15.121:0/4065622824 >> 172.21.15.121:0/4065622824 conn(0x5588b65f6650 msgr2=0x5588b66a6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d962d800 1 -- 172.21.15.121:0/4065622824 shutdown_connections 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d962d800 1 -- 172.21.15.121:0/4065622824 wait complete. 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d962d800 1 Processor -- start 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d962d800 1 -- start start 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d962d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 0x5588b66b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d962d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588b649b530 con 0x5588b669f890 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.364+0000 7f98d50fb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 0x5588b66b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.365+0000 7f98d50fb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 0x5588b66b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54782/0 (socket says 172.21.15.121:54782) 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.365+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 learned_addr learned my addr 172.21.15.121:0/3356009304 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.365+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d000a0e0 con 0x5588b669f890 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.365+0000 7f98d50fb640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 0x5588b66b4710 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f98d000a930 tx=0x7f98d0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.365+0000 7f98bdffb640 1 -- 172.21.15.121:0/3356009304 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98d0010900 con 0x5588b669f890 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.365+0000 7f98bdffb640 1 -- 172.21.15.121:0/3356009304 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d0010a60 con 0x5588b669f890 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.365+0000 7f98bdffb640 1 -- 172.21.15.121:0/3356009304 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98d0010d20 con 0x5588b669f890 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.365+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588b66b4c50 con 0x5588b669f890 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.365+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588b66b50b0 con 0x5588b669f890 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.366+0000 7f98bdffb640 1 -- 172.21.15.121:0/3356009304 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f98d0017030 con 0x5588b669f890 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.366+0000 7f98bdffb640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f98ac036110 0x7f98ac0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.366+0000 7f98bdffb640 1 -- 172.21.15.121:0/3356009304 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f98d004b7a0 con 0x5588b669f890 2023-12-07T21:09:17.364 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.366+0000 7f98cffff640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f98ac036110 0x7f98ac0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.367+0000 7f98cffff640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f98ac036110 0x7f98ac0385d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f98c0054000 tx=0x7f98c004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.367+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.367+0000 7f98d962d800 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5588b66bfe90 0x5588b66c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.367+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c2aa0 con 0x5588b66bfe90 2023-12-07T21:09:17.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.367+0000 7f98d50fb640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5588b66bfe90 0x5588b66c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.367+0000 7f98d50fb640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5588b66bfe90 0x5588b66c2350 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.367+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.367+0000 7f98d962d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.367+0000 7f98d962d800 20 realm 2023-12-07T21:09:17.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.367+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.367+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c2eb0 con 0x5588b66bfe90 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c3730 con 0x5588b66bfe90 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c3a90 con 0x5588b66bfe90 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c4290 con 0x5588b66bfe90 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 20 searching for the correct realm 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5588b66c5fd0 0x5588b66c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.368+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66c5fd0 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.369+0000 7f98d48fa640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5588b66c5fd0 0x5588b66c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.369+0000 7f98d48fa640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5588b66c5fd0 0x5588b66c8490 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.369+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.369+0000 7f98d48fa640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f98c8046b20 0x7f98c800e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.369+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c8046b20 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.369+0000 7f98cffff640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f98c8046b20 0x7f98c800e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.369+0000 7f98cffff640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f98c8046b20 0x7f98c800e550 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.370+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.370+0000 7f98cffff640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f98c005ca90 0x7f98c00673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.370+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c005ca90 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.370+0000 7f98d50fb640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f98c005ca90 0x7f98c00673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.370+0000 7f98d50fb640 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f98c005ca90 0x7f98c00673d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.370+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.370+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66bfe90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.371+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.371+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66bfe90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.371+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.371+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c005ca90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.371+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.371+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c005ca90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.371+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.371+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c8046b20 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.372+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.372+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66c5fd0 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.372+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.372+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66bfe90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.372+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.372+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c005ca90 2023-12-07T21:09:17.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.372+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.372+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66bfe90 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.373+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.373+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c8046b20 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.373+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.373+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66c5fd0 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.373+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.373+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66c5fd0 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.373+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.373+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c005ca90 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.374+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.374+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66c5fd0 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.374+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.374+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66c5fd0 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.374+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.374+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66bfe90 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.374+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.374+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66bfe90 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.374+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.374+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c005ca90 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.375+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.375+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66c5fd0 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.375+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.375+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c8046b20 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.376+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.376+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66bfe90 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.376+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.376+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c005ca90 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.376+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.376+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66c5fd0 2023-12-07T21:09:17.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.376+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.376+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c005ca90 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.377+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.377+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c8046b20 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.377+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.377+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66c5fd0 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.377+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.377+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x7f98c005ca90 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.377+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.377+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8b60 con 0x5588b66bfe90 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f98d0053080 con 0x7f98c8046b20 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:17.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c4b90 con 0x5588b66bfe90 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c47e0 con 0x5588b66bfe90 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.378+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c5430 con 0x5588b66c5fd0 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:17.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 20 zone default found 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 4 Realm: () 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 20 zonegroup default 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66c8fa0 con 0x7f98c005ca90 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cae20 con 0x5588b66c5fd0 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cb180 con 0x5588b66c5fd0 2023-12-07T21:09:17.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.379+0000 7f98d962d800 20 started sync module instance, tier type = 2023-12-07T21:09:17.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.380+0000 7f98d962d800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:17.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.380+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66ca3f0 con 0x7f98c8046b20 2023-12-07T21:09:17.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.380+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.381+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94045662064464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66ca7d0 con 0x7f98c8046b20 2023-12-07T21:09:17.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.381+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cb980 con 0x5588b66bfe90 2023-12-07T21:09:17.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.381+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94045662064464] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.382+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.382+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94045664485200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cb980 con 0x5588b66bfe90 2023-12-07T21:09:17.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.382+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cc2f0 con 0x5588b66c5fd0 2023-12-07T21:09:17.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.383+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.383+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94045664493136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66ccb40 con 0x5588b66c5fd0 2023-12-07T21:09:17.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.383+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cd520 con 0x7f98c8046b20 2023-12-07T21:09:17.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.383+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94045664485200] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.384+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94045664493136] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.384+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.384+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94045664490720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cd900 con 0x7f98c8046b20 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.384+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66ce100 con 0x5588b66bfe90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.385+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.385+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94045664501104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66ce7c0 con 0x5588b66bfe90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.385+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94045664490720] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.385+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cd080 con 0x7f98c005ca90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.386+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.386+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94045664505200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66ce7c0 con 0x7f98c005ca90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.386+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cfc30 con 0x7f98c005ca90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.386+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94045664501104] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.387+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94045664505200] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.387+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.387+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94045664506240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cf790 con 0x7f98c005ca90 2023-12-07T21:09:17.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.387+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cff90 con 0x7f98c005ca90 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.388+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94045664506240] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.388+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.388+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94045664507792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66d0040 con 0x7f98c005ca90 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.388+0000 7f98d962d800 20 add_watcher() i=0 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.388+0000 7f98d962d800 20 add_watcher() i=1 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.388+0000 7f98d962d800 20 add_watcher() i=2 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.388+0000 7f98d962d800 20 add_watcher() i=3 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.388+0000 7f98d962d800 20 add_watcher() i=4 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.388+0000 7f98d962d800 20 add_watcher() i=5 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.388+0000 7f98d962d800 20 add_watcher() i=6 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.389+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94045664507792] v31'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.389+0000 7f98d962d800 20 add_watcher() i=7 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.389+0000 7f98d962d800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:17.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.389+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66d3210 con 0x5588b66bfe90 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.389+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.389+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94045664509200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66d05c0 con 0x5588b66bfe90 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.390+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94045664509200] v31'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.390+0000 7f989afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.391+0000 7f98d962d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.391+0000 7f98d962d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.391+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66db830 con 0x5588b66bfe90 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.392+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.392+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66dbc70 con 0x7f98c005ca90 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.393+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'14 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.393+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66dc0b0 con 0x5588b66c5fd0 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.394+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.394+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66dca80 con 0x5588b66bfe90 2023-12-07T21:09:17.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.395+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'113 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.395+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66d98b0 con 0x7f98c8046b20 2023-12-07T21:09:17.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.396+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'32 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.396+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66dd5f0 con 0x5588b66c5fd0 2023-12-07T21:09:17.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.397+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.397+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66ddb20 con 0x5588b66bfe90 2023-12-07T21:09:17.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.398+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.398+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66ddb20 con 0x7f98c005ca90 2023-12-07T21:09:17.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.399+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.399+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66ddb20 con 0x7f98c8046b20 2023-12-07T21:09:17.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.400+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.400+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66de4f0 con 0x5588b66c5fd0 2023-12-07T21:09:17.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.401+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.401+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66d8930 con 0x7f98c8046b20 2023-12-07T21:09:17.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.402+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'33 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.402+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66d8930 con 0x7f98c005ca90 2023-12-07T21:09:17.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.403+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.403+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66d8930 con 0x7f98c8046b20 2023-12-07T21:09:17.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.404+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.404+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df060 con 0x7f98c005ca90 2023-12-07T21:09:17.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.405+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'27 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.405+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df060 con 0x5588b66bfe90 2023-12-07T21:09:17.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.406+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'114 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.406+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df060 con 0x5588b66c5fd0 2023-12-07T21:09:17.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.408+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.408+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df060 con 0x7f98c8046b20 2023-12-07T21:09:17.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.408+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'34 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.409+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df060 con 0x5588b66c5fd0 2023-12-07T21:09:17.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.409+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.409+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df060 con 0x5588b66bfe90 2023-12-07T21:09:17.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.410+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.410+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df060 con 0x5588b66bfe90 2023-12-07T21:09:17.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.411+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'115 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.411+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df060 con 0x5588b66c5fd0 2023-12-07T21:09:17.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.412+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'27 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.412+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df060 con 0x7f98c8046b20 2023-12-07T21:09:17.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.414+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.414+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df0f0 con 0x5588b66c5fd0 2023-12-07T21:09:17.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.414+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.414+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df2c0 con 0x5588b66c5fd0 2023-12-07T21:09:17.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.415+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.415+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df2c0 con 0x5588b66c5fd0 2023-12-07T21:09:17.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.416+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.416+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df6e0 con 0x5588b66c5fd0 2023-12-07T21:09:17.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.417+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'22 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.417+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df6e0 con 0x7f98c005ca90 2023-12-07T21:09:17.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.418+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.418+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df6e0 con 0x5588b66c5fd0 2023-12-07T21:09:17.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.419+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.419+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df6e0 con 0x7f98c005ca90 2023-12-07T21:09:17.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.421+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'22 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.421+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df6e0 con 0x5588b66c5fd0 2023-12-07T21:09:17.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.422+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'28 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.422+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df6e0 con 0x7f98c005ca90 2023-12-07T21:09:17.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.424+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'28 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.424+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66df6e0 con 0x7f98c8046b20 2023-12-07T21:09:17.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.425+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.425+0000 7f9899fdb640 20 reqs_thread_entry: start 2023-12-07T21:09:17.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.425+0000 7f98d962d800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:17.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.425+0000 7f98d962d800 20 Filter name: none 2023-12-07T21:09:17.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.425+0000 7f980b7fe640 20 reqs_thread_entry: start 2023-12-07T21:09:17.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.425+0000 7f98d962d800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-12-07T21:09:17.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.425+0000 7f98d962d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.425+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b670a0d0 con 0x7f98c005ca90 2023-12-07T21:09:17.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.426+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.426+0000 7f98d962d800 20 rados_obj.operate() r=0 bl.length=346 2023-12-07T21:09:17.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.426+0000 7f98d962d800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-12-07T21:09:17.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.426+0000 7f98d962d800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:09:17.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.426+0000 7f98d962d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:17.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.426+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b670c510 con 0x7f98c005ca90 2023-12-07T21:09:17.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.426+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.421 INFO:teuthology.orchestra.run.smithi121.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2023-12-07T21:09:17.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.427+0000 7f989afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.427+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94045664509200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66dc5e0 con 0x5588b66bfe90 2023-12-07T21:09:17.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.428+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94045664509200] v31'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.428+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94045662064464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66dc5e0 con 0x7f98c8046b20 2023-12-07T21:09:17.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.429+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94045662064464] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.429+0000 7f98d962d800 20 remove_watcher() i=0 2023-12-07T21:09:17.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.429+0000 7f98d962d800 2 removed watcher, disabling cache 2023-12-07T21:09:17.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.429+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94045664485200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66dca80 con 0x5588b66bfe90 2023-12-07T21:09:17.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.430+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94045664485200] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.430+0000 7f98d962d800 20 remove_watcher() i=1 2023-12-07T21:09:17.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.430+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94045664493136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66dca80 con 0x5588b66c5fd0 2023-12-07T21:09:17.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.431+0000 7f98d48fa640 1 -- 172.21.15.121:0/3356009304 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94045664493136] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98c8016070 con 0x5588b66c5fd0 2023-12-07T21:09:17.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.431+0000 7f98d962d800 20 remove_watcher() i=2 2023-12-07T21:09:17.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.431+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94045664490720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66dca80 con 0x7f98c8046b20 2023-12-07T21:09:17.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.432+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94045664490720] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98c0052840 con 0x7f98c8046b20 2023-12-07T21:09:17.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.432+0000 7f98d962d800 20 remove_watcher() i=3 2023-12-07T21:09:17.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.432+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94045664501104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66dca80 con 0x5588b66bfe90 2023-12-07T21:09:17.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.433+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94045664501104] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x5588b66bfe90 2023-12-07T21:09:17.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.433+0000 7f98d962d800 20 remove_watcher() i=4 2023-12-07T21:09:17.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.433+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94045664505200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cdd70 con 0x7f98c005ca90 2023-12-07T21:09:17.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.434+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94045664505200] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.434+0000 7f98d962d800 20 remove_watcher() i=5 2023-12-07T21:09:17.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.434+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94045664506240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cdd70 con 0x7f98c005ca90 2023-12-07T21:09:17.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.435+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94045664506240] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.435+0000 7f98d962d800 20 remove_watcher() i=6 2023-12-07T21:09:17.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.435+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94045664507792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5588b66cf210 con 0x7f98c005ca90 2023-12-07T21:09:17.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d50fb640 1 -- 172.21.15.121:0/3356009304 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94045664507792] v31'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98d002e9d0 con 0x7f98c005ca90 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 20 remove_watcher() i=7 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f98c005ca90 msgr2=0x7f98c00673d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f98c005ca90 0x7f98c00673d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5588b66bfe90 msgr2=0x5588b66c2350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5588b66bfe90 0x5588b66c2350 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f98c8046b20 msgr2=0x7f98c800e550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f98c8046b20 0x7f98c800e550 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5588b66c5fd0 msgr2=0x5588b66c8490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5588b66c5fd0 0x5588b66c8490 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f98ac036110 msgr2=0x7f98ac0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f98ac036110 0x7f98ac0385d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f98c0054000 tx=0x7f98c004e000 comp rx=0 tx=0).stop 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 msgr2=0x5588b66b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 --2- 172.21.15.121:0/3356009304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b669f890 0x5588b66b4710 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f98d000a930 tx=0x7f98d0003370 comp rx=0 tx=0).stop 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 reap_dead start 2023-12-07T21:09:17.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98cffff640 1 -- 172.21.15.121:0/3356009304 reap_dead start 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 shutdown_connections 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 >> 172.21.15.121:0/3356009304 conn(0x5588b65f6650 msgr2=0x5588b66a5610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 shutdown_connections 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.436+0000 7f98d962d800 1 -- 172.21.15.121:0/3356009304 wait complete. 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.437+0000 7f98d962d800 1 -- 172.21.15.121:0/3589923475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f98b80360c0 msgr2=0x7f98b8038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.437+0000 7f98d962d800 1 --2- 172.21.15.121:0/3589923475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f98b80360c0 0x7f98b8038580 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f98c8001600 tx=0x7f98c8049040 comp rx=0 tx=0).stop 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.437+0000 7f98d962d800 1 -- 172.21.15.121:0/3589923475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 msgr2=0x5588b65f1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.437+0000 7f98d962d800 1 --2- 172.21.15.121:0/3589923475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b65f1e60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x5588b6693330 tx=0x7f98c8000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.437+0000 7f98d962d800 1 -- 172.21.15.121:0/3589923475 shutdown_connections 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.437+0000 7f98d962d800 1 --2- 172.21.15.121:0/3589923475 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f98b80360c0 0x7f98b8038580 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.437+0000 7f98d962d800 1 --2- 172.21.15.121:0/3589923475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588b65f3700 0x5588b65f1e60 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.437+0000 7f98d962d800 1 -- 172.21.15.121:0/3589923475 >> 172.21.15.121:0/3589923475 conn(0x5588b65ecf60 msgr2=0x5588b6695950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.437+0000 7f98d962d800 1 -- 172.21.15.121:0/3589923475 shutdown_connections 2023-12-07T21:09:17.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.437+0000 7f98d962d800 1 -- 172.21.15.121:0/3589923475 wait complete. 2023-12-07T21:09:17.434 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-12-07T21:09:17.434 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2023-12-07T21:09:17.434 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2023-12-07T21:09:17.435 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2023-12-07T21:09:17.519 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:17.519 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:17.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.526+0000 7fa0c1810800 1 Processor -- start 2023-12-07T21:09:17.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.526+0000 7fa0c1810800 1 -- start start 2023-12-07T21:09:17.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.526+0000 7fa0c1810800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f890d6b850 0x55f890d6bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.526+0000 7fa0c1810800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f890cb6740 con 0x55f890d6c1b0 2023-12-07T21:09:17.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.526+0000 7fa0c1810800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f890c7f880 con 0x55f890d6b850 2023-12-07T21:09:17.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.527+0000 7fa0bcf3c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f890d6b850 0x55f890d6bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.527+0000 7fa0bc73b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55f890d6c1b0 0x55f890d682d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55824/0 (socket says 172.21.15.121:55824) 2023-12-07T21:09:17.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.527+0000 7fa0bc73b640 1 -- 172.21.15.121:0/2288473336 learned_addr learned my addr 172.21.15.121:0/2288473336 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:17.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.527+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/2288473336 >> v1:172.21.15.89:6789/0 conn(0x55f890d6c1b0 legacy=0x55f890d682d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.527+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/2288473336 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f890d68b70 con 0x55f890d6b850 2023-12-07T21:09:17.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.529+0000 7fa0bcf3c640 1 --2- 172.21.15.121:0/2288473336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890d6bc70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac005fd0 tx=0x7fa0ac01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5331cc28881a55f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.529+0000 7fa0bbf3a640 1 -- 172.21.15.121:0/2288473336 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0ac052560 con 0x55f890d6b850 2023-12-07T21:09:17.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.529+0000 7fa0bbf3a640 1 -- 172.21.15.121:0/2288473336 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac0526c0 con 0x55f890d6b850 2023-12-07T21:09:17.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.529+0000 7fa0bbf3a640 1 -- 172.21.15.121:0/2288473336 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0ac0529e0 con 0x55f890d6b850 2023-12-07T21:09:17.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.529+0000 7fa0c1810800 1 -- 172.21.15.121:0/2288473336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 msgr2=0x55f890d6bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.529+0000 7fa0c1810800 1 --2- 172.21.15.121:0/2288473336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890d6bc70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac005fd0 tx=0x7fa0ac01cb90 comp rx=0 tx=0).stop 2023-12-07T21:09:17.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.529+0000 7fa0c1810800 1 -- 172.21.15.121:0/2288473336 shutdown_connections 2023-12-07T21:09:17.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.529+0000 7fa0c1810800 1 --2- 172.21.15.121:0/2288473336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890d6bc70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.529+0000 7fa0c1810800 1 -- 172.21.15.121:0/2288473336 >> 172.21.15.121:0/2288473336 conn(0x55f890d63f70 msgr2=0x55f890d66390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.529+0000 7fa0c1810800 1 -- 172.21.15.121:0/2288473336 shutdown_connections 2023-12-07T21:09:17.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.529+0000 7fa0c1810800 1 -- 172.21.15.121:0/2288473336 wait complete. 2023-12-07T21:09:17.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.530+0000 7fa0c1810800 1 Processor -- start 2023-12-07T21:09:17.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.530+0000 7fa0c1810800 1 -- start start 2023-12-07T21:09:17.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.530+0000 7fa0c1810800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e0f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.530+0000 7fa0c1810800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f890c7cdb0 con 0x55f890d6b850 2023-12-07T21:09:17.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.530+0000 7fa0bcf3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e0f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.530+0000 7fa0bcf3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e0f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54802/0 (socket says 172.21.15.121:54802) 2023-12-07T21:09:17.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.530+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/1775903073 learned_addr learned my addr 172.21.15.121:0/1775903073 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/1775903073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac00a100 con 0x55f890d6b850 2023-12-07T21:09:17.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0bcf3c640 1 --2- 172.21.15.121:0/1775903073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e0f340 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00a3f0 tx=0x7fa0ac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d11c04adcc1756 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0bb739640 1 -- 172.21.15.121:0/1775903073 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0ac052960 con 0x55f890d6b850 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0bb739640 1 -- 172.21.15.121:0/1775903073 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac052c10 con 0x55f890d6b850 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0bb739640 1 -- 172.21.15.121:0/1775903073 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0ac05c430 con 0x55f890d6b850 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0c1810800 1 -- 172.21.15.121:0/1775903073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 msgr2=0x55f890e0f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0c1810800 1 --2- 172.21.15.121:0/1775903073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e0f340 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00a3f0 tx=0x7fa0ac04c000 comp rx=0 tx=0).stop 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0c1810800 1 -- 172.21.15.121:0/1775903073 shutdown_connections 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0c1810800 1 --2- 172.21.15.121:0/1775903073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e0f340 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0c1810800 1 -- 172.21.15.121:0/1775903073 >> 172.21.15.121:0/1775903073 conn(0x55f890d63f70 msgr2=0x55f890e0afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0c1810800 1 -- 172.21.15.121:0/1775903073 shutdown_connections 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.531+0000 7fa0c1810800 1 -- 172.21.15.121:0/1775903073 wait complete. 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.532+0000 7fa0c1810800 1 Processor -- start 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.532+0000 7fa0c1810800 1 -- start start 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.532+0000 7fa0c1810800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e166b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.532+0000 7fa0c1810800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f890c786a0 con 0x55f890d6b850 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.532+0000 7fa0bcf3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e166b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.532+0000 7fa0bcf3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e166b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54816/0 (socket says 172.21.15.121:54816) 2023-12-07T21:09:17.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.532+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/2994663042 learned_addr learned my addr 172.21.15.121:0/2994663042 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.533+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/2994663042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f890d68b70 con 0x55f890d6b850 2023-12-07T21:09:17.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.533+0000 7fa0bcf3c640 1 --2- 172.21.15.121:0/2994663042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e166b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00a3f0 tx=0x7fa0ac003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.533+0000 7fa0ba737640 1 -- 172.21.15.121:0/2994663042 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0ac06b070 con 0x55f890d6b850 2023-12-07T21:09:17.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.533+0000 7fa0ba737640 1 -- 172.21.15.121:0/2994663042 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac05cb80 con 0x55f890d6b850 2023-12-07T21:09:17.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.533+0000 7fa0ba737640 1 -- 172.21.15.121:0/2994663042 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0ac05ce60 con 0x55f890d6b850 2023-12-07T21:09:17.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.533+0000 7fa0c1810800 1 -- 172.21.15.121:0/2994663042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f890e16bf0 con 0x55f890d6b850 2023-12-07T21:09:17.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.533+0000 7fa0c1810800 1 -- 172.21.15.121:0/2994663042 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f890e170d0 con 0x55f890d6b850 2023-12-07T21:09:17.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.533+0000 7fa0c1810800 1 Processor -- start 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.533+0000 7fa0c1810800 1 -- start start 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0c1810800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 0x55f890d69570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0c1810800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f890c12890 con 0x55f890d6b020 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0ba737640 1 -- 172.21.15.121:0/2994663042 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa0ac0663f0 con 0x55f890d6b850 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0bd73d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 0x55f890d69570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0bd73d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 0x55f890d69570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54820/0 (socket says 172.21.15.121:54820) 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0bd73d640 1 -- 172.21.15.121:0/439713765 learned_addr learned my addr 172.21.15.121:0/439713765 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0ba737640 1 --2- 172.21.15.121:0/2994663042 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa0a8036070 0x7fa0a8038530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0ba737640 1 -- 172.21.15.121:0/2994663042 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fa0ac08d390 con 0x55f890d6b850 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0bcf3c640 1 --2- 172.21.15.121:0/2994663042 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa0a8036070 0x7fa0a8038530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0bd73d640 1 -- 172.21.15.121:0/439713765 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f890d69ab0 con 0x55f890d6b020 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0bd73d640 1 --2- 172.21.15.121:0/439713765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 0x55f890d69570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400a400 tx=0x7fa0b400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8d386942b2a9ca server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0bcf3c640 1 --2- 172.21.15.121:0/2994663042 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa0a8036070 0x7fa0a8038530 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac076aa0 tx=0x7fa0ac0769d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0a3fff640 1 -- 172.21.15.121:0/439713765 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0b40087e0 con 0x55f890d6b020 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0a3fff640 1 -- 172.21.15.121:0/439713765 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4008960 con 0x55f890d6b020 2023-12-07T21:09:17.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.534+0000 7fa0a3fff640 1 -- 172.21.15.121:0/439713765 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0b4008c80 con 0x55f890d6b020 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.535+0000 7fa0c1810800 1 -- 172.21.15.121:0/439713765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 msgr2=0x55f890d69570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.535+0000 7fa0c1810800 1 --2- 172.21.15.121:0/439713765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 0x55f890d69570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400a400 tx=0x7fa0b400a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.535+0000 7fa0c1810800 1 -- 172.21.15.121:0/439713765 shutdown_connections 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.535+0000 7fa0c1810800 1 --2- 172.21.15.121:0/439713765 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 0x55f890d69570 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.535+0000 7fa0c1810800 1 -- 172.21.15.121:0/439713765 >> 172.21.15.121:0/439713765 conn(0x55f890d6c1b0 msgr2=0x55f890e1dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.535+0000 7fa0c1810800 1 -- 172.21.15.121:0/439713765 shutdown_connections 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.535+0000 7fa0c1810800 1 -- 172.21.15.121:0/439713765 wait complete. 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.535+0000 7fa0c1810800 1 Processor -- start 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.535+0000 7fa0c1810800 1 -- start start 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.535+0000 7fa0c1810800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 0x55f890e2ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.535+0000 7fa0c1810800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f890c12530 con 0x55f890d6b020 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.536+0000 7fa0bd73d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 0x55f890e2ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.536+0000 7fa0bd73d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 0x55f890e2ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54832/0 (socket says 172.21.15.121:54832) 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.536+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 learned_addr learned my addr 172.21.15.121:0/3361253177 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.536+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4005c90 con 0x55f890d6b020 2023-12-07T21:09:17.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.536+0000 7fa0bd73d640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 0x55f890e2ba50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c010 tx=0x7fa0b4002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.536+0000 7fa0a27fc640 1 -- 172.21.15.121:0/3361253177 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0b4013840 con 0x55f890d6b020 2023-12-07T21:09:17.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.536+0000 7fa0a27fc640 1 -- 172.21.15.121:0/3361253177 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b40139a0 con 0x55f890d6b020 2023-12-07T21:09:17.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.536+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f890e2bf90 con 0x55f890d6b020 2023-12-07T21:09:17.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.536+0000 7fa0a27fc640 1 -- 172.21.15.121:0/3361253177 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0b4013c80 con 0x55f890d6b020 2023-12-07T21:09:17.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.536+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f890e2c450 con 0x55f890d6b020 2023-12-07T21:09:17.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.537+0000 7fa0a27fc640 1 -- 172.21.15.121:0/3361253177 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa0b401e420 con 0x55f890d6b020 2023-12-07T21:09:17.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.537+0000 7fa0a27fc640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa0980360c0 0x7fa098038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.537+0000 7fa0a27fc640 1 -- 172.21.15.121:0/3361253177 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fa0b404b910 con 0x55f890d6b020 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.537+0000 7fa0bc73b640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa0980360c0 0x7fa098038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.537+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0c1810800 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f890e371a0 0x55f890e39660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e39db0 con 0x55f890e371a0 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0bc73b640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa0980360c0 0x7fa098038580 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0000f60 tx=0x7fa0b0001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0bd73d640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f890e371a0 0x55f890e39660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0bd73d640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f890e371a0 0x55f890e39660 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0c1810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0c1810800 20 realm 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3a1c0 con 0x55f890e371a0 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0c1810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0c1810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.538+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3aa40 con 0x55f890e371a0 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0c1810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3ada0 con 0x55f890e371a0 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0c1810800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3b5a0 con 0x55f890e371a0 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0c1810800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0c1810800 20 searching for the correct realm 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0c1810800 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f890e3d2c0 0x55f890e3f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3fe00 con 0x55f890e3d2c0 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.539+0000 7fa0bcf3c640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f890e3d2c0 0x55f890e3f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.540+0000 7fa0bcf3c640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f890e3d2c0 0x55f890e3f730 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.540+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0ac08d0d0 con 0x55f890e3d2c0 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.540+0000 7fa0bcf3c640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa0ac06e760 0x7fa0ac005050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.540+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3fe00 con 0x7fa0ac06e760 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.540+0000 7fa0bc73b640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa0ac06e760 0x7fa0ac005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.540+0000 7fa0bc73b640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa0ac06e760 0x7fa0ac005050 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.540+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b0006070 con 0x7fa0ac06e760 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.540+0000 7fa0bc73b640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa0b000d3d0 0x7fa0b000d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.541+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3fe00 con 0x7fa0b000d3d0 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.541+0000 7fa0bd73d640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa0b000d3d0 0x7fa0b000d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.541+0000 7fa0bd73d640 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa0b000d3d0 0x7fa0b000d830 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.541+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x7fa0b000d3d0 2023-12-07T21:09:17.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.541+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3fe00 con 0x55f890e371a0 2023-12-07T21:09:17.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.542+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.542+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3fe00 con 0x55f890e371a0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.542+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.542+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3fe00 con 0x7fa0b000d3d0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.542+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x7fa0b000d3d0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.542+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.542+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x7fa0b000d3d0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.542+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0ac06e760 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.542+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b0006070 con 0x7fa0ac06e760 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.542+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e3d2c0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.543+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.543+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e371a0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.543+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.543+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.543+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x7fa0b000d3d0 2023-12-07T21:09:17.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.543+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e371a0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.543+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.543+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0ac06e760 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.544+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa0b0006070 con 0x7fa0ac06e760 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.544+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e3d2c0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.544+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.544+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e3d2c0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.544+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.544+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.544+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x7fa0b000d3d0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.544+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e3d2c0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.545+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.545+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e3d2c0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.545+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.545+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e371a0 2023-12-07T21:09:17.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.545+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.545+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e371a0 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.545+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.545+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.546+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x7fa0b000d3d0 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.546+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e3d2c0 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.546+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.546+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0ac06e760 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.546+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b0006070 con 0x7fa0ac06e760 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.546+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e371a0 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.547+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4024070 con 0x55f890e371a0 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.547+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.547+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.547+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e3d2c0 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.547+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.547+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.547+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.547+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0ac06e760 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.548+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b0006070 con 0x7fa0ac06e760 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.548+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e3d2c0 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.548+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.548+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.548+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.548+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x55f890e371a0 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0b403e040 con 0x7fa0ac06e760 2023-12-07T21:09:17.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa0b0006070 con 0x7fa0ac06e760 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3bf00 con 0x55f890e371a0 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3c750 con 0x55f890e371a0 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.549+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e3c750 con 0x55f890e3d2c0 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 20 zone default found 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 4 Realm: () 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 20 zonegroup default 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e402a0 con 0x7fa0b000d3d0 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e42080 con 0x55f890e3d2c0 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e42410 con 0x55f890e3d2c0 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.550+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.551+0000 7fa0c1810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.551+0000 7fa0c1810800 20 started sync module instance, tier type = 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.551+0000 7fa0c1810800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.551+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e41960 con 0x7fa0ac06e760 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.552+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b0006070 con 0x7fa0ac06e760 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.552+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94526068694864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e41d10 con 0x7fa0ac06e760 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.552+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e42cb0 con 0x55f890e371a0 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.553+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94526068694864] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b0006070 con 0x7fa0ac06e760 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.553+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.553+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94526071116992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e42cf0 con 0x55f890e371a0 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.553+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e43740 con 0x55f890e3d2c0 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.554+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94526071116992] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.554+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.554+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94526071124544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e43b20 con 0x55f890e3d2c0 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.554+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e44490 con 0x7fa0ac06e760 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.555+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b0026040 con 0x7fa0ac06e760 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.555+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94526071130096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e450a0 con 0x7fa0ac06e760 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.555+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e45a10 con 0x55f890e371a0 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.555+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94526071124544] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.556+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.556+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94526071130096] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b0026040 con 0x7fa0ac06e760 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.556+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94526071121936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e45a10 con 0x55f890e371a0 2023-12-07T21:09:17.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.556+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e46260 con 0x7fa0b000d3d0 2023-12-07T21:09:17.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.557+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94526071121936] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.557+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.557+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94526071133824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e45f70 con 0x7fa0b000d3d0 2023-12-07T21:09:17.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.557+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e469f0 con 0x7fa0b000d3d0 2023-12-07T21:09:17.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.558+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94526071133824] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.558+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.558+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94526071137520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e469b0 con 0x7fa0b000d3d0 2023-12-07T21:09:17.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.558+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e47320 con 0x7fa0b000d3d0 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.559+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94526071137520] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.559+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.559+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94526071134864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e47320 con 0x7fa0b000d3d0 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.559+0000 7fa0c1810800 20 add_watcher() i=0 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.559+0000 7fa0c1810800 20 add_watcher() i=1 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.559+0000 7fa0c1810800 20 add_watcher() i=2 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.559+0000 7fa0c1810800 20 add_watcher() i=3 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.559+0000 7fa0c1810800 20 add_watcher() i=4 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.559+0000 7fa0c1810800 20 add_watcher() i=5 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.559+0000 7fa0c1810800 20 add_watcher() i=6 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.560+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94526071134864] v31'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.560+0000 7fa0c1810800 20 add_watcher() i=7 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.560+0000 7fa0c1810800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.560+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e4a710 con 0x55f890e371a0 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.561+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.561+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94526071140432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e47c20 con 0x55f890e371a0 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.562+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94526071140432] v31'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.562+0000 7fa082fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.562+0000 7fa0c1810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.562+0000 7fa0c1810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.562+0000 7fa0c1810800 5 note: GC not initialized 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.562+0000 7fa081fe3640 20 reqs_thread_entry: start 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.562+0000 7fa0c1810800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.562+0000 7fa0c1810800 20 Filter name: none 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7f9ff37fe640 20 reqs_thread_entry: start 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7fa0c1810800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e7d6f0 con 0x7fa0b000d3d0 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7fa0c1810800 20 rados_obj.operate() r=0 bl.length=346 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7fa0c1810800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7fa0c1810800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:09:17.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7fa0c1810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7fa0c1810800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.563+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e7f170 con 0x7fa0ac06e760 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv22 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fa0b0026040 con 0x7fa0ac06e760 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 : miss 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e80c90 con 0x7fa0ac06e760 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(64 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv21 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fa0b0026040 con 0x7fa0ac06e760 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:17.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.564+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e84570 con 0x7fa0b000d3d0 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.566+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(65 fud.buckets [call] v31'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.566+0000 7fa0c1810800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.566+0000 7fa0c1810800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.566+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e83520 con 0x7fa0ac06e760 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.566+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv22 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7fa0b0026040 con 0x7fa0ac06e760 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.566+0000 7fa0c1810800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.566+0000 7fa0c1810800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.566+0000 7fa0c1810800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.566+0000 7fa0c1810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.566+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e88970 con 0x7fa0ac06e760 2023-12-07T21:09:17.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.567+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'23 uv23 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7fa0b0026040 con 0x7fa0ac06e760 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.567+0000 7fa0c1810800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.567+0000 7fa0c1810800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.567+0000 7fa0c1810800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.568+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94526071389600 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e85f00 con 0x7fa0b000d3d0 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.568+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== watch-notify(notify (1) cookie 94526071137520 notify 133143986185 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x55f890e2c450 con 0x7fa0b000d3d0 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.568+0000 7fa0a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94526071137520 notifier 4468 bl.length()=338 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.568+0000 7fa0a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.568+0000 7fa0a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.568+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(68 notify.6 [notify cookie 94526071389600 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.568+0000 7fa0a3fff640 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fa0900042a0 con 0x7fa0b000d3d0 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.568+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.568+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== watch-notify(notify_complete (2) cookie 94526071389600 notify 133143986185 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f890e2bf90 con 0x7fa0b000d3d0 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.569+0000 7fa082fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.569+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94526071140432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e66650 con 0x55f890e371a0 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.570+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94526071140432] v31'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.570+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94526068694864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e82490 con 0x7fa0ac06e760 2023-12-07T21:09:17.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.571+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94526068694864] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b0026040 con 0x7fa0ac06e760 2023-12-07T21:09:17.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.571+0000 7fa0c1810800 20 remove_watcher() i=0 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.571+0000 7fa0c1810800 2 removed watcher, disabling cache 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.571+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94526071116992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e7f4d0 con 0x55f890e371a0 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.572+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94526071116992] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.572+0000 7fa0c1810800 20 remove_watcher() i=1 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.572+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94526071124544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e7f4d0 con 0x55f890e3d2c0 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.573+0000 7fa0bcf3c640 1 -- 172.21.15.121:0/3361253177 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94526071124544] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0ac066920 con 0x55f890e3d2c0 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.573+0000 7fa0c1810800 20 remove_watcher() i=2 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.573+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94526071130096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e7f830 con 0x7fa0ac06e760 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.574+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94526071130096] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b0026040 con 0x7fa0ac06e760 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.574+0000 7fa0c1810800 20 remove_watcher() i=3 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.574+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94526071121936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e7f830 con 0x55f890e371a0 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.575+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94526071121936] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x55f890e371a0 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.575+0000 7fa0c1810800 20 remove_watcher() i=4 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.575+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94526071133824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e42810 con 0x7fa0b000d3d0 2023-12-07T21:09:17.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.576+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94526071133824] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.576+0000 7fa0c1810800 20 remove_watcher() i=5 2023-12-07T21:09:17.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.576+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94526071137520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e42810 con 0x7fa0b000d3d0 2023-12-07T21:09:17.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.577+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94526071137520] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.577+0000 7fa0c1810800 20 remove_watcher() i=6 2023-12-07T21:09:17.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.577+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94526071134864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f890e464f0 con 0x7fa0b000d3d0 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0bd73d640 1 -- 172.21.15.121:0/3361253177 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94526071134864] v31'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa0b4053040 con 0x7fa0b000d3d0 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 20 remove_watcher() i=7 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa0b000d3d0 msgr2=0x7fa0b000d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa0b000d3d0 0x7fa0b000d830 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f890e371a0 msgr2=0x55f890e39660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f890e371a0 0x55f890e39660 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa0ac06e760 msgr2=0x7fa0ac005050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa0ac06e760 0x7fa0ac005050 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f890e3d2c0 msgr2=0x55f890e3f730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f890e3d2c0 0x55f890e3f730 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa0980360c0 msgr2=0x7fa098038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa0980360c0 0x7fa098038580 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0000f60 tx=0x7fa0b0001230 comp rx=0 tx=0).stop 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 msgr2=0x55f890e2ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 --2- 172.21.15.121:0/3361253177 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b020 0x55f890e2ba50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c010 tx=0x7fa0b4002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 reap_dead start 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0bc73b640 1 -- 172.21.15.121:0/3361253177 reap_dead start 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 shutdown_connections 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 >> 172.21.15.121:0/3361253177 conn(0x55f890d6c1b0 msgr2=0x55f890e1ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 shutdown_connections 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.578+0000 7fa0c1810800 1 -- 172.21.15.121:0/3361253177 wait complete. 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.579+0000 7fa0c1810800 1 -- 172.21.15.121:0/2994663042 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa0a8036070 msgr2=0x7fa0a8038530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.579+0000 7fa0c1810800 1 --2- 172.21.15.121:0/2994663042 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa0a8036070 0x7fa0a8038530 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac076aa0 tx=0x7fa0ac0769d0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.579+0000 7fa0c1810800 1 -- 172.21.15.121:0/2994663042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 msgr2=0x55f890e166b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.579+0000 7fa0c1810800 1 --2- 172.21.15.121:0/2994663042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e166b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00a3f0 tx=0x7fa0ac003330 comp rx=0 tx=0).stop 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.579+0000 7fa0c1810800 1 -- 172.21.15.121:0/2994663042 shutdown_connections 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.579+0000 7fa0c1810800 1 --2- 172.21.15.121:0/2994663042 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa0a8036070 0x7fa0a8038530 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.579+0000 7fa0c1810800 1 --2- 172.21.15.121:0/2994663042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f890d6b850 0x55f890e166b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.579+0000 7fa0c1810800 1 -- 172.21.15.121:0/2994663042 >> 172.21.15.121:0/2994663042 conn(0x55f890d63f70 msgr2=0x55f890e0e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.579+0000 7fa0c1810800 1 -- 172.21.15.121:0/2994663042 shutdown_connections 2023-12-07T21:09:17.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.579+0000 7fa0c1810800 1 -- 172.21.15.121:0/2994663042 wait complete. 2023-12-07T21:09:17.577 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1'] 2023-12-07T21:09:17.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1'] 2023-12-07T21:09:17.578 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:17.623 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:17.623 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:17.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.630+0000 7fac3b68c800 1 Processor -- start 2023-12-07T21:09:17.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.630+0000 7fac3b68c800 1 -- start start 2023-12-07T21:09:17.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.630+0000 7fac3b68c800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x564094baeae0 0x564094baef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.630+0000 7fac3b68c800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564094afc740 con 0x564094baf440 2023-12-07T21:09:17.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.630+0000 7fac3b68c800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x564094ac5880 con 0x564094baeae0 2023-12-07T21:09:17.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.631+0000 7fac3918c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x564094baeae0 0x564094baef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.631+0000 7fac3898b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x564094baf440 0x564094baf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55838/0 (socket says 172.21.15.121:55838) 2023-12-07T21:09:17.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.631+0000 7fac3898b640 1 -- 172.21.15.121:0/2286586958 learned_addr learned my addr 172.21.15.121:0/2286586958 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:17.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.631+0000 7fac3918c640 1 -- 172.21.15.121:0/2286586958 >> v1:172.21.15.89:6789/0 conn(0x564094baf440 legacy=0x564094baf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.631+0000 7fac3918c640 1 -- 172.21.15.121:0/2286586958 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564094b24500 con 0x564094baeae0 2023-12-07T21:09:17.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.633+0000 7fac3918c640 1 --2- 172.21.15.121:0/2286586958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094baef00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fac2c005fd0 tx=0x7fac2c01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c49ae9221a22efd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.633+0000 7fac2bfff640 1 -- 172.21.15.121:0/2286586958 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac2c052560 con 0x564094baeae0 2023-12-07T21:09:17.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.633+0000 7fac2bfff640 1 -- 172.21.15.121:0/2286586958 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c0526c0 con 0x564094baeae0 2023-12-07T21:09:17.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.633+0000 7fac2bfff640 1 -- 172.21.15.121:0/2286586958 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac2c0529e0 con 0x564094baeae0 2023-12-07T21:09:17.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.633+0000 7fac3b68c800 1 -- 172.21.15.121:0/2286586958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 msgr2=0x564094baef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.633+0000 7fac3b68c800 1 --2- 172.21.15.121:0/2286586958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094baef00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fac2c005fd0 tx=0x7fac2c01cb90 comp rx=0 tx=0).stop 2023-12-07T21:09:17.628 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.633+0000 7fac3b68c800 1 -- 172.21.15.121:0/2286586958 shutdown_connections 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.633+0000 7fac3b68c800 1 --2- 172.21.15.121:0/2286586958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094baef00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.633+0000 7fac3b68c800 1 -- 172.21.15.121:0/2286586958 >> 172.21.15.121:0/2286586958 conn(0x564094baa780 msgr2=0x564094bacba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.634+0000 7fac3b68c800 1 -- 172.21.15.121:0/2286586958 shutdown_connections 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.634+0000 7fac3b68c800 1 -- 172.21.15.121:0/2286586958 wait complete. 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.634+0000 7fac3b68c800 1 Processor -- start 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.634+0000 7fac3b68c800 1 -- start start 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.634+0000 7fac3b68c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c57080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.634+0000 7fac3b68c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564094ac2db0 con 0x564094baeae0 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.635+0000 7fac3918c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c57080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.635+0000 7fac3918c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c57080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54846/0 (socket says 172.21.15.121:54846) 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.635+0000 7fac3918c640 1 -- 172.21.15.121:0/1321433172 learned_addr learned my addr 172.21.15.121:0/1321433172 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.635+0000 7fac3918c640 1 -- 172.21.15.121:0/1321433172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c00a100 con 0x564094baeae0 2023-12-07T21:09:17.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.635+0000 7fac3918c640 1 --2- 172.21.15.121:0/1321433172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c57080 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00a3f0 tx=0x7fac2c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee256eb3fe803e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.635+0000 7fac2b7fe640 1 -- 172.21.15.121:0/1321433172 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac2c052960 con 0x564094baeae0 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.635+0000 7fac2b7fe640 1 -- 172.21.15.121:0/1321433172 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c052ac0 con 0x564094baeae0 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.635+0000 7fac2b7fe640 1 -- 172.21.15.121:0/1321433172 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac2c052d60 con 0x564094baeae0 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3b68c800 1 -- 172.21.15.121:0/1321433172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 msgr2=0x564094c57080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1321433172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c57080 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00a3f0 tx=0x7fac2c04c000 comp rx=0 tx=0).stop 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3b68c800 1 -- 172.21.15.121:0/1321433172 shutdown_connections 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1321433172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c57080 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3b68c800 1 -- 172.21.15.121:0/1321433172 >> 172.21.15.121:0/1321433172 conn(0x564094baa780 msgr2=0x564094c52cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3b68c800 1 -- 172.21.15.121:0/1321433172 shutdown_connections 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3b68c800 1 -- 172.21.15.121:0/1321433172 wait complete. 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3b68c800 1 Processor -- start 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3b68c800 1 -- start start 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3b68c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c5e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3b68c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564094abe6a0 con 0x564094baeae0 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3918c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c5e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3918c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c5e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54858/0 (socket says 172.21.15.121:54858) 2023-12-07T21:09:17.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.636+0000 7fac3918c640 1 -- 172.21.15.121:0/1030215092 learned_addr learned my addr 172.21.15.121:0/1030215092 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.637+0000 7fac3918c640 1 -- 172.21.15.121:0/1030215092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564094b24500 con 0x564094baeae0 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.637+0000 7fac3918c640 1 --2- 172.21.15.121:0/1030215092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c5e4f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0448a0 tx=0x7fac2c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.637+0000 7fac2a7fc640 1 -- 172.21.15.121:0/1030215092 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac2c06c070 con 0x564094baeae0 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.637+0000 7fac2a7fc640 1 -- 172.21.15.121:0/1030215092 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c070410 con 0x564094baeae0 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.637+0000 7fac3b68c800 1 -- 172.21.15.121:0/1030215092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564094c5ea30 con 0x564094baeae0 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.637+0000 7fac2a7fc640 1 -- 172.21.15.121:0/1030215092 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac2c0706f0 con 0x564094baeae0 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.637+0000 7fac3b68c800 1 -- 172.21.15.121:0/1030215092 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564094c5ef70 con 0x564094baeae0 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac3b68c800 1 Processor -- start 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac3b68c800 1 -- start start 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac2a7fc640 1 -- 172.21.15.121:0/1030215092 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fac2c0663f0 con 0x564094baeae0 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac3b68c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 0x564094c6ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac3b68c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564094a58890 con 0x564094c6a6f0 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac2a7fc640 1 --2- 172.21.15.121:0/1030215092 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fac1c036110 0x7fac1c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac3998d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 0x564094c6ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac2a7fc640 1 -- 172.21.15.121:0/1030215092 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fac2c08d970 con 0x564094baeae0 2023-12-07T21:09:17.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac3998d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 0x564094c6ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54868/0 (socket says 172.21.15.121:54868) 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac3998d640 1 -- 172.21.15.121:0/662628266 learned_addr learned my addr 172.21.15.121:0/662628266 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac3918c640 1 --2- 172.21.15.121:0/1030215092 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fac1c036110 0x7fac1c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.638+0000 7fac3998d640 1 -- 172.21.15.121:0/662628266 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564094c6b050 con 0x564094c6a6f0 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac3918c640 1 --2- 172.21.15.121:0/1030215092 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fac1c036110 0x7fac1c0385d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fac2c05cd60 tx=0x7fac2c066f40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac3998d640 1 --2- 172.21.15.121:0/662628266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 0x564094c6ab10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fac3400a400 tx=0x7fac3400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de73203b36c9385e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac1bfff640 1 -- 172.21.15.121:0/662628266 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac340087e0 con 0x564094c6a6f0 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac1bfff640 1 -- 172.21.15.121:0/662628266 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac34008960 con 0x564094c6a6f0 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac1bfff640 1 -- 172.21.15.121:0/662628266 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac34008c80 con 0x564094c6a6f0 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac3b68c800 1 -- 172.21.15.121:0/662628266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 msgr2=0x564094c6ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac3b68c800 1 --2- 172.21.15.121:0/662628266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 0x564094c6ab10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fac3400a400 tx=0x7fac3400a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac3b68c800 1 -- 172.21.15.121:0/662628266 shutdown_connections 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac3b68c800 1 --2- 172.21.15.121:0/662628266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 0x564094c6ab10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac3b68c800 1 -- 172.21.15.121:0/662628266 >> 172.21.15.121:0/662628266 conn(0x564094baf440 msgr2=0x564094c65ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac3b68c800 1 -- 172.21.15.121:0/662628266 shutdown_connections 2023-12-07T21:09:17.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.639+0000 7fac3b68c800 1 -- 172.21.15.121:0/662628266 wait complete. 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.640+0000 7fac3b68c800 1 Processor -- start 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.640+0000 7fac3b68c800 1 -- start start 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.640+0000 7fac3b68c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 0x564094c717a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.640+0000 7fac3b68c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x564094a58530 con 0x564094c6a6f0 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.640+0000 7fac3998d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 0x564094c717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.640+0000 7fac3998d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 0x564094c717a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54876/0 (socket says 172.21.15.121:54876) 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.640+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 learned_addr learned my addr 172.21.15.121:0/1440662738 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.640+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34005c90 con 0x564094c6a6f0 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.640+0000 7fac3998d640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 0x564094c717a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fac3400a900 tx=0x7fac34002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.640+0000 7fac1a7fc640 1 -- 172.21.15.121:0/1440662738 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac34013780 con 0x564094c6a6f0 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.640+0000 7fac1a7fc640 1 -- 172.21.15.121:0/1440662738 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac340138e0 con 0x564094c6a6f0 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.641+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564094c71ce0 con 0x564094c6a6f0 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.641+0000 7fac1a7fc640 1 -- 172.21.15.121:0/1440662738 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac34013b80 con 0x564094c6a6f0 2023-12-07T21:09:17.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.641+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564094c721a0 con 0x564094c6a6f0 2023-12-07T21:09:17.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.641+0000 7fac1a7fc640 1 -- 172.21.15.121:0/1440662738 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fac3401e420 con 0x564094c6a6f0 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.641+0000 7fac1a7fc640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fac140360c0 0x7fac14038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.642+0000 7fac1a7fc640 1 -- 172.21.15.121:0/1440662738 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fac3404b780 con 0x564094c6a6f0 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.642+0000 7fac3898b640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fac140360c0 0x7fac14038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.642+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.642+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564094c7ce90 0x564094c7f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.642+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c7faa0 con 0x564094c7ce90 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.642+0000 7fac3898b640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fac140360c0 0x7fac14038580 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fac30000f60 tx=0x7fac30001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.642+0000 7fac3998d640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564094c7ce90 0x564094c7f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.642+0000 7fac3998d640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564094c7ce90 0x564094c7f350 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 20 realm 2023-12-07T21:09:17.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c7feb0 con 0x564094c7ce90 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c80730 con 0x564094c7ce90 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c80a90 con 0x564094c7ce90 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c81290 con 0x564094c7ce90 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.643+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.644+0000 7fac3b68c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.644+0000 7fac3b68c800 20 searching for the correct realm 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.644+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x564094c82fb0 0x564094c85420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.644+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c82fb0 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.644+0000 7fac3918c640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x564094c82fb0 0x564094c85420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.644+0000 7fac3918c640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x564094c82fb0 0x564094c85420 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.644+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.644+0000 7fac3918c640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fac2c07a060 0x7fac2c071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.644+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac2c07a060 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.644+0000 7fac3898b640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fac2c07a060 0x7fac2c071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.645+0000 7fac3898b640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fac2c07a060 0x7fac2c071860 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.645+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac30006070 con 0x7fac2c07a060 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.645+0000 7fac3898b640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fac3000d3d0 0x7fac3000d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.645+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac3000d3d0 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.645+0000 7fac3998d640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fac3000d3d0 0x7fac3000d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.646+0000 7fac3998d640 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fac3000d3d0 0x7fac3000d830 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.646+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.646+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c7ce90 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.646+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.646+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c7ce90 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.646+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.646+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac3000d3d0 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.647+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.647+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac3000d3d0 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.647+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.647+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac2c07a060 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.647+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac30006070 con 0x7fac2c07a060 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.647+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c82fb0 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.647+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.647+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c7ce90 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.647+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.647+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac3000d3d0 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.648+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.648+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c7ce90 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.648+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.648+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac2c07a060 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.648+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fac30006070 con 0x7fac2c07a060 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.648+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c82fb0 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.648+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.648+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c82fb0 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.649+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.649+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac3000d3d0 2023-12-07T21:09:17.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.649+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.649+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c82fb0 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.649+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.649+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c82fb0 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.649+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.649+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c7ce90 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.649+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.650+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c7ce90 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.650+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.650+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac3000d3d0 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.650+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.650+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c82fb0 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.650+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.650+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac2c07a060 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.650+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac30006070 con 0x7fac2c07a060 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.650+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c7ce90 2023-12-07T21:09:17.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.651+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.651+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac3000d3d0 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.651+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.651+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c82fb0 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.651+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.651+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac3000d3d0 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.651+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.651+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac2c07a060 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.652+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac30006070 con 0x7fac2c07a060 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.652+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c82fb0 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.652+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.652+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x7fac3000d3d0 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.652+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.652+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85af0 con 0x564094c7ce90 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.652+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.652+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fac34054080 con 0x7fac2c07a060 2023-12-07T21:09:17.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fac30006070 con 0x7fac2c07a060 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c81bf0 con 0x564094c7ce90 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c82440 con 0x564094c7ce90 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c82440 con 0x564094c82fb0 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 zone default found 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 4 Realm: () 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 zonegroup default 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.653+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c85f90 con 0x7fac3000d3d0 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3b68c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c87d70 con 0x564094c82fb0 2023-12-07T21:09:17.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3b68c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c880d0 con 0x564094c82fb0 2023-12-07T21:09:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3b68c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3b68c800 20 started sync module instance, tier type = 2023-12-07T21:09:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3b68c800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.654+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c87650 con 0x7fac2c07a060 2023-12-07T21:09:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.655+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac30006070 con 0x7fac2c07a060 2023-12-07T21:09:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.655+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94835371638608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c87a00 con 0x7fac2c07a060 2023-12-07T21:09:17.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.655+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c88960 con 0x564094c7ce90 2023-12-07T21:09:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.656+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94835371638608] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac30006070 con 0x7fac2c07a060 2023-12-07T21:09:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.657+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.657+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94835374059952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c88d10 con 0x564094c7ce90 2023-12-07T21:09:17.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.657+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c89510 con 0x564094c82fb0 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.658+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94835374059952] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.658+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.658+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94835374066960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c89120 con 0x564094c82fb0 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.658+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8a200 con 0x7fac2c07a060 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.659+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94835374066960] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.659+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac30026040 con 0x7fac2c07a060 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.659+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94835374070224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8aa00 con 0x7fac2c07a060 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.659+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8b200 con 0x564094c7ce90 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.660+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94835374070224] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac30026040 con 0x7fac2c07a060 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.660+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.660+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94835374075232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8b170 con 0x564094c7ce90 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.660+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8bef0 con 0x7fac3000d3d0 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.661+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94835374075232] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.661+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.661+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94835374077280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8be10 con 0x7fac3000d3d0 2023-12-07T21:09:17.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.661+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8c780 con 0x7fac3000d3d0 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.662+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.662+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94835374077280] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.662+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94835374080736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8c6f0 con 0x7fac3000d3d0 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.663+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8d060 con 0x7fac3000d3d0 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.663+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94835374080736] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.663+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.663+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94835374078320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8d060 con 0x7fac3000d3d0 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.664+0000 7fac3b68c800 20 add_watcher() i=0 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.664+0000 7fac3b68c800 20 add_watcher() i=1 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.664+0000 7fac3b68c800 20 add_watcher() i=2 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.664+0000 7fac3b68c800 20 add_watcher() i=3 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.664+0000 7fac3b68c800 20 add_watcher() i=4 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.664+0000 7fac3b68c800 20 add_watcher() i=5 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.664+0000 7fac3b68c800 20 add_watcher() i=6 2023-12-07T21:09:17.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.664+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94835374078320] v31'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.664+0000 7fac3b68c800 20 add_watcher() i=7 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.664+0000 7fac3b68c800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.665+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c90350 con 0x564094c7ce90 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.665+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.665+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94835374083376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8d5e0 con 0x564094c7ce90 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.666+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94835374083376] v31'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.666+0000 7fabfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.666+0000 7fac3b68c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.666+0000 7fac3b68c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.666+0000 7fac3b68c800 5 note: GC not initialized 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.666+0000 7fabfdfe3640 20 reqs_thread_entry: start 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 20 Filter name: none 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fab6f7fe640 20 reqs_thread_entry: start 2023-12-07T21:09:17.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094cc3410 con 0x564094c7ce90 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094cc4e90 con 0x7fac2c07a060 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.667+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fac30026040 con 0x7fac2c07a060 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 : miss 2023-12-07T21:09:17.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094cc6a50 con 0x7fac2c07a060 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(64 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv21 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fac30026040 con 0x7fac2c07a060 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.668+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094ccb390 con 0x7fac3000d3d0 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.669+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(65 fud.buckets [call] v31'5 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.669+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094cd1330 con 0x7fac2c07a060 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.670+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(66 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'24 uv24 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fac30026040 con 0x7fac2c07a060 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.670+0000 7fac3b68c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:17.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.670+0000 7fac3b68c800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.670+0000 7fac3b68c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.670+0000 7fac3b68c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1, ofs0, ns] 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.670+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94835374321808 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094cd0cd0 con 0x7fac3000d3d0 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== watch-notify(notify (1) cookie 94835374077280 notify 133143986186 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x564094c721a0 con 0x7fac3000d3d0 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94835374077280 notifier 4474 bl.length()=725 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(67 notify.5 [notify cookie 94835374321808 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac1bfff640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fac0c0042a0 con 0x7fac3000d3d0 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== watch-notify(notify_complete (2) cookie 94835374321808 notify 133143986186 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564094c71ce0 con 0x7fac3000d3d0 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac3b68c800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_sources= new_sources= 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac3b68c800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential sources added=[] removed=[] 2023-12-07T21:09:17.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac3b68c800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_dests= new_dests= 2023-12-07T21:09:17.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac3b68c800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential dests added=[] removed=[] 2023-12-07T21:09:17.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.671+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094cd0cd0 con 0x7fac2c07a060 2023-12-07T21:09:17.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.672+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(69 foo.buckets [call] v31'25 uv25 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fac30026040 con 0x7fac2c07a060 2023-12-07T21:09:17.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.672+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094cd0cd0 con 0x7fac2c07a060 2023-12-07T21:09:17.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'26 uv26 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7fac30026040 con 0x7fac2c07a060 2023-12-07T21:09:17.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac3b68c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-12-07T21:09:17.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac3b68c800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:17.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac3b68c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-12-07T21:09:17.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94835374321808 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094cd0cd0 con 0x7fac3000d3d0 2023-12-07T21:09:17.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== watch-notify(notify (1) cookie 94835374080736 notify 133143986187 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x564094c71ce0 con 0x7fac3000d3d0 2023-12-07T21:09:17.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 94835374080736 notifier 4474 bl.length()=314 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(71 notify.6 [notify cookie 94835374321808 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac1bfff640 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fac0c004600 con 0x7fac3000d3d0 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.674+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== watch-notify(notify_complete (2) cookie 94835374321808 notify 133143986187 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fac34005c90 con 0x7fac3000d3d0 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.675+0000 7fabfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.675+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94835374083376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8fe80 con 0x564094c7ce90 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.676+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94835374083376] v31'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.676+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94835371638608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8fe80 con 0x7fac2c07a060 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.677+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94835371638608] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac30026040 con 0x7fac2c07a060 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.677+0000 7fac3b68c800 20 remove_watcher() i=0 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.677+0000 7fac3b68c800 2 removed watcher, disabling cache 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.677+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94835374059952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c81bf0 con 0x564094c7ce90 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.678+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94835374059952] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.678+0000 7fac3b68c800 20 remove_watcher() i=1 2023-12-07T21:09:17.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.678+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94835374066960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c81bf0 con 0x564094c82fb0 2023-12-07T21:09:17.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.679+0000 7fac3918c640 1 -- 172.21.15.121:0/1440662738 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94835374066960] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac2c080070 con 0x564094c82fb0 2023-12-07T21:09:17.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.679+0000 7fac3b68c800 20 remove_watcher() i=2 2023-12-07T21:09:17.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.679+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94835374070224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8fe80 con 0x7fac2c07a060 2023-12-07T21:09:17.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.680+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94835374070224] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac30026040 con 0x7fac2c07a060 2023-12-07T21:09:17.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.680+0000 7fac3b68c800 20 remove_watcher() i=3 2023-12-07T21:09:17.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.680+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94835374075232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8fe80 con 0x564094c7ce90 2023-12-07T21:09:17.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.681+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94835374075232] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x564094c7ce90 2023-12-07T21:09:17.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.681+0000 7fac3b68c800 20 remove_watcher() i=4 2023-12-07T21:09:17.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.681+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94835374077280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8fe80 con 0x7fac3000d3d0 2023-12-07T21:09:17.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.682+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94835374077280] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.682+0000 7fac3b68c800 20 remove_watcher() i=5 2023-12-07T21:09:17.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.682+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94835374080736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8fe80 con 0x7fac3000d3d0 2023-12-07T21:09:17.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.683+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94835374080736] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.683+0000 7fac3b68c800 20 remove_watcher() i=6 2023-12-07T21:09:17.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.683+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94835374078320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x564094c8fe80 con 0x7fac3000d3d0 2023-12-07T21:09:17.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3998d640 1 -- 172.21.15.121:0/1440662738 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94835374078320] v31'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fac34024070 con 0x7fac3000d3d0 2023-12-07T21:09:17.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 20 remove_watcher() i=7 2023-12-07T21:09:17.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fac3000d3d0 msgr2=0x7fac3000d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fac3000d3d0 0x7fac3000d830 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564094c7ce90 msgr2=0x564094c7f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x564094c7ce90 0x564094c7f350 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fac2c07a060 msgr2=0x7fac2c071860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fac2c07a060 0x7fac2c071860 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x564094c82fb0 msgr2=0x564094c85420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x564094c82fb0 0x564094c85420 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fac140360c0 msgr2=0x7fac14038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fac140360c0 0x7fac14038580 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fac30000f60 tx=0x7fac30001230 comp rx=0 tx=0).stop 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 msgr2=0x564094c717a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1440662738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094c6a6f0 0x564094c717a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fac3400a900 tx=0x7fac34002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 reap_dead start 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3898b640 1 -- 172.21.15.121:0/1440662738 reap_dead start 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 shutdown_connections 2023-12-07T21:09:17.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 >> 172.21.15.121:0/1440662738 conn(0x564094baf440 msgr2=0x564094c648d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 shutdown_connections 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.684+0000 7fac3b68c800 1 -- 172.21.15.121:0/1440662738 wait complete. 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.685+0000 7fac3b68c800 1 -- 172.21.15.121:0/1030215092 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fac1c036110 msgr2=0x7fac1c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.685+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1030215092 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fac1c036110 0x7fac1c0385d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fac2c05cd60 tx=0x7fac2c066f40 comp rx=0 tx=0).stop 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.685+0000 7fac3b68c800 1 -- 172.21.15.121:0/1030215092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 msgr2=0x564094c5e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.685+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1030215092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c5e4f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0448a0 tx=0x7fac2c003330 comp rx=0 tx=0).stop 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.685+0000 7fac3b68c800 1 -- 172.21.15.121:0/1030215092 shutdown_connections 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.685+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1030215092 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fac1c036110 0x7fac1c0385d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.685+0000 7fac3b68c800 1 --2- 172.21.15.121:0/1030215092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x564094baeae0 0x564094c5e4f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.685+0000 7fac3b68c800 1 -- 172.21.15.121:0/1030215092 >> 172.21.15.121:0/1030215092 conn(0x564094baa780 msgr2=0x564094c55d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.685+0000 7fac3b68c800 1 -- 172.21.15.121:0/1030215092 shutdown_connections 2023-12-07T21:09:17.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.685+0000 7fac3b68c800 1 -- 172.21.15.121:0/1030215092 wait complete. 2023-12-07T21:09:17.682 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2023-12-07T21:09:17.682 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2023-12-07T21:09:17.682 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2023-12-07T21:09:17.724 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:17.724 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:17.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.731+0000 7f5acab1f800 1 Processor -- start 2023-12-07T21:09:17.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.731+0000 7f5acab1f800 1 -- start start 2023-12-07T21:09:17.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.731+0000 7f5acab1f800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562aeedb3540 0x562aeedb5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.731+0000 7f5acab1f800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562aeecfc7a0 con 0x562aeedaf100 2023-12-07T21:09:17.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.731+0000 7f5acab1f800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x562aeecc5880 con 0x562aeedb3540 2023-12-07T21:09:17.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.731+0000 7f5abdf53640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562aeedb3540 0x562aeedb5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.731+0000 7f5ac6754640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x562aeedaf100 0x562aeedaf520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55854/0 (socket says 172.21.15.121:55854) 2023-12-07T21:09:17.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.731+0000 7f5ac6754640 1 -- 172.21.15.121:0/1678493882 learned_addr learned my addr 172.21.15.121:0/1678493882 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:17.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.732+0000 7f5abdf53640 1 -- 172.21.15.121:0/1678493882 >> v1:172.21.15.89:6789/0 conn(0x562aeedaf100 legacy=0x562aeedaf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.732+0000 7f5abdf53640 1 -- 172.21.15.121:0/1678493882 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aeedb6f60 con 0x562aeedb3540 2023-12-07T21:09:17.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.733+0000 7f5abdf53640 1 --2- 172.21.15.121:0/1678493882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedb3540 0x562aeedb5930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000a470 tx=0x7f5ab001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c763efa7c6a2bd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.734+0000 7f5ac5f53640 1 -- 172.21.15.121:0/1678493882 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab0052570 con 0x562aeedb3540 2023-12-07T21:09:17.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.734+0000 7f5ac5f53640 1 -- 172.21.15.121:0/1678493882 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab00526d0 con 0x562aeedb3540 2023-12-07T21:09:17.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.734+0000 7f5ac5f53640 1 -- 172.21.15.121:0/1678493882 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab0052990 con 0x562aeedb3540 2023-12-07T21:09:17.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.734+0000 7f5acab1f800 1 -- 172.21.15.121:0/1678493882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedb3540 msgr2=0x562aeedb5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.734+0000 7f5acab1f800 1 --2- 172.21.15.121:0/1678493882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedb3540 0x562aeedb5930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000a470 tx=0x7f5ab001cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:17.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.734+0000 7f5acab1f800 1 -- 172.21.15.121:0/1678493882 shutdown_connections 2023-12-07T21:09:17.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.734+0000 7f5acab1f800 1 --2- 172.21.15.121:0/1678493882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedb3540 0x562aeedb5930 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.734+0000 7f5acab1f800 1 -- 172.21.15.121:0/1678493882 >> 172.21.15.121:0/1678493882 conn(0x562aeedaa880 msgr2=0x562aeedacca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.734+0000 7f5acab1f800 1 -- 172.21.15.121:0/1678493882 shutdown_connections 2023-12-07T21:09:17.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.734+0000 7f5acab1f800 1 -- 172.21.15.121:0/1678493882 wait complete. 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.735+0000 7f5acab1f800 1 Processor -- start 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.735+0000 7f5acab1f800 1 -- start start 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.735+0000 7f5acab1f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeed241b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.735+0000 7f5acab1f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeecc2db0 con 0x562aeedaf100 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.735+0000 7f5ac6754640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeed241b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.735+0000 7f5ac6754640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeed241b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54888/0 (socket says 172.21.15.121:54888) 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.735+0000 7f5ac6754640 1 -- 172.21.15.121:0/428086998 learned_addr learned my addr 172.21.15.121:0/428086998 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.735+0000 7f5ac6754640 1 -- 172.21.15.121:0/428086998 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0005d20 con 0x562aeedaf100 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.736+0000 7f5ac6754640 1 --2- 172.21.15.121:0/428086998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeed241b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8001c80 tx=0x7f5ab800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63ef2f5c488932e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.736+0000 7f5ac5752640 1 -- 172.21.15.121:0/428086998 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab800e470 con 0x562aeedaf100 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.736+0000 7f5ac5752640 1 -- 172.21.15.121:0/428086998 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab800e5d0 con 0x562aeedaf100 2023-12-07T21:09:17.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.736+0000 7f5ac5752640 1 -- 172.21.15.121:0/428086998 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab800e8d0 con 0x562aeedaf100 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.736+0000 7f5acab1f800 1 -- 172.21.15.121:0/428086998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 msgr2=0x562aeed241b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.736+0000 7f5acab1f800 1 --2- 172.21.15.121:0/428086998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeed241b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8001c80 tx=0x7f5ab800b6c0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.736+0000 7f5acab1f800 1 -- 172.21.15.121:0/428086998 shutdown_connections 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.736+0000 7f5acab1f800 1 --2- 172.21.15.121:0/428086998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeed241b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.736+0000 7f5acab1f800 1 -- 172.21.15.121:0/428086998 >> 172.21.15.121:0/428086998 conn(0x562aeedaa880 msgr2=0x562aeee4f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.736+0000 7f5acab1f800 1 -- 172.21.15.121:0/428086998 shutdown_connections 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.736+0000 7f5acab1f800 1 -- 172.21.15.121:0/428086998 wait complete. 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5acab1f800 1 Processor -- start 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5acab1f800 1 -- start start 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5acab1f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeee5c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5acab1f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeecbe6a0 con 0x562aeedaf100 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5ac6754640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeee5c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5ac6754640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeee5c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54896/0 (socket says 172.21.15.121:54896) 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5ac6754640 1 -- 172.21.15.121:0/2686172726 learned_addr learned my addr 172.21.15.121:0/2686172726 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5ac6754640 1 -- 172.21.15.121:0/2686172726 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aeecfc7a0 con 0x562aeedaf100 2023-12-07T21:09:17.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5ac6754640 1 --2- 172.21.15.121:0/2686172726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeee5c310 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8000c00 tx=0x7f5ab8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5abffff640 1 -- 172.21.15.121:0/2686172726 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab801f070 con 0x562aeedaf100 2023-12-07T21:09:17.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5abffff640 1 -- 172.21.15.121:0/2686172726 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab8018640 con 0x562aeedaf100 2023-12-07T21:09:17.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5abffff640 1 -- 172.21.15.121:0/2686172726 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ab8018960 con 0x562aeedaf100 2023-12-07T21:09:17.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.737+0000 7f5acab1f800 1 -- 172.21.15.121:0/2686172726 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562aeee5c850 con 0x562aeedaf100 2023-12-07T21:09:17.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.738+0000 7f5acab1f800 1 -- 172.21.15.121:0/2686172726 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562aeee5cd30 con 0x562aeedaf100 2023-12-07T21:09:17.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.738+0000 7f5acab1f800 1 Processor -- start 2023-12-07T21:09:17.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.738+0000 7f5acab1f800 1 -- start start 2023-12-07T21:09:17.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.738+0000 7f5acab1f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 0x562aeee688e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.738+0000 7f5abffff640 1 -- 172.21.15.121:0/2686172726 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f5ab8018bd0 con 0x562aeedaf100 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.738+0000 7f5acab1f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeec58890 con 0x562aeee684c0 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.738+0000 7f5ac6f55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 0x562aeee688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.738+0000 7f5abffff640 1 --2- 172.21.15.121:0/2686172726 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5aa80360c0 0x7f5aa8038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.738+0000 7f5ac6f55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 0x562aeee688e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54908/0 (socket says 172.21.15.121:54908) 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.738+0000 7f5ac6f55640 1 -- 172.21.15.121:0/1694541047 learned_addr learned my addr 172.21.15.121:0/1694541047 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.738+0000 7f5abffff640 1 -- 172.21.15.121:0/2686172726 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f5ab804bb10 con 0x562aeedaf100 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5ac6754640 1 --2- 172.21.15.121:0/2686172726 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5aa80360c0 0x7f5aa8038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5ac6f55640 1 -- 172.21.15.121:0/1694541047 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aeee68e20 con 0x562aeee684c0 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5ac6f55640 1 --2- 172.21.15.121:0/1694541047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 0x562aeee688e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000a430 tx=0x7f5ac000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db39c9fff11865e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5ac6754640 1 --2- 172.21.15.121:0/2686172726 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5aa80360c0 0x7f5aa8038580 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8022710 tx=0x7f5ab8018ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5abd752640 1 -- 172.21.15.121:0/1694541047 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ac0001650 con 0x562aeee684c0 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5abd752640 1 -- 172.21.15.121:0/1694541047 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac00017d0 con 0x562aeee684c0 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5abd752640 1 -- 172.21.15.121:0/1694541047 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ac0001ab0 con 0x562aeee684c0 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5acab1f800 1 -- 172.21.15.121:0/1694541047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 msgr2=0x562aeee688e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5acab1f800 1 --2- 172.21.15.121:0/1694541047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 0x562aeee688e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000a430 tx=0x7f5ac000a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5acab1f800 1 -- 172.21.15.121:0/1694541047 shutdown_connections 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5acab1f800 1 --2- 172.21.15.121:0/1694541047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 0x562aeee688e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5acab1f800 1 -- 172.21.15.121:0/1694541047 >> 172.21.15.121:0/1694541047 conn(0x562aeedb3540 msgr2=0x562aeee638a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5acab1f800 1 -- 172.21.15.121:0/1694541047 shutdown_connections 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.739+0000 7f5acab1f800 1 -- 172.21.15.121:0/1694541047 wait complete. 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.740+0000 7f5acab1f800 1 Processor -- start 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.740+0000 7f5acab1f800 1 -- start start 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.740+0000 7f5acab1f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 0x562aeee6f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.740+0000 7f5acab1f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeec58530 con 0x562aeee684c0 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.740+0000 7f5ac6f55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 0x562aeee6f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.740+0000 7f5ac6f55640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 0x562aeee6f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54922/0 (socket says 172.21.15.121:54922) 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.740+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 learned_addr learned my addr 172.21.15.121:0/4253274803 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.740+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac000a0e0 con 0x562aeee684c0 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.741+0000 7f5ac6f55640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 0x562aeee6f410 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000ae40 tx=0x7f5ac0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.741+0000 7f5aa77fe640 1 -- 172.21.15.121:0/4253274803 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ac00109e0 con 0x562aeee684c0 2023-12-07T21:09:17.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.741+0000 7f5aa77fe640 1 -- 172.21.15.121:0/4253274803 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac0010b40 con 0x562aeee684c0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.741+0000 7f5aa77fe640 1 -- 172.21.15.121:0/4253274803 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ac0010e20 con 0x562aeee684c0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.741+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562aeee6f950 con 0x562aeee684c0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.741+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562aeee6fdb0 con 0x562aeee684c0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.741+0000 7f5aa77fe640 1 -- 172.21.15.121:0/4253274803 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f5ac0017070 con 0x562aeee684c0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.742+0000 7f5aa77fe640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5aa00360c0 0x7f5aa0038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.742+0000 7f5aa77fe640 1 -- 172.21.15.121:0/4253274803 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f5ac004b970 con 0x562aeee684c0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.742+0000 7f5abdf53640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5aa00360c0 0x7f5aa0038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.742+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.742+0000 7f5acab1f800 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562aeee7aac0 0x562aeee7cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.742+0000 7f5abdf53640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5aa00360c0 0x7f5aa0038580 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0054000 tx=0x7f5ab004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.742+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee7d6d0 con 0x562aeee7aac0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.742+0000 7f5ac6f55640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562aeee7aac0 0x562aeee7cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5ac6f55640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562aeee7aac0 0x562aeee7cf80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5acab1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5acab1f800 20 realm 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee7dae0 con 0x562aeee7aac0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5acab1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5acab1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee7e360 con 0x562aeee7aac0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5acab1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.743+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee7e6c0 con 0x562aeee7aac0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5acab1f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee7eec0 con 0x562aeee7aac0 2023-12-07T21:09:17.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5acab1f800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5acab1f800 20 searching for the correct realm 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5acab1f800 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562aeee80be0 0x562aeee83050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee80be0 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5ac6754640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562aeee80be0 0x562aeee83050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5ac6754640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562aeee80be0 0x562aeee83050 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.744+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.745+0000 7f5ac6754640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f5ab8017050 0x7f5ab80229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.745+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x7f5ab8017050 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.745+0000 7f5abdf53640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f5ab8017050 0x7f5ab80229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.745+0000 7f5abdf53640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f5ab8017050 0x7f5ab80229b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.745+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.745+0000 7f5abdf53640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f5ab005ca90 0x7f5ab00673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.745+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x7f5ab005ca90 2023-12-07T21:09:17.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.745+0000 7f5ac6f55640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f5ab005ca90 0x7f5ab00673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.746+0000 7f5ac6f55640 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f5ab005ca90 0x7f5ab00673d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.746+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.746+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee7aac0 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.746+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.746+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee7aac0 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.746+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.746+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x7f5ab005ca90 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.747+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.747+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x7f5ab005ca90 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.747+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.747+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x7f5ab8017050 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.747+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.747+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee80be0 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.747+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.747+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee7aac0 2023-12-07T21:09:17.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.747+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.747+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x7f5ab005ca90 2023-12-07T21:09:17.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.748+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.748+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee7aac0 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.748+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.748+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x7f5ab8017050 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.748+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.748+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee80be0 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.748+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.748+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee80be0 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.749+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.749+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x7f5ab005ca90 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.749+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.749+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee80be0 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.749+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.749+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee80be0 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.749+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.749+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee7aac0 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.750+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.750+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x562aeee7aac0 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.750+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.750+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83720 con 0x7f5ab005ca90 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.750+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.750+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5ac0053040 con 0x562aeee80be0 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.750+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.750+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5ac0053040 con 0x7f5ab8017050 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.750+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.750+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5ac0053040 con 0x562aeee7aac0 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.751+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.751+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5ac0053040 con 0x7f5ab005ca90 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.751+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.751+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5ac0053040 con 0x562aeee80be0 2023-12-07T21:09:17.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.751+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.751+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5ac0053040 con 0x7f5ab005ca90 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.751+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.751+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5ac0053040 con 0x7f5ab8017050 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.752+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.752+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5ac0053040 con 0x562aeee80be0 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.752+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.752+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5ac0053040 con 0x7f5ab005ca90 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.752+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.752+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5ac0053040 con 0x562aeee7aac0 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5ac0053040 con 0x7f5ab8017050 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:17.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee7f7c0 con 0x562aeee7aac0 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee7f440 con 0x562aeee7aac0 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.753+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee80090 con 0x562aeee80be0 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:17.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 20 zone default found 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 4 Realm: () 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 20 zonegroup default 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee83b60 con 0x7f5ab005ca90 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.754+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee859e0 con 0x562aeee80be0 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.755+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.755+0000 7f5acab1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.755+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.755+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee85d40 con 0x562aeee80be0 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.755+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.755+0000 7f5acab1f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.755+0000 7f5acab1f800 20 started sync module instance, tier type = 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.755+0000 7f5acab1f800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.755+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee84fb0 con 0x7f5ab8017050 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.756+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.756+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94742394404688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee85390 con 0x7f5ab8017050 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.756+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee86540 con 0x562aeee7aac0 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.757+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94742394404688] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.757+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.757+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94742396816144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee86540 con 0x562aeee7aac0 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.757+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee86f90 con 0x562aeee80be0 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.758+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94742396816144] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.758+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.758+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94742396821664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee864b0 con 0x562aeee80be0 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.758+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee87c80 con 0x7f5ab8017050 2023-12-07T21:09:17.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.759+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94742396821664] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.759+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.759+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94742396826704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee884d0 con 0x7f5ab8017050 2023-12-07T21:09:17.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.759+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee88cd0 con 0x562aeee7aac0 2023-12-07T21:09:17.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.760+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.760+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94742396832096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee89520 con 0x562aeee7aac0 2023-12-07T21:09:17.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.760+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee89ed0 con 0x7f5ab005ca90 2023-12-07T21:09:17.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.761+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94742396826704] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.761+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94742396832096] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.762+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.762+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94742396829744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee89030 con 0x7f5ab005ca90 2023-12-07T21:09:17.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.762+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee8a720 con 0x7f5ab005ca90 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.762+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.763+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94742396838528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee89030 con 0x7f5ab005ca90 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.763+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee8b030 con 0x7f5ab005ca90 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.764+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(58 notify.7 [create] v31'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.764+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94742396829744] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.764+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94742396840752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee8b4d0 con 0x7f5ab005ca90 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.764+0000 7f5acab1f800 20 add_watcher() i=0 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.764+0000 7f5acab1f800 20 add_watcher() i=1 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.764+0000 7f5acab1f800 20 add_watcher() i=2 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.764+0000 7f5acab1f800 20 add_watcher() i=3 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.764+0000 7f5acab1f800 20 add_watcher() i=4 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.764+0000 7f5acab1f800 20 add_watcher() i=5 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.764+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94742396838528] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.764+0000 7f5acab1f800 20 add_watcher() i=6 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.765+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94742396840752] v31'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.766+0000 7f5acab1f800 20 add_watcher() i=7 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.766+0000 7f5acab1f800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.766+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee89ab0 con 0x562aeee7aac0 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.766+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.766+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94742396836528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee8a690 con 0x562aeee7aac0 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.767+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94742396836528] v31'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.767+0000 7f5a877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.767+0000 7f5acab1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.767+0000 7f5acab1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.767+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee96450 con 0x562aeee7aac0 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.768+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.768+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee96910 con 0x7f5ab005ca90 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.770+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'15 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.770+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee96e40 con 0x562aeee80be0 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.770+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.770+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee97810 con 0x562aeee7aac0 2023-12-07T21:09:17.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.771+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'122 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.771+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee94470 con 0x7f5ab8017050 2023-12-07T21:09:17.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.772+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'35 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.772+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee98380 con 0x562aeee80be0 2023-12-07T21:09:17.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.773+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.773+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee98b80 con 0x562aeee7aac0 2023-12-07T21:09:17.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.775+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.775+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee98b80 con 0x7f5ab005ca90 2023-12-07T21:09:17.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.776+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.776+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee98b80 con 0x7f5ab8017050 2023-12-07T21:09:17.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.777+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.777+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee99650 con 0x562aeee80be0 2023-12-07T21:09:17.771 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.778+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.778+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee93460 con 0x7f5ab8017050 2023-12-07T21:09:17.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.779+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'36 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.779+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee93460 con 0x7f5ab005ca90 2023-12-07T21:09:17.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.780+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.780+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee93460 con 0x7f5ab8017050 2023-12-07T21:09:17.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.780+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.774 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.780+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a1c0 con 0x7f5ab005ca90 2023-12-07T21:09:17.775 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.782+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'29 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.782+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a1c0 con 0x562aeee7aac0 2023-12-07T21:09:17.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.783+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'123 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.783+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a1c0 con 0x562aeee80be0 2023-12-07T21:09:17.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.784+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.778 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.784+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee933f0 con 0x7f5ab8017050 2023-12-07T21:09:17.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.785+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'37 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.785+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x562aeee80be0 2023-12-07T21:09:17.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.786+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.786+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x562aeee7aac0 2023-12-07T21:09:17.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.787+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.787+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x562aeee7aac0 2023-12-07T21:09:17.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.788+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'124 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x562aeee7aac0 2023-12-07T21:09:17.781 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.788+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x562aeee80be0 2023-12-07T21:09:17.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.789+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'30 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.789+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x7f5ab8017050 2023-12-07T21:09:17.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.789+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.790+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x562aeee80be0 2023-12-07T21:09:17.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.791+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.791+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x562aeee80be0 2023-12-07T21:09:17.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.792+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.792+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x562aeee80be0 2023-12-07T21:09:17.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.793+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.793+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x562aeee80be0 2023-12-07T21:09:17.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.793+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.793+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x7f5ab005ca90 2023-12-07T21:09:17.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.794+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.794+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x562aeee80be0 2023-12-07T21:09:17.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.795+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.795+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x7f5ab005ca90 2023-12-07T21:09:17.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.796+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'24 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.796+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x562aeee80be0 2023-12-07T21:09:17.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.797+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'31 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.797+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x7f5ab005ca90 2023-12-07T21:09:17.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.798+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'30 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.798+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee9a660 con 0x7f5ab8017050 2023-12-07T21:09:17.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.799+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f5a867fc640 20 reqs_thread_entry: start 2023-12-07T21:09:17.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f5acab1f800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f5acab1f800 20 Filter name: none 2023-12-07T21:09:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f59f7fff640 20 reqs_thread_entry: start 2023-12-07T21:09:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f5acab1f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-12-07T21:09:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f5acab1f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeeec51f0 con 0x7f5ab005ca90 2023-12-07T21:09:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f5acab1f800 20 rados_obj.operate() r=0 bl.length=346 2023-12-07T21:09:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f5acab1f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-12-07T21:09:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f5acab1f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:09:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.800+0000 7f5acab1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:17.795 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.801+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeeec7630 con 0x7f5ab005ca90 2023-12-07T21:09:17.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.801+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.801+0000 7f5acab1f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2023-12-07T21:09:17.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.801+0000 7f5acab1f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-12-07T21:09:17.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.801+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94742397078448 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeeec7cb0 con 0x562aeee80be0 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.801+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== watch-notify(notify (1) cookie 94742396821664 notify 133143986179 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f5ab8034040 con 0x562aeee80be0 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.801+0000 7f5abd752640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94742396821664 notifier 4480 bl.length()=170 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.801+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 28 ==== osd_op_reply(96 notify.2 [notify cookie 94742397078448 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.801+0000 7f5abd752640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5a98004160 con 0x562aeee80be0 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.801+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 29 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.802+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 30 ==== watch-notify(notify_complete (2) cookie 94742397078448 notify 133143986179 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562aeee5cd30 con 0x562aeee80be0 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.802+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeeec7bb0 con 0x7f5ab005ca90 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v31'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5ac000fc50 con 0x7f5ab005ca90 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5acab1f800 10 removing email index: 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5acab1f800 10 removing user buckets index 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5acab1f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94742397078448 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeeec7ca0 con 0x7f5ab005ca90 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== watch-notify(notify (1) cookie 94742396838528 notify 133143986188 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f5ac0059020 con 0x7f5ab005ca90 2023-12-07T21:09:17.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5abd752640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94742396838528 notifier 4480 bl.length()=160 2023-12-07T21:09:17.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(99 notify.6 [notify cookie 94742397078448 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5ac005b040 con 0x7f5ab005ca90 2023-12-07T21:09:17.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5abd752640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5a98004160 con 0x7f5ab005ca90 2023-12-07T21:09:17.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac005b040 con 0x7f5ab005ca90 2023-12-07T21:09:17.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 30 ==== watch-notify(notify_complete (2) cookie 94742397078448 notify 133143986188 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562aeee6fdb0 con 0x7f5ab005ca90 2023-12-07T21:09:17.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.803+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeeec55c0 con 0x7f5ab005ca90 2023-12-07T21:09:17.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.804+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 31 ==== osd_op_reply(101 fud.buckets [delete] v31'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f5ac005b040 con 0x7f5ab005ca90 2023-12-07T21:09:17.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.804+0000 7f5acab1f800 10 removing user index: fud 2023-12-07T21:09:17.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.804+0000 7f5acab1f800 10 removing default.rgw.meta+users.uid+fud from cache 2023-12-07T21:09:17.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.804+0000 7f5acab1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-12-07T21:09:17.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.804+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94742397078448 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeeec65d0 con 0x7f5ab005ca90 2023-12-07T21:09:17.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.805+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 32 ==== watch-notify(notify (1) cookie 94742396829744 notify 133143986189 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x562aeee6fdb0 con 0x7f5ab005ca90 2023-12-07T21:09:17.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.805+0000 7f5abcf51640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94742396829744 notifier 4480 bl.length()=152 2023-12-07T21:09:17.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.805+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 33 ==== osd_op_reply(102 notify.5 [notify cookie 94742397078448 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5ac005b040 con 0x7f5ab005ca90 2023-12-07T21:09:17.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.805+0000 7f5abcf51640 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f5a00003280 con 0x7f5ab005ca90 2023-12-07T21:09:17.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.805+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 34 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac005b040 con 0x7f5ab005ca90 2023-12-07T21:09:17.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.805+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 35 ==== watch-notify(notify_complete (2) cookie 94742397078448 notify 133143986189 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562aeee6f950 con 0x7f5ab005ca90 2023-12-07T21:09:17.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.805+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeeec9070 con 0x7f5ab005ca90 2023-12-07T21:09:17.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.806+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 36 ==== osd_op_reply(104 fud [call,call,delete] v31'2 uv2 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f5ac005b040 con 0x7f5ab005ca90 2023-12-07T21:09:17.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.807+0000 7f5a877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.807+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94742396836528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee97c40 con 0x562aeee7aac0 2023-12-07T21:09:17.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.808+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94742396836528] v31'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5ac005b040 con 0x562aeee7aac0 2023-12-07T21:09:17.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.808+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94742394404688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee97c40 con 0x7f5ab8017050 2023-12-07T21:09:17.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.808+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94742394404688] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.809+0000 7f5acab1f800 20 remove_watcher() i=0 2023-12-07T21:09:17.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.809+0000 7f5acab1f800 2 removed watcher, disabling cache 2023-12-07T21:09:17.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.809+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94742396816144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee97c40 con 0x562aeee7aac0 2023-12-07T21:09:17.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.810+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94742396816144] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac005b040 con 0x562aeee7aac0 2023-12-07T21:09:17.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.810+0000 7f5acab1f800 20 remove_watcher() i=1 2023-12-07T21:09:17.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.810+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94742396821664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee97c40 con 0x562aeee80be0 2023-12-07T21:09:17.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.811+0000 7f5ac6754640 1 -- 172.21.15.121:0/4253274803 <== osd.3 v2:172.21.15.121:6800/4032235766 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94742396821664] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab8014070 con 0x562aeee80be0 2023-12-07T21:09:17.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.811+0000 7f5acab1f800 20 remove_watcher() i=2 2023-12-07T21:09:17.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.811+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94742396826704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee97c40 con 0x7f5ab8017050 2023-12-07T21:09:17.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.812+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94742396826704] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ab0052840 con 0x7f5ab8017050 2023-12-07T21:09:17.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.812+0000 7f5acab1f800 20 remove_watcher() i=3 2023-12-07T21:09:17.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.812+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94742396832096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee97c40 con 0x562aeee7aac0 2023-12-07T21:09:17.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.813+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94742396832096] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac005b040 con 0x562aeee7aac0 2023-12-07T21:09:17.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.813+0000 7f5acab1f800 20 remove_watcher() i=4 2023-12-07T21:09:17.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.813+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94742396829744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee97c40 con 0x7f5ab005ca90 2023-12-07T21:09:17.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.814+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94742396829744] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac005b040 con 0x7f5ab005ca90 2023-12-07T21:09:17.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.814+0000 7f5acab1f800 20 remove_watcher() i=5 2023-12-07T21:09:17.808 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.814+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94742396838528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee97c40 con 0x7f5ab005ca90 2023-12-07T21:09:17.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.815+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94742396838528] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac005b040 con 0x7f5ab005ca90 2023-12-07T21:09:17.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.815+0000 7f5acab1f800 20 remove_watcher() i=6 2023-12-07T21:09:17.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.815+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94742396840752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x562aeee97c40 con 0x7f5ab005ca90 2023-12-07T21:09:17.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5ac6f55640 1 -- 172.21.15.121:0/4253274803 <== osd.0 v2:172.21.15.89:6800/654939948 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94742396840752] v31'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ac005b040 con 0x7f5ab005ca90 2023-12-07T21:09:17.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 20 remove_watcher() i=7 2023-12-07T21:09:17.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f5ab005ca90 msgr2=0x7f5ab00673d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f5ab005ca90 0x7f5ab00673d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562aeee7aac0 msgr2=0x562aeee7cf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562aeee7aac0 0x562aeee7cf80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f5ab8017050 msgr2=0x7f5ab80229b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f5ab8017050 0x7f5ab80229b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562aeee80be0 msgr2=0x562aeee83050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562aeee80be0 0x562aeee83050 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5aa00360c0 msgr2=0x7f5aa0038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5aa00360c0 0x7f5aa0038580 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0054000 tx=0x7f5ab004e000 comp rx=0 tx=0).stop 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 msgr2=0x562aeee6f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 --2- 172.21.15.121:0/4253274803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeee684c0 0x562aeee6f410 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000ae40 tx=0x7f5ac0003370 comp rx=0 tx=0).stop 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 reap_dead start 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5abdf53640 1 -- 172.21.15.121:0/4253274803 reap_dead start 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 shutdown_connections 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 >> 172.21.15.121:0/4253274803 conn(0x562aeedb3540 msgr2=0x562aeee626a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 shutdown_connections 2023-12-07T21:09:17.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.816+0000 7f5acab1f800 1 -- 172.21.15.121:0/4253274803 wait complete. 2023-12-07T21:09:17.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.817+0000 7f5acab1f800 1 -- 172.21.15.121:0/2686172726 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5aa80360c0 msgr2=0x7f5aa8038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.817+0000 7f5acab1f800 1 --2- 172.21.15.121:0/2686172726 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5aa80360c0 0x7f5aa8038580 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8022710 tx=0x7f5ab8018ac0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.817+0000 7f5acab1f800 1 -- 172.21.15.121:0/2686172726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 msgr2=0x562aeee5c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.817+0000 7f5acab1f800 1 --2- 172.21.15.121:0/2686172726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeee5c310 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8000c00 tx=0x7f5ab8000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.817+0000 7f5acab1f800 1 -- 172.21.15.121:0/2686172726 shutdown_connections 2023-12-07T21:09:17.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.817+0000 7f5acab1f800 1 --2- 172.21.15.121:0/2686172726 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5aa80360c0 0x7f5aa8038580 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.817+0000 7f5acab1f800 1 --2- 172.21.15.121:0/2686172726 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562aeedaf100 0x562aeee5c310 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.817+0000 7f5acab1f800 1 -- 172.21.15.121:0/2686172726 >> 172.21.15.121:0/2686172726 conn(0x562aeedaa880 msgr2=0x562aeee52a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.817+0000 7f5acab1f800 1 -- 172.21.15.121:0/2686172726 shutdown_connections 2023-12-07T21:09:17.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.817+0000 7f5acab1f800 1 -- 172.21.15.121:0/2686172726 wait complete. 2023-12-07T21:09:17.814 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-12-07T21:09:17.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2023-12-07T21:09:17.814 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2023-12-07T21:09:17.907 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:17.907 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:17.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.914+0000 7fcab002d800 1 Processor -- start 2023-12-07T21:09:17.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.914+0000 7fcab002d800 1 -- start start 2023-12-07T21:09:17.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.914+0000 7fcab002d800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f5edb1eb30 0x55f5edbacd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.914+0000 7fcab002d800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f5edaf6740 con 0x55f5edbad2a0 2023-12-07T21:09:17.908 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.914+0000 7fcab002d800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f5edabf880 con 0x55f5edb1eb30 2023-12-07T21:09:17.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.915+0000 7fcaab21a640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f5edb1eb30 0x55f5edbacd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.915+0000 7fcaaaa19640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55f5edbad2a0 0x55f5edbaf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55868/0 (socket says 172.21.15.121:55868) 2023-12-07T21:09:17.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.915+0000 7fcaaaa19640 1 -- 172.21.15.121:0/1621862216 learned_addr learned my addr 172.21.15.121:0/1621862216 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:17.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.915+0000 7fcaab21a640 1 -- 172.21.15.121:0/1621862216 >> v1:172.21.15.89:6789/0 conn(0x55f5edbad2a0 legacy=0x55f5edbaf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.909 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.915+0000 7fcaab21a640 1 -- 172.21.15.121:0/1621862216 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5edbb1ff0 con 0x55f5edb1eb30 2023-12-07T21:09:17.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.917+0000 7fcaab21a640 1 --2- 172.21.15.121:0/1621862216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edbacd60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fca9c005fd0 tx=0x7fca9c01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e360c058bc689e73 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.917+0000 7fcaaa218640 1 -- 172.21.15.121:0/1621862216 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca9c052560 con 0x55f5edb1eb30 2023-12-07T21:09:17.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.917+0000 7fcaaa218640 1 -- 172.21.15.121:0/1621862216 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c0526c0 con 0x55f5edb1eb30 2023-12-07T21:09:17.911 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.917+0000 7fcaaa218640 1 -- 172.21.15.121:0/1621862216 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca9c0529e0 con 0x55f5edb1eb30 2023-12-07T21:09:17.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.917+0000 7fcab002d800 1 -- 172.21.15.121:0/1621862216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 msgr2=0x55f5edbacd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.917+0000 7fcab002d800 1 --2- 172.21.15.121:0/1621862216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edbacd60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fca9c005fd0 tx=0x7fca9c01cb90 comp rx=0 tx=0).stop 2023-12-07T21:09:17.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.917+0000 7fcab002d800 1 -- 172.21.15.121:0/1621862216 shutdown_connections 2023-12-07T21:09:17.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.917+0000 7fcab002d800 1 --2- 172.21.15.121:0/1621862216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edbacd60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.917+0000 7fcab002d800 1 -- 172.21.15.121:0/1621862216 >> 172.21.15.121:0/1621862216 conn(0x55f5edba4820 msgr2=0x55f5edba6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.918+0000 7fcab002d800 1 -- 172.21.15.121:0/1621862216 shutdown_connections 2023-12-07T21:09:17.912 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.918+0000 7fcab002d800 1 -- 172.21.15.121:0/1621862216 wait complete. 2023-12-07T21:09:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.918+0000 7fcab002d800 1 Processor -- start 2023-12-07T21:09:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.918+0000 7fcab002d800 1 -- start start 2023-12-07T21:09:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.918+0000 7fcab002d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edc4ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.918+0000 7fcab002d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5edabcdb0 con 0x55f5edb1eb30 2023-12-07T21:09:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.919+0000 7fcaab21a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edc4ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.919+0000 7fcaab21a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edc4ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54944/0 (socket says 172.21.15.121:54944) 2023-12-07T21:09:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.919+0000 7fcaab21a640 1 -- 172.21.15.121:0/3694911730 learned_addr learned my addr 172.21.15.121:0/3694911730 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.919+0000 7fcaab21a640 1 -- 172.21.15.121:0/3694911730 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c00a100 con 0x55f5edb1eb30 2023-12-07T21:09:17.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.919+0000 7fcaab21a640 1 --2- 172.21.15.121:0/3694911730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edc4ee20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fca9c054040 tx=0x7fca9c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8363acad7c2f04f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.919+0000 7fcaa9a17640 1 -- 172.21.15.121:0/3694911730 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca9c052960 con 0x55f5edb1eb30 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.919+0000 7fcaa9a17640 1 -- 172.21.15.121:0/3694911730 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c052ac0 con 0x55f5edb1eb30 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.919+0000 7fcaa9a17640 1 -- 172.21.15.121:0/3694911730 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca9c052d60 con 0x55f5edb1eb30 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcab002d800 1 -- 172.21.15.121:0/3694911730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 msgr2=0x55f5edc4ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcab002d800 1 --2- 172.21.15.121:0/3694911730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edc4ee20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fca9c054040 tx=0x7fca9c04c000 comp rx=0 tx=0).stop 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcab002d800 1 -- 172.21.15.121:0/3694911730 shutdown_connections 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcab002d800 1 --2- 172.21.15.121:0/3694911730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edc4ee20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcab002d800 1 -- 172.21.15.121:0/3694911730 >> 172.21.15.121:0/3694911730 conn(0x55f5edba4820 msgr2=0x55f5edc4aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcab002d800 1 -- 172.21.15.121:0/3694911730 shutdown_connections 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcab002d800 1 -- 172.21.15.121:0/3694911730 wait complete. 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcab002d800 1 Processor -- start 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcab002d800 1 -- start start 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcab002d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edbaa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcab002d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5edab86a0 con 0x55f5edb1eb30 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcaab21a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edbaa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.916 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcaab21a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edbaa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54960/0 (socket says 172.21.15.121:54960) 2023-12-07T21:09:17.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.920+0000 7fcaab21a640 1 -- 172.21.15.121:0/2065968730 learned_addr learned my addr 172.21.15.121:0/2065968730 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.921+0000 7fcaab21a640 1 -- 172.21.15.121:0/2065968730 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5edbb1ff0 con 0x55f5edb1eb30 2023-12-07T21:09:17.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.921+0000 7fcaab21a640 1 --2- 172.21.15.121:0/2065968730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edbaa5f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fca9c052690 tx=0x7fca9c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.921+0000 7fcaa8a15640 1 -- 172.21.15.121:0/2065968730 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca9c06b070 con 0x55f5edb1eb30 2023-12-07T21:09:17.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.921+0000 7fcaa8a15640 1 -- 172.21.15.121:0/2065968730 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c06f3f0 con 0x55f5edb1eb30 2023-12-07T21:09:17.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.921+0000 7fcab002d800 1 -- 172.21.15.121:0/2065968730 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f5edbaab30 con 0x55f5edb1eb30 2023-12-07T21:09:17.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.921+0000 7fcaa8a15640 1 -- 172.21.15.121:0/2065968730 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca9c06f6d0 con 0x55f5edb1eb30 2023-12-07T21:09:17.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.921+0000 7fcab002d800 1 -- 172.21.15.121:0/2065968730 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5edba90d0 con 0x55f5edb1eb30 2023-12-07T21:09:17.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcab002d800 1 Processor -- start 2023-12-07T21:09:17.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcab002d800 1 -- start start 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcab002d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 0x55f5edc649d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcab002d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5eda52890 con 0x55f5edc645b0 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcaa8a15640 1 -- 172.21.15.121:0/2065968730 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fca9c06f830 con 0x55f5edb1eb30 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcaaba1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 0x55f5edc649d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcaaba1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 0x55f5edc649d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54962/0 (socket says 172.21.15.121:54962) 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcaaba1b640 1 -- 172.21.15.121:0/640034096 learned_addr learned my addr 172.21.15.121:0/640034096 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcaa8a15640 1 --2- 172.21.15.121:0/2065968730 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca98036110 0x7fca980385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcaa8a15640 1 -- 172.21.15.121:0/2065968730 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fca9c08d6f0 con 0x55f5edb1eb30 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcaab21a640 1 --2- 172.21.15.121:0/2065968730 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca98036110 0x7fca980385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcaaba1b640 1 -- 172.21.15.121:0/640034096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5edc64f10 con 0x55f5edc645b0 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcaaba1b640 1 --2- 172.21.15.121:0/640034096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 0x55f5edc649d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400a400 tx=0x7fcaa400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479c6edbbff3ae00 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.922+0000 7fcaab21a640 1 --2- 172.21.15.121:0/2065968730 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca98036110 0x7fca980385d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca9c08bc00 tx=0x7fca9c066f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fca927fc640 1 -- 172.21.15.121:0/640034096 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcaa40087e0 con 0x55f5edc645b0 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fca927fc640 1 -- 172.21.15.121:0/640034096 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa4008960 con 0x55f5edc645b0 2023-12-07T21:09:17.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fca927fc640 1 -- 172.21.15.121:0/640034096 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcaa4008c80 con 0x55f5edc645b0 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fcab002d800 1 -- 172.21.15.121:0/640034096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 msgr2=0x55f5edc649d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fcab002d800 1 --2- 172.21.15.121:0/640034096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 0x55f5edc649d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400a400 tx=0x7fcaa400a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fcab002d800 1 -- 172.21.15.121:0/640034096 shutdown_connections 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fcab002d800 1 --2- 172.21.15.121:0/640034096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 0x55f5edc649d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fcab002d800 1 -- 172.21.15.121:0/640034096 >> 172.21.15.121:0/640034096 conn(0x55f5edbad2a0 msgr2=0x55f5edc5f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fcab002d800 1 -- 172.21.15.121:0/640034096 shutdown_connections 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fcab002d800 1 -- 172.21.15.121:0/640034096 wait complete. 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fcab002d800 1 Processor -- start 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.923+0000 7fcab002d800 1 -- start start 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fcab002d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 0x55f5edc6b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fcab002d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5eda52530 con 0x55f5edc645b0 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fcaaba1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 0x55f5edc6b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fcaaba1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 0x55f5edc6b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54970/0 (socket says 172.21.15.121:54970) 2023-12-07T21:09:17.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 learned_addr learned my addr 172.21.15.121:0/2221893046 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa4005c90 con 0x55f5edc645b0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fcaaba1b640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 0x55f5edc6b6e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400a900 tx=0x7fcaa4002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fca90ff9640 1 -- 172.21.15.121:0/2221893046 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcaa4013780 con 0x55f5edc645b0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fca90ff9640 1 -- 172.21.15.121:0/2221893046 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa40138e0 con 0x55f5edc645b0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fca90ff9640 1 -- 172.21.15.121:0/2221893046 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcaa4013b80 con 0x55f5edc645b0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f5edc6bc20 con 0x55f5edc645b0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.924+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5edc6c0e0 con 0x55f5edc645b0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.925+0000 7fca90ff9640 1 -- 172.21.15.121:0/2221893046 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fcaa401e420 con 0x55f5edc645b0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.925+0000 7fca90ff9640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca840360c0 0x7fca84038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.925+0000 7fca90ff9640 1 -- 172.21.15.121:0/2221893046 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fcaa404b700 con 0x55f5edc645b0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.926+0000 7fcaaaa19640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca840360c0 0x7fca84038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.926+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.926+0000 7fcab002d800 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f5edc76dd0 0x55f5edc79290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.926+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc799e0 con 0x55f5edc76dd0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.926+0000 7fcaaaa19640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca840360c0 0x7fca84038580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0000f60 tx=0x7fcaa0001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.926+0000 7fcaaba1b640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f5edc76dd0 0x55f5edc79290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.926+0000 7fcaaba1b640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f5edc76dd0 0x55f5edc79290 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.926+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 20 realm 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc79df0 con 0x55f5edc76dd0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7a670 con 0x55f5edc76dd0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7a9d0 con 0x55f5edc76dd0 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7b1d0 con 0x55f5edc76dd0 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 20 searching for the correct realm 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.927+0000 7fcab002d800 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f5edc7cef0 0x55f5edc7f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.928+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc7cef0 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.928+0000 7fcaab21a640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f5edc7cef0 0x55f5edc7f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.928+0000 7fcaab21a640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f5edc7cef0 0x55f5edc7f360 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.928+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.928+0000 7fcaab21a640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fca9c078060 0x7fca9c08d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.928+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fca9c078060 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.928+0000 7fcaaaa19640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fca9c078060 0x7fca9c08d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.929+0000 7fcaaaa19640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fca9c078060 0x7fca9c08d900 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.929+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa0006070 con 0x7fca9c078060 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.929+0000 7fcaaaa19640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fcaa000d3d0 0x7fcaa000d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.929+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fcaa000d3d0 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.929+0000 7fcaaba1b640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fcaa000d3d0 0x7fcaa000d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.929+0000 7fcaaba1b640 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fcaa000d3d0 0x7fcaa000d830 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.930+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.930+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc76dd0 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.930+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.930+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc76dd0 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.930+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.930+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fcaa000d3d0 2023-12-07T21:09:17.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.930+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.930+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fcaa000d3d0 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.931+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.931+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fca9c078060 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.931+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa0006070 con 0x7fca9c078060 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.931+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc7cef0 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.931+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.931+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc76dd0 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.931+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.931+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fcaa000d3d0 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.932+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.932+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc76dd0 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.932+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.932+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fca9c078060 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.932+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fcaa0006070 con 0x7fca9c078060 2023-12-07T21:09:17.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.932+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc7cef0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.932+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.932+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc7cef0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.932+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.932+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fcaa000d3d0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.933+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.933+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc7cef0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.933+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.933+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc7cef0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.933+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.933+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc76dd0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.933+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.933+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc76dd0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.934+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.934+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fcaa000d3d0 2023-12-07T21:09:17.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.934+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.934+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc7cef0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.934+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.934+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fca9c078060 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.934+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa0006070 con 0x7fca9c078060 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.934+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc76dd0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.935+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.935+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fcaa000d3d0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.935+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.935+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc7cef0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.935+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.935+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fcaa000d3d0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.935+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.935+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fca9c078060 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.936+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa0006070 con 0x7fca9c078060 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.936+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc7cef0 2023-12-07T21:09:17.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.936+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.936+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x7fcaa000d3d0 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.936+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.936+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fa30 con 0x55f5edc76dd0 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.936+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.936+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fcaa4053080 con 0x7fca9c078060 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaa0006070 con 0x7fca9c078060 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7bb30 con 0x55f5edc76dd0 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7c380 con 0x55f5edc76dd0 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7c380 con 0x55f5edc7cef0 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 zone default found 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 4 Realm: () 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 zonegroup default 2023-12-07T21:09:17.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.937+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc7fe70 con 0x7fcaa000d3d0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcab002d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc81c30 con 0x55f5edc7cef0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcab002d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc81f90 con 0x55f5edc7cef0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcab002d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcab002d800 20 started sync module instance, tier type = 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcab002d800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:17.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.938+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc81510 con 0x7fca9c078060 2023-12-07T21:09:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.939+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa0006070 con 0x7fca9c078060 2023-12-07T21:09:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.939+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94514742239056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc818c0 con 0x7fca9c078060 2023-12-07T21:09:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.939+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc82800 con 0x55f5edc76dd0 2023-12-07T21:09:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.940+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94514742239056] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa0006070 con 0x7fca9c078060 2023-12-07T21:09:17.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.941+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.941+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94514744660080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc82860 con 0x55f5edc76dd0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.941+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc83320 con 0x55f5edc7cef0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.942+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.942+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94514744667616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc83b70 con 0x55f5edc7cef0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.942+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc84570 con 0x7fca9c078060 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.942+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94514744660080] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.943+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa0026040 con 0x7fca9c078060 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.943+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94514744664928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc84df0 con 0x7fca9c078060 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.943+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc855f0 con 0x55f5edc76dd0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.943+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94514744667616] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.944+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94514744664928] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa0026040 con 0x7fca9c078060 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.944+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.944+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94514744669904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc855f0 con 0x55f5edc76dd0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.944+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc85e40 con 0x7fcaa000d3d0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.945+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.945+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94514744669904] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.945+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94514744677872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc86110 con 0x7fcaa000d3d0 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.945+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc85150 con 0x7fcaa000d3d0 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.946+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94514744677872] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.946+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.946+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94514744676688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc866c0 con 0x7fcaa000d3d0 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.946+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc86f00 con 0x7fcaa000d3d0 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.947+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.947+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94514744682176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc87580 con 0x7fcaa000d3d0 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.947+0000 7fcab002d800 20 add_watcher() i=0 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.947+0000 7fcab002d800 20 add_watcher() i=1 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.947+0000 7fcab002d800 20 add_watcher() i=2 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.947+0000 7fcab002d800 20 add_watcher() i=3 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.947+0000 7fcab002d800 20 add_watcher() i=4 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.947+0000 7fcab002d800 20 add_watcher() i=5 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.947+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94514744676688] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.947+0000 7fcab002d800 20 add_watcher() i=6 2023-12-07T21:09:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.948+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94514744682176] v31'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.948+0000 7fcab002d800 20 add_watcher() i=7 2023-12-07T21:09:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.948+0000 7fcab002d800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.948+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc8a5b0 con 0x55f5edc76dd0 2023-12-07T21:09:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.948+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.948+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94514744684768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc87990 con 0x55f5edc76dd0 2023-12-07T21:09:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.949+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94514744684768] v31'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.949+0000 7fca717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.950+0000 7fcab002d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.950+0000 7fcab002d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:17.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.950+0000 7fcab002d800 5 note: GC not initialized 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.950+0000 7fc9ebfff640 20 reqs_thread_entry: start 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.950+0000 7fcab002d800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.950+0000 7fcab002d800 20 Filter name: none 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.950+0000 7fc9e9ffb640 20 reqs_thread_entry: start 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.950+0000 7fcab002d800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.950+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.950+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edcbd540 con 0x7fcaa000d3d0 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:17.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edcbbc40 con 0x7fcaa000d3d0 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.951+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~385 in=385b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edcbfe20 con 0x7fcaa000d3d0 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.952+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~385] v31'5 uv5 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.952+0000 7fcab002d800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.952+0000 7fcab002d800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.952+0000 7fcab002d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.952+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94514744912624 in=588b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edcc07f0 con 0x7fca9c078060 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.953+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== watch-notify(notify (1) cookie 94514744664928 notify 133143986194 ret 0) v3 ==== 618+0+0 (crc 0 0 0) 0x55f5edaf6740 con 0x7fca9c078060 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.953+0000 7fca927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94514744664928 notifier 4486 bl.length()=576 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.953+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(65 notify.3 [notify cookie 94514744912624 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcaa0026040 con 0x7fca9c078060 2023-12-07T21:09:17.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.953+0000 7fca927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.953+0000 7fca927fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.953+0000 7fca927fc640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fca800042a0 con 0x7fca9c078060 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.953+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa0026040 con 0x7fca9c078060 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.953+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== watch-notify(notify_complete (2) cookie 94514744912624 notify 133143986194 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcaa000de60 con 0x7fca9c078060 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.953+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edcbbc40 con 0x7fcaa000d3d0 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.954+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v31'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.954+0000 7fcab002d800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.954+0000 7fcab002d800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.954+0000 7fcab002d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.954+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94514744912624 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edcbbc40 con 0x55f5edc7cef0 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.955+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== watch-notify(notify (1) cookie 94514744667616 notify 133143986180 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x7fca9c09d040 con 0x55f5edc7cef0 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.955+0000 7fca927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94514744667616 notifier 4486 bl.length()=192 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.955+0000 7fca927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.955+0000 7fca927fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.955+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(68 notify.2 [notify cookie 94514744912624 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.955+0000 7fca927fc640 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fca80004600 con 0x55f5edc7cef0 2023-12-07T21:09:17.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.955+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.955+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== watch-notify(notify_complete (2) cookie 94514744912624 notify 133143986180 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f5edba90d0 con 0x55f5edc7cef0 2023-12-07T21:09:17.958 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.956+0000 7fca717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.956+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94514744684768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edcbc5a0 con 0x55f5edc76dd0 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.957+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94514744684768] v31'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.957+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94514742239056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edcbc5a0 con 0x7fca9c078060 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.958+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94514742239056] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa0026040 con 0x7fca9c078060 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.958+0000 7fcab002d800 20 remove_watcher() i=0 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.958+0000 7fcab002d800 2 removed watcher, disabling cache 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.958+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94514744660080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edcbc900 con 0x55f5edc76dd0 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.959+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94514744660080] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.959+0000 7fcab002d800 20 remove_watcher() i=1 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.959+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94514744667616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc74070 con 0x55f5edc7cef0 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.960+0000 7fcaab21a640 1 -- 172.21.15.121:0/2221893046 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94514744667616] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca9c0663f0 con 0x55f5edc7cef0 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.960+0000 7fcab002d800 20 remove_watcher() i=2 2023-12-07T21:09:17.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.960+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94514744664928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc74070 con 0x7fca9c078060 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.961+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94514744664928] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa0026040 con 0x7fca9c078060 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.961+0000 7fcab002d800 20 remove_watcher() i=3 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.961+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94514744669904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc74070 con 0x55f5edc76dd0 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.962+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94514744669904] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x55f5edc76dd0 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.962+0000 7fcab002d800 20 remove_watcher() i=4 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.962+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94514744677872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc74070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.963+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94514744677872] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.963+0000 7fcab002d800 20 remove_watcher() i=5 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.963+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94514744676688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc855c0 con 0x7fcaa000d3d0 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.964+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94514744676688] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.964+0000 7fcab002d800 20 remove_watcher() i=6 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.964+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94514744682176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f5edc85150 con 0x7fcaa000d3d0 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcaaba1b640 1 -- 172.21.15.121:0/2221893046 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94514744682176] v31'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaa4024070 con 0x7fcaa000d3d0 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 20 remove_watcher() i=7 2023-12-07T21:09:17.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fcaa000d3d0 msgr2=0x7fcaa000d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fcaa000d3d0 0x7fcaa000d830 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f5edc76dd0 msgr2=0x55f5edc79290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f5edc76dd0 0x55f5edc79290 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fca9c078060 msgr2=0x7fca9c08d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fca9c078060 0x7fca9c08d900 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f5edc7cef0 msgr2=0x55f5edc7f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f5edc7cef0 0x55f5edc7f360 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca840360c0 msgr2=0x7fca84038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca840360c0 0x7fca84038580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0000f60 tx=0x7fcaa0001230 comp rx=0 tx=0).stop 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 msgr2=0x55f5edc6b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 --2- 172.21.15.121:0/2221893046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edc645b0 0x55f5edc6b6e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400a900 tx=0x7fcaa4002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 reap_dead start 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcaaaa19640 1 -- 172.21.15.121:0/2221893046 reap_dead start 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 shutdown_connections 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 >> 172.21.15.121:0/2221893046 conn(0x55f5edbad2a0 msgr2=0x55f5edc5f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 shutdown_connections 2023-12-07T21:09:17.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2221893046 wait complete. 2023-12-07T21:09:17.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2065968730 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca98036110 msgr2=0x7fca980385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 --2- 172.21.15.121:0/2065968730 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca98036110 0x7fca980385d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca9c08bc00 tx=0x7fca9c066f90 comp rx=0 tx=0).stop 2023-12-07T21:09:17.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2065968730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 msgr2=0x55f5edbaa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:17.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 --2- 172.21.15.121:0/2065968730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edbaa5f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fca9c052690 tx=0x7fca9c003330 comp rx=0 tx=0).stop 2023-12-07T21:09:17.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2065968730 shutdown_connections 2023-12-07T21:09:17.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 --2- 172.21.15.121:0/2065968730 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca98036110 0x7fca980385d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 --2- 172.21.15.121:0/2065968730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f5edb1eb30 0x55f5edbaa5f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:17.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.965+0000 7fcab002d800 1 -- 172.21.15.121:0/2065968730 >> 172.21.15.121:0/2065968730 conn(0x55f5edba4820 msgr2=0x55f5edc4db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:17.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.966+0000 7fcab002d800 1 -- 172.21.15.121:0/2065968730 shutdown_connections 2023-12-07T21:09:17.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:17.966+0000 7fcab002d800 1 -- 172.21.15.121:0/2065968730 wait complete. 2023-12-07T21:09:17.966 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:17.966 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-12-07T21:09:17.966 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-12-07T21:09:17.966 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2023-12-07T21:09:18.012 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:18.012 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:18.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.019+0000 7f7af092c800 1 Processor -- start 2023-12-07T21:09:18.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.019+0000 7f7af092c800 1 -- start start 2023-12-07T21:09:18.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.019+0000 7f7af092c800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55fe14c8c670 0x55fe14c8ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.019+0000 7f7af092c800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fe14bd8740 con 0x55fe14c8b330 2023-12-07T21:09:18.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.019+0000 7f7af092c800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fe14ba1880 con 0x55fe14c8c670 2023-12-07T21:09:18.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.020+0000 7f7aec6f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55fe14c8c670 0x55fe14c8ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.020+0000 7f7aec6f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55fe14c8c670 0x55fe14c8ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54980/0 (socket says 172.21.15.121:54980) 2023-12-07T21:09:18.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.020+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2144586527 learned_addr learned my addr 172.21.15.121:0/2144586527 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.020+0000 7f7aebeef640 1 --1- 172.21.15.121:0/2144586527 >> v1:172.21.15.89:6789/0 conn(0x55fe14c8b330 0x55fe14c8b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55880/0 (socket says 172.21.15.121:55880) 2023-12-07T21:09:18.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.020+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2144586527 >> v1:172.21.15.89:6789/0 conn(0x55fe14c8b330 legacy=0x55fe14c8b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.020+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2144586527 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe14c8d160 con 0x55fe14c8c670 2023-12-07T21:09:18.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.022+0000 7f7aec6f0640 1 --2- 172.21.15.121:0/2144586527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8c670 0x55fe14c8ca90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00a6b0 tx=0x7f7adc01ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829f33c139830a51 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.022+0000 7f7aeb6ee640 1 -- 172.21.15.121:0/2144586527 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7adc00a200 con 0x55fe14c8c670 2023-12-07T21:09:18.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.022+0000 7f7aeb6ee640 1 -- 172.21.15.121:0/2144586527 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc00a360 con 0x55fe14c8c670 2023-12-07T21:09:18.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.022+0000 7f7aeb6ee640 1 -- 172.21.15.121:0/2144586527 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7adc0086e0 con 0x55fe14c8c670 2023-12-07T21:09:18.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.022+0000 7f7af092c800 1 -- 172.21.15.121:0/2144586527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8c670 msgr2=0x55fe14c8ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.022+0000 7f7af092c800 1 --2- 172.21.15.121:0/2144586527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8c670 0x55fe14c8ca90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00a6b0 tx=0x7f7adc01ebc0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.023+0000 7f7af092c800 1 -- 172.21.15.121:0/2144586527 shutdown_connections 2023-12-07T21:09:18.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.023+0000 7f7af092c800 1 --2- 172.21.15.121:0/2144586527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8c670 0x55fe14c8ca90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.023+0000 7f7af092c800 1 -- 172.21.15.121:0/2144586527 >> 172.21.15.121:0/2144586527 conn(0x55fe14c85f00 msgr2=0x55fe14c88320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.023+0000 7f7af092c800 1 -- 172.21.15.121:0/2144586527 shutdown_connections 2023-12-07T21:09:18.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.023+0000 7f7af092c800 1 -- 172.21.15.121:0/2144586527 wait complete. 2023-12-07T21:09:18.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.023+0000 7f7af092c800 1 Processor -- start 2023-12-07T21:09:18.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.023+0000 7f7af092c800 1 -- start start 2023-12-07T21:09:18.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.023+0000 7f7af092c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d33480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.023+0000 7f7af092c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe14b9edb0 con 0x55fe14c8b330 2023-12-07T21:09:18.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.024+0000 7f7aec6f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d33480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.024+0000 7f7aec6f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d33480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54992/0 (socket says 172.21.15.121:54992) 2023-12-07T21:09:18.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.024+0000 7f7aec6f0640 1 -- 172.21.15.121:0/114839017 learned_addr learned my addr 172.21.15.121:0/114839017 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.024+0000 7f7aec6f0640 1 -- 172.21.15.121:0/114839017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc005de0 con 0x55fe14c8b330 2023-12-07T21:09:18.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.024+0000 7f7aec6f0640 1 --2- 172.21.15.121:0/114839017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d33480 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7adc056040 tx=0x7f7adc04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2faa988f93623c2c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.024+0000 7f7aeaeed640 1 -- 172.21.15.121:0/114839017 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7adc05d460 con 0x55fe14c8b330 2023-12-07T21:09:18.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.024+0000 7f7aeaeed640 1 -- 172.21.15.121:0/114839017 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc05d600 con 0x55fe14c8b330 2023-12-07T21:09:18.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.024+0000 7f7aeaeed640 1 -- 172.21.15.121:0/114839017 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7adc05d8e0 con 0x55fe14c8b330 2023-12-07T21:09:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7af092c800 1 -- 172.21.15.121:0/114839017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 msgr2=0x55fe14d33480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7af092c800 1 --2- 172.21.15.121:0/114839017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d33480 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7adc056040 tx=0x7f7adc04e000 comp rx=0 tx=0).stop 2023-12-07T21:09:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7af092c800 1 -- 172.21.15.121:0/114839017 shutdown_connections 2023-12-07T21:09:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7af092c800 1 --2- 172.21.15.121:0/114839017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d33480 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7af092c800 1 -- 172.21.15.121:0/114839017 >> 172.21.15.121:0/114839017 conn(0x55fe14c85f00 msgr2=0x55fe14d2ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7af092c800 1 -- 172.21.15.121:0/114839017 shutdown_connections 2023-12-07T21:09:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7af092c800 1 -- 172.21.15.121:0/114839017 wait complete. 2023-12-07T21:09:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7af092c800 1 Processor -- start 2023-12-07T21:09:18.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7af092c800 1 -- start start 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7af092c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d3a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7af092c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe14b9a6a0 con 0x55fe14c8b330 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7aec6f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d3a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7aec6f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d3a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54996/0 (socket says 172.21.15.121:54996) 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7aec6f0640 1 -- 172.21.15.121:0/1423393590 learned_addr learned my addr 172.21.15.121:0/1423393590 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.025+0000 7f7aec6f0640 1 -- 172.21.15.121:0/1423393590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe14c8d160 con 0x55fe14c8b330 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.026+0000 7f7aec6f0640 1 --2- 172.21.15.121:0/1423393590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d3a8a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7adc005570 tx=0x7f7adc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.026+0000 7f7ae9eeb640 1 -- 172.21.15.121:0/1423393590 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7adc05dab0 con 0x55fe14c8b330 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.026+0000 7f7ae9eeb640 1 -- 172.21.15.121:0/1423393590 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc05dc10 con 0x55fe14c8b330 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.026+0000 7f7ae9eeb640 1 -- 172.21.15.121:0/1423393590 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7adc06e400 con 0x55fe14c8b330 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.026+0000 7f7af092c800 1 -- 172.21.15.121:0/1423393590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fe14d3ade0 con 0x55fe14c8b330 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.026+0000 7f7af092c800 1 -- 172.21.15.121:0/1423393590 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe14d3b320 con 0x55fe14c8b330 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.026+0000 7f7af092c800 1 Processor -- start 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.026+0000 7f7af092c800 1 -- start start 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7af092c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d46f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7af092c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe14b34890 con 0x55fe14d46b00 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7ae9eeb640 1 -- 172.21.15.121:0/1423393590 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7adc064040 con 0x55fe14c8b330 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7ae9eeb640 1 --2- 172.21.15.121:0/1423393590 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7ad80360c0 0x7f7ad8038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7aecef1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d46f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7ae9eeb640 1 -- 172.21.15.121:0/1423393590 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f7adc08cd60 con 0x55fe14c8b330 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7aecef1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d46f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55008/0 (socket says 172.21.15.121:55008) 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7aecef1640 1 -- 172.21.15.121:0/1344844039 learned_addr learned my addr 172.21.15.121:0/1344844039 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7aec6f0640 1 --2- 172.21.15.121:0/1423393590 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7ad80360c0 0x7f7ad8038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7aecef1640 1 -- 172.21.15.121:0/1344844039 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe14d47460 con 0x55fe14d46b00 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7aec6f0640 1 --2- 172.21.15.121:0/1423393590 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7ad80360c0 0x7f7ad8038580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7adc05dfd0 tx=0x7f7adc07b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7aecef1640 1 --2- 172.21.15.121:0/1344844039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d46f20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400a430 tx=0x7f7ae400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922f0d10d54bdb68 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.027+0000 7f7ad37fe640 1 -- 172.21.15.121:0/1344844039 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ae4001650 con 0x55fe14d46b00 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7ad37fe640 1 -- 172.21.15.121:0/1344844039 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae40017d0 con 0x55fe14d46b00 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7ad37fe640 1 -- 172.21.15.121:0/1344844039 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ae4001ab0 con 0x55fe14d46b00 2023-12-07T21:09:18.030 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7af092c800 1 -- 172.21.15.121:0/1344844039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 msgr2=0x55fe14d46f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7af092c800 1 --2- 172.21.15.121:0/1344844039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d46f20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400a430 tx=0x7f7ae400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7af092c800 1 -- 172.21.15.121:0/1344844039 shutdown_connections 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7af092c800 1 --2- 172.21.15.121:0/1344844039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d46f20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7af092c800 1 -- 172.21.15.121:0/1344844039 >> 172.21.15.121:0/1344844039 conn(0x55fe14c8c670 msgr2=0x55fe14d41ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7af092c800 1 -- 172.21.15.121:0/1344844039 shutdown_connections 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7af092c800 1 -- 172.21.15.121:0/1344844039 wait complete. 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7af092c800 1 Processor -- start 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7af092c800 1 -- start start 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.028+0000 7f7af092c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d4dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.029+0000 7f7af092c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe14b34530 con 0x55fe14d46b00 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.029+0000 7f7aecef1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d4dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.029+0000 7f7aecef1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d4dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55012/0 (socket says 172.21.15.121:55012) 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.029+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 learned_addr learned my addr 172.21.15.121:0/2365297713 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.029+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae400a0e0 con 0x55fe14d46b00 2023-12-07T21:09:18.031 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.029+0000 7f7aecef1640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d4dad0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400ae40 tx=0x7f7ae4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.029+0000 7f7ad1ffb640 1 -- 172.21.15.121:0/2365297713 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ae40109e0 con 0x55fe14d46b00 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.029+0000 7f7ad1ffb640 1 -- 172.21.15.121:0/2365297713 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae4010b40 con 0x55fe14d46b00 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.029+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fe14d4e010 con 0x55fe14d46b00 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.029+0000 7f7ad1ffb640 1 -- 172.21.15.121:0/2365297713 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ae4010e20 con 0x55fe14d46b00 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.029+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe14d4e470 con 0x55fe14d46b00 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.030+0000 7f7ad1ffb640 1 -- 172.21.15.121:0/2365297713 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7ae4017070 con 0x55fe14d46b00 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.030+0000 7f7ad1ffb640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7ac80360c0 0x7f7ac8038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.030+0000 7f7ad1ffb640 1 -- 172.21.15.121:0/2365297713 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f7ae404ba30 con 0x55fe14d46b00 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.030+0000 7f7aebeef640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7ac80360c0 0x7f7ac8038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.031+0000 7f7aebeef640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7ac80360c0 0x7f7ac8038580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0000f60 tx=0x7f7ae00012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.031+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.031+0000 7f7af092c800 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55fe14d590f0 0x55fe14d5b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.031+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d5bd00 con 0x55fe14d590f0 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.031+0000 7f7aecef1640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55fe14d590f0 0x55fe14d5b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.032 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.031+0000 7f7aecef1640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55fe14d590f0 0x55fe14d5b5b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.031+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ae400fc50 con 0x55fe14d590f0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.031+0000 7f7af092c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.031+0000 7f7af092c800 20 realm 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.031+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.031+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d5c110 con 0x55fe14d590f0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ae400fc50 con 0x55fe14d590f0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7af092c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7af092c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d5c990 con 0x55fe14d590f0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ae400fc50 con 0x55fe14d590f0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7af092c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d5ccf0 con 0x55fe14d590f0 2023-12-07T21:09:18.033 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7ae400fc50 con 0x55fe14d590f0 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7af092c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d5d4f0 con 0x55fe14d590f0 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.032+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7ae400fc50 con 0x55fe14d590f0 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.033+0000 7f7af092c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.033+0000 7f7af092c800 20 searching for the correct realm 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.033+0000 7f7af092c800 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55fe14d5f210 0x55fe14d61680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.033+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d5f210 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.033+0000 7f7aec6f0640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55fe14d5f210 0x55fe14d61680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.033+0000 7f7aec6f0640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55fe14d5f210 0x55fe14d61680 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.033+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc054bb0 con 0x55fe14d5f210 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.033+0000 7f7aec6f0640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7adc0581c0 0x7f7adc0773e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.033+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7adc0581c0 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.033+0000 7f7aebeef640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7adc0581c0 0x7f7adc0773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.034 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.034+0000 7f7aebeef640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7adc0581c0 0x7f7adc0773e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.034+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.034+0000 7f7aebeef640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7ae000f070 0x7f7ae000e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.034+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7ae000f070 2023-12-07T21:09:18.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.034+0000 7f7aecef1640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7ae000f070 0x7f7ae000e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.035 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.034+0000 7f7aecef1640 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7ae000f070 0x7f7ae000e8c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.043 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.035+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae400fc50 con 0x7f7ae000f070 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.035+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d590f0 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.035+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae400fc50 con 0x55fe14d590f0 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.035+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d590f0 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.035+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae400fc50 con 0x55fe14d590f0 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.035+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7ae000f070 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.035+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.035+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7ae000f070 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.035+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.035+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7adc0581c0 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.036+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.036+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d5f210 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.036+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc0585e0 con 0x55fe14d5f210 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.036+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d590f0 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.036+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.044 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.036+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7ae000f070 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.036+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.036+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d590f0 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.037+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.037+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7adc0581c0 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.037+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.037+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d5f210 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.037+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.037+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d5f210 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.037+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.037+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7ae000f070 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.038+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.038+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d5f210 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.038+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.038+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d5f210 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.038+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.045 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.038+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d590f0 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.038+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.038+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d590f0 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.039+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.039+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7ae000f070 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.039+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.039+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d5f210 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.039+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.039+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7adc0581c0 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.039+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.039+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d590f0 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.040+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.040+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7ae000f070 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.040+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.040+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d5f210 2023-12-07T21:09:18.046 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.040+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.040+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7ae000f070 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.040+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.040+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7adc0581c0 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.041+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.041+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d5f210 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.041+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.041+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7ae000f070 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.041+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.041+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x55fe14d590f0 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.041+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.041+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d61d50 con 0x7f7adc0581c0 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:18.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d5de50 con 0x55fe14d590f0 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d5e6a0 con 0x55fe14d590f0 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d62190 con 0x55fe14d5f210 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 zone default found 2023-12-07T21:09:18.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 4 Realm: () 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 zonegroup default 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.042+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d624f0 con 0x7f7ae000f070 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7af092c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d642a0 con 0x55fe14d5f210 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7af092c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d646a0 con 0x55fe14d5f210 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7af092c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7af092c800 20 started sync module instance, tier type = 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7af092c800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.043+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d63b80 con 0x7f7adc0581c0 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.044+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.044+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94549757214544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d63f30 con 0x7f7adc0581c0 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.044+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d64f60 con 0x55fe14d590f0 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.045+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94549757214544] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.045+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.045+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94549759637216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d65000 con 0x55fe14d590f0 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.045+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d65ad0 con 0x55fe14d5f210 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.046+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94549759637216] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.047+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.047+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94549759645104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d65e80 con 0x55fe14d5f210 2023-12-07T21:09:18.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.047+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d667f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.048+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94549759645104] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.048+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.048+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94549759642304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d66ff0 con 0x7f7adc0581c0 2023-12-07T21:09:18.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.048+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d677f0 con 0x55fe14d590f0 2023-12-07T21:09:18.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.049+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94549759642304] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.049+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.049+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94549759652688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d67760 con 0x55fe14d590f0 2023-12-07T21:09:18.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.049+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d684e0 con 0x7f7ae000f070 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.050+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.050+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94549759652688] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.050+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94549759656000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d68450 con 0x7f7ae000f070 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.050+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d67ba0 con 0x7f7ae000f070 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.051+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94549759656000] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.051+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.051+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94549759658128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d68ea0 con 0x7f7ae000f070 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.051+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d696a0 con 0x7f7ae000f070 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.052+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.052+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94549759659952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d69a90 con 0x7f7ae000f070 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.052+0000 7f7af092c800 20 add_watcher() i=0 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.052+0000 7f7af092c800 20 add_watcher() i=1 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.052+0000 7f7af092c800 20 add_watcher() i=2 2023-12-07T21:09:18.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.052+0000 7f7af092c800 20 add_watcher() i=3 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.052+0000 7f7af092c800 20 add_watcher() i=4 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.052+0000 7f7af092c800 20 add_watcher() i=5 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.052+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94549759658128] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.052+0000 7f7af092c800 20 add_watcher() i=6 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.053+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94549759659952] v31'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.053+0000 7f7af092c800 20 add_watcher() i=7 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.053+0000 7f7af092c800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.053+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d67ba0 con 0x55fe14d590f0 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.053+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.053+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94549759661360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d67ba0 con 0x55fe14d590f0 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.054+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94549759661360] v31'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.054+0000 7f7ab27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.054+0000 7f7af092c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.054+0000 7f7af092c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:18.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.054+0000 7f7af092c800 5 note: GC not initialized 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.055+0000 7f7ab17e2640 20 reqs_thread_entry: start 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.055+0000 7f7af092c800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.055+0000 7f7af092c800 20 Filter name: none 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.055+0000 7f7a22ffd640 20 reqs_thread_entry: start 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.055+0000 7f7af092c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.055+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.055+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d9fc10 con 0x7f7ae000f070 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.056+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.056+0000 7f7af092c800 20 rados_obj.operate() r=0 bl.length=385 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.056+0000 7f7af092c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.056+0000 7f7af092c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.056+0000 7f7af092c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da1690 con 0x7f7adc0581c0 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv26 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 : miss 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da30a0 con 0x7f7adc0581c0 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(64 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv24 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.057+0000 7f7af092c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2023-12-07T21:09:18.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.058+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da7990 con 0x7f7adc0581c0 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.059+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(65 foo.buckets [call] v31'27 uv27 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.059+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:66 8.6 8:670db692:root::.bucket.meta.testx%3amyfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14dab540 con 0x7f7ae000f070 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.060+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [create,call,writefull 0~371,setxattr (203)] v31'1 uv1 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.060+0000 7f7af092c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x7 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.060+0000 7f7af092c800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.060+0000 7f7af092c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.060+0000 7f7af092c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1, ofs0, ns] 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.060+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94549759930096 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da9460 con 0x55fe14d590f0 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== watch-notify(notify (1) cookie 94549759652688 notify 133143986187 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x55fe14d4e470 con 0x55fe14d590f0 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7ad37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 94549759652688 notifier 4492 bl.length()=806 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7ad37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x7 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(67 notify.4 [notify cookie 94549759930096 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7ad37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7ad37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7ad37fe640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7ac00042a0 con 0x55fe14d590f0 2023-12-07T21:09:18.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify_complete (2) cookie 94549759930096 notify 133143986187 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fe14d4e010 con 0x55fe14d590f0 2023-12-07T21:09:18.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7af092c800 20 handle_bi_update(): bucket=testx:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_sources= new_sources= 2023-12-07T21:09:18.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7af092c800 20 handle_bi_update(): bucket=testx:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential sources added=[] removed=[] 2023-12-07T21:09:18.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7af092c800 20 handle_bi_update(): bucket=testx:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_dests= new_dests= 2023-12-07T21:09:18.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7af092c800 20 handle_bi_update(): bucket=testx:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential dests added=[] removed=[] 2023-12-07T21:09:18.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.061+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da95e0 con 0x55fe14d590f0 2023-12-07T21:09:18.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.062+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v31'1 uv1 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.062+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da97b0 con 0x55fe14d590f0 2023-12-07T21:09:18.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.063+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v31'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.063+0000 7f7af092c800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2023-12-07T21:09:18.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.063+0000 7f7af092c800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2023-12-07T21:09:18.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.063+0000 7f7af092c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2023-12-07T21:09:18.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.063+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94549759930096 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14dabc40 con 0x55fe14d590f0 2023-12-07T21:09:18.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.063+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== watch-notify(notify (1) cookie 94549759652688 notify 133143986188 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x55fe14d4e010 con 0x55fe14d590f0 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.063+0000 7f7ad37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94549759652688 notifier 4492 bl.length()=348 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.063+0000 7f7ad37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.063+0000 7f7ad37fe640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.063+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(71 notify.4 [notify cookie 94549759930096 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.063+0000 7f7ad37fe640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7ac00042a0 con 0x55fe14d590f0 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.064+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== watch-notify(notify_complete (2) cookie 94549759930096 notify 133143986188 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f7ae400a0e0 con 0x55fe14d590f0 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.064+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.064+0000 7f7af092c800 10 removing default.rgw.meta+root+myfoo from cache 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.064+0000 7f7af092c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.064+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94549759930096 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da0680 con 0x7f7ae000f070 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.064+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== watch-notify(notify (1) cookie 94549759658128 notify 133143986190 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f7ae400a0e0 con 0x7f7ae000f070 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.064+0000 7f7ad2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94549759658128 notifier 4492 bl.length()=149 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.064+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(73 notify.6 [notify cookie 94549759930096 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.064+0000 7f7ad2ffd640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7a30003280 con 0x7f7ae000f070 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.065+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== watch-notify(notify_complete (2) cookie 94549759930096 notify 133143986190 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fe14d47460 con 0x7f7ae000f070 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.065+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(74 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.065+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:75 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da7cf0 con 0x7f7adc0581c0 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.066+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(75 myfoo [call,delete] v31'28 uv28 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.066+0000 7f7af092c800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 from cache 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.066+0000 7f7af092c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1, ofs0, ns] 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.066+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [notify cookie 94549759930096 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da9450 con 0x7f7ae000f070 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.066+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== watch-notify(notify (1) cookie 94549759656000 notify 133143986191 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x55fe14d47460 con 0x7f7ae000f070 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.066+0000 7f7ad2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94549759656000 notifier 4492 bl.length()=206 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.066+0000 7f7ad2ffd640 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7a30003330 con 0x7f7ae000f070 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.066+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(76 notify.5 [notify cookie 94549759930096 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.066+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(77 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.066+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== watch-notify(notify_complete (2) cookie 94549759930096 notify 133143986191 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f7ae401ad10 con 0x7f7ae000f070 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.066+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da9450 con 0x7f7adc0581c0 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.067+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call,delete] v31'29 uv29 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.068+0000 7f7ab27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.068+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94549759661360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d88870 con 0x55fe14d590f0 2023-12-07T21:09:18.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.069+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94549759661360] v31'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.069+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94549757214544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d88870 con 0x7f7adc0581c0 2023-12-07T21:09:18.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.070+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94549757214544] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.070+0000 7f7af092c800 20 remove_watcher() i=0 2023-12-07T21:09:18.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.070+0000 7f7af092c800 2 removed watcher, disabling cache 2023-12-07T21:09:18.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.070+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94549759637216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d88870 con 0x55fe14d590f0 2023-12-07T21:09:18.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.071+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94549759637216] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.071+0000 7f7af092c800 20 remove_watcher() i=1 2023-12-07T21:09:18.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.071+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94549759645104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d88870 con 0x55fe14d5f210 2023-12-07T21:09:18.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.072+0000 7f7aec6f0640 1 -- 172.21.15.121:0/2365297713 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94549759645104] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7adc05ca00 con 0x55fe14d5f210 2023-12-07T21:09:18.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.072+0000 7f7af092c800 20 remove_watcher() i=2 2023-12-07T21:09:18.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.072+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94549759642304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da9450 con 0x7f7adc0581c0 2023-12-07T21:09:18.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.073+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94549759642304] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae000f5f0 con 0x7f7adc0581c0 2023-12-07T21:09:18.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.073+0000 7f7af092c800 20 remove_watcher() i=3 2023-12-07T21:09:18.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.073+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94549759652688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14da9450 con 0x55fe14d590f0 2023-12-07T21:09:18.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.074+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94549759652688] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x55fe14d590f0 2023-12-07T21:09:18.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.074+0000 7f7af092c800 20 remove_watcher() i=4 2023-12-07T21:09:18.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.074+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94549759656000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d67350 con 0x7f7ae000f070 2023-12-07T21:09:18.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.075+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94549759656000] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.075+0000 7f7af092c800 20 remove_watcher() i=5 2023-12-07T21:09:18.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.075+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94549759658128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d67350 con 0x7f7ae000f070 2023-12-07T21:09:18.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.076+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94549759658128] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.076+0000 7f7af092c800 20 remove_watcher() i=6 2023-12-07T21:09:18.071 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.076+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94549759659952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55fe14d67350 con 0x7f7ae000f070 2023-12-07T21:09:18.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7aecef1640 1 -- 172.21.15.121:0/2365297713 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94549759659952] v31'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ae4038040 con 0x7f7ae000f070 2023-12-07T21:09:18.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 20 remove_watcher() i=7 2023-12-07T21:09:18.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7ae000f070 msgr2=0x7f7ae000e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7ae000f070 0x7f7ae000e8c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55fe14d590f0 msgr2=0x55fe14d5b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55fe14d590f0 0x55fe14d5b5b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7adc0581c0 msgr2=0x7f7adc0773e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7adc0581c0 0x7f7adc0773e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55fe14d5f210 msgr2=0x55fe14d61680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.073 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55fe14d5f210 0x55fe14d61680 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7ac80360c0 msgr2=0x7f7ac8038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7ac80360c0 0x7f7ac8038580 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0000f60 tx=0x7f7ae00012f0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 msgr2=0x55fe14d4dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d4dad0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7ae400ae40 tx=0x7f7ae4003370 comp rx=0 tx=0).stop 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7aebeef640 1 -- 172.21.15.121:0/2365297713 reap_dead start 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 shutdown_connections 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 --2- 172.21.15.121:0/2365297713 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14d46b00 0x55fe14d4dad0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 >> 172.21.15.121:0/2365297713 conn(0x55fe14c8c670 msgr2=0x55fe14d40ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 shutdown_connections 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/2365297713 wait complete. 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/1423393590 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7ad80360c0 msgr2=0x7f7ad8038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 --2- 172.21.15.121:0/1423393590 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7ad80360c0 0x7f7ad8038580 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7adc05dfd0 tx=0x7f7adc07b040 comp rx=0 tx=0).stop 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/1423393590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 msgr2=0x55fe14d3a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.074 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 --2- 172.21.15.121:0/1423393590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d3a8a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7adc005570 tx=0x7f7adc002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/1423393590 shutdown_connections 2023-12-07T21:09:18.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 --2- 172.21.15.121:0/1423393590 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7ad80360c0 0x7f7ad8038580 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 --2- 172.21.15.121:0/1423393590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fe14c8b330 0x55fe14d3a8a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.078+0000 7f7af092c800 1 -- 172.21.15.121:0/1423393590 >> 172.21.15.121:0/1423393590 conn(0x55fe14c85f00 msgr2=0x55fe14d2dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.079+0000 7f7af092c800 1 -- 172.21.15.121:0/1423393590 shutdown_connections 2023-12-07T21:09:18.075 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.079+0000 7f7af092c800 1 -- 172.21.15.121:0/1423393590 wait complete. 2023-12-07T21:09:18.076 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2023-12-07T21:09:18.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2023-12-07T21:09:18.076 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2023-12-07T21:09:18.117 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:18.117 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:18.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.124+0000 7f081ae8c800 1 Processor -- start 2023-12-07T21:09:18.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.124+0000 7f081ae8c800 1 -- start start 2023-12-07T21:09:18.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.124+0000 7f081ae8c800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b65be28b90 0x55b65beb6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.124+0000 7f081ae8c800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b65be007a0 con 0x55b65beb7300 2023-12-07T21:09:18.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.124+0000 7f081ae8c800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b65bdc9880 con 0x55b65be28b90 2023-12-07T21:09:18.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.124+0000 7f081898c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b65be28b90 0x55b65beb6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.124+0000 7f081818b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55b65beb7300 0x55b65beb9790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55894/0 (socket says 172.21.15.121:55894) 2023-12-07T21:09:18.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.124+0000 7f081818b640 1 -- 172.21.15.121:0/2937592433 learned_addr learned my addr 172.21.15.121:0/2937592433 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:18.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.125+0000 7f081898c640 1 -- 172.21.15.121:0/2937592433 >> v1:172.21.15.89:6789/0 conn(0x55b65beb7300 legacy=0x55b65beb9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.125+0000 7f081798a640 1 -- 172.21.15.121:0/2937592433 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904708720 0 0) 0x55b65be007a0 con 0x55b65beb7300 2023-12-07T21:09:18.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.125+0000 7f081898c640 1 -- 172.21.15.121:0/2937592433 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b65bebc050 con 0x55b65be28b90 2023-12-07T21:09:18.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.126+0000 7f081898c640 1 --2- 172.21.15.121:0/2937592433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65beb6dc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f081000a470 tx=0x7f081001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a6a91afeb702e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.127+0000 7f081798a640 1 -- 172.21.15.121:0/2937592433 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0810052570 con 0x55b65be28b90 2023-12-07T21:09:18.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.127+0000 7f081798a640 1 -- 172.21.15.121:0/2937592433 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08100526d0 con 0x55b65be28b90 2023-12-07T21:09:18.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.127+0000 7f081798a640 1 -- 172.21.15.121:0/2937592433 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0810052990 con 0x55b65be28b90 2023-12-07T21:09:18.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.127+0000 7f081ae8c800 1 -- 172.21.15.121:0/2937592433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 msgr2=0x55b65beb6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.127+0000 7f081ae8c800 1 --2- 172.21.15.121:0/2937592433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65beb6dc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f081000a470 tx=0x7f081001cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:18.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.127+0000 7f081ae8c800 1 -- 172.21.15.121:0/2937592433 shutdown_connections 2023-12-07T21:09:18.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.127+0000 7f081ae8c800 1 --2- 172.21.15.121:0/2937592433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65beb6dc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.127+0000 7f081ae8c800 1 -- 172.21.15.121:0/2937592433 >> 172.21.15.121:0/2937592433 conn(0x55b65beae880 msgr2=0x55b65beb0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.127+0000 7f081ae8c800 1 -- 172.21.15.121:0/2937592433 shutdown_connections 2023-12-07T21:09:18.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.127+0000 7f081ae8c800 1 -- 172.21.15.121:0/2937592433 wait complete. 2023-12-07T21:09:18.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.128+0000 7f081ae8c800 1 Processor -- start 2023-12-07T21:09:18.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.128+0000 7f081ae8c800 1 -- start start 2023-12-07T21:09:18.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.128+0000 7f081ae8c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65bf58c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.128+0000 7f081ae8c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65bdc6db0 con 0x55b65be28b90 2023-12-07T21:09:18.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.128+0000 7f081898c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65bf58c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.128+0000 7f081898c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65bf58c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55018/0 (socket says 172.21.15.121:55018) 2023-12-07T21:09:18.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.128+0000 7f081898c640 1 -- 172.21.15.121:0/2654680740 learned_addr learned my addr 172.21.15.121:0/2654680740 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.129+0000 7f081898c640 1 -- 172.21.15.121:0/2654680740 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0810005d20 con 0x55b65be28b90 2023-12-07T21:09:18.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.129+0000 7f081898c640 1 --2- 172.21.15.121:0/2654680740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65bf58c40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0810055040 tx=0x7f081004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e2ff22fa2f638b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.129+0000 7f0817189640 1 -- 172.21.15.121:0/2654680740 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f081000a170 con 0x55b65be28b90 2023-12-07T21:09:18.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.129+0000 7f0817189640 1 -- 172.21.15.121:0/2654680740 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081000a2d0 con 0x55b65be28b90 2023-12-07T21:09:18.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.129+0000 7f0817189640 1 -- 172.21.15.121:0/2654680740 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0810052990 con 0x55b65be28b90 2023-12-07T21:09:18.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.129+0000 7f081ae8c800 1 -- 172.21.15.121:0/2654680740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 msgr2=0x55b65bf58c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.129+0000 7f081ae8c800 1 --2- 172.21.15.121:0/2654680740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65bf58c40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0810055040 tx=0x7f081004c000 comp rx=0 tx=0).stop 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081ae8c800 1 -- 172.21.15.121:0/2654680740 shutdown_connections 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081ae8c800 1 --2- 172.21.15.121:0/2654680740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65bf58c40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081ae8c800 1 -- 172.21.15.121:0/2654680740 >> 172.21.15.121:0/2654680740 conn(0x55b65beae880 msgr2=0x55b65bf548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081ae8c800 1 -- 172.21.15.121:0/2654680740 shutdown_connections 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081ae8c800 1 -- 172.21.15.121:0/2654680740 wait complete. 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081ae8c800 1 Processor -- start 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081ae8c800 1 -- start start 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081ae8c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65beb4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081ae8c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65bdc26a0 con 0x55b65be28b90 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081898c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65beb4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081898c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65beb4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55024/0 (socket says 172.21.15.121:55024) 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081898c640 1 -- 172.21.15.121:0/2596159773 learned_addr learned my addr 172.21.15.121:0/2596159773 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.130+0000 7f081898c640 1 -- 172.21.15.121:0/2596159773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b65bebc050 con 0x55b65be28b90 2023-12-07T21:09:18.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.131+0000 7f081898c640 1 --2- 172.21.15.121:0/2596159773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65beb4600 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f081005e040 tx=0x7f0810002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.131+0000 7f0816187640 1 -- 172.21.15.121:0/2596159773 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0810071570 con 0x55b65be28b90 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.131+0000 7f0816187640 1 -- 172.21.15.121:0/2596159773 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08100716f0 con 0x55b65be28b90 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.131+0000 7f081ae8c800 1 -- 172.21.15.121:0/2596159773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b65beb4b40 con 0x55b65be28b90 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.131+0000 7f0816187640 1 -- 172.21.15.121:0/2596159773 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08100719d0 con 0x55b65be28b90 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.131+0000 7f081ae8c800 1 -- 172.21.15.121:0/2596159773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b65beb30d0 con 0x55b65be28b90 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.131+0000 7f081ae8c800 1 Processor -- start 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f081ae8c800 1 -- start start 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f0816187640 1 -- 172.21.15.121:0/2596159773 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0810059070 con 0x55b65be28b90 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f081ae8c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 0x55b65bf6e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f081ae8c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65bd5c890 con 0x55b65bf6e420 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f0816187640 1 --2- 172.21.15.121:0/2596159773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08040360c0 0x7f0804038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f0816187640 1 -- 172.21.15.121:0/2596159773 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f081008d310 con 0x55b65be28b90 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f081918d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 0x55b65bf6e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f081898c640 1 --2- 172.21.15.121:0/2596159773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08040360c0 0x7f0804038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f081918d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 0x55b65bf6e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55040/0 (socket says 172.21.15.121:55040) 2023-12-07T21:09:18.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f081918d640 1 -- 172.21.15.121:0/411020014 learned_addr learned my addr 172.21.15.121:0/411020014 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f081918d640 1 -- 172.21.15.121:0/411020014 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b65bf6ed80 con 0x55b65bf6e420 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f081898c640 1 --2- 172.21.15.121:0/2596159773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08040360c0 0x7f0804038580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0810067fd0 tx=0x7f081007af70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.132+0000 7f081918d640 1 --2- 172.21.15.121:0/411020014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 0x55b65bf6e840 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f080800a430 tx=0x7f080800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b441b6cdbb96430 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f07fffff640 1 -- 172.21.15.121:0/411020014 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0808001650 con 0x55b65bf6e420 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f07fffff640 1 -- 172.21.15.121:0/411020014 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08080017d0 con 0x55b65bf6e420 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f07fffff640 1 -- 172.21.15.121:0/411020014 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0808001ab0 con 0x55b65bf6e420 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f081ae8c800 1 -- 172.21.15.121:0/411020014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 msgr2=0x55b65bf6e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f081ae8c800 1 --2- 172.21.15.121:0/411020014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 0x55b65bf6e840 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f080800a430 tx=0x7f080800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f081ae8c800 1 -- 172.21.15.121:0/411020014 shutdown_connections 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f081ae8c800 1 --2- 172.21.15.121:0/411020014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 0x55b65bf6e840 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f081ae8c800 1 -- 172.21.15.121:0/411020014 >> 172.21.15.121:0/411020014 conn(0x55b65beb7300 msgr2=0x55b65bf69800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f081ae8c800 1 -- 172.21.15.121:0/411020014 shutdown_connections 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f081ae8c800 1 -- 172.21.15.121:0/411020014 wait complete. 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f081ae8c800 1 Processor -- start 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.133+0000 7f081ae8c800 1 -- start start 2023-12-07T21:09:18.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.134+0000 7f081ae8c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 0x55b65bf75530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.134+0000 7f081ae8c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65bd5c530 con 0x55b65bf6e420 2023-12-07T21:09:18.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.134+0000 7f081918d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 0x55b65bf75530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.134+0000 7f081918d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 0x55b65bf75530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55052/0 (socket says 172.21.15.121:55052) 2023-12-07T21:09:18.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.134+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 learned_addr learned my addr 172.21.15.121:0/610331784 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.134+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080800a0e0 con 0x55b65bf6e420 2023-12-07T21:09:18.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.134+0000 7f081918d640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 0x55b65bf75530 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f080800a930 tx=0x7f0808003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.134+0000 7f07fe7fc640 1 -- 172.21.15.121:0/610331784 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0808010900 con 0x55b65bf6e420 2023-12-07T21:09:18.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.134+0000 7f07fe7fc640 1 -- 172.21.15.121:0/610331784 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0808010a60 con 0x55b65bf6e420 2023-12-07T21:09:18.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.134+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b65bf75a70 con 0x55b65bf6e420 2023-12-07T21:09:18.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.134+0000 7f07fe7fc640 1 -- 172.21.15.121:0/610331784 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0808010d20 con 0x55b65bf6e420 2023-12-07T21:09:18.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.135+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b65bf75ed0 con 0x55b65bf6e420 2023-12-07T21:09:18.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.135+0000 7f07fe7fc640 1 -- 172.21.15.121:0/610331784 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0808017030 con 0x55b65bf6e420 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f07fe7fc640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f07f4036110 0x7f07f40385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f07fe7fc640 1 -- 172.21.15.121:0/610331784 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f080804b7d0 con 0x55b65bf6e420 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081818b640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f07f4036110 0x7f07f40385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081ae8c800 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b65bf80be0 0x55b65bf830a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf837f0 con 0x55b65bf80be0 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081918d640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b65bf80be0 0x55b65bf830a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081818b640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f07f4036110 0x7f07f40385d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f080c000c00 tx=0x7f080c001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081918d640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b65bf80be0 0x55b65bf830a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081ae8c800 20 realm 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.136+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf83bc0 con 0x55b65bf80be0 2023-12-07T21:09:18.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf84440 con 0x55b65bf80be0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf847a0 con 0x55b65bf80be0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf840e0 con 0x55b65bf80be0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:18.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 20 searching for the correct realm 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b65bf869f0 0x55b65bf88de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf869f0 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.137+0000 7f081898c640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b65bf869f0 0x55b65bf88de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.138+0000 7f081898c640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b65bf869f0 0x55b65bf88de0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.138+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.138+0000 7f081898c640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0810065050 0x7f08100795b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.138+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f0810065050 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.138+0000 7f081818b640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0810065050 0x7f08100795b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.138+0000 7f081818b640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0810065050 0x7f08100795b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.139+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.139+0000 7f081818b640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f080c00e8a0 0x7f080c00d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.139+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f080c00e8a0 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.139+0000 7f081918d640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f080c00e8a0 0x7f080c00d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.139+0000 7f081918d640 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f080c00e8a0 0x7f080c00d2f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.139+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.139+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf80be0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.140+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.140+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf80be0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.140+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.140+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f080c00e8a0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.140+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.140+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f080c00e8a0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.140+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.140+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f0810065050 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.141+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.141+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf869f0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.141+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.141+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf80be0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.141+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.141+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f080c00e8a0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.141+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.141+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf80be0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.142+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.142+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f0810065050 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.142+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.142+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf869f0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.142+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.142+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf869f0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.142+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.142+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f080c00e8a0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.143+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.143+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf869f0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.143+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.143+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf869f0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.143+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.143+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf80be0 2023-12-07T21:09:18.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.143+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.143+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf80be0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.143+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.143+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f080c00e8a0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.144+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.144+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf869f0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.144+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.144+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f0810065050 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.144+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.144+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf80be0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.145+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.145+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f080c00e8a0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.145+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.145+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf869f0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.145+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.145+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f080c00e8a0 2023-12-07T21:09:18.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.145+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.145+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f0810065050 2023-12-07T21:09:18.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.146+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.146+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf869f0 2023-12-07T21:09:18.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.146+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.146+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x7f080c00e8a0 2023-12-07T21:09:18.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.146+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.146+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89320 con 0x55b65bf80be0 2023-12-07T21:09:18.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0808053080 con 0x7f0810065050 2023-12-07T21:09:18.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:18.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:18.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:18.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:18.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf85670 con 0x55b65bf80be0 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf852f0 con 0x55b65bf80be0 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.147+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf85f40 con 0x55b65bf869f0 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 20 zone default found 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 4 Realm: () 2023-12-07T21:09:18.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 20 zonegroup default 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf89760 con 0x7f080c00e8a0 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8b520 con 0x55b65bf869f0 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.148+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8b880 con 0x55b65bf869f0 2023-12-07T21:09:18.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.149+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.149+0000 7f081ae8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.149+0000 7f081ae8c800 20 started sync module instance, tier type = 2023-12-07T21:09:18.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.149+0000 7f081ae8c800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:18.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.149+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8ae00 con 0x7f0810065050 2023-12-07T21:09:18.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.150+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.150+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94241713012560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8b1b0 con 0x7f0810065050 2023-12-07T21:09:18.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.150+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8c110 con 0x55b65bf80be0 2023-12-07T21:09:18.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.151+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94241713012560] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.151+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.151+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94241715431776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8c150 con 0x55b65bf80be0 2023-12-07T21:09:18.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.151+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8cbc0 con 0x55b65bf869f0 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.152+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94241715431776] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.152+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.152+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94241715439264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8cfa0 con 0x55b65bf869f0 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.152+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8d910 con 0x7f0810065050 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.153+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.153+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94241715439264] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.153+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94241715444928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8e570 con 0x7f0810065050 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.153+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8bc70 con 0x55b65bf80be0 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.154+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94241715444928] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.154+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.154+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94241715445968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8eee0 con 0x55b65bf80be0 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.154+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8f6e0 con 0x7f080c00e8a0 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.155+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.155+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94241715449840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8f980 con 0x7f080c00e8a0 2023-12-07T21:09:18.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.155+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94241715445968] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.155+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8ea80 con 0x7f080c00e8a0 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.156+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94241715449840] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.156+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.156+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94241715448448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8ff30 con 0x7f080c00e8a0 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.156+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf908a0 con 0x7f080c00e8a0 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.157+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.157+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94241715454976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf90cb0 con 0x7f080c00e8a0 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.157+0000 7f081ae8c800 20 add_watcher() i=0 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.157+0000 7f081ae8c800 20 add_watcher() i=1 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.157+0000 7f081ae8c800 20 add_watcher() i=2 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.157+0000 7f081ae8c800 20 add_watcher() i=3 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.157+0000 7f081ae8c800 20 add_watcher() i=4 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.157+0000 7f081ae8c800 20 add_watcher() i=5 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.157+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94241715448448] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.157 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.157+0000 7f081ae8c800 20 add_watcher() i=6 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.160+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94241715454976] v31'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.160+0000 7f081ae8c800 20 add_watcher() i=7 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.160+0000 7f081ae8c800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.160+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8f400 con 0x55b65bf80be0 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.160+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.160+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94241715450880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf90920 con 0x55b65bf80be0 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.161+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94241715450880] v31'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.161+0000 7f07defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.161+0000 7f081ae8c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.161+0000 7f081ae8c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.162+0000 7f081ae8c800 5 note: GC not initialized 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.162+0000 7f07ddfe3640 20 reqs_thread_entry: start 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.162+0000 7f081ae8c800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.162+0000 7f081ae8c800 20 Filter name: none 2023-12-07T21:09:18.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.162+0000 7f074f7fe640 20 reqs_thread_entry: start 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.162+0000 7f081ae8c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.162+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bfc6630 con 0x55b65bf80be0 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.162+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+332 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.162+0000 7f081ae8c800 20 rados_obj.operate() r=0 bl.length=193 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.163+0000 7f07defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.163+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94241715450880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf91150 con 0x55b65bf80be0 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.164+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94241715450880] v31'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.164+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94241713012560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8f400 con 0x7f0810065050 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.165+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94241713012560] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.165+0000 7f081ae8c800 20 remove_watcher() i=0 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.165+0000 7f081ae8c800 2 removed watcher, disabling cache 2023-12-07T21:09:18.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.165+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94241715431776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf91150 con 0x55b65bf80be0 2023-12-07T21:09:18.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.166+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94241715431776] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.166+0000 7f081ae8c800 20 remove_watcher() i=1 2023-12-07T21:09:18.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.166+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94241715439264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf91150 con 0x55b65bf869f0 2023-12-07T21:09:18.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.167+0000 7f081898c640 1 -- 172.21.15.121:0/610331784 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94241715439264] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0810062070 con 0x55b65bf869f0 2023-12-07T21:09:18.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.167+0000 7f081ae8c800 20 remove_watcher() i=2 2023-12-07T21:09:18.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.167+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94241715444928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf914b0 con 0x7f0810065050 2023-12-07T21:09:18.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.168+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94241715444928] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080c00f620 con 0x7f0810065050 2023-12-07T21:09:18.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.168+0000 7f081ae8c800 20 remove_watcher() i=3 2023-12-07T21:09:18.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.168+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94241715445968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf91810 con 0x55b65bf80be0 2023-12-07T21:09:18.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.169+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94241715445968] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x55b65bf80be0 2023-12-07T21:09:18.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.169+0000 7f081ae8c800 20 remove_watcher() i=4 2023-12-07T21:09:18.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.169+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94241715449840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf91810 con 0x7f080c00e8a0 2023-12-07T21:09:18.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.170+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94241715449840] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.170+0000 7f081ae8c800 20 remove_watcher() i=5 2023-12-07T21:09:18.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.170+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94241715448448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf91810 con 0x7f080c00e8a0 2023-12-07T21:09:18.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.171+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94241715448448] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.171+0000 7f081ae8c800 20 remove_watcher() i=6 2023-12-07T21:09:18.165 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.171+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94241715454976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55b65bf8ea80 con 0x7f080c00e8a0 2023-12-07T21:09:18.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081918d640 1 -- 172.21.15.121:0/610331784 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94241715454976] v31'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f080802e9d0 con 0x7f080c00e8a0 2023-12-07T21:09:18.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 20 remove_watcher() i=7 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f080c00e8a0 msgr2=0x7f080c00d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f080c00e8a0 0x7f080c00d2f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b65bf80be0 msgr2=0x55b65bf830a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b65bf80be0 0x55b65bf830a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0810065050 msgr2=0x7f08100795b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0810065050 0x7f08100795b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b65bf869f0 msgr2=0x55b65bf88de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b65bf869f0 0x55b65bf88de0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f07f4036110 msgr2=0x7f07f40385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f07f4036110 0x7f07f40385d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f080c000c00 tx=0x7f080c001330 comp rx=0 tx=0).stop 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 msgr2=0x55b65bf75530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081ae8c800 1 --2- 172.21.15.121:0/610331784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65bf6e420 0x55b65bf75530 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f080800a930 tx=0x7f0808003370 comp rx=0 tx=0).stop 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.172+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 reap_dead start 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081818b640 1 -- 172.21.15.121:0/610331784 reap_dead start 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 shutdown_connections 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 >> 172.21.15.121:0/610331784 conn(0x55b65beb7300 msgr2=0x55b65bf68600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 shutdown_connections 2023-12-07T21:09:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 -- 172.21.15.121:0/610331784 wait complete. 2023-12-07T21:09:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 -- 172.21.15.121:0/2596159773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08040360c0 msgr2=0x7f0804038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 --2- 172.21.15.121:0/2596159773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08040360c0 0x7f0804038580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0810067fd0 tx=0x7f081007af70 comp rx=0 tx=0).stop 2023-12-07T21:09:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 -- 172.21.15.121:0/2596159773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 msgr2=0x55b65beb4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 --2- 172.21.15.121:0/2596159773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65beb4600 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f081005e040 tx=0x7f0810002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 -- 172.21.15.121:0/2596159773 shutdown_connections 2023-12-07T21:09:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 --2- 172.21.15.121:0/2596159773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f08040360c0 0x7f0804038580 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 --2- 172.21.15.121:0/2596159773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b65be28b90 0x55b65beb4600 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 -- 172.21.15.121:0/2596159773 >> 172.21.15.121:0/2596159773 conn(0x55b65beae880 msgr2=0x55b65bf57950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 -- 172.21.15.121:0/2596159773 shutdown_connections 2023-12-07T21:09:18.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.173+0000 7f081ae8c800 1 -- 172.21.15.121:0/2596159773 wait complete. 2023-12-07T21:09:18.170 INFO:teuthology.orchestra.run.smithi121.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"NOm1U61fDhkq6p43BmXHvGmH","ver":2},"mtime":"2023-12-07T21:09:18.064441Z","data":{"bucket":{"name":"myfoo","marker":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","bucket_id":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2023-12-07T21:09:15.863874Z","linked":true,"has_bucket_info":false}} 2023-12-07T21:09:18.170 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'NOm1U61fDhkq6p43BmXHvGmH', 'ver': 2}, 'mtime': '2023-12-07T21:09:18.064441Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'bucket_id': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2023-12-07T21:09:15.863874Z', 'linked': True, 'has_bucket_info': False}} 2023-12-07T21:09:18.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2023-12-07T21:09:18.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2023-12-07T21:09:18.171 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2023-12-07T21:09:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.262+0000 7f651632c800 1 Processor -- start 2023-12-07T21:09:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.262+0000 7f651632c800 1 -- start start 2023-12-07T21:09:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.262+0000 7f651632c800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558f24088b60 0x558f24119210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.262+0000 7f651632c800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558f24060740 con 0x558f24119750 2023-12-07T21:09:18.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.262+0000 7f651632c800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x558f24029880 con 0x558f24088b60 2023-12-07T21:09:18.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.262+0000 7f65120f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558f24088b60 0x558f24119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.262+0000 7f65118ef640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x558f24119750 0x558f2411bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55906/0 (socket says 172.21.15.121:55906) 2023-12-07T21:09:18.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.262+0000 7f65118ef640 1 -- 172.21.15.121:0/321409767 learned_addr learned my addr 172.21.15.121:0/321409767 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:18.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.262+0000 7f65120f0640 1 -- 172.21.15.121:0/321409767 >> v1:172.21.15.89:6789/0 conn(0x558f24119750 legacy=0x558f2411bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.262+0000 7f65110ee640 1 -- 172.21.15.121:0/321409767 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 741418234 0 0) 0x558f24060740 con 0x558f24119750 2023-12-07T21:09:18.257 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.262+0000 7f65120f0640 1 -- 172.21.15.121:0/321409767 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f2411e270 con 0x558f24088b60 2023-12-07T21:09:18.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.264+0000 7f65120f0640 1 --2- 172.21.15.121:0/321409767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f24119210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f650400a470 tx=0x7f650401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97b142c98e965cf server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.264+0000 7f65110ee640 1 -- 172.21.15.121:0/321409767 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6504052570 con 0x558f24088b60 2023-12-07T21:09:18.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.264+0000 7f65110ee640 1 -- 172.21.15.121:0/321409767 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65040526d0 con 0x558f24088b60 2023-12-07T21:09:18.258 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.264+0000 7f65110ee640 1 -- 172.21.15.121:0/321409767 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6504052990 con 0x558f24088b60 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.265+0000 7f651632c800 1 -- 172.21.15.121:0/321409767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 msgr2=0x558f24119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.265+0000 7f651632c800 1 --2- 172.21.15.121:0/321409767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f24119210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f650400a470 tx=0x7f650401cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.265+0000 7f651632c800 1 -- 172.21.15.121:0/321409767 shutdown_connections 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.265+0000 7f651632c800 1 --2- 172.21.15.121:0/321409767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f24119210 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.265+0000 7f651632c800 1 -- 172.21.15.121:0/321409767 >> 172.21.15.121:0/321409767 conn(0x558f2410e890 msgr2=0x558f24110cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.265+0000 7f651632c800 1 -- 172.21.15.121:0/321409767 shutdown_connections 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.265+0000 7f651632c800 1 -- 172.21.15.121:0/321409767 wait complete. 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.266+0000 7f651632c800 1 Processor -- start 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.266+0000 7f651632c800 1 -- start start 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.266+0000 7f651632c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241bae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.266+0000 7f651632c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f24026db0 con 0x558f24088b60 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.266+0000 7f65120f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241bae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.260 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.266+0000 7f65120f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241bae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55072/0 (socket says 172.21.15.121:55072) 2023-12-07T21:09:18.261 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.266+0000 7f65120f0640 1 -- 172.21.15.121:0/1429485913 learned_addr learned my addr 172.21.15.121:0/1429485913 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.266+0000 7f65120f0640 1 -- 172.21.15.121:0/1429485913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504005d20 con 0x558f24088b60 2023-12-07T21:09:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.266+0000 7f65120f0640 1 --2- 172.21.15.121:0/1429485913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241bae90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6504000c00 tx=0x7f650404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6718ee180f0cccef server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f65108ed640 1 -- 172.21.15.121:0/1429485913 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650400a180 con 0x558f24088b60 2023-12-07T21:09:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f65108ed640 1 -- 172.21.15.121:0/1429485913 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650400a2e0 con 0x558f24088b60 2023-12-07T21:09:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f65108ed640 1 -- 172.21.15.121:0/1429485913 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6504052990 con 0x558f24088b60 2023-12-07T21:09:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f651632c800 1 -- 172.21.15.121:0/1429485913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 msgr2=0x558f241bae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f651632c800 1 --2- 172.21.15.121:0/1429485913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241bae90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6504000c00 tx=0x7f650404c000 comp rx=0 tx=0).stop 2023-12-07T21:09:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f651632c800 1 -- 172.21.15.121:0/1429485913 shutdown_connections 2023-12-07T21:09:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f651632c800 1 --2- 172.21.15.121:0/1429485913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241bae90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f651632c800 1 -- 172.21.15.121:0/1429485913 >> 172.21.15.121:0/1429485913 conn(0x558f2410e890 msgr2=0x558f241b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f651632c800 1 -- 172.21.15.121:0/1429485913 shutdown_connections 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f651632c800 1 -- 172.21.15.121:0/1429485913 wait complete. 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f651632c800 1 Processor -- start 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f651632c800 1 -- start start 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f651632c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.267+0000 7f651632c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f240226a0 con 0x558f24088b60 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.268+0000 7f65120f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.268+0000 7f65120f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241c2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55088/0 (socket says 172.21.15.121:55088) 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.268+0000 7f65120f0640 1 -- 172.21.15.121:0/1189636567 learned_addr learned my addr 172.21.15.121:0/1189636567 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.268+0000 7f65120f0640 1 -- 172.21.15.121:0/1189636567 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f2411e270 con 0x558f24088b60 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.268+0000 7f65120f0640 1 --2- 172.21.15.121:0/1189636567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241c2320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f650400a470 tx=0x7f6504002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.268+0000 7f65037fe640 1 -- 172.21.15.121:0/1189636567 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650406a070 con 0x558f24088b60 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.268+0000 7f65037fe640 1 -- 172.21.15.121:0/1189636567 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650405d420 con 0x558f24088b60 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.268+0000 7f65037fe640 1 -- 172.21.15.121:0/1189636567 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650405d700 con 0x558f24088b60 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.268+0000 7f651632c800 1 -- 172.21.15.121:0/1189636567 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558f241c2860 con 0x558f24088b60 2023-12-07T21:09:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.268+0000 7f651632c800 1 -- 172.21.15.121:0/1189636567 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f241c2d40 con 0x558f24088b60 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.269+0000 7f651632c800 1 Processor -- start 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.269+0000 7f651632c800 1 -- start start 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.269+0000 7f651632c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 0x558f241ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.269+0000 7f651632c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f23fbc890 con 0x558f241ce410 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.269+0000 7f65037fe640 1 -- 172.21.15.121:0/1189636567 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f650405d860 con 0x558f24088b60 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.269+0000 7f65037fe640 1 --2- 172.21.15.121:0/1189636567 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f64f4036110 0x7f64f40385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.269+0000 7f65128f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 0x558f241ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.269+0000 7f65037fe640 1 -- 172.21.15.121:0/1189636567 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f650408d180 con 0x558f24088b60 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.269+0000 7f65128f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 0x558f241ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55100/0 (socket says 172.21.15.121:55100) 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.269+0000 7f65128f1640 1 -- 172.21.15.121:0/4229246351 learned_addr learned my addr 172.21.15.121:0/4229246351 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.269+0000 7f65120f0640 1 --2- 172.21.15.121:0/1189636567 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f64f4036110 0x7f64f40385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f65128f1640 1 -- 172.21.15.121:0/4229246351 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f241ced70 con 0x558f241ce410 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f65120f0640 1 --2- 172.21.15.121:0/1189636567 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f64f4036110 0x7f64f40385d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6504052fd0 tx=0x7f650405dc10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f65128f1640 1 --2- 172.21.15.121:0/4229246351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 0x558f241ce830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f650c00a430 tx=0x7f650c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bca55b11256f7f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f65017fa640 1 -- 172.21.15.121:0/4229246351 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650c001650 con 0x558f241ce410 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f65017fa640 1 -- 172.21.15.121:0/4229246351 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c0017d0 con 0x558f241ce410 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f65017fa640 1 -- 172.21.15.121:0/4229246351 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650c001ab0 con 0x558f241ce410 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f651632c800 1 -- 172.21.15.121:0/4229246351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 msgr2=0x558f241ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f651632c800 1 --2- 172.21.15.121:0/4229246351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 0x558f241ce830 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f650c00a430 tx=0x7f650c00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f651632c800 1 -- 172.21.15.121:0/4229246351 shutdown_connections 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f651632c800 1 --2- 172.21.15.121:0/4229246351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 0x558f241ce830 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f651632c800 1 -- 172.21.15.121:0/4229246351 >> 172.21.15.121:0/4229246351 conn(0x558f24119750 msgr2=0x558f241c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f651632c800 1 -- 172.21.15.121:0/4229246351 shutdown_connections 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.270+0000 7f651632c800 1 -- 172.21.15.121:0/4229246351 wait complete. 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.271+0000 7f651632c800 1 Processor -- start 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.271+0000 7f651632c800 1 -- start start 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.271+0000 7f651632c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 0x558f241d5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.271+0000 7f651632c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f23fbc530 con 0x558f241ce410 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.271+0000 7f65128f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 0x558f241d5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.269 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.271+0000 7f65128f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 0x558f241d5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55112/0 (socket says 172.21.15.121:55112) 2023-12-07T21:09:18.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.271+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 learned_addr learned my addr 172.21.15.121:0/2489933523 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.271+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c00a0e0 con 0x558f241ce410 2023-12-07T21:09:18.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.271+0000 7f65128f1640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 0x558f241d5400 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f650c00a930 tx=0x7f650c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.271+0000 7f64f37fe640 1 -- 172.21.15.121:0/2489933523 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650c010900 con 0x558f241ce410 2023-12-07T21:09:18.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.272+0000 7f64f37fe640 1 -- 172.21.15.121:0/2489933523 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c010a60 con 0x558f241ce410 2023-12-07T21:09:18.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.272+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558f241d5940 con 0x558f241ce410 2023-12-07T21:09:18.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.272+0000 7f64f37fe640 1 -- 172.21.15.121:0/2489933523 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f650c010d20 con 0x558f241ce410 2023-12-07T21:09:18.270 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.272+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f241d5da0 con 0x558f241ce410 2023-12-07T21:09:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.272+0000 7f64f37fe640 1 -- 172.21.15.121:0/2489933523 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f650c017030 con 0x558f241ce410 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.272+0000 7f64f37fe640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f64ec036110 0x7f64ec0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.272+0000 7f64f37fe640 1 -- 172.21.15.121:0/2489933523 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f650c04b890 con 0x558f241ce410 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.273+0000 7f65118ef640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f64ec036110 0x7f64ec0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.273+0000 7f65118ef640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f64ec036110 0x7f64ec0385d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6508000c00 tx=0x7f6508001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.273+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.273+0000 7f651632c800 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558f241e0b10 0x558f241e2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.273+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e3720 con 0x558f241e0b10 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.273+0000 7f65128f1640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558f241e0b10 0x558f241e2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.273+0000 7f65128f1640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558f241e0b10 0x558f241e2fd0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 20 realm 2023-12-07T21:09:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e3b30 con 0x558f241e0b10 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e43b0 con 0x558f241e0b10 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e4710 con 0x558f241e0b10 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.274+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e4f10 con 0x558f241e0b10 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.275+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.275+0000 7f651632c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.275+0000 7f651632c800 20 searching for the correct realm 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.275+0000 7f651632c800 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558f241e6c30 0x558f241e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.275+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e6c30 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.275+0000 7f65120f0640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558f241e6c30 0x558f241e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.275+0000 7f65120f0640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558f241e6c30 0x558f241e90c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.275+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.275+0000 7f65120f0640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6504078060 0x7f650404c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.275+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f6504078060 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.275+0000 7f65118ef640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6504078060 0x7f650404c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.276+0000 7f65118ef640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6504078060 0x7f650404c990 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.276+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.276+0000 7f65118ef640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f650800e8a0 0x7f650800d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.276+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f650800e8a0 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.276+0000 7f65128f1640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f650800e8a0 0x7f650800d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.277+0000 7f65128f1640 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f650800e8a0 0x7f650800d2f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.277+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.277+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e0b10 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.277+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.277+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e0b10 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.277+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.277+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f650800e8a0 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.278+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.278+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f650800e8a0 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.278+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.278+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f6504078060 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.278+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.278+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e6c30 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.278+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.278+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e0b10 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.279+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.285 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.279+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f650800e8a0 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.279+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.279+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e0b10 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.279+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.279+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f6504078060 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.279+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.279+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e6c30 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.279+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.279+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e6c30 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.280+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.280+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f650800e8a0 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.280+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.280+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e6c30 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.280+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.280+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e6c30 2023-12-07T21:09:18.286 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.280+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.280+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e0b10 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.281+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.281+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e0b10 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.281+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.281+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f650800e8a0 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.281+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.281+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e6c30 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.281+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.281+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f6504078060 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.282+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.282+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e0b10 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.282+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.282+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f650800e8a0 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.282+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.282+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e6c30 2023-12-07T21:09:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.282+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.282+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f650800e8a0 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.283+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.283+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f6504078060 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.283+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.283+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e6c30 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.283+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.283+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f650800e8a0 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.283+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.283+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x558f241e0b10 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9790 con 0x7f6504078060 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e5870 con 0x558f241e0b10 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e60c0 con 0x558f241e0b10 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.284+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9bd0 con 0x558f241e6c30 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 20 zone default found 2023-12-07T21:09:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 4 Realm: () 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 20 zonegroup default 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241e9f30 con 0x7f650800e8a0 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241ebcf0 con 0x558f241e6c30 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241ec050 con 0x558f241e6c30 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 20 started sync module instance, tier type = 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.285+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241eb5d0 con 0x7f6504078060 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.286+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.286+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94073272254288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241eb980 con 0x7f6504078060 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.286+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241ec940 con 0x558f241e0b10 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.287+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94073272254288] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.288+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.288+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94073274675504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241ec940 con 0x558f241e0b10 2023-12-07T21:09:18.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.288+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241ed370 con 0x558f241e6c30 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.289+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.289+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94073274682992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241edb70 con 0x558f241e6c30 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.289+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241ee5c0 con 0x7f6504078060 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.289+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94073274675504] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.290+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94073274682992] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.290+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.290+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94073274687680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241ed800 con 0x7f6504078060 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.290+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241ef0d0 con 0x558f241e0b10 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.291+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.291+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94073274690544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241ef950 con 0x558f241e0b10 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.291+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241f0320 con 0x7f650800e8a0 2023-12-07T21:09:18.299 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.291+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94073274687680] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.292+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.292+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94073274690544] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.292+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94073274695200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241f02e0 con 0x7f650800e8a0 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.292+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241ef4d0 con 0x7f650800e8a0 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.293+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.293+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94073274692816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241f0b70 con 0x7f650800e8a0 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.293+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241f14e0 con 0x7f650800e8a0 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.293+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94073274695200] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.294+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.294+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94073274692816] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.294+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94073274680480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241f14e0 con 0x7f650800e8a0 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.294+0000 7f651632c800 20 add_watcher() i=0 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.294+0000 7f651632c800 20 add_watcher() i=1 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.294+0000 7f651632c800 20 add_watcher() i=2 2023-12-07T21:09:18.300 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.294+0000 7f651632c800 20 add_watcher() i=3 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.294+0000 7f651632c800 20 add_watcher() i=4 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.294+0000 7f651632c800 20 add_watcher() i=5 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.294+0000 7f651632c800 20 add_watcher() i=6 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.295+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94073274680480] v31'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.295+0000 7f651632c800 20 add_watcher() i=7 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.295+0000 7f651632c800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.295+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241f4510 con 0x558f241e0b10 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.295+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.295+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94073274699840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241f18f0 con 0x558f241e0b10 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.296+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94073274699840] v31'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.296+0000 7f64d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.296+0000 7f651632c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.296+0000 7f651632c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.296+0000 7f651632c800 5 note: GC not initialized 2023-12-07T21:09:18.301 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.296+0000 7f64d27fc640 20 reqs_thread_entry: start 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 20 Filter name: none 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f6443fff640 20 reqs_thread_entry: start 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f242272f0 con 0x558f241e0b10 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24228d70 con 0x558f241e0b10 2023-12-07T21:09:18.302 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+241 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 20 rados_obj.operate() r=0 bl.length=193 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 : miss 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.297+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:64 8.6 8:670db692:root::.bucket.meta.testx%3amyfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f2422a540 con 0x7f650800e8a0 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.298+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv1 ondisk = 0) v8 ==== 338+0+733 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.298+0000 7f651632c800 20 rados_obj.operate() r=0 bl.length=371 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.298+0000 7f651632c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.298+0000 7f651632c800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.298+0000 7f651632c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.298+0000 7f651632c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.298+0000 7f651632c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.298+0000 7f651632c800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2023-12-07T21:09:18.303 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.298+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f2422ead0 con 0x558f241e0b10 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.299+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v31'2 uv2 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.299+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24232390 con 0x7f6504078060 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.300+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [create,call,writefull 0~352,setxattr (123)] v31'30 uv30 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.300+0000 7f651632c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x7 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.300+0000 7f651632c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.300+0000 7f651632c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.300+0000 7f651632c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1, ofs0, ns] 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.300+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94073274958144 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24231e60 con 0x7f650800e8a0 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== watch-notify(notify (1) cookie 94073274695200 notify 133143986192 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x558f241d5da0 con 0x7f650800e8a0 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f65017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94073274695200 notifier 4504 bl.length()=701 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f65017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x7 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f65017fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f65017fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(67 notify.5 [notify cookie 94073274958144 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f65017fa640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f64e40042a0 con 0x7f650800e8a0 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== watch-notify(notify_complete (2) cookie 94073274958144 notify 133143986192 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558f241d5940 con 0x7f650800e8a0 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f651632c800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_sources= new_sources= 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f651632c800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential sources added=[] removed=[] 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f651632c800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_dests= new_dests= 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f651632c800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential dests added=[] removed=[] 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.301+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24231f80 con 0x7f6504078060 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.302+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(69 foo.buckets [call] v31'31 uv31 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.302+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24232ec0 con 0x7f6504078060 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.303+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'32 uv32 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.303+0000 7f651632c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.303+0000 7f651632c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.303+0000 7f651632c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94073274958144 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24232b60 con 0x7f650800e8a0 2023-12-07T21:09:18.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== watch-notify(notify (1) cookie 94073274692816 notify 133143986193 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x558f241d5940 con 0x7f650800e8a0 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f65017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94073274692816 notifier 4504 bl.length()=314 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f65017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f65017fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(71 notify.6 [notify cookie 94073274958144 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f65017fa640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f64e40042a0 con 0x7f650800e8a0 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== watch-notify(notify_complete (2) cookie 94073274958144 notify 133143986193 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f650c00a0e0 con 0x7f650800e8a0 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f651632c800 10 removing default.rgw.meta+root+testx/myfoo from cache 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f651632c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:73 7.d 7:b4812045:::notify.4:head [notify cookie 94073274958144 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24232b60 con 0x558f241e0b10 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== watch-notify(notify (1) cookie 94073274690544 notify 133143986189 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x7f650c00a0e0 con 0x558f241e0b10 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f6500ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94073274690544 notifier 4504 bl.length()=155 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(73 notify.4 [notify cookie 94073274958144 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.304+0000 7f6500ff9640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f644c003280 con 0x558f241e0b10 2023-12-07T21:09:18.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.305+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== watch-notify(notify_complete (2) cookie 94073274958144 notify 133143986189 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x558f241ced70 con 0x558f241e0b10 2023-12-07T21:09:18.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.305+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(74 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.305+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24232b60 con 0x558f241e0b10 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.306+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(75 testx/myfoo [call,delete] v31'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.306+0000 7f651632c800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 from cache 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.306+0000 7f651632c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1, ofs0, ns] 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.306+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 7.d 7:b4812045:::notify.4:head [notify cookie 94073274958144 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24232b60 con 0x558f241e0b10 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.306+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== watch-notify(notify (1) cookie 94073274690544 notify 133143986190 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x558f241ced70 con 0x558f241e0b10 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.306+0000 7f6500ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94073274690544 notifier 4504 bl.length()=212 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.306+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(76 notify.4 [notify cookie 94073274958144 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.306+0000 7f6500ff9640 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f644c003340 con 0x558f241e0b10 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.306+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== watch-notify(notify_complete (2) cookie 94073274958144 notify 133143986190 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f650c01b490 con 0x558f241e0b10 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.306+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(77 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.306+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 8.6 8:670db692:root::.bucket.meta.testx%3amyfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24232b60 con 0x7f650800e8a0 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.308+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(78 .bucket.meta.testx:myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call,delete] v31'2 uv2 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.308+0000 7f64d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.308+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94073274699840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24232b60 con 0x558f241e0b10 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.309+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94073274699840] v31'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.309+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94073272254288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24232b60 con 0x7f6504078060 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.310+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94073272254288] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.310+0000 7f651632c800 20 remove_watcher() i=0 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.310+0000 7f651632c800 2 removed watcher, disabling cache 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.310+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94073274675504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24210170 con 0x558f241e0b10 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.312+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 35 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94073274675504] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.312+0000 7f651632c800 20 remove_watcher() i=1 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.312+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94073274682992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f24210170 con 0x558f241e6c30 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.313+0000 7f65120f0640 1 -- 172.21.15.121:0/2489933523 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94073274682992] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6504059040 con 0x558f241e6c30 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.313+0000 7f651632c800 20 remove_watcher() i=2 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.313+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94073274687680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f2422b740 con 0x7f6504078060 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.314+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94073274687680] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650800f620 con 0x7f6504078060 2023-12-07T21:09:18.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.314+0000 7f651632c800 20 remove_watcher() i=3 2023-12-07T21:09:18.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.314+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94073274690544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f2422b740 con 0x558f241e0b10 2023-12-07T21:09:18.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.315+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.1 v2:172.21.15.121:6808/2140819418 36 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94073274690544] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x558f241e0b10 2023-12-07T21:09:18.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.315+0000 7f651632c800 20 remove_watcher() i=4 2023-12-07T21:09:18.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.315+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94073274695200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241eebf0 con 0x7f650800e8a0 2023-12-07T21:09:18.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.316+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94073274695200] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.316+0000 7f651632c800 20 remove_watcher() i=5 2023-12-07T21:09:18.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.316+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94073274692816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241efe20 con 0x7f650800e8a0 2023-12-07T21:09:18.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.317+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94073274692816] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.317+0000 7f651632c800 20 remove_watcher() i=6 2023-12-07T21:09:18.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.317+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94073274680480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x558f241efe20 con 0x7f650800e8a0 2023-12-07T21:09:18.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f65128f1640 1 -- 172.21.15.121:0/2489933523 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94073274680480] v31'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f650c02e9d0 con 0x7f650800e8a0 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 20 remove_watcher() i=7 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f650800e8a0 msgr2=0x7f650800d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f650800e8a0 0x7f650800d2f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558f241e0b10 msgr2=0x558f241e2fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558f241e0b10 0x558f241e2fd0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6504078060 msgr2=0x7f650404c990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6504078060 0x7f650404c990 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558f241e6c30 msgr2=0x558f241e90c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558f241e6c30 0x558f241e90c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f64ec036110 msgr2=0x7f64ec0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f64ec036110 0x7f64ec0385d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6508000c00 tx=0x7f6508001330 comp rx=0 tx=0).stop 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 msgr2=0x558f241d5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 --2- 172.21.15.121:0/2489933523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f241ce410 0x558f241d5400 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f650c00a930 tx=0x7f650c003370 comp rx=0 tx=0).stop 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 reap_dead start 2023-12-07T21:09:18.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f65118ef640 1 -- 172.21.15.121:0/2489933523 reap_dead start 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 shutdown_connections 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 >> 172.21.15.121:0/2489933523 conn(0x558f24119750 msgr2=0x558f241c85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 shutdown_connections 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/2489933523 wait complete. 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/1189636567 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f64f4036110 msgr2=0x7f64f40385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 --2- 172.21.15.121:0/1189636567 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f64f4036110 0x7f64f40385d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6504052fd0 tx=0x7f650405dc10 comp rx=0 tx=0).stop 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 -- 172.21.15.121:0/1189636567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 msgr2=0x558f241c2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.318+0000 7f651632c800 1 --2- 172.21.15.121:0/1189636567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241c2320 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f650400a470 tx=0x7f6504002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.319+0000 7f651632c800 1 -- 172.21.15.121:0/1189636567 shutdown_connections 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.319+0000 7f651632c800 1 --2- 172.21.15.121:0/1189636567 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f64f4036110 0x7f64f40385d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.319+0000 7f651632c800 1 --2- 172.21.15.121:0/1189636567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558f24088b60 0x558f241c2320 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.319+0000 7f651632c800 1 -- 172.21.15.121:0/1189636567 >> 172.21.15.121:0/1189636567 conn(0x558f2410e890 msgr2=0x558f241b9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.319+0000 7f651632c800 1 -- 172.21.15.121:0/1189636567 shutdown_connections 2023-12-07T21:09:18.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.319+0000 7f651632c800 1 -- 172.21.15.121:0/1189636567 wait complete. 2023-12-07T21:09:18.317 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-12-07T21:09:18.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2023-12-07T21:09:18.317 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2023-12-07T21:09:18.361 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:18.361 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.368+0000 7fc00272c800 1 Processor -- start 2023-12-07T21:09:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.368+0000 7fc00272c800 1 -- start start 2023-12-07T21:09:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.368+0000 7fc00272c800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5611c1c9f290 0x5611c1c9f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.369+0000 7fc00272c800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5611c1beb740 con 0x5611c1ca0450 2023-12-07T21:09:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.369+0000 7fc00272c800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5611c1bb4880 con 0x5611c1c9f290 2023-12-07T21:09:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.369+0000 7fbffe4f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5611c1c9f290 0x5611c1c9f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.369+0000 7fbffdcef640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5611c1ca0450 0x5611c1ca08d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55918/0 (socket says 172.21.15.121:55918) 2023-12-07T21:09:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.369+0000 7fbffdcef640 1 -- 172.21.15.121:0/3411563337 learned_addr learned my addr 172.21.15.121:0/3411563337 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.369+0000 7fbffe4f0640 1 -- 172.21.15.121:0/3411563337 >> v1:172.21.15.89:6789/0 conn(0x5611c1ca0450 legacy=0x5611c1ca08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.363 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.369+0000 7fbffe4f0640 1 -- 172.21.15.121:0/3411563337 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c1c9fd80 con 0x5611c1c9f290 2023-12-07T21:09:18.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.371+0000 7fbffe4f0640 1 --2- 172.21.15.121:0/3411563337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1c9f6b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbff0005fd0 tx=0x7fbff001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543922709524e302 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.371+0000 7fbffd4ee640 1 -- 172.21.15.121:0/3411563337 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff0052560 con 0x5611c1c9f290 2023-12-07T21:09:18.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.371+0000 7fbffd4ee640 1 -- 172.21.15.121:0/3411563337 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff00526c0 con 0x5611c1c9f290 2023-12-07T21:09:18.365 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.371+0000 7fbffd4ee640 1 -- 172.21.15.121:0/3411563337 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff00529e0 con 0x5611c1c9f290 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.371+0000 7fc00272c800 1 -- 172.21.15.121:0/3411563337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 msgr2=0x5611c1c9f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.371+0000 7fc00272c800 1 --2- 172.21.15.121:0/3411563337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1c9f6b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbff0005fd0 tx=0x7fbff001cb90 comp rx=0 tx=0).stop 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.372+0000 7fc00272c800 1 -- 172.21.15.121:0/3411563337 shutdown_connections 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.372+0000 7fc00272c800 1 --2- 172.21.15.121:0/3411563337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1c9f6b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.372+0000 7fc00272c800 1 -- 172.21.15.121:0/3411563337 >> 172.21.15.121:0/3411563337 conn(0x5611c1c9a990 msgr2=0x5611c1c9cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.372+0000 7fc00272c800 1 -- 172.21.15.121:0/3411563337 shutdown_connections 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.372+0000 7fc00272c800 1 -- 172.21.15.121:0/3411563337 wait complete. 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.372+0000 7fc00272c800 1 Processor -- start 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.372+0000 7fc00272c800 1 -- start start 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.372+0000 7fc00272c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d44200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.372+0000 7fc00272c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c1bb1db0 con 0x5611c1c9f290 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.373+0000 7fbffe4f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d44200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.373+0000 7fbffe4f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d44200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55128/0 (socket says 172.21.15.121:55128) 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.373+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2953614344 learned_addr learned my addr 172.21.15.121:0/2953614344 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.367 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.373+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2953614344 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff000a100 con 0x5611c1c9f290 2023-12-07T21:09:18.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.373+0000 7fbffe4f0640 1 --2- 172.21.15.121:0/2953614344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d44200 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbff0054040 tx=0x7fbff004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937fcc06885ab038 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.373+0000 7fbffcced640 1 -- 172.21.15.121:0/2953614344 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff0052960 con 0x5611c1c9f290 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.373+0000 7fbffcced640 1 -- 172.21.15.121:0/2953614344 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff0052ac0 con 0x5611c1c9f290 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.373+0000 7fbffcced640 1 -- 172.21.15.121:0/2953614344 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff0052d60 con 0x5611c1c9f290 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fc00272c800 1 -- 172.21.15.121:0/2953614344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 msgr2=0x5611c1d44200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fc00272c800 1 --2- 172.21.15.121:0/2953614344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d44200 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbff0054040 tx=0x7fbff004c000 comp rx=0 tx=0).stop 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fc00272c800 1 -- 172.21.15.121:0/2953614344 shutdown_connections 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fc00272c800 1 --2- 172.21.15.121:0/2953614344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d44200 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fc00272c800 1 -- 172.21.15.121:0/2953614344 >> 172.21.15.121:0/2953614344 conn(0x5611c1c9a990 msgr2=0x5611c1d3fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fc00272c800 1 -- 172.21.15.121:0/2953614344 shutdown_connections 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fc00272c800 1 -- 172.21.15.121:0/2953614344 wait complete. 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fc00272c800 1 Processor -- start 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fc00272c800 1 -- start start 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fc00272c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d4b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fc00272c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c1bad6a0 con 0x5611c1c9f290 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fbffe4f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d4b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fbffe4f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d4b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55144/0 (socket says 172.21.15.121:55144) 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.374+0000 7fbffe4f0640 1 -- 172.21.15.121:0/3755421596 learned_addr learned my addr 172.21.15.121:0/3755421596 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.375+0000 7fbffe4f0640 1 -- 172.21.15.121:0/3755421596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff004e070 con 0x5611c1c9f290 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.375+0000 7fbffe4f0640 1 --2- 172.21.15.121:0/3755421596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d4b690 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbff0052690 tx=0x7fbff0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.375+0000 7fbfef7fe640 1 -- 172.21.15.121:0/3755421596 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff006b070 con 0x5611c1c9f290 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.375+0000 7fbfef7fe640 1 -- 172.21.15.121:0/3755421596 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff005cce0 con 0x5611c1c9f290 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.375+0000 7fc00272c800 1 -- 172.21.15.121:0/3755421596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5611c1d4bbd0 con 0x5611c1c9f290 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.375+0000 7fbfef7fe640 1 -- 172.21.15.121:0/3755421596 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff006f430 con 0x5611c1c9f290 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.375+0000 7fc00272c800 1 -- 172.21.15.121:0/3755421596 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611c1d4c110 con 0x5611c1c9f290 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fc00272c800 1 Processor -- start 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fc00272c800 1 -- start start 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fbfef7fe640 1 -- 172.21.15.121:0/3755421596 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fbff00663f0 con 0x5611c1c9f290 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fc00272c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d57c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fc00272c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c1b47890 con 0x5611c1d57820 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fbfef7fe640 1 --2- 172.21.15.121:0/3755421596 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbfe0036110 0x7fbfe00385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fbfef7fe640 1 -- 172.21.15.121:0/3755421596 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fbff008d550 con 0x5611c1c9f290 2023-12-07T21:09:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fbffe4f0640 1 --2- 172.21.15.121:0/3755421596 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbfe0036110 0x7fbfe00385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fbffecf1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d57c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fbffecf1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d57c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55156/0 (socket says 172.21.15.121:55156) 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fbffecf1640 1 -- 172.21.15.121:0/2054072501 learned_addr learned my addr 172.21.15.121:0/2054072501 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.376+0000 7fbffe4f0640 1 --2- 172.21.15.121:0/3755421596 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbfe0036110 0x7fbfe00385d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbff0054040 tx=0x7fbff007b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fbffecf1640 1 -- 172.21.15.121:0/2054072501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611c1d58180 con 0x5611c1d57820 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fbffecf1640 1 --2- 172.21.15.121:0/2054072501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d57c40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbff800a400 tx=0x7fbff800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c3dc266e470849 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fbfed7fa640 1 -- 172.21.15.121:0/2054072501 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff80087e0 con 0x5611c1d57820 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fbfed7fa640 1 -- 172.21.15.121:0/2054072501 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff8008960 con 0x5611c1d57820 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fbfed7fa640 1 -- 172.21.15.121:0/2054072501 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff8008c80 con 0x5611c1d57820 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fc00272c800 1 -- 172.21.15.121:0/2054072501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 msgr2=0x5611c1d57c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fc00272c800 1 --2- 172.21.15.121:0/2054072501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d57c40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbff800a400 tx=0x7fbff800a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fc00272c800 1 -- 172.21.15.121:0/2054072501 shutdown_connections 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fc00272c800 1 --2- 172.21.15.121:0/2054072501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d57c40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fc00272c800 1 -- 172.21.15.121:0/2054072501 >> 172.21.15.121:0/2054072501 conn(0x5611c1ca0450 msgr2=0x5611c1d52c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fc00272c800 1 -- 172.21.15.121:0/2054072501 shutdown_connections 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.377+0000 7fc00272c800 1 -- 172.21.15.121:0/2054072501 wait complete. 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.378+0000 7fc00272c800 1 Processor -- start 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.378+0000 7fc00272c800 1 -- start start 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.378+0000 7fc00272c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d5e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.378+0000 7fc00272c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611c1b47530 con 0x5611c1d57820 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.378+0000 7fbffecf1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d5e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.378+0000 7fbffecf1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d5e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55160/0 (socket says 172.21.15.121:55160) 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.378+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 learned_addr learned my addr 172.21.15.121:0/2902513568 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.378+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff8005c90 con 0x5611c1d57820 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.378+0000 7fbffecf1640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d5e730 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbff800a900 tx=0x7fbff8002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.379+0000 7fbfdf7fe640 1 -- 172.21.15.121:0/2902513568 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff8013780 con 0x5611c1d57820 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.379+0000 7fbfdf7fe640 1 -- 172.21.15.121:0/2902513568 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff80138e0 con 0x5611c1d57820 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.379+0000 7fbfdf7fe640 1 -- 172.21.15.121:0/2902513568 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbff8013b80 con 0x5611c1d57820 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.379+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5611c1d5ec70 con 0x5611c1d57820 2023-12-07T21:09:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.379+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611c1d5f130 con 0x5611c1d57820 2023-12-07T21:09:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.379+0000 7fbfdf7fe640 1 -- 172.21.15.121:0/2902513568 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fbff8013ce0 con 0x5611c1d57820 2023-12-07T21:09:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.380+0000 7fbfdf7fe640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbfd8036110 0x7fbfd80385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.380+0000 7fbfdf7fe640 1 -- 172.21.15.121:0/2902513568 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fbff804b690 con 0x5611c1d57820 2023-12-07T21:09:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.380+0000 7fbffdcef640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbfd8036110 0x7fbfd80385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.380+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.380+0000 7fbffdcef640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbfd8036110 0x7fbfd80385d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbff4000f60 tx=0x7fbff4001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.380+0000 7fc00272c800 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5611c1d69e20 0x5611c1d6c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.380+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d6ca30 con 0x5611c1d69e20 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.380+0000 7fbffecf1640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5611c1d69e20 0x5611c1d6c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.380+0000 7fbffecf1640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5611c1d69e20 0x5611c1d6c2e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 20 realm 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d6ce40 con 0x5611c1d69e20 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d6d6c0 con 0x5611c1d69e20 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d6da20 con 0x5611c1d69e20 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.381+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d6e220 con 0x5611c1d69e20 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.382+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.382+0000 7fc00272c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.382+0000 7fc00272c800 20 searching for the correct realm 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.382+0000 7fc00272c800 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5611c1d6ff40 0x5611c1d723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.382+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d6ff40 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.382+0000 7fbffe4f0640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5611c1d6ff40 0x5611c1d723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.382+0000 7fbffe4f0640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5611c1d6ff40 0x5611c1d723b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.382+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.382+0000 7fbffe4f0640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fbff0079060 0x7fbff008d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.382+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff0079060 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.382+0000 7fbffdcef640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fbff0079060 0x7fbff008d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.383+0000 7fbffdcef640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fbff0079060 0x7fbff008d760 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.383+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff4006070 con 0x7fbff0079060 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.383+0000 7fbffdcef640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fbff400d3d0 0x7fbff400d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.383+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff400d3d0 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.383+0000 7fbffecf1640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fbff400d3d0 0x7fbff400d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.383+0000 7fbffecf1640 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fbff400d3d0 0x7fbff400d830 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.384+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.384+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d69e20 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.384+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.384+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d69e20 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.384+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.384+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff400d3d0 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.384+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.384+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff400d3d0 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.385+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.385+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff0079060 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.385+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff4006070 con 0x7fbff0079060 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.385+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d6ff40 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.385+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.385+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d69e20 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.385+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.385+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff400d3d0 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.386+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.386+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d69e20 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.386+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.386+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff0079060 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.386+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbff4006070 con 0x7fbff0079060 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.386+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d6ff40 2023-12-07T21:09:18.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.386+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.386+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d6ff40 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.386+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.386+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff400d3d0 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.387+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.387+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d6ff40 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.387+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.387+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d6ff40 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.387+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.387+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d69e20 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.387+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.387+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d69e20 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.388+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.388+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff400d3d0 2023-12-07T21:09:18.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.388+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.388+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d6ff40 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.388+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.388+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff0079060 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.388+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff4006070 con 0x7fbff0079060 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.388+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d69e20 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.389+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.389+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff400d3d0 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.389+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.389+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d6ff40 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.389+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.389+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff400d3d0 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.389+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.389+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff0079060 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.390+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff4006070 con 0x7fbff0079060 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.390+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d6ff40 2023-12-07T21:09:18.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.390+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.390+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x7fbff400d3d0 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.390+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.390+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72a80 con 0x5611c1d69e20 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.390+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.390+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbff8053080 con 0x7fbff0079060 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbff4006070 con 0x7fbff0079060 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d6eb80 con 0x5611c1d69e20 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d6f3d0 con 0x5611c1d69e20 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d6f3d0 con 0x5611c1d6ff40 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 zone default found 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 4 Realm: () 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:18.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 zonegroup default 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.391+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d72f00 con 0x7fbff400d3d0 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fc00272c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d74ce0 con 0x5611c1d6ff40 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fc00272c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d75040 con 0x5611c1d6ff40 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fc00272c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fc00272c800 20 started sync module instance, tier type = 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fc00272c800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.392+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d745c0 con 0x7fbff0079060 2023-12-07T21:09:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.393+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff4006070 con 0x7fbff0079060 2023-12-07T21:09:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.393+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94634264129360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d75430 con 0x7fbff0079060 2023-12-07T21:09:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.393+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d75c30 con 0x5611c1d69e20 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.394+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94634264129360] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff4006070 con 0x7fbff0079060 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.395+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.395+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94634266542368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d75c30 con 0x5611c1d69e20 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.395+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d76430 con 0x5611c1d6ff40 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.396+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94634266542368] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.396+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.396+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94634266548384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d76790 con 0x5611c1d6ff40 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.396+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d77100 con 0x7fbff0079060 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.397+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94634266548384] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.397+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.397+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94634266549424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d77900 con 0x7fbff0079060 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.397+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d78100 con 0x5611c1d69e20 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.398+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.398+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94634266557808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d787c0 con 0x5611c1d69e20 2023-12-07T21:09:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.398+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94634266549424] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.398+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d78d70 con 0x7fbff400d3d0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.399+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.399+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94634266555488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d78d70 con 0x7fbff400d3d0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.399+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d79bd0 con 0x7fbff400d3d0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.399+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94634266557808] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.400+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94634266555488] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.400+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.400+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94634266562848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d78d70 con 0x7fbff400d3d0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.400+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d79e70 con 0x7fbff400d3d0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.401+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94634266562848] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.401+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.401+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94634266564944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d79e30 con 0x7fbff400d3d0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.401+0000 7fc00272c800 20 add_watcher() i=0 2023-12-07T21:09:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.401+0000 7fc00272c800 20 add_watcher() i=1 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.401+0000 7fc00272c800 20 add_watcher() i=2 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.401+0000 7fc00272c800 20 add_watcher() i=3 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.401+0000 7fc00272c800 20 add_watcher() i=4 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.401+0000 7fc00272c800 20 add_watcher() i=5 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.401+0000 7fc00272c800 20 add_watcher() i=6 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.402+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94634266564944] v31'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.402+0000 7fc00272c800 20 add_watcher() i=7 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.402+0000 7fc00272c800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.402+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d7d220 con 0x5611c1d69e20 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.402+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.402+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94634266559008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d7a700 con 0x5611c1d69e20 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.403+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94634266559008] v31'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.403+0000 7fbfbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.403+0000 7fc00272c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.403+0000 7fc00272c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.403+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d85820 con 0x5611c1d69e20 2023-12-07T21:09:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.405+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.405+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d85c60 con 0x7fbff400d3d0 2023-12-07T21:09:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.406+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'16 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.406+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d86190 con 0x5611c1d6ff40 2023-12-07T21:09:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.407+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.407+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d86b60 con 0x5611c1d69e20 2023-12-07T21:09:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.408+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'135 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.408+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d838e0 con 0x7fbff0079060 2023-12-07T21:09:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.409+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'38 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.409+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d876d0 con 0x5611c1d6ff40 2023-12-07T21:09:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.409+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.410+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d880a0 con 0x5611c1d69e20 2023-12-07T21:09:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.411+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.411+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d88480 con 0x7fbff400d3d0 2023-12-07T21:09:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.412+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.412+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d88480 con 0x7fbff0079060 2023-12-07T21:09:18.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.413+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.413+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d88c80 con 0x5611c1d6ff40 2023-12-07T21:09:18.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.414+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.414+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d89000 con 0x7fbff0079060 2023-12-07T21:09:18.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.415+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'39 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.415+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d89530 con 0x7fbff400d3d0 2023-12-07T21:09:18.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.416+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.416+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d89530 con 0x7fbff0079060 2023-12-07T21:09:18.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.417+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.417+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x7fbff400d3d0 2023-12-07T21:09:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.418+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'31 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.418+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d69e20 2023-12-07T21:09:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.419+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'136 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.419+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d6ff40 2023-12-07T21:09:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.420+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.420+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x7fbff0079060 2023-12-07T21:09:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.421+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'40 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.421+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d6ff40 2023-12-07T21:09:18.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.422+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.422+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d69e20 2023-12-07T21:09:18.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.424+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.424+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d69e20 2023-12-07T21:09:18.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.425+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'137 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.425+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d6ff40 2023-12-07T21:09:18.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.426+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'33 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.420 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.426+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x7fbff0079060 2023-12-07T21:09:18.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.427+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.421 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.427+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d6ff40 2023-12-07T21:09:18.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.428+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.428+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d6ff40 2023-12-07T21:09:18.422 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.429+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.429+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d6ff40 2023-12-07T21:09:18.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.429+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.430+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d6ff40 2023-12-07T21:09:18.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.430+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'26 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.430+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x7fbff400d3d0 2023-12-07T21:09:18.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.431+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.432+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d6ff40 2023-12-07T21:09:18.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.432+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.432+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x7fbff400d3d0 2023-12-07T21:09:18.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.434+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'26 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.434+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x5611c1d6ff40 2023-12-07T21:09:18.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.435+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'34 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.435+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x7fbff400d3d0 2023-12-07T21:09:18.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.436+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'32 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.436+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d899d0 con 0x7fbff0079060 2023-12-07T21:09:18.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.437+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.437+0000 7fbfbe7fc640 20 reqs_thread_entry: start 2023-12-07T21:09:18.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.437+0000 7fc00272c800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:18.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.437+0000 7fc00272c800 20 Filter name: none 2023-12-07T21:09:18.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.437+0000 7fbf2ffff640 20 reqs_thread_entry: start 2023-12-07T21:09:18.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.437+0000 7fc00272c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2023-12-07T21:09:18.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.437+0000 7fc00272c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.437+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1db4990 con 0x7fbff400d3d0 2023-12-07T21:09:18.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.438+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.438+0000 7fc00272c800 20 rados_obj.operate() r=0 bl.length=385 2023-12-07T21:09:18.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.438+0000 7fc00272c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2023-12-07T21:09:18.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.438+0000 7fc00272c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2023-12-07T21:09:18.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.438+0000 7fc00272c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:18.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.438+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1db6dd0 con 0x5611c1d69e20 2023-12-07T21:09:18.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.438+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.438+0000 7fc00272c800 10 removing key index: p5YnriCv1nAtykxBrupQ 2023-12-07T21:09:18.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.438+0000 7fc00272c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-12-07T21:09:18.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.438+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94634266805456 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1db72f0 con 0x5611c1d6ff40 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.439+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== watch-notify(notify (1) cookie 94634266548384 notify 133143986181 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7fbff009e040 con 0x5611c1d6ff40 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.439+0000 7fbfed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94634266548384 notifier 4510 bl.length()=170 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.439+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 28 ==== osd_op_reply(96 notify.2 [notify cookie 94634266805456 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.439+0000 7fbfed7fa640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbfd0004160 con 0x5611c1d6ff40 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.439+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 29 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.439+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 30 ==== watch-notify(notify_complete (2) cookie 94634266805456 notify 133143986181 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5611c1d4c110 con 0x5611c1d6ff40 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.439+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1db5250 con 0x7fbff400d3d0 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.440+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v31'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.440+0000 7fc00272c800 10 removing email index: 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.440+0000 7fc00272c800 10 removing user buckets index 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.440+0000 7fc00272c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2023-12-07T21:09:18.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.440+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [notify cookie 94634266805456 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1db72f0 con 0x5611c1d69e20 2023-12-07T21:09:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.440+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== watch-notify(notify (1) cookie 94634266557808 notify 133143986191 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x5611c1d5f130 con 0x5611c1d69e20 2023-12-07T21:09:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.440+0000 7fbfed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94634266557808 notifier 4510 bl.length()=175 2023-12-07T21:09:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.440+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(99 notify.4 [notify cookie 94634266805456 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.440+0000 7fbfed7fa640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbfd0004160 con 0x5611c1d69e20 2023-12-07T21:09:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.441+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== watch-notify(notify_complete (2) cookie 94634266805456 notify 133143986191 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5611c1d5ec70 con 0x5611c1d69e20 2023-12-07T21:09:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.441+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(100 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.441+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:101 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1db7270 con 0x5611c1d69e20 2023-12-07T21:09:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.442+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(101 testx$tenanteduser.buckets [delete] v31'3 uv3 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.442+0000 7fc00272c800 10 removing user index: testx$tenanteduser 2023-12-07T21:09:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.442+0000 7fc00272c800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2023-12-07T21:09:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.442+0000 7fc00272c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2023-12-07T21:09:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.442+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [notify cookie 94634266805456 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1db6220 con 0x7fbff0079060 2023-12-07T21:09:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.442+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== watch-notify(notify (1) cookie 94634266549424 notify 133143986195 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x5611c1beb740 con 0x7fbff0079060 2023-12-07T21:09:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.442+0000 7fbfecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94634266549424 notifier 4510 bl.length()=167 2023-12-07T21:09:18.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.442+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(102 notify.3 [notify cookie 94634266805456 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.442+0000 7fbfecff9640 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fbf38003280 con 0x7fbff0079060 2023-12-07T21:09:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.442+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== watch-notify(notify_complete (2) cookie 94634266805456 notify 133143986195 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fbff400e6f0 con 0x7fbff0079060 2023-12-07T21:09:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.442+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(103 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.443+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:104 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1db6220 con 0x7fbff400d3d0 2023-12-07T21:09:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.444+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(104 testx$tenanteduser [call,call,delete] v31'8 uv8 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.444+0000 7fbfbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.444+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94634266559008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d82840 con 0x5611c1d69e20 2023-12-07T21:09:18.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.445+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94634266559008] v31'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.445+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94634264129360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d82840 con 0x7fbff0079060 2023-12-07T21:09:18.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.446+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94634264129360] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.446+0000 7fc00272c800 20 remove_watcher() i=0 2023-12-07T21:09:18.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.446+0000 7fc00272c800 2 removed watcher, disabling cache 2023-12-07T21:09:18.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.446+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94634266542368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d82840 con 0x5611c1d69e20 2023-12-07T21:09:18.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.448+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94634266542368] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.448+0000 7fc00272c800 20 remove_watcher() i=1 2023-12-07T21:09:18.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.448+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94634266548384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d82840 con 0x5611c1d6ff40 2023-12-07T21:09:18.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.449+0000 7fbffe4f0640 1 -- 172.21.15.121:0/2902513568 <== osd.3 v2:172.21.15.121:6800/4032235766 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94634266548384] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff007f070 con 0x5611c1d6ff40 2023-12-07T21:09:18.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.449+0000 7fc00272c800 20 remove_watcher() i=2 2023-12-07T21:09:18.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.449+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94634266549424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d82840 con 0x7fbff0079060 2023-12-07T21:09:18.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.450+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 <== osd.2 v2:172.21.15.121:6816/2557538450 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94634266549424] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff4026040 con 0x7fbff0079060 2023-12-07T21:09:18.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.450+0000 7fc00272c800 20 remove_watcher() i=3 2023-12-07T21:09:18.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.450+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94634266557808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d82840 con 0x5611c1d69e20 2023-12-07T21:09:18.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.451+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.1 v2:172.21.15.121:6808/2140819418 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94634266557808] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x5611c1d69e20 2023-12-07T21:09:18.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.451+0000 7fc00272c800 20 remove_watcher() i=4 2023-12-07T21:09:18.445 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.451+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94634266555488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d82840 con 0x7fbff400d3d0 2023-12-07T21:09:18.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.452+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94634266555488] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.452+0000 7fc00272c800 20 remove_watcher() i=5 2023-12-07T21:09:18.446 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.452+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94634266562848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d82840 con 0x7fbff400d3d0 2023-12-07T21:09:18.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.453+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94634266562848] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.453+0000 7fc00272c800 20 remove_watcher() i=6 2023-12-07T21:09:18.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.453+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94634266564944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611c1d82840 con 0x7fbff400d3d0 2023-12-07T21:09:18.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fbffecf1640 1 -- 172.21.15.121:0/2902513568 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94634266564944] v31'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbff8024070 con 0x7fbff400d3d0 2023-12-07T21:09:18.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 20 remove_watcher() i=7 2023-12-07T21:09:18.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fbff400d3d0 msgr2=0x7fbff400d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fbff400d3d0 0x7fbff400d830 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5611c1d69e20 msgr2=0x5611c1d6c2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.449 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5611c1d69e20 0x5611c1d6c2e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fbff0079060 msgr2=0x7fbff008d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fbff0079060 0x7fbff008d760 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5611c1d6ff40 msgr2=0x5611c1d723b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5611c1d6ff40 0x5611c1d723b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbfd8036110 msgr2=0x7fbfd80385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbfd8036110 0x7fbfd80385d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbff4000f60 tx=0x7fbff4001230 comp rx=0 tx=0).stop 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 msgr2=0x5611c1d5e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d5e730 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbff800a900 tx=0x7fbff8002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fbffdcef640 1 -- 172.21.15.121:0/2902513568 reap_dead start 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 shutdown_connections 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 --2- 172.21.15.121:0/2902513568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1d57820 0x5611c1d5e730 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 >> 172.21.15.121:0/2902513568 conn(0x5611c1ca0450 msgr2=0x5611c1d51a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 shutdown_connections 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.454+0000 7fc00272c800 1 -- 172.21.15.121:0/2902513568 wait complete. 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.455+0000 7fc00272c800 1 -- 172.21.15.121:0/3755421596 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbfe0036110 msgr2=0x7fbfe00385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.450 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.455+0000 7fc00272c800 1 --2- 172.21.15.121:0/3755421596 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbfe0036110 0x7fbfe00385d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbff0054040 tx=0x7fbff007b040 comp rx=0 tx=0).stop 2023-12-07T21:09:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.455+0000 7fc00272c800 1 -- 172.21.15.121:0/3755421596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 msgr2=0x5611c1d4b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.455+0000 7fc00272c800 1 --2- 172.21.15.121:0/3755421596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d4b690 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbff0052690 tx=0x7fbff0003330 comp rx=0 tx=0).stop 2023-12-07T21:09:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.455+0000 7fc00272c800 1 -- 172.21.15.121:0/3755421596 shutdown_connections 2023-12-07T21:09:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.455+0000 7fc00272c800 1 --2- 172.21.15.121:0/3755421596 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fbfe0036110 0x7fbfe00385d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.455+0000 7fc00272c800 1 --2- 172.21.15.121:0/3755421596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611c1c9f290 0x5611c1d4b690 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.455+0000 7fc00272c800 1 -- 172.21.15.121:0/3755421596 >> 172.21.15.121:0/3755421596 conn(0x5611c1c9a990 msgr2=0x5611c1d42f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.455+0000 7fc00272c800 1 -- 172.21.15.121:0/3755421596 shutdown_connections 2023-12-07T21:09:18.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.455+0000 7fc00272c800 1 -- 172.21.15.121:0/3755421596 wait complete. 2023-12-07T21:09:18.458 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2023-12-07T21:09:18.464 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2023-12-07T21:09:18.466 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:18.466 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2023-12-07T21:09:18.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2023-12-07T21:09:18.466 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2023-12-07T21:09:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.517+0000 7f100112c800 1 Processor -- start 2023-12-07T21:09:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.517+0000 7f100112c800 1 -- start start 2023-12-07T21:09:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.517+0000 7f100112c800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56240da7d5e0 0x56240da7f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.517+0000 7f100112c800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56240d9c6740 con 0x56240da7a6e0 2023-12-07T21:09:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.517+0000 7f100112c800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x56240d98f880 con 0x56240da7d5e0 2023-12-07T21:09:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.517+0000 7f0ff7fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56240da7d5e0 0x56240da7f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.517+0000 7f0ffcef0640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x56240da7a6e0 0x56240da7ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55924/0 (socket says 172.21.15.121:55924) 2023-12-07T21:09:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.517+0000 7f0ffcef0640 1 -- 172.21.15.121:0/3740668824 learned_addr learned my addr 172.21.15.121:0/3740668824 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.518+0000 7f0ff7fff640 1 -- 172.21.15.121:0/3740668824 >> v1:172.21.15.89:6789/0 conn(0x56240da7a6e0 legacy=0x56240da7ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.518+0000 7f0ff7fff640 1 -- 172.21.15.121:0/3740668824 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56240da80fb0 con 0x56240da7d5e0 2023-12-07T21:09:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.520+0000 7f0ff7fff640 1 --2- 172.21.15.121:0/3740668824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7d5e0 0x56240da7f9d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800a470 tx=0x7f0fe801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922a934f09b2634f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.520+0000 7f0ff77fe640 1 -- 172.21.15.121:0/3740668824 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8052570 con 0x56240da7d5e0 2023-12-07T21:09:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.520+0000 7f0ff77fe640 1 -- 172.21.15.121:0/3740668824 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe80526d0 con 0x56240da7d5e0 2023-12-07T21:09:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.520+0000 7f0ff77fe640 1 -- 172.21.15.121:0/3740668824 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fe8052990 con 0x56240da7d5e0 2023-12-07T21:09:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.520+0000 7f100112c800 1 -- 172.21.15.121:0/3740668824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7d5e0 msgr2=0x56240da7f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.520+0000 7f100112c800 1 --2- 172.21.15.121:0/3740668824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7d5e0 0x56240da7f9d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800a470 tx=0x7f0fe801cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.520+0000 7f100112c800 1 -- 172.21.15.121:0/3740668824 shutdown_connections 2023-12-07T21:09:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.520+0000 7f100112c800 1 --2- 172.21.15.121:0/3740668824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7d5e0 0x56240da7f9d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.520+0000 7f100112c800 1 -- 172.21.15.121:0/3740668824 >> 172.21.15.121:0/3740668824 conn(0x56240da73f70 msgr2=0x56240da76390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.520+0000 7f100112c800 1 -- 172.21.15.121:0/3740668824 shutdown_connections 2023-12-07T21:09:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.520+0000 7f100112c800 1 -- 172.21.15.121:0/3740668824 wait complete. 2023-12-07T21:09:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.521+0000 7f100112c800 1 Processor -- start 2023-12-07T21:09:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.521+0000 7f100112c800 1 -- start start 2023-12-07T21:09:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.521+0000 7f100112c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db1ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.521+0000 7f100112c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240d98cdb0 con 0x56240da7a6e0 2023-12-07T21:09:18.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.521+0000 7f0ffcef0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db1ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.521+0000 7f0ffcef0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db1ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55176/0 (socket says 172.21.15.121:55176) 2023-12-07T21:09:18.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.521+0000 7f0ffcef0640 1 -- 172.21.15.121:0/233292904 learned_addr learned my addr 172.21.15.121:0/233292904 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f0ffcef0640 1 -- 172.21.15.121:0/233292904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe8005d20 con 0x56240da7a6e0 2023-12-07T21:09:18.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f0ffcef0640 1 --2- 172.21.15.121:0/233292904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db1ddb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0001c50 tx=0x7f0ff000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362ee5e7a934e7f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f0ff6ffd640 1 -- 172.21.15.121:0/233292904 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff000e470 con 0x56240da7a6e0 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f0ff6ffd640 1 -- 172.21.15.121:0/233292904 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff000e5d0 con 0x56240da7a6e0 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f0ff6ffd640 1 -- 172.21.15.121:0/233292904 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff000e8d0 con 0x56240da7a6e0 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f100112c800 1 -- 172.21.15.121:0/233292904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 msgr2=0x56240db1ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f100112c800 1 --2- 172.21.15.121:0/233292904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db1ddb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0001c50 tx=0x7f0ff000b6c0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f100112c800 1 -- 172.21.15.121:0/233292904 shutdown_connections 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f100112c800 1 --2- 172.21.15.121:0/233292904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db1ddb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f100112c800 1 -- 172.21.15.121:0/233292904 >> 172.21.15.121:0/233292904 conn(0x56240da73f70 msgr2=0x56240db19a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f100112c800 1 -- 172.21.15.121:0/233292904 shutdown_connections 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.522+0000 7f100112c800 1 -- 172.21.15.121:0/233292904 wait complete. 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.523+0000 7f100112c800 1 Processor -- start 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.523+0000 7f100112c800 1 -- start start 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.523+0000 7f100112c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db25250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.523+0000 7f100112c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240d9886a0 con 0x56240da7a6e0 2023-12-07T21:09:18.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.523+0000 7f0ffcef0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db25250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.523+0000 7f0ffcef0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db25250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55178/0 (socket says 172.21.15.121:55178) 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.523+0000 7f0ffcef0640 1 -- 172.21.15.121:0/1102090935 learned_addr learned my addr 172.21.15.121:0/1102090935 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.523+0000 7f0ffcef0640 1 -- 172.21.15.121:0/1102090935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56240d9c6740 con 0x56240da7a6e0 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.524+0000 7f0ffcef0640 1 --2- 172.21.15.121:0/1102090935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db25250 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0000c00 tx=0x7f0ff0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.524+0000 7f0ff5ffb640 1 -- 172.21.15.121:0/1102090935 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff0021070 con 0x56240da7a6e0 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.524+0000 7f0ff5ffb640 1 -- 172.21.15.121:0/1102090935 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff001a980 con 0x56240da7a6e0 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.524+0000 7f100112c800 1 -- 172.21.15.121:0/1102090935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56240db25790 con 0x56240da7a6e0 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.524+0000 7f0ff5ffb640 1 -- 172.21.15.121:0/1102090935 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff001ac40 con 0x56240da7a6e0 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.524+0000 7f100112c800 1 -- 172.21.15.121:0/1102090935 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56240db25c70 con 0x56240da7a6e0 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.524+0000 7f100112c800 1 Processor -- start 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.524+0000 7f100112c800 1 -- start start 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f100112c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db34b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f100112c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240d922890 con 0x56240db34760 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0ff5ffb640 1 -- 172.21.15.121:0/1102090935 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0ff002f440 con 0x56240da7a6e0 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0ffd6f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db34b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0ffd6f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db34b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55186/0 (socket says 172.21.15.121:55186) 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/3687748861 learned_addr learned my addr 172.21.15.121:0/3687748861 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0ff5ffb640 1 --2- 172.21.15.121:0/1102090935 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0fe0036110 0x7f0fe00385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0ff5ffb640 1 -- 172.21.15.121:0/1102090935 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f0ff004bc00 con 0x56240da7a6e0 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0ffcef0640 1 --2- 172.21.15.121:0/1102090935 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0fe0036110 0x7f0fe00385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/3687748861 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56240db350c0 con 0x56240db34760 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0ffd6f1640 1 --2- 172.21.15.121:0/3687748861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db34b80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800a430 tx=0x7f0ff800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c74f4c9d313e84c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0ffcef0640 1 --2- 172.21.15.121:0/1102090935 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0fe0036110 0x7f0fe00385d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000e5a0 tx=0x7f0ff0017f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0fe77fe640 1 -- 172.21.15.121:0/3687748861 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff8001650 con 0x56240db34760 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0fe77fe640 1 -- 172.21.15.121:0/3687748861 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff80017d0 con 0x56240db34760 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.525+0000 7f0fe77fe640 1 -- 172.21.15.121:0/3687748861 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff8001ab0 con 0x56240db34760 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f100112c800 1 -- 172.21.15.121:0/3687748861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 msgr2=0x56240db34b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f100112c800 1 --2- 172.21.15.121:0/3687748861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db34b80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800a430 tx=0x7f0ff800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f100112c800 1 -- 172.21.15.121:0/3687748861 shutdown_connections 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f100112c800 1 --2- 172.21.15.121:0/3687748861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db34b80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f100112c800 1 -- 172.21.15.121:0/3687748861 >> 172.21.15.121:0/3687748861 conn(0x56240da7d5e0 msgr2=0x56240db2b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f100112c800 1 -- 172.21.15.121:0/3687748861 shutdown_connections 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f100112c800 1 -- 172.21.15.121:0/3687748861 wait complete. 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f100112c800 1 Processor -- start 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f100112c800 1 -- start start 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f100112c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db3b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f100112c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240d922530 con 0x56240db34760 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f0ffd6f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db3b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f0ffd6f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db3b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55198/0 (socket says 172.21.15.121:55198) 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.526+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 learned_addr learned my addr 172.21.15.121:0/4249039621 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.527+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff800a0e0 con 0x56240db34760 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.527+0000 7f0ffd6f1640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db3b750 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800a930 tx=0x7f0ff8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.527+0000 7f0fe5ffb640 1 -- 172.21.15.121:0/4249039621 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff8010900 con 0x56240db34760 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.527+0000 7f0fe5ffb640 1 -- 172.21.15.121:0/4249039621 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff8010a60 con 0x56240db34760 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.527+0000 7f0fe5ffb640 1 -- 172.21.15.121:0/4249039621 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0ff8010d20 con 0x56240db34760 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.527+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56240db3bc90 con 0x56240db34760 2023-12-07T21:09:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.527+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56240db3c0f0 con 0x56240db34760 2023-12-07T21:09:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.528+0000 7f0fe5ffb640 1 -- 172.21.15.121:0/4249039621 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0ff8017030 con 0x56240db34760 2023-12-07T21:09:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.528+0000 7f0fe5ffb640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0fd4036110 0x7f0fd40385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.528+0000 7f0fe5ffb640 1 -- 172.21.15.121:0/4249039621 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f0ff804b7d0 con 0x56240db34760 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.528+0000 7f0ff7fff640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0fd4036110 0x7f0fd40385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.528+0000 7f0ff7fff640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0fd4036110 0x7f0fd40385d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8054000 tx=0x7f0fe804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.528+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f100112c800 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56240db46ea0 0x56240db49360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db49ab0 con 0x56240db46ea0 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f0ffd6f1640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56240db46ea0 0x56240db49360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f0ffd6f1640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56240db46ea0 0x56240db49360 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f100112c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f100112c800 20 realm 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db49ec0 con 0x56240db46ea0 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f100112c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f100112c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.529+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4a740 con 0x56240db46ea0 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f100112c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4aaa0 con 0x56240db46ea0 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f100112c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4b2a0 con 0x56240db46ea0 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f100112c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f100112c800 20 searching for the correct realm 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f100112c800 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56240db4cfc0 0x56240db4f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db4cfc0 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.530+0000 7f0ffcef0640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56240db4cfc0 0x56240db4f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.531+0000 7f0ffcef0640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56240db4cfc0 0x56240db4f450 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.531+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff0014070 con 0x56240db4cfc0 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.531+0000 7f0ffcef0640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0ff0017050 0x7f0ff00165d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.531+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0ff0017050 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.531+0000 7f0ff7fff640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0ff0017050 0x7f0ff00165d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.531+0000 7f0ff7fff640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0ff0017050 0x7f0ff00165d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.532+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fe8052840 con 0x7f0ff0017050 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.532+0000 7f0ff7fff640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0fe805c920 0x7f0fe8009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.532+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0fe805c920 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.532+0000 7f0ffd6f1640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0fe805c920 0x7f0fe8009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.532+0000 7f0ffd6f1640 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0fe805c920 0x7f0fe8009410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.532+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.532+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db46ea0 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.533+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.533+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db46ea0 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.533+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.533+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0fe805c920 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.533+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.533+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0fe805c920 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.533+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.533+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0ff0017050 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.533+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fe8052840 con 0x7f0ff0017050 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.533+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db4cfc0 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.534+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff0014070 con 0x56240db4cfc0 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.534+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db46ea0 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.534+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.534+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0fe805c920 2023-12-07T21:09:18.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.534+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.534+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db46ea0 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.534+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.534+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0ff0017050 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.535+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0fe8052840 con 0x7f0ff0017050 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.535+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db4cfc0 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.535+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff0014070 con 0x56240db4cfc0 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.535+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db4cfc0 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.535+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff0014070 con 0x56240db4cfc0 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.535+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0fe805c920 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.535+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.535+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db4cfc0 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.535+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff0014070 con 0x56240db4cfc0 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.535+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db4cfc0 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.536+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff0014070 con 0x56240db4cfc0 2023-12-07T21:09:18.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.536+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db46ea0 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.536+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.536+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db46ea0 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.536+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.536+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0fe805c920 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.537+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.537+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db4cfc0 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.537+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0ff0014070 con 0x56240db4cfc0 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.537+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0ff0017050 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.537+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fe8052840 con 0x7f0ff0017050 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.537+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db46ea0 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.537+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.537+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0fe805c920 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.537+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.537+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db4cfc0 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.538+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff0014070 con 0x56240db4cfc0 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.538+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0fe805c920 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.538+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.538+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0ff0017050 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.538+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fe8052840 con 0x7f0ff0017050 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.538+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db4cfc0 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.538+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff0014070 con 0x56240db4cfc0 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.538+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x7f0fe805c920 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4fb20 con 0x56240db46ea0 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f0ff8053080 con 0x7f0ff0017050 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0fe8052840 con 0x7f0ff0017050 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f100112c800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f100112c800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f100112c800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f100112c800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f100112c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f100112c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4bc00 con 0x56240db46ea0 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f100112c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.539+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4c450 con 0x56240db46ea0 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4c450 con 0x56240db4cfc0 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0ff0014070 con 0x56240db4cfc0 2023-12-07T21:09:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 20 zone default found 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 4 Realm: () 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 20 zonegroup default 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db4ff60 con 0x7f0fe805c920 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db51cf0 con 0x56240db4cfc0 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.540+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.541+0000 7f100112c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.541+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.541+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db52050 con 0x56240db4cfc0 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.541+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.541+0000 7f100112c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.541+0000 7f100112c800 20 started sync module instance, tier type = 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.541+0000 7f100112c800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.541+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db515d0 con 0x7f0ff0017050 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.542+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fe8052840 con 0x7f0ff0017050 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.542+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94712846360400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db51980 con 0x7f0ff0017050 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.542+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db528e0 con 0x56240db46ea0 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.543+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94712846360400] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.543+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.543+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94712848781616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db528e0 con 0x56240db46ea0 2023-12-07T21:09:18.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.543+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db533b0 con 0x56240db4cfc0 2023-12-07T21:09:18.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.544+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.544+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94712848789136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db53c00 con 0x56240db4cfc0 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.544+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db545e0 con 0x7f0ff0017050 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.544+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94712848781616] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.545+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94712848789136] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.545+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.545+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94712848793856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db53870 con 0x7f0ff0017050 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.545+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db550a0 con 0x56240db46ea0 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.546+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.546+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94712848796512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db558f0 con 0x56240db46ea0 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.546+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94712848793856] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.546+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db52460 con 0x7f0fe805c920 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.547+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94712848796512] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.548+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.548+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94712848798672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db557e0 con 0x7f0fe805c920 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.548+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db56700 con 0x7f0fe805c920 2023-12-07T21:09:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.548+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94712848798672] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.549+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.549+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94712848801216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db56670 con 0x7f0fe805c920 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.549+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db56e70 con 0x7f0fe805c920 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.549+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.549+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94712848803920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db572c0 con 0x7f0fe805c920 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.549+0000 7f100112c800 20 add_watcher() i=0 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.549+0000 7f100112c800 20 add_watcher() i=1 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.549+0000 7f100112c800 20 add_watcher() i=2 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.549+0000 7f100112c800 20 add_watcher() i=3 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.549+0000 7f100112c800 20 add_watcher() i=4 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.549+0000 7f100112c800 20 add_watcher() i=5 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.550+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94712848801216] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.550+0000 7f100112c800 20 add_watcher() i=6 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.550+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94712848803920] v31'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.550+0000 7f100112c800 20 add_watcher() i=7 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.550+0000 7f100112c800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.550+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db561d0 con 0x56240db46ea0 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.551+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.551+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94712848805216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db561d0 con 0x56240db46ea0 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.552+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94712848805216] v31'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.552+0000 7f0fc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.552+0000 7f100112c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.552+0000 7f100112c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.552+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db62860 con 0x56240db46ea0 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.553+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.553+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db62d20 con 0x7f0fe805c920 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.555+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.555+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db63250 con 0x56240db4cfc0 2023-12-07T21:09:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.555+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.556+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db63c20 con 0x56240db46ea0 2023-12-07T21:09:18.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.556+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'140 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.556+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db608d0 con 0x7f0ff0017050 2023-12-07T21:09:18.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.557+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'41 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.557+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db64790 con 0x56240db4cfc0 2023-12-07T21:09:18.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.558+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.558+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db65160 con 0x56240db46ea0 2023-12-07T21:09:18.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.559+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.559+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db65160 con 0x7f0fe805c920 2023-12-07T21:09:18.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.560+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.560+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db65160 con 0x7f0ff0017050 2023-12-07T21:09:18.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.561+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.561+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db65960 con 0x56240db4cfc0 2023-12-07T21:09:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.562+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.562+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db65960 con 0x7f0ff0017050 2023-12-07T21:09:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.563+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'42 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.563+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db66330 con 0x7f0fe805c920 2023-12-07T21:09:18.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.564+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.564+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db66330 con 0x7f0ff0017050 2023-12-07T21:09:18.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.565+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.565+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db66330 con 0x7f0fe805c920 2023-12-07T21:09:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.566+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'33 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.566+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db66330 con 0x56240db46ea0 2023-12-07T21:09:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.567+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'141 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.567+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db66330 con 0x56240db4cfc0 2023-12-07T21:09:18.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.569+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'35 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.569+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663c0 con 0x7f0ff0017050 2023-12-07T21:09:18.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.569+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'43 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.569+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db66400 con 0x56240db4cfc0 2023-12-07T21:09:18.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.570+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.571+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x56240db46ea0 2023-12-07T21:09:18.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.572+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.572+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x56240db46ea0 2023-12-07T21:09:18.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.572+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'142 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.572+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x56240db4cfc0 2023-12-07T21:09:18.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.574+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'36 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.574+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x7f0ff0017050 2023-12-07T21:09:18.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.575+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.575+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x56240db4cfc0 2023-12-07T21:09:18.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.575+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.575+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x56240db4cfc0 2023-12-07T21:09:18.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.576+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.576+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x56240db4cfc0 2023-12-07T21:09:18.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.577+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.577+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x56240db4cfc0 2023-12-07T21:09:18.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.578+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'28 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.578+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x7f0fe805c920 2023-12-07T21:09:18.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.580+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.580+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x56240db4cfc0 2023-12-07T21:09:18.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.581+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.581+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x7f0fe805c920 2023-12-07T21:09:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.582+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'28 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.582+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x56240db4cfc0 2023-12-07T21:09:18.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.583+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.583+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x7f0fe805c920 2023-12-07T21:09:18.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.584+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'34 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.584+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db663e0 con 0x7f0ff0017050 2023-12-07T21:09:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f0fc1fdb640 20 reqs_thread_entry: start 2023-12-07T21:09:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f100112c800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f100112c800 20 Filter name: none 2023-12-07T21:09:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f0f337fe640 20 reqs_thread_entry: start 2023-12-07T21:09:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f100112c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:09:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db5fe60 con 0x7f0ff0017050 2023-12-07T21:09:18.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv32 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f100112c800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f100112c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f100112c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f100112c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 : miss 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f100112c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.586+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db93690 con 0x7f0ff0017050 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.587+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(95 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv30 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.587+0000 7f100112c800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.587+0000 7f100112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.587+0000 7f100112c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.587+0000 7f100112c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.587+0000 7f100112c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.587+0000 7f100112c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:18.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.587+0000 7f100112c800 20 get_obj_state: octx=0x7f0fe804ab60 obj=myfoo:four state=0x56240db94378 s->prefetch_data=0 2023-12-07T21:09:18.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.587+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:96 3.27s0 3:e7a6fb7c:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db95420 con 0x7f0fe805c920 2023-12-07T21:09:18.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.588+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(96 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+865 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.588+0000 7f100112c800 10 manifest: total_size = 4 2023-12-07T21:09:18.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.588+0000 7f100112c800 20 get_obj_state: setting s->obj_tag to ef4a9585-c98e-4264-8c5b-7c4065599143.4222.4704027176396831548 2023-12-07T21:09:18.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.588+0000 7f100112c800 20 get_obj_state: octx=0x7f0fe804ab60 obj=myfoo:four state=0x56240db94378 s->prefetch_data=0 2023-12-07T21:09:18.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.588+0000 7f100112c800 20 prepare_atomic_modification: state is not atomic. state=0x56240db94378 2023-12-07T21:09:18.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.588+0000 7f100112c800 20 bucket index object: :.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6 2023-12-07T21:09:18.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.588+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:97 4.26 4:658aa6de:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db99e70 con 0x7f0fe805c920 2023-12-07T21:09:18.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.589+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(97 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6 [stat,call,call] v31'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.589+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:98 3.27s0 3:e7a6fb7c:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db99e70 con 0x7f0fe805c920 2023-12-07T21:09:18.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.590+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(98 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1_four [call] v31'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.590+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:99 4.26 4:658aa6de:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db9a2b0 con 0x7f0fe805c920 2023-12-07T21:09:18.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.591+0000 7f0fc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.591+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94712848805216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db5f960 con 0x56240db46ea0 2023-12-07T21:09:18.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.591+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(99 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6 [stat,call,call] v31'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.591+0000 7f0fe77fe640 20 handle_completion(): completion ok for obj=four 2023-12-07T21:09:18.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.592+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94712848805216] v31'143 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.592+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94712846360400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db5f960 con 0x7f0ff0017050 2023-12-07T21:09:18.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.593+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94712846360400] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.593+0000 7f100112c800 20 remove_watcher() i=0 2023-12-07T21:09:18.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.593+0000 7f100112c800 2 removed watcher, disabling cache 2023-12-07T21:09:18.587 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.593+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94712848781616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db5f960 con 0x56240db46ea0 2023-12-07T21:09:18.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.594+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94712848781616] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.594+0000 7f100112c800 20 remove_watcher() i=1 2023-12-07T21:09:18.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.594+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94712848789136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db5f960 con 0x56240db4cfc0 2023-12-07T21:09:18.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.595+0000 7f0ffcef0640 1 -- 172.21.15.121:0/4249039621 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94712848789136] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff0057040 con 0x56240db4cfc0 2023-12-07T21:09:18.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.595+0000 7f100112c800 20 remove_watcher() i=2 2023-12-07T21:09:18.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.595+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94712848793856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db5f960 con 0x7f0ff0017050 2023-12-07T21:09:18.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.596+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94712848793856] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0fe8071040 con 0x7f0ff0017050 2023-12-07T21:09:18.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.596+0000 7f100112c800 20 remove_watcher() i=3 2023-12-07T21:09:18.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.596+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94712848796512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db5f960 con 0x56240db46ea0 2023-12-07T21:09:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.598+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94712848796512] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x56240db46ea0 2023-12-07T21:09:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.598+0000 7f100112c800 20 remove_watcher() i=4 2023-12-07T21:09:18.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.598+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94712848798672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db5f960 con 0x7f0fe805c920 2023-12-07T21:09:18.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.599+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94712848798672] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.599+0000 7f100112c800 20 remove_watcher() i=5 2023-12-07T21:09:18.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.599+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94712848801216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db5f960 con 0x7f0fe805c920 2023-12-07T21:09:18.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.600+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94712848801216] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.600+0000 7f100112c800 20 remove_watcher() i=6 2023-12-07T21:09:18.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.600+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94712848803920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56240db5f960 con 0x7f0fe805c920 2023-12-07T21:09:18.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f0ffd6f1640 1 -- 172.21.15.121:0/4249039621 <== osd.0 v2:172.21.15.89:6800/654939948 30 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94712848803920] v31'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0ff802e9d0 con 0x7f0fe805c920 2023-12-07T21:09:18.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 20 remove_watcher() i=7 2023-12-07T21:09:18.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0fe805c920 msgr2=0x7f0fe8009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.596 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0fe805c920 0x7f0fe8009410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56240db46ea0 msgr2=0x56240db49360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56240db46ea0 0x56240db49360 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0ff0017050 msgr2=0x7f0ff00165d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0ff0017050 0x7f0ff00165d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56240db4cfc0 msgr2=0x56240db4f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56240db4cfc0 0x56240db4f450 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0fd4036110 msgr2=0x7f0fd40385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0fd4036110 0x7f0fd40385d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8054000 tx=0x7f0fe804e000 comp rx=0 tx=0).stop 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 msgr2=0x56240db3b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db3b750 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800a930 tx=0x7f0ff8003370 comp rx=0 tx=0).stop 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f0ff7fff640 1 -- 172.21.15.121:0/4249039621 reap_dead start 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 shutdown_connections 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 --2- 172.21.15.121:0/4249039621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240db34760 0x56240db3b750 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.597 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 >> 172.21.15.121:0/4249039621 conn(0x56240da7d5e0 msgr2=0x56240db2a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 shutdown_connections 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 -- 172.21.15.121:0/4249039621 wait complete. 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.601+0000 7f100112c800 1 -- 172.21.15.121:0/1102090935 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0fe0036110 msgr2=0x7f0fe00385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.602+0000 7f100112c800 1 --2- 172.21.15.121:0/1102090935 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0fe0036110 0x7f0fe00385d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000e5a0 tx=0x7f0ff0017f90 comp rx=0 tx=0).stop 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.602+0000 7f100112c800 1 -- 172.21.15.121:0/1102090935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 msgr2=0x56240db25250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.602+0000 7f100112c800 1 --2- 172.21.15.121:0/1102090935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db25250 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0000c00 tx=0x7f0ff0000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.602+0000 7f100112c800 1 -- 172.21.15.121:0/1102090935 shutdown_connections 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.602+0000 7f100112c800 1 --2- 172.21.15.121:0/1102090935 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0fe0036110 0x7f0fe00385d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.602+0000 7f100112c800 1 --2- 172.21.15.121:0/1102090935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56240da7a6e0 0x56240db25250 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.602+0000 7f100112c800 1 -- 172.21.15.121:0/1102090935 >> 172.21.15.121:0/1102090935 conn(0x56240da73f70 msgr2=0x56240db1cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.602+0000 7f100112c800 1 -- 172.21.15.121:0/1102090935 shutdown_connections 2023-12-07T21:09:18.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.602+0000 7f100112c800 1 -- 172.21.15.121:0/1102090935 wait complete. 2023-12-07T21:09:18.599 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2023-12-07T21:09:18.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2023-12-07T21:09:18.600 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2023-12-07T21:09:18.641 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:18.642 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:18.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.648+0000 7fc457f37800 1 Processor -- start 2023-12-07T21:09:18.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.648+0000 7fc457f37800 1 -- start start 2023-12-07T21:09:18.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.649+0000 7fc457f37800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5570186527d0 0x557018654bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.649+0000 7fc457f37800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55701859a7a0 con 0x55701864f840 2023-12-07T21:09:18.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.649+0000 7fc457f37800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x557018563880 con 0x5570186527d0 2023-12-07T21:09:18.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.649+0000 7fc45346e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5570186527d0 0x557018654bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.649+0000 7fc453c6f640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55701864f840 0x55701864fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55934/0 (socket says 172.21.15.121:55934) 2023-12-07T21:09:18.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.649+0000 7fc453c6f640 1 -- 172.21.15.121:0/3188021376 learned_addr learned my addr 172.21.15.121:0/3188021376 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:18.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.649+0000 7fc45346e640 1 -- 172.21.15.121:0/3188021376 >> v1:172.21.15.89:6789/0 conn(0x55701864f840 legacy=0x55701864fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.649+0000 7fc45346e640 1 -- 172.21.15.121:0/3188021376 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557018656110 con 0x5570186527d0 2023-12-07T21:09:18.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.651+0000 7fc45346e640 1 --2- 172.21.15.121:0/3188021376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5570186527d0 0x557018654bc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc44800a470 tx=0x7fc44801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11053be09963854 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.651+0000 7fc452c6d640 1 -- 172.21.15.121:0/3188021376 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc448052570 con 0x5570186527d0 2023-12-07T21:09:18.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.651+0000 7fc452c6d640 1 -- 172.21.15.121:0/3188021376 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4480526d0 con 0x5570186527d0 2023-12-07T21:09:18.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.651+0000 7fc452c6d640 1 -- 172.21.15.121:0/3188021376 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc448052990 con 0x5570186527d0 2023-12-07T21:09:18.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.652+0000 7fc457f37800 1 -- 172.21.15.121:0/3188021376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5570186527d0 msgr2=0x557018654bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.652+0000 7fc457f37800 1 --2- 172.21.15.121:0/3188021376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5570186527d0 0x557018654bc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc44800a470 tx=0x7fc44801cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:18.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.652+0000 7fc457f37800 1 -- 172.21.15.121:0/3188021376 shutdown_connections 2023-12-07T21:09:18.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.652+0000 7fc457f37800 1 --2- 172.21.15.121:0/3188021376 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5570186527d0 0x557018654bc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.652+0000 7fc457f37800 1 -- 172.21.15.121:0/3188021376 >> 172.21.15.121:0/3188021376 conn(0x557018647f60 msgr2=0x55701864a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.652+0000 7fc457f37800 1 -- 172.21.15.121:0/3188021376 shutdown_connections 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.652+0000 7fc457f37800 1 -- 172.21.15.121:0/3188021376 wait complete. 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.652+0000 7fc457f37800 1 Processor -- start 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.652+0000 7fc457f37800 1 -- start start 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.652+0000 7fc457f37800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.653+0000 7fc457f37800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557018560db0 con 0x55701864f840 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.653+0000 7fc453c6f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.653+0000 7fc453c6f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55220/0 (socket says 172.21.15.121:55220) 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.653+0000 7fc453c6f640 1 -- 172.21.15.121:0/3148044665 learned_addr learned my addr 172.21.15.121:0/3148044665 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.653+0000 7fc453c6f640 1 -- 172.21.15.121:0/3148044665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc448005d20 con 0x55701864f840 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.653+0000 7fc453c6f640 1 --2- 172.21.15.121:0/3148044665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186f2e20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc444006fa0 tx=0x7fc444001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c01bc6dfc197d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.653+0000 7fc45246c640 1 -- 172.21.15.121:0/3148044665 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc444004520 con 0x55701864f840 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.653+0000 7fc45246c640 1 -- 172.21.15.121:0/3148044665 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4440046a0 con 0x55701864f840 2023-12-07T21:09:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.653+0000 7fc45246c640 1 -- 172.21.15.121:0/3148044665 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc444004a00 con 0x55701864f840 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc457f37800 1 -- 172.21.15.121:0/3148044665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 msgr2=0x5570186f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc457f37800 1 --2- 172.21.15.121:0/3148044665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186f2e20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc444006fa0 tx=0x7fc444001930 comp rx=0 tx=0).stop 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc457f37800 1 -- 172.21.15.121:0/3148044665 shutdown_connections 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc457f37800 1 --2- 172.21.15.121:0/3148044665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186f2e20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc457f37800 1 -- 172.21.15.121:0/3148044665 >> 172.21.15.121:0/3148044665 conn(0x557018647f60 msgr2=0x5570186eea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc457f37800 1 -- 172.21.15.121:0/3148044665 shutdown_connections 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc457f37800 1 -- 172.21.15.121:0/3148044665 wait complete. 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc457f37800 1 Processor -- start 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc457f37800 1 -- start start 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc457f37800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186fa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc457f37800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55701855c6a0 con 0x55701864f840 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc453c6f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc453c6f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186fa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55230/0 (socket says 172.21.15.121:55230) 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.654+0000 7fc453c6f640 1 -- 172.21.15.121:0/3072317152 learned_addr learned my addr 172.21.15.121:0/3072317152 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.655+0000 7fc453c6f640 1 -- 172.21.15.121:0/3072317152 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55701859a7a0 con 0x55701864f840 2023-12-07T21:09:18.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.655+0000 7fc453c6f640 1 --2- 172.21.15.121:0/3072317152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186fa360 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc44400f000 tx=0x7fc444000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.655+0000 7fc45146a640 1 -- 172.21.15.121:0/3072317152 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc444023030 con 0x55701864f840 2023-12-07T21:09:18.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.655+0000 7fc45146a640 1 -- 172.21.15.121:0/3072317152 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc444013630 con 0x55701864f840 2023-12-07T21:09:18.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.655+0000 7fc457f37800 1 -- 172.21.15.121:0/3072317152 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5570186fa8a0 con 0x55701864f840 2023-12-07T21:09:18.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.655+0000 7fc45146a640 1 -- 172.21.15.121:0/3072317152 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4440138d0 con 0x55701864f840 2023-12-07T21:09:18.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.655+0000 7fc457f37800 1 -- 172.21.15.121:0/3072317152 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5570186fad80 con 0x55701864f840 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc457f37800 1 Processor -- start 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc457f37800 1 -- start start 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc457f37800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 0x55701864d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc457f37800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570184f6890 con 0x55701864f010 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc45146a640 1 -- 172.21.15.121:0/3072317152 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc444026070 con 0x55701864f840 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc454470640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 0x55701864d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc454470640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 0x55701864d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55232/0 (socket says 172.21.15.121:55232) 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc454470640 1 -- 172.21.15.121:0/23786026 learned_addr learned my addr 172.21.15.121:0/23786026 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc45146a640 1 --2- 172.21.15.121:0/3072317152 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc440036110 0x7fc4400385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc45146a640 1 -- 172.21.15.121:0/3072317152 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc444024070 con 0x55701864f840 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc453c6f640 1 --2- 172.21.15.121:0/3072317152 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc440036110 0x7fc4400385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc454470640 1 -- 172.21.15.121:0/23786026 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55701864daa0 con 0x55701864f010 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc454470640 1 --2- 172.21.15.121:0/23786026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 0x55701864d560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00a400 tx=0x7fc44c00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b172c137041780c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.656+0000 7fc453c6f640 1 --2- 172.21.15.121:0/3072317152 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc440036110 0x7fc4400385d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc444012fd0 tx=0x7fc444011fb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc43affd640 1 -- 172.21.15.121:0/23786026 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc44c0087e0 con 0x55701864f010 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc43affd640 1 -- 172.21.15.121:0/23786026 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c008960 con 0x55701864f010 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc43affd640 1 -- 172.21.15.121:0/23786026 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc44c008c80 con 0x55701864f010 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc457f37800 1 -- 172.21.15.121:0/23786026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 msgr2=0x55701864d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc457f37800 1 --2- 172.21.15.121:0/23786026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 0x55701864d560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00a400 tx=0x7fc44c00a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc457f37800 1 -- 172.21.15.121:0/23786026 shutdown_connections 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc457f37800 1 --2- 172.21.15.121:0/23786026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 0x55701864d560 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc457f37800 1 -- 172.21.15.121:0/23786026 >> 172.21.15.121:0/23786026 conn(0x5570186527d0 msgr2=0x5570187018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc457f37800 1 -- 172.21.15.121:0/23786026 shutdown_connections 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc457f37800 1 -- 172.21.15.121:0/23786026 wait complete. 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc457f37800 1 Processor -- start 2023-12-07T21:09:18.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc457f37800 1 -- start start 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.657+0000 7fc457f37800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 0x55701870f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.658+0000 7fc457f37800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570184f6530 con 0x55701864f010 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.658+0000 7fc454470640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 0x55701870f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.658+0000 7fc454470640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 0x55701870f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55242/0 (socket says 172.21.15.121:55242) 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.658+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 learned_addr learned my addr 172.21.15.121:0/656781054 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.658+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c005c90 con 0x55701864f010 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.658+0000 7fc454470640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 0x55701870f6d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00a900 tx=0x7fc44c002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.658+0000 7fc4397fa640 1 -- 172.21.15.121:0/656781054 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc44c013780 con 0x55701864f010 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.658+0000 7fc4397fa640 1 -- 172.21.15.121:0/656781054 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c0138e0 con 0x55701864f010 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.658+0000 7fc4397fa640 1 -- 172.21.15.121:0/656781054 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc44c013b80 con 0x55701864f010 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.658+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55701870fc10 con 0x55701864f010 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.658+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5570187100d0 con 0x55701864f010 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.659+0000 7fc4397fa640 1 -- 172.21.15.121:0/656781054 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc44c01e420 con 0x55701864f010 2023-12-07T21:09:18.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.659+0000 7fc4397fa640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc42c0360c0 0x7fc42c038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.659+0000 7fc4397fa640 1 -- 172.21.15.121:0/656781054 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc44c04b750 con 0x55701864f010 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.659+0000 7fc45346e640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc42c0360c0 0x7fc42c038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.659+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.659+0000 7fc457f37800 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55701871ae40 0x55701871d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.659+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701871da50 con 0x55701871ae40 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.659+0000 7fc454470640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55701871ae40 0x55701871d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc45346e640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc42c0360c0 0x7fc42c038580 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc448054000 tx=0x7fc44804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc454470640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55701871ae40 0x55701871d300 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc457f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc457f37800 20 realm 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701871de40 con 0x55701871ae40 2023-12-07T21:09:18.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc457f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc457f37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701871e6c0 con 0x55701871ae40 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc457f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.660+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701871ea20 con 0x55701871ae40 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.661+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.661+0000 7fc457f37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.661+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.661+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701871e320 con 0x55701871ae40 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.661+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.661+0000 7fc457f37800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.661+0000 7fc457f37800 20 searching for the correct realm 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.661+0000 7fc457f37800 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557018720c30 0x557018723020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.661+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x557018720c30 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.661+0000 7fc453c6f640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557018720c30 0x557018723020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.661+0000 7fc453c6f640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557018720c30 0x557018723020 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.662+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.662+0000 7fc453c6f640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc444041040 0x7fc44404aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.662+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc444041040 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.662+0000 7fc45346e640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc444041040 0x7fc44404aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.662+0000 7fc45346e640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc444041040 0x7fc44404aac0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.662+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc448059040 con 0x7fc444041040 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.662+0000 7fc45346e640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc44805d930 0x7fc448009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.662+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc44805d930 2023-12-07T21:09:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.663+0000 7fc454470640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc44805d930 0x7fc448009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.663+0000 7fc454470640 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc44805d930 0x7fc448009410 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.663+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.663+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x55701871ae40 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.663+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.664+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x55701871ae40 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.664+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.664+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc44805d930 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.664+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.664+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc44805d930 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.664+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.664+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc444041040 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.664+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc448059040 con 0x7fc444041040 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.664+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x557018720c30 2023-12-07T21:09:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.665+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.665+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x55701871ae40 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.665+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.665+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc44805d930 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.665+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.665+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x55701871ae40 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.665+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.665+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc444041040 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.666+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc448059040 con 0x7fc444041040 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.666+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x557018720c30 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.666+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.666+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x557018720c30 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.666+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.666+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc44805d930 2023-12-07T21:09:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.666+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.666+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x557018720c30 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.667+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.667+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x557018720c30 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.667+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.667+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x55701871ae40 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.667+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.667+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x55701871ae40 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.667+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.667+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc44805d930 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.667+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.668+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x557018720c30 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.668+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.668+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc444041040 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.668+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc448059040 con 0x7fc444041040 2023-12-07T21:09:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.668+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x55701871ae40 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.668+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.668+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc44805d930 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.669+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.669+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x557018720c30 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.669+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.669+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc44805d930 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.669+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.669+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc444041040 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.669+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc448059040 con 0x7fc444041040 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.669+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x557018720c30 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x7fc44805d930 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187235b0 con 0x55701871ae40 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc44c054080 con 0x7fc444041040 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc448059040 con 0x7fc444041040 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc457f37800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc457f37800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc457f37800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc457f37800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc457f37800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc457f37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.670+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701871f850 con 0x55701871ae40 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701871f4d0 con 0x55701871ae40 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018720120 con 0x557018720c30 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 20 zone default found 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 4 Realm: () 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 20 zonegroup default 2023-12-07T21:09:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.671+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187239d0 con 0x7fc44805d930 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc457f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018725760 con 0x557018720c30 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc457f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018725b10 con 0x557018720c30 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc457f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc457f37800 20 started sync module instance, tier type = 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc457f37800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.672+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018725040 con 0x7fc444041040 2023-12-07T21:09:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.673+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448059040 con 0x7fc444041040 2023-12-07T21:09:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.673+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93939932421968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187253f0 con 0x7fc444041040 2023-12-07T21:09:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.673+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187263d0 con 0x55701871ae40 2023-12-07T21:09:18.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.674+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93939932421968] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.675+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.675+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93939934841760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018726410 con 0x55701871ae40 2023-12-07T21:09:18.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.675+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018726ea0 con 0x557018720c30 2023-12-07T21:09:18.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.676+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.676+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93939934849376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187276f0 con 0x557018720c30 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.676+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187280d0 con 0x7fc444041040 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.676+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93939934841760] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.677+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93939934849376] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.677+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.677+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93939934846768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018727360 con 0x7fc444041040 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.677+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018728ba0 con 0x55701871ae40 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.678+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93939934846768] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.678+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.678+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93939934856864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018728f80 con 0x55701871ae40 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.678+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018729800 con 0x7fc44805d930 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.681+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93939934856864] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.681+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.681+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93939934854128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187293d0 con 0x7fc44805d930 2023-12-07T21:09:18.691 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.681+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701872a0e0 con 0x7fc44805d930 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.682+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93939934854128] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.682+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.682+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93939934862176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187293d0 con 0x7fc44805d930 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.682+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701872aaa0 con 0x7fc44805d930 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.683+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.683+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93939934864896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701872aef0 con 0x7fc44805d930 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.683+0000 7fc457f37800 20 add_watcher() i=0 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.683+0000 7fc457f37800 20 add_watcher() i=1 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.683+0000 7fc457f37800 20 add_watcher() i=2 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.683+0000 7fc457f37800 20 add_watcher() i=3 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.683+0000 7fc457f37800 20 add_watcher() i=4 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.683+0000 7fc457f37800 20 add_watcher() i=5 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.683+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93939934862176] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.683+0000 7fc457f37800 20 add_watcher() i=6 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.684+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93939934864896] v31'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.684+0000 7fc457f37800 20 add_watcher() i=7 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.684+0000 7fc457f37800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.684+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018728f30 con 0x55701871ae40 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.684+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.684+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93939934865936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018728f30 con 0x55701871ae40 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.685+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93939934865936] v31'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.685+0000 7fc419fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.685+0000 7fc457f37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.685+0000 7fc457f37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.685+0000 7fc457f37800 5 note: GC not initialized 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.685+0000 7fc418fe1640 20 reqs_thread_entry: start 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc457f37800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc457f37800 20 Filter name: none 2023-12-07T21:09:18.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc3927fc640 20 reqs_thread_entry: start 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018760f20 con 0x7fc444041040 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv32 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc457f37800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018761900 con 0x7fc444041040 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(63 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv30 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc457f37800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc457f37800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.686+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018760460 con 0x7fc444041040 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv32 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187633f0 con 0x7fc444041040 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(65 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv30 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 4.e 4:719083e2:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018762e20 con 0x7fc444041040 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 4.37 4:efedcd12:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018767e90 con 0x7fc44805d930 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 4.27 4:e642d40c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701876a6b0 con 0x55701871ae40 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 4.27 4:e4a2f79e:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701876ced0 con 0x55701871ae40 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 4.18 4:1bea850c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701876fa50 con 0x7fc444041040 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 4.9 4:933a13f7:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187722f0 con 0x55701871ae40 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 4.26 4:658aa6de:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018774e20 con 0x7fc44805d930 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:73 4.3e 4:7c54f31d:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018777840 con 0x7fc444041040 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:74 4.9 4:93faacf1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701877a240 con 0x55701871ae40 2023-12-07T21:09:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:75 4.34 4:2d01635f:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701877a2c0 con 0x7fc444041040 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.687+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:76 4.3f 4:fca757fe:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55701877f040 con 0x7fc444041040 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(68 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(71 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.5 [call out=124b] v0'0 uv10 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(72 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(67 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(66 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(70 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(73 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(75 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(74 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.8 [call out=124b] v0'0 uv14 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(76 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1.3 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc457f37800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.b 6:d2b92e8e:::pubsub..bucket.myfoo%2fef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018772af0 con 0x557018720c30 2023-12-07T21:09:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(77 pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.688+0000 7fc457f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.689+0000 7fc419fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.689+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93939934865936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018761fc0 con 0x55701871ae40 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.690+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93939934865936] v31'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.690+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93939932421968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187499d0 con 0x7fc444041040 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.691+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93939932421968] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.691+0000 7fc457f37800 20 remove_watcher() i=0 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.691+0000 7fc457f37800 2 removed watcher, disabling cache 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.691+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93939934841760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187499d0 con 0x55701871ae40 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.692+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93939934841760] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.692+0000 7fc457f37800 20 remove_watcher() i=1 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.692+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93939934849376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5570187499d0 con 0x557018720c30 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.693+0000 7fc453c6f640 1 -- 172.21.15.121:0/656781054 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93939934849376] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44403a040 con 0x557018720c30 2023-12-07T21:09:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.693+0000 7fc457f37800 20 remove_watcher() i=2 2023-12-07T21:09:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.693+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93939934846768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018761f40 con 0x7fc444041040 2023-12-07T21:09:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.694+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93939934846768] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc448072040 con 0x7fc444041040 2023-12-07T21:09:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.694+0000 7fc457f37800 20 remove_watcher() i=3 2023-12-07T21:09:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.694+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93939934856864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018761f40 con 0x55701871ae40 2023-12-07T21:09:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.695+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93939934856864] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x55701871ae40 2023-12-07T21:09:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.695+0000 7fc457f37800 20 remove_watcher() i=4 2023-12-07T21:09:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.695+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93939934854128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018761f40 con 0x7fc44805d930 2023-12-07T21:09:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.696+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93939934854128] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.696+0000 7fc457f37800 20 remove_watcher() i=5 2023-12-07T21:09:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.696+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93939934862176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018727bf0 con 0x7fc44805d930 2023-12-07T21:09:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.697+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93939934862176] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.697+0000 7fc457f37800 20 remove_watcher() i=6 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.697+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93939934864896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x557018727bf0 con 0x7fc44805d930 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc454470640 1 -- 172.21.15.121:0/656781054 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93939934864896] v31'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc44c024070 con 0x7fc44805d930 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 20 remove_watcher() i=7 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc44805d930 msgr2=0x7fc448009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc44805d930 0x7fc448009410 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55701871ae40 msgr2=0x55701871d300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55701871ae40 0x55701871d300 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc444041040 msgr2=0x7fc44404aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc444041040 0x7fc44404aac0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557018720c30 msgr2=0x557018723020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557018720c30 0x557018723020 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc42c0360c0 msgr2=0x7fc42c038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc42c0360c0 0x7fc42c038580 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc448054000 tx=0x7fc44804e000 comp rx=0 tx=0).stop 2023-12-07T21:09:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 msgr2=0x55701870f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 --2- 172.21.15.121:0/656781054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f010 0x55701870f6d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00a900 tx=0x7fc44c002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 reap_dead start 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc45346e640 1 -- 172.21.15.121:0/656781054 reap_dead start 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 shutdown_connections 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 >> 172.21.15.121:0/656781054 conn(0x5570186527d0 msgr2=0x5570187006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 shutdown_connections 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.698+0000 7fc457f37800 1 -- 172.21.15.121:0/656781054 wait complete. 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.699+0000 7fc457f37800 1 -- 172.21.15.121:0/3072317152 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc440036110 msgr2=0x7fc4400385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.699+0000 7fc457f37800 1 --2- 172.21.15.121:0/3072317152 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc440036110 0x7fc4400385d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc444012fd0 tx=0x7fc444011fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.699+0000 7fc457f37800 1 -- 172.21.15.121:0/3072317152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 msgr2=0x5570186fa360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.699+0000 7fc457f37800 1 --2- 172.21.15.121:0/3072317152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186fa360 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc44400f000 tx=0x7fc444000f40 comp rx=0 tx=0).stop 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.699+0000 7fc457f37800 1 -- 172.21.15.121:0/3072317152 shutdown_connections 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.699+0000 7fc457f37800 1 --2- 172.21.15.121:0/3072317152 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc440036110 0x7fc4400385d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.699+0000 7fc457f37800 1 --2- 172.21.15.121:0/3072317152 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55701864f840 0x5570186fa360 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.699+0000 7fc457f37800 1 -- 172.21.15.121:0/3072317152 >> 172.21.15.121:0/3072317152 conn(0x557018647f60 msgr2=0x5570186f1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.699+0000 7fc457f37800 1 -- 172.21.15.121:0/3072317152 shutdown_connections 2023-12-07T21:09:18.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.699+0000 7fc457f37800 1 -- 172.21.15.121:0/3072317152 wait complete. 2023-12-07T21:09:18.703 INFO:teuthology.orchestra.run.smithi121.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"209e4ade-356c-43a0-a93d-cc9500dad162","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","marker":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2023-12-07T21:09:18.301417Z","creation_time":"2023-12-07T21:09:15.863874Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2023-12-07T21:09:18.704 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '209e4ade-356c-43a0-a93d-cc9500dad162', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'marker': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2023-12-07T21:09:18.301417Z', 'creation_time': '2023-12-07T21:09:15.863874Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2023-12-07T21:09:18.704 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2023-12-07T21:09:18.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2023-12-07T21:09:18.704 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2023-12-07T21:09:18.785 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:18.785 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:18.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.791+0000 7f8b5b32c800 1 Processor -- start 2023-12-07T21:09:18.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.792+0000 7f8b5b32c800 1 -- start start 2023-12-07T21:09:18.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.792+0000 7f8b5b32c800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f082888830 0x55f082888c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.792+0000 7f8b5b32c800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f0827d3790 con 0x55f082889190 2023-12-07T21:09:18.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.792+0000 7f8b5b32c800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f08279c880 con 0x55f082888830 2023-12-07T21:09:18.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.792+0000 7f8b570f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f082888830 0x55f082888c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.792+0000 7f8b568ef640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55f082889190 0x55f0828852b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55942/0 (socket says 172.21.15.121:55942) 2023-12-07T21:09:18.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.792+0000 7f8b570f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f082888830 0x55f082888c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55246/0 (socket says 172.21.15.121:55246) 2023-12-07T21:09:18.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.792+0000 7f8b568ef640 1 -- 172.21.15.121:0/2845685258 learned_addr learned my addr 172.21.15.121:0/2845685258 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:18.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.792+0000 7f8b570f0640 1 -- 172.21.15.121:0/2845685258 >> v1:172.21.15.89:6789/0 conn(0x55f082889190 legacy=0x55f0828852b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.792+0000 7f8b570f0640 1 -- 172.21.15.121:0/2845685258 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f082885b50 con 0x55f082888830 2023-12-07T21:09:18.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.794+0000 7f8b570f0640 1 --2- 172.21.15.121:0/2845685258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f082888c50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b48005fd0 tx=0x7f8b4801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27642a8724b80bba server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.794+0000 7f8b560ee640 1 -- 172.21.15.121:0/2845685258 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b48052560 con 0x55f082888830 2023-12-07T21:09:18.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.794+0000 7f8b560ee640 1 -- 172.21.15.121:0/2845685258 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b480526c0 con 0x55f082888830 2023-12-07T21:09:18.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.794+0000 7f8b560ee640 1 -- 172.21.15.121:0/2845685258 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b480529e0 con 0x55f082888830 2023-12-07T21:09:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.795+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2845685258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 msgr2=0x55f082888c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.795+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/2845685258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f082888c50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8b48005fd0 tx=0x7f8b4801cb90 comp rx=0 tx=0).stop 2023-12-07T21:09:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.795+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2845685258 shutdown_connections 2023-12-07T21:09:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.795+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/2845685258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f082888c50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.795+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2845685258 >> 172.21.15.121:0/2845685258 conn(0x55f082880f50 msgr2=0x55f082883370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.795+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2845685258 shutdown_connections 2023-12-07T21:09:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.795+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2845685258 wait complete. 2023-12-07T21:09:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b5b32c800 1 Processor -- start 2023-12-07T21:09:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b5b32c800 1 -- start start 2023-12-07T21:09:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b5b32c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f08292c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b5b32c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f082799db0 con 0x55f082888830 2023-12-07T21:09:18.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b570f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f08292c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b570f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f08292c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55260/0 (socket says 172.21.15.121:55260) 2023-12-07T21:09:18.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b570f0640 1 -- 172.21.15.121:0/1986610734 learned_addr learned my addr 172.21.15.121:0/1986610734 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b570f0640 1 -- 172.21.15.121:0/1986610734 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4800a100 con 0x55f082888830 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b570f0640 1 --2- 172.21.15.121:0/1986610734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f08292c320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800a3f0 tx=0x7f8b4804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7146c3c774a56a9b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b558ed640 1 -- 172.21.15.121:0/1986610734 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b48052960 con 0x55f082888830 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b558ed640 1 -- 172.21.15.121:0/1986610734 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b48052ac0 con 0x55f082888830 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.796+0000 7f8b558ed640 1 -- 172.21.15.121:0/1986610734 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b48052d60 con 0x55f082888830 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.797+0000 7f8b5b32c800 1 -- 172.21.15.121:0/1986610734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 msgr2=0x55f08292c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.797+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/1986610734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f08292c320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800a3f0 tx=0x7f8b4804c000 comp rx=0 tx=0).stop 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.797+0000 7f8b5b32c800 1 -- 172.21.15.121:0/1986610734 shutdown_connections 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.797+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/1986610734 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f08292c320 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.797+0000 7f8b5b32c800 1 -- 172.21.15.121:0/1986610734 >> 172.21.15.121:0/1986610734 conn(0x55f082880f50 msgr2=0x55f082927f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.797+0000 7f8b5b32c800 1 -- 172.21.15.121:0/1986610734 shutdown_connections 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.797+0000 7f8b5b32c800 1 -- 172.21.15.121:0/1986610734 wait complete. 2023-12-07T21:09:18.800 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.797+0000 7f8b5b32c800 1 Processor -- start 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.797+0000 7f8b5b32c800 1 -- start start 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.797+0000 7f8b5b32c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f0829337f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.797+0000 7f8b5b32c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0827956a0 con 0x55f082888830 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.798+0000 7f8b570f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f0829337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.798+0000 7f8b570f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f0829337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55266/0 (socket says 172.21.15.121:55266) 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.798+0000 7f8b570f0640 1 -- 172.21.15.121:0/2639194712 learned_addr learned my addr 172.21.15.121:0/2639194712 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.798+0000 7f8b570f0640 1 -- 172.21.15.121:0/2639194712 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f082885b50 con 0x55f082888830 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.798+0000 7f8b570f0640 1 --2- 172.21.15.121:0/2639194712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f0829337f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8b480448a0 tx=0x7f8b48003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.798+0000 7f8b548eb640 1 -- 172.21.15.121:0/2639194712 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b4806c070 con 0x55f082888830 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.798+0000 7f8b548eb640 1 -- 172.21.15.121:0/2639194712 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4805ccc0 con 0x55f082888830 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.798+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2639194712 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f082933d30 con 0x55f082888830 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.798+0000 7f8b548eb640 1 -- 172.21.15.121:0/2639194712 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b48070410 con 0x55f082888830 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.798+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2639194712 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f082934270 con 0x55f082888830 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.799+0000 7f8b5b32c800 1 Processor -- start 2023-12-07T21:09:18.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.799+0000 7f8b5b32c800 1 -- start start 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.799+0000 7f8b5b32c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 0x55f08293fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.799+0000 7f8b5b32c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08272f890 con 0x55f08293f980 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.799+0000 7f8b548eb640 1 -- 172.21.15.121:0/2639194712 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f8b480663f0 con 0x55f082888830 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.799+0000 7f8b548eb640 1 --2- 172.21.15.121:0/2639194712 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b44036110 0x7f8b440385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.799+0000 7f8b578f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 0x55f08293fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.799+0000 7f8b548eb640 1 -- 172.21.15.121:0/2639194712 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f8b4808d5e0 con 0x55f082888830 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.799+0000 7f8b578f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 0x55f08293fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55278/0 (socket says 172.21.15.121:55278) 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.799+0000 7f8b578f1640 1 -- 172.21.15.121:0/922069264 learned_addr learned my addr 172.21.15.121:0/922069264 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.799+0000 7f8b570f0640 1 --2- 172.21.15.121:0/2639194712 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b44036110 0x7f8b440385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b578f1640 1 -- 172.21.15.121:0/922069264 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0829402e0 con 0x55f08293f980 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b570f0640 1 --2- 172.21.15.121:0/2639194712 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b44036110 0x7f8b440385d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8b48066810 tx=0x7f8b48066720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b578f1640 1 --2- 172.21.15.121:0/922069264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 0x55f08293fda0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000a400 tx=0x7f8b5000a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52758ca7fd317a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b3e7fc640 1 -- 172.21.15.121:0/922069264 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b500087e0 con 0x55f08293f980 2023-12-07T21:09:18.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b3e7fc640 1 -- 172.21.15.121:0/922069264 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b50008960 con 0x55f08293f980 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b3e7fc640 1 -- 172.21.15.121:0/922069264 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b50008c80 con 0x55f08293f980 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b5b32c800 1 -- 172.21.15.121:0/922069264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 msgr2=0x55f08293fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/922069264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 0x55f08293fda0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000a400 tx=0x7f8b5000a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b5b32c800 1 -- 172.21.15.121:0/922069264 shutdown_connections 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/922069264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 0x55f08293fda0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b5b32c800 1 -- 172.21.15.121:0/922069264 >> 172.21.15.121:0/922069264 conn(0x55f082889190 msgr2=0x55f08293ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b5b32c800 1 -- 172.21.15.121:0/922069264 shutdown_connections 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.800+0000 7f8b5b32c800 1 -- 172.21.15.121:0/922069264 wait complete. 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.801+0000 7f8b5b32c800 1 Processor -- start 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.801+0000 7f8b5b32c800 1 -- start start 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.801+0000 7f8b5b32c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 0x55f082887f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.801+0000 7f8b5b32c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08272f530 con 0x55f08293f980 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.801+0000 7f8b578f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 0x55f082887f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.803 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.801+0000 7f8b578f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 0x55f082887f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55292/0 (socket says 172.21.15.121:55292) 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.801+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 learned_addr learned my addr 172.21.15.121:0/94577739 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.801+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50005c90 con 0x55f08293f980 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.801+0000 7f8b578f1640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 0x55f082887f40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000a900 tx=0x7f8b50002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.802+0000 7f8b3cff9640 1 -- 172.21.15.121:0/94577739 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b50013780 con 0x55f08293f980 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.802+0000 7f8b3cff9640 1 -- 172.21.15.121:0/94577739 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b500138e0 con 0x55f08293f980 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.802+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0828865c0 con 0x55f08293f980 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.802+0000 7f8b3cff9640 1 -- 172.21.15.121:0/94577739 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b50013b80 con 0x55f08293f980 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.802+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f082886a80 con 0x55f08293f980 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.802+0000 7f8b3cff9640 1 -- 172.21.15.121:0/94577739 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f8b5001e420 con 0x55f08293f980 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.802+0000 7f8b5b32c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b3cff9640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b300360c0 0x7f8b30038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b3cff9640 1 -- 172.21.15.121:0/94577739 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f8b5004b700 con 0x55f08293f980 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b568ef640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b300360c0 0x7f8b30038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f082954320 0x55f0829567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.804 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082956f30 con 0x55f082954320 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b578f1640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f082954320 0x55f0829567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b568ef640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b300360c0 0x7f8b30038580 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c000f60 tx=0x7f8b4c001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b578f1640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f082954320 0x55f0829567e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b5b32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b5b32c800 20 realm 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b5b32c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.803+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082957300 con 0x55f082954320 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082957b50 con 0x55f082954320 2023-12-07T21:09:18.805 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082957eb0 con 0x55f082954320 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f0829577f0 con 0x55f082954320 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 20 searching for the correct realm 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f08295a100 0x55f08295c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f08295a100 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.804+0000 7f8b570f0640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f08295a100 0x55f08295c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.806 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.805+0000 7f8b570f0640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f08295a100 0x55f08295c4f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.805+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.805+0000 7f8b570f0640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8b4807a060 0x7f8b48005040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.805+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4807a060 2023-12-07T21:09:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.805+0000 7f8b568ef640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8b4807a060 0x7f8b48005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.805+0000 7f8b568ef640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8b4807a060 0x7f8b48005040 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.806+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b4c006070 con 0x7f8b4807a060 2023-12-07T21:09:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.806+0000 7f8b568ef640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8b4c00d3d0 0x7f8b4c00d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.806+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.806+0000 7f8b578f1640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8b4c00d3d0 0x7f8b4c00d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.807 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.806+0000 7f8b578f1640 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8b4c00d3d0 0x7f8b4c00d830 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.806+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.806+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f082954320 2023-12-07T21:09:18.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.807+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.807+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f082954320 2023-12-07T21:09:18.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.807+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.807+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.807+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.807+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.807+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.807+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4807a060 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.807+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b4c006070 con 0x7f8b4807a060 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.807+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f08295a100 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.808+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.808+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f082954320 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.808+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.808+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.808+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.808+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f082954320 2023-12-07T21:09:18.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.808+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.808+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4807a060 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.809+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8b4c006070 con 0x7f8b4807a060 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.809+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f08295a100 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.809+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.809+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f08295a100 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.809+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.809+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.809+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.809+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f08295a100 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.810+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.810+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f08295a100 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.810+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.810+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f082954320 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.810+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.810+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f082954320 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.810+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.810+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.811+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.811+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f08295a100 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.811+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.811+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4807a060 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.811+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b4c006070 con 0x7f8b4807a060 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.811+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f082954320 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.811+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.811+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.812+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.812+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f08295a100 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.812+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.812+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.820 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.812+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.812+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4807a060 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.813+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b4c006070 con 0x7f8b4807a060 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.813+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f08295a100 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.813+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.813+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.813+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.813+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ca80 con 0x55f082954320 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50053080 con 0x7f8b4807a060 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8b4c006070 con 0x7f8b4807a060 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:18.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082958d40 con 0x55f082954320 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f0829589c0 con 0x55f082954320 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082959610 con 0x55f08295a100 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.814+0000 7f8b5b32c800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 20 zone default found 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 4 Realm: () 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 20 zonegroup default 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295cec0 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295ec50 con 0x55f08295a100 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295efe0 con 0x55f08295a100 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 20 started sync module instance, tier type = 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.815+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295e530 con 0x7f8b4807a060 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.816+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b4c006070 con 0x7f8b4807a060 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.816+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491468951376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295e8e0 con 0x7f8b4807a060 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.816+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295f8a0 con 0x55f082954320 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.817+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.817+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491471377408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295fe90 con 0x55f082954320 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.818+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082960960 con 0x55f08295a100 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.819+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94491468951376] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b4c006070 con 0x7f8b4807a060 2023-12-07T21:09:18.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.819+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94491471377408] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.819+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.819+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94491471381568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295f8f0 con 0x55f08295a100 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.819+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f0829611b0 con 0x7f8b4807a060 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.820+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b4c026040 con 0x7f8b4807a060 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.820+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94491471385872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082961dc0 con 0x7f8b4807a060 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.820+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082962640 con 0x55f082954320 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.820+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94491471381568] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.821+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.821+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491471388960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f0829629f0 con 0x55f082954320 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.821+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082963360 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.821+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94491471385872] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b4c026040 con 0x7f8b4807a060 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.822+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.822+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94491471388960] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.822+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94491471386912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082963360 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.822+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f08295e090 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.823+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94491471386912] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.823+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.823+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94491471392448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082963770 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.823+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082963fb0 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.824+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.824+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94491471394672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082963b80 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.824+0000 7f8b5b32c800 20 add_watcher() i=0 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.824+0000 7f8b5b32c800 20 add_watcher() i=1 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.824+0000 7f8b5b32c800 20 add_watcher() i=2 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.824+0000 7f8b5b32c800 20 add_watcher() i=3 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.824+0000 7f8b5b32c800 20 add_watcher() i=4 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.824+0000 7f8b5b32c800 20 add_watcher() i=5 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.824+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94491471392448] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.824+0000 7f8b5b32c800 20 add_watcher() i=6 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.825+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94491471394672] v31'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.825+0000 7f8b5b32c800 20 add_watcher() i=7 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.825+0000 7f8b5b32c800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.825+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f0829632d0 con 0x55f082954320 2023-12-07T21:09:18.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.825+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.825+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94491471397648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f0829632d0 con 0x55f082954320 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.826+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94491471397648] v31'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.826+0000 7f8b1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.827+0000 7f8b5b32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.827+0000 7f8b5b32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.827+0000 7f8b5b32c800 5 note: GC not initialized 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.827+0000 7f8a97fff640 20 reqs_thread_entry: start 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.827+0000 7f8b5b32c800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.827+0000 7f8b5b32c800 20 Filter name: none 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.827+0000 7f8a95ffb640 20 reqs_thread_entry: start 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.827+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082999a40 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.827+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(62 [pgnls start_epoch 31 out=254b] v31'34 uv18 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.827+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082958d40 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.828+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(63 [pgnls start_epoch 31 out=131b] v31'4 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.828+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082958d40 con 0x55f08295a100 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.828+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.828+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082958d40 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.828+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(65 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.828+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082958d40 con 0x55f082954320 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.829+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(66 [pgnls start_epoch 31 out=335b] v31'146 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.829+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x7f8b4807a060 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.829+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(67 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8b4c026040 con 0x7f8b4807a060 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.829+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f08295a100 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.829+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(68 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.829+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f08295a100 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.829+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(69 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.829+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f08295a100 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.830+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(70 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.830+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x7f8b4807a060 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.830+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(71 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8b4c026040 con 0x7f8b4807a060 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.830+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x7f8b4807a060 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.830+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 [pgnls start_epoch 31 out=336b] v31'27 uv19 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x7f8b4c026040 con 0x7f8b4807a060 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.830+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f08295a100 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.830+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(73 [pgnls start_epoch 31 out=131b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.830+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f08295a100 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.831+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(74 [pgnls start_epoch 31 out=254b] v31'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.831+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f08295a100 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.831+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(75 [pgnls start_epoch 31 out=90b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.831+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f082954320 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.831+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(76 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.831+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f08295a100 2023-12-07T21:09:18.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.832+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(77 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.832+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f082954320 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.832+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(78 [pgnls start_epoch 31 out=254b] v31'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.832+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f08295a100 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.832+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(79 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.832+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f08295a100 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.832+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(80 [pgnls start_epoch 31 out=172b] v31'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.832+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f082954320 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.833+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(81 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.833+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x7f8b4807a060 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.833+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(82 [pgnls start_epoch 31 out=276b] v31'16 uv15 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x7f8b4c026040 con 0x7f8b4807a060 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.833+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x7f8b4807a060 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.833+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(83 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8b4c026040 con 0x7f8b4807a060 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.833+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f082954320 2023-12-07T21:09:18.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.833+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(84 [pgnls start_epoch 31 out=295b] v31'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8b50024070 con 0x55f082954320 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.833+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.834+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(85 [pgnls start_epoch 31 out=172b] v31'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.834+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x7f8b4807a060 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.834+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(86 [pgnls start_epoch 31 out=213b] v31'43 uv19 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8b4c026040 con 0x7f8b4807a060 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.834+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.835+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(87 [pgnls start_epoch 31 out=172b] v31'19 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8b50024070 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.835+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f08295a100 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.835+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(88 [pgnls start_epoch 31 out=172b] v31'18 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.835+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x55f08295a100 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.835+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(89 [pgnls start_epoch 31 out=90b] v31'13 uv5 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.835+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b480b1040 con 0x55f08295a100 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.835+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(90 [pgnls start_epoch 31 out=90b] v31'37 uv13 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.835+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b480b1040 con 0x55f082954320 2023-12-07T21:09:18.839 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.836+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(91 [pgnls start_epoch 31 out=131b] v31'6 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7f8b50063090 con 0x55f082954320 2023-12-07T21:09:18.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.836+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x7f8b4807a060 2023-12-07T21:09:18.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.836+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(92 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7f8b4c026040 con 0x7f8b4807a060 2023-12-07T21:09:18.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.836+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f8b50059040 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.840 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.836+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(93 [pgnls start_epoch 31 out=213b] v31'20 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7f8b50063090 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.840 INFO:teuthology.orchestra.run.smithi121.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2023-12-07T21:09:18.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.838+0000 7f8b1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.838+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94491471397648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082998480 con 0x55f082954320 2023-12-07T21:09:18.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.839+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94491471397648] v31'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8b50063090 con 0x55f082954320 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.839+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94491468951376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082998480 con 0x7f8b4807a060 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.840+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94491468951376] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b4c026040 con 0x7f8b4807a060 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.840+0000 7f8b5b32c800 20 remove_watcher() i=0 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.840+0000 7f8b5b32c800 2 removed watcher, disabling cache 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.840+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94491471377408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082998870 con 0x55f082954320 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.841+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94491471377408] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50063090 con 0x55f082954320 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.841+0000 7f8b5b32c800 20 remove_watcher() i=1 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.841+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94491471381568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082998870 con 0x55f08295a100 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.842+0000 7f8b570f0640 1 -- 172.21.15.121:0/94577739 <== osd.3 v2:172.21.15.121:6800/4032235766 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94491471381568] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b48080040 con 0x55f08295a100 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.842+0000 7f8b5b32c800 20 remove_watcher() i=2 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.842+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94491471385872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082998870 con 0x7f8b4807a060 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.843+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94491471385872] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b4c026040 con 0x7f8b4807a060 2023-12-07T21:09:18.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.843+0000 7f8b5b32c800 20 remove_watcher() i=3 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.843+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94491471388960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082998bd0 con 0x55f082954320 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.844+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94491471388960] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50063090 con 0x55f082954320 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.844+0000 7f8b5b32c800 20 remove_watcher() i=4 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.844+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94491471386912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082962120 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.845+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94491471386912] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50063090 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.845+0000 7f8b5b32c800 20 remove_watcher() i=5 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.845+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94491471392448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082962120 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.846+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94491471392448] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50063090 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.846+0000 7f8b5b32c800 20 remove_watcher() i=6 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.846+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94491471394672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f082962ec0 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b578f1640 1 -- 172.21.15.121:0/94577739 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94491471394672] v31'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8b50063090 con 0x7f8b4c00d3d0 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 20 remove_watcher() i=7 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8b4c00d3d0 msgr2=0x7f8b4c00d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8b4c00d3d0 0x7f8b4c00d830 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f082954320 msgr2=0x55f0829567e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f082954320 0x55f0829567e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8b4807a060 msgr2=0x7f8b48005040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8b4807a060 0x7f8b48005040 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f08295a100 msgr2=0x55f08295c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f08295a100 0x55f08295c4f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b300360c0 msgr2=0x7f8b30038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b300360c0 0x7f8b30038580 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c000f60 tx=0x7f8b4c001230 comp rx=0 tx=0).stop 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 msgr2=0x55f082887f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/94577739 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08293f980 0x55f082887f40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000a900 tx=0x7f8b50002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 reap_dead start 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 shutdown_connections 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b568ef640 1 -- 172.21.15.121:0/94577739 reap_dead start 2023-12-07T21:09:18.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.847+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 >> 172.21.15.121:0/94577739 conn(0x55f082889190 msgr2=0x55f082939b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 shutdown_connections 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 -- 172.21.15.121:0/94577739 wait complete. 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2639194712 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b44036110 msgr2=0x7f8b440385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/2639194712 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b44036110 0x7f8b440385d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8b48066810 tx=0x7f8b48066720 comp rx=0 tx=0).stop 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2639194712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 msgr2=0x55f0829337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/2639194712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f0829337f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8b480448a0 tx=0x7f8b48003330 comp rx=0 tx=0).stop 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2639194712 shutdown_connections 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/2639194712 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8b44036110 0x7f8b440385d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 --2- 172.21.15.121:0/2639194712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f082888830 0x55f0829337f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2639194712 >> 172.21.15.121:0/2639194712 conn(0x55f082880f50 msgr2=0x55f08292b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2639194712 shutdown_connections 2023-12-07T21:09:18.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.848+0000 7f8b5b32c800 1 -- 172.21.15.121:0/2639194712 wait complete. 2023-12-07T21:09:18.849 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2023-12-07T21:09:18.849 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2023-12-07T21:09:18.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2023-12-07T21:09:18.850 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2023-12-07T21:09:18.932 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:18.932 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:18.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.939+0000 7fc77eb30800 1 Processor -- start 2023-12-07T21:09:18.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.939+0000 7fc77eb30800 1 -- start start 2023-12-07T21:09:18.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.939+0000 7fc77eb30800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f7ccc555d0 0x55f7ccc579c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.939+0000 7fc77eb30800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f7ccb9e7a0 con 0x55f7ccc526d0 2023-12-07T21:09:18.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.939+0000 7fc77eb30800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f7ccb67880 con 0x55f7ccc555d0 2023-12-07T21:09:18.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.939+0000 7fc77a0c5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f7ccc555d0 0x55f7ccc579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.939+0000 7fc77a8c6640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55f7ccc526d0 0x55f7ccc52af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55950/0 (socket says 172.21.15.121:55950) 2023-12-07T21:09:18.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.939+0000 7fc77a8c6640 1 -- 172.21.15.121:0/338054775 learned_addr learned my addr 172.21.15.121:0/338054775 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:18.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.940+0000 7fc77a0c5640 1 -- 172.21.15.121:0/338054775 >> v1:172.21.15.89:6789/0 conn(0x55f7ccc526d0 legacy=0x55f7ccc52af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.940+0000 7fc77a0c5640 1 -- 172.21.15.121:0/338054775 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7ccc58fa0 con 0x55f7ccc555d0 2023-12-07T21:09:18.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.940+0000 7fc7798c4640 1 -- 172.21.15.121:0/338054775 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991534843 0 0) 0x55f7ccb9e7a0 con 0x55f7ccc526d0 2023-12-07T21:09:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.941+0000 7fc77a0c5640 1 --2- 172.21.15.121:0/338054775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc555d0 0x55f7ccc579c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc77000a470 tx=0x7fc77001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd0a34895df0765 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.942+0000 7fc7798c4640 1 -- 172.21.15.121:0/338054775 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc770052570 con 0x55f7ccc555d0 2023-12-07T21:09:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.942+0000 7fc7798c4640 1 -- 172.21.15.121:0/338054775 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7700526d0 con 0x55f7ccc555d0 2023-12-07T21:09:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.942+0000 7fc7798c4640 1 -- 172.21.15.121:0/338054775 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc770052990 con 0x55f7ccc555d0 2023-12-07T21:09:18.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.942+0000 7fc77eb30800 1 -- 172.21.15.121:0/338054775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc555d0 msgr2=0x55f7ccc579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.942+0000 7fc77eb30800 1 --2- 172.21.15.121:0/338054775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc555d0 0x55f7ccc579c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc77000a470 tx=0x7fc77001cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.942+0000 7fc77eb30800 1 -- 172.21.15.121:0/338054775 shutdown_connections 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.942+0000 7fc77eb30800 1 --2- 172.21.15.121:0/338054775 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc555d0 0x55f7ccc579c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.942+0000 7fc77eb30800 1 -- 172.21.15.121:0/338054775 >> 172.21.15.121:0/338054775 conn(0x55f7ccc4bf60 msgr2=0x55f7ccc4e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.942+0000 7fc77eb30800 1 -- 172.21.15.121:0/338054775 shutdown_connections 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.942+0000 7fc77eb30800 1 -- 172.21.15.121:0/338054775 wait complete. 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.943+0000 7fc77eb30800 1 Processor -- start 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.943+0000 7fc77eb30800 1 -- start start 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.943+0000 7fc77eb30800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7ccc50560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.943+0000 7fc77eb30800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7ccb64db0 con 0x55f7ccc526d0 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.943+0000 7fc77a8c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7ccc50560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.943+0000 7fc77a8c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7ccc50560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55308/0 (socket says 172.21.15.121:55308) 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.943+0000 7fc77a8c6640 1 -- 172.21.15.121:0/822478867 learned_addr learned my addr 172.21.15.121:0/822478867 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.943+0000 7fc77a8c6640 1 -- 172.21.15.121:0/822478867 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc770005d20 con 0x55f7ccc526d0 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.944+0000 7fc77a8c6640 1 --2- 172.21.15.121:0/822478867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7ccc50560 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b210 tx=0x7fc76c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff72c6c3930cc7e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.944+0000 7fc7790c3640 1 -- 172.21.15.121:0/822478867 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc76c014070 con 0x55f7ccc526d0 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.944+0000 7fc7790c3640 1 -- 172.21.15.121:0/822478867 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c00d500 con 0x55f7ccc526d0 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.944+0000 7fc7790c3640 1 -- 172.21.15.121:0/822478867 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc76c00d800 con 0x55f7ccc526d0 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.944+0000 7fc77eb30800 1 -- 172.21.15.121:0/822478867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 msgr2=0x55f7ccc50560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.944+0000 7fc77eb30800 1 --2- 172.21.15.121:0/822478867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7ccc50560 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b210 tx=0x7fc76c00b6d0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.944+0000 7fc77eb30800 1 -- 172.21.15.121:0/822478867 shutdown_connections 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.944+0000 7fc77eb30800 1 --2- 172.21.15.121:0/822478867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7ccc50560 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.944+0000 7fc77eb30800 1 -- 172.21.15.121:0/822478867 >> 172.21.15.121:0/822478867 conn(0x55f7ccc4bf60 msgr2=0x55f7cccf18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.944+0000 7fc77eb30800 1 -- 172.21.15.121:0/822478867 shutdown_connections 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.944+0000 7fc77eb30800 1 -- 172.21.15.121:0/822478867 wait complete. 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.945+0000 7fc77eb30800 1 Processor -- start 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.945+0000 7fc77eb30800 1 -- start start 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.945+0000 7fc77eb30800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7cccfe1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.945+0000 7fc77eb30800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7ccb606a0 con 0x55f7ccc526d0 2023-12-07T21:09:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.945+0000 7fc77a8c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7cccfe1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.945+0000 7fc77a8c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7cccfe1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55312/0 (socket says 172.21.15.121:55312) 2023-12-07T21:09:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.945+0000 7fc77a8c6640 1 -- 172.21.15.121:0/1068787546 learned_addr learned my addr 172.21.15.121:0/1068787546 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.945+0000 7fc77a8c6640 1 -- 172.21.15.121:0/1068787546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c001b70 con 0x55f7ccc526d0 2023-12-07T21:09:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.945+0000 7fc77a8c6640 1 --2- 172.21.15.121:0/1068787546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7cccfe1f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b210 tx=0x7fc76c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.945+0000 7fc763fff640 1 -- 172.21.15.121:0/1068787546 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc76c00de30 con 0x55f7ccc526d0 2023-12-07T21:09:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.946+0000 7fc763fff640 1 -- 172.21.15.121:0/1068787546 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c020070 con 0x55f7ccc526d0 2023-12-07T21:09:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.946+0000 7fc763fff640 1 -- 172.21.15.121:0/1068787546 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc76c00fb00 con 0x55f7ccc526d0 2023-12-07T21:09:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.946+0000 7fc77eb30800 1 -- 172.21.15.121:0/1068787546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f7cccfe730 con 0x55f7ccc526d0 2023-12-07T21:09:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.946+0000 7fc77eb30800 1 -- 172.21.15.121:0/1068787546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7cccfec10 con 0x55f7ccc526d0 2023-12-07T21:09:18.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.946+0000 7fc77eb30800 1 Processor -- start 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.946+0000 7fc77eb30800 1 -- start start 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.946+0000 7fc77eb30800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 0x55f7ccd0a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.946+0000 7fc77eb30800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7ccafa890 con 0x55f7ccd0a440 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.946+0000 7fc763fff640 1 -- 172.21.15.121:0/1068787546 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc76c00d040 con 0x55f7ccc526d0 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc77b0c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 0x55f7ccd0a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc77b0c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 0x55f7ccd0a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55318/0 (socket says 172.21.15.121:55318) 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc77b0c7640 1 -- 172.21.15.121:0/142481914 learned_addr learned my addr 172.21.15.121:0/142481914 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc763fff640 1 --2- 172.21.15.121:0/1068787546 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc768036110 0x7fc7680385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc763fff640 1 -- 172.21.15.121:0/1068787546 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc76c00a040 con 0x55f7ccc526d0 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc77a8c6640 1 --2- 172.21.15.121:0/1068787546 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc768036110 0x7fc7680385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc77b0c7640 1 -- 172.21.15.121:0/142481914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7ccd0ada0 con 0x55f7ccd0a440 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc77b0c7640 1 --2- 172.21.15.121:0/142481914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 0x55f7ccd0a860 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc77400a430 tx=0x7fc77400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2354ef00af46d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc77a8c6640 1 --2- 172.21.15.121:0/1068787546 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc768036110 0x7fc7680385d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc76c01bfd0 tx=0x7fc76c0013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc761ffb640 1 -- 172.21.15.121:0/142481914 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc774001650 con 0x55f7ccd0a440 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc761ffb640 1 -- 172.21.15.121:0/142481914 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7740017d0 con 0x55f7ccd0a440 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.947+0000 7fc761ffb640 1 -- 172.21.15.121:0/142481914 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc774001ab0 con 0x55f7ccd0a440 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77eb30800 1 -- 172.21.15.121:0/142481914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 msgr2=0x55f7ccd0a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77eb30800 1 --2- 172.21.15.121:0/142481914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 0x55f7ccd0a860 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc77400a430 tx=0x7fc77400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77eb30800 1 -- 172.21.15.121:0/142481914 shutdown_connections 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77eb30800 1 --2- 172.21.15.121:0/142481914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 0x55f7ccd0a860 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77eb30800 1 -- 172.21.15.121:0/142481914 >> 172.21.15.121:0/142481914 conn(0x55f7ccc555d0 msgr2=0x55f7ccd05820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77eb30800 1 -- 172.21.15.121:0/142481914 shutdown_connections 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77eb30800 1 -- 172.21.15.121:0/142481914 wait complete. 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77eb30800 1 Processor -- start 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77eb30800 1 -- start start 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77eb30800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 0x55f7cccf7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77eb30800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7ccafa530 con 0x55f7ccd0a440 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77b0c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 0x55f7cccf7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77b0c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 0x55f7cccf7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55324/0 (socket says 172.21.15.121:55324) 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.948+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 learned_addr learned my addr 172.21.15.121:0/2068571402 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.949+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77400a0e0 con 0x55f7ccd0a440 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.949+0000 7fc77b0c7640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 0x55f7cccf7520 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc77400a930 tx=0x7fc774003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.949+0000 7fc75bfff640 1 -- 172.21.15.121:0/2068571402 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc774010900 con 0x55f7ccd0a440 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.949+0000 7fc75bfff640 1 -- 172.21.15.121:0/2068571402 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774010a60 con 0x55f7ccd0a440 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.949+0000 7fc75bfff640 1 -- 172.21.15.121:0/2068571402 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc774010d20 con 0x55f7ccd0a440 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.949+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f7cccf5ba0 con 0x55f7ccd0a440 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.949+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7cccf6000 con 0x55f7ccd0a440 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.950+0000 7fc75bfff640 1 -- 172.21.15.121:0/2068571402 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fc774017030 con 0x55f7ccd0a440 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.950+0000 7fc75bfff640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc754036110 0x7fc7540385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.950+0000 7fc75bfff640 1 -- 172.21.15.121:0/2068571402 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fc77404b810 con 0x55f7ccd0a440 2023-12-07T21:09:18.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.950+0000 7fc77a0c5640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc754036110 0x7fc7540385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.950+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.950+0000 7fc77eb30800 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f7ccd1ee10 0x55f7ccd212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.950+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd21a20 con 0x55f7ccd1ee10 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.950+0000 7fc77a0c5640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc754036110 0x7fc7540385d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc770054000 tx=0x7fc77004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.950+0000 7fc77b0c7640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f7ccd1ee10 0x55f7ccd212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77b0c7640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f7ccd1ee10 0x55f7ccd212d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77eb30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77eb30800 20 realm 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd21e10 con 0x55f7ccd1ee10 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77eb30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77eb30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:18.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd22690 con 0x55f7ccd1ee10 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77eb30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.951+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd229f0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.952+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.952+0000 7fc77eb30800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.952+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.952+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd231f0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.952+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.952+0000 7fc77eb30800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.952+0000 7fc77eb30800 20 searching for the correct realm 2023-12-07T21:09:18.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.952+0000 7fc77eb30800 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f7ccd24f10 0x55f7ccd273a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.952+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd24f10 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.952+0000 7fc77a8c6640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f7ccd24f10 0x55f7ccd273a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.952+0000 7fc77a8c6640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f7ccd24f10 0x55f7ccd273a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.953+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc76c016070 con 0x55f7ccd24f10 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.953+0000 7fc77a8c6640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc76c01c8c0 0x7fc76c030440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.953+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc76c01c8c0 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.953+0000 7fc77a0c5640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc76c01c8c0 0x7fc76c030440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.953+0000 7fc77a0c5640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc76c01c8c0 0x7fc76c030440 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.953+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.953+0000 7fc77a0c5640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc77005ca90 0x7fc7700673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.953+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc77005ca90 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.954+0000 7fc77b0c7640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc77005ca90 0x7fc7700673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:18.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.954+0000 7fc77b0c7640 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc77005ca90 0x7fc7700673d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.954+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.954+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd1ee10 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.954+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.954+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd1ee10 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.954+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.954+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc77005ca90 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.955+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.955+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc77005ca90 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.955+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.955+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc76c01c8c0 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.955+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.955+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd24f10 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.955+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc76c016070 con 0x55f7ccd24f10 2023-12-07T21:09:18.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.955+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd1ee10 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.956+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.956+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc77005ca90 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.956+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.956+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd1ee10 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.956+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.956+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc76c01c8c0 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.956+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.956+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd24f10 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.956+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc76c016070 con 0x55f7ccd24f10 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.956+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd24f10 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.957+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc76c016070 con 0x55f7ccd24f10 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.957+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc77005ca90 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.957+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.957+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd24f10 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.957+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc76c048040 con 0x55f7ccd24f10 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.957+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd24f10 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.957+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc76c048040 con 0x55f7ccd24f10 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.957+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd1ee10 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.958+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.958+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd1ee10 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.958+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.958+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc77005ca90 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.958+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.958+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd24f10 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.958+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc76c048040 con 0x55f7ccd24f10 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.958+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc76c01c8c0 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.958+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.958+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd1ee10 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.959+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.959+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc77005ca90 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.959+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.959+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd24f10 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.959+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc76c048040 con 0x55f7ccd24f10 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.959+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc77005ca90 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.959+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.959+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc76c01c8c0 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.960+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.960+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd24f10 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.960+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc76c048040 con 0x55f7ccd24f10 2023-12-07T21:09:18.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.960+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x7fc77005ca90 2023-12-07T21:09:18.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27a70 con 0x55f7ccd1ee10 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc774053080 con 0x7fc76c01c8c0 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77eb30800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77eb30800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77eb30800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77eb30800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77eb30800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77eb30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd23b20 con 0x55f7ccd1ee10 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77eb30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.961+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd237a0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd243f0 con 0x55f7ccd24f10 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc76c048040 con 0x55f7ccd24f10 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 20 zone default found 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 4 Realm: () 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 20 zonegroup default 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd27eb0 con 0x7fc77005ca90 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd29d30 con 0x55f7ccd24f10 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.962+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc76c057040 con 0x55f7ccd24f10 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.963+0000 7fc77eb30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.963+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.963+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2a090 con 0x55f7ccd24f10 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.963+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc76c057040 con 0x55f7ccd24f10 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.963+0000 7fc77eb30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.963+0000 7fc77eb30800 20 started sync module instance, tier type = 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.963+0000 7fc77eb30800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.963+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd29300 con 0x7fc76c01c8c0 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.964+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.964+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522779213648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd296e0 con 0x7fc76c01c8c0 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.964+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2a890 con 0x55f7ccd1ee10 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.965+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522779213648] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.965+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.965+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522781634144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2a890 con 0x55f7ccd1ee10 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.965+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2b240 con 0x55f7ccd24f10 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.966+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc76c057040 con 0x55f7ccd24f10 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.966+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522781642080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2ba90 con 0x55f7ccd24f10 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.966+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2c470 con 0x7fc76c01c8c0 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.966+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522781634144] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.967+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.967+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522781639664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2ccf0 con 0x7fc76c01c8c0 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.967+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2d4f0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.967+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522781642080] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc76c057040 con 0x55f7ccd24f10 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.968+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522781639664] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.968+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.968+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522781644272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2c960 con 0x55f7ccd1ee10 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.968+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2db80 con 0x7fc77005ca90 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.969+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.969+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522781644272] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.969+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522781652624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2db80 con 0x7fc77005ca90 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.969+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2d050 con 0x7fc77005ca90 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.970+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522781652624] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.972+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.972+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522781651024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2e540 con 0x7fc77005ca90 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.972+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2ed40 con 0x7fc77005ca90 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.973+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.974+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522781651024] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.974+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522781656864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2dfc0 con 0x7fc77005ca90 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.974+0000 7fc77eb30800 20 add_watcher() i=0 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.974+0000 7fc77eb30800 20 add_watcher() i=1 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.974+0000 7fc77eb30800 20 add_watcher() i=2 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.974+0000 7fc77eb30800 20 add_watcher() i=3 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.974+0000 7fc77eb30800 20 add_watcher() i=4 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.974+0000 7fc77eb30800 20 add_watcher() i=5 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.974+0000 7fc77eb30800 20 add_watcher() i=6 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.975+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522781656864] v31'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.975+0000 7fc77eb30800 20 add_watcher() i=7 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.975+0000 7fc77eb30800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.975+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd32100 con 0x55f7ccd1ee10 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.975+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.975+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522781657904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd2f610 con 0x55f7ccd1ee10 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.976+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522781657904] v31'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.976+0000 7fc740fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 5 note: GC not initialized 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc6bb7fe640 20 reqs_thread_entry: start 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 20 Filter name: none 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc6b97fa640 20 reqs_thread_entry: start 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd65150 con 0x55f7ccd1ee10 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:18.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.977+0000 7fc77eb30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd67590 con 0x7fc76c01c8c0 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv31 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 20 disabling bucket name=myfoo 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd64bf0 con 0x7fc76c01c8c0 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 : miss 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 20 rados->read ofs=0 len=0 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd67180 con 0x7fc76c01c8c0 2023-12-07T21:09:18.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(65 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv30 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.978+0000 7fc77eb30800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.979+0000 7fc77eb30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.979+0000 7fc77eb30800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.979+0000 7fc77eb30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.979+0000 7fc77eb30800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.979+0000 7fc77eb30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.979+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd6fed0 con 0x7fc76c01c8c0 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(66 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'33 uv33 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc77eb30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc77eb30800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc77eb30800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc77eb30800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1, ofs0, ns] 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94522781895520 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd6d760 con 0x7fc77005ca90 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== watch-notify(notify (1) cookie 94522781652624 notify 133143986194 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55f7cccf6000 con 0x7fc77005ca90 2023-12-07T21:09:18.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc761ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94522781652624 notifier 4534 bl.length()=725 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc761ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc761ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc761ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(67 notify.5 [notify cookie 94522781895520 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.980+0000 7fc761ffb640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc7500042a0 con 0x7fc77005ca90 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.981+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.981+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== watch-notify(notify_complete (2) cookie 94522781895520 notify 133143986194 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f7cccf5ba0 con 0x7fc77005ca90 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.981+0000 7fc77eb30800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_sources= new_sources= 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.981+0000 7fc77eb30800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential sources added=[] removed=[] 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.981+0000 7fc77eb30800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_dests= new_dests= 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.981+0000 7fc77eb30800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential dests added=[] removed=[] 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.981+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd6a540 con 0x55f7ccd1ee10 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v31'12 uv12 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc77eb30800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc77eb30800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc77eb30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94522781895520 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd6eb20 con 0x55f7ccd1ee10 2023-12-07T21:09:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94522781644272 notify 133143986192 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x55f7cccf5ba0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc761ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94522781644272 notifier 4534 bl.length()=533 2023-12-07T21:09:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc761ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc761ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(70 notify.4 [notify cookie 94522781895520 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc761ffb640 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fc750004600 con 0x55f7ccd1ee10 2023-12-07T21:09:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.982+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.983+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== watch-notify(notify_complete (2) cookie 94522781895520 notify 133143986192 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc77400a0e0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.990 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.983+0000 7fc740fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.983+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522781657904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd4dff0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.984+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94522781657904] v31'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.984+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522779213648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd4dff0 con 0x7fc76c01c8c0 2023-12-07T21:09:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.985+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94522779213648] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.985+0000 7fc77eb30800 20 remove_watcher() i=0 2023-12-07T21:09:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.985+0000 7fc77eb30800 2 removed watcher, disabling cache 2023-12-07T21:09:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.985+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522781634144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd23b20 con 0x55f7ccd1ee10 2023-12-07T21:09:18.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.986+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94522781634144] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.986+0000 7fc77eb30800 20 remove_watcher() i=1 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.986+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522781642080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd23b20 con 0x55f7ccd24f10 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.987+0000 7fc77a8c6640 1 -- 172.21.15.121:0/2068571402 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94522781642080] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc76c057040 con 0x55f7ccd24f10 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.987+0000 7fc77eb30800 20 remove_watcher() i=2 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.987+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522781639664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd4dff0 con 0x7fc76c01c8c0 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.988+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94522781639664] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc770052840 con 0x7fc76c01c8c0 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.988+0000 7fc77eb30800 20 remove_watcher() i=3 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.988+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522781644272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd4dff0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.989+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94522781644272] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x55f7ccd1ee10 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.989+0000 7fc77eb30800 20 remove_watcher() i=4 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.989+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522781652624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd4dff0 con 0x7fc77005ca90 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.990+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94522781652624] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.990+0000 7fc77eb30800 20 remove_watcher() i=5 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.990+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522781651024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd4dff0 con 0x7fc77005ca90 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.991+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94522781651024] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.991+0000 7fc77eb30800 20 remove_watcher() i=6 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.991+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522781656864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55f7ccd4dff0 con 0x7fc77005ca90 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.992+0000 7fc77b0c7640 1 -- 172.21.15.121:0/2068571402 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94522781656864] v31'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc77402e9d0 con 0x7fc77005ca90 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.992+0000 7fc77eb30800 20 remove_watcher() i=7 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc77005ca90 msgr2=0x7fc7700673d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fc77005ca90 0x7fc7700673d0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f7ccd1ee10 msgr2=0x55f7ccd212d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f7ccd1ee10 0x55f7ccd212d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc76c01c8c0 msgr2=0x7fc76c030440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fc76c01c8c0 0x7fc76c030440 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f7ccd24f10 msgr2=0x55f7ccd273a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f7ccd24f10 0x55f7ccd273a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc754036110 msgr2=0x7fc7540385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc754036110 0x7fc7540385d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc770054000 tx=0x7fc77004e000 comp rx=0 tx=0).stop 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 msgr2=0x55f7cccf7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 --2- 172.21.15.121:0/2068571402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccd0a440 0x55f7cccf7520 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc77400a930 tx=0x7fc774003370 comp rx=0 tx=0).stop 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 reap_dead start 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77a0c5640 1 -- 172.21.15.121:0/2068571402 reap_dead start 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 shutdown_connections 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 >> 172.21.15.121:0/2068571402 conn(0x55f7ccc555d0 msgr2=0x55f7ccd04620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 shutdown_connections 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/2068571402 wait complete. 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/1068787546 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc768036110 msgr2=0x7fc7680385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 --2- 172.21.15.121:0/1068787546 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc768036110 0x7fc7680385d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc76c01bfd0 tx=0x7fc76c0013e0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/1068787546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 msgr2=0x55f7cccfe1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:18.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 --2- 172.21.15.121:0/1068787546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7cccfe1f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00b210 tx=0x7fc76c000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/1068787546 shutdown_connections 2023-12-07T21:09:18.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 --2- 172.21.15.121:0/1068787546 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fc768036110 0x7fc7680385d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 --2- 172.21.15.121:0/1068787546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f7ccc526d0 0x55f7cccfe1f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:18.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/1068787546 >> 172.21.15.121:0/1068787546 conn(0x55f7ccc4bf60 msgr2=0x55f7cccf4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:18.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/1068787546 shutdown_connections 2023-12-07T21:09:18.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:18.993+0000 7fc77eb30800 1 -- 172.21.15.121:0/1068787546 wait complete. 2023-12-07T21:09:18.998 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:19.000 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2023-12-07T21:09:19.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2023-12-07T21:09:19.000 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2023-12-07T21:09:19.077 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:19.077 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:19.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.084+0000 7f0206b22800 1 Processor -- start 2023-12-07T21:09:19.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.084+0000 7f0206b22800 1 -- start start 2023-12-07T21:09:19.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.084+0000 7f0206b22800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5611868c9520 0x5611868cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:19.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.084+0000 7f0206b22800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5611868117a0 con 0x561186839b50 2023-12-07T21:09:19.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.084+0000 7f0206b22800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5611867da880 con 0x5611868c9520 2023-12-07T21:09:19.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.084+0000 7f0201fa5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5611868c9520 0x5611868cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:19.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.084+0000 7f02027a6640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x561186839b50 0x5611868c7e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:55964/0 (socket says 172.21.15.121:55964) 2023-12-07T21:09:19.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.084+0000 7f02027a6640 1 -- 172.21.15.121:0/2965742459 learned_addr learned my addr 172.21.15.121:0/2965742459 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:19.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.085+0000 7f0201fa5640 1 -- 172.21.15.121:0/2965742459 >> v1:172.21.15.89:6789/0 conn(0x561186839b50 legacy=0x5611868c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.085+0000 7f0201fa5640 1 -- 172.21.15.121:0/2965742459 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611868cd050 con 0x5611868c9520 2023-12-07T21:09:19.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.086+0000 7f0201fa5640 1 --2- 172.21.15.121:0/2965742459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611868c9520 0x5611868cb970 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00a470 tx=0x7f01ec01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fda3742df7f49e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:19.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.087+0000 7f02017a4640 1 -- 172.21.15.121:0/2965742459 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01ec052570 con 0x5611868c9520 2023-12-07T21:09:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.087+0000 7f02017a4640 1 -- 172.21.15.121:0/2965742459 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec0526d0 con 0x5611868c9520 2023-12-07T21:09:19.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.087+0000 7f02017a4640 1 -- 172.21.15.121:0/2965742459 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01ec052990 con 0x5611868c9520 2023-12-07T21:09:19.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.087+0000 7f0206b22800 1 -- 172.21.15.121:0/2965742459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611868c9520 msgr2=0x5611868cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.087+0000 7f0206b22800 1 --2- 172.21.15.121:0/2965742459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611868c9520 0x5611868cb970 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00a470 tx=0x7f01ec01cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.087+0000 7f0206b22800 1 -- 172.21.15.121:0/2965742459 shutdown_connections 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.087+0000 7f0206b22800 1 --2- 172.21.15.121:0/2965742459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5611868c9520 0x5611868cb970 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.087+0000 7f0206b22800 1 -- 172.21.15.121:0/2965742459 >> 172.21.15.121:0/2965742459 conn(0x5611868bf880 msgr2=0x5611868c1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.087+0000 7f0206b22800 1 -- 172.21.15.121:0/2965742459 shutdown_connections 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.087+0000 7f0206b22800 1 -- 172.21.15.121:0/2965742459 wait complete. 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.088+0000 7f0206b22800 1 Processor -- start 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.088+0000 7f0206b22800 1 -- start start 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.088+0000 7f0206b22800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186969e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.088+0000 7f0206b22800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611867d7db0 con 0x561186839b50 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.088+0000 7f02027a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186969e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.088+0000 7f02027a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186969e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55344/0 (socket says 172.21.15.121:55344) 2023-12-07T21:09:19.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.088+0000 7f02027a6640 1 -- 172.21.15.121:0/1651360119 learned_addr learned my addr 172.21.15.121:0/1651360119 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:19.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.088+0000 7f02027a6640 1 -- 172.21.15.121:0/1651360119 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec005d20 con 0x561186839b50 2023-12-07T21:09:19.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f02027a6640 1 --2- 172.21.15.121:0/1651360119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186969e40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f01fc001c50 tx=0x7f01fc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eca8fc02e1d80cb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:19.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0200fa3640 1 -- 172.21.15.121:0/1651360119 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01fc00e470 con 0x561186839b50 2023-12-07T21:09:19.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0200fa3640 1 -- 172.21.15.121:0/1651360119 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc00e5d0 con 0x561186839b50 2023-12-07T21:09:19.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0200fa3640 1 -- 172.21.15.121:0/1651360119 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01fc00e8d0 con 0x561186839b50 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0206b22800 1 -- 172.21.15.121:0/1651360119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 msgr2=0x561186969e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0206b22800 1 --2- 172.21.15.121:0/1651360119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186969e40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f01fc001c50 tx=0x7f01fc00b6c0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0206b22800 1 -- 172.21.15.121:0/1651360119 shutdown_connections 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0206b22800 1 --2- 172.21.15.121:0/1651360119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186969e40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0206b22800 1 -- 172.21.15.121:0/1651360119 >> 172.21.15.121:0/1651360119 conn(0x5611868bf880 msgr2=0x561186965ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0206b22800 1 -- 172.21.15.121:0/1651360119 shutdown_connections 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0206b22800 1 -- 172.21.15.121:0/1651360119 wait complete. 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0206b22800 1 Processor -- start 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.089+0000 7f0206b22800 1 -- start start 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.090+0000 7f0206b22800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186971340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.090+0000 7f0206b22800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611867d36a0 con 0x561186839b50 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.090+0000 7f02027a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186971340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:19.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.090+0000 7f02027a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186971340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55356/0 (socket says 172.21.15.121:55356) 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.090+0000 7f02027a6640 1 -- 172.21.15.121:0/522679229 learned_addr learned my addr 172.21.15.121:0/522679229 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.090+0000 7f02027a6640 1 -- 172.21.15.121:0/522679229 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611868117a0 con 0x561186839b50 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.090+0000 7f02027a6640 1 --2- 172.21.15.121:0/522679229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186971340 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f01fc000c00 tx=0x7f01fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.090+0000 7f01fb7fe640 1 -- 172.21.15.121:0/522679229 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01fc01f070 con 0x561186839b50 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.090+0000 7f01fb7fe640 1 -- 172.21.15.121:0/522679229 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc018770 con 0x561186839b50 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.090+0000 7f0206b22800 1 -- 172.21.15.121:0/522679229 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561186971880 con 0x561186839b50 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.090+0000 7f01fb7fe640 1 -- 172.21.15.121:0/522679229 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01fc018a30 con 0x561186839b50 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f0206b22800 1 -- 172.21.15.121:0/522679229 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561186971d60 con 0x561186839b50 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f0206b22800 1 Processor -- start 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f0206b22800 1 -- start start 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f0206b22800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x56118697d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f0206b22800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118676d890 con 0x56118697d4d0 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f01fb7fe640 1 -- 172.21.15.121:0/522679229 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f01fc018b90 con 0x561186839b50 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f0202fa7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x56118697d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:19.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f01fb7fe640 1 --2- 172.21.15.121:0/522679229 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e4036110 0x7f01e40385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f0202fa7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x56118697d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55368/0 (socket says 172.21.15.121:55368) 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f0202fa7640 1 -- 172.21.15.121:0/1454154241 learned_addr learned my addr 172.21.15.121:0/1454154241 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f01fb7fe640 1 -- 172.21.15.121:0/522679229 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f01fc04b970 con 0x561186839b50 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.091+0000 7f02027a6640 1 --2- 172.21.15.121:0/522679229 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e4036110 0x7f01e40385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f0202fa7640 1 -- 172.21.15.121:0/1454154241 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56118697de30 con 0x56118697d4d0 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f0202fa7640 1 --2- 172.21.15.121:0/1454154241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x56118697d8f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f01f400a430 tx=0x7f01f400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fecbdf8ffa6096f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f02027a6640 1 --2- 172.21.15.121:0/522679229 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e4036110 0x7f01e40385d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00dfd0 tx=0x7f01fc00dec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f01f97fa640 1 -- 172.21.15.121:0/1454154241 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01f4001650 con 0x56118697d4d0 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f01f97fa640 1 -- 172.21.15.121:0/1454154241 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f40017d0 con 0x56118697d4d0 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f01f97fa640 1 -- 172.21.15.121:0/1454154241 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01f4001ab0 con 0x56118697d4d0 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f0206b22800 1 -- 172.21.15.121:0/1454154241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 msgr2=0x56118697d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f0206b22800 1 --2- 172.21.15.121:0/1454154241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x56118697d8f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f01f400a430 tx=0x7f01f400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f0206b22800 1 -- 172.21.15.121:0/1454154241 shutdown_connections 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f0206b22800 1 --2- 172.21.15.121:0/1454154241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x56118697d8f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f0206b22800 1 -- 172.21.15.121:0/1454154241 >> 172.21.15.121:0/1454154241 conn(0x5611868c9520 msgr2=0x5611869788b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f0206b22800 1 -- 172.21.15.121:0/1454154241 shutdown_connections 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.092+0000 7f0206b22800 1 -- 172.21.15.121:0/1454154241 wait complete. 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f0206b22800 1 Processor -- start 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f0206b22800 1 -- start start 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f0206b22800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x5611869844b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f0206b22800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56118676d530 con 0x56118697d4d0 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f0202fa7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x5611869844b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f0202fa7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x5611869844b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55370/0 (socket says 172.21.15.121:55370) 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 learned_addr learned my addr 172.21.15.121:0/3227328066 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f400a0e0 con 0x56118697d4d0 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f0202fa7640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x5611869844b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f01f400a930 tx=0x7f01f4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:19.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f01e37fe640 1 -- 172.21.15.121:0/3227328066 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01f4010900 con 0x56118697d4d0 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f01e37fe640 1 -- 172.21.15.121:0/3227328066 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f4010a60 con 0x56118697d4d0 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.093+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5611869849f0 con 0x56118697d4d0 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.094+0000 7f01e37fe640 1 -- 172.21.15.121:0/3227328066 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01f4010d20 con 0x56118697d4d0 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.094+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561186984e50 con 0x56118697d4d0 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.094+0000 7f01e37fe640 1 -- 172.21.15.121:0/3227328066 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f01f4017030 con 0x56118697d4d0 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.094+0000 7f01e37fe640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01dc036110 0x7f01dc0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.094+0000 7f01e37fe640 1 -- 172.21.15.121:0/3227328066 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f01f404b890 con 0x56118697d4d0 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.095+0000 7f0201fa5640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01dc036110 0x7f01dc0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.095+0000 7f0201fa5640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01dc036110 0x7f01dc0385d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f01ec054000 tx=0x7f01ec04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.095+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.095+0000 7f0206b22800 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56118698fc00 0x5611869920c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.095+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186992810 con 0x56118698fc00 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.095+0000 7f0202fa7640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56118698fc00 0x5611869920c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:19.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.095+0000 7f0202fa7640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56118698fc00 0x5611869920c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 20 realm 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186992c20 con 0x56118698fc00 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869934a0 con 0x56118698fc00 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:19.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186993800 con 0x56118698fc00 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.096+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186994000 con 0x56118698fc00 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.097+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.097+0000 7f0206b22800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.097+0000 7f0206b22800 20 searching for the correct realm 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.097+0000 7f0206b22800 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x561186995d20 0x5611869981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.097+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x561186995d20 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.097+0000 7f02027a6640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x561186995d20 0x5611869981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.097+0000 7f02027a6640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x561186995d20 0x5611869981b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.097+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.097+0000 7f02027a6640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f01fc017050 0x7f01fc04b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.097+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01fc017050 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.098+0000 7f0201fa5640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f01fc017050 0x7f01fc04b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.098+0000 7f0201fa5640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f01fc017050 0x7f01fc04b3a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.098+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.098+0000 7f0201fa5640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f01ec05c920 0x7f01ec0673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.098+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01ec05c920 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.098+0000 7f0202fa7640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f01ec05c920 0x7f01ec0673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.099+0000 7f0202fa7640 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f01ec05c920 0x7f01ec0673d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.099+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.099+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x56118698fc00 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.099+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.099+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x56118698fc00 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.100+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.100+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01ec05c920 2023-12-07T21:09:19.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.100+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.100+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01ec05c920 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.100+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.100+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01fc017050 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.100+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.100+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x561186995d20 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.101+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.101+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x56118698fc00 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.101+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.101+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01ec05c920 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.101+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.101+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x56118698fc00 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.101+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.101+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01fc017050 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.101+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.101+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x561186995d20 2023-12-07T21:09:19.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.102+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.102+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x561186995d20 2023-12-07T21:09:19.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.102+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.102+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01ec05c920 2023-12-07T21:09:19.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.102+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.102+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x561186995d20 2023-12-07T21:09:19.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.102+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.102+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x561186995d20 2023-12-07T21:09:19.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.102+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.102+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x56118698fc00 2023-12-07T21:09:19.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.103+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.103+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x56118698fc00 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.103+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.103+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01ec05c920 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.103+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.103+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x561186995d20 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.103+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.103+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01fc017050 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.104+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.104+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x56118698fc00 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.104+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.104+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01ec05c920 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.104+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.104+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x561186995d20 2023-12-07T21:09:19.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.104+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.104+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01ec05c920 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.105+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.105+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01fc017050 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.105+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.105+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x561186995d20 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.105+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.105+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01ec05c920 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x56118698fc00 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186998880 con 0x7f01fc017050 2023-12-07T21:09:19.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0206b22800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0206b22800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0206b22800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0206b22800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0206b22800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0206b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.106+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186994900 con 0x56118698fc00 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186994580 con 0x56118698fc00 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869952d0 con 0x561186995d20 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 20 zone default found 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 4 Realm: () 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 20 zonegroup default 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.107+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186999160 con 0x7f01ec05c920 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f0206b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699ac30 con 0x561186995d20 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f0206b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699b040 con 0x561186995d20 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f0206b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f0206b22800 20 started sync module instance, tier type = 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f0206b22800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.108+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186999f80 con 0x7f01fc017050 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.109+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.109+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94633270234960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699a330 con 0x7f01fc017050 2023-12-07T21:09:19.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.109+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699b8e0 con 0x56118698fc00 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.110+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.110+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94633272652864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699beb0 con 0x56118698fc00 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.110+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699c980 con 0x561186995d20 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.110+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94633270234960] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.111+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.111+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94633272656992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699cd30 con 0x561186995d20 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.111+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699d6a0 con 0x7f01fc017050 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.112+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94633272652864] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.112+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.112+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94633272656992] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.112+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94633272646368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699d310 con 0x7f01fc017050 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.113+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699e0a0 con 0x56118698fc00 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.113+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94633272646368] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.114+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.114+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94633272654096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699e480 con 0x56118698fc00 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.114+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699edf0 con 0x7f01ec05c920 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.115+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.115+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94633272654096] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.115+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94633272666448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699f200 con 0x7f01ec05c920 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.115+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699dbc0 con 0x7f01ec05c920 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.116+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.116+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94633272662976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699fb70 con 0x7f01ec05c920 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.116+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699fb70 con 0x7f01ec05c920 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.116+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94633272666448] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.117+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94633272662976] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.117+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.117+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94633272669904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x56118699fae0 con 0x7f01ec05c920 2023-12-07T21:09:19.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.117+0000 7f0206b22800 20 add_watcher() i=0 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.117+0000 7f0206b22800 20 add_watcher() i=1 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.117+0000 7f0206b22800 20 add_watcher() i=2 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.117+0000 7f0206b22800 20 add_watcher() i=3 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.117+0000 7f0206b22800 20 add_watcher() i=4 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.117+0000 7f0206b22800 20 add_watcher() i=5 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.117+0000 7f0206b22800 20 add_watcher() i=6 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.118+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94633272669904] v31'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.118+0000 7f0206b22800 20 add_watcher() i=7 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.118+0000 7f0206b22800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.118+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869a3510 con 0x56118698fc00 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.118+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.118+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94633272672320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869a08f0 con 0x56118698fc00 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.119+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94633272672320] v31'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.119+0000 7f01c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.119+0000 7f0206b22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.119+0000 7f0206b22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0206b22800 5 note: GC not initialized 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f01c27fc640 20 reqs_thread_entry: start 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0206b22800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0206b22800 20 Filter name: none 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0133fff640 20 reqs_thread_entry: start 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0206b22800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869d6310 con 0x56118698fc00 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv12 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0206b22800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0206b22800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:19.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0206b22800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.120+0000 7f0206b22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869d8750 con 0x7f01fc017050 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv31 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0206b22800 20 enabling bucket name=myfoo 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0206b22800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869d5e40 con 0x7f01fc017050 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0206b22800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0206b22800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0206b22800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0206b22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 : miss 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0206b22800 20 rados->read ofs=0 len=0 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.121+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869d83a0 con 0x7f01fc017050 2023-12-07T21:09:19.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.122+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(65 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv33 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.122+0000 7f0206b22800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:19.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.122+0000 7f0206b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:19.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.122+0000 7f0206b22800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:19.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.122+0000 7f0206b22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:19.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.122+0000 7f0206b22800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:19.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.122+0000 7f0206b22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 2023-12-07T21:09:19.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.122+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 8.9 8:90fc1b5b:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869e1490 con 0x7f01fc017050 2023-12-07T21:09:19.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(66 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v31'34 uv34 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f0206b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:19.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f0206b22800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:19.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f0206b22800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f0206b22800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1, ofs0, ns] 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94633272909136 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869dcaf0 con 0x7f01ec05c920 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== watch-notify(notify (1) cookie 94633272666448 notify 133143986195 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x561186984e50 con 0x7f01ec05c920 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f01f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94633272666448 notifier 4540 bl.length()=725 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f01f97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 info.flags=0x17 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f01f97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1 to cache LRU end 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(67 notify.5 [notify cookie 94633272909136 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f01f97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.123+0000 7f01f97fa640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f01d40042a0 con 0x7f01ec05c920 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.124+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.124+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== watch-notify(notify_complete (2) cookie 94633272909136 notify 133143986195 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5611869849f0 con 0x7f01ec05c920 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.124+0000 7f0206b22800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_sources= new_sources= 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.124+0000 7f0206b22800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential sources added=[] removed=[] 2023-12-07T21:09:19.130 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.124+0000 7f0206b22800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): orig_dests= new_dests= 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.124+0000 7f0206b22800 20 handle_bi_update(): bucket=:myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1]): potential dests added=[] removed=[] 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.124+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869defd0 con 0x56118698fc00 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v31'13 uv13 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f0206b22800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f0206b22800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f0206b22800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94633272909136 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869defd0 con 0x56118698fc00 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94633272654096 notify 133143986193 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x5611869849f0 con 0x56118698fc00 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f01f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94633272654096 notifier 4540 bl.length()=533 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f01f97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f01f97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(70 notify.4 [notify cookie 94633272909136 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f01f97fa640 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f01d4004600 con 0x56118698fc00 2023-12-07T21:09:19.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== watch-notify(notify_complete (2) cookie 94633272909136 notify 133143986193 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f01f400a0e0 con 0x56118698fc00 2023-12-07T21:09:19.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.125+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.132 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:19.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.126+0000 7f01c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:19.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.126+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94633272672320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869defd0 con 0x56118698fc00 2023-12-07T21:09:19.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.127+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94633272672320] v31'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.127+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94633270234960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869defd0 con 0x7f01fc017050 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.128+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94633270234960] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.128+0000 7f0206b22800 20 remove_watcher() i=0 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.128+0000 7f0206b22800 2 removed watcher, disabling cache 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.128+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94633272652864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186994580 con 0x56118698fc00 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.129+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94633272652864] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.129+0000 7f0206b22800 20 remove_watcher() i=1 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.129+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94633272656992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x5611869defd0 con 0x561186995d20 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.131+0000 7f02027a6640 1 -- 172.21.15.121:0/3227328066 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94633272656992] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01fc014070 con 0x561186995d20 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.131+0000 7f0206b22800 20 remove_watcher() i=2 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.131+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94633272646368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186994580 con 0x7f01fc017050 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.132+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94633272646368] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01ec052840 con 0x7f01fc017050 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.132+0000 7f0206b22800 20 remove_watcher() i=3 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.132+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94633272654096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186994580 con 0x56118698fc00 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.133+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94633272654096] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x56118698fc00 2023-12-07T21:09:19.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.133+0000 7f0206b22800 20 remove_watcher() i=4 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.133+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94633272666448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186994580 con 0x7f01ec05c920 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.134+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94633272666448] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.134+0000 7f0206b22800 20 remove_watcher() i=5 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.134+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94633272662976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186994580 con 0x7f01ec05c920 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.134+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94633272662976] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.134+0000 7f0206b22800 20 remove_watcher() i=6 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.134+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94633272669904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x561186994580 con 0x7f01ec05c920 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.135+0000 7f0202fa7640 1 -- 172.21.15.121:0/3227328066 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94633272669904] v31'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f01f402e9d0 con 0x7f01ec05c920 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.135+0000 7f0206b22800 20 remove_watcher() i=7 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.135+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f01ec05c920 msgr2=0x7f01ec0673d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.135+0000 7f0206b22800 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f01ec05c920 0x7f01ec0673d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.135+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56118698fc00 msgr2=0x5611869920c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.135+0000 7f0206b22800 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56118698fc00 0x5611869920c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.135+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f01fc017050 msgr2=0x7f01fc04b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.135+0000 7f0206b22800 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f01fc017050 0x7f01fc04b3a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.135+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x561186995d20 msgr2=0x5611869981b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.135+0000 7f0206b22800 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x561186995d20 0x5611869981b0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01dc036110 msgr2=0x7f01dc0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01dc036110 0x7f01dc0385d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f01ec054000 tx=0x7f01ec04e000 comp rx=0 tx=0).stop 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 msgr2=0x5611869844b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x5611869844b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f01f400a930 tx=0x7f01f4003370 comp rx=0 tx=0).stop 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0201fa5640 1 -- 172.21.15.121:0/3227328066 reap_dead start 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 shutdown_connections 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 --2- 172.21.15.121:0/3227328066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56118697d4d0 0x5611869844b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 >> 172.21.15.121:0/3227328066 conn(0x5611868c9520 msgr2=0x5611869776b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 shutdown_connections 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/3227328066 wait complete. 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/522679229 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e4036110 msgr2=0x7f01e40385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 --2- 172.21.15.121:0/522679229 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e4036110 0x7f01e40385d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00dfd0 tx=0x7f01fc00dec0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/522679229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 msgr2=0x561186971340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:19.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 --2- 172.21.15.121:0/522679229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186971340 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f01fc000c00 tx=0x7f01fc000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/522679229 shutdown_connections 2023-12-07T21:09:19.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 --2- 172.21.15.121:0/522679229 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f01e4036110 0x7f01e40385d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 --2- 172.21.15.121:0/522679229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561186839b50 0x561186971340 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:19.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/522679229 >> 172.21.15.121:0/522679229 conn(0x5611868bf880 msgr2=0x561186968b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:19.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/522679229 shutdown_connections 2023-12-07T21:09:19.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:19.136+0000 7f0206b22800 1 -- 172.21.15.121:0/522679229 wait complete. 2023-12-07T21:09:19.140 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:19.147 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-12-07T21:09:19.379 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2023-12-07T21:09:19.390 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:34.390 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2023-12-07T21:09:34.391 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2023-12-07T21:09:34.391 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2023-12-07T21:09:34.439 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:34.439 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:34.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.447+0000 7fd3fa813800 1 Processor -- start 2023-12-07T21:09:34.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.447+0000 7fd3fa813800 1 -- start start 2023-12-07T21:09:34.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.447+0000 7fd3fa813800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a683228ca0 0x55a683227200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.447+0000 7fd3fa813800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a6831fe7a0 con 0x55a683227740 2023-12-07T21:09:34.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.447+0000 7fd3fa813800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a6831c7880 con 0x55a683228ca0 2023-12-07T21:09:34.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.448+0000 7fd3f8313640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a683228ca0 0x55a683227200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.448+0000 7fd3f7b12640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55a683227740 0x55a6832ba110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:34062/0 (socket says 172.21.15.121:34062) 2023-12-07T21:09:34.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.448+0000 7fd3f7b12640 1 -- 172.21.15.121:0/3332462321 learned_addr learned my addr 172.21.15.121:0/3332462321 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:34.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.448+0000 7fd3f8313640 1 -- 172.21.15.121:0/3332462321 >> v1:172.21.15.89:6789/0 conn(0x55a683227740 legacy=0x55a6832ba110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.448+0000 7fd3f8313640 1 -- 172.21.15.121:0/3332462321 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a683227c80 con 0x55a683228ca0 2023-12-07T21:09:34.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.450+0000 7fd3f8313640 1 --2- 172.21.15.121:0/3332462321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683228ca0 0x55a683227200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800a470 tx=0x7fd3e801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2488e3059bbe18dd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.450+0000 7fd3f7311640 1 -- 172.21.15.121:0/3332462321 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3e8052440 con 0x55a683228ca0 2023-12-07T21:09:34.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.450+0000 7fd3f7311640 1 -- 172.21.15.121:0/3332462321 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e80525a0 con 0x55a683228ca0 2023-12-07T21:09:34.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.450+0000 7fd3f7311640 1 -- 172.21.15.121:0/3332462321 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3e8052860 con 0x55a683228ca0 2023-12-07T21:09:34.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.451+0000 7fd3fa813800 1 -- 172.21.15.121:0/3332462321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683228ca0 msgr2=0x55a683227200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.451+0000 7fd3fa813800 1 --2- 172.21.15.121:0/3332462321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683228ca0 0x55a683227200 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800a470 tx=0x7fd3e801cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:34.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.451+0000 7fd3fa813800 1 -- 172.21.15.121:0/3332462321 shutdown_connections 2023-12-07T21:09:34.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.451+0000 7fd3fa813800 1 --2- 172.21.15.121:0/3332462321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683228ca0 0x55a683227200 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.451+0000 7fd3fa813800 1 -- 172.21.15.121:0/3332462321 >> 172.21.15.121:0/3332462321 conn(0x55a6832ad980 msgr2=0x55a6832afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.451+0000 7fd3fa813800 1 -- 172.21.15.121:0/3332462321 shutdown_connections 2023-12-07T21:09:34.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.451+0000 7fd3fa813800 1 -- 172.21.15.121:0/3332462321 wait complete. 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.452+0000 7fd3fa813800 1 Processor -- start 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.452+0000 7fd3fa813800 1 -- start start 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.452+0000 7fd3fa813800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683359270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.452+0000 7fd3fa813800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6831c4db0 con 0x55a683227740 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.452+0000 7fd3f8313640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683359270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.452+0000 7fd3f8313640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683359270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45116/0 (socket says 172.21.15.121:45116) 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.452+0000 7fd3f8313640 1 -- 172.21.15.121:0/2637928789 learned_addr learned my addr 172.21.15.121:0/2637928789 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.452+0000 7fd3f8313640 1 -- 172.21.15.121:0/2637928789 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e8005d20 con 0x55a683227740 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.452+0000 7fd3f8313640 1 --2- 172.21.15.121:0/2637928789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683359270 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8000c00 tx=0x7fd3e804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6bcc9300dc2023 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.453+0000 7fd3f6b10640 1 -- 172.21.15.121:0/2637928789 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3e800a240 con 0x55a683227740 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.453+0000 7fd3f6b10640 1 -- 172.21.15.121:0/2637928789 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e8052710 con 0x55a683227740 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.453+0000 7fd3f6b10640 1 -- 172.21.15.121:0/2637928789 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3e80529d0 con 0x55a683227740 2023-12-07T21:09:34.447 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.453+0000 7fd3fa813800 1 -- 172.21.15.121:0/2637928789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 msgr2=0x55a683359270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.453+0000 7fd3fa813800 1 --2- 172.21.15.121:0/2637928789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683359270 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8000c00 tx=0x7fd3e804c000 comp rx=0 tx=0).stop 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.453+0000 7fd3fa813800 1 -- 172.21.15.121:0/2637928789 shutdown_connections 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.453+0000 7fd3fa813800 1 --2- 172.21.15.121:0/2637928789 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683359270 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.453+0000 7fd3fa813800 1 -- 172.21.15.121:0/2637928789 >> 172.21.15.121:0/2637928789 conn(0x55a6832ad980 msgr2=0x55a683354ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.453+0000 7fd3fa813800 1 -- 172.21.15.121:0/2637928789 shutdown_connections 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.453+0000 7fd3fa813800 1 -- 172.21.15.121:0/2637928789 wait complete. 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.453+0000 7fd3fa813800 1 Processor -- start 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.454+0000 7fd3fa813800 1 -- start start 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.454+0000 7fd3fa813800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683360530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.454+0000 7fd3fa813800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6831c06a0 con 0x55a683227740 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.454+0000 7fd3f8313640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683360530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.454+0000 7fd3f8313640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683360530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45132/0 (socket says 172.21.15.121:45132) 2023-12-07T21:09:34.448 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.454+0000 7fd3f8313640 1 -- 172.21.15.121:0/4212126651 learned_addr learned my addr 172.21.15.121:0/4212126651 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.454+0000 7fd3f8313640 1 -- 172.21.15.121:0/4212126651 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a683227c80 con 0x55a683227740 2023-12-07T21:09:34.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.455+0000 7fd3f8313640 1 --2- 172.21.15.121:0/4212126651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683360530 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8000c00 tx=0x7fd3e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.455+0000 7fd3f5b0e640 1 -- 172.21.15.121:0/4212126651 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3e806b070 con 0x55a683227740 2023-12-07T21:09:34.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.455+0000 7fd3f5b0e640 1 -- 172.21.15.121:0/4212126651 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e8052ca0 con 0x55a683227740 2023-12-07T21:09:34.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.455+0000 7fd3fa813800 1 -- 172.21.15.121:0/4212126651 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a683360a70 con 0x55a683227740 2023-12-07T21:09:34.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.455+0000 7fd3f5b0e640 1 -- 172.21.15.121:0/4212126651 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3e8065450 con 0x55a683227740 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.455+0000 7fd3fa813800 1 -- 172.21.15.121:0/4212126651 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a683360fb0 con 0x55a683227740 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.455+0000 7fd3fa813800 1 Processor -- start 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.455+0000 7fd3fa813800 1 -- start start 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3fa813800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 0x55a68336cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3fa813800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a68315a890 con 0x55a68336c740 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3f5b0e640 1 -- 172.21.15.121:0/4212126651 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fd3e8059070 con 0x55a683227740 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3f8b14640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 0x55a68336cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3f8b14640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 0x55a68336cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45140/0 (socket says 172.21.15.121:45140) 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3f8b14640 1 -- 172.21.15.121:0/2502797967 learned_addr learned my addr 172.21.15.121:0/2502797967 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3f5b0e640 1 --2- 172.21.15.121:0/4212126651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd3e40360c0 0x7fd3e4038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3f5b0e640 1 -- 172.21.15.121:0/4212126651 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fd3e808cac0 con 0x55a683227740 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3f8313640 1 --2- 172.21.15.121:0/4212126651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd3e40360c0 0x7fd3e4038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3f8b14640 1 -- 172.21.15.121:0/2502797967 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a68336d0a0 con 0x55a68336c740 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3f8b14640 1 --2- 172.21.15.121:0/2502797967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 0x55a68336cb60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000a430 tx=0x7fd3f000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7827ed622a05c978 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3df7fe640 1 -- 172.21.15.121:0/2502797967 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3f0001650 con 0x55a68336c740 2023-12-07T21:09:34.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.456+0000 7fd3f8313640 1 --2- 172.21.15.121:0/4212126651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd3e40360c0 0x7fd3e4038580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800a360 tx=0x7fd3e8009f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.457+0000 7fd3df7fe640 1 -- 172.21.15.121:0/2502797967 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f00017d0 con 0x55a68336c740 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.457+0000 7fd3df7fe640 1 -- 172.21.15.121:0/2502797967 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3f0001ab0 con 0x55a68336c740 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.457+0000 7fd3fa813800 1 -- 172.21.15.121:0/2502797967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 msgr2=0x55a68336cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.457+0000 7fd3fa813800 1 --2- 172.21.15.121:0/2502797967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 0x55a68336cb60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000a430 tx=0x7fd3f000a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.457+0000 7fd3fa813800 1 -- 172.21.15.121:0/2502797967 shutdown_connections 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.457+0000 7fd3fa813800 1 --2- 172.21.15.121:0/2502797967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 0x55a68336cb60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.457+0000 7fd3fa813800 1 -- 172.21.15.121:0/2502797967 >> 172.21.15.121:0/2502797967 conn(0x55a683228ca0 msgr2=0x55a683367b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.457+0000 7fd3fa813800 1 -- 172.21.15.121:0/2502797967 shutdown_connections 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.457+0000 7fd3fa813800 1 -- 172.21.15.121:0/2502797967 wait complete. 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.457+0000 7fd3fa813800 1 Processor -- start 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.457+0000 7fd3fa813800 1 -- start start 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.458+0000 7fd3fa813800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 0x55a683373870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.458+0000 7fd3fa813800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a68315a530 con 0x55a68336c740 2023-12-07T21:09:34.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.458+0000 7fd3f8b14640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 0x55a683373870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.458+0000 7fd3f8b14640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 0x55a683373870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45148/0 (socket says 172.21.15.121:45148) 2023-12-07T21:09:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.458+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 learned_addr learned my addr 172.21.15.121:0/1154580442 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.458+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f000a0e0 con 0x55a68336c740 2023-12-07T21:09:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.458+0000 7fd3f8b14640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 0x55a683373870 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000a930 tx=0x7fd3f0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.459+0000 7fd3ddffb640 1 -- 172.21.15.121:0/1154580442 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3f0010900 con 0x55a68336c740 2023-12-07T21:09:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.459+0000 7fd3ddffb640 1 -- 172.21.15.121:0/1154580442 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f0010a60 con 0x55a68336c740 2023-12-07T21:09:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.459+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a683373db0 con 0x55a68336c740 2023-12-07T21:09:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.459+0000 7fd3ddffb640 1 -- 172.21.15.121:0/1154580442 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3f0010d20 con 0x55a68336c740 2023-12-07T21:09:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.459+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a683374210 con 0x55a68336c740 2023-12-07T21:09:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.460+0000 7fd3ddffb640 1 -- 172.21.15.121:0/1154580442 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fd3f0017030 con 0x55a68336c740 2023-12-07T21:09:34.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.460+0000 7fd3ddffb640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd3d00360c0 0x7fd3d0038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.460+0000 7fd3ddffb640 1 -- 172.21.15.121:0/1154580442 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7fd3f004b850 con 0x55a68336c740 2023-12-07T21:09:34.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.460+0000 7fd3fa813800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.460+0000 7fd3f7b12640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd3d00360c0 0x7fd3d0038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.460+0000 7fd3fa813800 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a68337eed0 0x55a683381390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.460+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683381ae0 con 0x55a68337eed0 2023-12-07T21:09:34.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.460+0000 7fd3f8b14640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a68337eed0 0x55a683381390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.460+0000 7fd3f7b12640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd3d00360c0 0x7fd3d0038580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a683368760 tx=0x7fd3ec001270 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.460+0000 7fd3f8b14640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a68337eed0 0x55a683381390 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3fa813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3fa813800 20 realm 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3fa813800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683381ef0 con 0x55a68337eed0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3fa813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3fa813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3fa813800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683382770 con 0x55a68337eed0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3fa813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3fa813800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.461+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683382ad0 con 0x55a68337eed0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.462+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.462+0000 7fd3fa813800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.462+0000 7fd3fa813800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.462+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833823d0 con 0x55a68337eed0 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.462+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.462+0000 7fd3fa813800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.462+0000 7fd3fa813800 20 searching for the correct realm 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.462+0000 7fd3fa813800 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a683384ce0 0x55a6833870d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.462+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a683384ce0 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.462+0000 7fd3f8313640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a683384ce0 0x55a6833870d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.462+0000 7fd3f8313640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a683384ce0 0x55a6833870d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.463+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.463+0000 7fd3f8313640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd3e8079060 0x7fd3e808c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.463+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3e8079060 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.463+0000 7fd3f7b12640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd3e8079060 0x7fd3e808c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.463+0000 7fd3f7b12640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd3e8079060 0x7fd3e808c0c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.463+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.463+0000 7fd3f7b12640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd3ec00ec20 0x7fd3ec00d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.463+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3ec00ec20 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.464+0000 7fd3f8b14640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd3ec00ec20 0x7fd3ec00d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.464+0000 7fd3f8b14640 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd3ec00ec20 0x7fd3ec00d8e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.464+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.465+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a68337eed0 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.465+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.465+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a68337eed0 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.465+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.465+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3ec00ec20 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.465+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.465+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3ec00ec20 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.466+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.466+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3e8079060 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.466+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.466+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a683384ce0 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.466+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.466+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a68337eed0 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.466+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.466+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3ec00ec20 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.467+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.467+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a68337eed0 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.467+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.467+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3e8079060 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.467+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.467+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a683384ce0 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.467+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.468+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a683384ce0 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.468+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.468+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3ec00ec20 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.468+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.468+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a683384ce0 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.468+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.468+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a683384ce0 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.469+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.469+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a68337eed0 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.469+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.469+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a68337eed0 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.469+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.467 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.469+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3ec00ec20 2023-12-07T21:09:34.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.469+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.470+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a683384ce0 2023-12-07T21:09:34.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.470+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.470+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3e8079060 2023-12-07T21:09:34.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.470+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.470+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a68337eed0 2023-12-07T21:09:34.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.470+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.470+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3ec00ec20 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.471+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.471+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a683384ce0 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.471+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.471+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3ec00ec20 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.471+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.471+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3e8079060 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.471+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.471+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a683384ce0 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.472+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.472+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x7fd3ec00ec20 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.472+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.472+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387660 con 0x55a68337eed0 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.472+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.472+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7fd3f0053080 con 0x7fd3e8079060 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683383930 con 0x55a68337eed0 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833835b0 con 0x55a68337eed0 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683384200 con 0x55a683384ce0 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 zone default found 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 4 Realm: () 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 zonegroup default 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.473+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683387a80 con 0x7fd3ec00ec20 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.474+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.474+0000 7fd3fa813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.474+0000 7fd3fa813800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.474+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683389810 con 0x55a683384ce0 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.474+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.474+0000 7fd3fa813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.474+0000 7fd3fa813800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.474+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683389b70 con 0x55a683384ce0 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.475+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.475+0000 7fd3fa813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.475+0000 7fd3fa813800 20 started sync module instance, tier type = 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.475+0000 7fd3fa813800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.475+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833890f0 con 0x7fd3e8079060 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.476+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.476+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94173652033360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833894a0 con 0x7fd3e8079060 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.476+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338a460 con 0x55a68337eed0 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.477+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94173652033360] v31'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.477+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.477+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94173654453328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338a810 con 0x55a68337eed0 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.477+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338b010 con 0x55a683384ce0 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.479+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94173654453328] v31'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.479+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.479+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94173654460432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338ac20 con 0x55a683384ce0 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.479+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338bd00 con 0x7fd3e8079060 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.480+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.480+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94173654460432] v31'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.480+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94173654466656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338c470 con 0x7fd3e8079060 2023-12-07T21:09:34.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.480+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338ccb0 con 0x55a68337eed0 2023-12-07T21:09:34.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.481+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.481+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94173654468560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338d500 con 0x55a68337eed0 2023-12-07T21:09:34.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.481+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94173654466656] v31'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.481+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338b3c0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.482+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94173654468560] v31'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.482+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.482+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94173654470672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338d420 con 0x7fd3ec00ec20 2023-12-07T21:09:34.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.482+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338e310 con 0x7fd3ec00ec20 2023-12-07T21:09:34.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.484+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94173654470672] v31'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.484+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.484+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94173654473168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338e280 con 0x7fd3ec00ec20 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.484+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338ebf0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.485+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.485+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94173654473168] v31'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.485+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94173654476624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338eb60 con 0x7fd3ec00ec20 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.485+0000 7fd3fa813800 20 add_watcher() i=0 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.485+0000 7fd3fa813800 20 add_watcher() i=1 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.485+0000 7fd3fa813800 20 add_watcher() i=2 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.485+0000 7fd3fa813800 20 add_watcher() i=3 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.485+0000 7fd3fa813800 20 add_watcher() i=4 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.485+0000 7fd3fa813800 20 add_watcher() i=5 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.485+0000 7fd3fa813800 20 add_watcher() i=6 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.486+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94173654476624] v31'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.486+0000 7fd3fa813800 20 add_watcher() i=7 2023-12-07T21:09:34.482 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.486+0000 7fd3fa813800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.486+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a683391fb0 con 0x55a68337eed0 2023-12-07T21:09:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.487+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.487+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94173654474208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68338f4f0 con 0x55a68337eed0 2023-12-07T21:09:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.488+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94173654474208] v31'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.488+0000 7fd3be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.488+0000 7fd3fa813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.488+0000 7fd3fa813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:34.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.488+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339a420 con 0x55a68337eed0 2023-12-07T21:09:34.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.489+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.490+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339a420 con 0x7fd3ec00ec20 2023-12-07T21:09:34.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.491+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.491+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339aa30 con 0x55a683384ce0 2023-12-07T21:09:34.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.492+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.492+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339b400 con 0x55a68337eed0 2023-12-07T21:09:34.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.493+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'153 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.493+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833985d0 con 0x7fd3e8079060 2023-12-07T21:09:34.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.494+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'44 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.494+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339bf70 con 0x55a683384ce0 2023-12-07T21:09:34.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.495+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.495+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339c940 con 0x55a68337eed0 2023-12-07T21:09:34.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.497+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.497+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339c940 con 0x7fd3ec00ec20 2023-12-07T21:09:34.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.498+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.498+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339c940 con 0x7fd3e8079060 2023-12-07T21:09:34.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.499+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.492 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.499+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339d310 con 0x55a683384ce0 2023-12-07T21:09:34.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.500+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.500+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833975c0 con 0x7fd3e8079060 2023-12-07T21:09:34.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.501+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'45 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.501+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339de80 con 0x7fd3ec00ec20 2023-12-07T21:09:34.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.502+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.502+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339de80 con 0x7fd3e8079060 2023-12-07T21:09:34.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.503+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.503+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x7fd3ec00ec20 2023-12-07T21:09:34.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.505+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'36 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.505+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a68337eed0 2023-12-07T21:09:34.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.506+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'154 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.506+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a683384ce0 2023-12-07T21:09:34.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.507+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'38 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.507+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x7fd3e8079060 2023-12-07T21:09:34.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.508+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'46 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.508+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a683384ce0 2023-12-07T21:09:34.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.509+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.509+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a68337eed0 2023-12-07T21:09:34.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.510+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'26 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.510+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a68337eed0 2023-12-07T21:09:34.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.511+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'155 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.511+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a683384ce0 2023-12-07T21:09:34.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.512+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'39 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.512+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x7fd3e8079060 2023-12-07T21:09:34.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.514+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.514+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a683384ce0 2023-12-07T21:09:34.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.515+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.515+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a683384ce0 2023-12-07T21:09:34.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.515+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.515+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a683384ce0 2023-12-07T21:09:34.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.516+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.516+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a683384ce0 2023-12-07T21:09:34.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.517+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'30 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.517+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x7fd3ec00ec20 2023-12-07T21:09:34.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.519+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.519+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a683384ce0 2023-12-07T21:09:34.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.519+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.520+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x7fd3ec00ec20 2023-12-07T21:09:34.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.521+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'30 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.521+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x55a683384ce0 2023-12-07T21:09:34.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.522+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'40 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.522+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x7fd3ec00ec20 2023-12-07T21:09:34.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.523+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'37 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.523+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a68339e320 con 0x7fd3e8079060 2023-12-07T21:09:34.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.524+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.524+0000 7fd3bd7e2640 20 reqs_thread_entry: start 2023-12-07T21:09:34.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.525+0000 7fd3fa813800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:34.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.525+0000 7fd3fa813800 20 Filter name: none 2023-12-07T21:09:34.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.525+0000 7fd32effd640 20 reqs_thread_entry: start 2023-12-07T21:09:34.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.525+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c9900 con 0x55a68337eed0 2023-12-07T21:09:34.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.525+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.525+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c9900 con 0x55a68337eed0 2023-12-07T21:09:34.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.525+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.525+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c7820 con 0x55a68337eed0 2023-12-07T21:09:34.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.526+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.526+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c7820 con 0x7fd3ec00ec20 2023-12-07T21:09:34.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.526+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.526+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c77d0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.526+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.526+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c77d0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.527+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.527+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c77d0 con 0x55a683384ce0 2023-12-07T21:09:34.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.527+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.527+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c77d0 con 0x55a683384ce0 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.527+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.527+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c77d0 con 0x55a683384ce0 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.527+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.527+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c77d0 con 0x55a68337eed0 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.528+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.528+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c77d0 con 0x55a68337eed0 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.528+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.528+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a68337eed0 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.528+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.528+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.529+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.529+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3e8079060 2023-12-07T21:09:34.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.529+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.529+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.529+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.529+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.529+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.529+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.530+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.530+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.530+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.530+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a68337eed0 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.530+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.530+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a68337eed0 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.530+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.530+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a68337eed0 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.531+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.531+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.531+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.531+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.531+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.531+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.532+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.532+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.532+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.532+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3e8079060 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.532+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.532+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.533+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.533+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.533+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.533+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.533+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.533+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.533+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.533+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.534+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.534+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3e8079060 2023-12-07T21:09:34.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.534+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.534+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.534+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.534+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.535+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.535+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.535+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.535+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.535+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.535+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.536+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.536+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3e8079060 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.536+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.536+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.536+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.536+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.537+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.537+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.537+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.537+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.537+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.537+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a68337eed0 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.538+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.538+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a68337eed0 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.538+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.538+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a68337eed0 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.538+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.538+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.538+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.538+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.539+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.539+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.539+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.539+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.539+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.539+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3e8079060 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.540+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.540+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.540+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.540+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.540+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.540+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.540+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.540+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.541+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.541+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a68337eed0 2023-12-07T21:09:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.541+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.541+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a68337eed0 2023-12-07T21:09:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.541+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.541+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a68337eed0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.541+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.541+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a68337eed0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.542+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.542+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a68337eed0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.542+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.542+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a68337eed0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.542+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.542+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.542+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.542+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.543+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.543+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.543+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.543+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.543+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.543+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3e8079060 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.543+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.544+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3e8079060 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.544+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.544+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.544+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.544+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.544+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.544+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.544+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.544+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.545+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.545+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.545+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.545+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.545+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.545+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.545+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.545+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.546+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.546+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.546+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.546+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.546+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.546+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.546+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.546+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.547+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.547+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.547+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.547+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.548+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.548+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.548+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.548+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c97f0 con 0x55a683384ce0 2023-12-07T21:09:34.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.548+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.548+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.549+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.549+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.549+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.549+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.549+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.549+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c77d0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.550+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.550+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.550+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.550+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.550+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.550+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.551+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.551+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x55a683384ce0 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.551+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.551+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.551+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.551+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c77d0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.552+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.552+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c87e0 con 0x7fd3ec00ec20 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.552+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 44 ==== osd_op_reply(186 gc.30 [call out=1701b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+1701 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.552+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c8750 con 0x7fd3e8079060 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.552+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.552+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c8720 con 0x7fd3e8079060 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.553+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.553+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c8720 con 0x7fd3e8079060 2023-12-07T21:09:34.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.553+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.554+0000 7fd3be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:34.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.554+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94173654474208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c83c0 con 0x55a68337eed0 2023-12-07T21:09:34.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.555+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94173654474208] v31'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.555+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94173652033360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c8d90 con 0x7fd3e8079060 2023-12-07T21:09:34.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.556+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94173652033360] v31'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.556+0000 7fd3fa813800 20 remove_watcher() i=0 2023-12-07T21:09:34.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.556+0000 7fd3fa813800 2 removed watcher, disabling cache 2023-12-07T21:09:34.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.556+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94173654453328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c8d90 con 0x55a68337eed0 2023-12-07T21:09:34.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.557+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94173654453328] v31'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.557+0000 7fd3fa813800 20 remove_watcher() i=1 2023-12-07T21:09:34.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.557+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94173654460432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c8d90 con 0x55a683384ce0 2023-12-07T21:09:34.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.558+0000 7fd3f8313640 1 -- 172.21.15.121:0/1154580442 <== osd.3 v2:172.21.15.121:6800/4032235766 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94173654460432] v31'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3e807f070 con 0x55a683384ce0 2023-12-07T21:09:34.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.558+0000 7fd3fa813800 20 remove_watcher() i=2 2023-12-07T21:09:34.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.558+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94173654466656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c8d90 con 0x7fd3e8079060 2023-12-07T21:09:34.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.559+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 <== osd.2 v2:172.21.15.121:6816/2557538450 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94173654466656] v31'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3ec006070 con 0x7fd3e8079060 2023-12-07T21:09:34.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.559+0000 7fd3fa813800 20 remove_watcher() i=3 2023-12-07T21:09:34.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.559+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94173654468560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c8d90 con 0x55a68337eed0 2023-12-07T21:09:34.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.560+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.1 v2:172.21.15.121:6808/2140819418 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94173654468560] v31'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x55a68337eed0 2023-12-07T21:09:34.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.560+0000 7fd3fa813800 20 remove_watcher() i=4 2023-12-07T21:09:34.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.560+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94173654470672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c8d90 con 0x7fd3ec00ec20 2023-12-07T21:09:34.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.561+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94173654470672] v31'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.561+0000 7fd3fa813800 20 remove_watcher() i=5 2023-12-07T21:09:34.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.561+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94173654473168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c8d90 con 0x7fd3ec00ec20 2023-12-07T21:09:34.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.562+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94173654473168] v31'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.562+0000 7fd3fa813800 20 remove_watcher() i=6 2023-12-07T21:09:34.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.562+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94173654476624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a6833c8d90 con 0x7fd3ec00ec20 2023-12-07T21:09:34.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.563+0000 7fd3f8b14640 1 -- 172.21.15.121:0/1154580442 <== osd.0 v2:172.21.15.89:6800/654939948 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94173654476624] v31'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd3f002ea00 con 0x7fd3ec00ec20 2023-12-07T21:09:34.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.563+0000 7fd3fa813800 20 remove_watcher() i=7 2023-12-07T21:09:34.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.563+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd3ec00ec20 msgr2=0x7fd3ec00d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.563+0000 7fd3fa813800 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd3ec00ec20 0x7fd3ec00d8e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.563+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a68337eed0 msgr2=0x55a683381390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.563+0000 7fd3fa813800 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a68337eed0 0x55a683381390 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.563+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd3e8079060 msgr2=0x7fd3e808c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.563+0000 7fd3fa813800 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd3e8079060 0x7fd3e808c0c0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.563+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a683384ce0 msgr2=0x55a6833870d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.563+0000 7fd3fa813800 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a683384ce0 0x55a6833870d0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd3d00360c0 msgr2=0x7fd3d0038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd3d00360c0 0x7fd3d0038580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a683368760 tx=0x7fd3ec001270 comp rx=0 tx=0).stop 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 msgr2=0x55a683373870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 --2- 172.21.15.121:0/1154580442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a68336c740 0x55a683373870 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd3f000a930 tx=0x7fd3f0003370 comp rx=0 tx=0).stop 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 reap_dead start 2023-12-07T21:09:34.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3f7b12640 1 -- 172.21.15.121:0/1154580442 reap_dead start 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 shutdown_connections 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 >> 172.21.15.121:0/1154580442 conn(0x55a683228ca0 msgr2=0x55a683366920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 shutdown_connections 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/1154580442 wait complete. 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/4212126651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd3e40360c0 msgr2=0x7fd3e4038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 --2- 172.21.15.121:0/4212126651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd3e40360c0 0x7fd3e4038580 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd3e800a360 tx=0x7fd3e8009f90 comp rx=0 tx=0).stop 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/4212126651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 msgr2=0x55a683360530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 --2- 172.21.15.121:0/4212126651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683360530 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8000c00 tx=0x7fd3e8002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/4212126651 shutdown_connections 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 --2- 172.21.15.121:0/4212126651 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd3e40360c0 0x7fd3e4038580 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 --2- 172.21.15.121:0/4212126651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a683227740 0x55a683360530 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/4212126651 >> 172.21.15.121:0/4212126651 conn(0x55a6832ad980 msgr2=0x55a683357f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/4212126651 shutdown_connections 2023-12-07T21:09:34.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.564+0000 7fd3fa813800 1 -- 172.21.15.121:0/4212126651 wait complete. 2023-12-07T21:09:34.560 INFO:teuthology.orchestra.run.smithi121.stdout:[{"tag":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7156068476305243133\u0000","time":"2023-12-07T21:09:34.392616+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_7","key":"","instance":""}]}] 2023-12-07T21:09:34.560 DEBUG:tasks.util.rgw: json result: [{'tag': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7156068476305243133\x00', 'time': '2023-12-07T21:09:34.392616+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_7', 'key': '', 'instance': ''}]}] 2023-12-07T21:09:34.561 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2023-12-07T21:09:34.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2023-12-07T21:09:34.561 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2023-12-07T21:09:34.601 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:34.601 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.609+0000 7f19ae51e800 1 Processor -- start 2023-12-07T21:09:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.609+0000 7f19ae51e800 1 -- start start 2023-12-07T21:09:34.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.609+0000 7f19ae51e800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a4ddfe3b40 0x55a4de071df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.609+0000 7f19ae51e800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a4ddfbb790 con 0x55a4de072330 2023-12-07T21:09:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.609+0000 7f19ae51e800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a4ddf84880 con 0x55a4ddfe3b40 2023-12-07T21:09:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.610+0000 7f19ab824640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55a4de072330 0x55a4de074780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:34070/0 (socket says 172.21.15.121:34070) 2023-12-07T21:09:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.610+0000 7f19ab824640 1 -- 172.21.15.121:0/1545393065 learned_addr learned my addr 172.21.15.121:0/1545393065 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.610+0000 7f19ac025640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a4ddfe3b40 0x55a4de071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.610+0000 7f19ac025640 1 -- 172.21.15.121:0/1545393065 >> v1:172.21.15.89:6789/0 conn(0x55a4de072330 legacy=0x55a4de074780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.610+0000 7f19ac025640 1 -- 172.21.15.121:0/1545393065 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4de077040 con 0x55a4ddfe3b40 2023-12-07T21:09:34.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.612+0000 7f19ac025640 1 --2- 172.21.15.121:0/1545393065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de071df0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f199c005fd0 tx=0x7f199c01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdd43495167e55 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.612+0000 7f19ab023640 1 -- 172.21.15.121:0/1545393065 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f199c052560 con 0x55a4ddfe3b40 2023-12-07T21:09:34.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.612+0000 7f19ab023640 1 -- 172.21.15.121:0/1545393065 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0526c0 con 0x55a4ddfe3b40 2023-12-07T21:09:34.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.612+0000 7f19ab023640 1 -- 172.21.15.121:0/1545393065 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f199c0529e0 con 0x55a4ddfe3b40 2023-12-07T21:09:34.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.612+0000 7f19ae51e800 1 -- 172.21.15.121:0/1545393065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 msgr2=0x55a4de071df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.612+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1545393065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de071df0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f199c005fd0 tx=0x7f199c01cb90 comp rx=0 tx=0).stop 2023-12-07T21:09:34.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.612+0000 7f19ae51e800 1 -- 172.21.15.121:0/1545393065 shutdown_connections 2023-12-07T21:09:34.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.612+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1545393065 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de071df0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.612+0000 7f19ae51e800 1 -- 172.21.15.121:0/1545393065 >> 172.21.15.121:0/1545393065 conn(0x55a4de069870 msgr2=0x55a4de06bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.612+0000 7f19ae51e800 1 -- 172.21.15.121:0/1545393065 shutdown_connections 2023-12-07T21:09:34.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.612+0000 7f19ae51e800 1 -- 172.21.15.121:0/1545393065 wait complete. 2023-12-07T21:09:34.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.613+0000 7f19ae51e800 1 Processor -- start 2023-12-07T21:09:34.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.613+0000 7f19ae51e800 1 -- start start 2023-12-07T21:09:34.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.613+0000 7f19ae51e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de113dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.613+0000 7f19ae51e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4ddf81db0 con 0x55a4ddfe3b40 2023-12-07T21:09:34.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.614+0000 7f19ac025640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de113dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.614+0000 7f19ac025640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de113dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45162/0 (socket says 172.21.15.121:45162) 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.614+0000 7f19ac025640 1 -- 172.21.15.121:0/3286678549 learned_addr learned my addr 172.21.15.121:0/3286678549 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.614+0000 7f19ac025640 1 -- 172.21.15.121:0/3286678549 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c00a100 con 0x55a4ddfe3b40 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.614+0000 7f19ac025640 1 --2- 172.21.15.121:0/3286678549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de113dc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f199c007000 tx=0x7f199c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66765ccd2fb56b9a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.614+0000 7f19aa822640 1 -- 172.21.15.121:0/3286678549 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f199c052960 con 0x55a4ddfe3b40 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.614+0000 7f19aa822640 1 -- 172.21.15.121:0/3286678549 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c052c10 con 0x55a4ddfe3b40 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.614+0000 7f19aa822640 1 -- 172.21.15.121:0/3286678549 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f199c05c430 con 0x55a4ddfe3b40 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.615+0000 7f19ae51e800 1 -- 172.21.15.121:0/3286678549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 msgr2=0x55a4de113dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.615+0000 7f19ae51e800 1 --2- 172.21.15.121:0/3286678549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de113dc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f199c007000 tx=0x7f199c04c000 comp rx=0 tx=0).stop 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.615+0000 7f19ae51e800 1 -- 172.21.15.121:0/3286678549 shutdown_connections 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.615+0000 7f19ae51e800 1 --2- 172.21.15.121:0/3286678549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de113dc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.615+0000 7f19ae51e800 1 -- 172.21.15.121:0/3286678549 >> 172.21.15.121:0/3286678549 conn(0x55a4de069870 msgr2=0x55a4de10fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.615+0000 7f19ae51e800 1 -- 172.21.15.121:0/3286678549 shutdown_connections 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.615+0000 7f19ae51e800 1 -- 172.21.15.121:0/3286678549 wait complete. 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.615+0000 7f19ae51e800 1 Processor -- start 2023-12-07T21:09:34.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.615+0000 7f19ae51e800 1 -- start start 2023-12-07T21:09:34.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.615+0000 7f19ae51e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de11b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.615+0000 7f19ae51e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4ddf7d6a0 con 0x55a4ddfe3b40 2023-12-07T21:09:34.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.616+0000 7f19ac025640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de11b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.616+0000 7f19ac025640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de11b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45172/0 (socket says 172.21.15.121:45172) 2023-12-07T21:09:34.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.616+0000 7f19ac025640 1 -- 172.21.15.121:0/3188786605 learned_addr learned my addr 172.21.15.121:0/3188786605 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.616+0000 7f19ac025640 1 -- 172.21.15.121:0/3188786605 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4de077040 con 0x55a4ddfe3b40 2023-12-07T21:09:34.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.616+0000 7f19ac025640 1 --2- 172.21.15.121:0/3188786605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de11b130 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f199c000f80 tx=0x7f199c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.616+0000 7f19a9820640 1 -- 172.21.15.121:0/3188786605 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f199c06c070 con 0x55a4ddfe3b40 2023-12-07T21:09:34.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.616+0000 7f19a9820640 1 -- 172.21.15.121:0/3188786605 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c04aba0 con 0x55a4ddfe3b40 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.616+0000 7f19ae51e800 1 -- 172.21.15.121:0/3188786605 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a4de11b670 con 0x55a4ddfe3b40 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.616+0000 7f19a9820640 1 -- 172.21.15.121:0/3188786605 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f199c070410 con 0x55a4ddfe3b40 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.616+0000 7f19ae51e800 1 -- 172.21.15.121:0/3188786605 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4de11bbb0 con 0x55a4ddfe3b40 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.617+0000 7f19ae51e800 1 Processor -- start 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.617+0000 7f19ae51e800 1 -- start start 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.617+0000 7f19ae51e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 0x55a4de1277c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.617+0000 7f19ae51e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4ddf17890 con 0x55a4de1273a0 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.617+0000 7f19a9820640 1 -- 172.21.15.121:0/3188786605 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f199c0663f0 con 0x55a4ddfe3b40 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.617+0000 7f19ac826640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 0x55a4de1277c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.617+0000 7f19ac826640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 0x55a4de1277c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45178/0 (socket says 172.21.15.121:45178) 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.617+0000 7f19ac826640 1 -- 172.21.15.121:0/1751090779 learned_addr learned my addr 172.21.15.121:0/1751090779 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.617+0000 7f19a9820640 1 --2- 172.21.15.121:0/3188786605 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f19980360c0 0x7f1998038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.617+0000 7f19a9820640 1 -- 172.21.15.121:0/3188786605 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f199c08d640 con 0x55a4ddfe3b40 2023-12-07T21:09:34.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.617+0000 7f19ac826640 1 -- 172.21.15.121:0/1751090779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4de127d00 con 0x55a4de1273a0 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19ac025640 1 --2- 172.21.15.121:0/3188786605 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f19980360c0 0x7f1998038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19ac826640 1 --2- 172.21.15.121:0/1751090779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 0x55a4de1277c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f19a400a400 tx=0x7f19a400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be54126009b781d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19937fe640 1 -- 172.21.15.121:0/1751090779 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19a40087e0 con 0x55a4de1273a0 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19ac025640 1 --2- 172.21.15.121:0/3188786605 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f19980360c0 0x7f1998038580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f199c051ff0 tx=0x7f199c051f40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19937fe640 1 -- 172.21.15.121:0/1751090779 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4008960 con 0x55a4de1273a0 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19937fe640 1 -- 172.21.15.121:0/1751090779 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19a4008c80 con 0x55a4de1273a0 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19ae51e800 1 -- 172.21.15.121:0/1751090779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 msgr2=0x55a4de1277c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1751090779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 0x55a4de1277c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f19a400a400 tx=0x7f19a400a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19ae51e800 1 -- 172.21.15.121:0/1751090779 shutdown_connections 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1751090779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 0x55a4de1277c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19ae51e800 1 -- 172.21.15.121:0/1751090779 >> 172.21.15.121:0/1751090779 conn(0x55a4de072330 msgr2=0x55a4de122780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19ae51e800 1 -- 172.21.15.121:0/1751090779 shutdown_connections 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.618+0000 7f19ae51e800 1 -- 172.21.15.121:0/1751090779 wait complete. 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.619+0000 7f19ae51e800 1 Processor -- start 2023-12-07T21:09:34.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.619+0000 7f19ae51e800 1 -- start start 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.619+0000 7f19ae51e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 0x55a4de12e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.619+0000 7f19ae51e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4ddf17530 con 0x55a4de1273a0 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.619+0000 7f19ac826640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 0x55a4de12e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.619+0000 7f19ac826640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 0x55a4de12e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45182/0 (socket says 172.21.15.121:45182) 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.619+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 learned_addr learned my addr 172.21.15.121:0/1605965762 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.619+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4005c90 con 0x55a4de1273a0 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.619+0000 7f19ac826640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 0x55a4de12e2b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c010 tx=0x7f19a4002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.620+0000 7f1991ffb640 1 -- 172.21.15.121:0/1605965762 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19a4013840 con 0x55a4de1273a0 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.620+0000 7f1991ffb640 1 -- 172.21.15.121:0/1605965762 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a40139a0 con 0x55a4de1273a0 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.620+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a4de12e7f0 con 0x55a4de1273a0 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.620+0000 7f1991ffb640 1 -- 172.21.15.121:0/1605965762 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19a4013c80 con 0x55a4de1273a0 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.620+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4de12ecb0 con 0x55a4de1273a0 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.620+0000 7f1991ffb640 1 -- 172.21.15.121:0/1605965762 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f19a401e420 con 0x55a4de1273a0 2023-12-07T21:09:34.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.621+0000 7f1991ffb640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f19840360c0 0x7f1984038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.621+0000 7f1991ffb640 1 -- 172.21.15.121:0/1605965762 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f19a404b950 con 0x55a4de1273a0 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.621+0000 7f19ab824640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f19840360c0 0x7f1984038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.621+0000 7f19ae51e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.621+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a4de139a30 0x55a4de13bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.621+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de13c640 con 0x55a4de139a30 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.621+0000 7f19ab824640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f19840360c0 0x7f1984038580 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19a0000f60 tx=0x7f19a0001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.621+0000 7f19ac826640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a4de139a30 0x55a4de13bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.621+0000 7f19ac826640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a4de139a30 0x55a4de13bef0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 20 realm 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de13ca50 con 0x55a4de139a30 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de13d2d0 con 0x55a4de139a30 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de13d630 con 0x55a4de139a30 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.622+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de13de30 con 0x55a4de139a30 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.623+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.623+0000 7f19ae51e800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.623+0000 7f19ae51e800 20 searching for the correct realm 2023-12-07T21:09:34.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.623+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a4de13fb50 0x55a4de141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.623+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de142690 con 0x55a4de13fb50 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.623+0000 7f19ac025640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a4de13fb50 0x55a4de141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.623+0000 7f19ac025640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a4de13fb50 0x55a4de141fc0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.623+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.623+0000 7f19ac025640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f199c089040 0x7f199c05b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.623+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de142690 con 0x7f199c089040 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.624+0000 7f19ab824640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f199c089040 0x7f199c05b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.624+0000 7f19ab824640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f199c089040 0x7f199c05b570 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.624+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a0006070 con 0x7f199c089040 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.624+0000 7f19ab824640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f19a000d3d0 0x7f19a000d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.624+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de142690 con 0x7f19a000d3d0 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.624+0000 7f19ac826640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f19a000d3d0 0x7f19a000d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.623 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.625+0000 7f19ac826640 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f19a000d3d0 0x7f19a000d830 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.625+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x7f19a000d3d0 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.625+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de142690 con 0x55a4de139a30 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.625+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.625+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de142690 con 0x55a4de139a30 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.626+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.626+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de142690 con 0x7f19a000d3d0 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.626+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x7f19a000d3d0 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.626+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f19a000d3d0 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.626+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x7f19a000d3d0 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.626+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f199c089040 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.626+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a0006070 con 0x7f199c089040 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.626+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de13fb50 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.627+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.633 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.627+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de139a30 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.627+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.627+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f19a000d3d0 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.627+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x7f19a000d3d0 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.627+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de139a30 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.627+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.627+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f199c089040 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.628+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f19a0006070 con 0x7f199c089040 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.628+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de13fb50 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.628+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.628+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de13fb50 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.628+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.628+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f19a000d3d0 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.628+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x7f19a000d3d0 2023-12-07T21:09:34.634 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.628+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de13fb50 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.629+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.629+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de13fb50 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.629+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.629+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de139a30 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.629+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.629+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de139a30 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.629+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.629+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f19a000d3d0 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.629+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x7f19a000d3d0 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.629+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de13fb50 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.630+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.630+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f199c089040 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.630+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a0006070 con 0x7f199c089040 2023-12-07T21:09:34.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.630+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de139a30 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.630+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4024070 con 0x55a4de139a30 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.630+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f19a000d3d0 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.630+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.631+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de13fb50 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.631+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.631+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f19a000d3d0 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.631+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.631+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f199c089040 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.631+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a0006070 con 0x7f199c089040 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.631+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de13fb50 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f19a000d3d0 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x55a4de139a30 2023-12-07T21:09:34.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f19a403e040 con 0x7f199c089040 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f19a0006070 con 0x7f199c089040 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ae51e800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ae51e800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ae51e800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ae51e800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ae51e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ae51e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ae51e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.632+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de13e790 con 0x55a4de139a30 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de13efe0 con 0x55a4de139a30 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de13efe0 con 0x55a4de13fb50 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 20 zone default found 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 4 Realm: () 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 20 zonegroup default 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.633+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de142b10 con 0x7f19a000d3d0 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ae51e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ae51e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de1448f0 con 0x55a4de13fb50 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ae51e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ae51e800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de144c50 con 0x55a4de13fb50 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ae51e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ae51e800 20 started sync module instance, tier type = 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ae51e800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.634+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de1441d0 con 0x7f199c089040 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.635+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a0006070 con 0x7f199c089040 2023-12-07T21:09:34.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.635+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94166586453840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de144580 con 0x7f199c089040 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.635+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de1454f0 con 0x55a4de139a30 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.636+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94166586453840] v31'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a0006070 con 0x7f199c089040 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.636+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.636+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94166588865840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de1454f0 con 0x55a4de139a30 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.636+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de145fb0 con 0x55a4de13fb50 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.637+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94166588865840] v31'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.638+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.638+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94166588870736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de145460 con 0x55a4de13fb50 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.638+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de146ca0 con 0x7f199c089040 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.639+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.639+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94166588878928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de147900 con 0x7f199c089040 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.639+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de148270 con 0x55a4de139a30 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.639+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94166588870736] v31'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.640+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94166588878928] v31'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.640+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.640+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94166588875616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de148270 con 0x55a4de139a30 2023-12-07T21:09:34.641 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.640+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de148ac0 con 0x7f19a000d3d0 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.641+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.641+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94166588883568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de148d00 con 0x7f19a000d3d0 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.641+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de1497d0 con 0x7f19a000d3d0 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.641+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94166588875616] v31'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.642+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v31'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.642+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94166588887728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de149790 con 0x7f19a000d3d0 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.642+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de14a100 con 0x7f19a000d3d0 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.642+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94166588883568] v31'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.643+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94166588887728] v31'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.643+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v31'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.643+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94166588882384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de149c60 con 0x7f19a000d3d0 2023-12-07T21:09:34.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.643+0000 7f19ae51e800 20 add_watcher() i=0 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.643+0000 7f19ae51e800 20 add_watcher() i=1 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.643+0000 7f19ae51e800 20 add_watcher() i=2 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.643+0000 7f19ae51e800 20 add_watcher() i=3 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.643+0000 7f19ae51e800 20 add_watcher() i=4 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.643+0000 7f19ae51e800 20 add_watcher() i=5 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.643+0000 7f19ae51e800 20 add_watcher() i=6 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.644+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94166588882384] v31'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.644+0000 7f19ae51e800 20 add_watcher() i=7 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.644+0000 7f19ae51e800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.644+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de14d130 con 0x55a4de139a30 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.644+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.644+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94166588890208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de14a5e0 con 0x55a4de139a30 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.645+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94166588890208] v31'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.645+0000 7f19727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.646+0000 7f19ae51e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:34.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.646+0000 7f19ae51e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:34.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.646+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de1554f0 con 0x55a4de139a30 2023-12-07T21:09:34.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.647+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.647+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de155930 con 0x7f19a000d3d0 2023-12-07T21:09:34.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.648+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'19 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.648+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de155e60 con 0x55a4de13fb50 2023-12-07T21:09:34.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.649+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.649+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de156830 con 0x55a4de139a30 2023-12-07T21:09:34.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.650+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'158 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.650+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de1535d0 con 0x7f199c089040 2023-12-07T21:09:34.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.651+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'47 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.651+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de1573a0 con 0x55a4de13fb50 2023-12-07T21:09:34.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.652+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.652+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de1578d0 con 0x55a4de139a30 2023-12-07T21:09:34.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.653+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.653+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de157d70 con 0x7f19a000d3d0 2023-12-07T21:09:34.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.654+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.654+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de157d70 con 0x7f199c089040 2023-12-07T21:09:34.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.655+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.655+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de158570 con 0x55a4de13fb50 2023-12-07T21:09:34.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.656+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.649 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.656+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de152530 con 0x7f199c089040 2023-12-07T21:09:34.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.657+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'48 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.657+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de1590e0 con 0x7f19a000d3d0 2023-12-07T21:09:34.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.658+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.658+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de1590e0 con 0x7f199c089040 2023-12-07T21:09:34.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.659+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.652 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.659+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159170 con 0x7f19a000d3d0 2023-12-07T21:09:34.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.660+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'38 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.653 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.660+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159170 con 0x55a4de139a30 2023-12-07T21:09:34.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.661+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'159 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.654 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.661+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159170 con 0x55a4de13fb50 2023-12-07T21:09:34.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.662+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'41 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.655 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.662+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159170 con 0x7f199c089040 2023-12-07T21:09:34.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.663+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'49 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.656 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.663+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x55a4de13fb50 2023-12-07T21:09:34.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.664+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.657 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.664+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x55a4de139a30 2023-12-07T21:09:34.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.665+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'27 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.658 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.665+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x55a4de139a30 2023-12-07T21:09:34.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.666+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'160 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.659 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.667+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x55a4de13fb50 2023-12-07T21:09:34.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.668+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'42 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.660 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.668+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x7f199c089040 2023-12-07T21:09:34.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.669+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.661 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.669+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x55a4de13fb50 2023-12-07T21:09:34.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.669+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.662 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.669+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x55a4de13fb50 2023-12-07T21:09:34.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.670+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.663 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.670+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x55a4de13fb50 2023-12-07T21:09:34.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.671+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.664 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.671+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x55a4de13fb50 2023-12-07T21:09:34.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.672+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'32 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.665 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.672+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x7f19a000d3d0 2023-12-07T21:09:34.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.673+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.666 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.673+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x55a4de13fb50 2023-12-07T21:09:34.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.674+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.667 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.674+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x7f19a000d3d0 2023-12-07T21:09:34.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.676+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'32 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.668 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.676+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x55a4de13fb50 2023-12-07T21:09:34.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.676+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'43 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.669 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.677+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x7f19a000d3d0 2023-12-07T21:09:34.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.677+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'39 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.670 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.678+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de159200 con 0x7f199c089040 2023-12-07T21:09:34.671 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.678+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.679+0000 7f19717e2640 20 reqs_thread_entry: start 2023-12-07T21:09:34.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.679+0000 7f19ae51e800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:34.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.679+0000 7f19ae51e800 20 Filter name: none 2023-12-07T21:09:34.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.679+0000 7f18e2ffd640 20 reqs_thread_entry: start 2023-12-07T21:09:34.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.679+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2023-12-07T21:09:34.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.679+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:94 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de185810 con 0x55a4de13fb50 2023-12-07T21:09:34.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.680+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(94 gc.29 [call] v31'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.680+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:95 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de185810 con 0x55a4de13fb50 2023-12-07T21:09:34.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.680+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 28 ==== osd_op_reply(95 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.680+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.680+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:96 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de184800 con 0x55a4de13fb50 2023-12-07T21:09:34.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.681+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 29 ==== osd_op_reply(96 gc.29 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.681+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:97 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de185810 con 0x55a4de13fb50 2023-12-07T21:09:34.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.681+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 30 ==== osd_op_reply(97 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.681+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.681+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:98 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de185810 con 0x55a4de13fb50 2023-12-07T21:09:34.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.681+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 31 ==== osd_op_reply(98 gc.29 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.681+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.681+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:99 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de185810 con 0x55a4de13fb50 2023-12-07T21:09:34.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.682+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 32 ==== osd_op_reply(99 gc.29 [call] v31'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.682+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2023-12-07T21:09:34.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.682+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:100 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de185810 con 0x7f19a000d3d0 2023-12-07T21:09:34.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.683+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(100 gc.30 [call] v31'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.683+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de185810 con 0x7f19a000d3d0 2023-12-07T21:09:34.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.683+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(101 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.683+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.683+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de184800 con 0x7f19a000d3d0 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(102 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de185810 con 0x7f19a000d3d0 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(103 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:104 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de185810 con 0x7f19a000d3d0 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(104 gc.30 [call out=1701b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+1701 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 20 garbage collection: RGWGC::process iterating over entry tag='ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7156068476305243133', time=2023-12-07T21:09:34.392616+0000, chain.objs.size()=7 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_1 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:105 3.2cs0 3:367263e7:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de183a80 con 0x55a4de13fb50 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_2 2023-12-07T21:09:34.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:106 3.10s0 3:085a465d:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de188940 con 0x55a4de139a30 2023-12-07T21:09:34.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_3 2023-12-07T21:09:34.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:107 3.3ds0 3:bd59174a:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18b160 con 0x55a4de13fb50 2023-12-07T21:09:34.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_4 2023-12-07T21:09:34.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:108 3.22s0 3:474f2e05:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18daa0 con 0x55a4de13fb50 2023-12-07T21:09:34.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_5 2023-12-07T21:09:34.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:109 3.1cs0 3:3abcfb40:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18b160 con 0x55a4de139a30 2023-12-07T21:09:34.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_6 2023-12-07T21:09:34.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.684+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:110 3.16s0 3:69d2fdc0:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de192840 con 0x7f199c089040 2023-12-07T21:09:34.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.685+0000 7f19ae51e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_7 2023-12-07T21:09:34.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.685+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:111 3.21s0 3:86611018:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de194d00 con 0x7f19a000d3d0 2023-12-07T21:09:34.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.689+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 33 ==== osd_op_reply(107 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_3 [call] v31'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.689+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 34 ==== osd_op_reply(108 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_4 [call] v31'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.689+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(109 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_5 [call] v31'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.689+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(106 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_2 [call] v31'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.691+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(111 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_7 [call] v31'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.691+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 35 ==== osd_op_reply(105 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_1 [call] v31'4 uv4 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.691+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(110 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1__shadow_.2nDlkKNT9grB_EUSJFoxuQnR7hXbCei_6 [call] v31'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.691+0000 7f19ae51e800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-07T21:09:34.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.691+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:112 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ac30 con 0x7f19a000d3d0 2023-12-07T21:09:34.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.697+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 30 ==== osd_op_reply(112 gc.30 [call] v31'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.690 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.697+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:113 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ac30 con 0x7f19a000d3d0 2023-12-07T21:09:34.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.700+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 31 ==== osd_op_reply(113 gc.30 [call] v31'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.692 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.700+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2023-12-07T21:09:34.693 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.700+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:114 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ac30 con 0x7f199c089040 2023-12-07T21:09:34.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.701+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(114 gc.31 [call] v31'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.701+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:115 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab90 con 0x7f199c089040 2023-12-07T21:09:34.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.701+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(115 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.701+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.701+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:116 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b80 con 0x7f199c089040 2023-12-07T21:09:34.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.701+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(116 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.702+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:117 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab90 con 0x7f199c089040 2023-12-07T21:09:34.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.702+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 22 ==== osd_op_reply(117 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.702+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.702+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:118 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab90 con 0x7f199c089040 2023-12-07T21:09:34.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.702+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 23 ==== osd_op_reply(118 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.702+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.702+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:119 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab90 con 0x7f199c089040 2023-12-07T21:09:34.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.703+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 24 ==== osd_op_reply(119 gc.31 [call] v31'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.703+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2023-12-07T21:09:34.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.703+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:120 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab90 con 0x55a4de139a30 2023-12-07T21:09:34.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.704+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(120 gc.0 [call] v31'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.704+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:121 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab90 con 0x55a4de139a30 2023-12-07T21:09:34.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.704+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(121 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.704+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.704+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:122 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b80 con 0x55a4de139a30 2023-12-07T21:09:34.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.705+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(122 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.705+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:123 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab90 con 0x55a4de139a30 2023-12-07T21:09:34.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.705+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(123 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.705+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.705+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:124 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab90 con 0x55a4de139a30 2023-12-07T21:09:34.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.705+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(124 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.705+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.705+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:125 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab90 con 0x55a4de139a30 2023-12-07T21:09:34.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.706+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 35 ==== osd_op_reply(125 gc.0 [call] v31'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.706+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2023-12-07T21:09:34.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.706+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:126 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab90 con 0x7f19a000d3d0 2023-12-07T21:09:34.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.707+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 32 ==== osd_op_reply(126 gc.1 [call] v31'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.707+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:127 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab90 con 0x7f19a000d3d0 2023-12-07T21:09:34.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.707+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 33 ==== osd_op_reply(127 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.707+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.707+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:128 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f19a000d3d0 2023-12-07T21:09:34.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.708+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 34 ==== osd_op_reply(128 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.708+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:129 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.708+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 35 ==== osd_op_reply(129 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.708+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.708+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:130 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.708+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 36 ==== osd_op_reply(130 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.708+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.708+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:131 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.710+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 37 ==== osd_op_reply(131 gc.1 [call] v31'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.710+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2023-12-07T21:09:34.703 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.710+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:132 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 36 ==== osd_op_reply(132 gc.2 [call] v31'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:133 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 37 ==== osd_op_reply(133 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:134 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 38 ==== osd_op_reply(134 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:135 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 39 ==== osd_op_reply(135 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:136 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 40 ==== osd_op_reply(136 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.711+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:137 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.712+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 41 ==== osd_op_reply(137 gc.2 [call] v31'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.712+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2023-12-07T21:09:34.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.712+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:138 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.713+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 36 ==== osd_op_reply(138 gc.3 [call] v31'161 uv161 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.713+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:139 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.713+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 37 ==== osd_op_reply(139 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.713+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.713+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:140 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de139a30 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.714+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 38 ==== osd_op_reply(140 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.714+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:141 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.714+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 39 ==== osd_op_reply(141 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.714+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.714+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:142 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.714+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 40 ==== osd_op_reply(142 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.714+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.714+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:143 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.715+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 41 ==== osd_op_reply(143 gc.3 [call] v31'162 uv162 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.715+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2023-12-07T21:09:34.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.715+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:144 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.716+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 25 ==== osd_op_reply(144 gc.4 [call] v31'50 uv50 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.716+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:145 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.716+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 26 ==== osd_op_reply(145 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.716+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.716+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:146 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f199c089040 2023-12-07T21:09:34.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.717+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 27 ==== osd_op_reply(146 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.717+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:147 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.717+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 28 ==== osd_op_reply(147 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.717+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.717+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:148 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.717+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 29 ==== osd_op_reply(148 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.717+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.717+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:149 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.718+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 30 ==== osd_op_reply(149 gc.4 [call] v31'51 uv51 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.718+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2023-12-07T21:09:34.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.718+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:150 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.719+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 42 ==== osd_op_reply(150 gc.5 [call] v31'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.719+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:151 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.720+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 43 ==== osd_op_reply(151 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.720+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.720+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:152 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.720+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 44 ==== osd_op_reply(152 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.720+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:153 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.720+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 45 ==== osd_op_reply(153 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.720+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.720+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:154 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.720+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 46 ==== osd_op_reply(154 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.720+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.720+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:155 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.721+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 47 ==== osd_op_reply(155 gc.5 [call] v31'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.721+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2023-12-07T21:09:34.714 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.721+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:156 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.722+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 42 ==== osd_op_reply(156 gc.6 [call] v31'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.722+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:157 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.723+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 43 ==== osd_op_reply(157 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.723+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.723+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:158 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de139a30 2023-12-07T21:09:34.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.723+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 44 ==== osd_op_reply(158 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.723+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:159 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.723+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 45 ==== osd_op_reply(159 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.723+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.723+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:160 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.723+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 46 ==== osd_op_reply(160 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.723+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.723+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:161 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.717 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.724+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 47 ==== osd_op_reply(161 gc.6 [call] v31'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.724+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2023-12-07T21:09:34.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.724+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:162 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.725+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 38 ==== osd_op_reply(162 gc.7 [call] v31'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.725+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:163 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.725+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 39 ==== osd_op_reply(163 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.719 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.725+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.725+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:164 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f19a000d3d0 2023-12-07T21:09:34.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.726+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 40 ==== osd_op_reply(164 gc.7 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.726+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:165 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.726+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 41 ==== osd_op_reply(165 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.726+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.726+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:166 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.726+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 42 ==== osd_op_reply(166 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.726+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.720 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.726+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:167 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.727+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 43 ==== osd_op_reply(167 gc.7 [call] v31'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.727+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2023-12-07T21:09:34.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.727+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:168 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.728+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 31 ==== osd_op_reply(168 gc.8 [call] v31'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.728+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:169 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.728+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 32 ==== osd_op_reply(169 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.728+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.728+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:170 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f199c089040 2023-12-07T21:09:34.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.728+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 33 ==== osd_op_reply(170 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.729+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:171 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.729+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 34 ==== osd_op_reply(171 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.729+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.729+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:172 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.729+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 35 ==== osd_op_reply(172 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.729+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.729+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:173 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.730+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 36 ==== osd_op_reply(173 gc.8 [call] v31'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.730+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.730+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:174 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.731+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 48 ==== osd_op_reply(174 gc.9 [call] v31'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.731+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:175 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.731+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 49 ==== osd_op_reply(175 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.731+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.731+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:176 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.732+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 50 ==== osd_op_reply(176 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.732+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:177 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.732+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 51 ==== osd_op_reply(177 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.732+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.732+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:178 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.732+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 52 ==== osd_op_reply(178 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.732+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.732+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:179 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.733+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 53 ==== osd_op_reply(179 gc.9 [call] v31'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.733+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.733+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:180 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.734+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 37 ==== osd_op_reply(180 gc.10 [call] v31'52 uv52 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.734+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:181 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.734+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 38 ==== osd_op_reply(181 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.734+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.734+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:182 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f199c089040 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.734+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 39 ==== osd_op_reply(182 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.734+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:183 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.735+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 40 ==== osd_op_reply(183 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.735+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.735+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:184 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.735+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 41 ==== osd_op_reply(184 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.735+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.735+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:185 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.736+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 42 ==== osd_op_reply(185 gc.10 [call] v31'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.736+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2023-12-07T21:09:34.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.736+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:186 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.737+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 44 ==== osd_op_reply(186 gc.11 [call] v31'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.737+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:187 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.737+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 45 ==== osd_op_reply(187 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.737+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.737+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:188 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f19a000d3d0 2023-12-07T21:09:34.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.737+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 46 ==== osd_op_reply(188 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.737+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:189 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.738+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 47 ==== osd_op_reply(189 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.738+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.738+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:190 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.738+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 48 ==== osd_op_reply(190 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.738+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.738+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:191 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.739+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 49 ==== osd_op_reply(191 gc.11 [call] v31'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.739+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2023-12-07T21:09:34.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.739+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:192 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.741+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 43 ==== osd_op_reply(192 gc.12 [call] v31'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.741+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:193 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.741+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 44 ==== osd_op_reply(193 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.741+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.741+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:194 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f199c089040 2023-12-07T21:09:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.741+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 45 ==== osd_op_reply(194 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.741+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:195 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.741+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 46 ==== osd_op_reply(195 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.741+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.741+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:196 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.742+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 47 ==== osd_op_reply(196 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.742+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.742+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:197 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.743+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 48 ==== osd_op_reply(197 gc.12 [call] v31'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.743+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2023-12-07T21:09:34.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.743+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:198 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.744+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 50 ==== osd_op_reply(198 gc.13 [call] v31'43 uv43 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.744+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:199 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.744+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 51 ==== osd_op_reply(199 gc.13 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.744+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.744+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:200 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f19a000d3d0 2023-12-07T21:09:34.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.745+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 52 ==== osd_op_reply(200 gc.13 [call out=24b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.745+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:201 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.745+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 53 ==== osd_op_reply(201 gc.13 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.745+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.745+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:202 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.745+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 54 ==== osd_op_reply(202 gc.13 [call out=15b] v0'0 uv43 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.745+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.745+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:203 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.746+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 55 ==== osd_op_reply(203 gc.13 [call] v31'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.746+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2023-12-07T21:09:34.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.746+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:204 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.747+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 48 ==== osd_op_reply(204 gc.14 [call] v31'163 uv163 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.747+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:205 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.748+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 49 ==== osd_op_reply(205 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.748+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.748+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:206 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de139a30 2023-12-07T21:09:34.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.748+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 50 ==== osd_op_reply(206 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.748+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:207 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.748+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 51 ==== osd_op_reply(207 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.748+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.748+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:208 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.748+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 52 ==== osd_op_reply(208 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.748+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.748+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:209 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.749+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 53 ==== osd_op_reply(209 gc.14 [call] v31'164 uv164 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.749+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2023-12-07T21:09:34.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.750+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:210 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.751+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 54 ==== osd_op_reply(210 gc.15 [call] v31'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.751+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:211 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.751+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 55 ==== osd_op_reply(211 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.751+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.751+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:212 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.751+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 56 ==== osd_op_reply(212 gc.15 [call out=24b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.752+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:213 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.752+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 57 ==== osd_op_reply(213 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.752+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.752+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:214 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.752+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 58 ==== osd_op_reply(214 gc.15 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.752+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.752+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:215 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.753+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 59 ==== osd_op_reply(215 gc.15 [call] v31'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.753+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2023-12-07T21:09:34.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.753+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:216 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.754+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 49 ==== osd_op_reply(216 gc.16 [call] v31'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.754+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:217 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.754+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 50 ==== osd_op_reply(217 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.754+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.754+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:218 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f199c089040 2023-12-07T21:09:34.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.755+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 51 ==== osd_op_reply(218 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.755+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:219 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.755+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 52 ==== osd_op_reply(219 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.755+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.755+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:220 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.755+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 53 ==== osd_op_reply(220 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.755+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.755+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:221 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.756+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 54 ==== osd_op_reply(221 gc.16 [call] v31'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.756+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.756+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:222 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.757+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 60 ==== osd_op_reply(222 gc.17 [call] v31'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.757+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:223 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.757+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 61 ==== osd_op_reply(223 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.757+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.757+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:224 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.757+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 62 ==== osd_op_reply(224 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.757+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:225 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.758+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 63 ==== osd_op_reply(225 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.758+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.758+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:226 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.758+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 64 ==== osd_op_reply(226 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.758+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.758+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:227 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.759+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 65 ==== osd_op_reply(227 gc.17 [call] v31'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.759+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2023-12-07T21:09:34.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.759+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:228 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.760+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 54 ==== osd_op_reply(228 gc.18 [call] v31'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.760+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:229 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.761+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 55 ==== osd_op_reply(229 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.761+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.761+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:230 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de139a30 2023-12-07T21:09:34.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.761+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 56 ==== osd_op_reply(230 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.761+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:231 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.761+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 57 ==== osd_op_reply(231 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.761+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.761+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:232 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.761+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 58 ==== osd_op_reply(232 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.761+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.761+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:233 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.762+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 59 ==== osd_op_reply(233 gc.18 [call] v31'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.762+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2023-12-07T21:09:34.756 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.762+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:234 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.763+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 60 ==== osd_op_reply(234 gc.19 [call] v31'165 uv165 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.763+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:235 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.764+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 61 ==== osd_op_reply(235 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.764+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.764+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:236 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de139a30 2023-12-07T21:09:34.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.764+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 62 ==== osd_op_reply(236 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.764+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:237 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.764+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 63 ==== osd_op_reply(237 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.764+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.764+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:238 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.764+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 64 ==== osd_op_reply(238 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.764+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.764+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:239 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de139a30 2023-12-07T21:09:34.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.765+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 65 ==== osd_op_reply(239 gc.19 [call] v31'166 uv166 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.765+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2023-12-07T21:09:34.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.765+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:240 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.767+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 66 ==== osd_op_reply(240 gc.20 [call] v31'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.767+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:241 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.767+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 67 ==== osd_op_reply(241 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.767+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.767+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:242 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.767+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 68 ==== osd_op_reply(242 gc.20 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.767+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:243 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.767+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 69 ==== osd_op_reply(243 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.767+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.767+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:244 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.768+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 70 ==== osd_op_reply(244 gc.20 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.768+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.768+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:245 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.769+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 71 ==== osd_op_reply(245 gc.20 [call] v31'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.769+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2023-12-07T21:09:34.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.769+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:246 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.770+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 55 ==== osd_op_reply(246 gc.21 [call] v31'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.770+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:247 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.770+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 56 ==== osd_op_reply(247 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.770+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.770+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:248 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f199c089040 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.770+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 57 ==== osd_op_reply(248 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.770+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:249 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.771+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 58 ==== osd_op_reply(249 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.771+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.771+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:250 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.771+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 59 ==== osd_op_reply(250 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.771+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.771+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:251 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f199c089040 2023-12-07T21:09:34.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.772+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 60 ==== osd_op_reply(251 gc.21 [call] v31'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.772+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2023-12-07T21:09:34.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.772+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:252 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.773+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 72 ==== osd_op_reply(252 gc.22 [call] v31'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.773+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:253 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.773+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 73 ==== osd_op_reply(253 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.773+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.773+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:254 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.773+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 74 ==== osd_op_reply(254 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.773+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:255 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.773+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 75 ==== osd_op_reply(255 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.773+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.773+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:256 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.774+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 76 ==== osd_op_reply(256 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.774+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.774+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:257 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.775+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 77 ==== osd_op_reply(257 gc.22 [call] v31'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.775+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2023-12-07T21:09:34.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.775+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:258 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.776+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 78 ==== osd_op_reply(258 gc.23 [call] v31'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.776+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:259 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.776+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 79 ==== osd_op_reply(259 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.776+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.776+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:260 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.776+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 80 ==== osd_op_reply(260 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.776+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:261 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.776+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 81 ==== osd_op_reply(261 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.776+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.776+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:262 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.777+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 82 ==== osd_op_reply(262 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.777+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.777+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:263 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.777+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 83 ==== osd_op_reply(263 gc.23 [call] v31'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.777+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2023-12-07T21:09:34.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.777+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:264 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.772 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.778+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 84 ==== osd_op_reply(264 gc.24 [call] v31'16 uv16 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.778+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:265 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.779+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 85 ==== osd_op_reply(265 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.779+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.779+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:266 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.779+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 86 ==== osd_op_reply(266 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.779+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:267 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.779+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 87 ==== osd_op_reply(267 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.779+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.779+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:268 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.779+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 88 ==== osd_op_reply(268 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.779+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.773 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.779+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:269 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.780+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 89 ==== osd_op_reply(269 gc.24 [call] v31'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.780+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.780+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:270 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.781+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 90 ==== osd_op_reply(270 gc.25 [call] v31'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.781+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:271 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.781+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 91 ==== osd_op_reply(271 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.781+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.781+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:272 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.782+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 92 ==== osd_op_reply(272 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.782+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:273 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.782+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 93 ==== osd_op_reply(273 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.776 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.782+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.782+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:274 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.782+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 94 ==== osd_op_reply(274 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.782+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.782+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:275 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.783+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 95 ==== osd_op_reply(275 gc.25 [call] v31'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.783+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2023-12-07T21:09:34.777 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.783+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:276 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.784+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 56 ==== osd_op_reply(276 gc.26 [call] v31'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.784+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:277 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.785+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 57 ==== osd_op_reply(277 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.785+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.785+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:278 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f19a000d3d0 2023-12-07T21:09:34.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.785+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 58 ==== osd_op_reply(278 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.785+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:279 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.779 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.785+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 59 ==== osd_op_reply(279 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.785+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.785+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:280 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.785+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 60 ==== osd_op_reply(280 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.785+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.785+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:281 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.786+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 61 ==== osd_op_reply(281 gc.26 [call] v31'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.786+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2023-12-07T21:09:34.780 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.786+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:282 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.787+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 96 ==== osd_op_reply(282 gc.27 [call] v31'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.787+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:283 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.787+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 97 ==== osd_op_reply(283 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.787+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.788+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:284 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.788+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 98 ==== osd_op_reply(284 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.788+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:285 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.788+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 99 ==== osd_op_reply(285 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.788+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.782 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.788+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:286 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x55a4de13fb50 2023-12-07T21:09:34.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.788+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 100 ==== osd_op_reply(286 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.788+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.788+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:287 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x55a4de13fb50 2023-12-07T21:09:34.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.789+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 101 ==== osd_op_reply(287 gc.27 [call] v31'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.789+0000 7f19ae51e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2023-12-07T21:09:34.783 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.789+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:288 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.790+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 62 ==== osd_op_reply(288 gc.28 [call] v31'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.784 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.790+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:289 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.791+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 63 ==== osd_op_reply(289 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.791+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.791+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:290 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de189b20 con 0x7f19a000d3d0 2023-12-07T21:09:34.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.791+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 64 ==== osd_op_reply(290 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.791+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:291 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.791+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 65 ==== osd_op_reply(291 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.791+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:09:34.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.791+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:292 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.791+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 66 ==== osd_op_reply(292 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.791+0000 7f19ae51e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:09:34.785 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.791+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:293 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de18ab30 con 0x7f19a000d3d0 2023-12-07T21:09:34.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.792+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 67 ==== osd_op_reply(293 gc.28 [call] v31'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.793+0000 7f19727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:34.786 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.793+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94166588890208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de156390 con 0x55a4de139a30 2023-12-07T21:09:34.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.794+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94166588890208] v31'167 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.787 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.794+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94166586453840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de156390 con 0x7f199c089040 2023-12-07T21:09:34.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.795+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 61 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94166586453840] v31'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.795+0000 7f19ae51e800 20 remove_watcher() i=0 2023-12-07T21:09:34.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.795+0000 7f19ae51e800 2 removed watcher, disabling cache 2023-12-07T21:09:34.788 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.795+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94166588865840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de156390 con 0x55a4de139a30 2023-12-07T21:09:34.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.796+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94166588865840] v31'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.796+0000 7f19ae51e800 20 remove_watcher() i=1 2023-12-07T21:09:34.789 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.796+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94166588870736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de156390 con 0x55a4de13fb50 2023-12-07T21:09:34.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.797+0000 7f19ac025640 1 -- 172.21.15.121:0/1605965762 <== osd.3 v2:172.21.15.121:6800/4032235766 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94166588870736] v31'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f199c05ea60 con 0x55a4de13fb50 2023-12-07T21:09:34.790 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.797+0000 7f19ae51e800 20 remove_watcher() i=2 2023-12-07T21:09:34.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.797+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94166588878928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de156390 con 0x7f199c089040 2023-12-07T21:09:34.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.798+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 <== osd.2 v2:172.21.15.121:6816/2557538450 62 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94166588878928] v31'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a0026040 con 0x7f199c089040 2023-12-07T21:09:34.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.798+0000 7f19ae51e800 20 remove_watcher() i=3 2023-12-07T21:09:34.791 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.798+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94166588875616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de156390 con 0x55a4de139a30 2023-12-07T21:09:34.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.799+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.1 v2:172.21.15.121:6808/2140819418 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94166588875616] v31'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x55a4de139a30 2023-12-07T21:09:34.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.799+0000 7f19ae51e800 20 remove_watcher() i=4 2023-12-07T21:09:34.792 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.799+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94166588883568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de156390 con 0x7f19a000d3d0 2023-12-07T21:09:34.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.800+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94166588883568] v31'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.800+0000 7f19ae51e800 20 remove_watcher() i=5 2023-12-07T21:09:34.793 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.800+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94166588887728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de156390 con 0x7f19a000d3d0 2023-12-07T21:09:34.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.801+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94166588887728] v31'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.801+0000 7f19ae51e800 20 remove_watcher() i=6 2023-12-07T21:09:34.794 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.801+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94166588882384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55a4de156390 con 0x7f19a000d3d0 2023-12-07T21:09:34.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.802+0000 7f19ac826640 1 -- 172.21.15.121:0/1605965762 <== osd.0 v2:172.21.15.89:6800/654939948 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94166588882384] v31'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f19a4053040 con 0x7f19a000d3d0 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.802+0000 7f19ae51e800 20 remove_watcher() i=7 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f19a000d3d0 msgr2=0x7f19a000d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f19a000d3d0 0x7f19a000d830 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a4de139a30 msgr2=0x55a4de13bef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a4de139a30 0x55a4de13bef0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f199c089040 msgr2=0x7f199c05b570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f199c089040 0x7f199c05b570 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a4de13fb50 msgr2=0x55a4de141fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a4de13fb50 0x55a4de141fc0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f19840360c0 msgr2=0x7f1984038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f19840360c0 0x7f1984038580 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19a0000f60 tx=0x7f19a0001230 comp rx=0 tx=0).stop 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 msgr2=0x55a4de12e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 --2- 172.21.15.121:0/1605965762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4de1273a0 0x55a4de12e2b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c010 tx=0x7f19a4002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 reap_dead start 2023-12-07T21:09:34.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 shutdown_connections 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 >> 172.21.15.121:0/1605965762 conn(0x55a4de072330 msgr2=0x55a4de121580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ab824640 1 -- 172.21.15.121:0/1605965762 reap_dead start 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 shutdown_connections 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/1605965762 wait complete. 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/3188786605 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f19980360c0 msgr2=0x7f1998038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 --2- 172.21.15.121:0/3188786605 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f19980360c0 0x7f1998038580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f199c051ff0 tx=0x7f199c051f40 comp rx=0 tx=0).stop 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/3188786605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 msgr2=0x55a4de11b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 --2- 172.21.15.121:0/3188786605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de11b130 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f199c000f80 tx=0x7f199c003330 comp rx=0 tx=0).stop 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/3188786605 shutdown_connections 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 --2- 172.21.15.121:0/3188786605 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f19980360c0 0x7f1998038580 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 --2- 172.21.15.121:0/3188786605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a4ddfe3b40 0x55a4de11b130 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/3188786605 >> 172.21.15.121:0/3188786605 conn(0x55a4de069870 msgr2=0x55a4de112ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/3188786605 shutdown_connections 2023-12-07T21:09:34.798 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.803+0000 7f19ae51e800 1 -- 172.21.15.121:0/3188786605 wait complete. 2023-12-07T21:09:34.799 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2023-12-07T21:09:34.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2023-12-07T21:09:34.800 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2023-12-07T21:09:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:34.883 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:34.884 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.891+0000 7f7ac27da800 1 Processor -- start 2023-12-07T21:09:34.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.891+0000 7f7ac27da800 1 -- start start 2023-12-07T21:09:34.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.892+0000 7f7ac27da800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c70da12720 0x55c70da12b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.892+0000 7f7ac27da800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c70d95e7a0 con 0x55c70da11430 2023-12-07T21:09:34.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.892+0000 7f7ac27da800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c70d927880 con 0x55c70da12720 2023-12-07T21:09:34.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.892+0000 7f7ac02da640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55c70da12720 0x55c70da12b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.892+0000 7f7abfad9640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55c70da11430 0x55c70da118e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:34086/0 (socket says 172.21.15.121:34086) 2023-12-07T21:09:34.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.892+0000 7f7abfad9640 1 -- 172.21.15.121:0/3255698258 learned_addr learned my addr 172.21.15.121:0/3255698258 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:34.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.892+0000 7f7ac02da640 1 -- 172.21.15.121:0/3255698258 >> v1:172.21.15.89:6789/0 conn(0x55c70da11430 legacy=0x55c70da118e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.885 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.892+0000 7f7ac02da640 1 -- 172.21.15.121:0/3255698258 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c70da131c0 con 0x55c70da12720 2023-12-07T21:09:34.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.894+0000 7f7ac02da640 1 --2- 172.21.15.121:0/3255698258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da12720 0x55c70da12b40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a470 tx=0x7f7ab001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b4523dac38fc08 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.894+0000 7f7abf2d8640 1 -- 172.21.15.121:0/3255698258 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab0052570 con 0x55c70da12720 2023-12-07T21:09:34.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.894+0000 7f7abf2d8640 1 -- 172.21.15.121:0/3255698258 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab00526d0 con 0x55c70da12720 2023-12-07T21:09:34.887 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.894+0000 7f7abf2d8640 1 -- 172.21.15.121:0/3255698258 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab0052990 con 0x55c70da12720 2023-12-07T21:09:34.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.894+0000 7f7ac27da800 1 -- 172.21.15.121:0/3255698258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da12720 msgr2=0x55c70da12b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.894+0000 7f7ac27da800 1 --2- 172.21.15.121:0/3255698258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da12720 0x55c70da12b40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a470 tx=0x7f7ab001cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:34.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.895+0000 7f7ac27da800 1 -- 172.21.15.121:0/3255698258 shutdown_connections 2023-12-07T21:09:34.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.895+0000 7f7ac27da800 1 --2- 172.21.15.121:0/3255698258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da12720 0x55c70da12b40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.895+0000 7f7ac27da800 1 -- 172.21.15.121:0/3255698258 >> 172.21.15.121:0/3255698258 conn(0x55c70da0bf60 msgr2=0x55c70da0e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.895+0000 7f7ac27da800 1 -- 172.21.15.121:0/3255698258 shutdown_connections 2023-12-07T21:09:34.889 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.895+0000 7f7ac27da800 1 -- 172.21.15.121:0/3255698258 wait complete. 2023-12-07T21:09:34.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.895+0000 7f7ac27da800 1 Processor -- start 2023-12-07T21:09:34.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.895+0000 7f7ac27da800 1 -- start start 2023-12-07T21:09:34.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.895+0000 7f7ac27da800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dab61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.895+0000 7f7ac27da800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c70d924db0 con 0x55c70da11430 2023-12-07T21:09:34.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.896+0000 7f7ac02da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dab61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.896+0000 7f7ac02da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dab61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45208/0 (socket says 172.21.15.121:45208) 2023-12-07T21:09:34.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.896+0000 7f7ac02da640 1 -- 172.21.15.121:0/1872216157 learned_addr learned my addr 172.21.15.121:0/1872216157 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.896+0000 7f7ac02da640 1 -- 172.21.15.121:0/1872216157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab0005d20 con 0x55c70da11430 2023-12-07T21:09:34.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.896+0000 7f7ac02da640 1 --2- 172.21.15.121:0/1872216157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dab61d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0055040 tx=0x7f7ab004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cb1165409bb9f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.890 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.896+0000 7f7abead7640 1 -- 172.21.15.121:0/1872216157 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab000a180 con 0x55c70da11430 2023-12-07T21:09:34.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.896+0000 7f7abead7640 1 -- 172.21.15.121:0/1872216157 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab000a300 con 0x55c70da11430 2023-12-07T21:09:34.891 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.896+0000 7f7abead7640 1 -- 172.21.15.121:0/1872216157 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab00529b0 con 0x55c70da11430 2023-12-07T21:09:34.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.897+0000 7f7ac27da800 1 -- 172.21.15.121:0/1872216157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 msgr2=0x55c70dab61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.897+0000 7f7ac27da800 1 --2- 172.21.15.121:0/1872216157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dab61d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0055040 tx=0x7f7ab004c000 comp rx=0 tx=0).stop 2023-12-07T21:09:34.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.897+0000 7f7ac27da800 1 -- 172.21.15.121:0/1872216157 shutdown_connections 2023-12-07T21:09:34.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.897+0000 7f7ac27da800 1 --2- 172.21.15.121:0/1872216157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dab61d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.897+0000 7f7ac27da800 1 -- 172.21.15.121:0/1872216157 >> 172.21.15.121:0/1872216157 conn(0x55c70da0bf60 msgr2=0x55c70dab1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.897+0000 7f7ac27da800 1 -- 172.21.15.121:0/1872216157 shutdown_connections 2023-12-07T21:09:34.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.897+0000 7f7ac27da800 1 -- 172.21.15.121:0/1872216157 wait complete. 2023-12-07T21:09:34.900 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.897+0000 7f7ac27da800 1 Processor -- start 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.897+0000 7f7ac27da800 1 -- start start 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7ac27da800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dabd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7ac27da800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c70d9206a0 con 0x55c70da11430 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7ac02da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dabd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7ac02da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dabd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45222/0 (socket says 172.21.15.121:45222) 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7ac02da640 1 -- 172.21.15.121:0/2024816114 learned_addr learned my addr 172.21.15.121:0/2024816114 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7ac02da640 1 -- 172.21.15.121:0/2024816114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c70da131c0 con 0x55c70da11430 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7ac02da640 1 --2- 172.21.15.121:0/2024816114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dabd540 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a470 tx=0x7f7ab0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7abdad5640 1 -- 172.21.15.121:0/2024816114 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab006a070 con 0x55c70da11430 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7abdad5640 1 -- 172.21.15.121:0/2024816114 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab0052ca0 con 0x55c70da11430 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7ac27da800 1 -- 172.21.15.121:0/2024816114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c70dabda80 con 0x55c70da11430 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7abdad5640 1 -- 172.21.15.121:0/2024816114 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab005c410 con 0x55c70da11430 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.898+0000 7f7ac27da800 1 -- 172.21.15.121:0/2024816114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c70dabdfc0 con 0x55c70da11430 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.899+0000 7f7ac27da800 1 Processor -- start 2023-12-07T21:09:34.901 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.899+0000 7f7ac27da800 1 -- start start 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.899+0000 7f7abdad5640 1 -- 172.21.15.121:0/2024816114 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7ab0059030 con 0x55c70da11430 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.899+0000 7f7ac27da800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dacacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.899+0000 7f7ac27da800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c70d8ba890 con 0x55c70daca8a0 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.899+0000 7f7ac0adb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dacacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.899+0000 7f7abdad5640 1 --2- 172.21.15.121:0/2024816114 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7aac036110 0x7f7aac0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.899+0000 7f7ac0adb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dacacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45232/0 (socket says 172.21.15.121:45232) 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.899+0000 7f7ac0adb640 1 -- 172.21.15.121:0/2860266411 learned_addr learned my addr 172.21.15.121:0/2860266411 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.899+0000 7f7abdad5640 1 -- 172.21.15.121:0/2024816114 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f7ab008c980 con 0x55c70da11430 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.900+0000 7f7ac02da640 1 --2- 172.21.15.121:0/2024816114 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7aac036110 0x7f7aac0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.900+0000 7f7ac0adb640 1 -- 172.21.15.121:0/2860266411 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c70dacb200 con 0x55c70daca8a0 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.900+0000 7f7ac0adb640 1 --2- 172.21.15.121:0/2860266411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dacacc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800a430 tx=0x7f7ab800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f629a2f3766f8386 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.900+0000 7f7ac02da640 1 --2- 172.21.15.121:0/2024816114 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7aac036110 0x7f7aac0385d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ab005c6e0 tx=0x7f7ab005c630 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.900+0000 7f7aa77fe640 1 -- 172.21.15.121:0/2860266411 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab8001650 con 0x55c70daca8a0 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.900+0000 7f7aa77fe640 1 -- 172.21.15.121:0/2860266411 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab80017d0 con 0x55c70daca8a0 2023-12-07T21:09:34.902 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.900+0000 7f7aa77fe640 1 -- 172.21.15.121:0/2860266411 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab8001ab0 con 0x55c70daca8a0 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac27da800 1 -- 172.21.15.121:0/2860266411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 msgr2=0x55c70dacacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac27da800 1 --2- 172.21.15.121:0/2860266411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dacacc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800a430 tx=0x7f7ab800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac27da800 1 -- 172.21.15.121:0/2860266411 shutdown_connections 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac27da800 1 --2- 172.21.15.121:0/2860266411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dacacc0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac27da800 1 -- 172.21.15.121:0/2860266411 >> 172.21.15.121:0/2860266411 conn(0x55c70da12720 msgr2=0x55c70dac5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac27da800 1 -- 172.21.15.121:0/2860266411 shutdown_connections 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac27da800 1 -- 172.21.15.121:0/2860266411 wait complete. 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac27da800 1 Processor -- start 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac27da800 1 -- start start 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac27da800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dac24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac27da800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c70d8ba530 con 0x55c70daca8a0 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac0adb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dac24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac0adb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dac24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45240/0 (socket says 172.21.15.121:45240) 2023-12-07T21:09:34.903 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.901+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 learned_addr learned my addr 172.21.15.121:0/1627898008 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.902+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab800a0e0 con 0x55c70daca8a0 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.902+0000 7f7ac0adb640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dac24e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800a930 tx=0x7f7ab8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.902+0000 7f7aa5ffb640 1 -- 172.21.15.121:0/1627898008 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab8010900 con 0x55c70daca8a0 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.902+0000 7f7aa5ffb640 1 -- 172.21.15.121:0/1627898008 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab8010a60 con 0x55c70daca8a0 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.902+0000 7f7aa5ffb640 1 -- 172.21.15.121:0/1627898008 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ab8010d20 con 0x55c70daca8a0 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.902+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c70dac0b60 con 0x55c70daca8a0 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.902+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c70dac0fc0 con 0x55c70daca8a0 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.903+0000 7f7aa5ffb640 1 -- 172.21.15.121:0/1627898008 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7ab8017030 con 0x55c70daca8a0 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.903+0000 7f7ac27da800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.903+0000 7f7aa5ffb640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7a98036110 0x7f7a980385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.903+0000 7f7aa5ffb640 1 -- 172.21.15.121:0/1627898008 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6038+0+0 (secure 0 0 0) 0x7f7ab804b7d0 con 0x55c70daca8a0 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.903+0000 7f7abfad9640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7a98036110 0x7f7a980385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.903+0000 7f7ac27da800 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55c70dadf1a0 0x55c70dae1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.904 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.903+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae1d90 con 0x55c70dadf1a0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.903+0000 7f7ac0adb640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55c70dadf1a0 0x55c70dae1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7abfad9640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7a98036110 0x7f7a980385d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4000f60 tx=0x7f7ab4001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac0adb640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55c70dadf1a0 0x55c70dae1640 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac27da800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac27da800 20 realm 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac27da800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae2180 con 0x55c70dadf1a0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac27da800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac27da800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac27da800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae29d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.905 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac27da800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac27da800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.904+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae2d30 con 0x55c70dadf1a0 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.905+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.905+0000 7f7ac27da800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.905+0000 7f7ac27da800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.905+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae2670 con 0x55c70dadf1a0 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.905+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.905+0000 7f7ac27da800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.905+0000 7f7ac27da800 20 searching for the correct realm 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.905+0000 7f7ac27da800 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55c70dae4f80 0x55c70dae7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.905+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dae4f80 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.905+0000 7f7ac02da640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55c70dae4f80 0x55c70dae7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.906+0000 7f7ac02da640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55c70dae4f80 0x55c70dae7370 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.906 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.906+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.906+0000 7f7ac02da640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7ab0078060 0x7f7ab00540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.906+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab0078060 2023-12-07T21:09:34.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.906+0000 7f7abfad9640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7ab0078060 0x7f7ab00540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.907+0000 7f7abfad9640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7ab0078060 0x7f7ab00540e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.907+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.907+0000 7f7abfad9640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7ab400d3d0 0x7f7ab400d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:34.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.907+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab400d3d0 2023-12-07T21:09:34.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.907+0000 7f7ac0adb640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7ab400d3d0 0x7f7ab400d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:34.907 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.907+0000 7f7ac0adb640 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7ab400d3d0 0x7f7ab400d830 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:34.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.908+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.908+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dadf1a0 2023-12-07T21:09:34.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.908+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.908+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dadf1a0 2023-12-07T21:09:34.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.908+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.908+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab400d3d0 2023-12-07T21:09:34.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.908+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.908+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab400d3d0 2023-12-07T21:09:34.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.909+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.909+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab0078060 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.909+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.909+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dae4f80 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.909+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.909+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dadf1a0 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.909+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.909+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab400d3d0 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.910+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.910+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dadf1a0 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.910+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.910+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab0078060 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.910+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 31 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.910+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dae4f80 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.910+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.910+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dae4f80 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.910+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.910+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab400d3d0 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.911+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.911+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dae4f80 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.911+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.911+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dae4f80 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.911+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.911+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dadf1a0 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.912+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.912+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dadf1a0 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.912+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 31 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.912+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab400d3d0 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.912+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.920 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.912+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dae4f80 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.912+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.912+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab0078060 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.913+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.913+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dadf1a0 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.913+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.913+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab400d3d0 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.913+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.913+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dae4f80 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.913+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.913+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab400d3d0 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.914+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.914+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab0078060 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.914+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.914+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dae4f80 2023-12-07T21:09:34.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.914+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.914+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x7f7ab400d3d0 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.914+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.914+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7950 con 0x55c70dadf1a0 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) v8 -- 0x7f7ab8053080 con 0x7f7ab0078060 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae3bc0 con 0x55c70dadf1a0 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae3840 con 0x55c70dadf1a0 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.915+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae4490 con 0x55c70dae4f80 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 20 zone default found 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 4 Realm: () 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:34.923 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 20 zonegroup default 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae7d70 con 0x7f7ab400d3d0 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae9ae0 con 0x55c70dae4f80 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 20 rados->read ofs=0 len=0 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae9e60 con 0x55c70dae4f80 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 20 started sync module instance, tier type = 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.916+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae93c0 con 0x7f7ab0078060 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.917+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v31'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.917+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94313413975888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dae9770 con 0x7f7ab0078060 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.917+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daea720 con 0x55c70dadf1a0 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.919+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94313413975888] v31'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.919+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v31'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.919+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94313416396576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daea760 con 0x55c70dadf1a0 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.919+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daeb200 con 0x55c70dae4f80 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.920+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v31'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.920+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94313416404192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daeba50 con 0x55c70dae4f80 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.920+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daec420 con 0x7f7ab0078060 2023-12-07T21:09:34.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.920+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94313416396576] v31'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.921+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94313416404192] v31'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.921+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v31'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab4026040 con 0x7f7ab0078060 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.921+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94313416408864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daeb6c0 con 0x7f7ab0078060 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.921+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daecf10 con 0x55c70dadf1a0 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.922+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94313416408864] v31'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab4026040 con 0x7f7ab0078060 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.922+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v31'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.922+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94313416411632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daed2c0 con 0x55c70dadf1a0 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.922+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daedc30 con 0x7f7ab400d3d0 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.923+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v31'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.923+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94313416415120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daee040 con 0x7f7ab400d3d0 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.923+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daeea10 con 0x7f7ab400d3d0 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.923+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94313416411632] v31'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.924+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94313416415120] v31'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.924+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v31'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.924+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94313416418576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daedba0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.924+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daef090 con 0x7f7ab400d3d0 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.925+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v31'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.925+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94313416418576] v31'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.925+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94313416420336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daef4a0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.925+0000 7f7ac27da800 20 add_watcher() i=0 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.925+0000 7f7ac27da800 20 add_watcher() i=1 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.925+0000 7f7ac27da800 20 add_watcher() i=2 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.925+0000 7f7ac27da800 20 add_watcher() i=3 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.925+0000 7f7ac27da800 20 add_watcher() i=4 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.925+0000 7f7ac27da800 20 add_watcher() i=5 2023-12-07T21:09:34.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.925+0000 7f7ac27da800 20 add_watcher() i=6 2023-12-07T21:09:34.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.926+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94313416420336] v31'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.926+0000 7f7ac27da800 20 add_watcher() i=7 2023-12-07T21:09:34.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.926+0000 7f7ac27da800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:34.930 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.926+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daf24d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.926+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.926+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94313416421376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daef8b0 con 0x55c70dadf1a0 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.927+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94313416421376] v31'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.927+0000 7f7a86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.927+0000 7f7ac27da800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.927+0000 7f7ac27da800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.928+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dafa690 con 0x55c70dadf1a0 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.929+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.929+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dafa860 con 0x7f7ab400d3d0 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.930+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.930+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dafad90 con 0x55c70dae4f80 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.931+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'23 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.931+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dafb760 con 0x55c70dadf1a0 2023-12-07T21:09:34.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.932+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'169 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.932+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daf8840 con 0x7f7ab0078060 2023-12-07T21:09:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.933+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'56 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ab4026040 con 0x7f7ab0078060 2023-12-07T21:09:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.933+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dafc2d0 con 0x55c70dae4f80 2023-12-07T21:09:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.934+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.934+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dafcaf0 con 0x55c70dadf1a0 2023-12-07T21:09:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.935+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.935+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dafcaf0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.936+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.936+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dafcaf0 con 0x7f7ab0078060 2023-12-07T21:09:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.937+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ab4026040 con 0x7f7ab0078060 2023-12-07T21:09:34.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.937+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dafd500 con 0x55c70dae4f80 2023-12-07T21:09:34.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.939+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.939+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70daf7830 con 0x7f7ab0078060 2023-12-07T21:09:34.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.940+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'57 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab4026040 con 0x7f7ab0078060 2023-12-07T21:09:34.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.940+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dafe070 con 0x7f7ab400d3d0 2023-12-07T21:09:34.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.941+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.941+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) v8 -- 0x55c70dafe070 con 0x7f7ab0078060 2023-12-07T21:09:34.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.943+0000 7f7aa5ffb640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_map(32..32 src has 1..32) v4 ==== 491+0+0 (crc 0 0 0) 0x7f7ab400e6f0 con 0x7f7ab0078060 2023-12-07T21:09:34.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.948+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.948+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe510 con 0x7f7ab400d3d0 2023-12-07T21:09:34.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.950+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'45 uv44 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.950+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe510 con 0x55c70dadf1a0 2023-12-07T21:09:34.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.951+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'170 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.951+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe510 con 0x55c70dae4f80 2023-12-07T21:09:34.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.952+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'50 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.952+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe6e0 con 0x7f7ab0078060 2023-12-07T21:09:34.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.953+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'58 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.953+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe770 con 0x55c70dae4f80 2023-12-07T21:09:34.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.954+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.954+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe770 con 0x55c70dadf1a0 2023-12-07T21:09:34.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.956+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.956+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe770 con 0x55c70dadf1a0 2023-12-07T21:09:34.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.956+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'171 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.956+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe770 con 0x55c70dae4f80 2023-12-07T21:09:34.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.957+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'51 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.957+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe770 con 0x7f7ab0078060 2023-12-07T21:09:34.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.958+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.958+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe800 con 0x55c70dae4f80 2023-12-07T21:09:34.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.959+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.959+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe800 con 0x55c70dae4f80 2023-12-07T21:09:34.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.960+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.960+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe9d0 con 0x55c70dae4f80 2023-12-07T21:09:34.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.961+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'18 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.961+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe9d0 con 0x55c70dae4f80 2023-12-07T21:09:34.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.962+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.962+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.963+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.963+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe9d0 con 0x55c70dae4f80 2023-12-07T21:09:34.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.964+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.964+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.965+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.965+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe940 con 0x55c70dae4f80 2023-12-07T21:09:34.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.966+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'52 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.966+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe940 con 0x7f7ab400d3d0 2023-12-07T21:09:34.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.967+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'46 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.967+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafe940 con 0x7f7ab0078060 2023-12-07T21:09:34.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.968+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.968+0000 7f7a85fdb640 20 reqs_thread_entry: start 2023-12-07T21:09:34.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.968+0000 7f7ac27da800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:34.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.968+0000 7f7ac27da800 20 Filter name: none 2023-12-07T21:09:34.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.968+0000 7f79f77fe640 20 reqs_thread_entry: start 2023-12-07T21:09:34.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.968+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.969+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.969+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dadf1a0 2023-12-07T21:09:34.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.969+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.969+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.969+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.969+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.970+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.970+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab400d3d0 2023-12-07T21:09:34.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.970+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.970+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.970+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.970+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.971+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.971+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.971+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.971+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.971+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.971+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.972+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.972+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dadf1a0 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.972+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.972+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.972+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.972+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.972+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.972+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab0078060 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.972+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.972+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.973+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.973+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.973+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.973+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.973+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.973+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.973+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.973+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.974+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.974+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dadf1a0 2023-12-07T21:09:34.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.974+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.974+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.974+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.974+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.975+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.975+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab400d3d0 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.975+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.975+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.975+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.975+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.976+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.976+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab0078060 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.976+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.976+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.976+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.976+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.976+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.976+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.977+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.977+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.977+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.977+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.977+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.977+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab0078060 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.978+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.978+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.978+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.978+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.978+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.978+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab400d3d0 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.979+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.979+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.979+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.979+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.979+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.979+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab0078060 2023-12-07T21:09:34.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.979+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.979+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.979+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.979+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.980+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.980+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab400d3d0 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.980+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.980+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.980+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.980+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.981+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.981+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dadf1a0 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.981+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.981+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.981+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.981+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.981+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.981+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.982+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.982+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.982+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.982+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.982+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.982+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab0078060 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.982+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.982+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.983+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.983+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.983+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.983+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.983+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.983+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.983+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.983+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.983+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.984+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dadf1a0 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.984+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.984+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.984+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.984+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.984+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.984+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dadf1a0 2023-12-07T21:09:34.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.984+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.984+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dadf1a0 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.985+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.985+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.985+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.985+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.985+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.985+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.985+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.985+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.986+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.986+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab0078060 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.986+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.986+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.986+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.986+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.986+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.986+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.987+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.987+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.987+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.987+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.987+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.987+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.987+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.987+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.987+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.987+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.988+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.988+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.988+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.988+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.988+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.988+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.988+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.988+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.989+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab005c8f0 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.989+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.989+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab009e020 con 0x55c70dae4f80 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.989+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.989+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.989+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab400d3d0 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.989+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.990+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.990+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.990+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.990+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab009e020 con 0x55c70dae4f80 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.990+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.990+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab009e020 con 0x55c70dae4f80 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.990+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.990+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab009e020 con 0x55c70dae4f80 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.990+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.991+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.991+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab400d3d0 2023-12-07T21:09:34.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.991+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.991+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.991+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.991+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.992+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab009e020 con 0x55c70dae4f80 2023-12-07T21:09:34.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.992+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x55c70dae4f80 2023-12-07T21:09:34.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.992+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab009e020 con 0x55c70dae4f80 2023-12-07T21:09:34.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.992+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x55c70dae4f80 2023-12-07T21:09:34.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.992+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab009e020 con 0x55c70dae4f80 2023-12-07T21:09:34.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.992+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.992+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.992+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab400d3d0 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.993+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.993+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab400d3d0 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.993+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.993+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.993+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.993+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db29210 con 0x7f7ab0078060 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.994+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.994+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70db2a220 con 0x7f7ab0078060 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.994+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.995+0000 7f7a86fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.995+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94313416421376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafb2c0 con 0x55c70dadf1a0 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.996+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94313416421376] v32'172 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.996+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94313413975888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafb2c0 con 0x7f7ab0078060 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.997+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94313413975888] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.997+0000 7f7ac27da800 20 remove_watcher() i=0 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.997+0000 7f7ac27da800 2 removed watcher, disabling cache 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.997+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94313416396576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafb2c0 con 0x55c70dadf1a0 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.998+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94313416396576] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.998+0000 7f7ac27da800 20 remove_watcher() i=1 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.998+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94313416404192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafb2c0 con 0x55c70dae4f80 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.999+0000 7f7ac02da640 1 -- 172.21.15.121:0/1627898008 <== osd.3 v2:172.21.15.121:6800/4032235766 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94313416404192] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab009e020 con 0x55c70dae4f80 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.999+0000 7f7ac27da800 20 remove_watcher() i=2 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:34.999+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94313416408864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafb2c0 con 0x7f7ab0078060 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.000+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 <== osd.2 v2:172.21.15.121:6816/2557538450 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94313416408864] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab4006070 con 0x7f7ab0078060 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.000+0000 7f7ac27da800 20 remove_watcher() i=3 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.000+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94313416411632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70dafb2c0 con 0x55c70dadf1a0 2023-12-07T21:09:34.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.001+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.1 v2:172.21.15.121:6808/2140819418 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94313416411632] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x55c70dadf1a0 2023-12-07T21:09:34.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.001+0000 7f7ac27da800 20 remove_watcher() i=4 2023-12-07T21:09:34.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.001+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94313416415120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70daec9f0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.002+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94313416415120] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:34.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.002+0000 7f7ac27da800 20 remove_watcher() i=5 2023-12-07T21:09:34.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.002+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94313416418576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70daec9f0 con 0x7f7ab400d3d0 2023-12-07T21:09:35.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.003+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94313416418576] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:35.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.003+0000 7f7ac27da800 20 remove_watcher() i=6 2023-12-07T21:09:35.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.003+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94313416420336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c70daec9f0 con 0x7f7ab400d3d0 2023-12-07T21:09:35.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac0adb640 1 -- 172.21.15.121:0/1627898008 <== osd.0 v2:172.21.15.89:6800/654939948 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94313416420336] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ab802e9d0 con 0x7f7ab400d3d0 2023-12-07T21:09:35.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac27da800 20 remove_watcher() i=7 2023-12-07T21:09:35.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7ab400d3d0 msgr2=0x7f7ab400d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac27da800 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f7ab400d3d0 0x7f7ab400d830 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55c70dadf1a0 msgr2=0x55c70dae1640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac27da800 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55c70dadf1a0 0x55c70dae1640 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7ab0078060 msgr2=0x7f7ab00540e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac27da800 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7ab0078060 0x7f7ab00540e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55c70dae4f80 msgr2=0x55c70dae7370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac27da800 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55c70dae4f80 0x55c70dae7370 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7a98036110 msgr2=0x7f7a980385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.004+0000 7f7ac27da800 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7a98036110 0x7f7a980385d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4000f60 tx=0x7f7ab4001230 comp rx=0 tx=0).stop 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 msgr2=0x55c70dac24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dac24e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800a930 tx=0x7f7ab8003370 comp rx=0 tx=0).stop 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7abfad9640 1 -- 172.21.15.121:0/1627898008 reap_dead start 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 shutdown_connections 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 --2- 172.21.15.121:0/1627898008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70daca8a0 0x55c70dac24e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 >> 172.21.15.121:0/1627898008 conn(0x55c70da12720 msgr2=0x55c70dac4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 shutdown_connections 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 -- 172.21.15.121:0/1627898008 wait complete. 2023-12-07T21:09:35.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 -- 172.21.15.121:0/2024816114 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7aac036110 msgr2=0x7f7aac0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 --2- 172.21.15.121:0/2024816114 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7aac036110 0x7f7aac0385d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ab005c6e0 tx=0x7f7ab005c630 comp rx=0 tx=0).stop 2023-12-07T21:09:35.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 -- 172.21.15.121:0/2024816114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 msgr2=0x55c70dabd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 --2- 172.21.15.121:0/2024816114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dabd540 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a470 tx=0x7f7ab0002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 -- 172.21.15.121:0/2024816114 shutdown_connections 2023-12-07T21:09:35.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 --2- 172.21.15.121:0/2024816114 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7aac036110 0x7f7aac0385d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 --2- 172.21.15.121:0/2024816114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55c70da11430 0x55c70dabd540 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 -- 172.21.15.121:0/2024816114 >> 172.21.15.121:0/2024816114 conn(0x55c70da0bf60 msgr2=0x55c70dab4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:35.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 -- 172.21.15.121:0/2024816114 shutdown_connections 2023-12-07T21:09:35.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.005+0000 7f7ac27da800 1 -- 172.21.15.121:0/2024816114 wait complete. 2023-12-07T21:09:35.003 INFO:teuthology.orchestra.run.smithi121.stdout:[] 2023-12-07T21:09:35.003 DEBUG:tasks.util.rgw: json result: [] 2023-12-07T21:09:35.003 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2023-12-07T21:09:35.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2023-12-07T21:09:35.004 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2023-12-07T21:09:35.046 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:35.046 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:35.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.054+0000 7fd9bf02f800 1 Processor -- start 2023-12-07T21:09:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.054+0000 7fd9bf02f800 1 -- start start 2023-12-07T21:09:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.054+0000 7fd9bf02f800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e21e7d9b50 0x55e21e86a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.054+0000 7fd9bf02f800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e21e7b17a0 con 0x55e21e86a740 2023-12-07T21:09:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.054+0000 7fd9bf02f800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e21e77a880 con 0x55e21e7d9b50 2023-12-07T21:09:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.055+0000 7fd9b1a2d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55e21e86a740 0x55e21e86cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:34092/0 (socket says 172.21.15.121:34092) 2023-12-07T21:09:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.055+0000 7fd9ba22e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e21e7d9b50 0x55e21e86a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.055+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/3494201056 learned_addr learned my addr 172.21.15.121:0/3494201056 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.055+0000 7fd9ba22e640 1 -- 172.21.15.121:0/3494201056 >> v1:172.21.15.89:6789/0 conn(0x55e21e86a740 legacy=0x55e21e86cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.055+0000 7fd9ba22e640 1 -- 172.21.15.121:0/3494201056 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e21e86f260 con 0x55e21e7d9b50 2023-12-07T21:09:35.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.057+0000 7fd9ba22e640 1 --2- 172.21.15.121:0/3494201056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e86a200 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00a470 tx=0x7fd9ac01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147d2fc77ba33cd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:35.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.057+0000 7fd9b9a2d640 1 -- 172.21.15.121:0/3494201056 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9ac052570 con 0x55e21e7d9b50 2023-12-07T21:09:35.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.057+0000 7fd9b9a2d640 1 -- 172.21.15.121:0/3494201056 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac0526d0 con 0x55e21e7d9b50 2023-12-07T21:09:35.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.057+0000 7fd9b9a2d640 1 -- 172.21.15.121:0/3494201056 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9ac052990 con 0x55e21e7d9b50 2023-12-07T21:09:35.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.057+0000 7fd9bf02f800 1 -- 172.21.15.121:0/3494201056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 msgr2=0x55e21e86a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.057+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/3494201056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e86a200 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00a470 tx=0x7fd9ac01cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:35.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.057+0000 7fd9bf02f800 1 -- 172.21.15.121:0/3494201056 shutdown_connections 2023-12-07T21:09:35.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.057+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/3494201056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e86a200 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.057+0000 7fd9bf02f800 1 -- 172.21.15.121:0/3494201056 >> 172.21.15.121:0/3494201056 conn(0x55e21e85f880 msgr2=0x55e21e861ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:35.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.057+0000 7fd9bf02f800 1 -- 172.21.15.121:0/3494201056 shutdown_connections 2023-12-07T21:09:35.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.057+0000 7fd9bf02f800 1 -- 172.21.15.121:0/3494201056 wait complete. 2023-12-07T21:09:35.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.058+0000 7fd9bf02f800 1 Processor -- start 2023-12-07T21:09:35.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.058+0000 7fd9bf02f800 1 -- start start 2023-12-07T21:09:35.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.058+0000 7fd9bf02f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e90c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:35.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.058+0000 7fd9bf02f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e21e777db0 con 0x55e21e7d9b50 2023-12-07T21:09:35.057 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.059+0000 7fd9ba22e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e90c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.059+0000 7fd9ba22e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e90c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45258/0 (socket says 172.21.15.121:45258) 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.059+0000 7fd9ba22e640 1 -- 172.21.15.121:0/1526182385 learned_addr learned my addr 172.21.15.121:0/1526182385 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.059+0000 7fd9ba22e640 1 -- 172.21.15.121:0/1526182385 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac005d20 con 0x55e21e7d9b50 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.059+0000 7fd9ba22e640 1 --2- 172.21.15.121:0/1526182385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e90c030 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac055040 tx=0x7fd9ac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b4361607c7acf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.059+0000 7fd9b922c640 1 -- 172.21.15.121:0/1526182385 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9ac00a180 con 0x55e21e7d9b50 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.059+0000 7fd9b922c640 1 -- 172.21.15.121:0/1526182385 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac00a2e0 con 0x55e21e7d9b50 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.059+0000 7fd9b922c640 1 -- 172.21.15.121:0/1526182385 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9ac0529b0 con 0x55e21e7d9b50 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.059+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1526182385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 msgr2=0x55e21e90c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.059+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/1526182385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e90c030 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac055040 tx=0x7fd9ac04c000 comp rx=0 tx=0).stop 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1526182385 shutdown_connections 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/1526182385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e90c030 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1526182385 >> 172.21.15.121:0/1526182385 conn(0x55e21e85f880 msgr2=0x55e21e907ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1526182385 shutdown_connections 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1526182385 wait complete. 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9bf02f800 1 Processor -- start 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9bf02f800 1 -- start start 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9bf02f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e913460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9bf02f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e21e7736a0 con 0x55e21e7d9b50 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9ba22e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e913460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9ba22e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e913460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45262/0 (socket says 172.21.15.121:45262) 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.060+0000 7fd9ba22e640 1 -- 172.21.15.121:0/1818837537 learned_addr learned my addr 172.21.15.121:0/1818837537 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.061+0000 7fd9ba22e640 1 -- 172.21.15.121:0/1818837537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e21e86f260 con 0x55e21e7d9b50 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.061+0000 7fd9ba22e640 1 --2- 172.21.15.121:0/1818837537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e913460 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac05e040 tx=0x7fd9ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:35.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.061+0000 7fd9b3fff640 1 -- 172.21.15.121:0/1818837537 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9ac06a070 con 0x55e21e7d9b50 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.061+0000 7fd9b3fff640 1 -- 172.21.15.121:0/1818837537 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac06f420 con 0x55e21e7d9b50 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.061+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1818837537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e21e9139a0 con 0x55e21e7d9b50 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.061+0000 7fd9b3fff640 1 -- 172.21.15.121:0/1818837537 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9ac06f6c0 con 0x55e21e7d9b50 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.061+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1818837537 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e21e913ee0 con 0x55e21e7d9b50 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9bf02f800 1 Processor -- start 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9bf02f800 1 -- start start 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9bf02f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 0x55e21e91f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9bf02f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e21e70d890 con 0x55e21e91f5b0 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9b3fff640 1 -- 172.21.15.121:0/1818837537 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fd9ac059030 con 0x55e21e7d9b50 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9baa2f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 0x55e21e91f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9baa2f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 0x55e21e91f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45268/0 (socket says 172.21.15.121:45268) 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9baa2f640 1 -- 172.21.15.121:0/3037014431 learned_addr learned my addr 172.21.15.121:0/3037014431 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:35.060 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9b3fff640 1 --2- 172.21.15.121:0/1818837537 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd99c0360c0 0x7fd99c038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9b3fff640 1 -- 172.21.15.121:0/1818837537 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fd9ac08d1f0 con 0x55e21e7d9b50 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9ba22e640 1 --2- 172.21.15.121:0/1818837537 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd99c0360c0 0x7fd99c038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9baa2f640 1 -- 172.21.15.121:0/3037014431 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e21e91ff10 con 0x55e21e91f5b0 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.062+0000 7fd9baa2f640 1 --2- 172.21.15.121:0/3037014431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 0x55e21e91f9d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400a430 tx=0x7fd9b400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295575f0ae0ed6b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9ba22e640 1 --2- 172.21.15.121:0/1818837537 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd99c0360c0 0x7fd99c038580 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac05cfd0 tx=0x7fd9ac009ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9b122c640 1 -- 172.21.15.121:0/3037014431 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9b4001650 con 0x55e21e91f5b0 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9b122c640 1 -- 172.21.15.121:0/3037014431 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b40017d0 con 0x55e21e91f5b0 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9b122c640 1 -- 172.21.15.121:0/3037014431 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9b4001ab0 con 0x55e21e91f5b0 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9bf02f800 1 -- 172.21.15.121:0/3037014431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 msgr2=0x55e21e91f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/3037014431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 0x55e21e91f9d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400a430 tx=0x7fd9b400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9bf02f800 1 -- 172.21.15.121:0/3037014431 shutdown_connections 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/3037014431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 0x55e21e91f9d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9bf02f800 1 -- 172.21.15.121:0/3037014431 >> 172.21.15.121:0/3037014431 conn(0x55e21e86a740 msgr2=0x55e21e91a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9bf02f800 1 -- 172.21.15.121:0/3037014431 shutdown_connections 2023-12-07T21:09:35.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9bf02f800 1 -- 172.21.15.121:0/3037014431 wait complete. 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9bf02f800 1 Processor -- start 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9bf02f800 1 -- start start 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9bf02f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 0x55e21e926670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.063+0000 7fd9bf02f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e21e70d530 con 0x55e21e91f5b0 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.064+0000 7fd9baa2f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 0x55e21e926670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.064+0000 7fd9baa2f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 0x55e21e926670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:45274/0 (socket says 172.21.15.121:45274) 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.064+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 learned_addr learned my addr 172.21.15.121:0/2915173097 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.064+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b400a0e0 con 0x55e21e91f5b0 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.064+0000 7fd9baa2f640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 0x55e21e926670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400a930 tx=0x7fd9b4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.064+0000 7fd99b7fe640 1 -- 172.21.15.121:0/2915173097 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9b4010900 con 0x55e21e91f5b0 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.064+0000 7fd99b7fe640 1 -- 172.21.15.121:0/2915173097 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b4010a60 con 0x55e21e91f5b0 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.064+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e21e926bb0 con 0x55e21e91f5b0 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.064+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e21e927010 con 0x55e21e91f5b0 2023-12-07T21:09:35.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.064+0000 7fd99b7fe640 1 -- 172.21.15.121:0/2915173097 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9b4010d00 con 0x55e21e91f5b0 2023-12-07T21:09:35.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.065+0000 7fd99b7fe640 1 -- 172.21.15.121:0/2915173097 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fd9b4017030 con 0x55e21e91f5b0 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.065+0000 7fd99b7fe640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd9940360c0 0x7fd994038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.065+0000 7fd99b7fe640 1 -- 172.21.15.121:0/2915173097 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fd9b404b900 con 0x55e21e91f5b0 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.065+0000 7fd9b1a2d640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd9940360c0 0x7fd994038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.066+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.066+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e21e931d70 0x55e21e934230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.066+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e21e934980 con 0x55e21e931d70 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.066+0000 7fd9b1a2d640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd9940360c0 0x7fd994038580 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4000f60 tx=0x7fd9a4001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.066+0000 7fd9baa2f640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e21e931d70 0x55e21e934230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.066+0000 7fd9baa2f640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e21e931d70 0x55e21e934230 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.066+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.066+0000 7fd9bf02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.066+0000 7fd9bf02f800 20 realm 2023-12-07T21:09:35.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.066+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.066+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e21e934d90 con 0x55e21e931d70 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e21e935610 con 0x55e21e931d70 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e21e935970 con 0x55e21e931d70 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e21e936170 con 0x55e21e931d70 2023-12-07T21:09:35.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:35.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 20 searching for the correct realm 2023-12-07T21:09:35.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e21e937e90 0x55e21e93a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:35.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.067+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e21e93a9f0 con 0x55e21e937e90 2023-12-07T21:09:35.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.068+0000 7fd9ba22e640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e21e937e90 0x55e21e93a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:35.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.068+0000 7fd9ba22e640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e21e937e90 0x55e21e93a320 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:35.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.952+0000 7fd99b7fe640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_map(33..33 src has 1..33) v4 ==== 312+0+0 (crc 0 0 0) 0x7fd9ac064890 con 0x55e21e937e90 2023-12-07T21:09:35.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.953+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.953+0000 7fd9ba22e640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd9ac05bb90 0x7fd9ac06f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:35.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.953+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93a9f0 con 0x7fd9ac05bb90 2023-12-07T21:09:35.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.953+0000 7fd9b1a2d640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd9ac05bb90 0x7fd9ac06f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:35.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.954+0000 7fd9b1a2d640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd9ac05bb90 0x7fd9ac06f820 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:35.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.954+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9a4006070 con 0x7fd9ac05bb90 2023-12-07T21:09:35.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.954+0000 7fd9b1a2d640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd9a400d3d0 0x7fd9a400d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:35.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.954+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93a9f0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.954+0000 7fd9baa2f640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd9a400d3d0 0x7fd9a400d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:35.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.955+0000 7fd9baa2f640 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd9a400d3d0 0x7fd9a400d830 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:35.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.955+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.955+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93a9f0 con 0x55e21e931d70 2023-12-07T21:09:35.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.955+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.955+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93a9f0 con 0x55e21e931d70 2023-12-07T21:09:35.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.956+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.956+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93a9f0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.956+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.956+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93a9f0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.956+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.956+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93a9f0 con 0x7fd9ac05bb90 2023-12-07T21:09:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.957+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9a4006070 con 0x7fd9ac05bb90 2023-12-07T21:09:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.957+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93a9f0 con 0x55e21e937e90 2023-12-07T21:09:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.957+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.957+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93a9f0 con 0x55e21e931d70 2023-12-07T21:09:35.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.957+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.957+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.958+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.958+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x55e21e931d70 2023-12-07T21:09:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.958+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.958+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x7fd9ac05bb90 2023-12-07T21:09:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.958+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd9a4006070 con 0x7fd9ac05bb90 2023-12-07T21:09:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.959+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x55e21e937e90 2023-12-07T21:09:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.959+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.959+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x55e21e937e90 2023-12-07T21:09:35.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.959+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.959+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.960+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.960+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x55e21e937e90 2023-12-07T21:09:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.960+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.960+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x55e21e937e90 2023-12-07T21:09:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.960+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.960+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x55e21e931d70 2023-12-07T21:09:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.961+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.961+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x55e21e931d70 2023-12-07T21:09:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.961+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.961+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.961+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.961+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x55e21e937e90 2023-12-07T21:09:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.962+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.962+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x7fd9ac05bb90 2023-12-07T21:09:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.962+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9a4006070 con 0x7fd9ac05bb90 2023-12-07T21:09:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.962+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x55e21e931d70 2023-12-07T21:09:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.962+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.962+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.963+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.963+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x55e21e937e90 2023-12-07T21:09:35.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.963+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.963+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b404bca0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.963+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.963+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b4053040 con 0x7fd9ac05bb90 2023-12-07T21:09:35.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.964+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9a4006070 con 0x7fd9ac05bb90 2023-12-07T21:09:35.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.964+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b4053040 con 0x55e21e937e90 2023-12-07T21:09:35.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.964+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.964+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b4053040 con 0x7fd9a400d3d0 2023-12-07T21:09:35.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.964+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.964+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b4053040 con 0x55e21e931d70 2023-12-07T21:09:35.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd9b4053040 con 0x7fd9ac05bb90 2023-12-07T21:09:35.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd9a4006070 con 0x7fd9ac05bb90 2023-12-07T21:09:35.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9bf02f800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:35.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9bf02f800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:35.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9bf02f800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:35.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9bf02f800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:35.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9bf02f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:35.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9bf02f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:35.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:35.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e936ad0 con 0x55e21e931d70 2023-12-07T21:09:35.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9bf02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:35.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:35.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.965+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e936e80 con 0x55e21e931d70 2023-12-07T21:09:35.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:35.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:35.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e936e80 con 0x55e21e937e90 2023-12-07T21:09:35.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 20 zone default found 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 4 Realm: () 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 20 zonegroup default 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.966+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93ae30 con 0x7fd9a400d3d0 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.967+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.967+0000 7fd9bf02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:35.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.967+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.967+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93c810 con 0x55e21e937e90 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.967+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.967+0000 7fd9bf02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.967+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.967+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93cb70 con 0x55e21e937e90 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.967+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.968+0000 7fd9bf02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.968+0000 7fd9bf02f800 20 started sync module instance, tier type = 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.968+0000 7fd9bf02f800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.968+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e9374e0 con 0x7fd9ac05bb90 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.969+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9a4006070 con 0x7fd9ac05bb90 2023-12-07T21:09:35.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.969+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94429661548368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93bc90 con 0x7fd9ac05bb90 2023-12-07T21:09:35.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.969+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93d410 con 0x55e21e931d70 2023-12-07T21:09:35.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.970+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94429661548368] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9a4006070 con 0x7fd9ac05bb90 2023-12-07T21:09:35.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.970+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.970+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94429663969648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93d410 con 0x55e21e931d70 2023-12-07T21:09:35.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.970+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93deb0 con 0x55e21e937e90 2023-12-07T21:09:35.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.972+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94429663969648] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.972+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(48 notify.2 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.972+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94429663973232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93d380 con 0x55e21e937e90 2023-12-07T21:09:35.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.972+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93ebe0 con 0x7fd9ac05bb90 2023-12-07T21:09:35.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.973+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(49 notify.2 [watch watch cookie 94429663973232] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.973+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.973+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94429663978352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93f430 con 0x7fd9ac05bb90 2023-12-07T21:09:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.973+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93fc30 con 0x55e21e931d70 2023-12-07T21:09:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.975+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.975+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94429663983808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e940480 con 0x55e21e931d70 2023-12-07T21:09:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.975+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e940e30 con 0x7fd9a400d3d0 2023-12-07T21:09:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.975+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94429663978352] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.976+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.976+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94429663981456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e940df0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.976+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94429663983808] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.976+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e9417f0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.977+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94429663981456] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.977+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.977+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94429663988048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e9400c0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.977+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e940d60 con 0x7fd9a400d3d0 2023-12-07T21:09:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.978+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94429663988048] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.978+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.978+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94429663990608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e941c00 con 0x7fd9a400d3d0 2023-12-07T21:09:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.978+0000 7fd9bf02f800 20 add_watcher() i=0 2023-12-07T21:09:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.978+0000 7fd9bf02f800 20 add_watcher() i=1 2023-12-07T21:09:35.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.978+0000 7fd9bf02f800 20 add_watcher() i=2 2023-12-07T21:09:35.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.978+0000 7fd9bf02f800 20 add_watcher() i=3 2023-12-07T21:09:35.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.978+0000 7fd9bf02f800 20 add_watcher() i=4 2023-12-07T21:09:35.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.978+0000 7fd9bf02f800 20 add_watcher() i=5 2023-12-07T21:09:35.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.978+0000 7fd9bf02f800 20 add_watcher() i=6 2023-12-07T21:09:35.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.979+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94429663990608] v33'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.979+0000 7fd9bf02f800 20 add_watcher() i=7 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.979+0000 7fd9bf02f800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.979+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e944e10 con 0x55e21e931d70 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.980+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.980+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94429663992016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e942180 con 0x55e21e931d70 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.981+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94429663992016] v33'173 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.981+0000 7fd97b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.981+0000 7fd9bf02f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.981+0000 7fd9bf02f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.982+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e9443f0 con 0x55e21e931d70 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.983+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.983+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e944810 con 0x7fd9a400d3d0 2023-12-07T21:09:35.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.984+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.984+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94de10 con 0x55e21e937e90 2023-12-07T21:09:35.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.985+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'24 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.986+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94e7e0 con 0x55e21e931d70 2023-12-07T21:09:35.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.987+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'174 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.987+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94d4a0 con 0x7fd9ac05bb90 2023-12-07T21:09:35.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.988+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'59 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:35.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.988+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94f350 con 0x55e21e937e90 2023-12-07T21:09:35.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.989+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.989+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94fb50 con 0x55e21e931d70 2023-12-07T21:09:35.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.990+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.990+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94fb50 con 0x7fd9a400d3d0 2023-12-07T21:09:35.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.992+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.992+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94fb50 con 0x7fd9ac05bb90 2023-12-07T21:09:35.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.993+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:35.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.993+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950350 con 0x55e21e937e90 2023-12-07T21:09:35.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.994+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.994+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950880 con 0x7fd9ac05bb90 2023-12-07T21:09:35.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.995+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'60 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:35.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.995+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950880 con 0x7fd9a400d3d0 2023-12-07T21:09:35.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.996+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.996+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950880 con 0x7fd9ac05bb90 2023-12-07T21:09:35.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.997+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:35.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.997+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.998+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'47 uv44 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:35.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:35.999+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x55e21e931d70 2023-12-07T21:09:35.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.000+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'175 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.000+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x55e21e937e90 2023-12-07T21:09:35.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.001+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'53 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.001+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x7fd9ac05bb90 2023-12-07T21:09:35.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.002+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'61 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:35.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.002+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x55e21e937e90 2023-12-07T21:09:35.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.003+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.003+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x55e21e931d70 2023-12-07T21:09:35.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.004+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.004+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x55e21e931d70 2023-12-07T21:09:35.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.005+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'176 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:35.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.005+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x55e21e937e90 2023-12-07T21:09:35.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.007+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'54 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:35.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.007+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x7fd9ac05bb90 2023-12-07T21:09:36.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.008+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'33 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:36.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.008+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x55e21e937e90 2023-12-07T21:09:36.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.009+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:36.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.009+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x55e21e937e90 2023-12-07T21:09:36.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.010+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:36.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.010+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x55e21e937e90 2023-12-07T21:09:36.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.011+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'19 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:36.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.011+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x55e21e937e90 2023-12-07T21:09:36.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.012+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:36.005 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.012+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x7fd9a400d3d0 2023-12-07T21:09:36.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.013+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'26 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:36.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.013+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e950fa0 con 0x55e21e937e90 2023-12-07T21:09:36.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.014+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:36.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.014+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e951340 con 0x7fd9a400d3d0 2023-12-07T21:09:36.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.015+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:36.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.015+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e951340 con 0x55e21e937e90 2023-12-07T21:09:36.009 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.017+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'55 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:36.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.017+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e951340 con 0x7fd9a400d3d0 2023-12-07T21:09:36.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.018+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'48 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:36.010 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.018+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e951340 con 0x7fd9ac05bb90 2023-12-07T21:09:36.011 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.019+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:36.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.019+0000 7fd97a7fc640 20 reqs_thread_entry: start 2023-12-07T21:09:36.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.019+0000 7fd9bf02f800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:36.013 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.019+0000 7fd9bf02f800 20 Filter name: none 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.019+0000 7fd8ebfff640 20 reqs_thread_entry: start 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.019+0000 7fd9bf02f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.020+0000 7fd9bf02f800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.020+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e97bee0 con 0x55e21e931d70 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.020+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.020+0000 7fd9bf02f800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.020+0000 7fd9bf02f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.020+0000 7fd9bf02f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.020+0000 7fd9bf02f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.020+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e97b970 con 0x7fd9ac05bb90 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.020+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv31 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:36.014 INFO:teuthology.orchestra.run.smithi121.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2023-12-07T21:09:36.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.021+0000 7fd97b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.021+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94429663992016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94e7e0 con 0x55e21e931d70 2023-12-07T21:09:36.015 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.023+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94429663992016] v33'177 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:36.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.023+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94429661548368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94e7e0 con 0x7fd9ac05bb90 2023-12-07T21:09:36.016 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.024+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94429661548368] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:36.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.024+0000 7fd9bf02f800 20 remove_watcher() i=0 2023-12-07T21:09:36.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.024+0000 7fd9bf02f800 2 removed watcher, disabling cache 2023-12-07T21:09:36.017 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.024+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94429663969648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94e7e0 con 0x55e21e931d70 2023-12-07T21:09:36.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.025+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94429663969648] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:36.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.025+0000 7fd9bf02f800 20 remove_watcher() i=1 2023-12-07T21:09:36.018 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.025+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94429663973232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94e7e0 con 0x55e21e937e90 2023-12-07T21:09:36.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.026+0000 7fd9ba22e640 1 -- 172.21.15.121:0/2915173097 <== osd.3 v2:172.21.15.121:6800/4032235766 28 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94429663973232] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9ac08b230 con 0x55e21e937e90 2023-12-07T21:09:36.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.026+0000 7fd9bf02f800 20 remove_watcher() i=2 2023-12-07T21:09:36.019 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.026+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94429663978352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94e7e0 con 0x7fd9ac05bb90 2023-12-07T21:09:36.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.027+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94429663978352] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9a4026040 con 0x7fd9ac05bb90 2023-12-07T21:09:36.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.027+0000 7fd9bf02f800 20 remove_watcher() i=3 2023-12-07T21:09:36.020 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.027+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94429663983808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e94e7e0 con 0x55e21e931d70 2023-12-07T21:09:36.021 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.029+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94429663983808] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x55e21e931d70 2023-12-07T21:09:36.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.029+0000 7fd9bf02f800 20 remove_watcher() i=4 2023-12-07T21:09:36.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.029+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94429663981456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93f8a0 con 0x7fd9a400d3d0 2023-12-07T21:09:36.022 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.030+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94429663981456] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:36.023 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.030+0000 7fd9bf02f800 20 remove_watcher() i=5 2023-12-07T21:09:36.023 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.030+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94429663988048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93ef90 con 0x7fd9a400d3d0 2023-12-07T21:09:36.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.031+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94429663988048] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:36.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.031+0000 7fd9bf02f800 20 remove_watcher() i=6 2023-12-07T21:09:36.024 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.031+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94429663990608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e21e93ef90 con 0x7fd9a400d3d0 2023-12-07T21:09:36.026 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9baa2f640 1 -- 172.21.15.121:0/2915173097 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94429663990608] v33'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd9b402e9d0 con 0x7fd9a400d3d0 2023-12-07T21:09:36.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 20 remove_watcher() i=7 2023-12-07T21:09:36.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd9a400d3d0 msgr2=0x7fd9a400d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd9a400d3d0 0x7fd9a400d830 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e21e931d70 msgr2=0x55e21e934230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e21e931d70 0x55e21e934230 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd9ac05bb90 msgr2=0x7fd9ac06f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd9ac05bb90 0x7fd9ac06f820 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e21e937e90 msgr2=0x55e21e93a320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e21e937e90 0x55e21e93a320 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd9940360c0 msgr2=0x7fd994038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.027 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd9940360c0 0x7fd994038580 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4000f60 tx=0x7fd9a4001230 comp rx=0 tx=0).stop 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 msgr2=0x55e21e926670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/2915173097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e91f5b0 0x55e21e926670 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400a930 tx=0x7fd9b4003370 comp rx=0 tx=0).stop 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 reap_dead start 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9b1a2d640 1 -- 172.21.15.121:0/2915173097 reap_dead start 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 shutdown_connections 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 >> 172.21.15.121:0/2915173097 conn(0x55e21e86a740 msgr2=0x55e21e919790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 shutdown_connections 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.032+0000 7fd9bf02f800 1 -- 172.21.15.121:0/2915173097 wait complete. 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.033+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1818837537 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd99c0360c0 msgr2=0x7fd99c038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.033+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/1818837537 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd99c0360c0 0x7fd99c038580 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac05cfd0 tx=0x7fd9ac009ef0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.033+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1818837537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 msgr2=0x55e21e913460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.028 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.033+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/1818837537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e913460 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac05e040 tx=0x7fd9ac002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.033+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1818837537 shutdown_connections 2023-12-07T21:09:36.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.033+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/1818837537 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd99c0360c0 0x7fd99c038580 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.033+0000 7fd9bf02f800 1 --2- 172.21.15.121:0/1818837537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e21e7d9b50 0x55e21e913460 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.033+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1818837537 >> 172.21.15.121:0/1818837537 conn(0x55e21e85f880 msgr2=0x55e21e90ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.033+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1818837537 shutdown_connections 2023-12-07T21:09:36.029 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.033+0000 7fd9bf02f800 1 -- 172.21.15.121:0/1818837537 wait complete. 2023-12-07T21:09:36.030 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-12-07T21:09:36.038 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2023-12-07T21:09:36.043 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:36.072 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:36.083 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:36.126 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2023-12-07T21:09:36.131 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:36.131 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-12-07T21:09:36.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-12-07T21:09:36.131 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2023-12-07T21:09:36.174 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:36.174 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.182+0000 7f384828c800 1 Processor -- start 2023-12-07T21:09:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.182+0000 7f384828c800 1 -- start start 2023-12-07T21:09:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.183+0000 7f384828c800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5612fcdcf6e0 0x5612fcdcfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.183+0000 7f384828c800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5612fcd1b740 con 0x5612fcdce3a0 2023-12-07T21:09:36.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.183+0000 7f384828c800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5612fcce4880 con 0x5612fcdcf6e0 2023-12-07T21:09:36.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.183+0000 7f3845d8c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5612fcdcf6e0 0x5612fcdcfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.183+0000 7f3845d8c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5612fcdcf6e0 0x5612fcdcfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54634/0 (socket says 172.21.15.121:54634) 2023-12-07T21:09:36.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.183+0000 7f3845d8c640 1 -- 172.21.15.121:0/616662047 learned_addr learned my addr 172.21.15.121:0/616662047 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.183+0000 7f383ffff640 1 --1- 172.21.15.121:0/616662047 >> v1:172.21.15.89:6789/0 conn(0x5612fcdce3a0 0x5612fcdce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:38068/0 (socket says 172.21.15.121:38068) 2023-12-07T21:09:36.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.183+0000 7f3845d8c640 1 -- 172.21.15.121:0/616662047 >> v1:172.21.15.89:6789/0 conn(0x5612fcdce3a0 legacy=0x5612fcdce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.183+0000 7f3845d8c640 1 -- 172.21.15.121:0/616662047 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612fcdd01d0 con 0x5612fcdcf6e0 2023-12-07T21:09:36.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.185+0000 7f3845d8c640 1 --2- 172.21.15.121:0/616662047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdcf6e0 0x5612fcdcfb00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f383800a520 tx=0x7f383801cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fb14cfb4532d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.185+0000 7f384558b640 1 -- 172.21.15.121:0/616662047 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3838052570 con 0x5612fcdcf6e0 2023-12-07T21:09:36.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.185+0000 7f384558b640 1 -- 172.21.15.121:0/616662047 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38380526d0 con 0x5612fcdcf6e0 2023-12-07T21:09:36.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.185+0000 7f384558b640 1 -- 172.21.15.121:0/616662047 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3838052990 con 0x5612fcdcf6e0 2023-12-07T21:09:36.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.186+0000 7f384828c800 1 -- 172.21.15.121:0/616662047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdcf6e0 msgr2=0x5612fcdcfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.186+0000 7f384828c800 1 --2- 172.21.15.121:0/616662047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdcf6e0 0x5612fcdcfb00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f383800a520 tx=0x7f383801cd00 comp rx=0 tx=0).stop 2023-12-07T21:09:36.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.186+0000 7f384828c800 1 -- 172.21.15.121:0/616662047 shutdown_connections 2023-12-07T21:09:36.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.186+0000 7f384828c800 1 --2- 172.21.15.121:0/616662047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdcf6e0 0x5612fcdcfb00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.186+0000 7f384828c800 1 -- 172.21.15.121:0/616662047 >> 172.21.15.121:0/616662047 conn(0x5612fcdc8f70 msgr2=0x5612fcdcb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.186+0000 7f384828c800 1 -- 172.21.15.121:0/616662047 shutdown_connections 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.186+0000 7f384828c800 1 -- 172.21.15.121:0/616662047 wait complete. 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.186+0000 7f384828c800 1 Processor -- start 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.186+0000 7f384828c800 1 -- start start 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.187+0000 7f384828c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce6ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.187+0000 7f384828c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612fcce1db0 con 0x5612fcdce3a0 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.187+0000 7f3845d8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce6ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.187+0000 7f3845d8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce6ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54638/0 (socket says 172.21.15.121:54638) 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.187+0000 7f3845d8c640 1 -- 172.21.15.121:0/2571983362 learned_addr learned my addr 172.21.15.121:0/2571983362 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.187+0000 7f3845d8c640 1 -- 172.21.15.121:0/2571983362 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3838005de0 con 0x5612fcdce3a0 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.187+0000 7f3845d8c640 1 --2- 172.21.15.121:0/2571983362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce6ffb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f383801cd40 tx=0x7f383804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bd61475d887aba server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.187+0000 7f3844d8a640 1 -- 172.21.15.121:0/2571983362 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3838052840 con 0x5612fcdce3a0 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.187+0000 7f3844d8a640 1 -- 172.21.15.121:0/2571983362 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38380529a0 con 0x5612fcdce3a0 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.187+0000 7f3844d8a640 1 -- 172.21.15.121:0/2571983362 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3838052c60 con 0x5612fcdce3a0 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.188+0000 7f384828c800 1 -- 172.21.15.121:0/2571983362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 msgr2=0x5612fce6ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.188+0000 7f384828c800 1 --2- 172.21.15.121:0/2571983362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce6ffb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f383801cd40 tx=0x7f383804c000 comp rx=0 tx=0).stop 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.188+0000 7f384828c800 1 -- 172.21.15.121:0/2571983362 shutdown_connections 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.188+0000 7f384828c800 1 --2- 172.21.15.121:0/2571983362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce6ffb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.188+0000 7f384828c800 1 -- 172.21.15.121:0/2571983362 >> 172.21.15.121:0/2571983362 conn(0x5612fcdc8f70 msgr2=0x5612fce729f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.188+0000 7f384828c800 1 -- 172.21.15.121:0/2571983362 shutdown_connections 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.188+0000 7f384828c800 1 -- 172.21.15.121:0/2571983362 wait complete. 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.188+0000 7f384828c800 1 Processor -- start 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.188+0000 7f384828c800 1 -- start start 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.188+0000 7f384828c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce7d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.188+0000 7f384828c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612fccdd6a0 con 0x5612fcdce3a0 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.189+0000 7f3845d8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce7d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.189+0000 7f3845d8c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce7d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54650/0 (socket says 172.21.15.121:54650) 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.189+0000 7f3845d8c640 1 -- 172.21.15.121:0/1315583356 learned_addr learned my addr 172.21.15.121:0/1315583356 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.189+0000 7f3845d8c640 1 -- 172.21.15.121:0/1315583356 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612fcdd01d0 con 0x5612fcdce3a0 2023-12-07T21:09:36.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.189+0000 7f3845d8c640 1 --2- 172.21.15.121:0/1315583356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce7d8a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3838005930 tx=0x7f3838002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.189+0000 7f383effd640 1 -- 172.21.15.121:0/1315583356 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f383806a070 con 0x5612fcdce3a0 2023-12-07T21:09:36.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.189+0000 7f383effd640 1 -- 172.21.15.121:0/1315583356 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3838065450 con 0x5612fcdce3a0 2023-12-07T21:09:36.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.189+0000 7f384828c800 1 -- 172.21.15.121:0/1315583356 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612fce7dde0 con 0x5612fcdce3a0 2023-12-07T21:09:36.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.189+0000 7f383effd640 1 -- 172.21.15.121:0/1315583356 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3838065730 con 0x5612fcdce3a0 2023-12-07T21:09:36.185 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.189+0000 7f384828c800 1 -- 172.21.15.121:0/1315583356 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612fce7e320 con 0x5612fcdce3a0 2023-12-07T21:09:36.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f384828c800 1 Processor -- start 2023-12-07T21:09:36.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f384828c800 1 -- start start 2023-12-07T21:09:36.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f384828c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 0x5612fce89f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f384828c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612fcc77890 con 0x5612fce89b10 2023-12-07T21:09:36.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f383effd640 1 -- 172.21.15.121:0/1315583356 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3838059070 con 0x5612fcdce3a0 2023-12-07T21:09:36.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f384658d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 0x5612fce89f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f384658d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 0x5612fce89f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54660/0 (socket says 172.21.15.121:54660) 2023-12-07T21:09:36.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f384658d640 1 -- 172.21.15.121:0/787364585 learned_addr learned my addr 172.21.15.121:0/787364585 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.202 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f383effd640 1 --2- 172.21.15.121:0/1315583356 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3828036110 0x7f38280385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f383effd640 1 -- 172.21.15.121:0/1315583356 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f383808cfb0 con 0x5612fcdce3a0 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f3845d8c640 1 --2- 172.21.15.121:0/1315583356 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3828036110 0x7f38280385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.190+0000 7f384658d640 1 -- 172.21.15.121:0/787364585 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612fce8a470 con 0x5612fce89b10 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f384658d640 1 --2- 172.21.15.121:0/787364585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 0x5612fce89f30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f384000a430 tx=0x7f384000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac83e56cdc89d6a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f3845d8c640 1 --2- 172.21.15.121:0/1315583356 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3828036110 0x7f38280385d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f383801cd20 tx=0x7f383805c490 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f383cff9640 1 -- 172.21.15.121:0/787364585 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3840001650 con 0x5612fce89b10 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f383cff9640 1 -- 172.21.15.121:0/787364585 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38400017d0 con 0x5612fce89b10 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f383cff9640 1 -- 172.21.15.121:0/787364585 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3840001ab0 con 0x5612fce89b10 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f384828c800 1 -- 172.21.15.121:0/787364585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 msgr2=0x5612fce89f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f384828c800 1 --2- 172.21.15.121:0/787364585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 0x5612fce89f30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f384000a430 tx=0x7f384000a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f384828c800 1 -- 172.21.15.121:0/787364585 shutdown_connections 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f384828c800 1 --2- 172.21.15.121:0/787364585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 0x5612fce89f30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f384828c800 1 -- 172.21.15.121:0/787364585 >> 172.21.15.121:0/787364585 conn(0x5612fcdcf6e0 msgr2=0x5612fce84ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f384828c800 1 -- 172.21.15.121:0/787364585 shutdown_connections 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.191+0000 7f384828c800 1 -- 172.21.15.121:0/787364585 wait complete. 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.192+0000 7f384828c800 1 Processor -- start 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.192+0000 7f384828c800 1 -- start start 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.192+0000 7f384828c800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 0x5612fce90b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.192+0000 7f384828c800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612fcc77530 con 0x5612fce89b10 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.192+0000 7f384658d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 0x5612fce90b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.192+0000 7f384658d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 0x5612fce90b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54662/0 (socket says 172.21.15.121:54662) 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.192+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 learned_addr learned my addr 172.21.15.121:0/3133085709 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.192+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384000a0e0 con 0x5612fce89b10 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.192+0000 7f384658d640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 0x5612fce90b50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f384000a930 tx=0x7f3840003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.193+0000 7f3826ffd640 1 -- 172.21.15.121:0/3133085709 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3840010900 con 0x5612fce89b10 2023-12-07T21:09:36.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.193+0000 7f3826ffd640 1 -- 172.21.15.121:0/3133085709 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3840010a60 con 0x5612fce89b10 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.193+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5612fce91090 con 0x5612fce89b10 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.193+0000 7f3826ffd640 1 -- 172.21.15.121:0/3133085709 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3840010d20 con 0x5612fce89b10 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.193+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612fce914f0 con 0x5612fce89b10 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.193+0000 7f3826ffd640 1 -- 172.21.15.121:0/3133085709 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3840017030 con 0x5612fce89b10 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.194+0000 7f3826ffd640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3820036110 0x7f38200385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.194+0000 7f3826ffd640 1 -- 172.21.15.121:0/3133085709 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f384004b8a0 con 0x5612fce89b10 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.194+0000 7f383ffff640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3820036110 0x7f38200385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.194+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.194+0000 7f384828c800 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5612fce9c230 0x5612fce9e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.194+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fce9ee40 con 0x5612fce9c230 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.194+0000 7f383ffff640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3820036110 0x7f38200385d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3830000f60 tx=0x7f38300012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.194+0000 7f384658d640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5612fce9c230 0x5612fce9e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.194+0000 7f384658d640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5612fce9c230 0x5612fce9e6f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 20 realm 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fce9f250 con 0x5612fce9c230 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fce9fad0 con 0x5612fce9c230 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fce9fe30 con 0x5612fce9c230 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.195+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea0630 con 0x5612fce9c230 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.196+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.196+0000 7f384828c800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.196+0000 7f384828c800 20 searching for the correct realm 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.196+0000 7f384828c800 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5612fcea2350 0x5612fcea47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.196+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fcea2350 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.196+0000 7f3845d8c640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5612fcea2350 0x5612fcea47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.196+0000 7f3845d8c640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5612fcea2350 0x5612fcea47e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.196+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.196+0000 7f3845d8c640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3838065070 0x7f38380790b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.196+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f3838065070 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.196+0000 7f383ffff640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3838065070 0x7f38380790b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.197+0000 7f383ffff640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3838065070 0x7f38380790b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.197+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.197+0000 7f383ffff640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f383000f070 0x7f383000e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.197+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f383000f070 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.197+0000 7f384658d640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f383000f070 0x7f383000e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.198+0000 7f384658d640 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f383000f070 0x7f383000e8c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.198+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.198+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fce9c230 2023-12-07T21:09:36.208 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.198+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.198+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fce9c230 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.198+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.198+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f383000f070 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.199+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.199+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f383000f070 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.199+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.199+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f3838065070 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.199+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.199+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fcea2350 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.200+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.200+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fce9c230 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.200+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.209 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.200+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f383000f070 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.200+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.200+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fce9c230 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.200+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.200+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f3838065070 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.200+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.201+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fcea2350 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.201+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.201+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fcea2350 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.201+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.201+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f383000f070 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.201+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.201+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fcea2350 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.201+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.210 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.201+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fcea2350 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.202+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.202+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fce9c230 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.202+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.202+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fce9c230 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.202+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.202+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f383000f070 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.202+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.202+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fcea2350 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.203+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.203+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f3838065070 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.203+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.211 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.203+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fce9c230 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.203+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.203+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f383000f070 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.203+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.203+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fcea2350 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.204+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.204+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f383000f070 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.204+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.204+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f3838065070 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.204+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.204+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fcea2350 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.204+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.204+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x7f383000f070 2023-12-07T21:09:36.212 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea4eb0 con 0x5612fce9c230 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f3840053080 con 0x7f3838065070 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384828c800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384828c800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384828c800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384828c800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384828c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384828c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.213 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea0f90 con 0x5612fce9c230 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384828c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.205+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea17e0 con 0x5612fce9c230 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea17e0 con 0x5612fcea2350 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 20 zone default found 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 4 Realm: () 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:36.214 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 20 zonegroup default 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea5310 con 0x7f383000f070 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.206+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea70f0 con 0x5612fcea2350 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.207+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.207+0000 7f384828c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.207+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.207+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea7450 con 0x5612fcea2350 2023-12-07T21:09:36.215 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.207+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.207+0000 7f384828c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.207+0000 7f384828c800 20 started sync module instance, tier type = 2023-12-07T21:09:36.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.207+0000 7f384828c800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:36.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.207+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea69d0 con 0x7f3838065070 2023-12-07T21:09:36.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.208+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.208+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94639550197584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea6d80 con 0x7f3838065070 2023-12-07T21:09:36.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.208+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea7cf0 con 0x5612fce9c230 2023-12-07T21:09:36.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.209+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94639550197584] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.209+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.209+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94639552619824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea7cf0 con 0x5612fce9c230 2023-12-07T21:09:36.216 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.209+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea8720 con 0x5612fcea2350 2023-12-07T21:09:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.210+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94639552619824] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.210+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.210+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94639552624720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea7c60 con 0x5612fcea2350 2023-12-07T21:09:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.211+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea9440 con 0x7f3838065070 2023-12-07T21:09:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.212+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94639552624720] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.212+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.212+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94639552629808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea9c90 con 0x7f3838065070 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.212+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceaa4d0 con 0x5612fce9c230 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.213+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94639552629808] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.213+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.213+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94639552632816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceaa880 con 0x5612fce9c230 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.213+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceab1f0 con 0x7f383000f070 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.214+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.214+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94639552632816] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.214+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94639552638288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceab600 con 0x7f383000f070 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.214+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcea9ff0 con 0x7f383000f070 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.215+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94639552638288] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.216+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.216+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94639552639328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceab570 con 0x7f383000f070 2023-12-07T21:09:36.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.216+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceac410 con 0x7f383000f070 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.217+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94639552639328] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.217+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.217+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94639552641744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceac380 con 0x7f383000f070 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.217+0000 7f384828c800 20 add_watcher() i=0 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.217+0000 7f384828c800 20 add_watcher() i=1 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.217+0000 7f384828c800 20 add_watcher() i=2 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.217+0000 7f384828c800 20 add_watcher() i=3 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.217+0000 7f384828c800 20 add_watcher() i=4 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.217+0000 7f384828c800 20 add_watcher() i=5 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.217+0000 7f384828c800 20 add_watcher() i=6 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.218+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94639552641744] v33'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.218+0000 7f384828c800 20 add_watcher() i=7 2023-12-07T21:09:36.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.218+0000 7f384828c800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.218+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceaf660 con 0x5612fce9c230 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.218+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.218+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94639552643152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceac900 con 0x5612fce9c230 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.219+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94639552643152] v33'178 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.219+0000 7f380b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.219+0000 7f384828c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.219+0000 7f384828c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.219+0000 7f384828c800 5 note: GC not initialized 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f380a7e4640 20 reqs_thread_entry: start 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f384828c800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f384828c800 20 Filter name: none 2023-12-07T21:09:36.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f377bfff640 20 reqs_thread_entry: start 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f384828c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcee2cc0 con 0x7f3838065070 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f384828c800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f384828c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f384828c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f384828c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 : miss 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f384828c800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.220+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:919cbaa3:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcee48e0 con 0x7f3838065070 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(63 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv41 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f384828c800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f384828c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 info.flags=0x17 2023-12-07T21:09:36.230 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f384828c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 to cache LRU end 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f384828c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f384828c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f384828c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f384828c800 20 get_obj_state: octx=0x7f3830001810 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5612fcee70f8 s->prefetch_data=0 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 3.3ds0 3:bfbabe11:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcee81f0 con 0x5612fcea2350 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 262+0+864 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f384828c800 10 manifest: total_size = 5 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.221+0000 7f384828c800 20 get_obj_state: setting s->obj_tag to _Q9Z-rgzf4WCOAq75BTpv7PUJhfGimIO 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.222+0000 7f380b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.222+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94639552643152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceaf1a0 con 0x5612fce9c230 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.223+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94639552643152] v33'179 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.223+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94639550197584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceaf1a0 con 0x7f3838065070 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.224+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94639550197584] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.224+0000 7f384828c800 20 remove_watcher() i=0 2023-12-07T21:09:36.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.224+0000 7f384828c800 2 removed watcher, disabling cache 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.224+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94639552619824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcee7c30 con 0x5612fce9c230 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.225+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94639552619824] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.225+0000 7f384828c800 20 remove_watcher() i=1 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.225+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94639552624720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcee7c30 con 0x5612fcea2350 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.226+0000 7f3845d8c640 1 -- 172.21.15.121:0/3133085709 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94639552624720] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3838065910 con 0x5612fcea2350 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.226+0000 7f384828c800 20 remove_watcher() i=2 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.226+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94639552629808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcee4f20 con 0x7f3838065070 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.227+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94639552629808] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f383000f5f0 con 0x7f3838065070 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.227+0000 7f384828c800 20 remove_watcher() i=3 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.227+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94639552632816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcee4f20 con 0x5612fce9c230 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.228+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94639552632816] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x5612fce9c230 2023-12-07T21:09:36.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.228+0000 7f384828c800 20 remove_watcher() i=4 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.228+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94639552638288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcee4f20 con 0x7f383000f070 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.229+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94639552638288] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.229+0000 7f384828c800 20 remove_watcher() i=5 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.229+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94639552639328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fceaad50 con 0x7f383000f070 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.230+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94639552639328] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.230+0000 7f384828c800 20 remove_watcher() i=6 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.230+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94639552641744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5612fcee4f20 con 0x7f383000f070 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384658d640 1 -- 172.21.15.121:0/3133085709 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94639552641744] v33'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f384002e9d0 con 0x7f383000f070 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 20 remove_watcher() i=7 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f383000f070 msgr2=0x7f383000e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f383000f070 0x7f383000e8c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5612fce9c230 msgr2=0x5612fce9e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.233 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5612fce9c230 0x5612fce9e6f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3838065070 msgr2=0x7f38380790b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3838065070 0x7f38380790b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5612fcea2350 msgr2=0x5612fcea47e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5612fcea2350 0x5612fcea47e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3820036110 msgr2=0x7f38200385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3820036110 0x7f38200385d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3830000f60 tx=0x7f38300012f0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 msgr2=0x5612fce90b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 --2- 172.21.15.121:0/3133085709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fce89b10 0x5612fce90b50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f384000a930 tx=0x7f3840003370 comp rx=0 tx=0).stop 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 reap_dead start 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 shutdown_connections 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f383ffff640 1 -- 172.21.15.121:0/3133085709 reap_dead start 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 >> 172.21.15.121:0/3133085709 conn(0x5612fcdcf6e0 msgr2=0x5612fce83cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 shutdown_connections 2023-12-07T21:09:36.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.231+0000 7f384828c800 1 -- 172.21.15.121:0/3133085709 wait complete. 2023-12-07T21:09:36.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.232+0000 7f384828c800 1 -- 172.21.15.121:0/1315583356 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3828036110 msgr2=0x7f38280385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.232+0000 7f384828c800 1 --2- 172.21.15.121:0/1315583356 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3828036110 0x7f38280385d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f383801cd20 tx=0x7f383805c490 comp rx=0 tx=0).stop 2023-12-07T21:09:36.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.232+0000 7f384828c800 1 -- 172.21.15.121:0/1315583356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 msgr2=0x5612fce7d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.232+0000 7f384828c800 1 --2- 172.21.15.121:0/1315583356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce7d8a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3838005930 tx=0x7f3838002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.232+0000 7f384828c800 1 -- 172.21.15.121:0/1315583356 shutdown_connections 2023-12-07T21:09:36.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.232+0000 7f384828c800 1 --2- 172.21.15.121:0/1315583356 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3828036110 0x7f38280385d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.232+0000 7f384828c800 1 --2- 172.21.15.121:0/1315583356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5612fcdce3a0 0x5612fce7d8a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.232+0000 7f384828c800 1 -- 172.21.15.121:0/1315583356 >> 172.21.15.121:0/1315583356 conn(0x5612fcdc8f70 msgr2=0x5612fce6d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.232+0000 7f384828c800 1 -- 172.21.15.121:0/1315583356 shutdown_connections 2023-12-07T21:09:36.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.232+0000 7f384828c800 1 -- 172.21.15.121:0/1315583356 wait complete. 2023-12-07T21:09:36.236 INFO:teuthology.orchestra.run.smithi121.stdout:fooFoofooFooFULL_CONTROL 2023-12-07T21:09:36.236 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2023-12-07T21:09:36.238 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2023-12-07T21:09:36.243 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:36.243 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-12-07T21:09:36.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2023-12-07T21:09:36.243 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2023-12-07T21:09:36.286 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:36.286 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:36.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.294+0000 7f447b82d800 1 Processor -- start 2023-12-07T21:09:36.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.295+0000 7f447b82d800 1 -- start start 2023-12-07T21:09:36.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.295+0000 7f447b82d800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5565114b2d20 0x5565114b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.295+0000 7f447b82d800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5565113fe740 con 0x5565114b5650 2023-12-07T21:09:36.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.295+0000 7f447b82d800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5565113c7880 con 0x5565114b2d20 2023-12-07T21:09:36.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.295+0000 7f4476a2e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5565114b2d20 0x5565114b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.295+0000 7f4476a2e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5565114b2d20 0x5565114b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54666/0 (socket says 172.21.15.121:54666) 2023-12-07T21:09:36.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.295+0000 7f4476a2e640 1 -- 172.21.15.121:0/3047251348 learned_addr learned my addr 172.21.15.121:0/3047251348 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.295+0000 7f4476a2e640 1 -- 172.21.15.121:0/3047251348 >> v1:172.21.15.89:6789/0 conn(0x5565114b5650 legacy=0x5565114b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.295+0000 7f4476a2e640 1 -- 172.21.15.121:0/3047251348 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565114ba170 con 0x5565114b2d20 2023-12-07T21:09:36.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.297+0000 7f4476a2e640 1 --2- 172.21.15.121:0/3047251348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565114b5110 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4468005fd0 tx=0x7f446801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b445d383d78f495 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.297+0000 7f4475a2c640 1 -- 172.21.15.121:0/3047251348 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4468052540 con 0x5565114b2d20 2023-12-07T21:09:36.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.297+0000 7f4475a2c640 1 -- 172.21.15.121:0/3047251348 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44680526a0 con 0x5565114b2d20 2023-12-07T21:09:36.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.297+0000 7f4475a2c640 1 -- 172.21.15.121:0/3047251348 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44680529c0 con 0x5565114b2d20 2023-12-07T21:09:36.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.298+0000 7f447b82d800 1 -- 172.21.15.121:0/3047251348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 msgr2=0x5565114b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.298+0000 7f447b82d800 1 --2- 172.21.15.121:0/3047251348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565114b5110 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4468005fd0 tx=0x7f446801cc50 comp rx=0 tx=0).stop 2023-12-07T21:09:36.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.298+0000 7f447b82d800 1 -- 172.21.15.121:0/3047251348 shutdown_connections 2023-12-07T21:09:36.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.298+0000 7f447b82d800 1 --2- 172.21.15.121:0/3047251348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565114b5110 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.298+0000 7f447b82d800 1 -- 172.21.15.121:0/3047251348 >> 172.21.15.121:0/3047251348 conn(0x5565114ac7f0 msgr2=0x5565114aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.298+0000 7f447b82d800 1 -- 172.21.15.121:0/3047251348 shutdown_connections 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.298+0000 7f447b82d800 1 -- 172.21.15.121:0/3047251348 wait complete. 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.298+0000 7f447b82d800 1 Processor -- start 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.298+0000 7f447b82d800 1 -- start start 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.299+0000 7f447b82d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565114b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.299+0000 7f447b82d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565113c4db0 con 0x5565114b2d20 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.299+0000 7f4476a2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565114b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.299+0000 7f4476a2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565114b2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54672/0 (socket says 172.21.15.121:54672) 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.299+0000 7f4476a2e640 1 -- 172.21.15.121:0/2798452038 learned_addr learned my addr 172.21.15.121:0/2798452038 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.299+0000 7f4476a2e640 1 -- 172.21.15.121:0/2798452038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446800a1c0 con 0x5565114b2d20 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.299+0000 7f4476a2e640 1 --2- 172.21.15.121:0/2798452038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565114b2450 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4468007000 tx=0x7f446804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b0eb1f03752ad6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.299+0000 7f447522b640 1 -- 172.21.15.121:0/2798452038 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4468061070 con 0x5565114b2d20 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.299+0000 7f447522b640 1 -- 172.21.15.121:0/2798452038 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4468052940 con 0x5565114b2d20 2023-12-07T21:09:36.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.299+0000 7f447522b640 1 -- 172.21.15.121:0/2798452038 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4468052c00 con 0x5565114b2d20 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f447b82d800 1 -- 172.21.15.121:0/2798452038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 msgr2=0x5565114b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f447b82d800 1 --2- 172.21.15.121:0/2798452038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565114b2450 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4468007000 tx=0x7f446804c000 comp rx=0 tx=0).stop 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f447b82d800 1 -- 172.21.15.121:0/2798452038 shutdown_connections 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f447b82d800 1 --2- 172.21.15.121:0/2798452038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565114b2450 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f447b82d800 1 -- 172.21.15.121:0/2798452038 >> 172.21.15.121:0/2798452038 conn(0x5565114ac7f0 msgr2=0x556511552b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f447b82d800 1 -- 172.21.15.121:0/2798452038 shutdown_connections 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f447b82d800 1 -- 172.21.15.121:0/2798452038 wait complete. 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f447b82d800 1 Processor -- start 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f447b82d800 1 -- start start 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f447b82d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565115604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f447b82d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565113c06a0 con 0x5565114b2d20 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f4476a2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565115604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f4476a2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565115604f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54688/0 (socket says 172.21.15.121:54688) 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.300+0000 7f4476a2e640 1 -- 172.21.15.121:0/615695248 learned_addr learned my addr 172.21.15.121:0/615695248 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.301+0000 7f4476a2e640 1 -- 172.21.15.121:0/615695248 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565114ba170 con 0x5565114b2d20 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.301+0000 7f4476a2e640 1 --2- 172.21.15.121:0/615695248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565115604f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4468005cb0 tx=0x7f4468003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.301+0000 7f445ffff640 1 -- 172.21.15.121:0/615695248 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4468061040 con 0x5565114b2d20 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.301+0000 7f445ffff640 1 -- 172.21.15.121:0/615695248 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446805d760 con 0x5565114b2d20 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.301+0000 7f447b82d800 1 -- 172.21.15.121:0/615695248 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556511560a30 con 0x5565114b2d20 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.301+0000 7f445ffff640 1 -- 172.21.15.121:0/615695248 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f446805da00 con 0x5565114b2d20 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.301+0000 7f447b82d800 1 -- 172.21.15.121:0/615695248 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556511560f10 con 0x5565114b2d20 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f447b82d800 1 Processor -- start 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f447b82d800 1 -- start start 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f445ffff640 1 -- 172.21.15.121:0/615695248 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f446805db60 con 0x5565114b2d20 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f447b82d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 0x55651156cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f447b82d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55651135a890 con 0x55651156c6f0 2023-12-07T21:09:36.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f445ffff640 1 --2- 172.21.15.121:0/615695248 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4464036110 0x7f44640385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f447722f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 0x55651156cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f447722f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 0x55651156cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54694/0 (socket says 172.21.15.121:54694) 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f447722f640 1 -- 172.21.15.121:0/1943281693 learned_addr learned my addr 172.21.15.121:0/1943281693 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f445ffff640 1 -- 172.21.15.121:0/615695248 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f446808d720 con 0x5565114b2d20 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f4476a2e640 1 --2- 172.21.15.121:0/615695248 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4464036110 0x7f44640385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f447722f640 1 -- 172.21.15.121:0/1943281693 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55651156d050 con 0x55651156c6f0 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f4476a2e640 1 --2- 172.21.15.121:0/615695248 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4464036110 0x7f44640385d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4468052670 tx=0x7f4468068f40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.302+0000 7f447722f640 1 --2- 172.21.15.121:0/1943281693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 0x55651156cb10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f447000a400 tx=0x7f447000a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f465629186c2bf62 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f445dffb640 1 -- 172.21.15.121:0/1943281693 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44700087e0 con 0x55651156c6f0 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f445dffb640 1 -- 172.21.15.121:0/1943281693 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4470008960 con 0x55651156c6f0 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f445dffb640 1 -- 172.21.15.121:0/1943281693 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4470008c80 con 0x55651156c6f0 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f447b82d800 1 -- 172.21.15.121:0/1943281693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 msgr2=0x55651156cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f447b82d800 1 --2- 172.21.15.121:0/1943281693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 0x55651156cb10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f447000a400 tx=0x7f447000a8c0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f447b82d800 1 -- 172.21.15.121:0/1943281693 shutdown_connections 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f447b82d800 1 --2- 172.21.15.121:0/1943281693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 0x55651156cb10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f447b82d800 1 -- 172.21.15.121:0/1943281693 >> 172.21.15.121:0/1943281693 conn(0x5565114b5650 msgr2=0x556511567ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f447b82d800 1 -- 172.21.15.121:0/1943281693 shutdown_connections 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f447b82d800 1 -- 172.21.15.121:0/1943281693 wait complete. 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f447b82d800 1 Processor -- start 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f447b82d800 1 -- start start 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f447b82d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 0x5565115736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.303+0000 7f447b82d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55651135a530 con 0x55651156c6f0 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.304+0000 7f447722f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 0x5565115736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.304+0000 7f447722f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 0x5565115736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54710/0 (socket says 172.21.15.121:54710) 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.304+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 learned_addr learned my addr 172.21.15.121:0/523479216 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.304+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4470005c90 con 0x55651156c6f0 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.304+0000 7f447722f640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 0x5565115736f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f447000a900 tx=0x7f4470002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.304+0000 7f4457fff640 1 -- 172.21.15.121:0/523479216 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4470013780 con 0x55651156c6f0 2023-12-07T21:09:36.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.304+0000 7f4457fff640 1 -- 172.21.15.121:0/523479216 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44700138e0 con 0x55651156c6f0 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.304+0000 7f4457fff640 1 -- 172.21.15.121:0/523479216 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4470013b80 con 0x55651156c6f0 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.304+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556511573c30 con 0x55651156c6f0 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.304+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565115740f0 con 0x55651156c6f0 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.305+0000 7f4457fff640 1 -- 172.21.15.121:0/523479216 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f447001e420 con 0x55651156c6f0 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.305+0000 7f4457fff640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f44500360c0 0x7f4450038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.305+0000 7f4457fff640 1 -- 172.21.15.121:0/523479216 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f447004b890 con 0x55651156c6f0 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447622d640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f44500360c0 0x7f4450038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447b82d800 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55651157ee90 0x556511581350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511581aa0 con 0x55651157ee90 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447622d640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f44500360c0 0x7f4450038580 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x556511568710 tx=0x7f446c001310 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447722f640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55651157ee90 0x556511581350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447722f640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55651157ee90 0x556511581350 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.313 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447b82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447b82d800 20 realm 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.306+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511581eb0 con 0x55651157ee90 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511582730 con 0x55651157ee90 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.314 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511582a90 con 0x55651157ee90 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511583290 con 0x55651157ee90 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 20 searching for the correct realm 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x556511584fb0 0x556511587420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x556511584fb0 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.307+0000 7f4476a2e640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x556511584fb0 0x556511587420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.308+0000 7f4476a2e640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x556511584fb0 0x556511587420 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.308+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.315 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.308+0000 7f4476a2e640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f4468071070 0x7f446808d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.308+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f4468071070 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.308+0000 7f447622d640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f4468071070 0x7f446808d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.308+0000 7f447622d640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f4468071070 0x7f446808d0e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.309+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.309+0000 7f447622d640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f446c00f8d0 0x7f446c00e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.309+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f446c00f8d0 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.309+0000 7f447722f640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f446c00f8d0 0x7f446c00e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.309+0000 7f447722f640 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f446c00f8d0 0x7f446c00e360 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.309+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.309+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x55651157ee90 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.310+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.310+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x55651157ee90 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.310+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.310+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f446c00f8d0 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.310+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.310+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f446c00f8d0 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.310+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.310+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f4468071070 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.310+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.310+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x556511584fb0 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.311+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.311+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x55651157ee90 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.311+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.311+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f446c00f8d0 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.311+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.311+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x55651157ee90 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.311+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.311+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f4468071070 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.312+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.312+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x556511584fb0 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.312+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.312+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x556511584fb0 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.312+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.312+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f446c00f8d0 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.313+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.313+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x556511584fb0 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.313+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.313+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x556511584fb0 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.313+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.313+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x55651157ee90 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.313+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.313+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x55651157ee90 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.313+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.313+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f446c00f8d0 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.314+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.314+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x556511584fb0 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.314+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.314+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f4468071070 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.314+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.314+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x55651157ee90 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.314+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.314+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f446c00f8d0 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.315+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.315+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x556511584fb0 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.315+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.315+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f446c00f8d0 2023-12-07T21:09:36.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.315+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.315+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f4468071070 2023-12-07T21:09:36.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.315+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.315+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x556511584fb0 2023-12-07T21:09:36.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x7f446c00f8d0 2023-12-07T21:09:36.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587af0 con 0x55651157ee90 2023-12-07T21:09:36.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f4470054080 con 0x7f4468071070 2023-12-07T21:09:36.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447b82d800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:36.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447b82d800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:36.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447b82d800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:36.330 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447b82d800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447b82d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447b82d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.316+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511583bf0 con 0x55651157ee90 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511584440 con 0x55651157ee90 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511584440 con 0x556511584fb0 2023-12-07T21:09:36.331 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 20 zone default found 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 4 Realm: () 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 20 zonegroup default 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.317+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511587f30 con 0x7f446c00f8d0 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f447b82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511589cf0 con 0x556511584fb0 2023-12-07T21:09:36.332 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f447b82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158a050 con 0x556511584fb0 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f447b82d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f447b82d800 20 started sync module instance, tier type = 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f447b82d800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.318+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115895d0 con 0x7f4468071070 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.319+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.319+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93892568653648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x556511589980 con 0x7f4468071070 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.319+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158a940 con 0x55651157ee90 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.320+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93892568653648] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.333 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.320+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.320+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93892571074864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158a940 con 0x55651157ee90 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.321+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158b410 con 0x556511584fb0 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.321+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.322+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93892571082480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158bc60 con 0x556511584fb0 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.322+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158c630 con 0x7f4468071070 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.322+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93892571074864] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.323+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93892571082480] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.323+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.323+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93892571087152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158b8d0 con 0x7f4468071070 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.323+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158d0a0 con 0x55651157ee90 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.324+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93892571087152] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.324+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.334 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.324+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93892571089792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158d480 con 0x55651157ee90 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.324+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158ddf0 con 0x7f446c00f8d0 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.325+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.325+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93892571093328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158e200 con 0x7f446c00f8d0 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.325+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158eb70 con 0x7f446c00f8d0 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.325+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93892571089792] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.326+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93892571093328] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.326+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.326+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93892571094368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158a5b0 con 0x7f446c00f8d0 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.326+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158f010 con 0x7f446c00f8d0 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.327+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v33'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.327+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93892571097968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158f420 con 0x7f446c00f8d0 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.327+0000 7f447b82d800 20 add_watcher() i=0 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.327+0000 7f447b82d800 20 add_watcher() i=1 2023-12-07T21:09:36.335 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.327+0000 7f447b82d800 20 add_watcher() i=2 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.327+0000 7f447b82d800 20 add_watcher() i=3 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.327+0000 7f447b82d800 20 add_watcher() i=4 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.327+0000 7f447b82d800 20 add_watcher() i=5 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.327+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93892571094368] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.328+0000 7f447b82d800 20 add_watcher() i=6 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.328+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93892571097968] v33'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.328+0000 7f447b82d800 20 add_watcher() i=7 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.328+0000 7f447b82d800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.328+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158e7a0 con 0x55651157ee90 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.329+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.329+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93892571099008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158e810 con 0x55651157ee90 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93892571099008] v33'180 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f443cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.336 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f447b82d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f447b82d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f447b82d800 5 note: GC not initialized 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f43b77fe640 20 reqs_thread_entry: start 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f447b82d800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f447b82d800 20 Filter name: none 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f43b57fa640 20 reqs_thread_entry: start 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f447b82d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.330+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115c5880 con 0x7f4468071070 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:36.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 : miss 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.9 8:919cbaa3:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115c74a0 con 0x7f4468071070 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(63 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv41 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 info.flags=0x17 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 to cache LRU end 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 20 get_obj_state: octx=0x7f446c001830 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5565115c9ca8 s->prefetch_data=0 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 3.3ds0 3:bfbabe11:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115cae00 con 0x556511584fb0 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 10 manifest: total_size = 5 2023-12-07T21:09:36.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.331+0000 7f447b82d800 20 get_obj_state: setting s->obj_tag to _C4Ar3oGFA7UbVNnjSPaKcTreSlEOOCe 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.332+0000 7f443cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.332+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93892571099008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115ae0e0 con 0x55651157ee90 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.333+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93892571099008] v33'181 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.333+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93892568653648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115ae0e0 con 0x7f4468071070 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.334+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93892568653648] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.334+0000 7f447b82d800 20 remove_watcher() i=0 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.334+0000 7f447b82d800 2 removed watcher, disabling cache 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.334+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93892571074864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115ca7e0 con 0x55651157ee90 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.335+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93892571074864] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.335+0000 7f447b82d800 20 remove_watcher() i=1 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.335+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93892571082480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115ca7e0 con 0x556511584fb0 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.336+0000 7f4476a2e640 1 -- 172.21.15.121:0/523479216 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93892571082480] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f446804f070 con 0x556511584fb0 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.336+0000 7f447b82d800 20 remove_watcher() i=2 2023-12-07T21:09:36.339 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.336+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93892571087152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115c7ae0 con 0x7f4468071070 2023-12-07T21:09:36.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.337+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93892571087152] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f446c0105b0 con 0x7f4468071070 2023-12-07T21:09:36.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.337+0000 7f447b82d800 20 remove_watcher() i=3 2023-12-07T21:09:36.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.337+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93892571089792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115c7ae0 con 0x55651157ee90 2023-12-07T21:09:36.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.338+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93892571089792] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x55651157ee90 2023-12-07T21:09:36.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.338+0000 7f447b82d800 20 remove_watcher() i=4 2023-12-07T21:09:36.342 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.338+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93892571093328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115c7ae0 con 0x7f446c00f8d0 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.339+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93892571093328] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.339+0000 7f447b82d800 20 remove_watcher() i=5 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.339+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93892571094368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55651158d950 con 0x7f446c00f8d0 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.340+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93892571094368] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.340+0000 7f447b82d800 20 remove_watcher() i=6 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.340+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93892571097968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5565115c7ae0 con 0x7f446c00f8d0 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447722f640 1 -- 172.21.15.121:0/523479216 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93892571097968] v33'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4470024070 con 0x7f446c00f8d0 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 20 remove_watcher() i=7 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f446c00f8d0 msgr2=0x7f446c00e360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f446c00f8d0 0x7f446c00e360 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55651157ee90 msgr2=0x556511581350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55651157ee90 0x556511581350 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f4468071070 msgr2=0x7f446808d0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f4468071070 0x7f446808d0e0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x556511584fb0 msgr2=0x556511587420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x556511584fb0 0x556511587420 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f44500360c0 msgr2=0x7f4450038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f44500360c0 0x7f4450038580 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x556511568710 tx=0x7f446c001310 comp rx=0 tx=0).stop 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 msgr2=0x5565115736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 --2- 172.21.15.121:0/523479216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55651156c6f0 0x5565115736f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f447000a900 tx=0x7f4470002ff0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 reap_dead start 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 shutdown_connections 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447622d640 1 -- 172.21.15.121:0/523479216 reap_dead start 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.341+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 >> 172.21.15.121:0/523479216 conn(0x5565114b5650 msgr2=0x5565115668d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 shutdown_connections 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 -- 172.21.15.121:0/523479216 wait complete. 2023-12-07T21:09:36.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 -- 172.21.15.121:0/615695248 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4464036110 msgr2=0x7f44640385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 --2- 172.21.15.121:0/615695248 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4464036110 0x7f44640385d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4468052670 tx=0x7f4468068f40 comp rx=0 tx=0).stop 2023-12-07T21:09:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 -- 172.21.15.121:0/615695248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 msgr2=0x5565115604f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 --2- 172.21.15.121:0/615695248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565115604f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4468005cb0 tx=0x7f4468003330 comp rx=0 tx=0).stop 2023-12-07T21:09:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 -- 172.21.15.121:0/615695248 shutdown_connections 2023-12-07T21:09:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 --2- 172.21.15.121:0/615695248 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4464036110 0x7f44640385d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 --2- 172.21.15.121:0/615695248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5565114b2d20 0x5565115604f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 -- 172.21.15.121:0/615695248 >> 172.21.15.121:0/615695248 conn(0x5565114ac7f0 msgr2=0x5565114b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 -- 172.21.15.121:0/615695248 shutdown_connections 2023-12-07T21:09:36.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.342+0000 7f447b82d800 1 -- 172.21.15.121:0/615695248 wait complete. 2023-12-07T21:09:36.346 INFO:teuthology.orchestra.run.smithi121.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2023-12-07T21:09:36.346 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2023-12-07T21:09:36.348 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2023-12-07T21:09:36.360 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:36.454 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2023-12-07T21:09:36.455 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2023-12-07T21:09:36.455 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2023-12-07T21:09:36.455 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2023-12-07T21:09:36.455 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2023-12-07T21:09:36.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2023-12-07T21:09:36.455 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2023-12-07T21:09:36.498 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:36.498 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:36.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.506+0000 7fe774f21800 1 Processor -- start 2023-12-07T21:09:36.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.507+0000 7fe774f21800 1 -- start start 2023-12-07T21:09:36.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.507+0000 7fe774f21800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55782cf40850 0x55782cf40c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.507+0000 7fe774f21800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55782ce8b740 con 0x55782cf411b0 2023-12-07T21:09:36.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.507+0000 7fe774f21800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55782ce54880 con 0x55782cf40850 2023-12-07T21:09:36.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.507+0000 7fe770ce5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55782cf40850 0x55782cf40c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.507+0000 7fe770ce5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55782cf40850 0x55782cf40c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54718/0 (socket says 172.21.15.121:54718) 2023-12-07T21:09:36.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.507+0000 7fe770ce5640 1 -- 172.21.15.121:0/885870047 learned_addr learned my addr 172.21.15.121:0/885870047 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.507+0000 7fe76bfff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55782cf411b0 0x55782cf3d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:38098/0 (socket says 172.21.15.121:38098) 2023-12-07T21:09:36.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.507+0000 7fe770ce5640 1 -- 172.21.15.121:0/885870047 >> v1:172.21.15.89:6789/0 conn(0x55782cf411b0 legacy=0x55782cf3d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.507+0000 7fe770ce5640 1 -- 172.21.15.121:0/885870047 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55782cf3db70 con 0x55782cf40850 2023-12-07T21:09:36.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.509+0000 7fe770ce5640 1 --2- 172.21.15.121:0/885870047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cf40c70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe76400a520 tx=0x7fe76401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7663f66a5fff7bf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.509+0000 7fe76b7fe640 1 -- 172.21.15.121:0/885870047 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe764052570 con 0x55782cf40850 2023-12-07T21:09:36.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.509+0000 7fe76b7fe640 1 -- 172.21.15.121:0/885870047 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7640526d0 con 0x55782cf40850 2023-12-07T21:09:36.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.509+0000 7fe76b7fe640 1 -- 172.21.15.121:0/885870047 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe764052990 con 0x55782cf40850 2023-12-07T21:09:36.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.510+0000 7fe774f21800 1 -- 172.21.15.121:0/885870047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 msgr2=0x55782cf40c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.510+0000 7fe774f21800 1 --2- 172.21.15.121:0/885870047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cf40c70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe76400a520 tx=0x7fe76401cee0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.510+0000 7fe774f21800 1 -- 172.21.15.121:0/885870047 shutdown_connections 2023-12-07T21:09:36.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.510+0000 7fe774f21800 1 --2- 172.21.15.121:0/885870047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cf40c70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.510+0000 7fe774f21800 1 -- 172.21.15.121:0/885870047 >> 172.21.15.121:0/885870047 conn(0x55782cf38f70 msgr2=0x55782cf3b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.510+0000 7fe774f21800 1 -- 172.21.15.121:0/885870047 shutdown_connections 2023-12-07T21:09:36.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.510+0000 7fe774f21800 1 -- 172.21.15.121:0/885870047 wait complete. 2023-12-07T21:09:36.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.510+0000 7fe774f21800 1 Processor -- start 2023-12-07T21:09:36.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.511+0000 7fe774f21800 1 -- start start 2023-12-07T21:09:36.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.511+0000 7fe774f21800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfe43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.511+0000 7fe774f21800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782ce51db0 con 0x55782cf40850 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.511+0000 7fe770ce5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfe43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.511+0000 7fe770ce5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfe43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54724/0 (socket says 172.21.15.121:54724) 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.511+0000 7fe770ce5640 1 -- 172.21.15.121:0/2093164524 learned_addr learned my addr 172.21.15.121:0/2093164524 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.511+0000 7fe770ce5640 1 -- 172.21.15.121:0/2093164524 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764005de0 con 0x55782cf40850 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.511+0000 7fe770ce5640 1 --2- 172.21.15.121:0/2093164524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfe43b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe764000c00 tx=0x7fe76404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36775ea2d428f09 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.511+0000 7fe76affd640 1 -- 172.21.15.121:0/2093164524 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe764052840 con 0x55782cf40850 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.511+0000 7fe76affd640 1 -- 172.21.15.121:0/2093164524 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7640529a0 con 0x55782cf40850 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.511+0000 7fe76affd640 1 -- 172.21.15.121:0/2093164524 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe764052c80 con 0x55782cf40850 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe774f21800 1 -- 172.21.15.121:0/2093164524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 msgr2=0x55782cfe43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe774f21800 1 --2- 172.21.15.121:0/2093164524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfe43b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe764000c00 tx=0x7fe76404c000 comp rx=0 tx=0).stop 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe774f21800 1 -- 172.21.15.121:0/2093164524 shutdown_connections 2023-12-07T21:09:36.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe774f21800 1 --2- 172.21.15.121:0/2093164524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfe43b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe774f21800 1 -- 172.21.15.121:0/2093164524 >> 172.21.15.121:0/2093164524 conn(0x55782cf38f70 msgr2=0x55782cfe0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe774f21800 1 -- 172.21.15.121:0/2093164524 shutdown_connections 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe774f21800 1 -- 172.21.15.121:0/2093164524 wait complete. 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe774f21800 1 Processor -- start 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe774f21800 1 -- start start 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe774f21800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfeb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe774f21800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782ce4d6a0 con 0x55782cf40850 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe770ce5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfeb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.512+0000 7fe770ce5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfeb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54734/0 (socket says 172.21.15.121:54734) 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.513+0000 7fe770ce5640 1 -- 172.21.15.121:0/590549644 learned_addr learned my addr 172.21.15.121:0/590549644 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.513+0000 7fe770ce5640 1 -- 172.21.15.121:0/590549644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55782cf3db70 con 0x55782cf40850 2023-12-07T21:09:36.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.513+0000 7fe770ce5640 1 --2- 172.21.15.121:0/590549644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfeb6f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe764005870 tx=0x7fe764002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.513+0000 7fe769ffb640 1 -- 172.21.15.121:0/590549644 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe76406a070 con 0x55782cf40850 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.513+0000 7fe769ffb640 1 -- 172.21.15.121:0/590549644 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe764065450 con 0x55782cf40850 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.513+0000 7fe774f21800 1 -- 172.21.15.121:0/590549644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55782cfebc30 con 0x55782cf40850 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.513+0000 7fe769ffb640 1 -- 172.21.15.121:0/590549644 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe764065730 con 0x55782cf40850 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.513+0000 7fe774f21800 1 -- 172.21.15.121:0/590549644 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55782cfec170 con 0x55782cf40850 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe774f21800 1 Processor -- start 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe774f21800 1 -- start start 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe769ffb640 1 -- 172.21.15.121:0/590549644 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fe764059070 con 0x55782cf40850 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe774f21800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cff7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe774f21800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782cde7890 con 0x55782cff7960 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe769ffb640 1 --2- 172.21.15.121:0/590549644 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe754036110 0x7fe7540385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe769ffb640 1 -- 172.21.15.121:0/590549644 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fe76408cff0 con 0x55782cf40850 2023-12-07T21:09:36.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe770ce5640 1 --2- 172.21.15.121:0/590549644 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe754036110 0x7fe7540385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe7714e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cff7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe7714e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cff7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54740/0 (socket says 172.21.15.121:54740) 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe7714e6640 1 -- 172.21.15.121:0/3206515721 learned_addr learned my addr 172.21.15.121:0/3206515721 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe7714e6640 1 -- 172.21.15.121:0/3206515721 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55782cff82c0 con 0x55782cff7960 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.514+0000 7fe770ce5640 1 --2- 172.21.15.121:0/590549644 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe754036110 0x7fe7540385d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe764044890 tx=0x7fe764079040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe7714e6640 1 --2- 172.21.15.121:0/3206515721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cff7d80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00a430 tx=0x7fe76c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d687ea7f941bb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe75b7fe640 1 -- 172.21.15.121:0/3206515721 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe76c001650 con 0x55782cff7960 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe75b7fe640 1 -- 172.21.15.121:0/3206515721 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c0017d0 con 0x55782cff7960 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe75b7fe640 1 -- 172.21.15.121:0/3206515721 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe76c001ab0 con 0x55782cff7960 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe774f21800 1 -- 172.21.15.121:0/3206515721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 msgr2=0x55782cff7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe774f21800 1 --2- 172.21.15.121:0/3206515721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cff7d80 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00a430 tx=0x7fe76c00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe774f21800 1 -- 172.21.15.121:0/3206515721 shutdown_connections 2023-12-07T21:09:36.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe774f21800 1 --2- 172.21.15.121:0/3206515721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cff7d80 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe774f21800 1 -- 172.21.15.121:0/3206515721 >> 172.21.15.121:0/3206515721 conn(0x55782cf411b0 msgr2=0x55782cff2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe774f21800 1 -- 172.21.15.121:0/3206515721 shutdown_connections 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe774f21800 1 -- 172.21.15.121:0/3206515721 wait complete. 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe774f21800 1 Processor -- start 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.515+0000 7fe774f21800 1 -- start start 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.516+0000 7fe774f21800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cffea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.516+0000 7fe774f21800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782cde7530 con 0x55782cff7960 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.516+0000 7fe7714e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cffea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.516+0000 7fe7714e6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cffea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54744/0 (socket says 172.21.15.121:54744) 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.516+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 learned_addr learned my addr 172.21.15.121:0/478520141 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.516+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c00a0e0 con 0x55782cff7960 2023-12-07T21:09:36.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.516+0000 7fe7714e6640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cffea00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00a930 tx=0x7fe76c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.517+0000 7fe759ffb640 1 -- 172.21.15.121:0/478520141 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe76c010900 con 0x55782cff7960 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.517+0000 7fe759ffb640 1 -- 172.21.15.121:0/478520141 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c010a60 con 0x55782cff7960 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.517+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55782cffef40 con 0x55782cff7960 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.517+0000 7fe759ffb640 1 -- 172.21.15.121:0/478520141 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe76c010d20 con 0x55782cff7960 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.517+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55782cfff3a0 con 0x55782cff7960 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.517+0000 7fe759ffb640 1 -- 172.21.15.121:0/478520141 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fe76c017030 con 0x55782cff7960 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.518+0000 7fe759ffb640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe7480360c0 0x7fe748038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.518+0000 7fe759ffb640 1 -- 172.21.15.121:0/478520141 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fe76c04b920 con 0x55782cff7960 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.518+0000 7fe76bfff640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe7480360c0 0x7fe748038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.518+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.518+0000 7fe774f21800 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55782d00a080 0x55782d00c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.518+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d00cc90 con 0x55782d00a080 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.518+0000 7fe76bfff640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe7480360c0 0x7fe748038580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe75c000f60 tx=0x7fe75c0012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.518+0000 7fe7714e6640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55782d00a080 0x55782d00c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.518+0000 7fe7714e6640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55782d00a080 0x55782d00c540 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 20 realm 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d00d0a0 con 0x55782d00a080 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d00d920 con 0x55782d00a080 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d00dc80 con 0x55782d00a080 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.519+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d00e480 con 0x55782d00a080 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.520+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.520+0000 7fe774f21800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.520+0000 7fe774f21800 20 searching for the correct realm 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.520+0000 7fe774f21800 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55782d0101a0 0x55782d012610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.520+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d0101a0 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.520+0000 7fe770ce5640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55782d0101a0 0x55782d012610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.520+0000 7fe770ce5640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55782d0101a0 0x55782d012610 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.520+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.520+0000 7fe770ce5640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe764065070 0x7fe76406e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.520+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe764065070 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.521+0000 7fe76bfff640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe764065070 0x7fe76406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.521+0000 7fe76bfff640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe764065070 0x7fe76406e820 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.521+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.521+0000 7fe76bfff640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe75c00f070 0x7fe75c00e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.521+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe75c00f070 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.521+0000 7fe7714e6640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe75c00f070 0x7fe75c00e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.522+0000 7fe7714e6640 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe75c00f070 0x7fe75c00e8c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.522+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.522+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d00a080 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.522+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.522+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d00a080 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.522+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.522+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe75c00f070 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.523+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.523+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe75c00f070 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.523+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.523+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe764065070 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.523+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.523+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d0101a0 2023-12-07T21:09:36.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.523+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.523+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d00a080 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.523+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.524+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe75c00f070 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.524+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.524+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d00a080 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.524+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.524+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe764065070 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.524+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.524+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d0101a0 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.524+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.524+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d0101a0 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.525+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.525+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe75c00f070 2023-12-07T21:09:36.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.525+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.525+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d0101a0 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.525+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.525+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d0101a0 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.525+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.525+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d00a080 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.526+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.526+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d00a080 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.526+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.526+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe75c00f070 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.526+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.526+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d0101a0 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.526+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.526+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe764065070 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.527+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.527+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d00a080 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.527+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.527+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe75c00f070 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.527+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.527+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d0101a0 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.527+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.527+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe75c00f070 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.527+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.527+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe764065070 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.528+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.528+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d0101a0 2023-12-07T21:09:36.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.528+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.528+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x7fe75c00f070 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.528+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.528+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d012ce0 con 0x55782d00a080 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.528+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.528+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe76c053080 con 0x7fe764065070 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:36.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d00ede0 con 0x55782d00a080 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d00f630 con 0x55782d00a080 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d00f630 con 0x55782d0101a0 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 zone default found 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 4 Realm: () 2023-12-07T21:09:36.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 zonegroup default 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.529+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d013120 con 0x7fe75c00f070 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe774f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d014ee0 con 0x55782d0101a0 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe774f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d015260 con 0x55782d0101a0 2023-12-07T21:09:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe774f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe774f21800 20 started sync module instance, tier type = 2023-12-07T21:09:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe774f21800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.530+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0147c0 con 0x7fe764065070 2023-12-07T21:09:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.531+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.532+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93974637080400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d015680 con 0x7fe764065070 2023-12-07T21:09:36.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.532+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d015e80 con 0x55782d00a080 2023-12-07T21:09:36.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.532+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93974637080400] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.533+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.533+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93974639493920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d015e80 con 0x55782d00a080 2023-12-07T21:09:36.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.533+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d016680 con 0x55782d0101a0 2023-12-07T21:09:36.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.534+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.534+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93974639501200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d016e80 con 0x55782d0101a0 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.534+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d017850 con 0x7fe764065070 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.534+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93974639493920] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.535+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93974639501200] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.535+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.535+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93974639506256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d017c00 con 0x7fe764065070 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.535+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d018400 con 0x55782d00a080 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.536+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93974639506256] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.536+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.536+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93974639509344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d018810 con 0x55782d00a080 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.536+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d019010 con 0x7fe75c00f070 2023-12-07T21:09:36.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.537+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.537+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93974639511840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d019310 con 0x7fe75c00f070 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.537+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d019de0 con 0x7fe75c00f070 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.537+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93974639509344] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.538+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93974639511840] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.538+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.538+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93974639515840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d018d70 con 0x7fe75c00f070 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.538+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d018d70 con 0x7fe75c00f070 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.539+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93974639515840] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.539+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.539+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93974639510384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d01a240 con 0x7fe75c00f070 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.539+0000 7fe774f21800 20 add_watcher() i=0 2023-12-07T21:09:36.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.539+0000 7fe774f21800 20 add_watcher() i=1 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.539+0000 7fe774f21800 20 add_watcher() i=2 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.539+0000 7fe774f21800 20 add_watcher() i=3 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.539+0000 7fe774f21800 20 add_watcher() i=4 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.539+0000 7fe774f21800 20 add_watcher() i=5 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.539+0000 7fe774f21800 20 add_watcher() i=6 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.540+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93974639510384] v33'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.540+0000 7fe774f21800 20 add_watcher() i=7 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.540+0000 7fe774f21800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.540+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d01d470 con 0x55782d00a080 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.540+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.540+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93974639517456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d01a7c0 con 0x55782d00a080 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.541+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93974639517456] v33'182 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.542+0000 7fe7367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.542+0000 7fe774f21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.542+0000 7fe774f21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.542+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d025a90 con 0x55782d00a080 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.543+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.543+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d025ed0 con 0x7fe75c00f070 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.544+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.544+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d026310 con 0x55782d0101a0 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.545+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'26 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.545+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d026ce0 con 0x55782d00a080 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.546+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'183 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.546+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d023b40 con 0x7fe764065070 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.547+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'62 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.547+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d027850 con 0x55782d0101a0 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.548+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.548+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d028220 con 0x55782d00a080 2023-12-07T21:09:36.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.549+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.549+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d028220 con 0x7fe75c00f070 2023-12-07T21:09:36.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.550+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.550+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d028220 con 0x7fe764065070 2023-12-07T21:09:36.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.551+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.552+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d028a20 con 0x55782d0101a0 2023-12-07T21:09:36.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.552+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.552+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022b90 con 0x7fe764065070 2023-12-07T21:09:36.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.553+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'63 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.553+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022b90 con 0x7fe75c00f070 2023-12-07T21:09:36.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.554+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.554+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022b90 con 0x7fe764065070 2023-12-07T21:09:36.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.555+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.555+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022490 con 0x7fe75c00f070 2023-12-07T21:09:36.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.556+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'49 uv44 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.556+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022aa0 con 0x55782d00a080 2023-12-07T21:09:36.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.557+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'184 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.557+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022a50 con 0x55782d0101a0 2023-12-07T21:09:36.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.559+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'56 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.559+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022a50 con 0x7fe764065070 2023-12-07T21:09:36.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.560+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'64 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.560+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022a50 con 0x55782d0101a0 2023-12-07T21:09:36.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.560+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.560+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022b40 con 0x55782d00a080 2023-12-07T21:09:36.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.561+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.561+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022b00 con 0x55782d00a080 2023-12-07T21:09:36.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.563+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'185 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.563+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022b00 con 0x55782d0101a0 2023-12-07T21:09:36.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.564+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'57 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.564+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d022b00 con 0x7fe764065070 2023-12-07T21:09:36.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.565+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'34 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.565+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d029590 con 0x55782d0101a0 2023-12-07T21:09:36.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.566+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.566+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d029590 con 0x55782d0101a0 2023-12-07T21:09:36.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.567+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.567+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d029590 con 0x55782d0101a0 2023-12-07T21:09:36.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.567+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'20 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.568+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d029590 con 0x55782d0101a0 2023-12-07T21:09:36.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.568+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.568+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d029590 con 0x7fe75c00f070 2023-12-07T21:09:36.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.570+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'27 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.570+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d029590 con 0x55782d0101a0 2023-12-07T21:09:36.563 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.571+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.571+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d029590 con 0x7fe75c00f070 2023-12-07T21:09:36.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.572+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.572+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d029590 con 0x55782d0101a0 2023-12-07T21:09:36.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.574+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'58 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.574+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d029590 con 0x7fe75c00f070 2023-12-07T21:09:36.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.575+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'50 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.568 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.575+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d029590 con 0x7fe764065070 2023-12-07T21:09:36.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.576+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.576+0000 7fe7357e2640 20 reqs_thread_entry: start 2023-12-07T21:09:36.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:36.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 20 Filter name: none 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe6a6ffd640 20 reqs_thread_entry: start 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0543f0 con 0x7fe764065070 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 : miss 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 8.9 8:919cbaa3:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d055ec0 con 0x7fe764065070 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(95 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv41 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 info.flags=0x17 2023-12-07T21:09:36.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.577+0000 7fe774f21800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 to cache LRU end 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.578+0000 7fe774f21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.578+0000 7fe774f21800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.578+0000 7fe774f21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.578+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:96 4.30 4:0df880b5:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d3440 con 0x55782d0101a0 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.578+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(96 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.578+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:97 4.33 4:ce1bf4b0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d3440 con 0x7fe75c00f070 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.578+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(97 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.578+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:98 4.2e 4:77d16012:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d3480 con 0x55782d0101a0 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.579+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 28 ==== osd_op_reply(98 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2 [call out=426b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.579+0000 7fe774f21800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.579+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:99 4.19 4:9b540787:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d3480 con 0x55782d0101a0 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.579+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 29 ==== osd_op_reply(99 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.579+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:100 4.9 4:926b3946:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d3480 con 0x55782d00a080 2023-12-07T21:09:36.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.579+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(100 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.4 [call out=85b] v0'0 uv17 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.579+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:101 4.b 4:d3fcce7f:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d3480 con 0x7fe764065070 2023-12-07T21:09:36.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.580+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(101 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.580+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 4.4 4:213e5884:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d3480 con 0x7fe75c00f070 2023-12-07T21:09:36.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.580+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(102 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6 [call out=426b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.580+0000 7fe774f21800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2023-12-07T21:09:36.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.580+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:103 4.19 4:989d9f7c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d3440 con 0x55782d0101a0 2023-12-07T21:09:36.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.580+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 30 ==== osd_op_reply(103 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.7 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.580+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:104 4.33 4:cdd0b9bb:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d3440 con 0x7fe75c00f070 2023-12-07T21:09:36.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.581+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(104 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8 [call out=425b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.581+0000 7fe774f21800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2023-12-07T21:09:36.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.581+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:105 4.9 4:904b452b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d3400 con 0x55782d00a080 2023-12-07T21:09:36.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.581+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(105 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.9 [call out=85b] v0'0 uv18 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.581+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:106 4.2a 4:564f3fa1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d3b50 con 0x55782d00a080 2023-12-07T21:09:36.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.581+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(106 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10 [call out=698b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+698 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.581+0000 7fe774f21800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2023-12-07T21:09:36.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.581+0000 7fe774f21800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2023-12-07T21:09:36.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.581+0000 7fe774f21800 20 get_obj_state: octx=0x7fe75c001810 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55782d0d28e8 s->prefetch_data=0 2023-12-07T21:09:36.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.581+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:107 3.29s0 3:943f21e1:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0569a0 con 0x7fe75c00f070 2023-12-07T21:09:36.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.582+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(107 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.582+0000 7fe774f21800 10 manifest: total_size = 6 2023-12-07T21:09:36.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.582+0000 7fe774f21800 20 get_obj_state: setting s->obj_tag to ef4a9585-c98e-4264-8c5b-7c4065599143.4222.11593570410854145307 2023-12-07T21:09:36.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.582+0000 7fe774f21800 20 get_obj_state: octx=0x7fe75c001810 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55782d0d28e8 s->prefetch_data=0 2023-12-07T21:09:36.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.582+0000 7fe774f21800 20 prepare_atomic_modification: state is not atomic. state=0x55782d0d28e8 2023-12-07T21:09:36.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.582+0000 7fe774f21800 20 bucket index object: :.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2 2023-12-07T21:09:36.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.582+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:108 4.2e 4:77d16012:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05b370 con 0x55782d0101a0 2023-12-07T21:09:36.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.583+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 31 ==== osd_op_reply(108 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2 [stat,call,call] v33'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.583+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:109 3.29s0 3:943f21e1:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05b370 con 0x7fe75c00f070 2023-12-07T21:09:36.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.584+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(109 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_9c8454ddf7aa50116496bac348d7550d [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.584+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:110 4.2e 4:77d16012:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05b410 con 0x55782d0101a0 2023-12-07T21:09:36.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.584+0000 7fe774f21800 20 get_obj_state: octx=0x7fe75c001810 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55782d0d28e8 s->prefetch_data=0 2023-12-07T21:09:36.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.584+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:111 3.9s0 3:93d0e8e1:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05b410 con 0x55782d0101a0 2023-12-07T21:09:36.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.585+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 32 ==== osd_op_reply(111 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.585+0000 7fe774f21800 10 manifest: total_size = 3 2023-12-07T21:09:36.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.585+0000 7fe774f21800 20 get_obj_state: setting s->obj_tag to ef4a9585-c98e-4264-8c5b-7c4065599143.4222.13025446538278459554 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.585+0000 7fe774f21800 20 get_obj_state: octx=0x7fe75c001810 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55782d0d28e8 s->prefetch_data=0 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.585+0000 7fe774f21800 20 prepare_atomic_modification: state is not atomic. state=0x55782d0d28e8 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.585+0000 7fe774f21800 20 bucket index object: :.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.585+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:112 4.4 4:213e5884:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d060090 con 0x7fe75c00f070 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.585+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 33 ==== osd_op_reply(110 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2 [stat,call,call] v33'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.585+0000 7fe75b7fe640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.586+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(112 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6 [stat,call,call] v33'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.586+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:113 3.9s0 3:93d0e8e1:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d059250 con 0x55782d0101a0 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.588+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 34 ==== osd_op_reply(113 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_b1b9a972ccd8c962a473909b97007eb4 [call] v33'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.588+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:114 4.4 4:213e5884:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05c420 con 0x7fe75c00f070 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.588+0000 7fe774f21800 20 get_obj_state: octx=0x7fe75c001810 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55782d0d28e8 s->prefetch_data=0 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.588+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:115 3.5s0 3:a2ba7671:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05c420 con 0x7fe764065070 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.588+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(115 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.588+0000 7fe774f21800 10 manifest: total_size = 4 2023-12-07T21:09:36.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.588+0000 7fe774f21800 20 get_obj_state: setting s->obj_tag to ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9834299157005583217 2023-12-07T21:09:36.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.588+0000 7fe774f21800 20 get_obj_state: octx=0x7fe75c001810 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55782d0d28e8 s->prefetch_data=0 2023-12-07T21:09:36.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.588+0000 7fe774f21800 20 prepare_atomic_modification: state is not atomic. state=0x55782d0d28e8 2023-12-07T21:09:36.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.588+0000 7fe774f21800 20 bucket index object: :.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8 2023-12-07T21:09:36.583 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.588+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:116 4.33 4:cdd0b9bb:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05c420 con 0x7fe75c00f070 2023-12-07T21:09:36.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.590+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 30 ==== osd_op_reply(116 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.590+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 31 ==== osd_op_reply(114 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6 [stat,call,call] v33'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.590+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:117 3.5s0 3:a2ba7671:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05c420 con 0x7fe764065070 2023-12-07T21:09:36.584 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.590+0000 7fe75affd640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2023-12-07T21:09:36.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.591+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 22 ==== osd_op_reply(117 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.592+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:118 4.33 4:cdd0b9bb:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05c3b0 con 0x7fe75c00f070 2023-12-07T21:09:36.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.592+0000 7fe774f21800 20 get_obj_state: octx=0x7fe75c001810 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55782d0d28e8 s->prefetch_data=0 2023-12-07T21:09:36.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.592+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:119 3.3es0 3:7e8c169b:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05c3b0 con 0x7fe75c00f070 2023-12-07T21:09:36.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.592+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 32 ==== osd_op_reply(119 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.592+0000 7fe774f21800 10 manifest: total_size = 5 2023-12-07T21:09:36.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.592+0000 7fe774f21800 20 get_obj_state: setting s->obj_tag to ef4a9585-c98e-4264-8c5b-7c4065599143.4222.13133726094568402883 2023-12-07T21:09:36.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.592+0000 7fe774f21800 20 get_obj_state: octx=0x7fe75c001810 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55782d0d28e8 s->prefetch_data=0 2023-12-07T21:09:36.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.592+0000 7fe774f21800 20 prepare_atomic_modification: state is not atomic. state=0x55782d0d28e8 2023-12-07T21:09:36.585 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.592+0000 7fe774f21800 20 bucket index object: :.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10 2023-12-07T21:09:36.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.592+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:120 4.2a 4:564f3fa1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05c3b0 con 0x55782d00a080 2023-12-07T21:09:36.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.593+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 33 ==== osd_op_reply(118 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8 [stat,call,call] v33'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.593+0000 7fe75b7fe640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2023-12-07T21:09:36.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.593+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(120 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10 [stat,call,call] v33'10 uv10 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.586 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.593+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:121 3.3es0 3:7e8c169b:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05c350 con 0x7fe75c00f070 2023-12-07T21:09:36.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.594+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 34 ==== osd_op_reply(121 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_24d27c169c2c881eb09a065116f2aa5c [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.594+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:122 4.2a 4:564f3fa1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05c350 con 0x55782d00a080 2023-12-07T21:09:36.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.594+0000 7fe774f21800 20 get_obj_state: octx=0x7fe75c001810 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55782d0d28e8 s->prefetch_data=0 2023-12-07T21:09:36.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.594+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:123 3.3ds0 3:bfbabe11:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0573a0 con 0x55782d0101a0 2023-12-07T21:09:36.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.595+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 35 ==== osd_op_reply(123 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 262+0+926 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.595+0000 7fe774f21800 10 manifest: total_size = 5 2023-12-07T21:09:36.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.595+0000 7fe774f21800 20 get_obj_state: setting s->obj_tag to _C4Ar3oGFA7UbVNnjSPaKcTreSlEOOCe 2023-12-07T21:09:36.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.595+0000 7fe774f21800 20 get_obj_state: octx=0x7fe75c001810 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55782d0d28e8 s->prefetch_data=0 2023-12-07T21:09:36.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.595+0000 7fe774f21800 20 prepare_atomic_modification: state is not atomic. state=0x55782d0d28e8 2023-12-07T21:09:36.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.595+0000 7fe774f21800 20 bucket index object: :.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10 2023-12-07T21:09:36.588 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.595+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:124 4.2a 4:564f3fa1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05c350 con 0x55782d00a080 2023-12-07T21:09:36.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.596+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(122 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10 [stat,call,call] v33'11 uv11 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.596+0000 7fe75affd640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2023-12-07T21:09:36.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.596+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(124 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10 [stat,call,call] v33'12 uv12 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.596+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:125 3.3ds0 3:bfbabe11:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05c350 con 0x55782d0101a0 2023-12-07T21:09:36.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 36 ==== osd_op_reply(125 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5_bb3aec0fdcdbc2974890f805c585d432 [call] v33'6 uv6 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:126 4.2a 4:564f3fa1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d056f00 con 0x55782d00a080 2023-12-07T21:09:36.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 20 list_objects_ordered: starting attempt 1 2023-12-07T21:09:36.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-07T21:09:36.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:127 4.30 4:0df880b5:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d056f00 con 0x55782d0101a0 2023-12-07T21:09:36.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:128 4.33 4:ce1bf4b0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05aa00 con 0x7fe75c00f070 2023-12-07T21:09:36.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:129 4.2e 4:77d16012:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d2ba0 con 0x55782d0101a0 2023-12-07T21:09:36.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:130 4.19 4:9b540787:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d067720 con 0x55782d0101a0 2023-12-07T21:09:36.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:131 4.9 4:926b3946:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d06a140 con 0x55782d00a080 2023-12-07T21:09:36.598 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:132 4.b 4:d3fcce7f:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d06cd00 con 0x7fe764065070 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:133 4.4 4:213e5884:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d06fae0 con 0x7fe75c00f070 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:134 4.19 4:989d9f7c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0728f0 con 0x55782d0101a0 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:135 4.33 4:cdd0b9bb:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0756b0 con 0x7fe75c00f070 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:136 4.9 4:904b452b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d056f00 con 0x55782d00a080 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.599+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:137 4.2a 4:564f3fa1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0728f0 con 0x55782d00a080 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 37 ==== osd_op_reply(127 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 38 ==== osd_op_reply(129 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 23 ==== osd_op_reply(132 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 35 ==== osd_op_reply(133 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 39 ==== osd_op_reply(130 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 36 ==== osd_op_reply(128 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76c02ea00 con 0x7fe75c00f070 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(131 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.4 [call out=85b] v0'0 uv17 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76c02ea00 con 0x55782d00a080 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 40 ==== osd_op_reply(134 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.7 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76408f040 con 0x55782d0101a0 2023-12-07T21:09:36.599 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 35 ==== osd_op_reply(136 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.9 [call out=85b] v0'0 uv18 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 36 ==== osd_op_reply(126 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10 [stat,call,call] v33'13 uv13 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe75b7fe640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2023-12-07T21:09:36.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.600+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 37 ==== osd_op_reply(135 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8 [call out=124b] v0'0 uv8 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 37 ==== osd_op_reply(137 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-07T21:09:36.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-07T21:09:36.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-07T21:09:36.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-07T21:09:36.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5])"; uploads.size()=0; is_truncated=0 2023-12-07T21:09:36.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:138 4.30 4:0df880b5:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d056f00 con 0x55782d0101a0 2023-12-07T21:09:36.600 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:139 4.33 4:ce1bf4b0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe75c00f070 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:140 4.2e 4:77d16012:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d06f4a0 con 0x55782d0101a0 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:141 4.19 4:9b540787:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d056f00 con 0x55782d0101a0 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:142 4.9 4:926b3946:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x55782d00a080 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:143 4.b 4:d3fcce7f:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d072400 con 0x7fe764065070 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:144 4.4 4:213e5884:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d056f00 con 0x7fe75c00f070 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:145 4.19 4:989d9f7c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d2ba0 con 0x55782d0101a0 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:146 4.33 4:cdd0b9bb:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d072400 con 0x7fe75c00f070 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:147 4.9 4:904b452b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d067af0 con 0x55782d00a080 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:148 4.2a 4:564f3fa1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d2ba0 con 0x55782d00a080 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 24 ==== osd_op_reply(143 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 41 ==== osd_op_reply(138 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe7640a8040 con 0x55782d0101a0 2023-12-07T21:09:36.601 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 42 ==== osd_op_reply(140 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe7640a8040 con 0x55782d0101a0 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 43 ==== osd_op_reply(141 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe7640a8040 con 0x55782d0101a0 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 38 ==== osd_op_reply(139 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 44 ==== osd_op_reply(145 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.7 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe7640a8040 con 0x55782d0101a0 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 39 ==== osd_op_reply(144 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 40 ==== osd_op_reply(146 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8 [call out=124b] v0'0 uv8 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 38 ==== osd_op_reply(142 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.4 [call out=85b] v0'0 uv17 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 39 ==== osd_op_reply(148 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 40 ==== osd_op_reply(147 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.9 [call out=85b] v0'0 uv18 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.601+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe764065070 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 25 ==== osd_op_reply(149 foo.buckets [call] v33'46 uv46 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe774f21800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe774f21800 10 removing default.rgw.meta+root+myfoo from cache 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe774f21800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-12-07T21:09:36.602 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:150 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93974639783360 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe75c00f070 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 41 ==== watch-notify(notify (1) cookie 93974639515840 notify 141733920794 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x55782cfff3a0 con 0x7fe75c00f070 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe75b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 93974639515840 notifier 4582 bl.length()=149 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 42 ==== osd_op_reply(150 notify.6 [notify cookie 93974639783360 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe75b7fe640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe744004160 con 0x7fe75c00f070 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 43 ==== osd_op_reply(151 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 44 ==== watch-notify(notify_complete (2) cookie 93974639783360 notify 141733920794 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55782cffef40 con 0x7fe75c00f070 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.603+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:152 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe764065070 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.604+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 26 ==== osd_op_reply(152 myfoo [call,call,delete] v33'47 uv47 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.604+0000 7fe774f21800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 from cache 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.604+0000 7fe774f21800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5, ofs0, ns] 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.604+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:153 7.3 7:c609908c:::notify.5:head [notify cookie 93974639783360 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe75c00f070 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.604+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 45 ==== watch-notify(notify (1) cookie 93974639511840 notify 141733920795 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x55782cffef40 con 0x7fe75c00f070 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.604+0000 7fe75b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920795 cookie 93974639511840 notifier 4582 bl.length()=206 2023-12-07T21:09:36.603 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.604+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 46 ==== osd_op_reply(153 notify.5 [notify cookie 93974639783360 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.604+0000 7fe75b7fe640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:154 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe744004160 con 0x7fe75c00f070 2023-12-07T21:09:36.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.605+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 47 ==== osd_op_reply(154 notify.5 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.605+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 48 ==== watch-notify(notify_complete (2) cookie 93974639783360 notify 141733920795 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe76c00a0e0 con 0x7fe75c00f070 2023-12-07T21:09:36.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.605+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:155 8.9 8:919cbaa3:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe764065070 2023-12-07T21:09:36.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 27 ==== osd_op_reply(155 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 [call,call,delete] v33'48 uv48 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:156 4.30 4:0df880b5:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x55782d0101a0 2023-12-07T21:09:36.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:157 4.33 4:ce1bf4b0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05adc0 con 0x7fe75c00f070 2023-12-07T21:09:36.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:158 4.2e 4:77d16012:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d06f2c0 con 0x55782d0101a0 2023-12-07T21:09:36.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:159 4.19 4:9b540787:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d2ba0 con 0x55782d0101a0 2023-12-07T21:09:36.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:160 4.9 4:926b3946:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d053110 con 0x55782d00a080 2023-12-07T21:09:36.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:161 4.b 4:d3fcce7f:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d060590 con 0x7fe764065070 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:162 4.4 4:213e5884:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05adc0 con 0x7fe75c00f070 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:163 4.19 4:989d9f7c:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x55782d0101a0 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:164 4.33 4:cdd0b9bb:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d06f2c0 con 0x7fe75c00f070 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:165 4.9 4:904b452b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d05adc0 con 0x55782d00a080 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.606+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:166 4.2a 4:564f3fa1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d053110 con 0x55782d00a080 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.607+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 41 ==== osd_op_reply(160 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.4 [delete] v33'19 uv19 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.607+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 28 ==== osd_op_reply(161 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.5 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 45 ==== osd_op_reply(156 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.0 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe7640a8040 con 0x55782d0101a0 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 46 ==== osd_op_reply(159 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.3 [delete] v33'5 uv5 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe7640a8040 con 0x55782d0101a0 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 49 ==== osd_op_reply(157 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.1 [delete] v33'9 uv9 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 42 ==== osd_op_reply(165 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.9 [delete] v33'20 uv20 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 50 ==== osd_op_reply(164 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.8 [delete] v33'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 43 ==== osd_op_reply(166 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.10 [delete] v33'14 uv14 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 51 ==== osd_op_reply(162 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.6 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 47 ==== osd_op_reply(163 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.7 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe7640a8040 con 0x55782d0101a0 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 48 ==== osd_op_reply(158 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5.2 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fe7640a8040 con 0x55782d0101a0 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe774f21800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 : miss 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe774f21800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:167 6.10 6:0b740635:::pubsub..bucket.myfoo%2fef4a9585-c98e-4264-8c5b-7c4065599143.4222.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe75c00f070 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 52 ==== osd_op_reply(167 pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe774f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe774f21800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 info.flags=0x0 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe774f21800 10 adding default.rgw.log++pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 to cache LRU end 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe774f21800 10 removing default.rgw.log++pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 from cache 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe774f21800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5, ofs0, ns] 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.608+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:168 7.d 7:b4812045:::notify.4:head [notify cookie 93974639783360 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x55782d00a080 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.609+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 44 ==== watch-notify(notify (1) cookie 93974639509344 notify 141733920787 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x7fe76c00a0e0 con 0x55782d00a080 2023-12-07T21:09:36.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.609+0000 7fe75affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920787 cookie 93974639509344 notifier 4582 bl.length()=203 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.609+0000 7fe75affd640 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:169 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe6b4003240 con 0x55782d00a080 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.609+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 45 ==== osd_op_reply(168 notify.4 [notify cookie 93974639783360 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.609+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 46 ==== osd_op_reply(169 notify.4 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.609+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 47 ==== watch-notify(notify_complete (2) cookie 93974639783360 notify 141733920787 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55782cff82c0 con 0x55782d00a080 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.609+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:170 6.10 6:0b740635:::pubsub..bucket.myfoo%2fef4a9585-c98e-4264-8c5b-7c4065599143.4222.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe75c00f070 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.610+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 53 ==== osd_op_reply(170 pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.5 [delete] v33'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.611+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:171 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe764065070 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.612+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 29 ==== osd_op_reply(171 foo.buckets [call] v33'49 uv49 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.612+0000 7fe7367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.612+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:172 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93974639517456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x55782d00a080 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.613+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 48 ==== osd_op_reply(172 data_loggenerations_metadata [watch unwatch cookie 93974639517456] v33'186 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.613+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:173 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93974637080400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe764065070 2023-12-07T21:09:36.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.614+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 30 ==== osd_op_reply(173 notify.0 [watch unwatch cookie 93974637080400] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.614+0000 7fe774f21800 20 remove_watcher() i=0 2023-12-07T21:09:36.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.614+0000 7fe774f21800 2 removed watcher, disabling cache 2023-12-07T21:09:36.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.614+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:174 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93974639493920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x55782d00a080 2023-12-07T21:09:36.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.615+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 49 ==== osd_op_reply(174 notify.1 [watch unwatch cookie 93974639493920] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.615+0000 7fe774f21800 20 remove_watcher() i=1 2023-12-07T21:09:36.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.615+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:175 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93974639501200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x55782d0101a0 2023-12-07T21:09:36.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.616+0000 7fe770ce5640 1 -- 172.21.15.121:0/478520141 <== osd.3 v2:172.21.15.121:6800/4032235766 49 ==== osd_op_reply(175 notify.2 [watch unwatch cookie 93974639501200] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe7640a8040 con 0x55782d0101a0 2023-12-07T21:09:36.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.616+0000 7fe774f21800 20 remove_watcher() i=2 2023-12-07T21:09:36.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.616+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:176 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93974639506256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe764065070 2023-12-07T21:09:36.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.617+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 <== osd.2 v2:172.21.15.121:6816/2557538450 31 ==== osd_op_reply(176 notify.3 [watch unwatch cookie 93974639506256] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe75c00f5f0 con 0x7fe764065070 2023-12-07T21:09:36.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.617+0000 7fe774f21800 20 remove_watcher() i=3 2023-12-07T21:09:36.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.617+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:177 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93974639509344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x55782d00a080 2023-12-07T21:09:36.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.618+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.1 v2:172.21.15.121:6808/2140819418 50 ==== osd_op_reply(177 notify.4 [watch unwatch cookie 93974639509344] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x55782d00a080 2023-12-07T21:09:36.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.618+0000 7fe774f21800 20 remove_watcher() i=4 2023-12-07T21:09:36.614 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.618+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:178 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93974639511840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe75c00f070 2023-12-07T21:09:36.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.619+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 54 ==== osd_op_reply(178 notify.5 [watch unwatch cookie 93974639511840] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.619+0000 7fe774f21800 20 remove_watcher() i=5 2023-12-07T21:09:36.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.619+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93974639515840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe75c00f070 2023-12-07T21:09:36.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.620+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 55 ==== osd_op_reply(179 notify.6 [watch unwatch cookie 93974639515840] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.620+0000 7fe774f21800 20 remove_watcher() i=6 2023-12-07T21:09:36.615 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.620+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:180 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93974639510384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55782d0d1180 con 0x7fe75c00f070 2023-12-07T21:09:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.621+0000 7fe7714e6640 1 -- 172.21.15.121:0/478520141 <== osd.0 v2:172.21.15.89:6800/654939948 56 ==== osd_op_reply(180 notify.7 [watch unwatch cookie 93974639510384] v33'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe76c063060 con 0x7fe75c00f070 2023-12-07T21:09:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.621+0000 7fe774f21800 20 remove_watcher() i=7 2023-12-07T21:09:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe75c00f070 msgr2=0x7fe75c00e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe75c00f070 0x7fe75c00e8c0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55782d00a080 msgr2=0x55782d00c540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55782d00a080 0x55782d00c540 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe764065070 msgr2=0x7fe76406e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe764065070 0x7fe76406e820 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55782d0101a0 msgr2=0x55782d012610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55782d0101a0 0x55782d012610 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe7480360c0 msgr2=0x7fe748038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe7480360c0 0x7fe748038580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe75c000f60 tx=0x7fe75c0012f0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 msgr2=0x55782cffea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cffea00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00a930 tx=0x7fe76c003370 comp rx=0 tx=0).stop 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe76bfff640 1 -- 172.21.15.121:0/478520141 reap_dead start 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 shutdown_connections 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 --2- 172.21.15.121:0/478520141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cff7960 0x55782cffea00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 >> 172.21.15.121:0/478520141 conn(0x55782cf411b0 msgr2=0x55782cff1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 shutdown_connections 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/478520141 wait complete. 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/590549644 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe754036110 msgr2=0x7fe7540385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 --2- 172.21.15.121:0/590549644 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe754036110 0x7fe7540385d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe764044890 tx=0x7fe764079040 comp rx=0 tx=0).stop 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/590549644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 msgr2=0x55782cfeb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 --2- 172.21.15.121:0/590549644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfeb6f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe764005870 tx=0x7fe764002fb0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/590549644 shutdown_connections 2023-12-07T21:09:36.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 --2- 172.21.15.121:0/590549644 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe754036110 0x7fe7540385d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 --2- 172.21.15.121:0/590549644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55782cf40850 0x55782cfeb6f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/590549644 >> 172.21.15.121:0/590549644 conn(0x55782cf38f70 msgr2=0x55782cfe30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/590549644 shutdown_connections 2023-12-07T21:09:36.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.622+0000 7fe774f21800 1 -- 172.21.15.121:0/590549644 wait complete. 2023-12-07T21:09:36.620 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2023-12-07T21:09:36.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2023-12-07T21:09:36.620 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2023-12-07T21:09:36.704 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:36.704 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:36.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.712+0000 7f90d2f26800 1 Processor -- start 2023-12-07T21:09:36.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.712+0000 7f90d2f26800 1 -- start start 2023-12-07T21:09:36.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.712+0000 7f90d2f26800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56022bec7860 0x56022bec9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.712+0000 7f90d2f26800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56022be0f740 con 0x56022bec48d0 2023-12-07T21:09:36.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.712+0000 7f90d2f26800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x56022bdd8880 con 0x56022bec7860 2023-12-07T21:09:36.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.712+0000 7f90ce322640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x56022bec7860 0x56022bec9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.712+0000 7f90ceb23640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x56022bec48d0 0x56022bec4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:38102/0 (socket says 172.21.15.121:38102) 2023-12-07T21:09:36.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.712+0000 7f90ceb23640 1 -- 172.21.15.121:0/4277747440 learned_addr learned my addr 172.21.15.121:0/4277747440 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:36.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.713+0000 7f90cdb21640 1 -- 172.21.15.121:0/4277747440 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334734737 0 0) 0x56022be0f740 con 0x56022bec48d0 2023-12-07T21:09:36.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.713+0000 7f90cdb21640 1 -- 172.21.15.121:0/4277747440 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b8001e10 con 0x56022bec48d0 2023-12-07T21:09:36.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.713+0000 7f90ce322640 1 -- 172.21.15.121:0/4277747440 >> v1:172.21.15.89:6789/0 conn(0x56022bec48d0 legacy=0x56022bec4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.713+0000 7f90ce322640 1 -- 172.21.15.121:0/4277747440 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56022becb1a0 con 0x56022bec7860 2023-12-07T21:09:36.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.714+0000 7f90ce322640 1 --2- 172.21.15.121:0/4277747440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec7860 0x56022bec9c50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f90c400a470 tx=0x7f90c401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e5bdc758890e0e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.715+0000 7f90cdb21640 1 -- 172.21.15.121:0/4277747440 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90c404ad60 con 0x56022bec7860 2023-12-07T21:09:36.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.715+0000 7f90cdb21640 1 -- 172.21.15.121:0/4277747440 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c4052440 con 0x56022bec7860 2023-12-07T21:09:36.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.715+0000 7f90cdb21640 1 -- 172.21.15.121:0/4277747440 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90c4052700 con 0x56022bec7860 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.715+0000 7f90d2f26800 1 -- 172.21.15.121:0/4277747440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec7860 msgr2=0x56022bec9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.715+0000 7f90d2f26800 1 --2- 172.21.15.121:0/4277747440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec7860 0x56022bec9c50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f90c400a470 tx=0x7f90c401cc80 comp rx=0 tx=0).stop 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.715+0000 7f90d2f26800 1 -- 172.21.15.121:0/4277747440 shutdown_connections 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.715+0000 7f90d2f26800 1 --2- 172.21.15.121:0/4277747440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec7860 0x56022bec9c50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.715+0000 7f90d2f26800 1 -- 172.21.15.121:0/4277747440 >> 172.21.15.121:0/4277747440 conn(0x56022bebcf70 msgr2=0x56022bebf390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.715+0000 7f90d2f26800 1 -- 172.21.15.121:0/4277747440 shutdown_connections 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.715+0000 7f90d2f26800 1 -- 172.21.15.121:0/4277747440 wait complete. 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.716+0000 7f90d2f26800 1 Processor -- start 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.716+0000 7f90d2f26800 1 -- start start 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.716+0000 7f90d2f26800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bf67c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.716+0000 7f90d2f26800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022bdd5db0 con 0x56022bec48d0 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.716+0000 7f90ceb23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bf67c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.716+0000 7f90ceb23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bf67c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54764/0 (socket says 172.21.15.121:54764) 2023-12-07T21:09:36.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.716+0000 7f90ceb23640 1 -- 172.21.15.121:0/4218238882 learned_addr learned my addr 172.21.15.121:0/4218238882 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90ceb23640 1 -- 172.21.15.121:0/4218238882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4005d20 con 0x56022bec48d0 2023-12-07T21:09:36.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90ceb23640 1 --2- 172.21.15.121:0/4218238882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bf67c70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f90c0001ca0 tx=0x7f90c000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5942e11d08d69f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90cd320640 1 -- 172.21.15.121:0/4218238882 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90c000e470 con 0x56022bec48d0 2023-12-07T21:09:36.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90cd320640 1 -- 172.21.15.121:0/4218238882 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c000e5d0 con 0x56022bec48d0 2023-12-07T21:09:36.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90cd320640 1 -- 172.21.15.121:0/4218238882 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90c000e8f0 con 0x56022bec48d0 2023-12-07T21:09:36.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90d2f26800 1 -- 172.21.15.121:0/4218238882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 msgr2=0x56022bf67c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90d2f26800 1 --2- 172.21.15.121:0/4218238882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bf67c70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f90c0001ca0 tx=0x7f90c000b6c0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90d2f26800 1 -- 172.21.15.121:0/4218238882 shutdown_connections 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90d2f26800 1 --2- 172.21.15.121:0/4218238882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bf67c70 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90d2f26800 1 -- 172.21.15.121:0/4218238882 >> 172.21.15.121:0/4218238882 conn(0x56022bebcf70 msgr2=0x56022bf638e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90d2f26800 1 -- 172.21.15.121:0/4218238882 shutdown_connections 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.717+0000 7f90d2f26800 1 -- 172.21.15.121:0/4218238882 wait complete. 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.718+0000 7f90d2f26800 1 Processor -- start 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.718+0000 7f90d2f26800 1 -- start start 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.718+0000 7f90d2f26800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bec3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.718+0000 7f90d2f26800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022bdd16a0 con 0x56022bec48d0 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.718+0000 7f90ceb23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bec3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.718+0000 7f90ceb23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bec3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54768/0 (socket says 172.21.15.121:54768) 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.718+0000 7f90ceb23640 1 -- 172.21.15.121:0/3235840081 learned_addr learned my addr 172.21.15.121:0/3235840081 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.718+0000 7f90ceb23640 1 -- 172.21.15.121:0/3235840081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b8001e10 con 0x56022bec48d0 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.718+0000 7f90ceb23640 1 --2- 172.21.15.121:0/3235840081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bec3ed0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f90c0000c00 tx=0x7f90c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90b7fff640 1 -- 172.21.15.121:0/3235840081 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90c001f070 con 0x56022bec48d0 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90b7fff640 1 -- 172.21.15.121:0/3235840081 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c0018770 con 0x56022bec48d0 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90d2f26800 1 -- 172.21.15.121:0/3235840081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56022bec4410 con 0x56022bec48d0 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90b7fff640 1 -- 172.21.15.121:0/3235840081 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90c0018a90 con 0x56022bec48d0 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90d2f26800 1 -- 172.21.15.121:0/3235840081 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56022bec2950 con 0x56022bec48d0 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90d2f26800 1 Processor -- start 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90d2f26800 1 -- start start 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90d2f26800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 0x56022bf7d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.725 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90d2f26800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022bd6b890 con 0x56022bf7d440 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90b7fff640 1 -- 172.21.15.121:0/3235840081 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f90c0018bf0 con 0x56022bec48d0 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90cf324640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 0x56022bf7d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90cf324640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 0x56022bf7d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54770/0 (socket says 172.21.15.121:54770) 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.719+0000 7f90cf324640 1 -- 172.21.15.121:0/3144768134 learned_addr learned my addr 172.21.15.121:0/3144768134 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90b7fff640 1 --2- 172.21.15.121:0/3235840081 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f90bc036110 0x7f90bc0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90cf324640 1 -- 172.21.15.121:0/3144768134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56022bf7dda0 con 0x56022bf7d440 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90b7fff640 1 -- 172.21.15.121:0/3235840081 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f90c004baa0 con 0x56022bec48d0 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90ceb23640 1 --2- 172.21.15.121:0/3235840081 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f90bc036110 0x7f90bc0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90cf324640 1 --2- 172.21.15.121:0/3144768134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 0x56022bf7d860 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f90c800a430 tx=0x7f90c800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d1a36df53cdc9b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90b5ffb640 1 -- 172.21.15.121:0/3144768134 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90c8001650 con 0x56022bf7d440 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90b5ffb640 1 -- 172.21.15.121:0/3144768134 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c80017d0 con 0x56022bf7d440 2023-12-07T21:09:36.726 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90b5ffb640 1 -- 172.21.15.121:0/3144768134 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90c8001ab0 con 0x56022bf7d440 2023-12-07T21:09:36.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90d2f26800 1 -- 172.21.15.121:0/3144768134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 msgr2=0x56022bf7d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90d2f26800 1 --2- 172.21.15.121:0/3144768134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 0x56022bf7d860 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f90c800a430 tx=0x7f90c800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90ceb23640 1 --2- 172.21.15.121:0/3235840081 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f90bc036110 0x7f90bc0385d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f90c0018fd0 tx=0x7f90c0018f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90d2f26800 1 -- 172.21.15.121:0/3144768134 shutdown_connections 2023-12-07T21:09:36.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90d2f26800 1 --2- 172.21.15.121:0/3144768134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 0x56022bf7d860 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90d2f26800 1 -- 172.21.15.121:0/3144768134 >> 172.21.15.121:0/3144768134 conn(0x56022bec7860 msgr2=0x56022bf78820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90d2f26800 1 -- 172.21.15.121:0/3144768134 shutdown_connections 2023-12-07T21:09:36.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.720+0000 7f90d2f26800 1 -- 172.21.15.121:0/3144768134 wait complete. 2023-12-07T21:09:36.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.721+0000 7f90d2f26800 1 Processor -- start 2023-12-07T21:09:36.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.721+0000 7f90d2f26800 1 -- start start 2023-12-07T21:09:36.727 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.721+0000 7f90d2f26800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 0x56022bf84470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.721+0000 7f90d2f26800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x56022bd6b530 con 0x56022bf7d440 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.721+0000 7f90cf324640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 0x56022bf84470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.721+0000 7f90cf324640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 0x56022bf84470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54776/0 (socket says 172.21.15.121:54776) 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.721+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 learned_addr learned my addr 172.21.15.121:0/1687199728 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.721+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c800a0e0 con 0x56022bf7d440 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.721+0000 7f90cf324640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 0x56022bf84470 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f90c800a930 tx=0x7f90c8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.722+0000 7f90affff640 1 -- 172.21.15.121:0/1687199728 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90c8010900 con 0x56022bf7d440 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.722+0000 7f90affff640 1 -- 172.21.15.121:0/1687199728 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c8010a60 con 0x56022bf7d440 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.722+0000 7f90affff640 1 -- 172.21.15.121:0/1687199728 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90c8010d20 con 0x56022bf7d440 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.722+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56022bf849b0 con 0x56022bf7d440 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.722+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56022bf84e10 con 0x56022bf7d440 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.722+0000 7f90affff640 1 -- 172.21.15.121:0/1687199728 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f90c8017030 con 0x56022bf7d440 2023-12-07T21:09:36.728 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.723+0000 7f90affff640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f90a8036110 0x7f90a80385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.723+0000 7f90affff640 1 -- 172.21.15.121:0/1687199728 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f90c804b8a0 con 0x56022bf7d440 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.723+0000 7f90ce322640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f90a8036110 0x7f90a80385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.723+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.723+0000 7f90d2f26800 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56022bf8fbc0 0x56022bf92080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.723+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf927d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.723+0000 7f90ce322640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f90a8036110 0x7f90a80385d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90c4054000 tx=0x7f90c404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.723+0000 7f90cf324640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56022bf8fbc0 0x56022bf92080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.723+0000 7f90cf324640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56022bf8fbc0 0x56022bf92080 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 20 realm 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.729 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf92be0 con 0x56022bf8fbc0 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf93460 con 0x56022bf8fbc0 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf937c0 con 0x56022bf8fbc0 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.730 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.724+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf93fc0 con 0x56022bf8fbc0 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.725+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.725+0000 7f90d2f26800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.725+0000 7f90d2f26800 20 searching for the correct realm 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.725+0000 7f90d2f26800 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56022bf95ce0 0x56022bf98170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.725+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf95ce0 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.725+0000 7f90ceb23640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56022bf95ce0 0x56022bf98170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.725+0000 7f90ceb23640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56022bf95ce0 0x56022bf98170 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.725+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.725+0000 7f90ceb23640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f90c0017050 0x7f90c002d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.725+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c0017050 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.726+0000 7f90ce322640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f90c0017050 0x7f90c002d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.726+0000 7f90ce322640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f90c0017050 0x7f90c002d440 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.731 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.726+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c40525b0 con 0x7f90c0017050 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.726+0000 7f90ce322640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f90c405c920 0x7f90c4009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.726+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c405c920 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.726+0000 7f90cf324640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f90c405c920 0x7f90c4009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.727+0000 7f90cf324640 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f90c405c920 0x7f90c4009410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.727+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.727+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf8fbc0 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.727+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.727+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf8fbc0 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.727+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.727+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c405c920 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.728+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.728+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c405c920 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.728+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.728+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c0017050 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.728+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c40525b0 con 0x7f90c0017050 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.728+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf95ce0 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.728+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.728+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf8fbc0 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.729+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.729+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c405c920 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.729+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.729+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf8fbc0 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.729+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.729+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c0017050 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.729+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f90c40525b0 con 0x7f90c0017050 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.729+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf95ce0 2023-12-07T21:09:36.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.730+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.730+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf95ce0 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.730+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.730+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c405c920 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.730+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.730+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf95ce0 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.730+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.730+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf95ce0 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.730+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.730+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf8fbc0 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.731+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.731+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf8fbc0 2023-12-07T21:09:36.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.731+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.731+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c405c920 2023-12-07T21:09:36.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.731+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.732+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf95ce0 2023-12-07T21:09:36.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.732+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.732+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c0017050 2023-12-07T21:09:36.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.732+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c40525b0 con 0x7f90c0017050 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.732+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf8fbc0 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.732+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.732+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c405c920 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.733+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.733+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf95ce0 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.733+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.733+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c405c920 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.733+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.733+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c0017050 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.733+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c40525b0 con 0x7f90c0017050 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.733+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf95ce0 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.733+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.733+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x7f90c405c920 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98840 con 0x56022bf8fbc0 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f90c8053080 con 0x7f90c0017050 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f90c4070040 con 0x7f90c0017050 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90d2f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90d2f26800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90d2f26800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90d2f26800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90d2f26800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90d2f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf948c0 con 0x56022bf8fbc0 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90d2f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.734+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf94540 con 0x56022bf8fbc0 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf95190 con 0x56022bf95ce0 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 20 zone default found 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 4 Realm: () 2023-12-07T21:09:36.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 20 zonegroup default 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf98c80 con 0x7f90c405c920 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.735+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9ab00 con 0x56022bf95ce0 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.736+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.736+0000 7f90d2f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.736+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.736+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9ae60 con 0x56022bf95ce0 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.736+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.736+0000 7f90d2f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.736+0000 7f90d2f26800 20 started sync module instance, tier type = 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.736+0000 7f90d2f26800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.736+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9a0d0 con 0x7f90c0017050 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.737+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c4070040 con 0x7f90c0017050 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.737+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94567325282128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9a4b0 con 0x7f90c0017050 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.737+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9b660 con 0x56022bf8fbc0 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.738+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94567325282128] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c4070040 con 0x7f90c0017050 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.738+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.738+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94567327702064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9b660 con 0x56022bf8fbc0 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.738+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9bfd0 con 0x56022bf95ce0 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.739+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94567327702064] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.739+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.739+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94567327707584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9b5d0 con 0x56022bf95ce0 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.739+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9ccc0 con 0x7f90c0017050 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.740+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c4070040 con 0x7f90c0017050 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.740+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94567327707584] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.740+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94567327712400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9d510 con 0x7f90c0017050 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.740+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9dd10 con 0x56022bf8fbc0 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.741+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.741+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94567327717760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9e560 con 0x56022bf8fbc0 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.742+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9ef10 con 0x7f90c405c920 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.742+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94567327712400] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c4070040 con 0x7f90c0017050 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.742+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.742+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94567327715440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9eed0 con 0x7f90c405c920 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.742+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9f7f0 con 0x7f90c405c920 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.743+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94567327717760] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.743+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.743+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94567327724272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9f7b0 con 0x7f90c405c920 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.743+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bfa0120 con 0x7f90c405c920 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.744+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94567327715440] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.744+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v33'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.744+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94567327722032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bfa0120 con 0x7f90c405c920 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.744+0000 7f90d2f26800 20 add_watcher() i=0 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.744+0000 7f90d2f26800 20 add_watcher() i=1 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.744+0000 7f90d2f26800 20 add_watcher() i=2 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.744+0000 7f90d2f26800 20 add_watcher() i=3 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.744+0000 7f90d2f26800 20 add_watcher() i=4 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.744+0000 7f90d2f26800 20 add_watcher() i=5 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.745+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94567327724272] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.745+0000 7f90d2f26800 20 add_watcher() i=6 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.745+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94567327722032] v33'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.745+0000 7f90d2f26800 20 add_watcher() i=7 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.745+0000 7f90d2f26800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.745+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bfa3150 con 0x56022bf8fbc0 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.746+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.746+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94567327726720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bfa0530 con 0x56022bf8fbc0 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94567327726720] v33'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f9094fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f90d2f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f90d2f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f90d2f26800 5 note: GC not initialized 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f900f7fe640 20 reqs_thread_entry: start 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f90d2f26800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:36.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f90d2f26800 20 Filter name: none 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f900d7fa640 20 reqs_thread_entry: start 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f90d2f26800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f90d2f26800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.747+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bfd5f50 con 0x56022bf8fbc0 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.748+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.748+0000 7f90d2f26800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.748+0000 7f90d2f26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.748+0000 7f90d2f26800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.748+0000 7f90d2f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.748+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~369 in=369b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bfdba50 con 0x56022bf8fbc0 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~369] v33'14 uv14 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90d2f26800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90d2f26800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:36.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90d2f26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:36.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94567327970512 in=557b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bfd8830 con 0x56022bf8fbc0 2023-12-07T21:09:36.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94567327717760 notify 141733920788 ret 0) v3 ==== 587+0+0 (crc 0 0 0) 0x56022bf84e10 con 0x56022bf8fbc0 2023-12-07T21:09:36.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920788 cookie 94567327717760 notifier 4588 bl.length()=545 2023-12-07T21:09:36.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(64 notify.4 [notify cookie 94567327970512 out=8b] v0'0 uv180 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90b5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:36.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90b5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:36.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90b5ffb640 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f90a40042a0 con 0x56022bf8fbc0 2023-12-07T21:09:36.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.749+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.750+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== watch-notify(notify_complete (2) cookie 94567327970512 notify 141733920788 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56022bf849b0 con 0x56022bf8fbc0 2023-12-07T21:09:36.755 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:36.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.750+0000 7f9094fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.750+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94567327726720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bfbedd0 con 0x56022bf8fbc0 2023-12-07T21:09:36.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.751+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94567327726720] v33'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.751+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94567325282128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf8d300 con 0x7f90c0017050 2023-12-07T21:09:36.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.752+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94567325282128] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c4070040 con 0x7f90c0017050 2023-12-07T21:09:36.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.752+0000 7f90d2f26800 20 remove_watcher() i=0 2023-12-07T21:09:36.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.752+0000 7f90d2f26800 2 removed watcher, disabling cache 2023-12-07T21:09:36.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.752+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94567327702064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf8d660 con 0x56022bf8fbc0 2023-12-07T21:09:36.760 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.753+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94567327702064] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.754+0000 7f90d2f26800 20 remove_watcher() i=1 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.754+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94567327707584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf8d660 con 0x56022bf95ce0 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.755+0000 7f90ceb23640 1 -- 172.21.15.121:0/1687199728 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94567327707584] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c0035070 con 0x56022bf95ce0 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.755+0000 7f90d2f26800 20 remove_watcher() i=2 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.755+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94567327712400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bfd4940 con 0x7f90c0017050 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.756+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94567327712400] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c4070040 con 0x7f90c0017050 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.756+0000 7f90d2f26800 20 remove_watcher() i=3 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.756+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94567327717760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bfd4ca0 con 0x56022bf8fbc0 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.757+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94567327717760] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x56022bf8fbc0 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.757+0000 7f90d2f26800 20 remove_watcher() i=4 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.757+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94567327715440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bfd4ca0 con 0x7f90c405c920 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.758+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94567327715440] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.758+0000 7f90d2f26800 20 remove_watcher() i=5 2023-12-07T21:09:36.761 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.758+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94567327724272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9d070 con 0x7f90c405c920 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.759+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94567327724272] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.759+0000 7f90d2f26800 20 remove_watcher() i=6 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.759+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94567327722032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56022bf9d070 con 0x7f90c405c920 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90cf324640 1 -- 172.21.15.121:0/1687199728 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94567327722032] v33'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f90c802e9d0 con 0x7f90c405c920 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 20 remove_watcher() i=7 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f90c405c920 msgr2=0x7f90c4009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f90c405c920 0x7f90c4009410 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56022bf8fbc0 msgr2=0x56022bf92080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x56022bf8fbc0 0x56022bf92080 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f90c0017050 msgr2=0x7f90c002d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f90c0017050 0x7f90c002d440 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56022bf95ce0 msgr2=0x56022bf98170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56022bf95ce0 0x56022bf98170 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f90a8036110 msgr2=0x7f90a80385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.762 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f90a8036110 0x7f90a80385d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90c4054000 tx=0x7f90c404e000 comp rx=0 tx=0).stop 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 msgr2=0x56022bf84470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 --2- 172.21.15.121:0/1687199728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bf7d440 0x56022bf84470 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f90c800a930 tx=0x7f90c8003370 comp rx=0 tx=0).stop 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 reap_dead start 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90ce322640 1 -- 172.21.15.121:0/1687199728 reap_dead start 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 shutdown_connections 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 >> 172.21.15.121:0/1687199728 conn(0x56022bec7860 msgr2=0x56022bf783f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 shutdown_connections 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/1687199728 wait complete. 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/3235840081 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f90bc036110 msgr2=0x7f90bc0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 --2- 172.21.15.121:0/3235840081 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f90bc036110 0x7f90bc0385d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f90c0018fd0 tx=0x7f90c0018f20 comp rx=0 tx=0).stop 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/3235840081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 msgr2=0x56022bec3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 --2- 172.21.15.121:0/3235840081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bec3ed0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f90c0000c00 tx=0x7f90c0000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/3235840081 shutdown_connections 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 --2- 172.21.15.121:0/3235840081 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f90bc036110 0x7f90bc0385d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 --2- 172.21.15.121:0/3235840081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x56022bec48d0 0x56022bec3ed0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/3235840081 >> 172.21.15.121:0/3235840081 conn(0x56022bebcf70 msgr2=0x56022bf66980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/3235840081 shutdown_connections 2023-12-07T21:09:36.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.760+0000 7f90d2f26800 1 -- 172.21.15.121:0/3235840081 wait complete. 2023-12-07T21:09:36.764 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:36.764 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2023-12-07T21:09:36.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2023-12-07T21:09:36.764 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2023-12-07T21:09:36.808 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:36.809 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:36.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.817+0000 7f62959ad800 1 Processor -- start 2023-12-07T21:09:36.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.817+0000 7f62959ad800 1 -- start start 2023-12-07T21:09:36.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.817+0000 7f62959ad800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562f033b3680 0x562f033b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.817+0000 7f62959ad800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562f032fb740 con 0x562f033af290 2023-12-07T21:09:36.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.817+0000 7f62959ad800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x562f032c4880 con 0x562f033b3680 2023-12-07T21:09:36.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.817+0000 7f62934ad640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x562f033af290 0x562f033af6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:38108/0 (socket says 172.21.15.121:38108) 2023-12-07T21:09:36.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.817+0000 7f62934ad640 1 -- 172.21.15.121:0/3532191135 learned_addr learned my addr 172.21.15.121:0/3532191135 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:09:36.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.817+0000 7f6292cac640 1 --2- 172.21.15.121:0/3532191135 >> v2:172.21.15.89:3300/0 conn(0x562f033b3680 0x562f033b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.817+0000 7f6292cac640 1 -- 172.21.15.121:0/3532191135 >> v1:172.21.15.89:6789/0 conn(0x562f033af290 legacy=0x562f033af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.817+0000 7f62924ab640 1 -- 172.21.15.121:0/3532191135 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507211113 0 0) 0x562f032fb740 con 0x562f033af290 2023-12-07T21:09:36.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.817+0000 7f6292cac640 1 -- 172.21.15.121:0/3532191135 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f033b70a0 con 0x562f033b3680 2023-12-07T21:09:36.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.819+0000 7f6292cac640 1 --2- 172.21.15.121:0/3532191135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033b3680 0x562f033b5a70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f628800a470 tx=0x7f628801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3f3ef3b380d42c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.819+0000 7f62924ab640 1 -- 172.21.15.121:0/3532191135 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6288052570 con 0x562f033b3680 2023-12-07T21:09:36.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.819+0000 7f62924ab640 1 -- 172.21.15.121:0/3532191135 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62880526d0 con 0x562f033b3680 2023-12-07T21:09:36.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.819+0000 7f62924ab640 1 -- 172.21.15.121:0/3532191135 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6288052990 con 0x562f033b3680 2023-12-07T21:09:36.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.820+0000 7f62959ad800 1 -- 172.21.15.121:0/3532191135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033b3680 msgr2=0x562f033b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.820+0000 7f62959ad800 1 --2- 172.21.15.121:0/3532191135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033b3680 0x562f033b5a70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f628800a470 tx=0x7f628801cd60 comp rx=0 tx=0).stop 2023-12-07T21:09:36.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.820+0000 7f62959ad800 1 -- 172.21.15.121:0/3532191135 shutdown_connections 2023-12-07T21:09:36.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.820+0000 7f62959ad800 1 --2- 172.21.15.121:0/3532191135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033b3680 0x562f033b5a70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.820+0000 7f62959ad800 1 -- 172.21.15.121:0/3532191135 >> 172.21.15.121:0/3532191135 conn(0x562f033aa990 msgr2=0x562f033acdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.820+0000 7f62959ad800 1 -- 172.21.15.121:0/3532191135 shutdown_connections 2023-12-07T21:09:36.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.820+0000 7f62959ad800 1 -- 172.21.15.121:0/3532191135 wait complete. 2023-12-07T21:09:36.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f62959ad800 1 Processor -- start 2023-12-07T21:09:36.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f62959ad800 1 -- start start 2023-12-07T21:09:36.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f62959ad800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f03453c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f62959ad800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f032c1db0 con 0x562f033af290 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f62934ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f03453c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f62934ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f03453c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54790/0 (socket says 172.21.15.121:54790) 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f62934ad640 1 -- 172.21.15.121:0/1178649063 learned_addr learned my addr 172.21.15.121:0/1178649063 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f62934ad640 1 -- 172.21.15.121:0/1178649063 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6288005d20 con 0x562f033af290 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f62934ad640 1 --2- 172.21.15.121:0/1178649063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f03453c50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f628400b240 tx=0x7f628400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f904b63f64c661f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f6291caa640 1 -- 172.21.15.121:0/1178649063 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6284014070 con 0x562f033af290 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f6291caa640 1 -- 172.21.15.121:0/1178649063 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628400d500 con 0x562f033af290 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.821+0000 7f6291caa640 1 -- 172.21.15.121:0/1178649063 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628400d820 con 0x562f033af290 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.822+0000 7f62959ad800 1 -- 172.21.15.121:0/1178649063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 msgr2=0x562f03453c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.822+0000 7f62959ad800 1 --2- 172.21.15.121:0/1178649063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f03453c50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f628400b240 tx=0x7f628400b700 comp rx=0 tx=0).stop 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.822+0000 7f62959ad800 1 -- 172.21.15.121:0/1178649063 shutdown_connections 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.822+0000 7f62959ad800 1 --2- 172.21.15.121:0/1178649063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f03453c50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.825 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.822+0000 7f62959ad800 1 -- 172.21.15.121:0/1178649063 >> 172.21.15.121:0/1178649063 conn(0x562f033aa990 msgr2=0x562f0344f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.822+0000 7f62959ad800 1 -- 172.21.15.121:0/1178649063 shutdown_connections 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.822+0000 7f62959ad800 1 -- 172.21.15.121:0/1178649063 wait complete. 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.822+0000 7f62959ad800 1 Processor -- start 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.822+0000 7f62959ad800 1 -- start start 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.822+0000 7f62959ad800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f0345b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.822+0000 7f62959ad800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f032bd6a0 con 0x562f033af290 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.823+0000 7f62934ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f0345b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.823+0000 7f62934ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f0345b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54804/0 (socket says 172.21.15.121:54804) 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.823+0000 7f62934ad640 1 -- 172.21.15.121:0/531252453 learned_addr learned my addr 172.21.15.121:0/531252453 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.823+0000 7f62934ad640 1 -- 172.21.15.121:0/531252453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284001ba0 con 0x562f033af290 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.823+0000 7f62934ad640 1 --2- 172.21.15.121:0/531252453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f0345b150 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x562f03450340 tx=0x7f6284000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.823+0000 7f6290ca8640 1 -- 172.21.15.121:0/531252453 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628400de10 con 0x562f033af290 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.823+0000 7f6290ca8640 1 -- 172.21.15.121:0/531252453 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6284020070 con 0x562f033af290 2023-12-07T21:09:36.826 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.823+0000 7f62959ad800 1 -- 172.21.15.121:0/531252453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562f0345b690 con 0x562f033af290 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.823+0000 7f6290ca8640 1 -- 172.21.15.121:0/531252453 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628400fc10 con 0x562f033af290 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.823+0000 7f62959ad800 1 -- 172.21.15.121:0/531252453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f0345bb70 con 0x562f033af290 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f62959ad800 1 Processor -- start 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f62959ad800 1 -- start start 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f62959ad800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 0x562f034677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f62959ad800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f03257890 con 0x562f034673a0 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f6290ca8640 1 -- 172.21.15.121:0/531252453 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f628400d040 con 0x562f033af290 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f6293cae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 0x562f034677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f6290ca8640 1 --2- 172.21.15.121:0/531252453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6280036110 0x7f62800385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f6293cae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 0x562f034677c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54808/0 (socket says 172.21.15.121:54808) 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f6293cae640 1 -- 172.21.15.121:0/1249592636 learned_addr learned my addr 172.21.15.121:0/1249592636 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f6290ca8640 1 -- 172.21.15.121:0/531252453 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f628400a040 con 0x562f033af290 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f62934ad640 1 --2- 172.21.15.121:0/531252453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6280036110 0x7f62800385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.827 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.824+0000 7f6293cae640 1 -- 172.21.15.121:0/1249592636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f03467d00 con 0x562f034673a0 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f6293cae640 1 --2- 172.21.15.121:0/1249592636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 0x562f034677c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f628c00a430 tx=0x7f628c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97d5a936399084e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f62934ad640 1 --2- 172.21.15.121:0/531252453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6280036110 0x7f62800385d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6284001630 tx=0x7f6284034040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f627a7fc640 1 -- 172.21.15.121:0/1249592636 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c001650 con 0x562f034673a0 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f627a7fc640 1 -- 172.21.15.121:0/1249592636 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c0017d0 con 0x562f034673a0 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f627a7fc640 1 -- 172.21.15.121:0/1249592636 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c001ab0 con 0x562f034673a0 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f62959ad800 1 -- 172.21.15.121:0/1249592636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 msgr2=0x562f034677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f62959ad800 1 --2- 172.21.15.121:0/1249592636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 0x562f034677c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f628c00a430 tx=0x7f628c00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f62959ad800 1 -- 172.21.15.121:0/1249592636 shutdown_connections 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f62959ad800 1 --2- 172.21.15.121:0/1249592636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 0x562f034677c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f62959ad800 1 -- 172.21.15.121:0/1249592636 >> 172.21.15.121:0/1249592636 conn(0x562f033b3680 msgr2=0x562f03462780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f62959ad800 1 -- 172.21.15.121:0/1249592636 shutdown_connections 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f62959ad800 1 -- 172.21.15.121:0/1249592636 wait complete. 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f62959ad800 1 Processor -- start 2023-12-07T21:09:36.828 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.825+0000 7f62959ad800 1 -- start start 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f62959ad800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 0x562f03325b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f62959ad800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f03257530 con 0x562f034673a0 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f6293cae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 0x562f03325b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f6293cae640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 0x562f03325b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54812/0 (socket says 172.21.15.121:54812) 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 learned_addr learned my addr 172.21.15.121:0/3348558952 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c00a0e0 con 0x562f034673a0 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f6293cae640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 0x562f03325b90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f628c00a930 tx=0x7f628c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f6278ff9640 1 -- 172.21.15.121:0/3348558952 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c010900 con 0x562f034673a0 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f6278ff9640 1 -- 172.21.15.121:0/3348558952 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c010a60 con 0x562f034673a0 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562f03324210 con 0x562f034673a0 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f6278ff9640 1 -- 172.21.15.121:0/3348558952 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c010d20 con 0x562f034673a0 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.826+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f03324670 con 0x562f034673a0 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.827+0000 7f6278ff9640 1 -- 172.21.15.121:0/3348558952 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f628c017030 con 0x562f034673a0 2023-12-07T21:09:36.829 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.827+0000 7f6278ff9640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f626c036110 0x7f626c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.827+0000 7f6278ff9640 1 -- 172.21.15.121:0/3348558952 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f628c04b8a0 con 0x562f034673a0 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.827+0000 7f6292cac640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f626c036110 0x7f626c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.828+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.828+0000 7f6292cac640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f626c036110 0x7f626c0385d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6288054000 tx=0x7f628804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.828+0000 7f62959ad800 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562f0347bd50 0x562f0347e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.828+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0347e960 con 0x562f0347bd50 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.828+0000 7f6293cae640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562f0347bd50 0x562f0347e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.828+0000 7f6293cae640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562f0347bd50 0x562f0347e210 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.828+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.828+0000 7f62959ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.828+0000 7f62959ad800 20 realm 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.828+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.828+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0347ed70 con 0x562f0347bd50 2023-12-07T21:09:36.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0347f5f0 con 0x562f0347bd50 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0347f950 con 0x562f0347bd50 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03480150 con 0x562f0347bd50 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:36.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 20 searching for the correct realm 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562f03481e70 0x562f03484300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.829+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f03481e70 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.830+0000 7f62934ad640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562f03481e70 0x562f03484300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.830+0000 7f62934ad640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562f03481e70 0x562f03484300 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.830+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.830+0000 7f62934ad640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6284018870 0x7f628400ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.830+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f6284018870 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.830+0000 7f6292cac640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6284018870 0x7f628400ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.831+0000 7f6292cac640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6284018870 0x7f628400ea60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.831+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6288052840 con 0x7f6284018870 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.831+0000 7f6292cac640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f628805ca90 0x7f62880673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.831+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f628805ca90 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.831+0000 7f6293cae640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f628805ca90 0x7f62880673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.831+0000 7f6293cae640 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f628805ca90 0x7f62880673d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.832+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.832+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f0347bd50 2023-12-07T21:09:36.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.832+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.832+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f0347bd50 2023-12-07T21:09:36.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.832+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.832+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f628805ca90 2023-12-07T21:09:36.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.832+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.832+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f628805ca90 2023-12-07T21:09:36.843 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.833+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.833+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f6284018870 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.833+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6288052840 con 0x7f6284018870 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.833+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f03481e70 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.833+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.833+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f0347bd50 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.833+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.833+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f628805ca90 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.834+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.834+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f0347bd50 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.834+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.834+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f6284018870 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.834+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6288052840 con 0x7f6284018870 2023-12-07T21:09:36.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.834+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f03481e70 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.834+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.834+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f03481e70 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.834+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.834+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f628805ca90 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.835+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.835+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f03481e70 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.835+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.835+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f03481e70 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.835+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.835+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f0347bd50 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.835+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.835+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f0347bd50 2023-12-07T21:09:36.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.836+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.836+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f628805ca90 2023-12-07T21:09:36.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.836+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.836+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f03481e70 2023-12-07T21:09:36.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.837+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.837+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f6284018870 2023-12-07T21:09:36.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.837+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6288052840 con 0x7f6284018870 2023-12-07T21:09:36.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.837+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f0347bd50 2023-12-07T21:09:36.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.837+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.837+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f628805ca90 2023-12-07T21:09:36.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.837+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.837+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f03481e70 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.837+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.838+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f628805ca90 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.838+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.838+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f6284018870 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.838+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6288052840 con 0x7f6284018870 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.838+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f03481e70 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.838+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.838+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x7f628805ca90 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.838+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034849d0 con 0x562f0347bd50 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f628c053080 con 0x7f6284018870 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6288052840 con 0x7f6284018870 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f62959ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f62959ad800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f62959ad800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f62959ad800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f62959ad800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f62959ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03480a50 con 0x562f0347bd50 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f62959ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034806d0 con 0x562f0347bd50 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.839+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03481320 con 0x562f03481e70 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 20 zone default found 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 4 Realm: () 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 20 zonegroup default 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03484e10 con 0x7f628805ca90 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03486c90 con 0x562f03481e70 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.840+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03486ff0 con 0x562f03481e70 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.841+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.841+0000 7f62959ad800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.841+0000 7f62959ad800 20 started sync module instance, tier type = 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.841+0000 7f62959ad800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:36.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.841+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03486260 con 0x7f6284018870 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.842+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288052840 con 0x7f6284018870 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.842+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94759916105552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03486640 con 0x7f6284018870 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.842+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034877f0 con 0x562f0347bd50 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.843+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94759916105552] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288072040 con 0x7f6284018870 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.843+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.843+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94759918525888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034877f0 con 0x562f0347bd50 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.843+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034881e0 con 0x562f03481e70 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.844+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94759918525888] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.844+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.844+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94759918533824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03488540 con 0x562f03481e70 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.844+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03488ef0 con 0x7f6284018870 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.845+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94759918533824] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.845+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288072040 con 0x7f6284018870 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.846+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94759918531408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03489740 con 0x7f6284018870 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.846+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03489f40 con 0x562f0347bd50 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.847+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.847+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94759918541776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0348a790 con 0x562f0347bd50 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.847+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94759918531408] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288072040 con 0x7f6284018870 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.847+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0348af90 con 0x7f628805ca90 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.848+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.848+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94759918544784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0348b040 con 0x7f628805ca90 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.848+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0348ba40 con 0x7f628805ca90 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.848+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94759918541776] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.848+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.849+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94759918544784] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.849+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94759918548288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0348ba00 con 0x7f628805ca90 2023-12-07T21:09:36.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.849+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0348aba0 con 0x7f628805ca90 2023-12-07T21:09:36.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.850+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v33'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.850+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94759918548288] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.850+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94759918545824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0348c370 con 0x7f628805ca90 2023-12-07T21:09:36.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.850+0000 7f62959ad800 20 add_watcher() i=0 2023-12-07T21:09:36.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.850+0000 7f62959ad800 20 add_watcher() i=1 2023-12-07T21:09:36.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.850+0000 7f62959ad800 20 add_watcher() i=2 2023-12-07T21:09:36.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.850+0000 7f62959ad800 20 add_watcher() i=3 2023-12-07T21:09:36.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.850+0000 7f62959ad800 20 add_watcher() i=4 2023-12-07T21:09:36.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.850+0000 7f62959ad800 20 add_watcher() i=5 2023-12-07T21:09:36.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.850+0000 7f62959ad800 20 add_watcher() i=6 2023-12-07T21:09:36.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.851+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94759918545824] v33'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.851+0000 7f62959ad800 20 add_watcher() i=7 2023-12-07T21:09:36.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.851+0000 7f62959ad800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:36.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.851+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0348f3a0 con 0x562f0347bd50 2023-12-07T21:09:36.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.852+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.852+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94759918550736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0348c780 con 0x562f0347bd50 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.853+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94759918550736] v33'189 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.853+0000 7f62597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.853+0000 7f62959ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.853+0000 7f62959ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.853+0000 7f62959ad800 5 note: GC not initialized 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.853+0000 7f61d3fff640 20 reqs_thread_entry: start 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.853+0000 7f62959ad800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.853+0000 7f62959ad800 20 Filter name: none 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.854+0000 7f61d1ffb640 20 reqs_thread_entry: start 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.854+0000 7f62959ad800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.854+0000 7f62959ad800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.854+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034c2160 con 0x562f0347bd50 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.854+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~369 out=369b,getxattrs out=75b] v0'0 uv14 ondisk = 0) v8 ==== 231+0+492 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.854+0000 7f62959ad800 20 rados_obj.operate() r=0 bl.length=369 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.854+0000 7f62959ad800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.854+0000 7f62959ad800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.854+0000 7f62959ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.854+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034c7d20 con 0x562f0347bd50 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.855+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v33'15 uv15 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.855+0000 7f62959ad800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.855+0000 7f62959ad800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.855+0000 7f62959ad800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.855+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94759918795200 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034c4a40 con 0x562f0347bd50 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.855+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== watch-notify(notify (1) cookie 94759918541776 notify 141733920789 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x562f03324670 con 0x562f0347bd50 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.855+0000 7f627a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920789 cookie 94759918541776 notifier 4594 bl.length()=533 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.855+0000 7f627a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2023-12-07T21:09:36.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.855+0000 7f627a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:36.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.855+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(64 notify.4 [notify cookie 94759918795200 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.855+0000 7f627a7fc640 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f62680042a0 con 0x562f0347bd50 2023-12-07T21:09:36.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.856+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.856+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== watch-notify(notify_complete (2) cookie 94759918795200 notify 141733920789 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x562f03324210 con 0x562f0347bd50 2023-12-07T21:09:36.859 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.857+0000 7f62597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.857+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94759918550736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034c0fd0 con 0x562f0347bd50 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.857+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94759918550736] v33'190 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.857+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94759916105552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034c0fd0 con 0x7f6284018870 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.859+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94759916105552] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288072040 con 0x7f6284018870 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.859+0000 7f62959ad800 20 remove_watcher() i=0 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.859+0000 7f62959ad800 2 removed watcher, disabling cache 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.859+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94759918525888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034c1330 con 0x562f0347bd50 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.860+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94759918525888] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.860+0000 7f62959ad800 20 remove_watcher() i=1 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.860+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94759918533824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034c1330 con 0x562f03481e70 2023-12-07T21:09:36.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.861+0000 7f62934ad640 1 -- 172.21.15.121:0/3348558952 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94759918533824] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6284016070 con 0x562f03481e70 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.861+0000 7f62959ad800 20 remove_watcher() i=2 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.861+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94759918531408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f034785b0 con 0x7f6284018870 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.862+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94759918531408] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6288072040 con 0x7f6284018870 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.862+0000 7f62959ad800 20 remove_watcher() i=3 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.862+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94759918541776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03478910 con 0x562f0347bd50 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.863+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94759918541776] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x562f0347bd50 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.863+0000 7f62959ad800 20 remove_watcher() i=4 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.863+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94759918544784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f03478910 con 0x7f628805ca90 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.864+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94759918544784] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.864+0000 7f62959ad800 20 remove_watcher() i=5 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.864+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94759918548288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0348a770 con 0x7f628805ca90 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.865+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94759918548288] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.865+0000 7f62959ad800 20 remove_watcher() i=6 2023-12-07T21:09:36.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.865+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94759918545824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562f0348b540 con 0x7f628805ca90 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f6293cae640 1 -- 172.21.15.121:0/3348558952 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94759918545824] v33'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c02e9d0 con 0x7f628805ca90 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 20 remove_watcher() i=7 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f628805ca90 msgr2=0x7f62880673d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f628805ca90 0x7f62880673d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562f0347bd50 msgr2=0x562f0347e210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562f0347bd50 0x562f0347e210 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6284018870 msgr2=0x7f628400ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f6284018870 0x7f628400ea60 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562f03481e70 msgr2=0x562f03484300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562f03481e70 0x562f03484300 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f626c036110 msgr2=0x7f626c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f626c036110 0x7f626c0385d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6288054000 tx=0x7f628804e000 comp rx=0 tx=0).stop 2023-12-07T21:09:36.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 msgr2=0x562f03325b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 --2- 172.21.15.121:0/3348558952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f034673a0 0x562f03325b90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f628c00a930 tx=0x7f628c003370 comp rx=0 tx=0).stop 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 reap_dead start 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 shutdown_connections 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f6292cac640 1 -- 172.21.15.121:0/3348558952 reap_dead start 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 >> 172.21.15.121:0/3348558952 conn(0x562f033b3680 msgr2=0x562f03461580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 shutdown_connections 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 -- 172.21.15.121:0/3348558952 wait complete. 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 -- 172.21.15.121:0/531252453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6280036110 msgr2=0x7f62800385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.866+0000 7f62959ad800 1 --2- 172.21.15.121:0/531252453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6280036110 0x7f62800385d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6284001630 tx=0x7f6284034040 comp rx=0 tx=0).stop 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.867+0000 7f62959ad800 1 -- 172.21.15.121:0/531252453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 msgr2=0x562f0345b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.867+0000 7f62959ad800 1 --2- 172.21.15.121:0/531252453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f0345b150 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x562f03450340 tx=0x7f6284000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.867+0000 7f62959ad800 1 -- 172.21.15.121:0/531252453 shutdown_connections 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.867+0000 7f62959ad800 1 --2- 172.21.15.121:0/531252453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6280036110 0x7f62800385d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.867+0000 7f62959ad800 1 --2- 172.21.15.121:0/531252453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562f033af290 0x562f0345b150 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.867+0000 7f62959ad800 1 -- 172.21.15.121:0/531252453 >> 172.21.15.121:0/531252453 conn(0x562f033aa990 msgr2=0x562f03452960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.867+0000 7f62959ad800 1 -- 172.21.15.121:0/531252453 shutdown_connections 2023-12-07T21:09:36.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.867+0000 7f62959ad800 1 -- 172.21.15.121:0/531252453 wait complete. 2023-12-07T21:09:36.868 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:09:36.879 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:36.879 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2023-12-07T21:09:36.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2023-12-07T21:09:36.880 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2023-12-07T21:09:36.922 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:09:36.922 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:09:36.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.930+0000 7faab8b3d800 1 Processor -- start 2023-12-07T21:09:36.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.930+0000 7faab8b3d800 1 -- start start 2023-12-07T21:09:36.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.931+0000 7faab8b3d800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5638cae1d540 0x5638cae1f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.931+0000 7faab8b3d800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5638cad667a0 con 0x5638cae19100 2023-12-07T21:09:36.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.931+0000 7faab8b3d800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5638cad2f880 con 0x5638cae1d540 2023-12-07T21:09:36.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.931+0000 7faaaffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5638cae1d540 0x5638cae1f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.931+0000 7faaaffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5638cae1d540 0x5638cae1f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54818/0 (socket says 172.21.15.121:54818) 2023-12-07T21:09:36.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.931+0000 7faaaffff640 1 -- 172.21.15.121:0/3543882809 learned_addr learned my addr 172.21.15.121:0/3543882809 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.931+0000 7faaaffff640 1 -- 172.21.15.121:0/3543882809 >> v1:172.21.15.89:6789/0 conn(0x5638cae19100 legacy=0x5638cae19520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.931+0000 7faaaf7fe640 1 -- 172.21.15.121:0/3543882809 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577896073 0 0) 0x5638cad667a0 con 0x5638cae19100 2023-12-07T21:09:36.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.931+0000 7faaaffff640 1 -- 172.21.15.121:0/3543882809 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638cae20f60 con 0x5638cae1d540 2023-12-07T21:09:36.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.933+0000 7faaaffff640 1 --2- 172.21.15.121:0/3543882809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae1d540 0x5638cae1f930 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faaa000a6b0 tx=0x7faaa001eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5f889cea879e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.933+0000 7faaaf7fe640 1 -- 172.21.15.121:0/3543882809 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaa000a200 con 0x5638cae1d540 2023-12-07T21:09:36.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.933+0000 7faaaf7fe640 1 -- 172.21.15.121:0/3543882809 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa000a360 con 0x5638cae1d540 2023-12-07T21:09:36.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.933+0000 7faaaf7fe640 1 -- 172.21.15.121:0/3543882809 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaa00086e0 con 0x5638cae1d540 2023-12-07T21:09:36.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.934+0000 7faab8b3d800 1 -- 172.21.15.121:0/3543882809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae1d540 msgr2=0x5638cae1f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.934+0000 7faab8b3d800 1 --2- 172.21.15.121:0/3543882809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae1d540 0x5638cae1f930 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faaa000a6b0 tx=0x7faaa001eda0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.934+0000 7faab8b3d800 1 -- 172.21.15.121:0/3543882809 shutdown_connections 2023-12-07T21:09:36.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.934+0000 7faab8b3d800 1 --2- 172.21.15.121:0/3543882809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae1d540 0x5638cae1f930 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.934+0000 7faab8b3d800 1 -- 172.21.15.121:0/3543882809 >> 172.21.15.121:0/3543882809 conn(0x5638cae14880 msgr2=0x5638cae16ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.934+0000 7faab8b3d800 1 -- 172.21.15.121:0/3543882809 shutdown_connections 2023-12-07T21:09:36.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.934+0000 7faab8b3d800 1 -- 172.21.15.121:0/3543882809 wait complete. 2023-12-07T21:09:36.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.934+0000 7faab8b3d800 1 Processor -- start 2023-12-07T21:09:36.931 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.934+0000 7faab8b3d800 1 -- start start 2023-12-07T21:09:36.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.935+0000 7faab8b3d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.935+0000 7faab8b3d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638cad2cdb0 con 0x5638cae19100 2023-12-07T21:09:36.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.935+0000 7faab489c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.935+0000 7faab489c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54830/0 (socket says 172.21.15.121:54830) 2023-12-07T21:09:36.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.935+0000 7faab489c640 1 -- 172.21.15.121:0/3492236293 learned_addr learned my addr 172.21.15.121:0/3492236293 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.935+0000 7faab489c640 1 -- 172.21.15.121:0/3492236293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0005de0 con 0x5638cae19100 2023-12-07T21:09:36.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.935+0000 7faab489c640 1 --2- 172.21.15.121:0/3492236293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec0de0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faaa8001e30 tx=0x7faaa800b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1eba52903b7769 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.935+0000 7faaaeffd640 1 -- 172.21.15.121:0/3492236293 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaa800d4b0 con 0x5638cae19100 2023-12-07T21:09:36.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.935+0000 7faaaeffd640 1 -- 172.21.15.121:0/3492236293 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa800a040 con 0x5638cae19100 2023-12-07T21:09:36.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.935+0000 7faaaeffd640 1 -- 172.21.15.121:0/3492236293 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaa800d7c0 con 0x5638cae19100 2023-12-07T21:09:36.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab8b3d800 1 -- 172.21.15.121:0/3492236293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 msgr2=0x5638caec0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab8b3d800 1 --2- 172.21.15.121:0/3492236293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec0de0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faaa8001e30 tx=0x7faaa800b650 comp rx=0 tx=0).stop 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab8b3d800 1 -- 172.21.15.121:0/3492236293 shutdown_connections 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab8b3d800 1 --2- 172.21.15.121:0/3492236293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec0de0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab8b3d800 1 -- 172.21.15.121:0/3492236293 >> 172.21.15.121:0/3492236293 conn(0x5638cae14880 msgr2=0x5638caeb8640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab8b3d800 1 -- 172.21.15.121:0/3492236293 shutdown_connections 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab8b3d800 1 -- 172.21.15.121:0/3492236293 wait complete. 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab8b3d800 1 Processor -- start 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab8b3d800 1 -- start start 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab8b3d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab8b3d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638cad286a0 con 0x5638cae19100 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab489c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.936+0000 7faab489c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54838/0 (socket says 172.21.15.121:54838) 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.937+0000 7faab489c640 1 -- 172.21.15.121:0/1712403975 learned_addr learned my addr 172.21.15.121:0/1712403975 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.937+0000 7faab489c640 1 -- 172.21.15.121:0/1712403975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa8001ae0 con 0x5638cae19100 2023-12-07T21:09:36.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.937+0000 7faab489c640 1 --2- 172.21.15.121:0/1712403975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec8340 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faaa800b690 tx=0x7faaa8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.937+0000 7faaadffb640 1 -- 172.21.15.121:0/1712403975 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaa8010650 con 0x5638cae19100 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.937+0000 7faaadffb640 1 -- 172.21.15.121:0/1712403975 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa80107b0 con 0x5638cae19100 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.937+0000 7faab8b3d800 1 -- 172.21.15.121:0/1712403975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638caec8880 con 0x5638cae19100 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.937+0000 7faaadffb640 1 -- 172.21.15.121:0/1712403975 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaa8010a50 con 0x5638cae19100 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.937+0000 7faab8b3d800 1 -- 172.21.15.121:0/1712403975 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638caec8d60 con 0x5638cae19100 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faab8b3d800 1 Processor -- start 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faab8b3d800 1 -- start start 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faab8b3d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 0x5638caed4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faab8b3d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638cacc2890 con 0x5638caed4520 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faaadffb640 1 -- 172.21.15.121:0/1712403975 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7faaa8018070 con 0x5638cae19100 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faab509d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 0x5638caed4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faab509d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 0x5638caed4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54850/0 (socket says 172.21.15.121:54850) 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faab509d640 1 -- 172.21.15.121:0/2128402525 learned_addr learned my addr 172.21.15.121:0/2128402525 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faaadffb640 1 --2- 172.21.15.121:0/1712403975 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faa980360c0 0x7faa98038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faaadffb640 1 -- 172.21.15.121:0/1712403975 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7faaa804b680 con 0x5638cae19100 2023-12-07T21:09:36.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faab489c640 1 --2- 172.21.15.121:0/1712403975 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faa980360c0 0x7faa98038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faab509d640 1 -- 172.21.15.121:0/2128402525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638caed4e80 con 0x5638caed4520 2023-12-07T21:09:36.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faab509d640 1 --2- 172.21.15.121:0/2128402525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 0x5638caed4940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faab000a430 tx=0x7faab000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabd94f95e0c7f8b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.938+0000 7faab489c640 1 --2- 172.21.15.121:0/1712403975 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faa980360c0 0x7faa98038580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faaa801cd80 tx=0x7faaa801cc90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.939+0000 7faa9f7fe640 1 -- 172.21.15.121:0/2128402525 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faab0001650 con 0x5638caed4520 2023-12-07T21:09:36.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.939+0000 7faa9f7fe640 1 -- 172.21.15.121:0/2128402525 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab00017d0 con 0x5638caed4520 2023-12-07T21:09:36.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.939+0000 7faa9f7fe640 1 -- 172.21.15.121:0/2128402525 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faab0001ab0 con 0x5638caed4520 2023-12-07T21:09:36.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab8b3d800 1 -- 172.21.15.121:0/2128402525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 msgr2=0x5638caed4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:36.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab8b3d800 1 --2- 172.21.15.121:0/2128402525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 0x5638caed4940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7faab000a430 tx=0x7faab000a8f0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab8b3d800 1 -- 172.21.15.121:0/2128402525 shutdown_connections 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab8b3d800 1 --2- 172.21.15.121:0/2128402525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 0x5638caed4940 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab8b3d800 1 -- 172.21.15.121:0/2128402525 >> 172.21.15.121:0/2128402525 conn(0x5638cae1d540 msgr2=0x5638caecf900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab8b3d800 1 -- 172.21.15.121:0/2128402525 shutdown_connections 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab8b3d800 1 -- 172.21.15.121:0/2128402525 wait complete. 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab8b3d800 1 Processor -- start 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab8b3d800 1 -- start start 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab8b3d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 0x5638caedb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab8b3d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638cacc2530 con 0x5638caed4520 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab509d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 0x5638caedb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab509d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 0x5638caedb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:54852/0 (socket says 172.21.15.121:54852) 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.940+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 learned_addr learned my addr 172.21.15.121:0/1322774280 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:09:36.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.941+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab000a0e0 con 0x5638caed4520 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.941+0000 7faab509d640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 0x5638caedb4f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7faab000ae40 tx=0x7faab0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.941+0000 7faa9dffb640 1 -- 172.21.15.121:0/1322774280 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faab00109e0 con 0x5638caed4520 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.941+0000 7faa9dffb640 1 -- 172.21.15.121:0/1322774280 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0010b40 con 0x5638caed4520 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.941+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638caedba30 con 0x5638caed4520 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.941+0000 7faa9dffb640 1 -- 172.21.15.121:0/1322774280 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faab0010e20 con 0x5638caed4520 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.941+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638caedbe90 con 0x5638caed4520 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.942+0000 7faa9dffb640 1 -- 172.21.15.121:0/1322774280 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7faab0017070 con 0x5638caed4520 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.942+0000 7faa9dffb640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faa8c036110 0x7faa8c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.942+0000 7faa9dffb640 1 -- 172.21.15.121:0/1322774280 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7faab004b6f0 con 0x5638caed4520 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.942+0000 7faaaffff640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faa8c036110 0x7faa8c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.942+0000 7faaaffff640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faa8c036110 0x7faa8c0385d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faaa0056000 tx=0x7faaa000a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.942+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.942+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5638caee6c10 0x5638caee90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.942+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caee9820 con 0x5638caee6c10 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab509d640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5638caee6c10 0x5638caee90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab509d640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5638caee6c10 0x5638caee90d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab8b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab8b3d800 20 realm 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caee9c30 con 0x5638caee6c10 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab8b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab8b3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeea4b0 con 0x5638caee6c10 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab8b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.943+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeea810 con 0x5638caee6c10 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab8b3d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeeb010 con 0x5638caee6c10 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab8b3d800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab8b3d800 20 searching for the correct realm 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5638caeecd30 0x5638caeef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caeecd30 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab489c640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5638caeecd30 0x5638caeef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.944+0000 7faab489c640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5638caeecd30 0x5638caeef1a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.945+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.945+0000 7faab489c640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7faaa803e040 0x7faaa800f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.945+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x7faaa803e040 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.945+0000 7faaaffff640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7faaa803e040 0x7faaa800f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.945+0000 7faaaffff640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7faaa803e040 0x7faaa800f3a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.945+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.945+0000 7faaaffff640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7faaa0055b90 0x7faaa005f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.945+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x7faaa0055b90 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.946+0000 7faab509d640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7faaa0055b90 0x7faaa005f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.946+0000 7faab509d640 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7faaa0055b90 0x7faaa005f930 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.946+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.946+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caee6c10 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.946+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.946+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caee6c10 2023-12-07T21:09:36.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.947+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.947+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x7faaa0055b90 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.947+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.947+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x7faaa0055b90 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.947+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.947+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x7faaa803e040 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.947+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.947+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caeecd30 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.948+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.948+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caee6c10 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.948+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.948+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x7faaa0055b90 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.948+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.948+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caee6c10 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.948+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.948+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x7faaa803e040 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.948+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.949+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caeecd30 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.949+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.949+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caeecd30 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.949+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.949+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x7faaa0055b90 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.949+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.949+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caeecd30 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.949+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.949+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caeecd30 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.950+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.950+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caee6c10 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.950+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.950+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caee6c10 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.950+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.950+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x7faaa0055b90 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.950+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.950+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caeecd30 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.951+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.951+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x7faaa803e040 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.951+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.951+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x5638caee6c10 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.951+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.951+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeef870 con 0x7faaa0055b90 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.952+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.952+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faab0053040 con 0x5638caeecd30 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.952+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.952+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faab0053040 con 0x7faaa0055b90 2023-12-07T21:09:36.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.952+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.952+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faab0053040 con 0x7faaa803e040 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.952+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.952+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faab0053040 con 0x5638caeecd30 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.952+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.952+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faab0053040 con 0x7faaa0055b90 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faab0053040 con 0x5638caee6c10 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faab0053040 con 0x7faaa803e040 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faab8b3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faab8b3d800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faab8b3d800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faab8b3d800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:09:36.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faab8b3d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faab8b3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.953+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeeb970 con 0x5638caee6c10 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeeb5f0 con 0x5638caee6c10 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeec240 con 0x5638caeecd30 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:09:36.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 20 zone default found 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 4 Realm: () 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 20 zonegroup default 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.954+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caeefcb0 con 0x7faaa0055b90 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab8b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef1a40 con 0x5638caeecd30 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab8b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef1da0 con 0x5638caeecd30 2023-12-07T21:09:36.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab8b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:09:36.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab8b3d800 20 started sync module instance, tier type = 2023-12-07T21:09:36.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab8b3d800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:09:36.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.955+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef1320 con 0x7faaa803e040 2023-12-07T21:09:36.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.956+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.956+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94801920401232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef2190 con 0x7faaa803e040 2023-12-07T21:09:36.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.956+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef2990 con 0x5638caee6c10 2023-12-07T21:09:36.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.957+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94801920401232] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.957+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.957+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94801922821760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef2990 con 0x5638caee6c10 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.957+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef3190 con 0x5638caeecd30 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.958+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94801922821760] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.959+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.959+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94801922827776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef34f0 con 0x5638caeecd30 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.959+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef3d50 con 0x7faaa803e040 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.960+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.960+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94801922834688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef49b0 con 0x7faaa803e040 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.960+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef5320 con 0x5638caee6c10 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.961+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94801922834688] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.961+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94801922827776] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.961+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.961+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94801922835728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef5320 con 0x5638caee6c10 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.961+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef5b70 con 0x7faaa0055b90 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.962+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.962+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94801922839600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef5dc0 con 0x7faaa0055b90 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.962+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef6890 con 0x7faaa0055b90 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.962+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94801922835728] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.964+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.964+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94801922839600] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.964+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94801922843504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef6850 con 0x7faaa0055b90 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.964+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef5880 con 0x7faaa0055b90 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.965+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94801922843504] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.965+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.965+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94801922838144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef6d20 con 0x7faaa0055b90 2023-12-07T21:09:36.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.965+0000 7faab8b3d800 20 add_watcher() i=0 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.965+0000 7faab8b3d800 20 add_watcher() i=1 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.965+0000 7faab8b3d800 20 add_watcher() i=2 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.965+0000 7faab8b3d800 20 add_watcher() i=3 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.965+0000 7faab8b3d800 20 add_watcher() i=4 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.965+0000 7faab8b3d800 20 add_watcher() i=5 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.965+0000 7faab8b3d800 20 add_watcher() i=6 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.966+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94801922838144] v33'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.966+0000 7faab8b3d800 20 add_watcher() i=7 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.966+0000 7faab8b3d800 2 all 8 watchers are set, enabling cache 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.966+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caefa1f0 con 0x5638caee6c10 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.967+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.967+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94801922845984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef75d0 con 0x5638caee6c10 2023-12-07T21:09:36.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.968+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94801922845984] v33'191 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.968+0000 7faa7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.968+0000 7faab8b3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.968+0000 7faab8b3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.968+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf02570 con 0x5638caee6c10 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.969+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.969+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf029b0 con 0x7faaa0055b90 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.970+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.970+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf02ee0 con 0x5638caeecd30 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.971+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'27 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.971+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf038b0 con 0x5638caee6c10 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.972+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'192 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.972+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf00600 con 0x7faaa803e040 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.973+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'65 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.973+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf04420 con 0x5638caeecd30 2023-12-07T21:09:36.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.974+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.974+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf04950 con 0x5638caee6c10 2023-12-07T21:09:36.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.975+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.975+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf04950 con 0x7faaa0055b90 2023-12-07T21:09:36.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.976+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.976+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf04950 con 0x7faaa803e040 2023-12-07T21:09:36.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.977+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.977+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf04e80 con 0x5638caeecd30 2023-12-07T21:09:36.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.978+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.978+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf053b0 con 0x7faaa803e040 2023-12-07T21:09:36.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.979+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'66 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.979+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05850 con 0x7faaa0055b90 2023-12-07T21:09:36.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.980+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.980+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05850 con 0x7faaa803e040 2023-12-07T21:09:36.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.981+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.981+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf04e80 con 0x7faaa0055b90 2023-12-07T21:09:36.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.982+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'51 uv44 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.975 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.982+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf04e80 con 0x5638caee6c10 2023-12-07T21:09:36.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.983+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'193 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.976 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.983+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf04e80 con 0x5638caeecd30 2023-12-07T21:09:36.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.984+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'59 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.977 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.984+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf055b0 con 0x7faaa803e040 2023-12-07T21:09:36.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.985+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'67 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.985+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05640 con 0x5638caeecd30 2023-12-07T21:09:36.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.986+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.986+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05640 con 0x5638caee6c10 2023-12-07T21:09:36.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.987+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.987+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05640 con 0x5638caee6c10 2023-12-07T21:09:36.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.988+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'194 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.988+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05610 con 0x5638caeecd30 2023-12-07T21:09:36.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.989+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'60 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.982 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.989+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05610 con 0x7faaa803e040 2023-12-07T21:09:36.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.990+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'35 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.990+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf057e0 con 0x5638caeecd30 2023-12-07T21:09:36.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.991+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.983 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.991+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf057e0 con 0x5638caeecd30 2023-12-07T21:09:36.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.992+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.984 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.992+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf057e0 con 0x5638caeecd30 2023-12-07T21:09:36.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.993+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'21 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.985 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.993+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf057e0 con 0x5638caeecd30 2023-12-07T21:09:36.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.993+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.986 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.994+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05c20 con 0x7faaa0055b90 2023-12-07T21:09:36.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.995+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'28 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.987 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.995+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05c20 con 0x5638caeecd30 2023-12-07T21:09:36.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.995+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.988 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.996+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05c20 con 0x7faaa0055b90 2023-12-07T21:09:36.989 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.997+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.990 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.997+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05c20 con 0x5638caeecd30 2023-12-07T21:09:36.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.998+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'61 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:36.991 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.998+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05c20 con 0x7faaa0055b90 2023-12-07T21:09:36.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.999+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'52 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:36.992 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:36.999+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf05c20 con 0x7faaa803e040 2023-12-07T21:09:36.993 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.000+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.000+0000 7faa797e2640 20 reqs_thread_entry: start 2023-12-07T21:09:36.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7faab8b3d800 20 init_complete bucket index max shards: 11 2023-12-07T21:09:36.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7faab8b3d800 20 Filter name: none 2023-12-07T21:09:36.994 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7fa9eaffd640 20 reqs_thread_entry: start 2023-12-07T21:09:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7faab8b3d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:09:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7faab8b3d800 20 rados->read ofs=0 len=0 2023-12-07T21:09:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf30650 con 0x5638caee6c10 2023-12-07T21:09:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7faab8b3d800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:09:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7faab8b3d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:09:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7faab8b3d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:09:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7faab8b3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:09:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.001+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf30570 con 0x7faaa803e040 2023-12-07T21:09:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.002+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv51 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.995 INFO:teuthology.orchestra.run.smithi121.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2023-12-07T21:09:36.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.002+0000 7faa7a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:09:36.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.002+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94801922845984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf038b0 con 0x5638caee6c10 2023-12-07T21:09:36.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.003+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94801922845984] v33'195 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.996 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.003+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94801920401232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf038b0 con 0x7faaa803e040 2023-12-07T21:09:36.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.004+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94801920401232] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:36.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.004+0000 7faab8b3d800 20 remove_watcher() i=0 2023-12-07T21:09:36.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.004+0000 7faab8b3d800 2 removed watcher, disabling cache 2023-12-07T21:09:36.997 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.004+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94801922821760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf038b0 con 0x5638caee6c10 2023-12-07T21:09:36.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.006+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94801922821760] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:36.998 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.006+0000 7faab8b3d800 20 remove_watcher() i=1 2023-12-07T21:09:36.999 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.006+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94801922827776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf038b0 con 0x5638caeecd30 2023-12-07T21:09:37.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.007+0000 7faab489c640 1 -- 172.21.15.121:0/1322774280 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94801922827776] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa800fcc0 con 0x5638caeecd30 2023-12-07T21:09:37.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.007+0000 7faab8b3d800 20 remove_watcher() i=2 2023-12-07T21:09:37.000 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.007+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94801922834688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf038b0 con 0x7faaa803e040 2023-12-07T21:09:37.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.008+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94801922834688] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faaa0068040 con 0x7faaa803e040 2023-12-07T21:09:37.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.008+0000 7faab8b3d800 20 remove_watcher() i=3 2023-12-07T21:09:37.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.008+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94801922835728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caf038b0 con 0x5638caee6c10 2023-12-07T21:09:37.001 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.009+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94801922835728] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x5638caee6c10 2023-12-07T21:09:37.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.009+0000 7faab8b3d800 20 remove_watcher() i=4 2023-12-07T21:09:37.002 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.009+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94801922839600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef4510 con 0x7faaa0055b90 2023-12-07T21:09:37.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.010+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94801922839600] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:37.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.010+0000 7faab8b3d800 20 remove_watcher() i=5 2023-12-07T21:09:37.003 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.010+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94801922843504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef4510 con 0x7faaa0055b90 2023-12-07T21:09:37.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.011+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94801922843504] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:37.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.011+0000 7faab8b3d800 20 remove_watcher() i=6 2023-12-07T21:09:37.004 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.011+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94801922838144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5638caef6370 con 0x7faaa0055b90 2023-12-07T21:09:37.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab509d640 1 -- 172.21.15.121:0/1322774280 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94801922838144] v33'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faab001b390 con 0x7faaa0055b90 2023-12-07T21:09:37.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 20 remove_watcher() i=7 2023-12-07T21:09:37.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7faaa0055b90 msgr2=0x7faaa005f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:37.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7faaa0055b90 0x7faaa005f930 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:37.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5638caee6c10 msgr2=0x5638caee90d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:37.006 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5638caee6c10 0x5638caee90d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7faaa803e040 msgr2=0x7faaa800f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7faaa803e040 0x7faaa800f3a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5638caeecd30 msgr2=0x5638caeef1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5638caeecd30 0x5638caeef1a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faa8c036110 msgr2=0x7faa8c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faa8c036110 0x7faa8c0385d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faaa0056000 tx=0x7faaa000a000 comp rx=0 tx=0).stop 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 msgr2=0x5638caedb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1322774280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638caed4520 0x5638caedb4f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7faab000ae40 tx=0x7faab0003370 comp rx=0 tx=0).stop 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 reap_dead start 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faaaffff640 1 -- 172.21.15.121:0/1322774280 reap_dead start 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 shutdown_connections 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 >> 172.21.15.121:0/1322774280 conn(0x5638cae1d540 msgr2=0x5638caece700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.012+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 shutdown_connections 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.013+0000 7faab8b3d800 1 -- 172.21.15.121:0/1322774280 wait complete. 2023-12-07T21:09:37.007 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.013+0000 7faab8b3d800 1 -- 172.21.15.121:0/1712403975 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faa980360c0 msgr2=0x7faa98038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:37.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.013+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1712403975 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faa980360c0 0x7faa98038580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faaa801cd80 tx=0x7faaa801cc90 comp rx=0 tx=0).stop 2023-12-07T21:09:37.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.013+0000 7faab8b3d800 1 -- 172.21.15.121:0/1712403975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 msgr2=0x5638caec8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:09:37.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.013+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1712403975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec8340 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faaa800b690 tx=0x7faaa8000ed0 comp rx=0 tx=0).stop 2023-12-07T21:09:37.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.013+0000 7faab8b3d800 1 -- 172.21.15.121:0/1712403975 shutdown_connections 2023-12-07T21:09:37.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.013+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1712403975 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faa980360c0 0x7faa98038580 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:37.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.013+0000 7faab8b3d800 1 --2- 172.21.15.121:0/1712403975 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5638cae19100 0x5638caec8340 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:09:37.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.013+0000 7faab8b3d800 1 -- 172.21.15.121:0/1712403975 >> 172.21.15.121:0/1712403975 conn(0x5638cae14880 msgr2=0x5638caebb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:09:37.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.013+0000 7faab8b3d800 1 -- 172.21.15.121:0/1712403975 shutdown_connections 2023-12-07T21:09:37.008 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:09:37.013+0000 7faab8b3d800 1 -- 172.21.15.121:0/1712403975 wait complete. 2023-12-07T21:09:37.009 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-12-07T21:09:37.024 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:09:37.029 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2023-12-07T21:10:12.030 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2023-12-07T21:10:12.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2023-12-07T21:10:12.031 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2023-12-07T21:10:12.083 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:12.083 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:12.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.091+0000 7f7126122800 1 Processor -- start 2023-12-07T21:10:12.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.091+0000 7f7126122800 1 -- start start 2023-12-07T21:10:12.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.092+0000 7f7126122800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a1c8131670 0x55a1c8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.092+0000 7f7126122800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a1c80797a0 con 0x55a1c812d280 2023-12-07T21:10:12.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.092+0000 7f7126122800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a1c8042880 con 0x55a1c8131670 2023-12-07T21:10:12.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.092+0000 7f7121594640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55a1c8131670 0x55a1c8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.092+0000 7f7121d95640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55a1c812d280 0x55a1c812d6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:35578/0 (socket says 172.21.15.121:35578) 2023-12-07T21:10:12.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.092+0000 7f7121d95640 1 -- 172.21.15.121:0/697790320 learned_addr learned my addr 172.21.15.121:0/697790320 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:12.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.092+0000 7f7121594640 1 -- 172.21.15.121:0/697790320 >> v1:172.21.15.89:6789/0 conn(0x55a1c812d280 legacy=0x55a1c812d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.092+0000 7f7121594640 1 -- 172.21.15.121:0/697790320 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1c8135090 con 0x55a1c8131670 2023-12-07T21:10:12.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.094+0000 7f7121594640 1 --2- 172.21.15.121:0/697790320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c8131670 0x55a1c8133a60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f711800a470 tx=0x7f711801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142d28eb70feacec server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.095+0000 7f7120d93640 1 -- 172.21.15.121:0/697790320 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7118052570 con 0x55a1c8131670 2023-12-07T21:10:12.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.095+0000 7f7120d93640 1 -- 172.21.15.121:0/697790320 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71180526d0 con 0x55a1c8131670 2023-12-07T21:10:12.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.095+0000 7f7120d93640 1 -- 172.21.15.121:0/697790320 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7118052990 con 0x55a1c8131670 2023-12-07T21:10:12.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.095+0000 7f7126122800 1 -- 172.21.15.121:0/697790320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c8131670 msgr2=0x55a1c8133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.095+0000 7f7126122800 1 --2- 172.21.15.121:0/697790320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c8131670 0x55a1c8133a60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f711800a470 tx=0x7f711801cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:12.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.095+0000 7f7126122800 1 -- 172.21.15.121:0/697790320 shutdown_connections 2023-12-07T21:10:12.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.095+0000 7f7126122800 1 --2- 172.21.15.121:0/697790320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c8131670 0x55a1c8133a60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.095+0000 7f7126122800 1 -- 172.21.15.121:0/697790320 >> 172.21.15.121:0/697790320 conn(0x55a1c8128980 msgr2=0x55a1c812ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.095+0000 7f7126122800 1 -- 172.21.15.121:0/697790320 shutdown_connections 2023-12-07T21:10:12.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.095+0000 7f7126122800 1 -- 172.21.15.121:0/697790320 wait complete. 2023-12-07T21:10:12.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.096+0000 7f7126122800 1 Processor -- start 2023-12-07T21:10:12.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.096+0000 7f7126122800 1 -- start start 2023-12-07T21:10:12.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.096+0000 7f7126122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c81d1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.096+0000 7f7126122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c803fdb0 con 0x55a1c812d280 2023-12-07T21:10:12.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.096+0000 7f7121d95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c81d1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.096+0000 7f7121d95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c81d1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42428/0 (socket says 172.21.15.121:42428) 2023-12-07T21:10:12.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.096+0000 7f7121d95640 1 -- 172.21.15.121:0/26032052 learned_addr learned my addr 172.21.15.121:0/26032052 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.097+0000 7f7121d95640 1 -- 172.21.15.121:0/26032052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7118005d20 con 0x55a1c812d280 2023-12-07T21:10:12.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.097+0000 7f7121d95640 1 --2- 172.21.15.121:0/26032052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c81d1eb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f71140014d0 tx=0x7f7114001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa60aeb5595d33ed server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.097+0000 7f7113fff640 1 -- 172.21.15.121:0/26032052 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7114004520 con 0x55a1c812d280 2023-12-07T21:10:12.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.097+0000 7f7113fff640 1 -- 172.21.15.121:0/26032052 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7114004680 con 0x55a1c812d280 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.097+0000 7f7113fff640 1 -- 172.21.15.121:0/26032052 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7114004980 con 0x55a1c812d280 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7126122800 1 -- 172.21.15.121:0/26032052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 msgr2=0x55a1c81d1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7126122800 1 --2- 172.21.15.121:0/26032052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c81d1eb0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f71140014d0 tx=0x7f7114001990 comp rx=0 tx=0).stop 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7126122800 1 -- 172.21.15.121:0/26032052 shutdown_connections 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7126122800 1 --2- 172.21.15.121:0/26032052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c81d1eb0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7126122800 1 -- 172.21.15.121:0/26032052 >> 172.21.15.121:0/26032052 conn(0x55a1c8128980 msgr2=0x55a1c81cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7126122800 1 -- 172.21.15.121:0/26032052 shutdown_connections 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7126122800 1 -- 172.21.15.121:0/26032052 wait complete. 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7126122800 1 Processor -- start 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7126122800 1 -- start start 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7126122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c80a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7126122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c803b6a0 con 0x55a1c812d280 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7121d95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c80a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7121d95640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c80a3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42444/0 (socket says 172.21.15.121:42444) 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.098+0000 7f7121d95640 1 -- 172.21.15.121:0/3232448067 learned_addr learned my addr 172.21.15.121:0/3232448067 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.099+0000 7f7121d95640 1 -- 172.21.15.121:0/3232448067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1c80797a0 con 0x55a1c812d280 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.099+0000 7f7121d95640 1 --2- 172.21.15.121:0/3232448067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c80a3ae0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f71140019d0 tx=0x7f7114001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.099+0000 7f7112ffd640 1 -- 172.21.15.121:0/3232448067 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7114023030 con 0x55a1c812d280 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.099+0000 7f7112ffd640 1 -- 172.21.15.121:0/3232448067 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7114013760 con 0x55a1c812d280 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.099+0000 7f7126122800 1 -- 172.21.15.121:0/3232448067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a1c80a4020 con 0x55a1c812d280 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.099+0000 7f7112ffd640 1 -- 172.21.15.121:0/3232448067 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7114013a80 con 0x55a1c812d280 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.099+0000 7f7126122800 1 -- 172.21.15.121:0/3232448067 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1c80a2570 con 0x55a1c812d280 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.100+0000 7f7126122800 1 Processor -- start 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.100+0000 7f7126122800 1 -- start start 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.100+0000 7f7112ffd640 1 -- 172.21.15.121:0/3232448067 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7114026070 con 0x55a1c812d280 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.100+0000 7f7126122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 0x55a1c81e7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.100+0000 7f7126122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c7fd5890 con 0x55a1c81e7740 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.100+0000 7f7112ffd640 1 --2- 172.21.15.121:0/3232448067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f71040360c0 0x7f7104038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.100+0000 7f7112ffd640 1 -- 172.21.15.121:0/3232448067 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f7114024070 con 0x55a1c812d280 2023-12-07T21:10:12.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.100+0000 7f7122596640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 0x55a1c81e7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.100+0000 7f7121d95640 1 --2- 172.21.15.121:0/3232448067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f71040360c0 0x7f7104038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.100+0000 7f7122596640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 0x55a1c81e7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42448/0 (socket says 172.21.15.121:42448) 2023-12-07T21:10:12.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.100+0000 7f7122596640 1 -- 172.21.15.121:0/1311286634 learned_addr learned my addr 172.21.15.121:0/1311286634 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7122596640 1 -- 172.21.15.121:0/1311286634 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1c81e80a0 con 0x55a1c81e7740 2023-12-07T21:10:12.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7121d95640 1 --2- 172.21.15.121:0/3232448067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f71040360c0 0x7f7104038580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7114013f30 tx=0x7f7114013e40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7122596640 1 --2- 172.21.15.121:0/1311286634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 0x55a1c81e7b60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f711c00a400 tx=0x7f711c00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed24c24bdc10d35b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7110ff9640 1 -- 172.21.15.121:0/1311286634 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f711c0087e0 con 0x55a1c81e7740 2023-12-07T21:10:12.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7110ff9640 1 -- 172.21.15.121:0/1311286634 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c008960 con 0x55a1c81e7740 2023-12-07T21:10:12.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7110ff9640 1 -- 172.21.15.121:0/1311286634 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f711c008c80 con 0x55a1c81e7740 2023-12-07T21:10:12.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7126122800 1 -- 172.21.15.121:0/1311286634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 msgr2=0x55a1c81e7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7126122800 1 --2- 172.21.15.121:0/1311286634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 0x55a1c81e7b60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f711c00a400 tx=0x7f711c00a8c0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7126122800 1 -- 172.21.15.121:0/1311286634 shutdown_connections 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7126122800 1 --2- 172.21.15.121:0/1311286634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 0x55a1c81e7b60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7126122800 1 -- 172.21.15.121:0/1311286634 >> 172.21.15.121:0/1311286634 conn(0x55a1c8131670 msgr2=0x55a1c81e2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7126122800 1 -- 172.21.15.121:0/1311286634 shutdown_connections 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.101+0000 7f7126122800 1 -- 172.21.15.121:0/1311286634 wait complete. 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.102+0000 7f7126122800 1 Processor -- start 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.102+0000 7f7126122800 1 -- start start 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.102+0000 7f7126122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 0x55a1c81ee670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.102+0000 7f7126122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1c7fd5530 con 0x55a1c81e7740 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.102+0000 7f7122596640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 0x55a1c81ee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.102+0000 7f7122596640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 0x55a1c81ee670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42456/0 (socket says 172.21.15.121:42456) 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.102+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 learned_addr learned my addr 172.21.15.121:0/2758170786 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.102+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c005c90 con 0x55a1c81e7740 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.103+0000 7f7122596640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 0x55a1c81ee670 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c010 tx=0x7f711c002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.103+0000 7f7102ffd640 1 -- 172.21.15.121:0/2758170786 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f711c013840 con 0x55a1c81e7740 2023-12-07T21:10:12.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.103+0000 7f7102ffd640 1 -- 172.21.15.121:0/2758170786 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c0139a0 con 0x55a1c81e7740 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.103+0000 7f7102ffd640 1 -- 172.21.15.121:0/2758170786 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f711c013c80 con 0x55a1c81e7740 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.103+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a1c81eebb0 con 0x55a1c81e7740 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.103+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1c81ef070 con 0x55a1c81e7740 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.104+0000 7f7102ffd640 1 -- 172.21.15.121:0/2758170786 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f711c01e420 con 0x55a1c81e7740 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.104+0000 7f7102ffd640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f70fc0360c0 0x7f70fc038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.104+0000 7f7102ffd640 1 -- 172.21.15.121:0/2758170786 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f711c04ba20 con 0x55a1c81e7740 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.104+0000 7f7126122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.104+0000 7f7121594640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f70fc0360c0 0x7f70fc038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.104+0000 7f7126122800 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a1c81f9e00 0x55a1c81fc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.104+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c81fc9e0 con 0x55a1c81f9e00 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7122596640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a1c81f9e00 0x55a1c81fc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7121594640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f70fc0360c0 0x7f70fc038580 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7118054000 tx=0x7f711804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7122596640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a1c81f9e00 0x55a1c81fc290 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7126122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7126122800 20 realm 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7126122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c81fcdd0 con 0x55a1c81f9e00 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7126122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7126122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7126122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.105+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c81fd620 con 0x55a1c81f9e00 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7126122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7126122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c81fd980 con 0x55a1c81f9e00 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7126122800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7126122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c81fd2c0 con 0x55a1c81f9e00 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7126122800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7126122800 20 searching for the correct realm 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7126122800 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a1c81ffbd0 0x55a1c8201fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8202550 con 0x55a1c81ffbd0 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.106+0000 7f7121d95640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a1c81ffbd0 0x55a1c8201fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.107+0000 7f7121d95640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a1c81ffbd0 0x55a1c8201fc0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.107+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.107+0000 7f7121d95640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7114028a90 0x7f7114011910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.107+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8202550 con 0x7f7114028a90 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.107+0000 7f7121594640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7114028a90 0x7f7114011910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.108+0000 7f7121594640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7114028a90 0x7f7114011910 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.108+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.108+0000 7f7121594640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f711805ca90 0x7f71180673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.108+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8202550 con 0x7f711805ca90 2023-12-07T21:10:12.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.108+0000 7f7122596640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f711805ca90 0x7f71180673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.109+0000 7f7122596640 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f711805ca90 0x7f71180673d0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.109+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.109+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8202550 con 0x55a1c81f9e00 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.109+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.109+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8202550 con 0x55a1c81f9e00 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.109+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.109+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8202550 con 0x7f711805ca90 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.110+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.110+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f711805ca90 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.110+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.110+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f7114028a90 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.110+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.110+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81ffbd0 2023-12-07T21:10:12.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.111+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.111+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81f9e00 2023-12-07T21:10:12.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.111+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.111+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f711805ca90 2023-12-07T21:10:12.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.111+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.111+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81f9e00 2023-12-07T21:10:12.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.111+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.111+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f7114028a90 2023-12-07T21:10:12.114 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.112+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.112+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81ffbd0 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.112+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.112+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81ffbd0 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.112+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.112+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f711805ca90 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.113+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.113+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81ffbd0 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.113+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.113+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81ffbd0 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.113+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.113+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81f9e00 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.114+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.114+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81f9e00 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.114+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.114+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f711805ca90 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.114+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.114+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81ffbd0 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.115+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.115+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f7114028a90 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.115+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.115+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81f9e00 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.115+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.115+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f711805ca90 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.116+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.116+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81ffbd0 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.116+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.116+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f711805ca90 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.116+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.116+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f7114028a90 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.116+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.116+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81ffbd0 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.117+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.117+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f711805ca90 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.117+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.117+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x55a1c81f9e00 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.117+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.117+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f711c03e040 con 0x7f7114028a90 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.117+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.117+0000 7f7126122800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c81fe7b0 con 0x55a1c81f9e00 2023-12-07T21:10:12.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c81fe3d0 con 0x55a1c81f9e00 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c81ff000 con 0x55a1c81ffbd0 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 zone default found 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 4 Realm: () 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:12.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 zonegroup default 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.118+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8202990 con 0x7f711805ca90 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.119+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.119+0000 7f7126122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.119+0000 7f7126122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.119+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8204810 con 0x55a1c81ffbd0 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.119+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.119+0000 7f7126122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.119+0000 7f7126122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.119+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8204b70 con 0x55a1c81ffbd0 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.120+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.120+0000 7f7126122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.120+0000 7f7126122800 20 started sync module instance, tier type = 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.120+0000 7f7126122800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.120+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8203de0 con 0x7f7114028a90 2023-12-07T21:10:12.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.121+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.121+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94153333231440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8204210 con 0x7f7114028a90 2023-12-07T21:10:12.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.121+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8205370 con 0x55a1c81f9e00 2023-12-07T21:10:12.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.122+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94153333231440] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.122+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.122+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94153335650624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8205370 con 0x55a1c81f9e00 2023-12-07T21:10:12.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.122+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8205d50 con 0x55a1c81ffbd0 2023-12-07T21:10:12.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.123+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94153335650624] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.124+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.124+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94153335656144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82052e0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.124+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8206a70 con 0x7f7114028a90 2023-12-07T21:10:12.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.125+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.125+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94153335664160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82076d0 con 0x7f7114028a90 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.125+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8208040 con 0x55a1c81f9e00 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.125+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94153335656144] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.126+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.126+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94153335667616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8207fb0 con 0x55a1c81f9e00 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.126+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8208d60 con 0x7f711805ca90 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.126+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94153335664160] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.127+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.127+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94153335665200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8208d60 con 0x7f711805ca90 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.127+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82095a0 con 0x7f711805ca90 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.127+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94153335667616] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.128+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94153335665200] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.128+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.128+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94153335669792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8208d30 con 0x7f711805ca90 2023-12-07T21:10:12.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.129+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8209c20 con 0x7f711805ca90 2023-12-07T21:10:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.130+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94153335669792] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.130+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.130+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94153335670832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8208d30 con 0x7f711805ca90 2023-12-07T21:10:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.130+0000 7f7126122800 20 add_watcher() i=0 2023-12-07T21:10:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.130+0000 7f7126122800 20 add_watcher() i=1 2023-12-07T21:10:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.130+0000 7f7126122800 20 add_watcher() i=2 2023-12-07T21:10:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.130+0000 7f7126122800 20 add_watcher() i=3 2023-12-07T21:10:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.130+0000 7f7126122800 20 add_watcher() i=4 2023-12-07T21:10:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.130+0000 7f7126122800 20 add_watcher() i=5 2023-12-07T21:10:12.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.130+0000 7f7126122800 20 add_watcher() i=6 2023-12-07T21:10:12.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.131+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94153335670832] v33'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.131+0000 7f7126122800 20 add_watcher() i=7 2023-12-07T21:10:12.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.131+0000 7f7126122800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:12.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.131+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c820cdf0 con 0x55a1c81f9e00 2023-12-07T21:10:12.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.131+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.131+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94153335674752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c820a230 con 0x55a1c81f9e00 2023-12-07T21:10:12.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.132+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94153335674752] v33'196 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.132+0000 7f70e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.132+0000 7f7126122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.132+0000 7f7126122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.132+0000 7f7126122800 5 note: GC not initialized 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.133+0000 7f70e67e4640 20 reqs_thread_entry: start 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.133+0000 7f7126122800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.133+0000 7f7126122800 20 Filter name: none 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.133+0000 7f7057fff640 20 reqs_thread_entry: start 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.133+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8240410 con 0x55a1c81f9e00 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.133+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.133+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8240410 con 0x7f7114028a90 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.133+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.133+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8240850 con 0x55a1c81f9e00 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.134+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.134+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8240850 con 0x55a1c81ffbd0 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.134+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.134+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8240c20 con 0x55a1c81ffbd0 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.134+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.134+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8240c20 con 0x55a1c81ffbd0 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.134+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.134+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8240c20 con 0x55a1c81f9e00 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.135+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.135+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8240c20 con 0x55a1c81f9e00 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.135+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.135+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8240bd0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.135+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.129 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.135+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8240bb0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.135+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.135+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8240bb0 con 0x7f711805ca90 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.136+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.136+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8242640 con 0x55a1c81f9e00 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.136+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.136+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8242640 con 0x7f7114028a90 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.137+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.137+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.137+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.137+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x7f711805ca90 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.137+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.137+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x7f711805ca90 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.137+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.137+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.138+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.138+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x7f711805ca90 2023-12-07T21:10:12.134 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.138+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.138+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81f9e00 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.138+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.138+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.139+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.139+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x7f711805ca90 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.139+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.139+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x7f7114028a90 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.139+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.139+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x7f711805ca90 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.140+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.140+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81f9e00 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.140+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.140+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81f9e00 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.140+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.140+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.140+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.140+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81f9e00 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.140+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.140+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81f9e00 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.141+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.141+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.141+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.141+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.141+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.141+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.141+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.141+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c82429a0 con 0x7f711805ca90 2023-12-07T21:10:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.142+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.143+0000 7f70e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.143+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94153335674752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8241680 con 0x55a1c81f9e00 2023-12-07T21:10:12.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.144+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94153335674752] v33'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.144+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94153333231440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8241680 con 0x7f7114028a90 2023-12-07T21:10:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.145+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94153333231440] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.145+0000 7f7126122800 20 remove_watcher() i=0 2023-12-07T21:10:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.145+0000 7f7126122800 2 removed watcher, disabling cache 2023-12-07T21:10:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.145+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94153335650624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8241680 con 0x55a1c81f9e00 2023-12-07T21:10:12.138 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.146+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94153335650624] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.146+0000 7f7126122800 20 remove_watcher() i=1 2023-12-07T21:10:12.139 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.146+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94153335656144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8241680 con 0x55a1c81ffbd0 2023-12-07T21:10:12.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.147+0000 7f7121d95640 1 -- 172.21.15.121:0/2758170786 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94153335656144] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7114010ae0 con 0x55a1c81ffbd0 2023-12-07T21:10:12.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.147+0000 7f7126122800 20 remove_watcher() i=2 2023-12-07T21:10:12.140 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.147+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94153335664160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8241680 con 0x7f7114028a90 2023-12-07T21:10:12.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.148+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94153335664160] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7118052840 con 0x7f7114028a90 2023-12-07T21:10:12.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.148+0000 7f7126122800 20 remove_watcher() i=3 2023-12-07T21:10:12.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.148+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94153335667616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8241680 con 0x55a1c81f9e00 2023-12-07T21:10:12.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.150+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94153335667616] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x55a1c81f9e00 2023-12-07T21:10:12.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.150+0000 7f7126122800 20 remove_watcher() i=4 2023-12-07T21:10:12.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.150+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94153335665200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8241680 con 0x7f711805ca90 2023-12-07T21:10:12.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.151+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94153335665200] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.151+0000 7f7126122800 20 remove_watcher() i=5 2023-12-07T21:10:12.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.151+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94153335669792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8207230 con 0x7f711805ca90 2023-12-07T21:10:12.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.152+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94153335669792] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.152+0000 7f7126122800 20 remove_watcher() i=6 2023-12-07T21:10:12.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.152+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94153335670832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55a1c8207230 con 0x7f711805ca90 2023-12-07T21:10:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.153+0000 7f7122596640 1 -- 172.21.15.121:0/2758170786 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94153335670832] v33'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f711c024070 con 0x7f711805ca90 2023-12-07T21:10:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.153+0000 7f7126122800 20 remove_watcher() i=7 2023-12-07T21:10:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.153+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f711805ca90 msgr2=0x7f71180673d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.153+0000 7f7126122800 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f711805ca90 0x7f71180673d0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.153+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a1c81f9e00 msgr2=0x55a1c81fc290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.153+0000 7f7126122800 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55a1c81f9e00 0x55a1c81fc290 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.153+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7114028a90 msgr2=0x7f7114011910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.153+0000 7f7126122800 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f7114028a90 0x7f7114011910 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.153+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a1c81ffbd0 msgr2=0x55a1c8201fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.153+0000 7f7126122800 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55a1c81ffbd0 0x55a1c8201fc0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.153+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f70fc0360c0 msgr2=0x7f70fc038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f70fc0360c0 0x7f70fc038580 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7118054000 tx=0x7f711804e000 comp rx=0 tx=0).stop 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 msgr2=0x55a1c81ee670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 --2- 172.21.15.121:0/2758170786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c81e7740 0x55a1c81ee670 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c010 tx=0x7f711c002ff0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 reap_dead start 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7121594640 1 -- 172.21.15.121:0/2758170786 reap_dead start 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 shutdown_connections 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 >> 172.21.15.121:0/2758170786 conn(0x55a1c8131670 msgr2=0x55a1c81e1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 shutdown_connections 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 -- 172.21.15.121:0/2758170786 wait complete. 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 -- 172.21.15.121:0/3232448067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f71040360c0 msgr2=0x7f7104038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 --2- 172.21.15.121:0/3232448067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f71040360c0 0x7f7104038580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7114013f30 tx=0x7f7114013e40 comp rx=0 tx=0).stop 2023-12-07T21:10:12.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 -- 172.21.15.121:0/3232448067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 msgr2=0x55a1c80a3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 --2- 172.21.15.121:0/3232448067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c80a3ae0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f71140019d0 tx=0x7f7114001250 comp rx=0 tx=0).stop 2023-12-07T21:10:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 -- 172.21.15.121:0/3232448067 shutdown_connections 2023-12-07T21:10:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 --2- 172.21.15.121:0/3232448067 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f71040360c0 0x7f7104038580 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 --2- 172.21.15.121:0/3232448067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55a1c812d280 0x55a1c80a3ae0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 -- 172.21.15.121:0/3232448067 >> 172.21.15.121:0/3232448067 conn(0x55a1c8128980 msgr2=0x55a1c81d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 -- 172.21.15.121:0/3232448067 shutdown_connections 2023-12-07T21:10:12.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.154+0000 7f7126122800 1 -- 172.21.15.121:0/3232448067 wait complete. 2023-12-07T21:10:12.150 INFO:teuthology.orchestra.run.smithi121.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2023-12-07T21:10:12.150 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2023-12-07T21:10:12.150 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2023-12-07T21:10:12.150 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2023-12-07T21:10:12.150 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2023-12-07T21:10:12.191 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:12.191 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:12.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.199+0000 7f446f52b800 1 Processor -- start 2023-12-07T21:10:12.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.200+0000 7f446f52b800 1 -- start start 2023-12-07T21:10:12.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.200+0000 7f446f52b800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558879247660 0x558879249a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.193 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.200+0000 7f446f52b800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55887918f790 con 0x558879243270 2023-12-07T21:10:12.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.200+0000 7f446f52b800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x558879158880 con 0x558879247660 2023-12-07T21:10:12.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.200+0000 7f446aa31640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558879247660 0x558879249a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.200+0000 7f446b232640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x558879243270 0x558879243690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:35586/0 (socket says 172.21.15.121:35586) 2023-12-07T21:10:12.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.200+0000 7f446b232640 1 -- 172.21.15.121:0/141065256 learned_addr learned my addr 172.21.15.121:0/141065256 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:12.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.200+0000 7f446aa31640 1 -- 172.21.15.121:0/141065256 >> v1:172.21.15.89:6789/0 conn(0x558879243270 legacy=0x558879243690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.194 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.200+0000 7f446aa31640 1 -- 172.21.15.121:0/141065256 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55887924b080 con 0x558879247660 2023-12-07T21:10:12.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.202+0000 7f446aa31640 1 --2- 172.21.15.121:0/141065256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879247660 0x558879249a50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f445400a470 tx=0x7f445401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a68f472d76ddefc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.202+0000 7f446a230640 1 -- 172.21.15.121:0/141065256 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4454052570 con 0x558879247660 2023-12-07T21:10:12.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.203+0000 7f446a230640 1 -- 172.21.15.121:0/141065256 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44540526d0 con 0x558879247660 2023-12-07T21:10:12.195 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.203+0000 7f446a230640 1 -- 172.21.15.121:0/141065256 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4454052990 con 0x558879247660 2023-12-07T21:10:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.203+0000 7f446f52b800 1 -- 172.21.15.121:0/141065256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879247660 msgr2=0x558879249a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.203+0000 7f446f52b800 1 --2- 172.21.15.121:0/141065256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879247660 0x558879249a50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f445400a470 tx=0x7f445401cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.203+0000 7f446f52b800 1 -- 172.21.15.121:0/141065256 shutdown_connections 2023-12-07T21:10:12.197 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.203+0000 7f446f52b800 1 --2- 172.21.15.121:0/141065256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879247660 0x558879249a50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.203+0000 7f446f52b800 1 -- 172.21.15.121:0/141065256 >> 172.21.15.121:0/141065256 conn(0x55887923e970 msgr2=0x558879240d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.203+0000 7f446f52b800 1 -- 172.21.15.121:0/141065256 shutdown_connections 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.203+0000 7f446f52b800 1 -- 172.21.15.121:0/141065256 wait complete. 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.204+0000 7f446f52b800 1 Processor -- start 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.204+0000 7f446f52b800 1 -- start start 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.204+0000 7f446f52b800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.204+0000 7f446f52b800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558879155db0 con 0x558879243270 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.204+0000 7f446b232640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.204+0000 7f446b232640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792e7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42474/0 (socket says 172.21.15.121:42474) 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.204+0000 7f446b232640 1 -- 172.21.15.121:0/928525191 learned_addr learned my addr 172.21.15.121:0/928525191 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.205+0000 7f446b232640 1 -- 172.21.15.121:0/928525191 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4454005d20 con 0x558879243270 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.205+0000 7f446b232640 1 --2- 172.21.15.121:0/928525191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792e7e60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4464001c80 tx=0x7f446400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61bfd4e56b9e0b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.205+0000 7f4469a2f640 1 -- 172.21.15.121:0/928525191 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f446400e470 con 0x558879243270 2023-12-07T21:10:12.198 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.205+0000 7f4469a2f640 1 -- 172.21.15.121:0/928525191 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446400e5d0 con 0x558879243270 2023-12-07T21:10:12.199 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.205+0000 7f4469a2f640 1 -- 172.21.15.121:0/928525191 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f446400e8d0 con 0x558879243270 2023-12-07T21:10:12.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.205+0000 7f446f52b800 1 -- 172.21.15.121:0/928525191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 msgr2=0x5588792e7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.205+0000 7f446f52b800 1 --2- 172.21.15.121:0/928525191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792e7e60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4464001c80 tx=0x7f446400b6c0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.203 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.205+0000 7f446f52b800 1 -- 172.21.15.121:0/928525191 shutdown_connections 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.205+0000 7f446f52b800 1 --2- 172.21.15.121:0/928525191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792e7e60 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.205+0000 7f446f52b800 1 -- 172.21.15.121:0/928525191 >> 172.21.15.121:0/928525191 conn(0x55887923e970 msgr2=0x5588792e3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.206+0000 7f446f52b800 1 -- 172.21.15.121:0/928525191 shutdown_connections 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.206+0000 7f446f52b800 1 -- 172.21.15.121:0/928525191 wait complete. 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.206+0000 7f446f52b800 1 Processor -- start 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.206+0000 7f446f52b800 1 -- start start 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.206+0000 7f446f52b800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.206+0000 7f446f52b800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588791516a0 con 0x558879243270 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.206+0000 7f446b232640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.206+0000 7f446b232640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792ef310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42478/0 (socket says 172.21.15.121:42478) 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.206+0000 7f446b232640 1 -- 172.21.15.121:0/3607930049 learned_addr learned my addr 172.21.15.121:0/3607930049 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.207+0000 7f446b232640 1 -- 172.21.15.121:0/3607930049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55887918f790 con 0x558879243270 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.207+0000 7f446b232640 1 --2- 172.21.15.121:0/3607930049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792ef310 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4464001ed0 tx=0x7f4464000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.207+0000 7f4468a2d640 1 -- 172.21.15.121:0/3607930049 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f446401f070 con 0x558879243270 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.207+0000 7f4468a2d640 1 -- 172.21.15.121:0/3607930049 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4464018640 con 0x558879243270 2023-12-07T21:10:12.204 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.207+0000 7f446f52b800 1 -- 172.21.15.121:0/3607930049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588792ef850 con 0x558879243270 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.207+0000 7f4468a2d640 1 -- 172.21.15.121:0/3607930049 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44640188e0 con 0x558879243270 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.207+0000 7f446f52b800 1 -- 172.21.15.121:0/3607930049 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588792efd30 con 0x558879243270 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f446f52b800 1 Processor -- start 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f446f52b800 1 -- start start 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f446f52b800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 0x5588792fb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f446f52b800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588790eb890 con 0x5588792fb510 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f4468a2d640 1 -- 172.21.15.121:0/3607930049 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f4464018a40 con 0x558879243270 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f446ba33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 0x5588792fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f446ba33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 0x5588792fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42486/0 (socket says 172.21.15.121:42486) 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f4468a2d640 1 --2- 172.21.15.121:0/3607930049 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f444c036110 0x7f444c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f446ba33640 1 -- 172.21.15.121:0/3908696145 learned_addr learned my addr 172.21.15.121:0/3908696145 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f4468a2d640 1 -- 172.21.15.121:0/3607930049 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f446404b980 con 0x558879243270 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f446b232640 1 --2- 172.21.15.121:0/3607930049 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f444c036110 0x7f444c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.208+0000 7f446ba33640 1 -- 172.21.15.121:0/3908696145 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588792fbe70 con 0x5588792fb510 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f446b232640 1 --2- 172.21.15.121:0/3607930049 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f444c036110 0x7f444c0385d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f446400dfd0 tx=0x7f446400df20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.205 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f446ba33640 1 --2- 172.21.15.121:0/3908696145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 0x5588792fb930 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f445c00a430 tx=0x7f445c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd6c9999d438a9c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f44627fc640 1 -- 172.21.15.121:0/3908696145 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f445c001650 con 0x5588792fb510 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f44627fc640 1 -- 172.21.15.121:0/3908696145 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c0017d0 con 0x5588792fb510 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f44627fc640 1 -- 172.21.15.121:0/3908696145 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f445c001ab0 con 0x5588792fb510 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f446f52b800 1 -- 172.21.15.121:0/3908696145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 msgr2=0x5588792fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f446f52b800 1 --2- 172.21.15.121:0/3908696145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 0x5588792fb930 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f445c00a430 tx=0x7f445c00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f446f52b800 1 -- 172.21.15.121:0/3908696145 shutdown_connections 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f446f52b800 1 --2- 172.21.15.121:0/3908696145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 0x5588792fb930 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f446f52b800 1 -- 172.21.15.121:0/3908696145 >> 172.21.15.121:0/3908696145 conn(0x558879247660 msgr2=0x5588792f68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f446f52b800 1 -- 172.21.15.121:0/3908696145 shutdown_connections 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.209+0000 7f446f52b800 1 -- 172.21.15.121:0/3908696145 wait complete. 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.210+0000 7f446f52b800 1 Processor -- start 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.210+0000 7f446f52b800 1 -- start start 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.210+0000 7f446f52b800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 0x558879302480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.206 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.210+0000 7f446f52b800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588790eb530 con 0x5588792fb510 2023-12-07T21:10:12.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.210+0000 7f446ba33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 0x558879302480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.210+0000 7f446ba33640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 0x558879302480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42498/0 (socket says 172.21.15.121:42498) 2023-12-07T21:10:12.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.210+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 learned_addr learned my addr 172.21.15.121:0/964555375 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.210+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c00a0e0 con 0x5588792fb510 2023-12-07T21:10:12.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.210+0000 7f446ba33640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 0x558879302480 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f445c00ae40 tx=0x7f445c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.211+0000 7f4460ff9640 1 -- 172.21.15.121:0/964555375 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f445c0109e0 con 0x5588792fb510 2023-12-07T21:10:12.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.211+0000 7f4460ff9640 1 -- 172.21.15.121:0/964555375 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c010b40 con 0x5588792fb510 2023-12-07T21:10:12.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.211+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588793029c0 con 0x5588792fb510 2023-12-07T21:10:12.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.211+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558879302e20 con 0x5588792fb510 2023-12-07T21:10:12.207 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.211+0000 7f4460ff9640 1 -- 172.21.15.121:0/964555375 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f445c010de0 con 0x5588792fb510 2023-12-07T21:10:12.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.211+0000 7f4460ff9640 1 -- 172.21.15.121:0/964555375 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f445c017070 con 0x5588792fb510 2023-12-07T21:10:12.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.212+0000 7f4460ff9640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f44440360c0 0x7f4444038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.212+0000 7f446f52b800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.212+0000 7f4460ff9640 1 -- 172.21.15.121:0/964555375 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f445c04bc40 con 0x5588792fb510 2023-12-07T21:10:12.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.212+0000 7f446aa31640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f44440360c0 0x7f4444038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.218 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.212+0000 7f446f52b800 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55887930dc10 0x5588793100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.212+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5588793107f0 con 0x55887930dc10 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.212+0000 7f446ba33640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55887930dc10 0x5588793100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.212+0000 7f446aa31640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f44440360c0 0x7f4444038580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4454054000 tx=0x7f445404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.212+0000 7f446ba33640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55887930dc10 0x5588793100a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f445c018c20 con 0x55887930dc10 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 20 realm 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879310be0 con 0x55887930dc10 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f445c018c20 con 0x55887930dc10 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.219 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879311430 con 0x55887930dc10 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f445c018c20 con 0x55887930dc10 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879311790 con 0x55887930dc10 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f445c018c20 con 0x55887930dc10 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5588793110d0 con 0x55887930dc10 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f445c018c20 con 0x55887930dc10 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 20 searching for the correct realm 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5588793139e0 0x558879315dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.213+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x5588793139e0 2023-12-07T21:10:12.220 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.214+0000 7f446b232640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5588793139e0 0x558879315dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.214+0000 7f446b232640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5588793139e0 0x558879315dd0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.214+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.214+0000 7f446b232640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f4464017050 0x7f44640260c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.214+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f4464017050 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.214+0000 7f446aa31640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f4464017050 0x7f44640260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.215+0000 7f446aa31640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f4464017050 0x7f44640260c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.215+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4454052840 con 0x7f4464017050 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.215+0000 7f446aa31640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f445405c920 0x7f4454009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.215+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f445405c920 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.215+0000 7f446ba33640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f445405c920 0x7f4454009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.215+0000 7f446ba33640 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f445405c920 0x7f4454009410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.216+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c018c20 con 0x7f445405c920 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.216+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x55887930dc10 2023-12-07T21:10:12.221 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.216+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c018c20 con 0x55887930dc10 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.216+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x55887930dc10 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.216+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c018c20 con 0x55887930dc10 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.216+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f445405c920 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.216+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.216+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f445405c920 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.217+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.217+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f4464017050 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.217+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4454052840 con 0x7f4464017050 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.217+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x5588793139e0 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.217+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.217+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x55887930dc10 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.217+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.217+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f445405c920 2023-12-07T21:10:12.222 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.218+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.218+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x55887930dc10 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.218+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.218+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f4464017050 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.218+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4454052840 con 0x7f4464017050 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.218+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x5588793139e0 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.218+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.218+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x5588793139e0 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.219+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.219+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f445405c920 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.219+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.219+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x5588793139e0 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.219+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.219+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x5588793139e0 2023-12-07T21:10:12.223 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.219+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.219+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x55887930dc10 2023-12-07T21:10:12.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.220+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.220+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x55887930dc10 2023-12-07T21:10:12.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.220+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.220+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f445405c920 2023-12-07T21:10:12.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.220+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.220+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x5588793139e0 2023-12-07T21:10:12.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.220+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.220+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f4464017050 2023-12-07T21:10:12.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.221+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4454052840 con 0x7f4464017050 2023-12-07T21:10:12.224 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.221+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x55887930dc10 2023-12-07T21:10:12.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.221+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.221+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f445405c920 2023-12-07T21:10:12.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.221+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.221+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x5588793139e0 2023-12-07T21:10:12.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.221+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.221+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f445405c920 2023-12-07T21:10:12.225 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.222+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.222+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f4464017050 2023-12-07T21:10:12.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.222+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4454052840 con 0x7f4464017050 2023-12-07T21:10:12.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.222+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x5588793139e0 2023-12-07T21:10:12.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.222+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.222+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f445405c920 2023-12-07T21:10:12.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.222+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.222+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x55887930dc10 2023-12-07T21:10:12.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879316360 con 0x7f4464017050 2023-12-07T21:10:12.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4454052840 con 0x7f4464017050 2023-12-07T21:10:12.226 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5588793125f0 con 0x55887930dc10 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879312270 con 0x55887930dc10 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.223+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879312ec0 con 0x5588793139e0 2023-12-07T21:10:12.227 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 20 zone default found 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 4 Realm: () 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 20 zonegroup default 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5588793167a0 con 0x7f445405c920 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879318620 con 0x5588793139e0 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.224+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879318980 con 0x5588793139e0 2023-12-07T21:10:12.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.225+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.225+0000 7f446f52b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.225+0000 7f446f52b800 20 started sync module instance, tier type = 2023-12-07T21:10:12.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.225+0000 7f446f52b800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:12.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.225+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879317bf0 con 0x7f4464017050 2023-12-07T21:10:12.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.226+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4454052840 con 0x7f4464017050 2023-12-07T21:10:12.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.226+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94044634787664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879317790 con 0x7f4464017050 2023-12-07T21:10:12.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.226+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879319180 con 0x55887930dc10 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.227+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94044634787664] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4454071040 con 0x7f4464017050 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.227+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.227+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94044637200288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879319180 con 0x55887930dc10 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.227+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879319ba0 con 0x5588793139e0 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.228+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94044637200288] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.228+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.228+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94044637203680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5588793190f0 con 0x5588793139e0 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.228+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55887931a8c0 con 0x7f4464017050 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.229+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94044637203680] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.230+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4454071040 con 0x7f4464017050 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.230+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94044637208720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55887931b110 con 0x7f4464017050 2023-12-07T21:10:12.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.230+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55887931b910 con 0x55887930dc10 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.231+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94044637208720] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4454071040 con 0x7f4464017050 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.231+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.231+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94044637213808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55887931b880 con 0x55887930dc10 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.231+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55887931c600 con 0x7f445405c920 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.232+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94044637213808] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.232+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.232+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94044637215856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55887931c520 con 0x7f445405c920 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.232+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55887931cec0 con 0x7f445405c920 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.233+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.233+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94044637219296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55887931d310 con 0x7f445405c920 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.233+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55887931ddc0 con 0x7f445405c920 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.233+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94044637215856] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.234+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94044637219296] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.234+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.234+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94044637220336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55887931c080 con 0x7f445405c920 2023-12-07T21:10:12.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.234+0000 7f446f52b800 20 add_watcher() i=0 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.234+0000 7f446f52b800 20 add_watcher() i=1 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.234+0000 7f446f52b800 20 add_watcher() i=2 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.234+0000 7f446f52b800 20 add_watcher() i=3 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.234+0000 7f446f52b800 20 add_watcher() i=4 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.234+0000 7f446f52b800 20 add_watcher() i=5 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.234+0000 7f446f52b800 20 add_watcher() i=6 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.235+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94044637220336] v33'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.235+0000 7f446f52b800 20 add_watcher() i=7 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.235+0000 7f446f52b800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.235+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879320db0 con 0x55887930dc10 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.235+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.235+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94044637223104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55887931e220 con 0x55887930dc10 2023-12-07T21:10:12.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.236+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94044637223104] v33'198 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.236+0000 7f44317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.236+0000 7f446f52b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.236+0000 7f446f52b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.236+0000 7f446f52b800 5 note: GC not initialized 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.237+0000 7f43abfff640 20 reqs_thread_entry: start 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.237+0000 7f446f52b800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.237+0000 7f446f52b800 20 Filter name: none 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.237+0000 7f43a9ffb640 20 reqs_thread_entry: start 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.237+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5588793542b0 con 0x55887930dc10 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.237+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.237+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5588793542b0 con 0x7f4464017050 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.237+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4454071040 con 0x7f4464017050 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.237+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5588793546f0 con 0x55887930dc10 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.238+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.238+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5588793546f0 con 0x5588793139e0 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.238+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.238+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879354b40 con 0x5588793139e0 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.238+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.238+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879354ef0 con 0x5588793139e0 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.238+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.238+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879354ef0 con 0x55887930dc10 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.238+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.238+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879354ef0 con 0x55887930dc10 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.239+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.239+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879354ef0 con 0x5588793139e0 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.239+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.239+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879354ea0 con 0x5588793139e0 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.239+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.239+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879354ea0 con 0x7f445405c920 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.240+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.243 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.240+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356860 con 0x55887930dc10 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.240+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.240+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356860 con 0x7f4464017050 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.240+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4454071040 con 0x7f4464017050 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.240+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x5588793139e0 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.240+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.240+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x7f445405c920 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.241+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.241+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x7f445405c920 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.241+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.241+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x5588793139e0 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.241+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.241+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x7f445405c920 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.241+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.242+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x55887930dc10 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.242+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.242+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x5588793139e0 2023-12-07T21:10:12.244 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.242+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.242+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x7f445405c920 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.243+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.243+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x7f4464017050 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.243+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4454071040 con 0x7f4464017050 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.243+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x7f445405c920 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.243+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.243+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x55887930dc10 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.243+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.243+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x55887930dc10 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.244+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.244+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x5588793139e0 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.244+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.244+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x55887930dc10 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.244+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.244+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x55887930dc10 2023-12-07T21:10:12.245 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.244+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.244+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x5588793139e0 2023-12-07T21:10:12.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.244+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.244+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x5588793139e0 2023-12-07T21:10:12.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.245+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.245+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x5588793139e0 2023-12-07T21:10:12.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.245+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.245+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356bc0 con 0x7f445405c920 2023-12-07T21:10:12.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.245+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.246+0000 7f44317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.246 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.246+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94044637223104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356410 con 0x55887930dc10 2023-12-07T21:10:12.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.247+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94044637223104] v33'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.247+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94044634787664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356410 con 0x7f4464017050 2023-12-07T21:10:12.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.248+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94044634787664] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4454071040 con 0x7f4464017050 2023-12-07T21:10:12.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.248+0000 7f446f52b800 20 remove_watcher() i=0 2023-12-07T21:10:12.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.248+0000 7f446f52b800 2 removed watcher, disabling cache 2023-12-07T21:10:12.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.248+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94044637200288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356410 con 0x55887930dc10 2023-12-07T21:10:12.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.250+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94044637200288] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.250+0000 7f446f52b800 20 remove_watcher() i=1 2023-12-07T21:10:12.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.250+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94044637203680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356410 con 0x5588793139e0 2023-12-07T21:10:12.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.250+0000 7f446b232640 1 -- 172.21.15.121:0/964555375 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94044637203680] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4464014070 con 0x5588793139e0 2023-12-07T21:10:12.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.250+0000 7f446f52b800 20 remove_watcher() i=2 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.251+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94044637208720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356410 con 0x7f4464017050 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.251+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94044637208720] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4454071040 con 0x7f4464017050 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.252+0000 7f446f52b800 20 remove_watcher() i=3 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.252+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94044637213808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356410 con 0x55887930dc10 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.253+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94044637213808] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x55887930dc10 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.253+0000 7f446f52b800 20 remove_watcher() i=4 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.253+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94044637215856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356410 con 0x7f445405c920 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.254+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94044637215856] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.254+0000 7f446f52b800 20 remove_watcher() i=5 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.254+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94044637219296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356410 con 0x7f445405c920 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.255+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94044637219296] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.255+0000 7f446f52b800 20 remove_watcher() i=6 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.255+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94044637220336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558879356410 con 0x7f445405c920 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446ba33640 1 -- 172.21.15.121:0/964555375 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94044637220336] v33'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f445c03c040 con 0x7f445405c920 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 20 remove_watcher() i=7 2023-12-07T21:10:12.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f445405c920 msgr2=0x7f4454009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f445405c920 0x7f4454009410 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55887930dc10 msgr2=0x5588793100a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55887930dc10 0x5588793100a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f4464017050 msgr2=0x7f44640260c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f4464017050 0x7f44640260c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5588793139e0 msgr2=0x558879315dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5588793139e0 0x558879315dd0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f44440360c0 msgr2=0x7f4444038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f44440360c0 0x7f4444038580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4454054000 tx=0x7f445404e000 comp rx=0 tx=0).stop 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 msgr2=0x558879302480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 --2- 172.21.15.121:0/964555375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5588792fb510 0x558879302480 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f445c00ae40 tx=0x7f445c003370 comp rx=0 tx=0).stop 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 reap_dead start 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 shutdown_connections 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446aa31640 1 -- 172.21.15.121:0/964555375 reap_dead start 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 >> 172.21.15.121:0/964555375 conn(0x558879247660 msgr2=0x5588792f56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 shutdown_connections 2023-12-07T21:10:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.256+0000 7f446f52b800 1 -- 172.21.15.121:0/964555375 wait complete. 2023-12-07T21:10:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.257+0000 7f446f52b800 1 -- 172.21.15.121:0/3607930049 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f444c036110 msgr2=0x7f444c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.257+0000 7f446f52b800 1 --2- 172.21.15.121:0/3607930049 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f444c036110 0x7f444c0385d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f446400dfd0 tx=0x7f446400df20 comp rx=0 tx=0).stop 2023-12-07T21:10:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.257+0000 7f446f52b800 1 -- 172.21.15.121:0/3607930049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 msgr2=0x5588792ef310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.257+0000 7f446f52b800 1 --2- 172.21.15.121:0/3607930049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792ef310 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4464001ed0 tx=0x7f4464000ed0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.257+0000 7f446f52b800 1 -- 172.21.15.121:0/3607930049 shutdown_connections 2023-12-07T21:10:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.257+0000 7f446f52b800 1 --2- 172.21.15.121:0/3607930049 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f444c036110 0x7f444c0385d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.257+0000 7f446f52b800 1 --2- 172.21.15.121:0/3607930049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558879243270 0x5588792ef310 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.257+0000 7f446f52b800 1 -- 172.21.15.121:0/3607930049 >> 172.21.15.121:0/3607930049 conn(0x55887923e970 msgr2=0x5588792e6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.257+0000 7f446f52b800 1 -- 172.21.15.121:0/3607930049 shutdown_connections 2023-12-07T21:10:12.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.257+0000 7f446f52b800 1 -- 172.21.15.121:0/3607930049 wait complete. 2023-12-07T21:10:12.254 INFO:teuthology.orchestra.run.smithi121.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2023-12-07T21:10:12.254 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2023-12-07T21:10:12.255 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2023-12-07T21:10:12.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2023-12-07T21:10:12.255 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2023-12-07T21:10:12.336 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:12.336 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:12.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.344+0000 7fa4607dc800 1 Processor -- start 2023-12-07T21:10:12.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.344+0000 7fa4607dc800 1 -- start start 2023-12-07T21:10:12.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.345+0000 7fa4607dc800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55abbff7d4e0 0x55abbff7f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.345+0000 7fa4607dc800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55abbfec57a0 con 0x55abbfeedb90 2023-12-07T21:10:12.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.345+0000 7fa4607dc800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55abbfe8e880 con 0x55abbff7d4e0 2023-12-07T21:10:12.337 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.345+0000 7fa45dadb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55abbff7d4e0 0x55abbff7f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.345+0000 7fa45e2dc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55abbfeedb90 0x55abbff7bdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:35594/0 (socket says 172.21.15.121:35594) 2023-12-07T21:10:12.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.345+0000 7fa45e2dc640 1 -- 172.21.15.121:0/280213993 learned_addr learned my addr 172.21.15.121:0/280213993 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:12.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.345+0000 7fa45dadb640 1 -- 172.21.15.121:0/280213993 >> v1:172.21.15.89:6789/0 conn(0x55abbfeedb90 legacy=0x55abbff7bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.338 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.345+0000 7fa45dadb640 1 -- 172.21.15.121:0/280213993 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abbff81050 con 0x55abbff7d4e0 2023-12-07T21:10:12.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.347+0000 7fa45dadb640 1 --2- 172.21.15.121:0/280213993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbff7d4e0 0x55abbff7f970 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa45400a470 tx=0x7fa45401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ad58157865f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.347+0000 7fa45d2da640 1 -- 172.21.15.121:0/280213993 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa454052570 con 0x55abbff7d4e0 2023-12-07T21:10:12.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.347+0000 7fa45d2da640 1 -- 172.21.15.121:0/280213993 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4540526d0 con 0x55abbff7d4e0 2023-12-07T21:10:12.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.347+0000 7fa45d2da640 1 -- 172.21.15.121:0/280213993 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa454052990 con 0x55abbff7d4e0 2023-12-07T21:10:12.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.348+0000 7fa4607dc800 1 -- 172.21.15.121:0/280213993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbff7d4e0 msgr2=0x55abbff7f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.348+0000 7fa4607dc800 1 --2- 172.21.15.121:0/280213993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbff7d4e0 0x55abbff7f970 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa45400a470 tx=0x7fa45401cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:12.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.348+0000 7fa4607dc800 1 -- 172.21.15.121:0/280213993 shutdown_connections 2023-12-07T21:10:12.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.348+0000 7fa4607dc800 1 --2- 172.21.15.121:0/280213993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbff7d4e0 0x55abbff7f970 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.348+0000 7fa4607dc800 1 -- 172.21.15.121:0/280213993 >> 172.21.15.121:0/280213993 conn(0x55abbff73880 msgr2=0x55abbff75ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.340 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.348+0000 7fa4607dc800 1 -- 172.21.15.121:0/280213993 shutdown_connections 2023-12-07T21:10:12.341 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.348+0000 7fa4607dc800 1 -- 172.21.15.121:0/280213993 wait complete. 2023-12-07T21:10:12.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.348+0000 7fa4607dc800 1 Processor -- start 2023-12-07T21:10:12.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.348+0000 7fa4607dc800 1 -- start start 2023-12-07T21:10:12.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.349+0000 7fa4607dc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abc001de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.349+0000 7fa4607dc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abbfe8bdb0 con 0x55abbfeedb90 2023-12-07T21:10:12.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.349+0000 7fa45e2dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abc001de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.349+0000 7fa45e2dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abc001de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42522/0 (socket says 172.21.15.121:42522) 2023-12-07T21:10:12.343 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.349+0000 7fa45e2dc640 1 -- 172.21.15.121:0/1866825682 learned_addr learned my addr 172.21.15.121:0/1866825682 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.349+0000 7fa45e2dc640 1 -- 172.21.15.121:0/1866825682 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454005d20 con 0x55abbfeedb90 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.349+0000 7fa45e2dc640 1 --2- 172.21.15.121:0/1866825682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abc001de20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa4500014a0 tx=0x7fa450001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700e0afe93b12440 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.349+0000 7fa45cad9640 1 -- 172.21.15.121:0/1866825682 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa450004520 con 0x55abbfeedb90 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.349+0000 7fa45cad9640 1 -- 172.21.15.121:0/1866825682 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa450004680 con 0x55abbfeedb90 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.349+0000 7fa45cad9640 1 -- 172.21.15.121:0/1866825682 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa450004980 con 0x55abbfeedb90 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.350+0000 7fa4607dc800 1 -- 172.21.15.121:0/1866825682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 msgr2=0x55abc001de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.350+0000 7fa4607dc800 1 --2- 172.21.15.121:0/1866825682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abc001de20 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa4500014a0 tx=0x7fa450001960 comp rx=0 tx=0).stop 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.350+0000 7fa4607dc800 1 -- 172.21.15.121:0/1866825682 shutdown_connections 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.350+0000 7fa4607dc800 1 --2- 172.21.15.121:0/1866825682 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abc001de20 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.350+0000 7fa4607dc800 1 -- 172.21.15.121:0/1866825682 >> 172.21.15.121:0/1866825682 conn(0x55abbff73880 msgr2=0x55abc0019a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.350+0000 7fa4607dc800 1 -- 172.21.15.121:0/1866825682 shutdown_connections 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.350+0000 7fa4607dc800 1 -- 172.21.15.121:0/1866825682 wait complete. 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.350+0000 7fa4607dc800 1 Processor -- start 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.350+0000 7fa4607dc800 1 -- start start 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.350+0000 7fa4607dc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abbff79600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.344 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.350+0000 7fa4607dc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abbfe876a0 con 0x55abbfeedb90 2023-12-07T21:10:12.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.351+0000 7fa45e2dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abbff79600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.351+0000 7fa45e2dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abbff79600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42530/0 (socket says 172.21.15.121:42530) 2023-12-07T21:10:12.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.351+0000 7fa45e2dc640 1 -- 172.21.15.121:0/1423259124 learned_addr learned my addr 172.21.15.121:0/1423259124 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.351+0000 7fa45e2dc640 1 -- 172.21.15.121:0/1423259124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abbfec57a0 con 0x55abbfeedb90 2023-12-07T21:10:12.345 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.351+0000 7fa45e2dc640 1 --2- 172.21.15.121:0/1423259124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abbff79600 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa450000f80 tx=0x7fa450001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.351+0000 7fa44f7fe640 1 -- 172.21.15.121:0/1423259124 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa450013760 con 0x55abbfeedb90 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.351+0000 7fa44f7fe640 1 -- 172.21.15.121:0/1423259124 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4500138c0 con 0x55abbfeedb90 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.351+0000 7fa44f7fe640 1 -- 172.21.15.121:0/1423259124 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa450013b80 con 0x55abbfeedb90 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.351+0000 7fa4607dc800 1 -- 172.21.15.121:0/1423259124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55abbff79b40 con 0x55abbfeedb90 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.351+0000 7fa4607dc800 1 -- 172.21.15.121:0/1423259124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55abbff78070 con 0x55abbfeedb90 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.352+0000 7fa4607dc800 1 Processor -- start 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.352+0000 7fa4607dc800 1 -- start start 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.352+0000 7fa4607dc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 0x55abc0033a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.352+0000 7fa4607dc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abbfe21890 con 0x55abc0033660 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.352+0000 7fa44f7fe640 1 -- 172.21.15.121:0/1423259124 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa450013ce0 con 0x55abbfeedb90 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.352+0000 7fa45eadd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 0x55abc0033a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.352+0000 7fa45eadd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 0x55abc0033a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42544/0 (socket says 172.21.15.121:42544) 2023-12-07T21:10:12.352 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.352+0000 7fa45eadd640 1 -- 172.21.15.121:0/3629730093 learned_addr learned my addr 172.21.15.121:0/3629730093 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.352+0000 7fa44f7fe640 1 --2- 172.21.15.121:0/1423259124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa440036110 0x7fa4400385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.352+0000 7fa44f7fe640 1 -- 172.21.15.121:0/1423259124 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fa45004ba20 con 0x55abbfeedb90 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.352+0000 7fa45e2dc640 1 --2- 172.21.15.121:0/1423259124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa440036110 0x7fa4400385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa45eadd640 1 -- 172.21.15.121:0/3629730093 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abc0033fc0 con 0x55abc0033660 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa45eadd640 1 --2- 172.21.15.121:0/3629730093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 0x55abc0033a80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa45800a400 tx=0x7fa45800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d693b5641c88077f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa45e2dc640 1 --2- 172.21.15.121:0/1423259124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa440036110 0x7fa4400385d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa450011ff0 tx=0x7fa450011f80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa44d7fa640 1 -- 172.21.15.121:0/3629730093 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4580087e0 con 0x55abc0033660 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa44d7fa640 1 -- 172.21.15.121:0/3629730093 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa458008960 con 0x55abc0033660 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa44d7fa640 1 -- 172.21.15.121:0/3629730093 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa458008c80 con 0x55abc0033660 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa4607dc800 1 -- 172.21.15.121:0/3629730093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 msgr2=0x55abc0033a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa4607dc800 1 --2- 172.21.15.121:0/3629730093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 0x55abc0033a80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa45800a400 tx=0x7fa45800a8c0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa4607dc800 1 -- 172.21.15.121:0/3629730093 shutdown_connections 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa4607dc800 1 --2- 172.21.15.121:0/3629730093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 0x55abc0033a80 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.353 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa4607dc800 1 -- 172.21.15.121:0/3629730093 >> 172.21.15.121:0/3629730093 conn(0x55abbff7d4e0 msgr2=0x55abc002ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa4607dc800 1 -- 172.21.15.121:0/3629730093 shutdown_connections 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.353+0000 7fa4607dc800 1 -- 172.21.15.121:0/3629730093 wait complete. 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.354+0000 7fa4607dc800 1 Processor -- start 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.354+0000 7fa4607dc800 1 -- start start 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.354+0000 7fa4607dc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 0x55abc003a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.354+0000 7fa4607dc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abbfe21530 con 0x55abc0033660 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.354+0000 7fa45eadd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 0x55abc003a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.354+0000 7fa45eadd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 0x55abc003a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42558/0 (socket says 172.21.15.121:42558) 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.354+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 learned_addr learned my addr 172.21.15.121:0/146443552 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.354+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa458005c90 con 0x55abc0033660 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.354+0000 7fa45eadd640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 0x55abc003a5c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c010 tx=0x7fa458002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.355+0000 7fa43f7fe640 1 -- 172.21.15.121:0/146443552 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa458013840 con 0x55abc0033660 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.355+0000 7fa43f7fe640 1 -- 172.21.15.121:0/146443552 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4580139a0 con 0x55abc0033660 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.355+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55abc003ab00 con 0x55abc0033660 2023-12-07T21:10:12.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.355+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55abc003afc0 con 0x55abc0033660 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.355+0000 7fa43f7fe640 1 -- 172.21.15.121:0/146443552 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa458013c40 con 0x55abc0033660 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.355+0000 7fa43f7fe640 1 -- 172.21.15.121:0/146443552 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa45801e420 con 0x55abc0033660 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.356+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.356+0000 7fa43f7fe640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa4380360c0 0x7fa438038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.356+0000 7fa43f7fe640 1 -- 172.21.15.121:0/146443552 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fa45804b8f0 con 0x55abc0033660 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.356+0000 7fa45dadb640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa4380360c0 0x7fa438038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.356+0000 7fa4607dc800 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55abc0045d90 0x55abc0048250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.356+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc00489a0 con 0x55abc0045d90 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.356+0000 7fa45eadd640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55abc0045d90 0x55abc0048250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.356+0000 7fa45dadb640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa4380360c0 0x7fa438038580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa454054000 tx=0x7fa45404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.356+0000 7fa45eadd640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55abc0045d90 0x55abc0048250 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa458024070 con 0x55abc0045d90 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 20 realm 2023-12-07T21:10:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0048d70 con 0x55abc0045d90 2023-12-07T21:10:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa458024070 con 0x55abc0045d90 2023-12-07T21:10:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc00495c0 con 0x55abc0045d90 2023-12-07T21:10:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa458024070 con 0x55abc0045d90 2023-12-07T21:10:12.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0049920 con 0x55abc0045d90 2023-12-07T21:10:12.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa458024070 con 0x55abc0045d90 2023-12-07T21:10:12.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.357+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc00491e0 con 0x55abc0045d90 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.358+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa458024070 con 0x55abc0045d90 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.358+0000 7fa4607dc800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.358+0000 7fa4607dc800 20 searching for the correct realm 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.358+0000 7fa4607dc800 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55abc004bb30 0x55abc004df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.358+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc004bb30 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.358+0000 7fa45e2dc640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55abc004bb30 0x55abc004df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.358+0000 7fa45e2dc640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55abc004bb30 0x55abc004df20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.358+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.358+0000 7fa45e2dc640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa45004aef0 0x7fa45004b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.358+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45004aef0 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.358+0000 7fa45dadb640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa45004aef0 0x7fa45004b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.359+0000 7fa45dadb640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa45004aef0 0x7fa45004b310 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.359+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.359+0000 7fa45dadb640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa45405c920 0x7fa4540673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.359+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45405c920 2023-12-07T21:10:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.359+0000 7fa45eadd640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa45405c920 0x7fa4540673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.359+0000 7fa45eadd640 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa45405c920 0x7fa4540673d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.360+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa458024070 con 0x7fa45405c920 2023-12-07T21:10:12.360 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.360+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc0045d90 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.360+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa458024070 con 0x55abc0045d90 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.360+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc0045d90 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.360+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa458024070 con 0x55abc0045d90 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.360+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45405c920 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.361+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa458024070 con 0x7fa45405c920 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.361+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45405c920 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.361+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa458024070 con 0x7fa45405c920 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.361+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45004aef0 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.361+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.361+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc004bb30 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.361+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.369 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.361+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc0045d90 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.361+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa458024070 con 0x55abc0045d90 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.361+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45405c920 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.362+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.362+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc0045d90 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.362+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.362+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45004aef0 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.362+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.362+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc004bb30 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.362+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.362+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc004bb30 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.363+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.363+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45405c920 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.363+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.363+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc004bb30 2023-12-07T21:10:12.370 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.363+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.363+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc004bb30 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.363+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.363+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc0045d90 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.364+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.364+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc0045d90 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.364+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.364+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45405c920 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.364+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.364+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc004bb30 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.364+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.364+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45004aef0 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.365+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.365+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc0045d90 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.365+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.365+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45405c920 2023-12-07T21:10:12.371 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.365+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.365+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc004bb30 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.365+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.365+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45405c920 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.366+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.366+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45004aef0 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.366+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.366+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc004bb30 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.366+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.366+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45405c920 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.366+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.366+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x55abc0045d90 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004e490 con 0x7fa45004aef0 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:12.372 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004a710 con 0x55abc0045d90 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004a330 con 0x55abc0045d90 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.367+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004b020 con 0x55abc004bb30 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 20 zone default found 2023-12-07T21:10:12.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 4 Realm: () 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 20 zonegroup default 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004ed70 con 0x7fa45405c920 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc00507e0 con 0x55abc004bb30 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0050c00 con 0x55abc004bb30 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.368+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.369+0000 7fa4607dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.369+0000 7fa4607dc800 20 started sync module instance, tier type = 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.369+0000 7fa4607dc800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.369+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004fd20 con 0x7fa45004aef0 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.370+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.370+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94196146900816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc004f980 con 0x7fa45004aef0 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.370+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc00514a0 con 0x55abc0045d90 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.371+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94196146900816] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.371+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.371+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94196149321936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc00514a0 con 0x55abc0045d90 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.371+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0051fc0 con 0x55abc004bb30 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.372+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94196149321936] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.372+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.372+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94196149325824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0051410 con 0x55abc004bb30 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.373+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0052cb0 con 0x7fa45004aef0 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.373+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94196149325824] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.374+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.374+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94196149331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0053500 con 0x7fa45004aef0 2023-12-07T21:10:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.374+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0053d00 con 0x55abc0045d90 2023-12-07T21:10:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.375+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94196149331072] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.375+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.375+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94196149336160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0054110 con 0x55abc0045d90 2023-12-07T21:10:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.375+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0054910 con 0x7fa45405c920 2023-12-07T21:10:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.376+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.376+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94196149336160] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.376+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94196149338656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0054cc0 con 0x7fa45405c920 2023-12-07T21:10:12.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.376+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0053c90 con 0x7fa45405c920 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.377+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94196149338656] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.377+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.377+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94196149337232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0055270 con 0x7fa45405c920 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.377+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0055be0 con 0x7fa45405c920 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.378+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v33'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.378+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94196149344064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0055ff0 con 0x7fa45405c920 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.378+0000 7fa4607dc800 20 add_watcher() i=0 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.378+0000 7fa4607dc800 20 add_watcher() i=1 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.378+0000 7fa4607dc800 20 add_watcher() i=2 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.378+0000 7fa4607dc800 20 add_watcher() i=3 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.378+0000 7fa4607dc800 20 add_watcher() i=4 2023-12-07T21:10:12.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.378+0000 7fa4607dc800 20 add_watcher() i=5 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.378+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94196149337232] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.378+0000 7fa4607dc800 20 add_watcher() i=6 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.379+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94196149344064] v33'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.379+0000 7fa4607dc800 20 add_watcher() i=7 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.379+0000 7fa4607dc800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.379+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc00546b0 con 0x55abc0045d90 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.379+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.380+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94196149345104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc00546b0 con 0x55abc0045d90 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.381+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94196149345104] v33'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.381+0000 7fa41f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.381+0000 7fa4607dc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.381+0000 7fa4607dc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.381+0000 7fa4607dc800 5 note: GC not initialized 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.381+0000 7fa41e7fc640 20 reqs_thread_entry: start 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.381+0000 7fa4607dc800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:12.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.381+0000 7fa4607dc800 20 Filter name: none 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.381+0000 7fa38ffff640 20 reqs_thread_entry: start 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.381+0000 7fa4607dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.381+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc008bb30 con 0x55abc0045d90 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.382+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.382+0000 7fa4607dc800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.382+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc008bb30 con 0x7fa45405c920 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.382+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.383+0000 7fa41f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.383+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94196149345104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc008bb30 con 0x55abc0045d90 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.384+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94196149345104] v33'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.384+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94196146900816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc008bb30 con 0x7fa45004aef0 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.385+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94196146900816] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.385+0000 7fa4607dc800 20 remove_watcher() i=0 2023-12-07T21:10:12.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.385+0000 7fa4607dc800 2 removed watcher, disabling cache 2023-12-07T21:10:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.385+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94196149321936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0056960 con 0x55abc0045d90 2023-12-07T21:10:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.387+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94196149321936] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.387+0000 7fa4607dc800 20 remove_watcher() i=1 2023-12-07T21:10:12.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.387+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94196149325824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0056960 con 0x55abc004bb30 2023-12-07T21:10:12.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.388+0000 7fa45e2dc640 1 -- 172.21.15.121:0/146443552 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94196149325824] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45003a040 con 0x55abc004bb30 2023-12-07T21:10:12.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.388+0000 7fa4607dc800 20 remove_watcher() i=2 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.388+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94196149331072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0056cc0 con 0x7fa45004aef0 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.389+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94196149331072] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa454052840 con 0x7fa45004aef0 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.389+0000 7fa4607dc800 20 remove_watcher() i=3 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.389+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94196149336160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0057020 con 0x55abc0045d90 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.390+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94196149336160] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x55abc0045d90 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.390+0000 7fa4607dc800 20 remove_watcher() i=4 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.390+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94196149338656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0057020 con 0x7fa45405c920 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.391+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94196149338656] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.391+0000 7fa4607dc800 20 remove_watcher() i=5 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.391+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94196149337232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0054220 con 0x7fa45405c920 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.392+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94196149337232] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.392+0000 7fa4607dc800 20 remove_watcher() i=6 2023-12-07T21:10:12.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.392+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94196149344064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55abc0054220 con 0x7fa45405c920 2023-12-07T21:10:12.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa45eadd640 1 -- 172.21.15.121:0/146443552 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94196149344064] v33'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa45803b040 con 0x7fa45405c920 2023-12-07T21:10:12.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 20 remove_watcher() i=7 2023-12-07T21:10:12.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa45405c920 msgr2=0x7fa4540673d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa45405c920 0x7fa4540673d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.387 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55abc0045d90 msgr2=0x55abc0048250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55abc0045d90 0x55abc0048250 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa45004aef0 msgr2=0x7fa45004b310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa45004aef0 0x7fa45004b310 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55abc004bb30 msgr2=0x55abc004df20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55abc004bb30 0x55abc004df20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa4380360c0 msgr2=0x7fa438038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa4380360c0 0x7fa438038580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa454054000 tx=0x7fa45404e000 comp rx=0 tx=0).stop 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 msgr2=0x55abc003a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 --2- 172.21.15.121:0/146443552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abc0033660 0x55abc003a5c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c010 tx=0x7fa458002ff0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 reap_dead start 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa45dadb640 1 -- 172.21.15.121:0/146443552 reap_dead start 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 shutdown_connections 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 >> 172.21.15.121:0/146443552 conn(0x55abbff7d4e0 msgr2=0x55abc002e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 shutdown_connections 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.393+0000 7fa4607dc800 1 -- 172.21.15.121:0/146443552 wait complete. 2023-12-07T21:10:12.388 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.394+0000 7fa4607dc800 1 -- 172.21.15.121:0/1423259124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa440036110 msgr2=0x7fa4400385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.394+0000 7fa4607dc800 1 --2- 172.21.15.121:0/1423259124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa440036110 0x7fa4400385d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa450011ff0 tx=0x7fa450011f80 comp rx=0 tx=0).stop 2023-12-07T21:10:12.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.394+0000 7fa4607dc800 1 -- 172.21.15.121:0/1423259124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 msgr2=0x55abbff79600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.394+0000 7fa4607dc800 1 --2- 172.21.15.121:0/1423259124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abbff79600 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa450000f80 tx=0x7fa450001250 comp rx=0 tx=0).stop 2023-12-07T21:10:12.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.394+0000 7fa4607dc800 1 -- 172.21.15.121:0/1423259124 shutdown_connections 2023-12-07T21:10:12.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.394+0000 7fa4607dc800 1 --2- 172.21.15.121:0/1423259124 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa440036110 0x7fa4400385d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.394+0000 7fa4607dc800 1 --2- 172.21.15.121:0/1423259124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55abbfeedb90 0x55abbff79600 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.394+0000 7fa4607dc800 1 -- 172.21.15.121:0/1423259124 >> 172.21.15.121:0/1423259124 conn(0x55abbff73880 msgr2=0x55abc001cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.394+0000 7fa4607dc800 1 -- 172.21.15.121:0/1423259124 shutdown_connections 2023-12-07T21:10:12.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.394+0000 7fa4607dc800 1 -- 172.21.15.121:0/1423259124 wait complete. 2023-12-07T21:10:12.390 INFO:teuthology.orchestra.run.smithi121.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2023-12-07T21:10:12.390 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2023-12-07T21:10:12.390 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2023-12-07T21:10:12.391 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2023-12-07T21:10:12.391 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2023-12-07T21:10:12.474 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:12.474 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.482+0000 7fe0e4746800 1 Processor -- start 2023-12-07T21:10:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.483+0000 7fe0e4746800 1 -- start start 2023-12-07T21:10:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.483+0000 7fe0e4746800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d581125550 0x55d581127940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.483+0000 7fe0e4746800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d58106e740 con 0x55d581121110 2023-12-07T21:10:12.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.483+0000 7fe0e4746800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d581037880 con 0x55d581125550 2023-12-07T21:10:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.483+0000 7fe0dfd09640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d581125550 0x55d581127940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.483+0000 7fe0e050a640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55d581121110 0x55d581121530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:35596/0 (socket says 172.21.15.121:35596) 2023-12-07T21:10:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.483+0000 7fe0e050a640 1 -- 172.21.15.121:0/721901508 learned_addr learned my addr 172.21.15.121:0/721901508 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.483+0000 7fe0df508640 1 -- 172.21.15.121:0/721901508 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874080781 0 0) 0x55d58106e740 con 0x55d581121110 2023-12-07T21:10:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.483+0000 7fe0df508640 1 -- 172.21.15.121:0/721901508 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c8001e10 con 0x55d581121110 2023-12-07T21:10:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.483+0000 7fe0dfd09640 1 -- 172.21.15.121:0/721901508 >> v1:172.21.15.89:6789/0 conn(0x55d581121110 legacy=0x55d581121530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.483+0000 7fe0dfd09640 1 -- 172.21.15.121:0/721901508 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d581128f70 con 0x55d581125550 2023-12-07T21:10:12.478 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.485+0000 7fe0dfd09640 1 --2- 172.21.15.121:0/721901508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581125550 0x55d581127940 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400a470 tx=0x7fe0d401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff64ea46772a424 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.485+0000 7fe0df508640 1 -- 172.21.15.121:0/721901508 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0d404ad60 con 0x55d581125550 2023-12-07T21:10:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.485+0000 7fe0df508640 1 -- 172.21.15.121:0/721901508 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d4052440 con 0x55d581125550 2023-12-07T21:10:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.485+0000 7fe0df508640 1 -- 172.21.15.121:0/721901508 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0d4052700 con 0x55d581125550 2023-12-07T21:10:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.486+0000 7fe0e4746800 1 -- 172.21.15.121:0/721901508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581125550 msgr2=0x55d581127940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.486+0000 7fe0e4746800 1 --2- 172.21.15.121:0/721901508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581125550 0x55d581127940 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400a470 tx=0x7fe0d401cc80 comp rx=0 tx=0).stop 2023-12-07T21:10:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.486+0000 7fe0e4746800 1 -- 172.21.15.121:0/721901508 shutdown_connections 2023-12-07T21:10:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.486+0000 7fe0e4746800 1 --2- 172.21.15.121:0/721901508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581125550 0x55d581127940 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.486+0000 7fe0e4746800 1 -- 172.21.15.121:0/721901508 >> 172.21.15.121:0/721901508 conn(0x55d58111c890 msgr2=0x55d58111ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.486+0000 7fe0e4746800 1 -- 172.21.15.121:0/721901508 shutdown_connections 2023-12-07T21:10:12.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.486+0000 7fe0e4746800 1 -- 172.21.15.121:0/721901508 wait complete. 2023-12-07T21:10:12.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.487+0000 7fe0e4746800 1 Processor -- start 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.487+0000 7fe0e4746800 1 -- start start 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.487+0000 7fe0e4746800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5810961c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.487+0000 7fe0e4746800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d581034db0 con 0x55d581121110 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.487+0000 7fe0e050a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5810961c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.487+0000 7fe0e050a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5810961c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42586/0 (socket says 172.21.15.121:42586) 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.487+0000 7fe0e050a640 1 -- 172.21.15.121:0/520293742 learned_addr learned my addr 172.21.15.121:0/520293742 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.487+0000 7fe0e050a640 1 -- 172.21.15.121:0/520293742 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d4005d20 con 0x55d581121110 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.487+0000 7fe0e050a640 1 --2- 172.21.15.121:0/520293742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5810961c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0006ea0 tx=0x7fe0d0006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d891db93bd89a36b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0ded07640 1 -- 172.21.15.121:0/520293742 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0d0004520 con 0x55d581121110 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0ded07640 1 -- 172.21.15.121:0/520293742 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d00046a0 con 0x55d581121110 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0ded07640 1 -- 172.21.15.121:0/520293742 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0d0004890 con 0x55d581121110 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0e4746800 1 -- 172.21.15.121:0/520293742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 msgr2=0x55d5810961c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0e4746800 1 --2- 172.21.15.121:0/520293742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5810961c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0006ea0 tx=0x7fe0d0006f90 comp rx=0 tx=0).stop 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0e4746800 1 -- 172.21.15.121:0/520293742 shutdown_connections 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0e4746800 1 --2- 172.21.15.121:0/520293742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5810961c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0e4746800 1 -- 172.21.15.121:0/520293742 >> 172.21.15.121:0/520293742 conn(0x55d58111c890 msgr2=0x55d5811c1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0e4746800 1 -- 172.21.15.121:0/520293742 shutdown_connections 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0e4746800 1 -- 172.21.15.121:0/520293742 wait complete. 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0e4746800 1 Processor -- start 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.488+0000 7fe0e4746800 1 -- start start 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.489+0000 7fe0e4746800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5811c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.489+0000 7fe0e4746800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5810306a0 con 0x55d581121110 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.489+0000 7fe0e050a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5811c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.489+0000 7fe0e050a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5811c7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42600/0 (socket says 172.21.15.121:42600) 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.489+0000 7fe0e050a640 1 -- 172.21.15.121:0/8410130 learned_addr learned my addr 172.21.15.121:0/8410130 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.489+0000 7fe0e050a640 1 -- 172.21.15.121:0/8410130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c8001e10 con 0x55d581121110 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.489+0000 7fe0e050a640 1 --2- 172.21.15.121:0/8410130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5811c7360 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0001560 tx=0x7fe0d0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.490+0000 7fe0ddd05640 1 -- 172.21.15.121:0/8410130 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0d0013760 con 0x55d581121110 2023-12-07T21:10:12.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.490+0000 7fe0ddd05640 1 -- 172.21.15.121:0/8410130 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d00138c0 con 0x55d581121110 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.490+0000 7fe0ddd05640 1 -- 172.21.15.121:0/8410130 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0d0013ba0 con 0x55d581121110 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.490+0000 7fe0e4746800 1 -- 172.21.15.121:0/8410130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5811c78a0 con 0x55d581121110 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.490+0000 7fe0e4746800 1 -- 172.21.15.121:0/8410130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5811c5de0 con 0x55d581121110 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.490+0000 7fe0e4746800 1 Processor -- start 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.490+0000 7fe0e4746800 1 -- start start 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.490+0000 7fe0e4746800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 0x55d5811dc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.490+0000 7fe0e4746800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d580fca890 con 0x55d5811dc580 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.490+0000 7fe0ddd05640 1 -- 172.21.15.121:0/8410130 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fe0d0013d00 con 0x55d581121110 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0ddd05640 1 --2- 172.21.15.121:0/8410130 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe0cc036110 0x7fe0cc0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0e0d0b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 0x55d5811dc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0e0d0b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 0x55d5811dc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42608/0 (socket says 172.21.15.121:42608) 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/451670586 learned_addr learned my addr 172.21.15.121:0/451670586 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0ddd05640 1 -- 172.21.15.121:0/8410130 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fe0d004b9d0 con 0x55d581121110 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0e050a640 1 --2- 172.21.15.121:0/8410130 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe0cc036110 0x7fe0cc0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/451670586 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5811dcee0 con 0x55d5811dc580 2023-12-07T21:10:12.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0e050a640 1 --2- 172.21.15.121:0/8410130 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe0cc036110 0x7fe0cc0385d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0006610 tx=0x7fe0d0011f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0e0d0b640 1 --2- 172.21.15.121:0/451670586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 0x55d5811dc9a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800a400 tx=0x7fe0d800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e690890a9bebbb2c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0c77fe640 1 -- 172.21.15.121:0/451670586 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0d80087e0 con 0x55d5811dc580 2023-12-07T21:10:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0c77fe640 1 -- 172.21.15.121:0/451670586 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d8008960 con 0x55d5811dc580 2023-12-07T21:10:12.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.491+0000 7fe0c77fe640 1 -- 172.21.15.121:0/451670586 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0d8008c80 con 0x55d5811dc580 2023-12-07T21:10:12.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e4746800 1 -- 172.21.15.121:0/451670586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 msgr2=0x55d5811dc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e4746800 1 --2- 172.21.15.121:0/451670586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 0x55d5811dc9a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800a400 tx=0x7fe0d800a8c0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e4746800 1 -- 172.21.15.121:0/451670586 shutdown_connections 2023-12-07T21:10:12.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e4746800 1 --2- 172.21.15.121:0/451670586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 0x55d5811dc9a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e4746800 1 -- 172.21.15.121:0/451670586 >> 172.21.15.121:0/451670586 conn(0x55d581125550 msgr2=0x55d5811d7960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e4746800 1 -- 172.21.15.121:0/451670586 shutdown_connections 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e4746800 1 -- 172.21.15.121:0/451670586 wait complete. 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e4746800 1 Processor -- start 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e4746800 1 -- start start 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e4746800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 0x55d5811e3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e4746800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d580fca530 con 0x55d5811dc580 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.492+0000 7fe0e0d0b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 0x55d5811e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.493+0000 7fe0e0d0b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 0x55d5811e3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42620/0 (socket says 172.21.15.121:42620) 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.493+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 learned_addr learned my addr 172.21.15.121:0/272553323 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.493+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8005c90 con 0x55d5811dc580 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.493+0000 7fe0e0d0b640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 0x55d5811e3530 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800c010 tx=0x7fe0d8002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.493+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/272553323 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0d8013840 con 0x55d5811dc580 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.493+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/272553323 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d80139a0 con 0x55d5811dc580 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.493+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5811e3a70 con 0x55d5811dc580 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.493+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/272553323 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0d8013c80 con 0x55d5811dc580 2023-12-07T21:10:12.496 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.493+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5811e3f30 con 0x55d5811dc580 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.494+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/272553323 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fe0d801e420 con 0x55d5811dc580 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.494+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.494+0000 7fe0c5ffb640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe0bc0360c0 0x7fe0bc038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.494+0000 7fe0c5ffb640 1 -- 172.21.15.121:0/272553323 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fe0d804b9e0 con 0x55d5811dc580 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.494+0000 7fe0dfd09640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe0bc0360c0 0x7fe0bc038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e4746800 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d5811eecc0 0x55d5811f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f18a0 con 0x55d5811eecc0 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e0d0b640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d5811eecc0 0x55d5811f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0dfd09640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe0bc0360c0 0x7fe0bc038580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4054000 tx=0x7fe0d404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e0d0b640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d5811eecc0 0x55d5811f1150 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e4746800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e4746800 20 realm 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f1c90 con 0x55d5811eecc0 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e4746800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e4746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.495+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f24e0 con 0x55d5811eecc0 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e4746800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f2840 con 0x55d5811eecc0 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e4746800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f2180 con 0x55d5811eecc0 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e4746800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e4746800 20 searching for the correct realm 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e4746800 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d5811f4a90 0x55d5811f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f7410 con 0x55d5811f4a90 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.496+0000 7fe0e050a640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d5811f4a90 0x55d5811f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.497+0000 7fe0e050a640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d5811f4a90 0x55d5811f6e80 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.497+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d0024020 con 0x55d5811f4a90 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.497+0000 7fe0e050a640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe0d0027730 0x7fe0d0049250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.497+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f7410 con 0x7fe0d0027730 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.497+0000 7fe0dfd09640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe0d0027730 0x7fe0d0049250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.497+0000 7fe0dfd09640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe0d0027730 0x7fe0d0049250 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.497+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d4059040 con 0x7fe0d0027730 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.497+0000 7fe0dfd09640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe0d405c950 0x7fe0d4009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.498+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f7410 con 0x7fe0d405c950 2023-12-07T21:10:12.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.498+0000 7fe0e0d0b640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe0d405c950 0x7fe0d4009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.498+0000 7fe0e0d0b640 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe0d405c950 0x7fe0d4009410 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.498+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.498+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f7410 con 0x55d5811eecc0 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.499+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.499+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f7410 con 0x55d5811eecc0 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.499+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.499+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f7410 con 0x7fe0d405c950 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.499+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.499+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d405c950 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.499+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.499+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d0027730 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.500+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d4059040 con 0x7fe0d0027730 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.500+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811f4a90 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.500+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d0024020 con 0x55d5811f4a90 2023-12-07T21:10:12.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.500+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811eecc0 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.500+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.500+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d405c950 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.500+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.500+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811eecc0 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.500+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.501+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d0027730 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.501+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe0d4059040 con 0x7fe0d0027730 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.501+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811f4a90 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.501+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d0024020 con 0x55d5811f4a90 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.501+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811f4a90 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.501+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d0024020 con 0x55d5811f4a90 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.501+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d405c950 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.502+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.502+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811f4a90 2023-12-07T21:10:12.501 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.502+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d0024020 con 0x55d5811f4a90 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.502+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811f4a90 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.502+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d0024020 con 0x55d5811f4a90 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.502+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811eecc0 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.502+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.502+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811eecc0 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.502+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.502+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d405c950 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.503+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.503+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811f4a90 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.503+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe0d0024020 con 0x55d5811f4a90 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.503+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d0027730 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.503+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d4059040 con 0x7fe0d0027730 2023-12-07T21:10:12.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.503+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811eecc0 2023-12-07T21:10:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.503+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.503+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d405c950 2023-12-07T21:10:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.504+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.504+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811f4a90 2023-12-07T21:10:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.504+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d0024020 con 0x55d5811f4a90 2023-12-07T21:10:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.504+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d405c950 2023-12-07T21:10:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.504+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.504+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d0027730 2023-12-07T21:10:12.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.505+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d4059040 con 0x7fe0d0027730 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.505+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811f4a90 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.505+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d0053040 con 0x55d5811f4a90 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.505+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d405c950 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.505+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.505+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x55d5811eecc0 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.505+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.505+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fe0d803e040 con 0x7fe0d0027730 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe0d4070040 con 0x7fe0d0027730 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:12.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:12.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:12.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f36a0 con 0x55d5811eecc0 2023-12-07T21:10:12.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f32c0 con 0x55d5811eecc0 2023-12-07T21:10:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f3ef0 con 0x55d5811f4a90 2023-12-07T21:10:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe0d0053040 con 0x55d5811f4a90 2023-12-07T21:10:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 zone default found 2023-12-07T21:10:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 4 Realm: () 2023-12-07T21:10:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:12.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 zonegroup default 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.506+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f7850 con 0x7fe0d405c950 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e4746800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f96d0 con 0x55d5811f4a90 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe0d0053040 con 0x55d5811f4a90 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e4746800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f9a30 con 0x55d5811f4a90 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe0d0053040 con 0x55d5811f4a90 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e4746800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e4746800 20 started sync module instance, tier type = 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e4746800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.507+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f8ca0 con 0x7fe0d0027730 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.508+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d4070040 con 0x7fe0d0027730 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.508+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94375480303440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811f8880 con 0x7fe0d0027730 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.508+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fa230 con 0x55d5811eecc0 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.510+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94375480303440] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d4070040 con 0x7fe0d0027730 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.510+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.510+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94375482724432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fa230 con 0x55d5811eecc0 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.510+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811facc0 con 0x55d5811f4a90 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.511+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94375482724432] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.511+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d0053040 con 0x55d5811f4a90 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.511+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94375482727824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fa1a0 con 0x55d5811f4a90 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.511+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fb9f0 con 0x7fe0d0027730 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.512+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94375482727824] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d0053040 con 0x55d5811f4a90 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.512+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d4070040 con 0x7fe0d0027730 2023-12-07T21:10:12.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.512+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94375482732960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fc270 con 0x7fe0d0027730 2023-12-07T21:10:12.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.512+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fca70 con 0x55d5811eecc0 2023-12-07T21:10:12.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.513+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.514+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94375482732960] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d4070040 con 0x7fe0d0027730 2023-12-07T21:10:12.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.514+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94375482738432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fd2c0 con 0x55d5811eecc0 2023-12-07T21:10:12.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.514+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fbdd0 con 0x7fe0d405c950 2023-12-07T21:10:12.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.515+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94375482738432] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.515+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.515+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94375482740112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fd1a0 con 0x7fe0d405c950 2023-12-07T21:10:12.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.515+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fe0d0 con 0x7fe0d405c950 2023-12-07T21:10:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.516+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94375482740112] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.516+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.516+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94375482742672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fe040 con 0x7fe0d405c950 2023-12-07T21:10:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.516+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fe9b0 con 0x7fe0d405c950 2023-12-07T21:10:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.517+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v33'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.517+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94375482742672] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.517+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94375482746128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fe920 con 0x7fe0d405c950 2023-12-07T21:10:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.517+0000 7fe0e4746800 20 add_watcher() i=0 2023-12-07T21:10:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.517+0000 7fe0e4746800 20 add_watcher() i=1 2023-12-07T21:10:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.517+0000 7fe0e4746800 20 add_watcher() i=2 2023-12-07T21:10:12.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.517+0000 7fe0e4746800 20 add_watcher() i=3 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.517+0000 7fe0e4746800 20 add_watcher() i=4 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.517+0000 7fe0e4746800 20 add_watcher() i=5 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.517+0000 7fe0e4746800 20 add_watcher() i=6 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.519+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94375482746128] v33'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.519+0000 7fe0e4746800 20 add_watcher() i=7 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.519+0000 7fe0e4746800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.519+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d581201df0 con 0x55d5811eecc0 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.519+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.519+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94375482747168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811ff270 con 0x55d5811eecc0 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.521+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94375482747168] v33'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.521+0000 7fe0a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.521+0000 7fe0e4746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.521+0000 7fe0e4746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.521+0000 7fe0e4746800 5 note: GC not initialized 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.521+0000 7fe0a57e2640 20 reqs_thread_entry: start 2023-12-07T21:10:12.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.521+0000 7fe0e4746800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.522+0000 7fe0e4746800 20 Filter name: none 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.522+0000 7fe016ffd640 20 reqs_thread_entry: start 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.522+0000 7fe0e4746800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.522+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d581234880 con 0x55d5811eecc0 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.522+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.522+0000 7fe0e4746800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.522+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d581234880 con 0x7fe0d405c950 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.523+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.523+0000 7fe0a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.523+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94375482747168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d581234880 con 0x55d5811eecc0 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.524+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94375482747168] v33'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.524+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94375480303440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d581234880 con 0x7fe0d0027730 2023-12-07T21:10:12.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.525+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94375480303440] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d4070040 con 0x7fe0d0027730 2023-12-07T21:10:12.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.525+0000 7fe0e4746800 20 remove_watcher() i=0 2023-12-07T21:10:12.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.525+0000 7fe0e4746800 2 removed watcher, disabling cache 2023-12-07T21:10:12.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.525+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94375482724432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5812338a0 con 0x55d5811eecc0 2023-12-07T21:10:12.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.527+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94375482724432] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.527+0000 7fe0e4746800 20 remove_watcher() i=1 2023-12-07T21:10:12.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.527+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94375482727824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5812338a0 con 0x55d5811f4a90 2023-12-07T21:10:12.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.528+0000 7fe0e050a640 1 -- 172.21.15.121:0/272553323 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94375482727824] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d0053040 con 0x55d5811f4a90 2023-12-07T21:10:12.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.528+0000 7fe0e4746800 20 remove_watcher() i=2 2023-12-07T21:10:12.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.528+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94375482732960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d581233c00 con 0x7fe0d0027730 2023-12-07T21:10:12.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.529+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94375482732960] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d4070040 con 0x7fe0d0027730 2023-12-07T21:10:12.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.529+0000 7fe0e4746800 20 remove_watcher() i=3 2023-12-07T21:10:12.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.529+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94375482738432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d58120b040 con 0x55d5811eecc0 2023-12-07T21:10:12.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.530+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94375482738432] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x55d5811eecc0 2023-12-07T21:10:12.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.530+0000 7fe0e4746800 20 remove_watcher() i=4 2023-12-07T21:10:12.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.530+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94375482740112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d58120b040 con 0x7fe0d405c950 2023-12-07T21:10:12.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.531+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94375482740112] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.531+0000 7fe0e4746800 20 remove_watcher() i=5 2023-12-07T21:10:12.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.531+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94375482742672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fcd90 con 0x7fe0d405c950 2023-12-07T21:10:12.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.532+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94375482742672] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.532+0000 7fe0e4746800 20 remove_watcher() i=6 2023-12-07T21:10:12.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.532+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94375482746128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d5811fcd90 con 0x7fe0d405c950 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e0d0b640 1 -- 172.21.15.121:0/272553323 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94375482746128] v33'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe0d8024070 con 0x7fe0d405c950 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 20 remove_watcher() i=7 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe0d405c950 msgr2=0x7fe0d4009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fe0d405c950 0x7fe0d4009410 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d5811eecc0 msgr2=0x55d5811f1150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d5811eecc0 0x55d5811f1150 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe0d0027730 msgr2=0x7fe0d0049250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fe0d0027730 0x7fe0d0049250 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d5811f4a90 msgr2=0x55d5811f6e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55d5811f4a90 0x55d5811f6e80 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe0bc0360c0 msgr2=0x7fe0bc038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe0bc0360c0 0x7fe0bc038580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4054000 tx=0x7fe0d404e000 comp rx=0 tx=0).stop 2023-12-07T21:10:12.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 msgr2=0x55d5811e3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0e4746800 1 --2- 172.21.15.121:0/272553323 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d5811dc580 0x55d5811e3530 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800c010 tx=0x7fe0d8002ff0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.533+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 reap_dead start 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 shutdown_connections 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0dfd09640 1 -- 172.21.15.121:0/272553323 reap_dead start 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 >> 172.21.15.121:0/272553323 conn(0x55d581125550 msgr2=0x55d5811d7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 shutdown_connections 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 -- 172.21.15.121:0/272553323 wait complete. 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 -- 172.21.15.121:0/8410130 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe0cc036110 msgr2=0x7fe0cc0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 --2- 172.21.15.121:0/8410130 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe0cc036110 0x7fe0cc0385d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0006610 tx=0x7fe0d0011f50 comp rx=0 tx=0).stop 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 -- 172.21.15.121:0/8410130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 msgr2=0x55d5811c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 --2- 172.21.15.121:0/8410130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5811c7360 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0001560 tx=0x7fe0d0001250 comp rx=0 tx=0).stop 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 -- 172.21.15.121:0/8410130 shutdown_connections 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 --2- 172.21.15.121:0/8410130 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fe0cc036110 0x7fe0cc0385d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 --2- 172.21.15.121:0/8410130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d581121110 0x55d5811c7360 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 -- 172.21.15.121:0/8410130 >> 172.21.15.121:0/8410130 conn(0x55d58111c890 msgr2=0x55d5811c48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 -- 172.21.15.121:0/8410130 shutdown_connections 2023-12-07T21:10:12.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.534+0000 7fe0e4746800 1 -- 172.21.15.121:0/8410130 wait complete. 2023-12-07T21:10:12.529 INFO:teuthology.orchestra.run.smithi121.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2023-12-07T21:10:12.530 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2023-12-07T21:10:12.530 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2023-12-07T21:10:12.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2023-12-07T21:10:12.530 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2023-12-07T21:10:12.573 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:12.574 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:12.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.582+0000 7f59d7127800 1 Processor -- start 2023-12-07T21:10:12.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.582+0000 7f59d7127800 1 -- start start 2023-12-07T21:10:12.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.582+0000 7f59d7127800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b056cf68f0 0x55b056cf6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.582+0000 7f59d7127800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b056c41740 con 0x55b056cf7250 2023-12-07T21:10:12.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.582+0000 7f59d7127800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b056c0a880 con 0x55b056cf68f0 2023-12-07T21:10:12.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.582+0000 7f59d2df4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b056cf68f0 0x55b056cf6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.582+0000 7f59d25f3640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55b056cf7250 0x55b056cf3330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:35610/0 (socket says 172.21.15.121:35610) 2023-12-07T21:10:12.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.582+0000 7f59d25f3640 1 -- 172.21.15.121:0/448955364 learned_addr learned my addr 172.21.15.121:0/448955364 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:12.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.583+0000 7f59d2df4640 1 -- 172.21.15.121:0/448955364 >> v1:172.21.15.89:6789/0 conn(0x55b056cf7250 legacy=0x55b056cf3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.583+0000 7f59d1df2640 1 -- 172.21.15.121:0/448955364 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425238472 0 0) 0x55b056c41740 con 0x55b056cf7250 2023-12-07T21:10:12.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.583+0000 7f59d2df4640 1 -- 172.21.15.121:0/448955364 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b056cf3b60 con 0x55b056cf68f0 2023-12-07T21:10:12.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.585+0000 7f59d2df4640 1 --2- 172.21.15.121:0/448955364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056cf6d10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f59c4005fd0 tx=0x7f59c401cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec23d31a176517df server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.585+0000 7f59d1df2640 1 -- 172.21.15.121:0/448955364 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59c4052560 con 0x55b056cf68f0 2023-12-07T21:10:12.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.585+0000 7f59d1df2640 1 -- 172.21.15.121:0/448955364 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c40526c0 con 0x55b056cf68f0 2023-12-07T21:10:12.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.585+0000 7f59d1df2640 1 -- 172.21.15.121:0/448955364 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59c40529a0 con 0x55b056cf68f0 2023-12-07T21:10:12.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.585+0000 7f59d7127800 1 -- 172.21.15.121:0/448955364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 msgr2=0x55b056cf6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.585+0000 7f59d7127800 1 --2- 172.21.15.121:0/448955364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056cf6d10 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f59c4005fd0 tx=0x7f59c401cb90 comp rx=0 tx=0).stop 2023-12-07T21:10:12.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.585+0000 7f59d7127800 1 -- 172.21.15.121:0/448955364 shutdown_connections 2023-12-07T21:10:12.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.585+0000 7f59d7127800 1 --2- 172.21.15.121:0/448955364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056cf6d10 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.585+0000 7f59d7127800 1 -- 172.21.15.121:0/448955364 >> 172.21.15.121:0/448955364 conn(0x55b056ceef70 msgr2=0x55b056cf1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.585+0000 7f59d7127800 1 -- 172.21.15.121:0/448955364 shutdown_connections 2023-12-07T21:10:12.578 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.585+0000 7f59d7127800 1 -- 172.21.15.121:0/448955364 wait complete. 2023-12-07T21:10:12.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.586+0000 7f59d7127800 1 Processor -- start 2023-12-07T21:10:12.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.586+0000 7f59d7127800 1 -- start start 2023-12-07T21:10:12.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.586+0000 7f59d7127800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056d9a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.586+0000 7f59d7127800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b056c07db0 con 0x55b056cf68f0 2023-12-07T21:10:12.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.587+0000 7f59d2df4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056d9a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.587+0000 7f59d2df4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056d9a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42636/0 (socket says 172.21.15.121:42636) 2023-12-07T21:10:12.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.587+0000 7f59d2df4640 1 -- 172.21.15.121:0/3577622980 learned_addr learned my addr 172.21.15.121:0/3577622980 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.587+0000 7f59d2df4640 1 -- 172.21.15.121:0/3577622980 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c400a100 con 0x55b056cf68f0 2023-12-07T21:10:12.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.587+0000 7f59d2df4640 1 --2- 172.21.15.121:0/3577622980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056d9a280 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f59c400a3f0 tx=0x7f59c404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e73b1218115b912 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.587+0000 7f59d15f1640 1 -- 172.21.15.121:0/3577622980 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59c4052960 con 0x55b056cf68f0 2023-12-07T21:10:12.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.587+0000 7f59d15f1640 1 -- 172.21.15.121:0/3577622980 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c4052ac0 con 0x55b056cf68f0 2023-12-07T21:10:12.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.588+0000 7f59d15f1640 1 -- 172.21.15.121:0/3577622980 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59c4052d60 con 0x55b056cf68f0 2023-12-07T21:10:12.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.588+0000 7f59d7127800 1 -- 172.21.15.121:0/3577622980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 msgr2=0x55b056d9a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.588+0000 7f59d7127800 1 --2- 172.21.15.121:0/3577622980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056d9a280 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f59c400a3f0 tx=0x7f59c404c000 comp rx=0 tx=0).stop 2023-12-07T21:10:12.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.588+0000 7f59d7127800 1 -- 172.21.15.121:0/3577622980 shutdown_connections 2023-12-07T21:10:12.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.588+0000 7f59d7127800 1 --2- 172.21.15.121:0/3577622980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056d9a280 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.588+0000 7f59d7127800 1 -- 172.21.15.121:0/3577622980 >> 172.21.15.121:0/3577622980 conn(0x55b056ceef70 msgr2=0x55b056d95ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.588+0000 7f59d7127800 1 -- 172.21.15.121:0/3577622980 shutdown_connections 2023-12-07T21:10:12.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.588+0000 7f59d7127800 1 -- 172.21.15.121:0/3577622980 wait complete. 2023-12-07T21:10:12.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.588+0000 7f59d7127800 1 Processor -- start 2023-12-07T21:10:12.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.589+0000 7f59d7127800 1 -- start start 2023-12-07T21:10:12.589 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.589+0000 7f59d7127800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056da1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.589+0000 7f59d7127800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b056c036a0 con 0x55b056cf68f0 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.589+0000 7f59d2df4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056da1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.589+0000 7f59d2df4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056da1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42638/0 (socket says 172.21.15.121:42638) 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.589+0000 7f59d2df4640 1 -- 172.21.15.121:0/2638052569 learned_addr learned my addr 172.21.15.121:0/2638052569 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.589+0000 7f59d2df4640 1 -- 172.21.15.121:0/2638052569 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b056cf3b60 con 0x55b056cf68f0 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.589+0000 7f59d2df4640 1 --2- 172.21.15.121:0/2638052569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056da1630 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f59c40448a0 tx=0x7f59c4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.589+0000 7f59bbfff640 1 -- 172.21.15.121:0/2638052569 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59c406c070 con 0x55b056cf68f0 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.590+0000 7f59bbfff640 1 -- 172.21.15.121:0/2638052569 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c405ccc0 con 0x55b056cf68f0 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.590+0000 7f59d7127800 1 -- 172.21.15.121:0/2638052569 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b056da1b70 con 0x55b056cf68f0 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.590+0000 7f59bbfff640 1 -- 172.21.15.121:0/2638052569 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59c4070410 con 0x55b056cf68f0 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.590+0000 7f59d7127800 1 -- 172.21.15.121:0/2638052569 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b056da20b0 con 0x55b056cf68f0 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.590+0000 7f59d7127800 1 Processor -- start 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.590+0000 7f59d7127800 1 -- start start 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.590+0000 7f59d7127800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 0x55b056dafe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.590 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.590+0000 7f59d7127800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b056b9d890 con 0x55b056dafa30 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.590+0000 7f59bbfff640 1 -- 172.21.15.121:0/2638052569 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f59c40663f0 con 0x55b056cf68f0 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.590+0000 7f59d35f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 0x55b056dafe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.591+0000 7f59d35f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 0x55b056dafe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42642/0 (socket says 172.21.15.121:42642) 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.591+0000 7f59d35f5640 1 -- 172.21.15.121:0/2883420642 learned_addr learned my addr 172.21.15.121:0/2883420642 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.591+0000 7f59bbfff640 1 --2- 172.21.15.121:0/2638052569 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59c00360c0 0x7f59c0038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.591+0000 7f59bbfff640 1 -- 172.21.15.121:0/2638052569 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f59c408d720 con 0x55b056cf68f0 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.591+0000 7f59d2df4640 1 --2- 172.21.15.121:0/2638052569 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59c00360c0 0x7f59c0038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.591+0000 7f59d35f5640 1 -- 172.21.15.121:0/2883420642 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b056db0390 con 0x55b056dafa30 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.591+0000 7f59d2df4640 1 --2- 172.21.15.121:0/2638052569 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59c00360c0 0x7f59c0038580 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f59c40788e0 tx=0x7f59c4064fb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.591+0000 7f59d35f5640 1 --2- 172.21.15.121:0/2883420642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 0x55b056dafe50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00a400 tx=0x7f59cc00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a9aa8e09544dbf server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.591+0000 7f59b9ffb640 1 -- 172.21.15.121:0/2883420642 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59cc0087e0 con 0x55b056dafa30 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.591+0000 7f59b9ffb640 1 -- 172.21.15.121:0/2883420642 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc008960 con 0x55b056dafa30 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.591+0000 7f59b9ffb640 1 -- 172.21.15.121:0/2883420642 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59cc008c80 con 0x55b056dafa30 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d7127800 1 -- 172.21.15.121:0/2883420642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 msgr2=0x55b056dafe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d7127800 1 --2- 172.21.15.121:0/2883420642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 0x55b056dafe50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00a400 tx=0x7f59cc00a8c0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.591 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d7127800 1 -- 172.21.15.121:0/2883420642 shutdown_connections 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d7127800 1 --2- 172.21.15.121:0/2883420642 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 0x55b056dafe50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d7127800 1 -- 172.21.15.121:0/2883420642 >> 172.21.15.121:0/2883420642 conn(0x55b056cf7250 msgr2=0x55b056cf45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d7127800 1 -- 172.21.15.121:0/2883420642 shutdown_connections 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d7127800 1 -- 172.21.15.121:0/2883420642 wait complete. 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d7127800 1 Processor -- start 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d7127800 1 -- start start 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d7127800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 0x55b056db6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d7127800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b056b9d530 con 0x55b056dafa30 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d35f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 0x55b056db6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d35f5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 0x55b056db6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42644/0 (socket says 172.21.15.121:42644) 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 learned_addr learned my addr 172.21.15.121:0/735205084 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.592+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59cc005c90 con 0x55b056dafa30 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.593+0000 7f59d35f5640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 0x55b056db6990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00c010 tx=0x7f59cc002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.593+0000 7f59b3fff640 1 -- 172.21.15.121:0/735205084 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59cc013840 con 0x55b056dafa30 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.593+0000 7f59b3fff640 1 -- 172.21.15.121:0/735205084 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59cc0139a0 con 0x55b056dafa30 2023-12-07T21:10:12.592 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.593+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b056db6ed0 con 0x55b056dafa30 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.593+0000 7f59b3fff640 1 -- 172.21.15.121:0/735205084 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59cc013c80 con 0x55b056dafa30 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.593+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b056db7390 con 0x55b056dafa30 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.594+0000 7f59b3fff640 1 -- 172.21.15.121:0/735205084 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f59cc01e420 con 0x55b056dafa30 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.594+0000 7f59b3fff640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59ac0360c0 0x7f59ac038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.594+0000 7f59b3fff640 1 -- 172.21.15.121:0/735205084 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f59cc04b960 con 0x55b056dafa30 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.594+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.594+0000 7f59d25f3640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59ac0360c0 0x7f59ac038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.594+0000 7f59d7127800 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b056dc20e0 0x55b056dc45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.594+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dc4cf0 con 0x55b056dc20e0 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.594+0000 7f59d35f5640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b056dc20e0 0x55b056dc45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.594+0000 7f59d25f3640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59ac0360c0 0x7f59ac038580 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f59c8000c00 tx=0x7f59c8001330 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d35f5640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b056dc20e0 0x55b056dc45a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59cc024070 con 0x55b056dc20e0 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 20 realm 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.593 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dc50c0 con 0x55b056dc20e0 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59cc024070 con 0x55b056dc20e0 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dc5940 con 0x55b056dc20e0 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59cc024070 con 0x55b056dc20e0 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dc5ca0 con 0x55b056dc20e0 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f59cc024070 con 0x55b056dc20e0 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.594 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.595+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dc55e0 con 0x55b056dc20e0 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.596+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f59cc024070 con 0x55b056dc20e0 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.596+0000 7f59d7127800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.596+0000 7f59d7127800 20 searching for the correct realm 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.596+0000 7f59d7127800 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b056dc7ef0 0x55b056dca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.596+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc7ef0 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.596+0000 7f59d2df4640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b056dc7ef0 0x55b056dca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.596+0000 7f59d2df4640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b056dc7ef0 0x55b056dca2e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.596+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.596+0000 7f59d2df4640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f59c407a060 0x7f59c40666a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.596+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c407a060 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.597+0000 7f59d25f3640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f59c407a060 0x7f59c40666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.595 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.597+0000 7f59d25f3640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f59c407a060 0x7f59c40666a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.597+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.604 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.597+0000 7f59d25f3640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f59c800e8a0 0x7f59c800d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.597+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c800e8a0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.597+0000 7f59d35f5640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f59c800e8a0 0x7f59c800d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.598+0000 7f59d35f5640 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f59c800e8a0 0x7f59c800d2f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.598+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc024070 con 0x7f59c800e8a0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.598+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc20e0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.598+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc024070 con 0x55b056dc20e0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.598+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc20e0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.599+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc024070 con 0x55b056dc20e0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.599+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c800e8a0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.599+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc024070 con 0x7f59c800e8a0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.599+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c800e8a0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.599+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc024070 con 0x7f59c800e8a0 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.599+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c407a060 2023-12-07T21:10:12.605 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.599+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.599+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc7ef0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.600+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.600+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc20e0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.600+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc024070 con 0x55b056dc20e0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.600+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c800e8a0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.600+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.600+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc20e0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.600+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.600+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c407a060 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.600+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.601+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc7ef0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.601+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.601+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc7ef0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.601+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.606 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.601+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c800e8a0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.601+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.601+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc7ef0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.601+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.601+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc7ef0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.602+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.602+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc20e0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.602+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.602+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc20e0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.602+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.602+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c800e8a0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.602+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.602+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc7ef0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.603+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.603+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c407a060 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.603+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.603+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc20e0 2023-12-07T21:10:12.607 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.603+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.603+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c800e8a0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.603+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.603+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc7ef0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.604+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.604+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c800e8a0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.604+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.604+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c407a060 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.604+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.604+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc7ef0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.604+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.604+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c800e8a0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x55b056dc20e0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dca870 con 0x7f59c407a060 2023-12-07T21:10:12.608 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d7127800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d7127800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d7127800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d7127800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d7127800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d7127800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dc6b30 con 0x55b056dc20e0 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.605+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dc67b0 con 0x55b056dc20e0 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dc74c0 con 0x55b056dc7ef0 2023-12-07T21:10:12.609 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 20 zone default found 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 4 Realm: () 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 20 zonegroup default 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dcb130 con 0x7f59c800e8a0 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.606+0000 7f59d7127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.607+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.607+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dcccf0 con 0x55b056dc7ef0 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.607+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.610 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.607+0000 7f59d7127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.607+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.607+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dcd120 con 0x55b056dc7ef0 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.607+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.607+0000 7f59d7127800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.607+0000 7f59d7127800 20 started sync module instance, tier type = 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.607+0000 7f59d7127800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.607+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dcc040 con 0x7f59c407a060 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.608+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.608+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94215857491792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dcc3f0 con 0x7f59c407a060 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.608+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dcd9e0 con 0x55b056dc20e0 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.609+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94215857491792] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.609+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.609+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94215859911584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dcda20 con 0x55b056dc20e0 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.609+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dce4e0 con 0x55b056dc7ef0 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.610+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.611 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.610+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94215859920800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dced30 con 0x55b056dc7ef0 2023-12-07T21:10:12.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.610+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dcf750 con 0x7f59c407a060 2023-12-07T21:10:12.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.611+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94215859911584] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.611+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94215859920800] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.612+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.612+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94215859925552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dce9a0 con 0x7f59c407a060 2023-12-07T21:10:12.612 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.612+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd0240 con 0x55b056dc20e0 2023-12-07T21:10:12.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.613+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.613+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94215859928352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd0a90 con 0x55b056dc20e0 2023-12-07T21:10:12.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.613+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd1480 con 0x7f59c800e8a0 2023-12-07T21:10:12.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.613+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94215859925552] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.614+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.614+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94215859928352] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.614+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94215859933024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd1440 con 0x7f59c800e8a0 2023-12-07T21:10:12.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.614+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd05f0 con 0x7f59c800e8a0 2023-12-07T21:10:12.616 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.615+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94215859933024] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.615+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.615+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94215859918144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd19a0 con 0x7f59c800e8a0 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.615+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd2200 con 0x7f59c800e8a0 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.616+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v33'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.616+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94215859935648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd28a0 con 0x7f59c800e8a0 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.616+0000 7f59d7127800 20 add_watcher() i=0 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.616+0000 7f59d7127800 20 add_watcher() i=1 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.616+0000 7f59d7127800 20 add_watcher() i=2 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.616+0000 7f59d7127800 20 add_watcher() i=3 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.616+0000 7f59d7127800 20 add_watcher() i=4 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.616+0000 7f59d7127800 20 add_watcher() i=5 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.616+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94215859918144] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.616+0000 7f59d7127800 20 add_watcher() i=6 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.617+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94215859935648] v33'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.617+0000 7f59d7127800 20 add_watcher() i=7 2023-12-07T21:10:12.617 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.617+0000 7f59d7127800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.617+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd57a0 con 0x55b056dc20e0 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.617+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.617+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94215859938000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd2b80 con 0x55b056dc20e0 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.618+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94215859938000] v33'204 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.619+0000 7f5998fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.619+0000 7f59d7127800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.619+0000 7f59d7127800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.619+0000 7f59d7127800 5 note: GC not initialized 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.619+0000 7f59137fe640 20 reqs_thread_entry: start 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.619+0000 7f59d7127800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.619+0000 7f59d7127800 20 Filter name: none 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.619+0000 7f59117fa640 20 reqs_thread_entry: start 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.619+0000 7f59d7127800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.619+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056e08110 con 0x55b056dc20e0 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.620+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.620+0000 7f59d7127800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:10:12.618 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.620+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056e08110 con 0x7f59c800e8a0 2023-12-07T21:10:12.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.620+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.621+0000 7f5998fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.621+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94215859938000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056e08110 con 0x55b056dc20e0 2023-12-07T21:10:12.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.622+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94215859938000] v33'205 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.622+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94215857491792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056e08110 con 0x7f59c407a060 2023-12-07T21:10:12.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.623+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94215857491792] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.623+0000 7f59d7127800 20 remove_watcher() i=0 2023-12-07T21:10:12.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.623+0000 7f59d7127800 2 removed watcher, disabling cache 2023-12-07T21:10:12.619 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.623+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94215859911584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056e06f70 con 0x55b056dc20e0 2023-12-07T21:10:12.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.624+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94215859911584] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.624+0000 7f59d7127800 20 remove_watcher() i=1 2023-12-07T21:10:12.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.624+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94215859920800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056e06f70 con 0x55b056dc7ef0 2023-12-07T21:10:12.620 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.625+0000 7f59d2df4640 1 -- 172.21.15.121:0/735205084 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94215859920800] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59c4080030 con 0x55b056dc7ef0 2023-12-07T21:10:12.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.625+0000 7f59d7127800 20 remove_watcher() i=2 2023-12-07T21:10:12.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.625+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94215859925552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056e072d0 con 0x7f59c407a060 2023-12-07T21:10:12.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.626+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94215859925552] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59c800f670 con 0x7f59c407a060 2023-12-07T21:10:12.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.626+0000 7f59d7127800 20 remove_watcher() i=3 2023-12-07T21:10:12.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.626+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94215859928352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd2ee0 con 0x55b056dc20e0 2023-12-07T21:10:12.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.627+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94215859928352] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x55b056dc20e0 2023-12-07T21:10:12.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.627+0000 7f59d7127800 20 remove_watcher() i=4 2023-12-07T21:10:12.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.627+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94215859933024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd2ee0 con 0x7f59c800e8a0 2023-12-07T21:10:12.621 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.628+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94215859933024] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.628+0000 7f59d7127800 20 remove_watcher() i=5 2023-12-07T21:10:12.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.628+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94215859918144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dd0f60 con 0x7f59c800e8a0 2023-12-07T21:10:12.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.630+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94215859918144] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.630+0000 7f59d7127800 20 remove_watcher() i=6 2023-12-07T21:10:12.622 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.630+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94215859935648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b056dcd540 con 0x7f59c800e8a0 2023-12-07T21:10:12.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d35f5640 1 -- 172.21.15.121:0/735205084 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94215859935648] v33'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f59cc03b040 con 0x7f59c800e8a0 2023-12-07T21:10:12.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 20 remove_watcher() i=7 2023-12-07T21:10:12.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f59c800e8a0 msgr2=0x7f59c800d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.624 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f59c800e8a0 0x7f59c800d2f0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b056dc20e0 msgr2=0x55b056dc45a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b056dc20e0 0x55b056dc45a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f59c407a060 msgr2=0x7f59c40666a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f59c407a060 0x7f59c40666a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b056dc7ef0 msgr2=0x55b056dca2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b056dc7ef0 0x55b056dca2e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59ac0360c0 msgr2=0x7f59ac038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59ac0360c0 0x7f59ac038580 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f59c8000c00 tx=0x7f59c8001330 comp rx=0 tx=0).stop 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 msgr2=0x55b056db6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 --2- 172.21.15.121:0/735205084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056dafa30 0x55b056db6990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00c010 tx=0x7f59cc002ff0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 reap_dead start 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d25f3640 1 -- 172.21.15.121:0/735205084 reap_dead start 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 shutdown_connections 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 >> 172.21.15.121:0/735205084 conn(0x55b056cf7250 msgr2=0x55b056da7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 shutdown_connections 2023-12-07T21:10:12.625 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/735205084 wait complete. 2023-12-07T21:10:12.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/2638052569 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59c00360c0 msgr2=0x7f59c0038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 --2- 172.21.15.121:0/2638052569 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59c00360c0 0x7f59c0038580 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f59c40788e0 tx=0x7f59c4064fb0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/2638052569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 msgr2=0x55b056da1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 --2- 172.21.15.121:0/2638052569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056da1630 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f59c40448a0 tx=0x7f59c4003330 comp rx=0 tx=0).stop 2023-12-07T21:10:12.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/2638052569 shutdown_connections 2023-12-07T21:10:12.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 --2- 172.21.15.121:0/2638052569 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f59c00360c0 0x7f59c0038580 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 --2- 172.21.15.121:0/2638052569 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b056cf68f0 0x55b056da1630 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.631+0000 7f59d7127800 1 -- 172.21.15.121:0/2638052569 >> 172.21.15.121:0/2638052569 conn(0x55b056ceef70 msgr2=0x55b056d98f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.632+0000 7f59d7127800 1 -- 172.21.15.121:0/2638052569 shutdown_connections 2023-12-07T21:10:12.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.632+0000 7f59d7127800 1 -- 172.21.15.121:0/2638052569 wait complete. 2023-12-07T21:10:12.627 INFO:teuthology.orchestra.run.smithi121.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2023-12-07T21:10:12.627 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2023-12-07T21:10:12.627 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2023-12-07T21:10:12.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2023-12-07T21:10:12.628 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2023-12-07T21:10:12.711 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:12.711 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:12.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.720+0000 7fa3b5816800 1 Processor -- start 2023-12-07T21:10:12.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.720+0000 7fa3b5816800 1 -- start start 2023-12-07T21:10:12.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.720+0000 7fa3b5816800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558c05ba9a10 0x558c05babe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.720+0000 7fa3b5816800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558c05aef740 con 0x558c05ba37c0 2023-12-07T21:10:12.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.720+0000 7fa3b5816800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x558c05ab8880 con 0x558c05ba9a10 2023-12-07T21:10:12.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.720+0000 7fa3abfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x558c05ba9a10 0x558c05babe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.720+0000 7fa3b0e93640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x558c05ba37c0 0x558c05ba3be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:35620/0 (socket says 172.21.15.121:35620) 2023-12-07T21:10:12.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.720+0000 7fa3b0e93640 1 -- 172.21.15.121:0/93292461 learned_addr learned my addr 172.21.15.121:0/93292461 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:12.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.720+0000 7fa3abfff640 1 -- 172.21.15.121:0/93292461 >> v1:172.21.15.89:6789/0 conn(0x558c05ba37c0 legacy=0x558c05ba3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.721+0000 7fa3ab7fe640 1 -- 172.21.15.121:0/93292461 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682759626 0 0) 0x558c05aef740 con 0x558c05ba37c0 2023-12-07T21:10:12.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.721+0000 7fa3abfff640 1 -- 172.21.15.121:0/93292461 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c05bad350 con 0x558c05ba9a10 2023-12-07T21:10:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.722+0000 7fa3abfff640 1 --2- 172.21.15.121:0/93292461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba9a10 0x558c05babe00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00a470 tx=0x7fa39c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f46861d410bbf0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.723+0000 7fa3ab7fe640 1 -- 172.21.15.121:0/93292461 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa39c052570 con 0x558c05ba9a10 2023-12-07T21:10:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.723+0000 7fa3ab7fe640 1 -- 172.21.15.121:0/93292461 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c0526d0 con 0x558c05ba9a10 2023-12-07T21:10:12.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.723+0000 7fa3ab7fe640 1 -- 172.21.15.121:0/93292461 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa39c052990 con 0x558c05ba9a10 2023-12-07T21:10:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.723+0000 7fa3b5816800 1 -- 172.21.15.121:0/93292461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba9a10 msgr2=0x558c05babe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.723+0000 7fa3b5816800 1 --2- 172.21.15.121:0/93292461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba9a10 0x558c05babe00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00a470 tx=0x7fa39c01cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.723+0000 7fa3b5816800 1 -- 172.21.15.121:0/93292461 shutdown_connections 2023-12-07T21:10:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.723+0000 7fa3b5816800 1 --2- 172.21.15.121:0/93292461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba9a10 0x558c05babe00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.723+0000 7fa3b5816800 1 -- 172.21.15.121:0/93292461 >> 172.21.15.121:0/93292461 conn(0x558c05b9cf70 msgr2=0x558c05b9f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.723+0000 7fa3b5816800 1 -- 172.21.15.121:0/93292461 shutdown_connections 2023-12-07T21:10:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.723+0000 7fa3b5816800 1 -- 172.21.15.121:0/93292461 wait complete. 2023-12-07T21:10:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.724+0000 7fa3b5816800 1 Processor -- start 2023-12-07T21:10:12.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.724+0000 7fa3b5816800 1 -- start start 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.724+0000 7fa3b5816800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c49f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.724+0000 7fa3b5816800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c05ab5db0 con 0x558c05ba37c0 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.724+0000 7fa3b0e93640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c49f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.724+0000 7fa3b0e93640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c49f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42666/0 (socket says 172.21.15.121:42666) 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.724+0000 7fa3b0e93640 1 -- 172.21.15.121:0/3309405302 learned_addr learned my addr 172.21.15.121:0/3309405302 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.724+0000 7fa3b0e93640 1 -- 172.21.15.121:0/3309405302 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c005d20 con 0x558c05ba37c0 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.725+0000 7fa3b0e93640 1 --2- 172.21.15.121:0/3309405302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c49f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400b240 tx=0x7fa3a400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e65c7cffee200e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.725+0000 7fa3aaffd640 1 -- 172.21.15.121:0/3309405302 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3a4014070 con 0x558c05ba37c0 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.725+0000 7fa3aaffd640 1 -- 172.21.15.121:0/3309405302 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a400d500 con 0x558c05ba37c0 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.725+0000 7fa3aaffd640 1 -- 172.21.15.121:0/3309405302 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3a400d820 con 0x558c05ba37c0 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.725+0000 7fa3b5816800 1 -- 172.21.15.121:0/3309405302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 msgr2=0x558c05c49f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.725+0000 7fa3b5816800 1 --2- 172.21.15.121:0/3309405302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c49f20 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400b240 tx=0x7fa3a400b700 comp rx=0 tx=0).stop 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.725+0000 7fa3b5816800 1 -- 172.21.15.121:0/3309405302 shutdown_connections 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.725+0000 7fa3b5816800 1 --2- 172.21.15.121:0/3309405302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c49f20 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.725+0000 7fa3b5816800 1 -- 172.21.15.121:0/3309405302 >> 172.21.15.121:0/3309405302 conn(0x558c05b9cf70 msgr2=0x558c05c45b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.725+0000 7fa3b5816800 1 -- 172.21.15.121:0/3309405302 shutdown_connections 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.725+0000 7fa3b5816800 1 -- 172.21.15.121:0/3309405302 wait complete. 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.726+0000 7fa3b5816800 1 Processor -- start 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.726+0000 7fa3b5816800 1 -- start start 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.726+0000 7fa3b5816800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.726+0000 7fa3b5816800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c05ab16a0 con 0x558c05ba37c0 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.726+0000 7fa3b0e93640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.726+0000 7fa3b0e93640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42682/0 (socket says 172.21.15.121:42682) 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.726+0000 7fa3b0e93640 1 -- 172.21.15.121:0/3790274838 learned_addr learned my addr 172.21.15.121:0/3790274838 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.726+0000 7fa3b0e93640 1 -- 172.21.15.121:0/3790274838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4001ba0 con 0x558c05ba37c0 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.726+0000 7fa3b0e93640 1 --2- 172.21.15.121:0/3790274838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c513c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x558c05c46610 tx=0x7fa3a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.727+0000 7fa3a9ffb640 1 -- 172.21.15.121:0/3790274838 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3a400de10 con 0x558c05ba37c0 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.727+0000 7fa3a9ffb640 1 -- 172.21.15.121:0/3790274838 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4020070 con 0x558c05ba37c0 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.727+0000 7fa3b5816800 1 -- 172.21.15.121:0/3790274838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558c05c51900 con 0x558c05ba37c0 2023-12-07T21:10:12.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.727+0000 7fa3a9ffb640 1 -- 172.21.15.121:0/3790274838 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3a400fc10 con 0x558c05ba37c0 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.727+0000 7fa3b5816800 1 -- 172.21.15.121:0/3790274838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c05c51de0 con 0x558c05ba37c0 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.727+0000 7fa3b5816800 1 Processor -- start 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.727+0000 7fa3b5816800 1 -- start start 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3b5816800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 0x558c05c5da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3b5816800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c05a4b890 con 0x558c05c5d610 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3a9ffb640 1 -- 172.21.15.121:0/3790274838 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa3a400d040 con 0x558c05ba37c0 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3a9ffb640 1 --2- 172.21.15.121:0/3790274838 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa3940360c0 0x7fa394038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3a9ffb640 1 -- 172.21.15.121:0/3790274838 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fa3a400a040 con 0x558c05ba37c0 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3b1694640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 0x558c05c5da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3b1694640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 0x558c05c5da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42692/0 (socket says 172.21.15.121:42692) 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3b1694640 1 -- 172.21.15.121:0/1036394238 learned_addr learned my addr 172.21.15.121:0/1036394238 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3b0e93640 1 --2- 172.21.15.121:0/3790274838 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa3940360c0 0x7fa394038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3b1694640 1 -- 172.21.15.121:0/1036394238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c05c5df70 con 0x558c05c5d610 2023-12-07T21:10:12.743 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3b0e93640 1 --2- 172.21.15.121:0/3790274838 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa3940360c0 0x7fa394038580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4001600 tx=0x7fa3a40013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3b1694640 1 --2- 172.21.15.121:0/1036394238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 0x558c05c5da30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00a430 tx=0x7fa3ac00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf1d6e534e0a1b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3937fe640 1 -- 172.21.15.121:0/1036394238 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac001650 con 0x558c05c5d610 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3937fe640 1 -- 172.21.15.121:0/1036394238 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac0017d0 con 0x558c05c5d610 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.728+0000 7fa3937fe640 1 -- 172.21.15.121:0/1036394238 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac001ab0 con 0x558c05c5d610 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.729+0000 7fa3b5816800 1 -- 172.21.15.121:0/1036394238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 msgr2=0x558c05c5da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.729+0000 7fa3b5816800 1 --2- 172.21.15.121:0/1036394238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 0x558c05c5da30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00a430 tx=0x7fa3ac00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.729+0000 7fa3b5816800 1 -- 172.21.15.121:0/1036394238 shutdown_connections 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.729+0000 7fa3b5816800 1 --2- 172.21.15.121:0/1036394238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 0x558c05c5da30 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.729+0000 7fa3b5816800 1 -- 172.21.15.121:0/1036394238 >> 172.21.15.121:0/1036394238 conn(0x558c05ba9a10 msgr2=0x558c05c589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.729+0000 7fa3b5816800 1 -- 172.21.15.121:0/1036394238 shutdown_connections 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.729+0000 7fa3b5816800 1 -- 172.21.15.121:0/1036394238 wait complete. 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.729+0000 7fa3b5816800 1 Processor -- start 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.729+0000 7fa3b5816800 1 -- start start 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.729+0000 7fa3b5816800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 0x558c05c645e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.729+0000 7fa3b5816800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c05a4b530 con 0x558c05c5d610 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.730+0000 7fa3b1694640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 0x558c05c645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.744 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.730+0000 7fa3b1694640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 0x558c05c645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42704/0 (socket says 172.21.15.121:42704) 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.730+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 learned_addr learned my addr 172.21.15.121:0/1221945528 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.730+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac00a0e0 con 0x558c05c5d610 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.730+0000 7fa3b1694640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 0x558c05c645e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00ae40 tx=0x7fa3ac003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.730+0000 7fa391ffb640 1 -- 172.21.15.121:0/1221945528 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac0109e0 con 0x558c05c5d610 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.730+0000 7fa391ffb640 1 -- 172.21.15.121:0/1221945528 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac010b40 con 0x558c05c5d610 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.730+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558c05c64b20 con 0x558c05c5d610 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.730+0000 7fa391ffb640 1 -- 172.21.15.121:0/1221945528 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3ac010e20 con 0x558c05c5d610 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.730+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c05c64f80 con 0x558c05c5d610 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.731+0000 7fa391ffb640 1 -- 172.21.15.121:0/1221945528 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa3ac017070 con 0x558c05c5d610 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.731+0000 7fa391ffb640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa38c0360c0 0x7fa38c038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.731+0000 7fa391ffb640 1 -- 172.21.15.121:0/1221945528 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fa3ac04ba40 con 0x558c05c5d610 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.731+0000 7fa3abfff640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa38c0360c0 0x7fa38c038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.731+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.731+0000 7fa3b5816800 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558c05c6fcd0 0x558c05c72190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.731+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c728e0 con 0x558c05c6fcd0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b1694640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558c05c6fcd0 0x558c05c72190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3abfff640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa38c0360c0 0x7fa38c038580 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00a470 tx=0x7fa39c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b1694640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558c05c6fcd0 0x558c05c72190 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b5816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b5816800 20 realm 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c72cd0 con 0x558c05c6fcd0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b5816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b5816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.732+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c73550 con 0x558c05c6fcd0 2023-12-07T21:10:12.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b5816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c738b0 con 0x558c05c6fcd0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b5816800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c731b0 con 0x558c05c6fcd0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b5816800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b5816800 20 searching for the correct realm 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b5816800 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558c05c75ac0 0x558c05c77eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c75ac0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.733+0000 7fa3b0e93640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558c05c75ac0 0x558c05c77eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.734+0000 7fa3b0e93640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558c05c75ac0 0x558c05c77eb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.734+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3a4016070 con 0x558c05c75ac0 2023-12-07T21:10:12.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.734+0000 7fa3b0e93640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa3a403d040 0x7fa3a400ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.734+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x7fa3a403d040 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.734+0000 7fa3abfff640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa3a403d040 0x7fa3a400ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.734+0000 7fa3abfff640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa3a403d040 0x7fa3a400ea60 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.734+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.734+0000 7fa3abfff640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa39c05c3e0 0x7fa39c05c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.735+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x7fa39c05c3e0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.735+0000 7fa3b1694640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa39c05c3e0 0x7fa39c05c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.735+0000 7fa3b1694640 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa39c05c3e0 0x7fa39c05c860 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.735+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.735+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c6fcd0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.736+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.736+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c6fcd0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.736+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.736+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x7fa39c05c3e0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.736+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.736+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x7fa39c05c3e0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.736+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.736+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x7fa3a403d040 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.737+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.737+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c75ac0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.737+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3a4016070 con 0x558c05c75ac0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.737+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c6fcd0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.737+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.737+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x7fa39c05c3e0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.737+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.737+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c6fcd0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.737+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.737+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x7fa3a403d040 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.738+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.738+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c75ac0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.738+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3a4016070 con 0x558c05c75ac0 2023-12-07T21:10:12.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.738+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c75ac0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.738+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3a4016070 con 0x558c05c75ac0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.738+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x7fa39c05c3e0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.739+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.739+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c75ac0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.739+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3a4016070 con 0x558c05c75ac0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.739+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c75ac0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.739+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3a4016070 con 0x558c05c75ac0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.739+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c6fcd0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.739+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.739+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x558c05c6fcd0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.740+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.740+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78440 con 0x7fa39c05c3e0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.740+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.740+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa3ac053040 con 0x558c05c75ac0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.740+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa3a4016070 con 0x558c05c75ac0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.740+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa3ac053040 con 0x7fa3a403d040 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.740+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.740+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa3ac053040 con 0x558c05c6fcd0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.741+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.741+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa3ac053040 con 0x7fa39c05c3e0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.741+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.741+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa3ac053040 con 0x558c05c75ac0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.741+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3a4016070 con 0x558c05c75ac0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.741+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa3ac053040 con 0x7fa39c05c3e0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.741+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.741+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa3ac053040 con 0x7fa3a403d040 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.742+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.742+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa3ac053040 con 0x558c05c75ac0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.742+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3a4016070 con 0x558c05c75ac0 2023-12-07T21:10:12.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.742+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa3ac053040 con 0x7fa39c05c3e0 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.742+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.742+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa3ac053040 con 0x558c05c6fcd0 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa3ac053040 con 0x7fa3a403d040 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c74710 con 0x558c05c6fcd0 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c74330 con 0x558c05c6fcd0 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.743+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c74f60 con 0x558c05c75ac0 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa3a4016070 con 0x558c05c75ac0 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 20 zone default found 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 4 Realm: () 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 20 zonegroup default 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c78860 con 0x7fa39c05c3e0 2023-12-07T21:10:12.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7a6e0 con 0x558c05c75ac0 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa3a4057040 con 0x558c05c75ac0 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.744+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7aa40 con 0x558c05c75ac0 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.745+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa3a4057040 con 0x558c05c75ac0 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.745+0000 7fa3b5816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.745+0000 7fa3b5816800 20 started sync module instance, tier type = 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.745+0000 7fa3b5816800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.745+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c79cb0 con 0x7fa3a403d040 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.746+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.746+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94059878330192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c79850 con 0x7fa3a403d040 2023-12-07T21:10:12.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.746+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7b240 con 0x558c05c6fcd0 2023-12-07T21:10:12.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.747+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94059878330192] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.747+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.747+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94059880751200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7b240 con 0x558c05c6fcd0 2023-12-07T21:10:12.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.747+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7bcb0 con 0x558c05c75ac0 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.748+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3a4057040 con 0x558c05c75ac0 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.748+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94059880757136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7c500 con 0x558c05c75ac0 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.748+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7cf00 con 0x7fa3a403d040 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.749+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94059880751200] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.749+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94059880757136] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3a4057040 con 0x558c05c75ac0 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.749+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.749+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94059880761856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7c170 con 0x7fa3a403d040 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.749+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7d990 con 0x558c05c6fcd0 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.750+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94059880761856] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.751+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.751+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94059880764496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7dd40 con 0x558c05c6fcd0 2023-12-07T21:10:12.763 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.751+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7e6b0 con 0x7fa39c05c3e0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.752+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.752+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94059880768016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7e620 con 0x7fa39c05c3e0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.752+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7f570 con 0x7fa39c05c3e0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.752+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94059880764496] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.753+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94059880768016] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.753+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.753+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94059880770144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7ada0 con 0x7fa39c05c3e0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.753+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7f9d0 con 0x7fa39c05c3e0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.754+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94059880770144] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.754+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.754+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94059880771696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7f9d0 con 0x7fa39c05c3e0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.754+0000 7fa3b5816800 20 add_watcher() i=0 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.754+0000 7fa3b5816800 20 add_watcher() i=1 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.754+0000 7fa3b5816800 20 add_watcher() i=2 2023-12-07T21:10:12.764 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.754+0000 7fa3b5816800 20 add_watcher() i=3 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.754+0000 7fa3b5816800 20 add_watcher() i=4 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.754+0000 7fa3b5816800 20 add_watcher() i=5 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.754+0000 7fa3b5816800 20 add_watcher() i=6 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.755+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94059880771696] v33'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.755+0000 7fa3b5816800 20 add_watcher() i=7 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.755+0000 7fa3b5816800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.755+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c82d90 con 0x558c05c6fcd0 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.755+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.755+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94059880773376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c802d0 con 0x558c05c6fcd0 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.756+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94059880773376] v33'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.756+0000 7fa3767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.756+0000 7fa3b5816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.756+0000 7fa3b5816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.756+0000 7fa3b5816800 5 note: GC not initialized 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.757+0000 7fa3757e2640 20 reqs_thread_entry: start 2023-12-07T21:10:12.765 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.757+0000 7fa3b5816800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.757+0000 7fa3b5816800 20 Filter name: none 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.757+0000 7fa2e6ffd640 20 reqs_thread_entry: start 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.757+0000 7fa3b5816800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.757+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05cb5920 con 0x558c05c6fcd0 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.757+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.757+0000 7fa3b5816800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.757+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05cb5920 con 0x7fa39c05c3e0 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.758+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.758+0000 7fa3767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.758+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94059880773376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05cb5920 con 0x558c05c6fcd0 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.759+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94059880773376] v33'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.759+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94059878330192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05cb5920 con 0x7fa3a403d040 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.760+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94059878330192] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.760+0000 7fa3b5816800 20 remove_watcher() i=0 2023-12-07T21:10:12.766 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.760+0000 7fa3b5816800 2 removed watcher, disabling cache 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.760+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94059880751200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05cb49d0 con 0x558c05c6fcd0 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.762+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94059880751200] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.762+0000 7fa3b5816800 20 remove_watcher() i=1 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.762+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94059880757136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05cb49d0 con 0x558c05c75ac0 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.763+0000 7fa3b0e93640 1 -- 172.21.15.121:0/1221945528 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94059880757136] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3a4057040 con 0x558c05c75ac0 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.763+0000 7fa3b5816800 20 remove_watcher() i=2 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.763+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94059880761856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05cb4d30 con 0x7fa3a403d040 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.764+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94059880761856] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa39c052ba0 con 0x7fa3a403d040 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.764+0000 7fa3b5816800 20 remove_watcher() i=3 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.764+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94059880764496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c8c0d0 con 0x558c05c6fcd0 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.765+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94059880764496] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x558c05c6fcd0 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.765+0000 7fa3b5816800 20 remove_watcher() i=4 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.765+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94059880768016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c8c0d0 con 0x7fa39c05c3e0 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.766+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94059880768016] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.766+0000 7fa3b5816800 20 remove_watcher() i=5 2023-12-07T21:10:12.767 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.766+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94059880770144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7e210 con 0x7fa39c05c3e0 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.767+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94059880770144] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.767+0000 7fa3b5816800 20 remove_watcher() i=6 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.767+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94059880771696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x558c05c7ea40 con 0x7fa39c05c3e0 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.768+0000 7fa3b1694640 1 -- 172.21.15.121:0/1221945528 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94059880771696] v33'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa3ac00fc50 con 0x7fa39c05c3e0 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.768+0000 7fa3b5816800 20 remove_watcher() i=7 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa39c05c3e0 msgr2=0x7fa39c05c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa39c05c3e0 0x7fa39c05c860 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558c05c6fcd0 msgr2=0x558c05c72190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x558c05c6fcd0 0x558c05c72190 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa3a403d040 msgr2=0x7fa3a400ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa3a403d040 0x7fa3a400ea60 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558c05c75ac0 msgr2=0x558c05c77eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x558c05c75ac0 0x558c05c77eb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.768 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa38c0360c0 msgr2=0x7fa38c038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa38c0360c0 0x7fa38c038580 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00a470 tx=0x7fa39c04e000 comp rx=0 tx=0).stop 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 msgr2=0x558c05c645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 --2- 172.21.15.121:0/1221945528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05c5d610 0x558c05c645e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00ae40 tx=0x7fa3ac003370 comp rx=0 tx=0).stop 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 reap_dead start 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 shutdown_connections 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3abfff640 1 -- 172.21.15.121:0/1221945528 reap_dead start 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 >> 172.21.15.121:0/1221945528 conn(0x558c05ba9a10 msgr2=0x558c05c577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 shutdown_connections 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/1221945528 wait complete. 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/3790274838 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa3940360c0 msgr2=0x7fa394038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 --2- 172.21.15.121:0/3790274838 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa3940360c0 0x7fa394038580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4001600 tx=0x7fa3a40013e0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/3790274838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 msgr2=0x558c05c513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 --2- 172.21.15.121:0/3790274838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c513c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x558c05c46610 tx=0x7fa3a4000ed0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.769 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/3790274838 shutdown_connections 2023-12-07T21:10:12.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 --2- 172.21.15.121:0/3790274838 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa3940360c0 0x7fa394038580 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 --2- 172.21.15.121:0/3790274838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x558c05ba37c0 0x558c05c513c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/3790274838 >> 172.21.15.121:0/3790274838 conn(0x558c05b9cf70 msgr2=0x558c05c48c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/3790274838 shutdown_connections 2023-12-07T21:10:12.770 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.769+0000 7fa3b5816800 1 -- 172.21.15.121:0/3790274838 wait complete. 2023-12-07T21:10:12.771 INFO:teuthology.orchestra.run.smithi121.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2023-12-07T21:10:12.771 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2023-12-07T21:10:12.771 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2023-12-07T21:10:12.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2023-12-07T21:10:12.771 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2023-12-07T21:10:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:12.816 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.824+0000 7faf3c812800 1 Processor -- start 2023-12-07T21:10:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.824+0000 7faf3c812800 1 -- start start 2023-12-07T21:10:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.824+0000 7faf3c812800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f08b583b60 0x55f08b611e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.824+0000 7faf3c812800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f08b55b740 con 0x55f08b612350 2023-12-07T21:10:12.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.824+0000 7faf3c812800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f08b524880 con 0x55f08b583b60 2023-12-07T21:10:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.825+0000 7faf37e50640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f08b583b60 0x55f08b611e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.825+0000 7faf2f64f640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55f08b612350 0x55f08b6147a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:35636/0 (socket says 172.21.15.121:35636) 2023-12-07T21:10:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.825+0000 7faf2f64f640 1 -- 172.21.15.121:0/1058784869 learned_addr learned my addr 172.21.15.121:0/1058784869 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.825+0000 7faf37e50640 1 -- 172.21.15.121:0/1058784869 >> v1:172.21.15.89:6789/0 conn(0x55f08b612350 legacy=0x55f08b6147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.825+0000 7faf37e50640 1 -- 172.21.15.121:0/1058784869 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f08b617060 con 0x55f08b583b60 2023-12-07T21:10:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.827+0000 7faf37e50640 1 --2- 172.21.15.121:0/1058784869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b611e10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7faf2800a470 tx=0x7faf2801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d474ab6e9d7683db server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.827+0000 7faf3764f640 1 -- 172.21.15.121:0/1058784869 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf28052570 con 0x55f08b583b60 2023-12-07T21:10:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.827+0000 7faf3764f640 1 -- 172.21.15.121:0/1058784869 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf280526d0 con 0x55f08b583b60 2023-12-07T21:10:12.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.827+0000 7faf3764f640 1 -- 172.21.15.121:0/1058784869 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf28052990 con 0x55f08b583b60 2023-12-07T21:10:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.827+0000 7faf3c812800 1 -- 172.21.15.121:0/1058784869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 msgr2=0x55f08b611e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.827+0000 7faf3c812800 1 --2- 172.21.15.121:0/1058784869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b611e10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7faf2800a470 tx=0x7faf2801cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.827+0000 7faf3c812800 1 -- 172.21.15.121:0/1058784869 shutdown_connections 2023-12-07T21:10:12.821 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.827+0000 7faf3c812800 1 --2- 172.21.15.121:0/1058784869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b611e10 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.827+0000 7faf3c812800 1 -- 172.21.15.121:0/1058784869 >> 172.21.15.121:0/1058784869 conn(0x55f08b609890 msgr2=0x55f08b60bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.827+0000 7faf3c812800 1 -- 172.21.15.121:0/1058784869 shutdown_connections 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.827+0000 7faf3c812800 1 -- 172.21.15.121:0/1058784869 wait complete. 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.828+0000 7faf3c812800 1 Processor -- start 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.828+0000 7faf3c812800 1 -- start start 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.828+0000 7faf3c812800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b60f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.828+0000 7faf3c812800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08b521db0 con 0x55f08b583b60 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.829+0000 7faf37e50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b60f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.829+0000 7faf37e50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b60f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42722/0 (socket says 172.21.15.121:42722) 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.829+0000 7faf37e50640 1 -- 172.21.15.121:0/1641348618 learned_addr learned my addr 172.21.15.121:0/1641348618 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.829+0000 7faf37e50640 1 -- 172.21.15.121:0/1641348618 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf28005d20 con 0x55f08b583b60 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.829+0000 7faf37e50640 1 --2- 172.21.15.121:0/1641348618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b60f530 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7faf28055040 tx=0x7faf2804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615538993e9a534f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.829+0000 7faf36e4e640 1 -- 172.21.15.121:0/1641348618 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf2800a180 con 0x55f08b583b60 2023-12-07T21:10:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.829+0000 7faf36e4e640 1 -- 172.21.15.121:0/1641348618 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2800a2e0 con 0x55f08b583b60 2023-12-07T21:10:12.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.829+0000 7faf36e4e640 1 -- 172.21.15.121:0/1641348618 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf280529b0 con 0x55f08b583b60 2023-12-07T21:10:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf3c812800 1 -- 172.21.15.121:0/1641348618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 msgr2=0x55f08b60f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf3c812800 1 --2- 172.21.15.121:0/1641348618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b60f530 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7faf28055040 tx=0x7faf2804c000 comp rx=0 tx=0).stop 2023-12-07T21:10:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf3c812800 1 -- 172.21.15.121:0/1641348618 shutdown_connections 2023-12-07T21:10:12.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf3c812800 1 --2- 172.21.15.121:0/1641348618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b60f530 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf3c812800 1 -- 172.21.15.121:0/1641348618 >> 172.21.15.121:0/1641348618 conn(0x55f08b609890 msgr2=0x55f08b6afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf3c812800 1 -- 172.21.15.121:0/1641348618 shutdown_connections 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf3c812800 1 -- 172.21.15.121:0/1641348618 wait complete. 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf3c812800 1 Processor -- start 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf3c812800 1 -- start start 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf3c812800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b6bd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf3c812800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08b51d6a0 con 0x55f08b583b60 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf37e50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b6bd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf37e50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b6bd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42724/0 (socket says 172.21.15.121:42724) 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.830+0000 7faf37e50640 1 -- 172.21.15.121:0/8982249 learned_addr learned my addr 172.21.15.121:0/8982249 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.831+0000 7faf37e50640 1 -- 172.21.15.121:0/8982249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f08b617060 con 0x55f08b583b60 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.831+0000 7faf37e50640 1 --2- 172.21.15.121:0/8982249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b6bd480 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7faf2805e040 tx=0x7faf28002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.831+0000 7faf35e4c640 1 -- 172.21.15.121:0/8982249 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf2806a070 con 0x55f08b583b60 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.831+0000 7faf35e4c640 1 -- 172.21.15.121:0/8982249 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2805c410 con 0x55f08b583b60 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.831+0000 7faf3c812800 1 -- 172.21.15.121:0/8982249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f08b6bd9c0 con 0x55f08b583b60 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.831+0000 7faf35e4c640 1 -- 172.21.15.121:0/8982249 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf2805c6b0 con 0x55f08b583b60 2023-12-07T21:10:12.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.831+0000 7faf3c812800 1 -- 172.21.15.121:0/8982249 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f08b6bdf00 con 0x55f08b583b60 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf3c812800 1 Processor -- start 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf35e4c640 1 -- 172.21.15.121:0/8982249 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7faf28059030 con 0x55f08b583b60 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf3c812800 1 -- start start 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf35e4c640 1 --2- 172.21.15.121:0/8982249 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faf18036110 0x7faf180385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf3c812800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 0x55f08b6c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf3c812800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08b4b7890 con 0x55f08b6c96e0 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf35e4c640 1 -- 172.21.15.121:0/8982249 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7faf2808cd10 con 0x55f08b583b60 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf38651640 1 --2- 172.21.15.121:0/8982249 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faf18036110 0x7faf180385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf37e50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 0x55f08b6c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf37e50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 0x55f08b6c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42732/0 (socket says 172.21.15.121:42732) 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf37e50640 1 -- 172.21.15.121:0/1274805979 learned_addr learned my addr 172.21.15.121:0/1274805979 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.832+0000 7faf37e50640 1 -- 172.21.15.121:0/1274805979 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f08b6ca040 con 0x55f08b6c96e0 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf38651640 1 --2- 172.21.15.121:0/8982249 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faf18036110 0x7faf180385d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55f08b6b09a0 tx=0x7faf30005840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf37e50640 1 --2- 172.21.15.121:0/1274805979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 0x55f08b6c9b00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7faf28056fd0 tx=0x7faf2806d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a66bead554653cc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf2ee4e640 1 -- 172.21.15.121:0/1274805979 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf280716e0 con 0x55f08b6c96e0 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf2ee4e640 1 -- 172.21.15.121:0/1274805979 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf28071840 con 0x55f08b6c96e0 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf2ee4e640 1 -- 172.21.15.121:0/1274805979 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf28071250 con 0x55f08b6c96e0 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf3c812800 1 -- 172.21.15.121:0/1274805979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 msgr2=0x55f08b6c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf3c812800 1 --2- 172.21.15.121:0/1274805979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 0x55f08b6c9b00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7faf28056fd0 tx=0x7faf2806d370 comp rx=0 tx=0).stop 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf3c812800 1 -- 172.21.15.121:0/1274805979 shutdown_connections 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf3c812800 1 --2- 172.21.15.121:0/1274805979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 0x55f08b6c9b00 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf3c812800 1 -- 172.21.15.121:0/1274805979 >> 172.21.15.121:0/1274805979 conn(0x55f08b612350 msgr2=0x55f08b6c4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf3c812800 1 -- 172.21.15.121:0/1274805979 shutdown_connections 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.833+0000 7faf3c812800 1 -- 172.21.15.121:0/1274805979 wait complete. 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf3c812800 1 Processor -- start 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf3c812800 1 -- start start 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf3c812800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 0x55f08b6d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf3c812800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08b4b7530 con 0x55f08b6c96e0 2023-12-07T21:10:12.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf37e50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 0x55f08b6d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf37e50640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 0x55f08b6d0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42734/0 (socket says 172.21.15.121:42734) 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 learned_addr learned my addr 172.21.15.121:0/1595246301 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f08b6bdf00 con 0x55f08b6c96e0 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf37e50640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 0x55f08b6d0710 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7faf28056fd0 tx=0x7faf2808b140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf2d64b640 1 -- 172.21.15.121:0/1595246301 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf28071660 con 0x55f08b6c96e0 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf2d64b640 1 -- 172.21.15.121:0/1595246301 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2805cda0 con 0x55f08b6c96e0 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.834+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f08b6d0c50 con 0x55f08b6c96e0 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.835+0000 7faf2d64b640 1 -- 172.21.15.121:0/1595246301 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf2806d660 con 0x55f08b6c96e0 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.835+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f08b6d10b0 con 0x55f08b6c96e0 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.835+0000 7faf2d64b640 1 -- 172.21.15.121:0/1595246301 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7faf2806d7c0 con 0x55f08b6c96e0 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.835+0000 7faf2d64b640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faf100360c0 0x7faf10038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.835+0000 7faf2d64b640 1 -- 172.21.15.121:0/1595246301 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7faf28096d30 con 0x55f08b6c96e0 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf2f64f640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faf100360c0 0x7faf10038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf3c812800 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f08b6dbc40 0x55f08b6de0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6de820 con 0x55f08b6dbc40 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf38651640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f08b6dbc40 0x55f08b6de0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf2f64f640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faf100360c0 0x7faf10038580 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faf20000f60 tx=0x7faf20001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf38651640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f08b6dbc40 0x55f08b6de0d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf3c812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf3c812800 20 realm 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.836+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6db290 con 0x55f08b6dbc40 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6df2a0 con 0x55f08b6dbc40 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.836 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6dfb20 con 0x55f08b6dbc40 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6dfe80 con 0x55f08b6dbc40 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 20 searching for the correct realm 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f08b6e1ba0 0x55f08b6e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4520 con 0x55f08b6e1ba0 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.837+0000 7faf37e50640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f08b6e1ba0 0x55f08b6e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.838+0000 7faf37e50640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f08b6e1ba0 0x55f08b6e3f90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.838+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.838+0000 7faf37e50640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7faf28078060 0x7faf28076360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.837 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.838+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4520 con 0x7faf28078060 2023-12-07T21:10:12.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.838+0000 7faf2f64f640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7faf28078060 0x7faf28076360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.838+0000 7faf2f64f640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7faf28078060 0x7faf28076360 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.839+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf20006070 con 0x7faf28078060 2023-12-07T21:10:12.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.839+0000 7faf2f64f640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7faf2000d3d0 0x7faf2000d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.839+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4520 con 0x7faf2000d3d0 2023-12-07T21:10:12.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.839+0000 7faf38651640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7faf2000d3d0 0x7faf2000d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.838 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.839+0000 7faf38651640 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7faf2000d3d0 0x7faf2000d830 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.839+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.839+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4520 con 0x55f08b6dbc40 2023-12-07T21:10:12.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.840+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.840+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4520 con 0x55f08b6dbc40 2023-12-07T21:10:12.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.840+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.840+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4520 con 0x7faf2000d3d0 2023-12-07T21:10:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.840+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.840+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4520 con 0x7faf2000d3d0 2023-12-07T21:10:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.840+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.840+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4520 con 0x7faf28078060 2023-12-07T21:10:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.841+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf20006070 con 0x7faf28078060 2023-12-07T21:10:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.841+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4520 con 0x55f08b6e1ba0 2023-12-07T21:10:12.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.841+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.841+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4520 con 0x55f08b6dbc40 2023-12-07T21:10:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.841+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.841+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4520 con 0x7faf2000d3d0 2023-12-07T21:10:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.841+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.841+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6dbc40 2023-12-07T21:10:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.842+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.853 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.842+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x7faf28078060 2023-12-07T21:10:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.842+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7faf20006070 con 0x7faf28078060 2023-12-07T21:10:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.842+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6e1ba0 2023-12-07T21:10:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.842+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.842+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6e1ba0 2023-12-07T21:10:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.842+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.842+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x7faf2000d3d0 2023-12-07T21:10:12.854 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.843+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.843+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6e1ba0 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.843+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.843+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6e1ba0 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.843+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.843+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6dbc40 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.843+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.843+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6dbc40 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.844+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.844+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x7faf2000d3d0 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.844+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.844+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6e1ba0 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.844+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.844+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x7faf28078060 2023-12-07T21:10:12.855 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.844+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf20006070 con 0x7faf28078060 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.844+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6dbc40 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.845+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.845+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x7faf2000d3d0 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.845+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.845+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6e1ba0 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.845+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.845+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x7faf2000d3d0 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.845+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.845+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x7faf28078060 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.846+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf20006070 con 0x7faf28078060 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.846+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6e1ba0 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.846+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.846+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x7faf2000d3d0 2023-12-07T21:10:12.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.846+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.846+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x55f08b6dbc40 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.846+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.846+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7faf30030040 con 0x7faf28078060 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faf20006070 con 0x7faf28078060 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e07b0 con 0x55f08b6dbc40 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e0430 con 0x55f08b6dbc40 2023-12-07T21:10:12.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e0440 con 0x55f08b6e1ba0 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.847+0000 7faf3c812800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 20 zone default found 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 4 Realm: () 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 20 zonegroup default 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e4990 con 0x7faf2000d3d0 2023-12-07T21:10:12.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e6810 con 0x55f08b6e1ba0 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e6b70 con 0x55f08b6e1ba0 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 20 started sync module instance, tier type = 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.848+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e5de0 con 0x7faf28078060 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.849+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf20006070 con 0x7faf28078060 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.849+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94491617357648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e5980 con 0x7faf28078060 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.849+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e7370 con 0x55f08b6dbc40 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.851+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94491617357648] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf20006070 con 0x7faf28078060 2023-12-07T21:10:12.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.851+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.851+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94491619778960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e73d0 con 0x55f08b6dbc40 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.851+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e7e90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.852+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94491619778960] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.852+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.852+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94491619785040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e8240 con 0x55f08b6e1ba0 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.852+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e8bb0 con 0x7faf28078060 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.853+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf20026040 con 0x7faf28078060 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.853+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94491619790688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6e9810 con 0x7faf28078060 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.853+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6ea180 con 0x55f08b6dbc40 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.853+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94491619785040] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.854+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94491619790688] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf20026040 con 0x7faf28078060 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.854+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.854+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94491619782352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6ea180 con 0x55f08b6dbc40 2023-12-07T21:10:12.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.854+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6ea9d0 con 0x7faf2000d3d0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.855+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.855+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94491619795600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6eac20 con 0x7faf2000d3d0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.855+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94491619782352] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.855+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6eb500 con 0x7faf2000d3d0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.856+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94491619795600] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.856+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.856+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94491619796640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6eabe0 con 0x7faf2000d3d0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.856+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6ebb10 con 0x7faf2000d3d0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.857+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94491619796640] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.857+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.857+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94491619799136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6ebb10 con 0x7faf2000d3d0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.857+0000 7faf3c812800 20 add_watcher() i=0 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.857+0000 7faf3c812800 20 add_watcher() i=1 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.857+0000 7faf3c812800 20 add_watcher() i=2 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.857+0000 7faf3c812800 20 add_watcher() i=3 2023-12-07T21:10:12.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.857+0000 7faf3c812800 20 add_watcher() i=4 2023-12-07T21:10:12.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.857+0000 7faf3c812800 20 add_watcher() i=5 2023-12-07T21:10:12.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.857+0000 7faf3c812800 20 add_watcher() i=6 2023-12-07T21:10:12.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.858+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94491619799136] v33'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.858+0000 7faf3c812800 20 add_watcher() i=7 2023-12-07T21:10:12.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.858+0000 7faf3c812800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:12.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.858+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6eee40 con 0x55f08b6dbc40 2023-12-07T21:10:12.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.859+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.859+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94491619801056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6ec090 con 0x55f08b6dbc40 2023-12-07T21:10:12.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.860+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94491619801056] v33'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.860+0000 7faefdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.860+0000 7faf3c812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:12.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.860+0000 7faf3c812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:12.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.860+0000 7faf3c812800 5 note: GC not initialized 2023-12-07T21:10:12.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.860+0000 7faefcfe1640 20 reqs_thread_entry: start 2023-12-07T21:10:12.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.860+0000 7faf3c812800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:12.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.860+0000 7faf3c812800 20 Filter name: none 2023-12-07T21:10:12.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.860+0000 7fae767fc640 20 reqs_thread_entry: start 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.860+0000 7faf3c812800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.860+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b7219b0 con 0x55f08b6dbc40 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.861+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.861+0000 7faf3c812800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.861+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b7219b0 con 0x7faf2000d3d0 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.861+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.862+0000 7faefdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.862+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94491619801056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b7219b0 con 0x55f08b6dbc40 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.863+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94491619801056] v33'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.863+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94491617357648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b7219b0 con 0x7faf28078060 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.864+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94491617357648] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf20026040 con 0x7faf28078060 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.864+0000 7faf3c812800 20 remove_watcher() i=0 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.864+0000 7faf3c812800 2 removed watcher, disabling cache 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.864+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94491619778960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6ee390 con 0x55f08b6dbc40 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.865+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94491619778960] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.865+0000 7faf3c812800 20 remove_watcher() i=1 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.865+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94491619785040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6ee390 con 0x55f08b6e1ba0 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.866+0000 7faf37e50640 1 -- 172.21.15.121:0/1595246301 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94491619785040] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf28076b90 con 0x55f08b6e1ba0 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.866+0000 7faf3c812800 20 remove_watcher() i=2 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.866+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94491619790688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6ee6f0 con 0x7faf28078060 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.867+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94491619790688] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf20026040 con 0x7faf28078060 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.867+0000 7faf3c812800 20 remove_watcher() i=3 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.867+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94491619782352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b720390 con 0x55f08b6dbc40 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.868+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94491619782352] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x55f08b6dbc40 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.868+0000 7faf3c812800 20 remove_watcher() i=4 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.868+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94491619795600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b720390 con 0x7faf2000d3d0 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.870+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94491619795600] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.870+0000 7faf3c812800 20 remove_watcher() i=5 2023-12-07T21:10:12.869 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.870+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94491619796640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6ea290 con 0x7faf2000d3d0 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.871+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94491619796640] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.871+0000 7faf3c812800 20 remove_watcher() i=6 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.871+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94491619799136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f08b6ea290 con 0x7faf2000d3d0 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.871+0000 7faf38651640 1 -- 172.21.15.121:0/1595246301 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94491619799136] v33'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faf30012140 con 0x7faf2000d3d0 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.871+0000 7faf3c812800 20 remove_watcher() i=7 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7faf2000d3d0 msgr2=0x7faf2000d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7faf2000d3d0 0x7faf2000d830 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f08b6dbc40 msgr2=0x55f08b6de0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f08b6dbc40 0x55f08b6de0d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7faf28078060 msgr2=0x7faf28076360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7faf28078060 0x7faf28076360 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.870 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f08b6e1ba0 msgr2=0x55f08b6e3f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55f08b6e1ba0 0x55f08b6e3f90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faf100360c0 msgr2=0x7faf10038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faf100360c0 0x7faf10038580 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faf20000f60 tx=0x7faf20001230 comp rx=0 tx=0).stop 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 msgr2=0x55f08b6d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 --2- 172.21.15.121:0/1595246301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b6c96e0 0x55f08b6d0710 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7faf28056fd0 tx=0x7faf2808b140 comp rx=0 tx=0).stop 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 reap_dead start 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf2f64f640 1 -- 172.21.15.121:0/1595246301 reap_dead start 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 shutdown_connections 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 >> 172.21.15.121:0/1595246301 conn(0x55f08b612350 msgr2=0x55f08b6c38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 shutdown_connections 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/1595246301 wait complete. 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/8982249 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faf18036110 msgr2=0x7faf180385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 --2- 172.21.15.121:0/8982249 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faf18036110 0x7faf180385d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55f08b6b09a0 tx=0x7faf30005840 comp rx=0 tx=0).stop 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/8982249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 msgr2=0x55f08b6bd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 --2- 172.21.15.121:0/8982249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b6bd480 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7faf2805e040 tx=0x7faf28002fb0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/8982249 shutdown_connections 2023-12-07T21:10:12.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 --2- 172.21.15.121:0/8982249 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7faf18036110 0x7faf180385d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 --2- 172.21.15.121:0/8982249 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f08b583b60 0x55f08b6bd480 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/8982249 >> 172.21.15.121:0/8982249 conn(0x55f08b609890 msgr2=0x55f08b60dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/8982249 shutdown_connections 2023-12-07T21:10:12.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.872+0000 7faf3c812800 1 -- 172.21.15.121:0/8982249 wait complete. 2023-12-07T21:10:12.873 INFO:teuthology.orchestra.run.smithi121.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2023-12-07T21:00:00.000000Z","epoch":1701982800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2023-12-07T21:10:12.873 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2023-12-07T21:00:00.000000Z', 'epoch': 1701982800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2023-12-07T21:10:12.873 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2023-12-07T21:10:12.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2023-12-07T21:10:12.873 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2023-12-07T21:10:12.924 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:12.924 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:12.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.932+0000 7f2a09320800 1 Processor -- start 2023-12-07T21:10:12.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.933+0000 7f2a09320800 1 -- start start 2023-12-07T21:10:12.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.933+0000 7f2a09320800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555c716e5810 0x555c716e7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.933+0000 7f2a09320800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555c7162d740 con 0x555c716e2880 2023-12-07T21:10:12.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.933+0000 7f2a09320800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x555c715f6880 con 0x555c716e5810 2023-12-07T21:10:12.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.933+0000 7f2a0476f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x555c716e5810 0x555c716e7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.933+0000 7f2a04f70640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x555c716e2880 0x555c716e2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:35638/0 (socket says 172.21.15.121:35638) 2023-12-07T21:10:12.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.933+0000 7f2a04f70640 1 -- 172.21.15.121:0/1972267857 learned_addr learned my addr 172.21.15.121:0/1972267857 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:12.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.933+0000 7f2a0476f640 1 -- 172.21.15.121:0/1972267857 >> v1:172.21.15.89:6789/0 conn(0x555c716e2880 legacy=0x555c716e2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.933+0000 7f2a0476f640 1 -- 172.21.15.121:0/1972267857 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c716e9150 con 0x555c716e5810 2023-12-07T21:10:12.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.933+0000 7f2a03f6e640 1 -- 172.21.15.121:0/1972267857 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 393651476 0 0) 0x555c7162d740 con 0x555c716e2880 2023-12-07T21:10:12.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.935+0000 7f2a0476f640 1 --2- 172.21.15.121:0/1972267857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e5810 0x555c716e7c00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f29f800a470 tx=0x7f29f801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdddcc93e1f5e46 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.935+0000 7f2a03f6e640 1 -- 172.21.15.121:0/1972267857 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29f8052570 con 0x555c716e5810 2023-12-07T21:10:12.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.935+0000 7f2a03f6e640 1 -- 172.21.15.121:0/1972267857 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f80526d0 con 0x555c716e5810 2023-12-07T21:10:12.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.935+0000 7f2a03f6e640 1 -- 172.21.15.121:0/1972267857 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29f8052990 con 0x555c716e5810 2023-12-07T21:10:12.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.936+0000 7f2a09320800 1 -- 172.21.15.121:0/1972267857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e5810 msgr2=0x555c716e7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.936+0000 7f2a09320800 1 --2- 172.21.15.121:0/1972267857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e5810 0x555c716e7c00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f29f800a470 tx=0x7f29f801cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:12.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.936+0000 7f2a09320800 1 -- 172.21.15.121:0/1972267857 shutdown_connections 2023-12-07T21:10:12.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.936+0000 7f2a09320800 1 --2- 172.21.15.121:0/1972267857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e5810 0x555c716e7c00 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.936+0000 7f2a09320800 1 -- 172.21.15.121:0/1972267857 >> 172.21.15.121:0/1972267857 conn(0x555c716dafa0 msgr2=0x555c716dd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.936+0000 7f2a09320800 1 -- 172.21.15.121:0/1972267857 shutdown_connections 2023-12-07T21:10:12.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.936+0000 7f2a09320800 1 -- 172.21.15.121:0/1972267857 wait complete. 2023-12-07T21:10:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.936+0000 7f2a09320800 1 Processor -- start 2023-12-07T21:10:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.936+0000 7f2a09320800 1 -- start start 2023-12-07T21:10:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.937+0000 7f2a09320800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c716e1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.937+0000 7f2a09320800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c715f3db0 con 0x555c716e2880 2023-12-07T21:10:12.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.937+0000 7f2a04f70640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c716e1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.937+0000 7f2a04f70640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c716e1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42758/0 (socket says 172.21.15.121:42758) 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.937+0000 7f2a04f70640 1 -- 172.21.15.121:0/2168444781 learned_addr learned my addr 172.21.15.121:0/2168444781 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.937+0000 7f2a04f70640 1 -- 172.21.15.121:0/2168444781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f8005d20 con 0x555c716e2880 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.937+0000 7f2a04f70640 1 --2- 172.21.15.121:0/2168444781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c716e1d10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f29f4001660 tx=0x7f29f4001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7accc8e64a2c5e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a0376d640 1 -- 172.21.15.121:0/2168444781 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29f4003450 con 0x555c716e2880 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a0376d640 1 -- 172.21.15.121:0/2168444781 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f40035d0 con 0x555c716e2880 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a0376d640 1 -- 172.21.15.121:0/2168444781 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29f4003930 con 0x555c716e2880 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a09320800 1 -- 172.21.15.121:0/2168444781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 msgr2=0x555c716e1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a09320800 1 --2- 172.21.15.121:0/2168444781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c716e1d10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f29f4001660 tx=0x7f29f4001b20 comp rx=0 tx=0).stop 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a09320800 1 -- 172.21.15.121:0/2168444781 shutdown_connections 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a09320800 1 --2- 172.21.15.121:0/2168444781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c716e1d10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a09320800 1 -- 172.21.15.121:0/2168444781 >> 172.21.15.121:0/2168444781 conn(0x555c716dafa0 msgr2=0x555c71781a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a09320800 1 -- 172.21.15.121:0/2168444781 shutdown_connections 2023-12-07T21:10:12.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a09320800 1 -- 172.21.15.121:0/2168444781 wait complete. 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a09320800 1 Processor -- start 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.938+0000 7f2a09320800 1 -- start start 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a09320800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c7178f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a09320800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c715ef6a0 con 0x555c716e2880 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a04f70640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c7178f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a04f70640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c7178f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42760/0 (socket says 172.21.15.121:42760) 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a04f70640 1 -- 172.21.15.121:0/4028703672 learned_addr learned my addr 172.21.15.121:0/4028703672 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a04f70640 1 -- 172.21.15.121:0/4028703672 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f4006ce0 con 0x555c716e2880 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a04f70640 1 --2- 172.21.15.121:0/4028703672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c7178f410 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x555c71782500 tx=0x7f29f4001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a0276b640 1 -- 172.21.15.121:0/4028703672 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29f4023030 con 0x555c716e2880 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a0276b640 1 -- 172.21.15.121:0/4028703672 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f4013820 con 0x555c716e2880 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a09320800 1 -- 172.21.15.121:0/4028703672 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c7178f950 con 0x555c716e2880 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a0276b640 1 -- 172.21.15.121:0/4028703672 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29f4013ac0 con 0x555c716e2880 2023-12-07T21:10:12.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.939+0000 7f2a09320800 1 -- 172.21.15.121:0/4028703672 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c7178fe30 con 0x555c716e2880 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.940+0000 7f2a09320800 1 Processor -- start 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.940+0000 7f2a09320800 1 -- start start 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.940+0000 7f2a0276b640 1 -- 172.21.15.121:0/4028703672 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f29f4026070 con 0x555c716e2880 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.940+0000 7f2a09320800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 0x555c7179ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.940+0000 7f2a09320800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c71589890 con 0x555c7179b660 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.940+0000 7f2a0276b640 1 --2- 172.21.15.121:0/4028703672 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29f0036110 0x7f29f00385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.940+0000 7f2a05771640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 0x555c7179ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.940+0000 7f2a0276b640 1 -- 172.21.15.121:0/4028703672 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f29f4024070 con 0x555c716e2880 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.940+0000 7f2a05771640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 0x555c7179ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42772/0 (socket says 172.21.15.121:42772) 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.940+0000 7f2a05771640 1 -- 172.21.15.121:0/2630582856 learned_addr learned my addr 172.21.15.121:0/2630582856 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.940+0000 7f2a04f70640 1 --2- 172.21.15.121:0/4028703672 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29f0036110 0x7f29f00385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f2a05771640 1 -- 172.21.15.121:0/2630582856 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c7179bfc0 con 0x555c7179b660 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f2a04f70640 1 --2- 172.21.15.121:0/4028703672 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29f0036110 0x7f29f00385d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f29f4013f70 tx=0x7f29f4013f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f2a05771640 1 --2- 172.21.15.121:0/2630582856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 0x555c7179ba80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00a400 tx=0x7f29fc00a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0ec7e7a29240f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f29ebfff640 1 -- 172.21.15.121:0/2630582856 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29fc0087e0 con 0x555c7179b660 2023-12-07T21:10:12.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f29ebfff640 1 -- 172.21.15.121:0/2630582856 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc008960 con 0x555c7179b660 2023-12-07T21:10:12.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f29ebfff640 1 -- 172.21.15.121:0/2630582856 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29fc008c80 con 0x555c7179b660 2023-12-07T21:10:12.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f2a09320800 1 -- 172.21.15.121:0/2630582856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 msgr2=0x555c7179ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f2a09320800 1 --2- 172.21.15.121:0/2630582856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 0x555c7179ba80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00a400 tx=0x7f29fc00a8c0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f2a09320800 1 -- 172.21.15.121:0/2630582856 shutdown_connections 2023-12-07T21:10:12.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f2a09320800 1 --2- 172.21.15.121:0/2630582856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 0x555c7179ba80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f2a09320800 1 -- 172.21.15.121:0/2630582856 >> 172.21.15.121:0/2630582856 conn(0x555c716e5810 msgr2=0x555c71796a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f2a09320800 1 -- 172.21.15.121:0/2630582856 shutdown_connections 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.941+0000 7f2a09320800 1 -- 172.21.15.121:0/2630582856 wait complete. 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.942+0000 7f2a09320800 1 Processor -- start 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.942+0000 7f2a09320800 1 -- start start 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.942+0000 7f2a09320800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 0x555c717a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.942+0000 7f2a09320800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c71589530 con 0x555c7179b660 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.942+0000 7f2a05771640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 0x555c717a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.942+0000 7f2a05771640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 0x555c717a25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42778/0 (socket says 172.21.15.121:42778) 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.942+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 learned_addr learned my addr 172.21.15.121:0/2436386478 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.942+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29fc005c90 con 0x555c7179b660 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.942+0000 7f2a05771640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 0x555c717a25f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00c010 tx=0x7f29fc002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.942+0000 7f29ea7fc640 1 -- 172.21.15.121:0/2436386478 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29fc013840 con 0x555c7179b660 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.943+0000 7f29ea7fc640 1 -- 172.21.15.121:0/2436386478 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc0139a0 con 0x555c7179b660 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.943+0000 7f29ea7fc640 1 -- 172.21.15.121:0/2436386478 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29fc013c80 con 0x555c7179b660 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.943+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c717a2b30 con 0x555c7179b660 2023-12-07T21:10:12.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.943+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c717a2ff0 con 0x555c7179b660 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.943+0000 7f29ea7fc640 1 -- 172.21.15.121:0/2436386478 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f29fc01e420 con 0x555c7179b660 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.943+0000 7f29ea7fc640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29e00360c0 0x7f29e0038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.944+0000 7f29ea7fc640 1 -- 172.21.15.121:0/2436386478 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f29fc04b960 con 0x555c7179b660 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.944+0000 7f2a0476f640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29e00360c0 0x7f29e0038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.944+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.944+0000 7f2a09320800 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x555c717add90 0x555c717b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.944+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b09a0 con 0x555c717add90 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.944+0000 7f2a05771640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x555c717add90 0x555c717b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.944+0000 7f2a0476f640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29e00360c0 0x7f29e0038580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29f8054000 tx=0x7f29f804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.944+0000 7f2a05771640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x555c717add90 0x555c717b0250 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 20 realm 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b0d90 con 0x555c717add90 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b1610 con 0x555c717add90 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b1970 con 0x555c717add90 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b2170 con 0x555c717add90 2023-12-07T21:10:12.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.945+0000 7f2a09320800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.946+0000 7f2a09320800 20 searching for the correct realm 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.946+0000 7f2a09320800 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x555c717b3e90 0x555c717b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.946+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717b3e90 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.946+0000 7f2a04f70640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x555c717b3e90 0x555c717b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.946+0000 7f2a04f70640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x555c717b3e90 0x555c717b6300 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.946+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f4029990 con 0x555c717b3e90 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.946+0000 7f2a04f70640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f29f4010590 0x7f29f40285f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.946+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f4010590 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.946+0000 7f2a0476f640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f29f4010590 0x7f29f40285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.947+0000 7f2a0476f640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f29f4010590 0x7f29f40285f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.947+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f8059040 con 0x7f29f4010590 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.947+0000 7f2a0476f640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f29f805d930 0x7f29f8009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.947+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f805d930 2023-12-07T21:10:12.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.947+0000 7f2a05771640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f29f805d930 0x7f29f8009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.947+0000 7f2a05771640 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f29f805d930 0x7f29f8009410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.948+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.948+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717add90 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.948+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.948+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717add90 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.948+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.948+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f805d930 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.948+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.948+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f805d930 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.949+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.949+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f4010590 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.949+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f8059040 con 0x7f29f4010590 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.949+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717b3e90 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.949+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f4029990 con 0x555c717b3e90 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.949+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717add90 2023-12-07T21:10:12.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.949+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.949+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f805d930 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.949+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.949+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717add90 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.950+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.950+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f4010590 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.950+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f29f8059040 con 0x7f29f4010590 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.950+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717b3e90 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.950+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f4029990 con 0x555c717b3e90 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.950+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717b3e90 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.950+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f4029990 con 0x555c717b3e90 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.950+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f805d930 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.951+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.951+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717b3e90 2023-12-07T21:10:12.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.951+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f4029990 con 0x555c717b3e90 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.951+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717b3e90 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.951+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f4029990 con 0x555c717b3e90 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.951+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717add90 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.951+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.951+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717add90 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.951+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.951+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f805d930 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.952+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.952+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717b3e90 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.952+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f29f4029990 con 0x555c717b3e90 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.952+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f4010590 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.952+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f8059040 con 0x7f29f4010590 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.953+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717add90 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.953+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.953+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f805d930 2023-12-07T21:10:12.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.953+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.953+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717b3e90 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.953+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f403a040 con 0x555c717b3e90 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.953+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f805d930 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.954+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.954+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f4010590 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.954+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f8059040 con 0x7f29f4010590 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.954+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717b3e90 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.954+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f403a040 con 0x555c717b3e90 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.954+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x7f29f805d930 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.954+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.954+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b69d0 con 0x555c717add90 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f29fc054080 con 0x7f29f4010590 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29f8059040 con 0x7f29f4010590 2023-12-07T21:10:12.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b2a70 con 0x555c717add90 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b32c0 con 0x555c717add90 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.955+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b32c0 con 0x555c717b3e90 2023-12-07T21:10:12.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f29f403a040 con 0x555c717b3e90 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 20 zone default found 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 4 Realm: () 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 20 zonegroup default 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b6e10 con 0x7f29f805d930 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b8c90 con 0x555c717b3e90 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f29f403a040 con 0x555c717b3e90 2023-12-07T21:10:12.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.956+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b8ff0 con 0x555c717b3e90 2023-12-07T21:10:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.957+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f29f403a040 con 0x555c717b3e90 2023-12-07T21:10:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.957+0000 7f2a09320800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.957+0000 7f2a09320800 20 started sync module instance, tier type = 2023-12-07T21:10:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.957+0000 7f2a09320800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.957+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b8260 con 0x7f29f4010590 2023-12-07T21:10:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.958+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29f8059040 con 0x7f29f4010590 2023-12-07T21:10:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.958+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93855526850384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b8680 con 0x7f29f4010590 2023-12-07T21:10:12.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.958+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b97f0 con 0x555c717add90 2023-12-07T21:10:12.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.959+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93855526850384] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29f8072040 con 0x7f29f4010590 2023-12-07T21:10:12.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.959+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.959+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93855529270720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b97f0 con 0x555c717add90 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.959+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717ba200 con 0x555c717b3e90 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.960+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93855529270720] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.960+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29f403a040 con 0x555c717b3e90 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.960+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93855529276240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717b9760 con 0x555c717b3e90 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.960+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717baef0 con 0x7f29f4010590 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.961+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29f8072040 con 0x7f29f4010590 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.961+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93855529284256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bbb50 con 0x7f29f4010590 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.961+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bc4c0 con 0x555c717add90 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.961+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93855529276240] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29f4053040 con 0x555c717b3e90 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.962+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.962+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93855529284256] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29f8072040 con 0x7f29f4010590 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.962+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93855529287712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bc430 con 0x555c717add90 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.962+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bb6b0 con 0x7f29f805d930 2023-12-07T21:10:12.968 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.963+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.963+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93855529287712] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.963+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93855529285296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bd1b0 con 0x7f29f805d930 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.963+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bc870 con 0x7f29f805d930 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.964+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93855529285296] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.964+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.964+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93855529289760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bd170 con 0x7f29f805d930 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.964+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bdd80 con 0x7f29f805d930 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.966+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v33'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.966+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93855529293936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bdd80 con 0x7f29f805d930 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.966+0000 7f2a09320800 20 add_watcher() i=0 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.966+0000 7f2a09320800 20 add_watcher() i=1 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.966+0000 7f2a09320800 20 add_watcher() i=2 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.966+0000 7f2a09320800 20 add_watcher() i=3 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.966+0000 7f2a09320800 20 add_watcher() i=4 2023-12-07T21:10:12.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.966+0000 7f2a09320800 20 add_watcher() i=5 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.966+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93855529289760] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.966+0000 7f2a09320800 20 add_watcher() i=6 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.967+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93855529293936] v33'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.967+0000 7f2a09320800 20 add_watcher() i=7 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.967+0000 7f2a09320800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.967+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bccb0 con 0x555c717add90 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.967+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.967+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93855529296064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bccb0 con 0x555c717add90 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.968+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93855529296064] v33'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.968+0000 7f29cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.968+0000 7f2a09320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.968+0000 7f2a09320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.968+0000 7f2a09320800 5 note: GC not initialized 2023-12-07T21:10:12.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.968+0000 7f29c9fe3640 20 reqs_thread_entry: start 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.968+0000 7f2a09320800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 20 Filter name: none 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f293b7fe640 20 reqs_thread_entry: start 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717f4290 con 0x7f29f805d930 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 20 rados->read ofs=0 len=0 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717f2a40 con 0x555c717add90 2023-12-07T21:10:12.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.969+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717f2e40 con 0x7f29f805d930 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.970+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~346] v33'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.970+0000 7f2a09320800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.970+0000 7f2a09320800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.970+0000 7f2a09320800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.970+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 93855529516272 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717f76e0 con 0x7f29f805d930 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.971+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== watch-notify(notify (1) cookie 93855529293936 notify 141733920800 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x555c717a2ff0 con 0x7f29f805d930 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.971+0000 7f29ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920800 cookie 93855529293936 notifier 4648 bl.length()=522 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.971+0000 7f29ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.971+0000 7f29ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2023-12-07T21:10:12.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.971+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(65 notify.7 [notify cookie 93855529516272 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.971+0000 7f29ebfff640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f29d80042a0 con 0x7f29f805d930 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.971+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.971+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== watch-notify(notify_complete (2) cookie 93855529516272 notify 141733920800 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x555c717a2b30 con 0x7f29f805d930 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.971+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717f56c0 con 0x555c717add90 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.972+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.972+0000 7f2a09320800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.972+0000 7f2a09320800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.972+0000 7f2a09320800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.972+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93855529516272 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717f76e0 con 0x7f29f805d930 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.972+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== watch-notify(notify (1) cookie 93855529285296 notify 141733920801 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x555c717a2b30 con 0x7f29f805d930 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.972+0000 7f29ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 93855529285296 notifier 4648 bl.length()=177 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.972+0000 7f29ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.972+0000 7f29ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.972+0000 7f29ebfff640 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f29d80042a0 con 0x7f29f805d930 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.972+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(68 notify.5 [notify cookie 93855529516272 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.973+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.974 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.973+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== watch-notify(notify_complete (2) cookie 93855529516272 notify 141733920801 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f29fc005c90 con 0x7f29f805d930 2023-12-07T21:10:12.974 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:10:12.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.974+0000 7f29cafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:12.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.974+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93855529296064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717c0df0 con 0x555c717add90 2023-12-07T21:10:12.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.975+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93855529296064] v33'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.975+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93855526850384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717c0df0 con 0x7f29f4010590 2023-12-07T21:10:12.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.976+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93855526850384] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29f8072040 con 0x7f29f4010590 2023-12-07T21:10:12.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.976+0000 7f2a09320800 20 remove_watcher() i=0 2023-12-07T21:10:12.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.976+0000 7f2a09320800 2 removed watcher, disabling cache 2023-12-07T21:10:12.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.976+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93855529270720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717c1150 con 0x555c717add90 2023-12-07T21:10:12.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.977+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93855529270720] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.977+0000 7f2a09320800 20 remove_watcher() i=1 2023-12-07T21:10:12.978 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.977+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93855529276240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717c1150 con 0x555c717b3e90 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.978+0000 7f2a04f70640 1 -- 172.21.15.121:0/2436386478 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93855529276240] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29f4053040 con 0x555c717b3e90 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.978+0000 7f2a09320800 20 remove_watcher() i=2 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.978+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93855529284256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717aad80 con 0x7f29f4010590 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.979+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93855529284256] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29f8072040 con 0x7f29f4010590 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.979+0000 7f2a09320800 20 remove_watcher() i=3 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.979+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93855529287712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717ab0e0 con 0x555c717add90 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.980+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93855529287712] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x555c717add90 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.980+0000 7f2a09320800 20 remove_watcher() i=4 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.980+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93855529285296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717ab0e0 con 0x7f29f805d930 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.982+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93855529285296] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.982+0000 7f2a09320800 20 remove_watcher() i=5 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.982+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93855529289760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bb6b0 con 0x7f29f805d930 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.983+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93855529289760] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.983+0000 7f2a09320800 20 remove_watcher() i=6 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.983+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93855529293936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x555c717bb6b0 con 0x7f29f805d930 2023-12-07T21:10:12.979 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a05771640 1 -- 172.21.15.121:0/2436386478 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93855529293936] v33'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29fc024070 con 0x7f29f805d930 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 20 remove_watcher() i=7 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f29f805d930 msgr2=0x7f29f8009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f29f805d930 0x7f29f8009410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x555c717add90 msgr2=0x555c717b0250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x555c717add90 0x555c717b0250 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f29f4010590 msgr2=0x7f29f40285f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f29f4010590 0x7f29f40285f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x555c717b3e90 msgr2=0x555c717b6300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x555c717b3e90 0x555c717b6300 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29e00360c0 msgr2=0x7f29e0038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29e00360c0 0x7f29e0038580 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29f8054000 tx=0x7f29f804e000 comp rx=0 tx=0).stop 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 msgr2=0x555c717a25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 --2- 172.21.15.121:0/2436386478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c7179b660 0x555c717a25f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00c010 tx=0x7f29fc002ff0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 reap_dead start 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a0476f640 1 -- 172.21.15.121:0/2436386478 reap_dead start 2023-12-07T21:10:12.980 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 shutdown_connections 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 >> 172.21.15.121:0/2436386478 conn(0x555c716e5810 msgr2=0x555c71795840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 shutdown_connections 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 -- 172.21.15.121:0/2436386478 wait complete. 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 -- 172.21.15.121:0/4028703672 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29f0036110 msgr2=0x7f29f00385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.984+0000 7f2a09320800 1 --2- 172.21.15.121:0/4028703672 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29f0036110 0x7f29f00385d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f29f4013f70 tx=0x7f29f4013f00 comp rx=0 tx=0).stop 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.985+0000 7f2a09320800 1 -- 172.21.15.121:0/4028703672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 msgr2=0x555c7178f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.985+0000 7f2a09320800 1 --2- 172.21.15.121:0/4028703672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c7178f410 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x555c71782500 tx=0x7f29f4001250 comp rx=0 tx=0).stop 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.985+0000 7f2a09320800 1 -- 172.21.15.121:0/4028703672 shutdown_connections 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.985+0000 7f2a09320800 1 --2- 172.21.15.121:0/4028703672 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29f0036110 0x7f29f00385d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.985+0000 7f2a09320800 1 --2- 172.21.15.121:0/4028703672 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555c716e2880 0x555c7178f410 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.985+0000 7f2a09320800 1 -- 172.21.15.121:0/4028703672 >> 172.21.15.121:0/4028703672 conn(0x555c716dafa0 msgr2=0x555c716e05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.985+0000 7f2a09320800 1 -- 172.21.15.121:0/4028703672 shutdown_connections 2023-12-07T21:10:12.981 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:12.985+0000 7f2a09320800 1 -- 172.21.15.121:0/4028703672 wait complete. 2023-12-07T21:10:12.982 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:10:12.995 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:10:13.000 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2023-12-07T21:10:13.000 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2023-12-07T21:10:13.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2023-12-07T21:10:13.001 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2023-12-07T21:10:13.046 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:13.047 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:13.047 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.055+0000 7fcf5eee4800 1 Processor -- start 2023-12-07T21:10:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.055+0000 7fcf5eee4800 1 -- start start 2023-12-07T21:10:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.055+0000 7fcf5eee4800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5651b6c77850 0x5651b6c77c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.055+0000 7fcf5eee4800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5651b6bc2740 con 0x5651b6c781b0 2023-12-07T21:10:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.055+0000 7fcf5eee4800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5651b6b8b880 con 0x5651b6c77850 2023-12-07T21:10:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.056+0000 7fcf5c9eb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5651b6c77850 0x5651b6c77c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.056+0000 7fcf5c1ea640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5651b6c781b0 0x5651b6c742d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:35648/0 (socket says 172.21.15.121:35648) 2023-12-07T21:10:13.048 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.056+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/4250938292 learned_addr learned my addr 172.21.15.121:0/4250938292 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.056+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/4250938292 >> v1:172.21.15.89:6789/0 conn(0x5651b6c781b0 legacy=0x5651b6c742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.049 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.056+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/4250938292 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651b6c74b70 con 0x5651b6c77850 2023-12-07T21:10:13.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.058+0000 7fcf5c9eb640 1 --2- 172.21.15.121:0/4250938292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6c77c70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00a470 tx=0x7fcf4c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80b0e479b842543 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:13.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.058+0000 7fcf5b9e9640 1 -- 172.21.15.121:0/4250938292 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf4c052570 con 0x5651b6c77850 2023-12-07T21:10:13.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.058+0000 7fcf5b9e9640 1 -- 172.21.15.121:0/4250938292 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c0526d0 con 0x5651b6c77850 2023-12-07T21:10:13.050 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.058+0000 7fcf5b9e9640 1 -- 172.21.15.121:0/4250938292 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf4c052990 con 0x5651b6c77850 2023-12-07T21:10:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.058+0000 7fcf5eee4800 1 -- 172.21.15.121:0/4250938292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 msgr2=0x5651b6c77c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.058+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/4250938292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6c77c70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00a470 tx=0x7fcf4c01cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:13.051 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.058+0000 7fcf5eee4800 1 -- 172.21.15.121:0/4250938292 shutdown_connections 2023-12-07T21:10:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.058+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/4250938292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6c77c70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.058+0000 7fcf5eee4800 1 -- 172.21.15.121:0/4250938292 >> 172.21.15.121:0/4250938292 conn(0x5651b6c6ff70 msgr2=0x5651b6c72390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.058+0000 7fcf5eee4800 1 -- 172.21.15.121:0/4250938292 shutdown_connections 2023-12-07T21:10:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.058+0000 7fcf5eee4800 1 -- 172.21.15.121:0/4250938292 wait complete. 2023-12-07T21:10:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.059+0000 7fcf5eee4800 1 Processor -- start 2023-12-07T21:10:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.059+0000 7fcf5eee4800 1 -- start start 2023-12-07T21:10:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.059+0000 7fcf5eee4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d1b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:13.052 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.059+0000 7fcf5eee4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b6b88db0 con 0x5651b6c77850 2023-12-07T21:10:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.059+0000 7fcf5c9eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d1b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.059+0000 7fcf5c9eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d1b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42788/0 (socket says 172.21.15.121:42788) 2023-12-07T21:10:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.060+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/1579351712 learned_addr learned my addr 172.21.15.121:0/1579351712 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.060+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/1579351712 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c005d20 con 0x5651b6c77850 2023-12-07T21:10:13.054 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.060+0000 7fcf5c9eb640 1 --2- 172.21.15.121:0/1579351712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d1b3b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c055040 tx=0x7fcf4c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9162a81b82cd28 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.060+0000 7fcf5b1e8640 1 -- 172.21.15.121:0/1579351712 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf4c00a180 con 0x5651b6c77850 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.060+0000 7fcf5b1e8640 1 -- 172.21.15.121:0/1579351712 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00a2e0 con 0x5651b6c77850 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.060+0000 7fcf5b1e8640 1 -- 172.21.15.121:0/1579351712 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf4c0529b0 con 0x5651b6c77850 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.060+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1579351712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 msgr2=0x5651b6d1b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.060+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/1579351712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d1b3b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c055040 tx=0x7fcf4c04c000 comp rx=0 tx=0).stop 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.060+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1579351712 shutdown_connections 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.060+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/1579351712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d1b3b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.061+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1579351712 >> 172.21.15.121:0/1579351712 conn(0x5651b6c6ff70 msgr2=0x5651b6d17020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.061+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1579351712 shutdown_connections 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.061+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1579351712 wait complete. 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.061+0000 7fcf5eee4800 1 Processor -- start 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.061+0000 7fcf5eee4800 1 -- start start 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.061+0000 7fcf5eee4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d22720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.061+0000 7fcf5eee4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b6b846a0 con 0x5651b6c77850 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.061+0000 7fcf5c9eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d22720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:13.055 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.061+0000 7fcf5c9eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d22720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42804/0 (socket says 172.21.15.121:42804) 2023-12-07T21:10:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.061+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/1441832102 learned_addr learned my addr 172.21.15.121:0/1441832102 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.061+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/1441832102 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651b6c74b70 con 0x5651b6c77850 2023-12-07T21:10:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.062+0000 7fcf5c9eb640 1 --2- 172.21.15.121:0/1441832102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d22720 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c05e040 tx=0x7fcf4c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.062+0000 7fcf5a1e6640 1 -- 172.21.15.121:0/1441832102 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf4c06a070 con 0x5651b6c77850 2023-12-07T21:10:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.062+0000 7fcf5a1e6640 1 -- 172.21.15.121:0/1441832102 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c052d90 con 0x5651b6c77850 2023-12-07T21:10:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.062+0000 7fcf5a1e6640 1 -- 172.21.15.121:0/1441832102 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf4c05c540 con 0x5651b6c77850 2023-12-07T21:10:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.062+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1441832102 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5651b6d22c60 con 0x5651b6c77850 2023-12-07T21:10:13.056 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.062+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1441832102 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651b6d231a0 con 0x5651b6c77850 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.062+0000 7fcf5eee4800 1 Processor -- start 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.062+0000 7fcf5eee4800 1 -- start start 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5a1e6640 1 -- 172.21.15.121:0/1441832102 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fcf4c059030 con 0x5651b6c77850 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5eee4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6c75590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5eee4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b6b1e890 con 0x5651b6c77040 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5a1e6640 1 --2- 172.21.15.121:0/1441832102 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fcf48036110 0x7fcf480385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5a1e6640 1 -- 172.21.15.121:0/1441832102 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fcf4c08cb50 con 0x5651b6c77850 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5d1ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6c75590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5d1ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6c75590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42808/0 (socket says 172.21.15.121:42808) 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/3160325777 learned_addr learned my addr 172.21.15.121:0/3160325777 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5c9eb640 1 --2- 172.21.15.121:0/1441832102 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fcf48036110 0x7fcf480385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/3160325777 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651b6c75ad0 con 0x5651b6c77040 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5c9eb640 1 --2- 172.21.15.121:0/1441832102 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fcf48036110 0x7fcf480385d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c052f70 tx=0x7fcf4c052f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:13.064 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf5d1ec640 1 --2- 172.21.15.121:0/3160325777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6c75590 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400a430 tx=0x7fcf5400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666382f084c69c4a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf43fff640 1 -- 172.21.15.121:0/3160325777 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf54001650 con 0x5651b6c77040 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf43fff640 1 -- 172.21.15.121:0/3160325777 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf540017d0 con 0x5651b6c77040 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.063+0000 7fcf43fff640 1 -- 172.21.15.121:0/3160325777 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf54001ab0 con 0x5651b6c77040 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.064+0000 7fcf5eee4800 1 -- 172.21.15.121:0/3160325777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 msgr2=0x5651b6c75590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.064+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/3160325777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6c75590 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400a430 tx=0x7fcf5400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.064+0000 7fcf5eee4800 1 -- 172.21.15.121:0/3160325777 shutdown_connections 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.064+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/3160325777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6c75590 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.064+0000 7fcf5eee4800 1 -- 172.21.15.121:0/3160325777 >> 172.21.15.121:0/3160325777 conn(0x5651b6c781b0 msgr2=0x5651b6d29db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.064+0000 7fcf5eee4800 1 -- 172.21.15.121:0/3160325777 shutdown_connections 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.064+0000 7fcf5eee4800 1 -- 172.21.15.121:0/3160325777 wait complete. 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.064+0000 7fcf5eee4800 1 Processor -- start 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.064+0000 7fcf5eee4800 1 -- start start 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.064+0000 7fcf5eee4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6d37b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.064+0000 7fcf5eee4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b6b1e530 con 0x5651b6c77040 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.065+0000 7fcf5d1ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6d37b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:13.065 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.065+0000 7fcf5d1ec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6d37b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:42814/0 (socket says 172.21.15.121:42814) 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.065+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 learned_addr learned my addr 172.21.15.121:0/2167766567 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.065+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5400a0e0 con 0x5651b6c77040 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.065+0000 7fcf5d1ec640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6d37b10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400ae40 tx=0x7fcf54003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.065+0000 7fcf427fc640 1 -- 172.21.15.121:0/2167766567 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf540109e0 con 0x5651b6c77040 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.065+0000 7fcf427fc640 1 -- 172.21.15.121:0/2167766567 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf54010b40 con 0x5651b6c77040 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.065+0000 7fcf427fc640 1 -- 172.21.15.121:0/2167766567 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf54010e20 con 0x5651b6c77040 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.065+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5651b6d38050 con 0x5651b6c77040 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.065+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651b6d384b0 con 0x5651b6c77040 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.066+0000 7fcf427fc640 1 -- 172.21.15.121:0/2167766567 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fcf54017070 con 0x5651b6c77040 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.066+0000 7fcf427fc640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fcf380360c0 0x7fcf38038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.066+0000 7fcf427fc640 1 -- 172.21.15.121:0/2167766567 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fcf5404bd00 con 0x5651b6c77040 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.066+0000 7fcf5c1ea640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fcf380360c0 0x7fcf38038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5651b6d43200 0x5651b6d456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:13.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d45e10 con 0x5651b6d43200 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5c1ea640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fcf380360c0 0x7fcf38038580 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcf50000f60 tx=0x7fcf50001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5d1ec640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5651b6d43200 0x5651b6d456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5d1ec640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5651b6d43200 0x5651b6d456c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5eee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5eee4800 20 realm 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d46220 con 0x5651b6d43200 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5eee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.067+0000 7fcf5eee4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d46aa0 con 0x5651b6d43200 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:13.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d46e00 con 0x5651b6d43200 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d47600 con 0x5651b6d43200 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 20 searching for the correct realm 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5651b6d49320 0x5651b6d4b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d49320 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.068+0000 7fcf5c9eb640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5651b6d49320 0x5651b6d4b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.069+0000 7fcf5c9eb640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5651b6d49320 0x5651b6d4b790 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.069+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.069+0000 7fcf5c9eb640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fcf4c078060 0x7fcf4c05bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.069+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf4c078060 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.069+0000 7fcf5c1ea640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fcf4c078060 0x7fcf4c05bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:13.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.069+0000 7fcf5c1ea640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fcf4c078060 0x7fcf4c05bab0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.070+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf50006070 con 0x7fcf4c078060 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.070+0000 7fcf5c1ea640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fcf5000d3d0 0x7fcf5000d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.070+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf5000d3d0 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.070+0000 7fcf5d1ec640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fcf5000d3d0 0x7fcf5000d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.070+0000 7fcf5d1ec640 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fcf5000d3d0 0x7fcf5000d830 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.070+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.070+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d43200 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.071+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.071+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d43200 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.071+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.071+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf5000d3d0 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.071+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.071+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf5000d3d0 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.071+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.071+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf4c078060 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.071+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf50006070 con 0x7fcf4c078060 2023-12-07T21:10:13.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.071+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d49320 2023-12-07T21:10:13.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.072+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.072+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d43200 2023-12-07T21:10:13.077 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.072+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.072+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf5000d3d0 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.072+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.072+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d43200 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.072+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.072+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf4c078060 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.073+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fcf50006070 con 0x7fcf4c078060 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.073+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d49320 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.073+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.073+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d49320 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.073+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.073+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf5000d3d0 2023-12-07T21:10:13.078 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.073+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.073+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d49320 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.073+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.073+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d49320 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.074+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.074+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d43200 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.074+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.074+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d43200 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.074+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.074+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf5000d3d0 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.075+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.075+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d49320 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.075+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.075+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf4c078060 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.075+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf50006070 con 0x7fcf4c078060 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.075+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d43200 2023-12-07T21:10:13.079 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.075+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.075+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf5000d3d0 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.076+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.076+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d49320 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.076+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.076+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf5000d3d0 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.076+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.076+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf4c078060 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.076+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf50006070 con 0x7fcf4c078060 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.076+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d49320 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf5000d3d0 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x5651b6d43200 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4be60 con 0x7fcf4c078060 2023-12-07T21:10:13.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcf50006070 con 0x7fcf4c078060 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5eee4800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5eee4800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5eee4800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5eee4800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5eee4800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5eee4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.077+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d47f60 con 0x5651b6d43200 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d487b0 con 0x5651b6d43200 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4c2a0 con 0x5651b6d49320 2023-12-07T21:10:13.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 20 zone default found 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 4 Realm: () 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 20 zonegroup default 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.078+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4c640 con 0x7fcf5000d3d0 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5eee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4e420 con 0x5651b6d49320 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5eee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:13.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4e780 con 0x5651b6d49320 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5eee4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5eee4800 20 started sync module instance, tier type = 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5eee4800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.079+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4dd00 con 0x7fcf4c078060 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.080+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf50006070 con 0x7fcf4c078060 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.080+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94908957318992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4e0b0 con 0x7fcf4c078060 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.080+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4f020 con 0x5651b6d43200 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.081+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94908957318992] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf50006070 con 0x7fcf4c078060 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.082+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.082+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94908959742048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4f020 con 0x5651b6d43200 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.082+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4fa90 con 0x5651b6d49320 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.083+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94908959742048] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.083+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.083+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94908959746944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d4ef90 con 0x5651b6d49320 2023-12-07T21:10:13.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.083+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d507c0 con 0x7fcf4c078060 2023-12-07T21:10:13.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.084+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94908959746944] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.084+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf50026040 con 0x7fcf4c078060 2023-12-07T21:10:13.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.084+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94908959752048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d51010 con 0x7fcf4c078060 2023-12-07T21:10:13.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.084+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d51810 con 0x5651b6d43200 2023-12-07T21:10:13.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.085+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.085+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94908959757440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d52060 con 0x5651b6d43200 2023-12-07T21:10:13.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.085+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d52a10 con 0x7fcf5000d3d0 2023-12-07T21:10:13.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.086+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94908959757440] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.086+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94908959752048] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf50026040 con 0x7fcf4c078060 2023-12-07T21:10:13.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.087+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.087+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94908959755120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d51b50 con 0x7fcf5000d3d0 2023-12-07T21:10:13.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.087+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d53290 con 0x7fcf5000d3d0 2023-12-07T21:10:13.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.088+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94908959755120] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.088+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.088+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94908959761712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d51b50 con 0x7fcf5000d3d0 2023-12-07T21:10:13.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.088+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d53730 con 0x7fcf5000d3d0 2023-12-07T21:10:13.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.089+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94908959761712] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.089+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.089+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94908959763808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d53610 con 0x7fcf5000d3d0 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.089+0000 7fcf5eee4800 20 add_watcher() i=0 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.089+0000 7fcf5eee4800 20 add_watcher() i=1 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.089+0000 7fcf5eee4800 20 add_watcher() i=2 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.089+0000 7fcf5eee4800 20 add_watcher() i=3 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.089+0000 7fcf5eee4800 20 add_watcher() i=4 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.089+0000 7fcf5eee4800 20 add_watcher() i=5 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.089+0000 7fcf5eee4800 20 add_watcher() i=6 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.090+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94908959763808] v33'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.090+0000 7fcf5eee4800 20 add_watcher() i=7 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.090+0000 7fcf5eee4800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.090+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d569d0 con 0x5651b6d43200 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.090+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.090 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.090+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94908959765312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d53ee0 con 0x5651b6d43200 2023-12-07T21:10:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.091+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94908959765312] v33'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.091+0000 7fcf22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:13.091 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.091+0000 7fcf5eee4800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:13.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.091+0000 7fcf5eee4800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:13.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.091+0000 7fcf5eee4800 5 note: GC not initialized 2023-12-07T21:10:13.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.091+0000 7fcf21fe3640 20 reqs_thread_entry: start 2023-12-07T21:10:13.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.091+0000 7fcf5eee4800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:13.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.092+0000 7fcf5eee4800 20 Filter name: none 2023-12-07T21:10:13.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.092+0000 7fce937fe640 20 reqs_thread_entry: start 2023-12-07T21:10:13.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.092+0000 7fcf5eee4800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2023-12-07T21:10:13.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.092+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.093 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.092+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d899f0 con 0x7fcf5000d3d0 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.092+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(62 bar [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.092+0000 7fcf5eee4800 20 rados_obj.operate() r=0 bl.length=346 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.092+0000 7fcf5eee4800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.092+0000 7fcf5eee4800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.092+0000 7fcf5eee4800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.092+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d8d5e0 con 0x7fcf4c078060 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.093+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(63 bud [create,call,writefull 0~181] v33'1 uv1 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fcf50026040 con 0x7fcf4c078060 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.093+0000 7fcf5eee4800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.093+0000 7fcf5eee4800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.093+0000 7fcf5eee4800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.093+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94908959998864 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d8cfe0 con 0x7fcf5000d3d0 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.094+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== watch-notify(notify (1) cookie 94908959755120 notify 141733920802 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x7fcf54057040 con 0x7fcf5000d3d0 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.094+0000 7fcf43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 94908959755120 notifier 4654 bl.length()=357 2023-12-07T21:10:13.094 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.094+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(64 notify.5 [notify cookie 94908959998864 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.094+0000 7fcf43fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.094+0000 7fcf43fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.094+0000 7fcf43fff640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcf300042a0 con 0x7fcf5000d3d0 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.094+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.094+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== watch-notify(notify_complete (2) cookie 94908959998864 notify 141733920802 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5651b6d384b0 con 0x7fcf5000d3d0 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.094+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d8cee0 con 0x5651b6d43200 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5eee4800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 : miss 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 8.16 8:69c108b0:root::.bucket.meta.myfoo6%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d8b820 con 0x5651b6d49320 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(67 .bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5eee4800 20 rados_obj.operate() r=0 bl.length=353 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5eee4800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 info.flags=0x17 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5eee4800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 to cache LRU end 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5eee4800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:10:13.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5eee4800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5eee4800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.095+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:68 8.16 8:69c108b0:root::.bucket.meta.myfoo6%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d95db0 con 0x5651b6d49320 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.096+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(68 .bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 [delete,create,call,call,writefull 0~353,setxattr (117)] v33'2 uv2 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.096+0000 7fcf5eee4800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 info.flags=0x17 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.096+0000 7fcf5eee4800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 to cache LRU end 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.096+0000 7fcf5eee4800 10 updating xattr: name=user.rgw.acl bl.length()=117 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.096+0000 7fcf5eee4800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9, ofs0, ns] 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.096+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94908959998864 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90060 con 0x7fcf4c078060 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== watch-notify(notify (1) cookie 94908957318992 notify 141733920790 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x5651b6bc2740 con 0x7fcf4c078060 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920790 cookie 94908957318992 notifier 4654 bl.length()=721 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(69 notify.0 [notify cookie 94908959998864 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcf50026040 con 0x7fcf4c078060 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf43fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 info.flags=0x17 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf43fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 to cache LRU end 2023-12-07T21:10:13.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf43fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2023-12-07T21:10:13.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf43fff640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcf300042a0 con 0x7fcf4c078060 2023-12-07T21:10:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== watch-notify(notify_complete (2) cookie 94908959998864 notify 141733920790 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcf5000e570 con 0x7fcf4c078060 2023-12-07T21:10:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(70 notify.0 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf50026040 con 0x7fcf4c078060 2023-12-07T21:10:13.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf5eee4800 20 handle_bi_update(): bucket=:myfoo6[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9]): orig_sources= new_sources= 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf5eee4800 20 handle_bi_update(): bucket=:myfoo6[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9]): potential sources added=[] removed=[] 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf5eee4800 20 handle_bi_update(): bucket=:myfoo6[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9]): orig_dests= new_dests= 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf5eee4800 20 handle_bi_update(): bucket=:myfoo6[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9]): potential dests added=[] removed=[] 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.097+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d903c0 con 0x5651b6d43200 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.098+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(71 bud.buckets [call] v33'3 uv0 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.098+0000 7fcf5eee4800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.098+0000 7fcf5eee4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.098+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d903c0 con 0x5651b6d43200 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.098+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(72 myfoo6 [call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 234+0+289 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.098+0000 7fcf5eee4800 20 rados_obj.operate() r=0 bl.length=166 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.098+0000 7fcf5eee4800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.098+0000 7fcf5eee4800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2023-12-07T21:10:13.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.098+0000 7fcf5eee4800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.098+0000 7fcf5eee4800 0 bucket entry point user mismatch, can't unlink bucket: bar != bud 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.099+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:73 4.3c 4:3c1f8b39:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d903c0 con 0x5651b6d43200 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.099+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(73 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.0 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.099+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 4.18 4:1ac3e722:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d903c0 con 0x7fcf4c078060 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.099+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(74 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.1 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcf50026040 con 0x7fcf4c078060 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.099+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 4.2a 4:55095488:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d907b0 con 0x5651b6d43200 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.099+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(75 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.2 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.099+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:76 4.16 4:6a7b480a:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d907b0 con 0x5651b6d49320 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.100+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(76 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.100+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:77 4.3d 4:bc01f47f:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d907b0 con 0x7fcf4c078060 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.100+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(77 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcf50026040 con 0x7fcf4c078060 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.100+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:78 4.25 4:a672a828:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d907b0 con 0x5651b6d49320 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.100+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(78 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.5 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.100+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 4.2e 4:759a0aa8:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d907b0 con 0x5651b6d49320 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.101+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.6 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.103 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.101+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:80 4.1c 4:3bfd4962:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d907b0 con 0x7fcf5000d3d0 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.101+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(80 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.7 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.101+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 4.9 4:90372147:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90720 con 0x5651b6d43200 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.102+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.8 [call out=85b] v0'0 uv21 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.102+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:82 4.32 4:4e81e049:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90740 con 0x5651b6d43200 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.102+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(82 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.9 [call out=377b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+377 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.102+0000 7fcf5eee4800 10 cls_bucket_list_unordered: got thirteen 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.102+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 4.3f 4:fe13d7ed:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90740 con 0x7fcf4c078060 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.102+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(83 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.10 [call out=85b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fcf50026040 con 0x7fcf4c078060 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.102+0000 7fcf5eee4800 20 get_obj_state: octx=0x7fcf50001750 obj=myfoo6:thirteen state=0x5651b6d8a7b8 s->prefetch_data=0 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.102+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:84 3.1es0 3:794cf2f7:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90740 con 0x7fcf5000d3d0 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(84 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 238+0+870 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 10 manifest: total_size = 8 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 20 get_obj_state: setting s->obj_tag to ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7664296698053525919 2023-12-07T21:10:13.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 20 Read xattr rgw_rados: user.rgw.acl 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 20 Read xattr rgw_rados: user.rgw.content_type 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 20 Read xattr rgw_rados: user.rgw.etag 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 20 Read xattr rgw_rados: user.rgw.idtag 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 20 Read xattr rgw_rados: user.rgw.manifest 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 20 Read xattr rgw_rados: user.rgw.pg_ver 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 20 Read xattr rgw_rados: user.rgw.source_zone 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 20 Read xattr rgw_rados: user.rgw.tail_tag 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 20 get_obj_state: octx=0x7fcf50001750 obj=myfoo6:thirteen state=0x5651b6d8a7b8 s->prefetch_data=0 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 : hit (requested=0x17, cached=0x17) 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 20 bucket index object: :.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.9 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.103+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:85 4.32 4:4e81e049:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d93b90 con 0x5651b6d43200 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.104+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(85 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.9 [stat,call,call] v33'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.104+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:86 3.1es0 3:794cf2f7:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d93b90 con 0x7fcf5000d3d0 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.105+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(86 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v33'2 uv2 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.105+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:87 4.32 4:4e81e049:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d99460 con 0x5651b6d43200 2023-12-07T21:10:13.105 INFO:teuthology.orchestra.run.smithi121.stderr:1 objects processed in :myfoo6[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9]). Next marker thirteen 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.105+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:88 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d8a110 con 0x7fcf4c078060 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.106+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(88 bud [delete,create,call,writefull 0~346] v33'2 uv2 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fcf50026040 con 0x7fcf4c078060 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf5eee4800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf5eee4800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf5eee4800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:89 7.3 7:c609908c:::notify.5:head [notify cookie 94908959998864 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d8a110 con 0x7fcf5000d3d0 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== watch-notify(notify (1) cookie 94908959755120 notify 141733920803 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7fcf54065000 con 0x7fcf5000d3d0 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 94908959755120 notifier 4654 bl.length()=522 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf43fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf43fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(89 notify.5 [notify cookie 94908959998864 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf43fff640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcf30004600 con 0x7fcf5000d3d0 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(90 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== watch-notify(notify_complete (2) cookie 94908959998864 notify 141733920803 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcf54060040 con 0x7fcf5000d3d0 2023-12-07T21:10:13.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.107+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:91 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d8a110 con 0x5651b6d43200 2023-12-07T21:10:13.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.152+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(87 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.9.9 [stat,call,call] v33'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.152+0000 7fcf43fff640 20 handle_completion(): completion ok for obj=thirteen 2023-12-07T21:10:13.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.152+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(91 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.152+0000 7fcf5eee4800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-12-07T21:10:13.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.152+0000 7fcf5eee4800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-07T21:10:13.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.152+0000 7fcf5eee4800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2023-12-07T21:10:13.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.152+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 7.3 7:c609908c:::notify.5:head [notify cookie 94908959998864 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d8a110 con 0x7fcf5000d3d0 2023-12-07T21:10:13.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.152+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== watch-notify(notify (1) cookie 94908959755120 notify 141733920804 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7fcf54060040 con 0x7fcf5000d3d0 2023-12-07T21:10:13.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.152+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 30 ==== osd_op_reply(92 notify.5 [notify cookie 94908959998864 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.146 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.152+0000 7fcf437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920804 cookie 94908959755120 notifier 4654 bl.length()=177 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf437fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf437fe640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcea0003400 con 0x7fcf5000d3d0 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 31 ==== watch-notify(notify_complete (2) cookie 94908959998864 notify 141733920804 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5651b6d384b0 con 0x7fcf5000d3d0 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 32 ==== osd_op_reply(93 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf5eee4800 10 removing user index: bar 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf5eee4800 10 removing default.rgw.meta+users.uid+bar from cache 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf5eee4800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:94 7.9 7:93e5b521:::notify.7:head [notify cookie 94908959998864 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d8a110 con 0x7fcf5000d3d0 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 33 ==== watch-notify(notify (1) cookie 94908959763808 notify 141733920805 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x5651b6d384b0 con 0x7fcf5000d3d0 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920805 cookie 94908959763808 notifier 4654 bl.length()=152 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 34 ==== osd_op_reply(94 notify.7 [notify cookie 94908959998864 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf437fe640 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:95 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fcea0003400 con 0x7fcf5000d3d0 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 35 ==== osd_op_reply(95 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 36 ==== watch-notify(notify_complete (2) cookie 94908959998864 notify 141733920805 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5651b6d38050 con 0x7fcf5000d3d0 2023-12-07T21:10:13.147 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.153+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:96 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d8a110 con 0x7fcf5000d3d0 2023-12-07T21:10:13.148 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.155+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 37 ==== osd_op_reply(96 bar [delete] v33'6 uv6 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.148 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:10:13.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.155+0000 7fcf22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:13.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.155+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94908959765312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d728b0 con 0x5651b6d43200 2023-12-07T21:10:13.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.156+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94908959765312] v33'213 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.149 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.156+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94908957318992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d728b0 con 0x7fcf4c078060 2023-12-07T21:10:13.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.157+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94908957318992] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf50026040 con 0x7fcf4c078060 2023-12-07T21:10:13.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.157+0000 7fcf5eee4800 20 remove_watcher() i=0 2023-12-07T21:10:13.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.157+0000 7fcf5eee4800 2 removed watcher, disabling cache 2023-12-07T21:10:13.150 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.157+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94908959742048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90060 con 0x5651b6d43200 2023-12-07T21:10:13.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.159+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94908959742048] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.159+0000 7fcf5eee4800 20 remove_watcher() i=1 2023-12-07T21:10:13.151 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.159+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94908959746944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90060 con 0x5651b6d49320 2023-12-07T21:10:13.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.160+0000 7fcf5c9eb640 1 -- 172.21.15.121:0/2167766567 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94908959746944] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf4c083070 con 0x5651b6d49320 2023-12-07T21:10:13.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.160+0000 7fcf5eee4800 20 remove_watcher() i=2 2023-12-07T21:10:13.152 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.160+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94908959752048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90060 con 0x7fcf4c078060 2023-12-07T21:10:13.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.161+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94908959752048] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf50026040 con 0x7fcf4c078060 2023-12-07T21:10:13.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.161+0000 7fcf5eee4800 20 remove_watcher() i=3 2023-12-07T21:10:13.153 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.161+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94908959757440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90060 con 0x5651b6d43200 2023-12-07T21:10:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.162+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94908959757440] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x5651b6d43200 2023-12-07T21:10:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.162+0000 7fcf5eee4800 20 remove_watcher() i=4 2023-12-07T21:10:13.154 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.162+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94908959755120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90060 con 0x7fcf5000d3d0 2023-12-07T21:10:13.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.163+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 38 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94908959755120] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.163+0000 7fcf5eee4800 20 remove_watcher() i=5 2023-12-07T21:10:13.155 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.163+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94908959761712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90060 con 0x7fcf5000d3d0 2023-12-07T21:10:13.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.164+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 39 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94908959761712] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.164+0000 7fcf5eee4800 20 remove_watcher() i=6 2023-12-07T21:10:13.156 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.164+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94908959763808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5651b6d90060 con 0x7fcf5000d3d0 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5d1ec640 1 -- 172.21.15.121:0/2167766567 <== osd.0 v2:172.21.15.89:6800/654939948 40 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94908959763808] v33'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcf5402ec20 con 0x7fcf5000d3d0 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 20 remove_watcher() i=7 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fcf5000d3d0 msgr2=0x7fcf5000d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fcf5000d3d0 0x7fcf5000d830 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5651b6d43200 msgr2=0x5651b6d456c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5651b6d43200 0x5651b6d456c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fcf4c078060 msgr2=0x7fcf4c05bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fcf4c078060 0x7fcf4c05bab0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5651b6d49320 msgr2=0x5651b6d4b790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5651b6d49320 0x5651b6d4b790 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fcf380360c0 msgr2=0x7fcf38038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fcf380360c0 0x7fcf38038580 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcf50000f60 tx=0x7fcf50001230 comp rx=0 tx=0).stop 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 msgr2=0x5651b6d37b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6d37b10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400ae40 tx=0x7fcf54003370 comp rx=0 tx=0).stop 2023-12-07T21:10:13.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5c1ea640 1 -- 172.21.15.121:0/2167766567 reap_dead start 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 shutdown_connections 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/2167766567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77040 0x5651b6d37b10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 >> 172.21.15.121:0/2167766567 conn(0x5651b6c781b0 msgr2=0x5651b6d28bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 shutdown_connections 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.165+0000 7fcf5eee4800 1 -- 172.21.15.121:0/2167766567 wait complete. 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.166+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1441832102 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fcf48036110 msgr2=0x7fcf480385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.166+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/1441832102 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fcf48036110 0x7fcf480385d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c052f70 tx=0x7fcf4c052f00 comp rx=0 tx=0).stop 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.166+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1441832102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 msgr2=0x5651b6d22720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.166+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/1441832102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d22720 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c05e040 tx=0x7fcf4c002fb0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.166+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1441832102 shutdown_connections 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.166+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/1441832102 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fcf48036110 0x7fcf480385d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.166+0000 7fcf5eee4800 1 --2- 172.21.15.121:0/1441832102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5651b6c77850 0x5651b6d22720 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.166+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1441832102 >> 172.21.15.121:0/1441832102 conn(0x5651b6c6ff70 msgr2=0x5651b6d1a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.166+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1441832102 shutdown_connections 2023-12-07T21:10:13.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:13.166+0000 7fcf5eee4800 1 -- 172.21.15.121:0/1441832102 wait complete. 2023-12-07T21:10:13.161 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:10:18.168 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:10:18.169 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2023-12-07T21:10:18.169 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2023-12-07T21:10:18.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2023-12-07T21:10:18.169 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2023-12-07T21:10:18.227 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:18.227 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:18.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.236+0000 7fd68f7dc800 1 Processor -- start 2023-12-07T21:10:18.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.236+0000 7fd68f7dc800 1 -- start start 2023-12-07T21:10:18.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.236+0000 7fd68f7dc800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55835b1e66e0 0x55835b1ef1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.236+0000 7fd68f7dc800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55835b132740 con 0x55835b1e4ba0 2023-12-07T21:10:18.228 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.236+0000 7fd68f7dc800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55835b0fb880 con 0x55835b1e66e0 2023-12-07T21:10:18.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.236+0000 7fd68cae2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55835b1e66e0 0x55835b1ef1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.236+0000 7fd68d2e3640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55835b1e4ba0 0x55835b1e4fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:58646/0 (socket says 172.21.15.121:58646) 2023-12-07T21:10:18.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.236+0000 7fd68d2e3640 1 -- 172.21.15.121:0/1230552791 learned_addr learned my addr 172.21.15.121:0/1230552791 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:18.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.237+0000 7fd68cae2640 1 -- 172.21.15.121:0/1230552791 >> v1:172.21.15.89:6789/0 conn(0x55835b1e4ba0 legacy=0x55835b1e4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.229 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.237+0000 7fd68cae2640 1 -- 172.21.15.121:0/1230552791 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55835b15a3f0 con 0x55835b1e66e0 2023-12-07T21:10:18.231 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.239+0000 7fd68cae2640 1 --2- 172.21.15.121:0/1230552791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e66e0 0x55835b1ef1e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd67800a470 tx=0x7fd67801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0e56f6a6a6ffe3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.239+0000 7fd687fff640 1 -- 172.21.15.121:0/1230552791 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd67804ad40 con 0x55835b1e66e0 2023-12-07T21:10:18.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.239+0000 7fd687fff640 1 -- 172.21.15.121:0/1230552791 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678052440 con 0x55835b1e66e0 2023-12-07T21:10:18.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.239+0000 7fd687fff640 1 -- 172.21.15.121:0/1230552791 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd67804aea0 con 0x55835b1e66e0 2023-12-07T21:10:18.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.239+0000 7fd68f7dc800 1 -- 172.21.15.121:0/1230552791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e66e0 msgr2=0x55835b1ef1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.239+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/1230552791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e66e0 0x55835b1ef1e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd67800a470 tx=0x7fd67801cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:18.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.239+0000 7fd68f7dc800 1 -- 172.21.15.121:0/1230552791 shutdown_connections 2023-12-07T21:10:18.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.239+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/1230552791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e66e0 0x55835b1ef1e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.239+0000 7fd68f7dc800 1 -- 172.21.15.121:0/1230552791 >> 172.21.15.121:0/1230552791 conn(0x55835b1e0820 msgr2=0x55835b1e2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.239+0000 7fd68f7dc800 1 -- 172.21.15.121:0/1230552791 shutdown_connections 2023-12-07T21:10:18.232 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.240+0000 7fd68f7dc800 1 -- 172.21.15.121:0/1230552791 wait complete. 2023-12-07T21:10:18.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.240+0000 7fd68f7dc800 1 Processor -- start 2023-12-07T21:10:18.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.240+0000 7fd68f7dc800 1 -- start start 2023-12-07T21:10:18.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.240+0000 7fd68f7dc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b28d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.240+0000 7fd68f7dc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55835b0f8db0 con 0x55835b1e4ba0 2023-12-07T21:10:18.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.241+0000 7fd68d2e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b28d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.241+0000 7fd68d2e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b28d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60310/0 (socket says 172.21.15.121:60310) 2023-12-07T21:10:18.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.241+0000 7fd68d2e3640 1 -- 172.21.15.121:0/1691084441 learned_addr learned my addr 172.21.15.121:0/1691084441 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.241+0000 7fd68d2e3640 1 -- 172.21.15.121:0/1691084441 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678005d20 con 0x55835b1e4ba0 2023-12-07T21:10:18.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.241+0000 7fd68d2e3640 1 --2- 172.21.15.121:0/1691084441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b28d2b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd6800014a0 tx=0x7fd680001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bc4646ae62b6b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.242+0000 7fd6877fe640 1 -- 172.21.15.121:0/1691084441 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd680004520 con 0x55835b1e4ba0 2023-12-07T21:10:18.234 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.242+0000 7fd6877fe640 1 -- 172.21.15.121:0/1691084441 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd680004680 con 0x55835b1e4ba0 2023-12-07T21:10:18.235 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.242+0000 7fd6877fe640 1 -- 172.21.15.121:0/1691084441 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd680004980 con 0x55835b1e4ba0 2023-12-07T21:10:18.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.242+0000 7fd68f7dc800 1 -- 172.21.15.121:0/1691084441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 msgr2=0x55835b28d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.242+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/1691084441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b28d2b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd6800014a0 tx=0x7fd680001960 comp rx=0 tx=0).stop 2023-12-07T21:10:18.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.242+0000 7fd68f7dc800 1 -- 172.21.15.121:0/1691084441 shutdown_connections 2023-12-07T21:10:18.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.242+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/1691084441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b28d2b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.242+0000 7fd68f7dc800 1 -- 172.21.15.121:0/1691084441 >> 172.21.15.121:0/1691084441 conn(0x55835b1e0820 msgr2=0x55835b288f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.242+0000 7fd68f7dc800 1 -- 172.21.15.121:0/1691084441 shutdown_connections 2023-12-07T21:10:18.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.242+0000 7fd68f7dc800 1 -- 172.21.15.121:0/1691084441 wait complete. 2023-12-07T21:10:18.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.243+0000 7fd68f7dc800 1 Processor -- start 2023-12-07T21:10:18.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.243+0000 7fd68f7dc800 1 -- start start 2023-12-07T21:10:18.239 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.243+0000 7fd68f7dc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b2947f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.243+0000 7fd68f7dc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55835b0f46a0 con 0x55835b1e4ba0 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.243+0000 7fd68d2e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b2947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.243+0000 7fd68d2e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b2947f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60320/0 (socket says 172.21.15.121:60320) 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.243+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3364533128 learned_addr learned my addr 172.21.15.121:0/3364533128 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.243+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3364533128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55835b132740 con 0x55835b1e4ba0 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.243+0000 7fd68d2e3640 1 --2- 172.21.15.121:0/3364533128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b2947f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd680000f80 tx=0x7fd680001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.244+0000 7fd6867fc640 1 -- 172.21.15.121:0/3364533128 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd680013760 con 0x55835b1e4ba0 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.244+0000 7fd6867fc640 1 -- 172.21.15.121:0/3364533128 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6800138c0 con 0x55835b1e4ba0 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.244+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3364533128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55835b294d30 con 0x55835b1e4ba0 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.244+0000 7fd6867fc640 1 -- 172.21.15.121:0/3364533128 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd680013b80 con 0x55835b1e4ba0 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.244+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3364533128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55835b295210 con 0x55835b1e4ba0 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.244+0000 7fd68f7dc800 1 Processor -- start 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.244+0000 7fd68f7dc800 1 -- start start 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd68f7dc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 0x55835b2a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.240 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd68f7dc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55835b08e890 con 0x55835b2a0930 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd6867fc640 1 -- 172.21.15.121:0/3364533128 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fd680013ce0 con 0x55835b1e4ba0 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd6867fc640 1 --2- 172.21.15.121:0/3364533128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd670036110 0x7fd6700385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd68dae4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 0x55835b2a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd6867fc640 1 -- 172.21.15.121:0/3364533128 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fd68004ba20 con 0x55835b1e4ba0 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd68dae4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 0x55835b2a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60336/0 (socket says 172.21.15.121:60336) 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd68dae4640 1 -- 172.21.15.121:0/122221188 learned_addr learned my addr 172.21.15.121:0/122221188 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd68d2e3640 1 --2- 172.21.15.121:0/3364533128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd670036110 0x7fd6700385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd68dae4640 1 -- 172.21.15.121:0/122221188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55835b2a1290 con 0x55835b2a0930 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd68d2e3640 1 --2- 172.21.15.121:0/3364533128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd670036110 0x7fd6700385d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd680011ff0 tx=0x7fd680011f80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.245+0000 7fd68dae4640 1 --2- 172.21.15.121:0/122221188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 0x55835b2a0d50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd68800a400 tx=0x7fd68800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9031cff92bd4e86d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd66ffff640 1 -- 172.21.15.121:0/122221188 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd6880087e0 con 0x55835b2a0930 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd66ffff640 1 -- 172.21.15.121:0/122221188 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688008960 con 0x55835b2a0930 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd66ffff640 1 -- 172.21.15.121:0/122221188 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd688008c80 con 0x55835b2a0930 2023-12-07T21:10:18.241 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd68f7dc800 1 -- 172.21.15.121:0/122221188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 msgr2=0x55835b2a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/122221188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 0x55835b2a0d50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd68800a400 tx=0x7fd68800a8c0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd68f7dc800 1 -- 172.21.15.121:0/122221188 shutdown_connections 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/122221188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 0x55835b2a0d50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd68f7dc800 1 -- 172.21.15.121:0/122221188 >> 172.21.15.121:0/122221188 conn(0x55835b1e66e0 msgr2=0x55835b29bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd68f7dc800 1 -- 172.21.15.121:0/122221188 shutdown_connections 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd68f7dc800 1 -- 172.21.15.121:0/122221188 wait complete. 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd68f7dc800 1 Processor -- start 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.246+0000 7fd68f7dc800 1 -- start start 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.247+0000 7fd68f7dc800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 0x55835b2a7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.247+0000 7fd68f7dc800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55835b08e530 con 0x55835b2a0930 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.247+0000 7fd68dae4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 0x55835b2a7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.247+0000 7fd68dae4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 0x55835b2a7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60346/0 (socket says 172.21.15.121:60346) 2023-12-07T21:10:18.242 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.247+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 learned_addr learned my addr 172.21.15.121:0/3396774773 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.247+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd688005c90 con 0x55835b2a0930 2023-12-07T21:10:18.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.247+0000 7fd68dae4640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 0x55835b2a7970 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd68800a900 tx=0x7fd688002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.248+0000 7fd66e7fc640 1 -- 172.21.15.121:0/3396774773 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd688013780 con 0x55835b2a0930 2023-12-07T21:10:18.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.248+0000 7fd66e7fc640 1 -- 172.21.15.121:0/3396774773 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6880138e0 con 0x55835b2a0930 2023-12-07T21:10:18.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.248+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55835b2a7eb0 con 0x55835b2a0930 2023-12-07T21:10:18.250 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.248+0000 7fd66e7fc640 1 -- 172.21.15.121:0/3396774773 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd688013b80 con 0x55835b2a0930 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.248+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55835b2a8370 con 0x55835b2a0930 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.248+0000 7fd66e7fc640 1 -- 172.21.15.121:0/3396774773 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fd68801e420 con 0x55835b2a0930 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.249+0000 7fd66e7fc640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd6680360c0 0x7fd668038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.249+0000 7fd66e7fc640 1 -- 172.21.15.121:0/3396774773 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fd68804b7d0 con 0x55835b2a0930 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.249+0000 7fd68cae2640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd6680360c0 0x7fd668038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.249+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.249+0000 7fd68cae2640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd6680360c0 0x7fd668038580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd678054000 tx=0x7fd67804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.249+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55835b2b3060 0x55835b2b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.249+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2b5c70 con 0x55835b2b3060 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.249+0000 7fd68dae4640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55835b2b3060 0x55835b2b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68dae4640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55835b2b3060 0x55835b2b5520 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68f7dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68f7dc800 20 realm 2023-12-07T21:10:18.251 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2b6080 con 0x55835b2b3060 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68f7dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68f7dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2b6900 con 0x55835b2b3060 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68f7dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.250+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2b6c60 con 0x55835b2b3060 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.251+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.251+0000 7fd68f7dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.251+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.251+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2b7460 con 0x55835b2b3060 2023-12-07T21:10:18.252 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.251+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.251+0000 7fd68f7dc800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.251+0000 7fd68f7dc800 20 searching for the correct realm 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.251+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55835b2b9180 0x55835b2bb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.251+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b9180 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.251+0000 7fd68d2e3640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55835b2b9180 0x55835b2bb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.252+0000 7fd68d2e3640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55835b2b9180 0x55835b2bb5f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.252+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.252+0000 7fd68d2e3640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd68004b0e0 0x7fd680032400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.252+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd68004b0e0 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.252+0000 7fd68cae2640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd68004b0e0 0x7fd680032400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.252+0000 7fd68cae2640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd68004b0e0 0x7fd680032400 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.253+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd678059040 con 0x7fd68004b0e0 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.253+0000 7fd68cae2640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd67805c440 0x7fd67805c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.253 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.253+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd67805c440 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.253+0000 7fd68dae4640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd67805c440 0x7fd67805c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.253+0000 7fd68dae4640 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd67805c440 0x7fd67805c860 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.254+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.254+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b3060 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.254+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.254+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b3060 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.254+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.254+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd67805c440 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.254+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.254+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd67805c440 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.255+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.255+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd68004b0e0 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.255+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd678066040 con 0x7fd68004b0e0 2023-12-07T21:10:18.254 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.255+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b9180 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.255+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.255+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b3060 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.256+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.256+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd67805c440 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.256+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.256+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b3060 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.256+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.256+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd68004b0e0 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.256+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fd678066040 con 0x7fd68004b0e0 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.256+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b9180 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.257+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.257+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b9180 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.257+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.255 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.257+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd67805c440 2023-12-07T21:10:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.257+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.257+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b9180 2023-12-07T21:10:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.257+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.257+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b9180 2023-12-07T21:10:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.258+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.258+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b3060 2023-12-07T21:10:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.258+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.258+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b3060 2023-12-07T21:10:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.258+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.256 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.258+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd67805c440 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.258+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.258+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b9180 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.259+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.259+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd68004b0e0 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.259+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd678066040 con 0x7fd68004b0e0 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.259+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b3060 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.259+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.259+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd67805c440 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.259+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.259+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b9180 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.260+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.263 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.260+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd67805c440 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.260+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.260+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd68004b0e0 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.260+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd678066040 con 0x7fd68004b0e0 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.260+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b9180 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.260+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.260+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x7fd67805c440 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bbcc0 con 0x55835b2b3060 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd688053080 con 0x7fd68004b0e0 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd678066040 con 0x7fd68004b0e0 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68f7dc800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68f7dc800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68f7dc800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:18.264 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68f7dc800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68f7dc800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68f7dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.261+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2b7d90 con 0x55835b2b3060 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2b7a10 con 0x55835b2b3060 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2b8660 con 0x55835b2b9180 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:18.265 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 20 zone default found 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 4 Realm: () 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 20 zonegroup default 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bc100 con 0x7fd67805c440 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.262+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68f7dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bdf80 con 0x55835b2b9180 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68f7dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.266 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2be2e0 con 0x55835b2b9180 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68f7dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68f7dc800 20 started sync module instance, tier type = 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68f7dc800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.263+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bd550 con 0x7fd68004b0e0 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.264+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd678066040 con 0x7fd68004b0e0 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.264+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94022656253776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bd940 con 0x7fd68004b0e0 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.264+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2beae0 con 0x55835b2b3060 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.265+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94022656253776] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd678066040 con 0x7fd68004b0e0 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.266+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.266+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94022658674864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2beae0 con 0x55835b2b3060 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.266+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bf4d0 con 0x55835b2b9180 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.267+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94022658674864] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.267+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.267 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.267+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94022658680384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2bea50 con 0x55835b2b9180 2023-12-07T21:10:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.267+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c01f0 con 0x7fd68004b0e0 2023-12-07T21:10:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.268+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd678066040 con 0x7fd68004b0e0 2023-12-07T21:10:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.268+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94022658688416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c0e50 con 0x7fd68004b0e0 2023-12-07T21:10:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.268+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c17c0 con 0x55835b2b3060 2023-12-07T21:10:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.268+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94022658680384] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.269+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.270+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94022658688416] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd678066040 con 0x7fd68004b0e0 2023-12-07T21:10:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.270+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94022658691872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c1730 con 0x55835b2b3060 2023-12-07T21:10:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.270+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c09b0 con 0x7fd67805c440 2023-12-07T21:10:18.268 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.271+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94022658691872] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.271+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.271+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94022658693856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c09b0 con 0x7fd67805c440 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.271+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c2830 con 0x7fd67805c440 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.272+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.272+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94022658696080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c2c40 con 0x7fd67805c440 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.272+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c35f0 con 0x7fd67805c440 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.272+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94022658693856] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.273+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94022658696080] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.273+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.273+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94022658694896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c27a0 con 0x7fd67805c440 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.273+0000 7fd68f7dc800 20 add_watcher() i=0 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.274+0000 7fd68f7dc800 20 add_watcher() i=1 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.274+0000 7fd68f7dc800 20 add_watcher() i=2 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.274+0000 7fd68f7dc800 20 add_watcher() i=3 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.274+0000 7fd68f7dc800 20 add_watcher() i=4 2023-12-07T21:10:18.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.274+0000 7fd68f7dc800 20 add_watcher() i=5 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.274+0000 7fd68f7dc800 20 add_watcher() i=6 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.275+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94022658694896] v33'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.275+0000 7fd68f7dc800 20 add_watcher() i=7 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.275+0000 7fd68f7dc800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.275+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c27a0 con 0x55835b2b3060 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.275+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.275+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94022658699536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c27a0 con 0x55835b2b3060 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.276+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94022658699536] v33'214 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.276+0000 7fd652fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.276+0000 7fd68f7dc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.276+0000 7fd68f7dc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.276+0000 7fd68f7dc800 5 note: GC not initialized 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.276+0000 7fd651fe3640 20 reqs_thread_entry: start 2023-12-07T21:10:18.274 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.276+0000 7fd68f7dc800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 20 Filter name: none 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd5c37fe640 20 reqs_thread_entry: start 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2f94d0 con 0x7fd67805c440 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2f7c80 con 0x7fd67805c440 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2023-12-07T21:10:18.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.277+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2f8080 con 0x7fd67805c440 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v33'7 uv7 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd68f7dc800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd68f7dc800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd68f7dc800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94022658920240 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2fc920 con 0x7fd67805c440 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== watch-notify(notify (1) cookie 94022658693856 notify 141733920806 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x55835b2a8370 con 0x7fd67805c440 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd66ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920806 cookie 94022658693856 notifier 4660 bl.length()=522 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd66ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(65 notify.5 [notify cookie 94022658920240 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd66ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd66ffff640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd6600042a0 con 0x7fd67805c440 2023-12-07T21:10:18.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.279+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== watch-notify(notify_complete (2) cookie 94022658920240 notify 141733920806 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55835b2a7eb0 con 0x7fd67805c440 2023-12-07T21:10:18.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.280+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2fa900 con 0x7fd67805c440 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'9 uv9 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd68f7dc800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd68f7dc800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd68f7dc800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94022658920240 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2fa900 con 0x55835b2b9180 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== watch-notify(notify (1) cookie 94022658680384 notify 141733920774 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55835b295210 con 0x55835b2b9180 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd66ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94022658680384 notifier 4660 bl.length()=177 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd66ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd66ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(68 notify.2 [notify cookie 94022658920240 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd66ffff640 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fd6600042a0 con 0x55835b2b9180 2023-12-07T21:10:18.278 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.281+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.279 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.282+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== watch-notify(notify_complete (2) cookie 94022658920240 notify 141733920774 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fd68002d070 con 0x55835b2b9180 2023-12-07T21:10:18.279 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:10:18.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.282+0000 7fd652fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:18.280 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.282+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94022658699536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2afff0 con 0x55835b2b3060 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.283+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94022658699536] v33'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.283+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94022656253776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2f8890 con 0x7fd68004b0e0 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.284+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94022656253776] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd678066040 con 0x7fd68004b0e0 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.284+0000 7fd68f7dc800 20 remove_watcher() i=0 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.284+0000 7fd68f7dc800 2 removed watcher, disabling cache 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.284+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94022658674864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2afff0 con 0x55835b2b3060 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.286+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94022658674864] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.286+0000 7fd68f7dc800 20 remove_watcher() i=1 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.286+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94022658680384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2afff0 con 0x55835b2b9180 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.287+0000 7fd68d2e3640 1 -- 172.21.15.121:0/3396774773 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94022658680384] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd680024020 con 0x55835b2b9180 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.287+0000 7fd68f7dc800 20 remove_watcher() i=2 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.287+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94022658688416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2afff0 con 0x7fd68004b0e0 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.288+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94022658688416] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd678066040 con 0x7fd68004b0e0 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.288+0000 7fd68f7dc800 20 remove_watcher() i=3 2023-12-07T21:10:18.281 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.288+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94022658691872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2b0350 con 0x55835b2b3060 2023-12-07T21:10:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.289+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94022658691872] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x55835b2b3060 2023-12-07T21:10:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.289+0000 7fd68f7dc800 20 remove_watcher() i=4 2023-12-07T21:10:18.282 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.289+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94022658693856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2b0350 con 0x7fd67805c440 2023-12-07T21:10:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.291+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94022658693856] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.291+0000 7fd68f7dc800 20 remove_watcher() i=5 2023-12-07T21:10:18.283 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.291+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94022658696080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c1ae0 con 0x7fd67805c440 2023-12-07T21:10:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.292+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94022658696080] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.292+0000 7fd68f7dc800 20 remove_watcher() i=6 2023-12-07T21:10:18.284 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.292+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94022658694896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55835b2c1ae0 con 0x7fd67805c440 2023-12-07T21:10:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68dae4640 1 -- 172.21.15.121:0/3396774773 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94022658694896] v33'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fd688024070 con 0x7fd67805c440 2023-12-07T21:10:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 20 remove_watcher() i=7 2023-12-07T21:10:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd67805c440 msgr2=0x7fd67805c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fd67805c440 0x7fd67805c860 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55835b2b3060 msgr2=0x55835b2b5520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55835b2b3060 0x55835b2b5520 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd68004b0e0 msgr2=0x7fd680032400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fd68004b0e0 0x7fd680032400 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55835b2b9180 msgr2=0x55835b2bb5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55835b2b9180 0x55835b2bb5f0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd6680360c0 msgr2=0x7fd668038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd6680360c0 0x7fd668038580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd678054000 tx=0x7fd67804e000 comp rx=0 tx=0).stop 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 msgr2=0x55835b2a7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3396774773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b2a0930 0x55835b2a7970 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd68800a900 tx=0x7fd688002ff0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 reap_dead start 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68cae2640 1 -- 172.21.15.121:0/3396774773 reap_dead start 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 shutdown_connections 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 >> 172.21.15.121:0/3396774773 conn(0x55835b1e66e0 msgr2=0x55835b29ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 shutdown_connections 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.293+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3396774773 wait complete. 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.294+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3364533128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd670036110 msgr2=0x7fd6700385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.294+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3364533128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd670036110 0x7fd6700385d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd680011ff0 tx=0x7fd680011f80 comp rx=0 tx=0).stop 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.294+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3364533128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 msgr2=0x55835b2947f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.294+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3364533128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b2947f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd680000f80 tx=0x7fd680001250 comp rx=0 tx=0).stop 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.294+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3364533128 shutdown_connections 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.294+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3364533128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd670036110 0x7fd6700385d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.294+0000 7fd68f7dc800 1 --2- 172.21.15.121:0/3364533128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55835b1e4ba0 0x55835b2947f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.294+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3364533128 >> 172.21.15.121:0/3364533128 conn(0x55835b1e0820 msgr2=0x55835b28bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.294+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3364533128 shutdown_connections 2023-12-07T21:10:18.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.294+0000 7fd68f7dc800 1 -- 172.21.15.121:0/3364533128 wait complete. 2023-12-07T21:10:18.289 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:10:18.302 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:10:18.307 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2023-12-07T21:10:18.308 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2023-12-07T21:10:18.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2023-12-07T21:10:18.308 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2023-12-07T21:10:18.352 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:18.352 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:18.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.361+0000 7f8cae2e4800 1 Processor -- start 2023-12-07T21:10:18.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.361+0000 7f8cae2e4800 1 -- start start 2023-12-07T21:10:18.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.361+0000 7f8cae2e4800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5629ff08b850 0x5629ff08bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.361+0000 7f8cae2e4800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5629fefd6740 con 0x5629ff08c1b0 2023-12-07T21:10:18.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.361+0000 7f8cae2e4800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5629fef9f880 con 0x5629ff08b850 2023-12-07T21:10:18.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.361+0000 7f8cabde4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5629ff08b850 0x5629ff08bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.361+0000 7f8cab5e3640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5629ff08c1b0 0x5629ff0882d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:58648/0 (socket says 172.21.15.121:58648) 2023-12-07T21:10:18.354 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.361+0000 7f8cab5e3640 1 -- 172.21.15.121:0/3856226314 learned_addr learned my addr 172.21.15.121:0/3856226314 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:18.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.361+0000 7f8caade2640 1 -- 172.21.15.121:0/3856226314 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134831650 0 0) 0x5629fefd6740 con 0x5629ff08c1b0 2023-12-07T21:10:18.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.361+0000 7f8caade2640 1 -- 172.21.15.121:0/3856226314 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c98001e10 con 0x5629ff08c1b0 2023-12-07T21:10:18.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.362+0000 7f8cabde4640 1 -- 172.21.15.121:0/3856226314 >> v1:172.21.15.89:6789/0 conn(0x5629ff08c1b0 legacy=0x5629ff0882d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.355 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.362+0000 7f8cabde4640 1 -- 172.21.15.121:0/3856226314 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ff088b70 con 0x5629ff08b850 2023-12-07T21:10:18.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.363+0000 7f8cabde4640 1 --2- 172.21.15.121:0/3856226314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff08bc70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c005fd0 tx=0x7f8c9c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6893442396719046 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.364+0000 7f8caade2640 1 -- 172.21.15.121:0/3856226314 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c9c052560 con 0x5629ff08b850 2023-12-07T21:10:18.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.364+0000 7f8caade2640 1 -- 172.21.15.121:0/3856226314 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c0526c0 con 0x5629ff08b850 2023-12-07T21:10:18.356 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.364+0000 7f8caade2640 1 -- 172.21.15.121:0/3856226314 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c9c0529e0 con 0x5629ff08b850 2023-12-07T21:10:18.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.364+0000 7f8cae2e4800 1 -- 172.21.15.121:0/3856226314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 msgr2=0x5629ff08bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.364+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/3856226314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff08bc70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c005fd0 tx=0x7f8c9c01cab0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.364+0000 7f8cae2e4800 1 -- 172.21.15.121:0/3856226314 shutdown_connections 2023-12-07T21:10:18.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.364+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/3856226314 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff08bc70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.364+0000 7f8cae2e4800 1 -- 172.21.15.121:0/3856226314 >> 172.21.15.121:0/3856226314 conn(0x5629ff083f70 msgr2=0x5629ff086390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.358 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.364+0000 7f8cae2e4800 1 -- 172.21.15.121:0/3856226314 shutdown_connections 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.364+0000 7f8cae2e4800 1 -- 172.21.15.121:0/3856226314 wait complete. 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.365+0000 7f8cae2e4800 1 Processor -- start 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.365+0000 7f8cae2e4800 1 -- start start 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.365+0000 7f8cae2e4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff12f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.365+0000 7f8cae2e4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fef9cdb0 con 0x5629ff08b850 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.365+0000 7f8cabde4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff12f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.365+0000 7f8cabde4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff12f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60354/0 (socket says 172.21.15.121:60354) 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.365+0000 7f8cabde4640 1 -- 172.21.15.121:0/894473223 learned_addr learned my addr 172.21.15.121:0/894473223 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8cabde4640 1 -- 172.21.15.121:0/894473223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c00a100 con 0x5629ff08b850 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8cabde4640 1 --2- 172.21.15.121:0/894473223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff12f160 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c007000 tx=0x7f8c9c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07f05188456cb68 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8caa5e1640 1 -- 172.21.15.121:0/894473223 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c9c052960 con 0x5629ff08b850 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8caa5e1640 1 -- 172.21.15.121:0/894473223 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c052ac0 con 0x5629ff08b850 2023-12-07T21:10:18.359 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8caa5e1640 1 -- 172.21.15.121:0/894473223 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c9c052d60 con 0x5629ff08b850 2023-12-07T21:10:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8cae2e4800 1 -- 172.21.15.121:0/894473223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 msgr2=0x5629ff12f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/894473223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff12f160 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c007000 tx=0x7f8c9c04c000 comp rx=0 tx=0).stop 2023-12-07T21:10:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8cae2e4800 1 -- 172.21.15.121:0/894473223 shutdown_connections 2023-12-07T21:10:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/894473223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff12f160 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8cae2e4800 1 -- 172.21.15.121:0/894473223 >> 172.21.15.121:0/894473223 conn(0x5629ff083f70 msgr2=0x5629ff12add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8cae2e4800 1 -- 172.21.15.121:0/894473223 shutdown_connections 2023-12-07T21:10:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.366+0000 7f8cae2e4800 1 -- 172.21.15.121:0/894473223 wait complete. 2023-12-07T21:10:18.373 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.367+0000 7f8cae2e4800 1 Processor -- start 2023-12-07T21:10:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.367+0000 7f8cae2e4800 1 -- start start 2023-12-07T21:10:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.367+0000 7f8cae2e4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff1365f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.367+0000 7f8cae2e4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fef986a0 con 0x5629ff08b850 2023-12-07T21:10:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.367+0000 7f8cabde4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff1365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.367+0000 7f8cabde4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff1365f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60360/0 (socket says 172.21.15.121:60360) 2023-12-07T21:10:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.367+0000 7f8cabde4640 1 -- 172.21.15.121:0/175488488 learned_addr learned my addr 172.21.15.121:0/175488488 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.368+0000 7f8cabde4640 1 -- 172.21.15.121:0/175488488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ff088b70 con 0x5629ff08b850 2023-12-07T21:10:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.368+0000 7f8cabde4640 1 --2- 172.21.15.121:0/175488488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff1365f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c01d1e0 tx=0x7f8c9c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.368+0000 7f8ca95df640 1 -- 172.21.15.121:0/175488488 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c9c06c070 con 0x5629ff08b850 2023-12-07T21:10:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.368+0000 7f8ca95df640 1 -- 172.21.15.121:0/175488488 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c05cce0 con 0x5629ff08b850 2023-12-07T21:10:18.374 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.368+0000 7f8ca95df640 1 -- 172.21.15.121:0/175488488 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c9c070410 con 0x5629ff08b850 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.368+0000 7f8cae2e4800 1 -- 172.21.15.121:0/175488488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629ff136b30 con 0x5629ff08b850 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.368+0000 7f8cae2e4800 1 -- 172.21.15.121:0/175488488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629ff137070 con 0x5629ff08b850 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.368+0000 7f8cae2e4800 1 Processor -- start 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.368+0000 7f8cae2e4800 1 -- start start 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8cae2e4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 0x5629ff142b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8cae2e4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fef32890 con 0x5629ff142740 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8ca95df640 1 -- 172.21.15.121:0/175488488 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f8c9c0663f0 con 0x5629ff08b850 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8ca95df640 1 --2- 172.21.15.121:0/175488488 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8c8c036110 0x7f8c8c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8ca95df640 1 -- 172.21.15.121:0/175488488 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f8c9c08d760 con 0x5629ff08b850 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8cac5e5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 0x5629ff142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8cac5e5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 0x5629ff142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60368/0 (socket says 172.21.15.121:60368) 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8cac5e5640 1 -- 172.21.15.121:0/11915481 learned_addr learned my addr 172.21.15.121:0/11915481 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.375 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8cabde4640 1 --2- 172.21.15.121:0/175488488 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8c8c036110 0x7f8c8c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8cac5e5640 1 -- 172.21.15.121:0/11915481 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629ff1430a0 con 0x5629ff142740 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8cabde4640 1 --2- 172.21.15.121:0/175488488 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8c8c036110 0x7f8c8c0385d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c05cb00 tx=0x7f8c9c066f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.369+0000 7f8cac5e5640 1 --2- 172.21.15.121:0/11915481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 0x5629ff142b60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400a400 tx=0x7f8ca400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144fb542a8ce53c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8ca2ffd640 1 -- 172.21.15.121:0/11915481 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ca40087e0 con 0x5629ff142740 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8ca2ffd640 1 -- 172.21.15.121:0/11915481 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca4008960 con 0x5629ff142740 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8ca2ffd640 1 -- 172.21.15.121:0/11915481 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ca4008c80 con 0x5629ff142740 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8cae2e4800 1 -- 172.21.15.121:0/11915481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 msgr2=0x5629ff142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/11915481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 0x5629ff142b60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400a400 tx=0x7f8ca400a8c0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8cae2e4800 1 -- 172.21.15.121:0/11915481 shutdown_connections 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/11915481 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 0x5629ff142b60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8cae2e4800 1 -- 172.21.15.121:0/11915481 >> 172.21.15.121:0/11915481 conn(0x5629ff08c1b0 msgr2=0x5629ff13db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.376 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8cae2e4800 1 -- 172.21.15.121:0/11915481 shutdown_connections 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8cae2e4800 1 -- 172.21.15.121:0/11915481 wait complete. 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8cae2e4800 1 Processor -- start 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8cae2e4800 1 -- start start 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.370+0000 7f8cae2e4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 0x5629ff149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.371+0000 7f8cae2e4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fef32530 con 0x5629ff142740 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.371+0000 7f8cac5e5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 0x5629ff149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.371+0000 7f8cac5e5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 0x5629ff149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60370/0 (socket says 172.21.15.121:60370) 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.371+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 learned_addr learned my addr 172.21.15.121:0/224430250 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.371+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca4005c90 con 0x5629ff142740 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.371+0000 7f8cac5e5640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 0x5629ff149710 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c010 tx=0x7f8ca4002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.371+0000 7f8ca17fa640 1 -- 172.21.15.121:0/224430250 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ca4013840 con 0x5629ff142740 2023-12-07T21:10:18.377 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.371+0000 7f8ca17fa640 1 -- 172.21.15.121:0/224430250 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca40139a0 con 0x5629ff142740 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.371+0000 7f8ca17fa640 1 -- 172.21.15.121:0/224430250 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8ca4013c80 con 0x5629ff142740 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.371+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629ff149c50 con 0x5629ff142740 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.371+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629ff14a110 con 0x5629ff142740 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.372+0000 7f8ca17fa640 1 -- 172.21.15.121:0/224430250 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f8ca401e420 con 0x5629ff142740 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.372+0000 7f8ca17fa640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8c840360c0 0x7f8c84038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.372+0000 7f8ca17fa640 1 -- 172.21.15.121:0/224430250 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f8ca404b960 con 0x5629ff142740 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.372+0000 7f8cab5e3640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8c840360c0 0x7f8c84038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.373+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.373+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5629ff154e30 0x5629ff1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.373+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff157a40 con 0x5629ff154e30 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.373+0000 7f8cac5e5640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5629ff154e30 0x5629ff1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.373+0000 7f8cab5e3640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8c840360c0 0x7f8c84038580 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c94000f60 tx=0x7f8c940010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.378 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.373+0000 7f8cac5e5640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5629ff154e30 0x5629ff1572f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.373+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ca4024070 con 0x5629ff154e30 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.373+0000 7f8cae2e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.373+0000 7f8cae2e4800 20 realm 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.373+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.373+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff157e10 con 0x5629ff154e30 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ca4024070 con 0x5629ff154e30 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff158690 con 0x5629ff154e30 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ca4024070 con 0x5629ff154e30 2023-12-07T21:10:18.379 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff1589f0 con 0x5629ff154e30 2023-12-07T21:10:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8ca4024070 con 0x5629ff154e30 2023-12-07T21:10:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff1591f0 con 0x5629ff154e30 2023-12-07T21:10:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8ca4024070 con 0x5629ff154e30 2023-12-07T21:10:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 20 searching for the correct realm 2023-12-07T21:10:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5629ff15af10 0x5629ff15d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.380 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff15af10 2023-12-07T21:10:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.374+0000 7f8cabde4640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5629ff15af10 0x5629ff15d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.375+0000 7f8cabde4640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5629ff15af10 0x5629ff15d380 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.375+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.375+0000 7f8cabde4640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8c9c07a060 0x7f8c9c005040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.375+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9c07a060 2023-12-07T21:10:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.375+0000 7f8cab5e3640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8c9c07a060 0x7f8c9c005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.375+0000 7f8cab5e3640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8c9c07a060 0x7f8c9c005040 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.376+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.376+0000 7f8cab5e3640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8c9400d3d0 0x7f8c9400d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.376+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9400d3d0 2023-12-07T21:10:18.381 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.376+0000 7f8cac5e5640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8c9400d3d0 0x7f8c9400d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.376+0000 7f8cac5e5640 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8c9400d3d0 0x7f8c9400d830 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.377+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca4024070 con 0x7f8c9400d3d0 2023-12-07T21:10:18.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.377+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff154e30 2023-12-07T21:10:18.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.377+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca4024070 con 0x5629ff154e30 2023-12-07T21:10:18.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.377+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff154e30 2023-12-07T21:10:18.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.377+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca4024070 con 0x5629ff154e30 2023-12-07T21:10:18.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.377+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9400d3d0 2023-12-07T21:10:18.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.377+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca4024070 con 0x7f8c9400d3d0 2023-12-07T21:10:18.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.377+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9400d3d0 2023-12-07T21:10:18.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.378+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca4024070 con 0x7f8c9400d3d0 2023-12-07T21:10:18.382 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.378+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9c07a060 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.378+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.378+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff15af10 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.378+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.378+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff154e30 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.378+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca4024070 con 0x5629ff154e30 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.378+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9400d3d0 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.379+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.379+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff154e30 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.379+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.379+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9c07a060 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.379+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.383 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.379+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff15af10 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.379+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.379+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff15af10 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.380+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.380+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9400d3d0 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.380+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.380+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff15af10 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.380+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.380+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff15af10 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.380+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.380+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff154e30 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.381+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.384 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.381+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff154e30 2023-12-07T21:10:18.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.381+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.385 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.381+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9400d3d0 2023-12-07T21:10:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.381+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.381+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff15af10 2023-12-07T21:10:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.381+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.381+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9c07a060 2023-12-07T21:10:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.382+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.382+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff154e30 2023-12-07T21:10:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.382+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.382+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9400d3d0 2023-12-07T21:10:18.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.382+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.382+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff15af10 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.383+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.383+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9400d3d0 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.383+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.383+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9c07a060 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.383+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.383+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff15af10 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.383+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.383+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9400d3d0 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x5629ff154e30 2023-12-07T21:10:18.397 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15da50 con 0x7f8c9c07a060 2023-12-07T21:10:18.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cae2e4800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:18.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cae2e4800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:18.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cae2e4800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:18.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cae2e4800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:18.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cae2e4800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:18.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cae2e4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:18.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff159b50 con 0x5629ff154e30 2023-12-07T21:10:18.398 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cae2e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.384+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15a3a0 con 0x5629ff154e30 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15de90 con 0x5629ff15af10 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 20 zone default found 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 4 Realm: () 2023-12-07T21:10:18.399 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 20 zonegroup default 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15e1f0 con 0x7f8c9400d3d0 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.385+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15ffa0 con 0x5629ff15af10 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.386+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.386+0000 7f8cae2e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.400 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.386+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.386+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff1603a0 con 0x5629ff15af10 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.386+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.386+0000 7f8cae2e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.386+0000 7f8cae2e4800 20 started sync module instance, tier type = 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.386+0000 7f8cae2e4800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.386+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff15f880 con 0x7f8c9c07a060 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.387+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.387+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94738370862928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff1607c0 con 0x7f8c9c07a060 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.387+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff160fc0 con 0x5629ff154e30 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.388+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94738370862928] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.388+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.388+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94738373276640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff160fc0 con 0x5629ff154e30 2023-12-07T21:10:18.401 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.388+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff1617c0 con 0x5629ff15af10 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.390+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94738373276640] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.390+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.390+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94738373282864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff161b20 con 0x5629ff15af10 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.390+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff162490 con 0x7f8c9c07a060 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.391+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.391+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94738373289968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff1630a0 con 0x7f8c9c07a060 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.391+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff163a10 con 0x5629ff154e30 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.391+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94738373282864] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.392+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94738373289968] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.392+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.392+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94738373283904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff162d10 con 0x5629ff154e30 2023-12-07T21:10:18.402 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.392+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff1640c0 con 0x7f8c9400d3d0 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.393+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.393+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94738373294976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff164080 con 0x7f8c9400d3d0 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.393+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff164f20 con 0x7f8c9400d3d0 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.393+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94738373283904] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.394+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94738373294976] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.394+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.394+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94738373296256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff164490 con 0x7f8c9400d3d0 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.394+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff1653c0 con 0x7f8c9400d3d0 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.395+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v33'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.395+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94738373300000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff1657d0 con 0x7f8c9400d3d0 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.395+0000 7f8cae2e4800 20 add_watcher() i=0 2023-12-07T21:10:18.403 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.395+0000 7f8cae2e4800 20 add_watcher() i=1 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.395+0000 7f8cae2e4800 20 add_watcher() i=2 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.395+0000 7f8cae2e4800 20 add_watcher() i=3 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.395+0000 7f8cae2e4800 20 add_watcher() i=4 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.395+0000 7f8cae2e4800 20 add_watcher() i=5 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.395+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94738373296256] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.395+0000 7f8cae2e4800 20 add_watcher() i=6 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.396+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94738373300000] v33'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.396+0000 7f8cae2e4800 20 add_watcher() i=7 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.396+0000 7f8cae2e4800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.396+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff164a80 con 0x5629ff154e30 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.396+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.396+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94738373301040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff164a80 con 0x5629ff154e30 2023-12-07T21:10:18.404 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.397+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94738373301040] v33'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.398+0000 7f8c71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.398+0000 7f8cae2e4800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.398+0000 7f8cae2e4800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.398+0000 7f8cae2e4800 5 note: GC not initialized 2023-12-07T21:10:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.398+0000 7f8c70fe1640 20 reqs_thread_entry: start 2023-12-07T21:10:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.398+0000 7f8cae2e4800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.398+0000 7f8cae2e4800 20 Filter name: none 2023-12-07T21:10:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.398+0000 7f8bea7fc640 20 reqs_thread_entry: start 2023-12-07T21:10:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.398+0000 7f8cae2e4800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2023-12-07T21:10:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.398+0000 7f8cae2e4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.398+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff19b640 con 0x7f8c9c07a060 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.399+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(62 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.399+0000 7f8cae2e4800 20 rados_obj.operate() r=0 bl.length=346 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.399+0000 7f8cae2e4800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.399+0000 7f8cae2e4800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.399+0000 7f8cae2e4800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.399+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff19f5b0 con 0x7f8c9400d3d0 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.400+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 fud [create,call,writefull 0~181] v33'8 uv7 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.401+0000 7f8c71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.401+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94738373301040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff171be0 con 0x5629ff154e30 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.402+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94738373301040] v33'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.402+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94738370862928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff171be0 con 0x7f8c9c07a060 2023-12-07T21:10:18.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.403+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94738370862928] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.403+0000 7f8cae2e4800 20 remove_watcher() i=0 2023-12-07T21:10:18.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.403+0000 7f8cae2e4800 2 removed watcher, disabling cache 2023-12-07T21:10:18.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.403+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94738373276640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff199d90 con 0x5629ff154e30 2023-12-07T21:10:18.411 DEBUG:teuthology.orchestra.run:got remote process result: 17 2023-12-07T21:10:18.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.404+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94738373276640] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.404+0000 7f8cae2e4800 20 remove_watcher() i=1 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.404+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94738373282864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff199d90 con 0x5629ff15af10 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.405+0000 7f8cabde4640 1 -- 172.21.15.121:0/224430250 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94738373282864] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c9c0666a0 con 0x5629ff15af10 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.405+0000 7f8cae2e4800 20 remove_watcher() i=2 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.405+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94738373289968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff19a0f0 con 0x7f8c9c07a060 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.406+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94738373289968] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c94006070 con 0x7f8c9c07a060 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.406+0000 7f8cae2e4800 20 remove_watcher() i=3 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.406+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94738373283904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff19a0f0 con 0x5629ff154e30 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.407+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94738373283904] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x5629ff154e30 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.407+0000 7f8cae2e4800 20 remove_watcher() i=4 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.407+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94738373294976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff19a0f0 con 0x7f8c9400d3d0 2023-12-07T21:10:18.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.408+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94738373294976] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.408+0000 7f8cae2e4800 20 remove_watcher() i=5 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.408+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94738373296256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff163b80 con 0x7f8c9400d3d0 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.409+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94738373296256] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.409+0000 7f8cae2e4800 20 remove_watcher() i=6 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.409+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94738373300000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5629ff164080 con 0x7f8c9400d3d0 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.410+0000 7f8cac5e5640 1 -- 172.21.15.121:0/224430250 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94738373300000] v33'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8ca403b040 con 0x7f8c9400d3d0 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.410+0000 7f8cae2e4800 20 remove_watcher() i=7 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.410+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8c9400d3d0 msgr2=0x7f8c9400d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.410+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f8c9400d3d0 0x7f8c9400d830 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.410+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5629ff154e30 msgr2=0x5629ff1572f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.410+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5629ff154e30 0x5629ff1572f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.410+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8c9c07a060 msgr2=0x7f8c9c005040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.410+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f8c9c07a060 0x7f8c9c005040 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.410+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5629ff15af10 msgr2=0x5629ff15d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.410+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5629ff15af10 0x5629ff15d380 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8c840360c0 msgr2=0x7f8c84038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8c840360c0 0x7f8c84038580 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c94000f60 tx=0x7f8c940010a0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 msgr2=0x5629ff149710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/224430250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff142740 0x5629ff149710 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400c010 tx=0x7f8ca4002ff0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 reap_dead start 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cab5e3640 1 -- 172.21.15.121:0/224430250 reap_dead start 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 shutdown_connections 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 >> 172.21.15.121:0/224430250 conn(0x5629ff08c1b0 msgr2=0x5629ff13c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 shutdown_connections 2023-12-07T21:10:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/224430250 wait complete. 2023-12-07T21:10:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/175488488 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8c8c036110 msgr2=0x7f8c8c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/175488488 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8c8c036110 0x7f8c8c0385d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c05cb00 tx=0x7f8c9c066f90 comp rx=0 tx=0).stop 2023-12-07T21:10:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/175488488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 msgr2=0x5629ff1365f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/175488488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff1365f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c01d1e0 tx=0x7f8c9c003330 comp rx=0 tx=0).stop 2023-12-07T21:10:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/175488488 shutdown_connections 2023-12-07T21:10:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/175488488 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f8c8c036110 0x7f8c8c0385d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 --2- 172.21.15.121:0/175488488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5629ff08b850 0x5629ff1365f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/175488488 >> 172.21.15.121:0/175488488 conn(0x5629ff083f70 msgr2=0x5629ff12de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/175488488 shutdown_connections 2023-12-07T21:10:18.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.411+0000 7f8cae2e4800 1 -- 172.21.15.121:0/175488488 wait complete. 2023-12-07T21:10:18.421 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:10:18.421 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2023-12-07T21:10:18.428 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2023-12-07T21:10:18.428 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2023-12-07T21:10:18.428 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2023-12-07T21:10:18.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2023-12-07T21:10:18.428 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2023-12-07T21:10:18.471 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:18.471 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:18.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.480+0000 7f7508722800 1 Processor -- start 2023-12-07T21:10:18.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.480+0000 7f7508722800 1 -- start start 2023-12-07T21:10:18.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.480+0000 7f7508722800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b80d390550 0x55b80d392940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.480+0000 7f7508722800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b80d2d9740 con 0x55b80d38c110 2023-12-07T21:10:18.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.480+0000 7f7508722800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b80d2a2880 con 0x55b80d390550 2023-12-07T21:10:18.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.480+0000 7f7503ba5640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55b80d390550 0x55b80d392940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.480+0000 7f75043a6640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55b80d38c110 0x55b80d38c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:58656/0 (socket says 172.21.15.121:58656) 2023-12-07T21:10:18.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.480+0000 7f75043a6640 1 -- 172.21.15.121:0/684483676 learned_addr learned my addr 172.21.15.121:0/684483676 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:18.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.480+0000 7f7503ba5640 1 -- 172.21.15.121:0/684483676 >> v1:172.21.15.89:6789/0 conn(0x55b80d38c110 legacy=0x55b80d38c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.480+0000 7f7503ba5640 1 -- 172.21.15.121:0/684483676 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b80d393f70 con 0x55b80d390550 2023-12-07T21:10:18.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.482+0000 7f7503ba5640 1 --2- 172.21.15.121:0/684483676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d390550 0x55b80d392940 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f74f800a470 tx=0x7f74f801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1664488d4a1dba06 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.483+0000 7f75033a4640 1 -- 172.21.15.121:0/684483676 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74f8052570 con 0x55b80d390550 2023-12-07T21:10:18.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.483+0000 7f75033a4640 1 -- 172.21.15.121:0/684483676 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f80526d0 con 0x55b80d390550 2023-12-07T21:10:18.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.483+0000 7f75033a4640 1 -- 172.21.15.121:0/684483676 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74f8052990 con 0x55b80d390550 2023-12-07T21:10:18.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.483+0000 7f7508722800 1 -- 172.21.15.121:0/684483676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d390550 msgr2=0x55b80d392940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.483+0000 7f7508722800 1 --2- 172.21.15.121:0/684483676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d390550 0x55b80d392940 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f74f800a470 tx=0x7f74f801cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:18.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.483+0000 7f7508722800 1 -- 172.21.15.121:0/684483676 shutdown_connections 2023-12-07T21:10:18.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.483+0000 7f7508722800 1 --2- 172.21.15.121:0/684483676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d390550 0x55b80d392940 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.483+0000 7f7508722800 1 -- 172.21.15.121:0/684483676 >> 172.21.15.121:0/684483676 conn(0x55b80d387890 msgr2=0x55b80d389cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.483+0000 7f7508722800 1 -- 172.21.15.121:0/684483676 shutdown_connections 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.483+0000 7f7508722800 1 -- 172.21.15.121:0/684483676 wait complete. 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.484+0000 7f7508722800 1 Processor -- start 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.484+0000 7f7508722800 1 -- start start 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.484+0000 7f7508722800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d3011c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.484+0000 7f7508722800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b80d29fdb0 con 0x55b80d38c110 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.484+0000 7f75043a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d3011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.484+0000 7f75043a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d3011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60398/0 (socket says 172.21.15.121:60398) 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.484+0000 7f75043a6640 1 -- 172.21.15.121:0/2115631125 learned_addr learned my addr 172.21.15.121:0/2115631125 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f75043a6640 1 -- 172.21.15.121:0/2115631125 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f8005d20 con 0x55b80d38c110 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f75043a6640 1 --2- 172.21.15.121:0/2115631125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d3011c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0014d0 tx=0x7f74fc001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6abe2ec22d6356 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f7502ba3640 1 -- 172.21.15.121:0/2115631125 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74fc004520 con 0x55b80d38c110 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f7502ba3640 1 -- 172.21.15.121:0/2115631125 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc004680 con 0x55b80d38c110 2023-12-07T21:10:18.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f7502ba3640 1 -- 172.21.15.121:0/2115631125 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74fc004980 con 0x55b80d38c110 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f7508722800 1 -- 172.21.15.121:0/2115631125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 msgr2=0x55b80d3011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f7508722800 1 --2- 172.21.15.121:0/2115631125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d3011c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0014d0 tx=0x7f74fc001990 comp rx=0 tx=0).stop 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f7508722800 1 -- 172.21.15.121:0/2115631125 shutdown_connections 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f7508722800 1 --2- 172.21.15.121:0/2115631125 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d3011c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f7508722800 1 -- 172.21.15.121:0/2115631125 >> 172.21.15.121:0/2115631125 conn(0x55b80d387890 msgr2=0x55b80d42c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f7508722800 1 -- 172.21.15.121:0/2115631125 shutdown_connections 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.485+0000 7f7508722800 1 -- 172.21.15.121:0/2115631125 wait complete. 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.486+0000 7f7508722800 1 Processor -- start 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.486+0000 7f7508722800 1 -- start start 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.486+0000 7f7508722800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d439320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.486+0000 7f7508722800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b80d29b6a0 con 0x55b80d38c110 2023-12-07T21:10:18.485 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.486+0000 7f75043a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d439320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.486+0000 7f75043a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d439320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60402/0 (socket says 172.21.15.121:60402) 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.486+0000 7f75043a6640 1 -- 172.21.15.121:0/3354859869 learned_addr learned my addr 172.21.15.121:0/3354859869 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.486+0000 7f75043a6640 1 -- 172.21.15.121:0/3354859869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b80d2d9740 con 0x55b80d38c110 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.486+0000 7f75043a6640 1 --2- 172.21.15.121:0/3354859869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d439320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f74fc000f80 tx=0x7f74fc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.487+0000 7f7501ba1640 1 -- 172.21.15.121:0/3354859869 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74fc023030 con 0x55b80d38c110 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.487+0000 7f7501ba1640 1 -- 172.21.15.121:0/3354859869 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc013760 con 0x55b80d38c110 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.487+0000 7f7508722800 1 -- 172.21.15.121:0/3354859869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b80d439860 con 0x55b80d38c110 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.487+0000 7f7501ba1640 1 -- 172.21.15.121:0/3354859869 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74fc013a80 con 0x55b80d38c110 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.487+0000 7f7508722800 1 -- 172.21.15.121:0/3354859869 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b80d439ce0 con 0x55b80d38c110 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.487+0000 7f7508722800 1 Processor -- start 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.487+0000 7f7508722800 1 -- start start 2023-12-07T21:10:18.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.487+0000 7f7508722800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d445870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.487+0000 7f7508722800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b80d235890 con 0x55b80d445450 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.487+0000 7f7501ba1640 1 -- 172.21.15.121:0/3354859869 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f74fc026070 con 0x55b80d38c110 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f7501ba1640 1 --2- 172.21.15.121:0/3354859869 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f0036110 0x7f74f00385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f7501ba1640 1 -- 172.21.15.121:0/3354859869 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f74fc024070 con 0x55b80d38c110 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f75043a6640 1 --2- 172.21.15.121:0/3354859869 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f0036110 0x7f74f00385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f7504ba7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d445870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f7504ba7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d445870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60406/0 (socket says 172.21.15.121:60406) 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f7504ba7640 1 -- 172.21.15.121:0/4120752873 learned_addr learned my addr 172.21.15.121:0/4120752873 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f75043a6640 1 --2- 172.21.15.121:0/3354859869 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f0036110 0x7f74f00385d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f74fc011ff0 tx=0x7f74fc006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f7504ba7640 1 -- 172.21.15.121:0/4120752873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b80d445db0 con 0x55b80d445450 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f7504ba7640 1 --2- 172.21.15.121:0/4120752873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d445870 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f74f400a400 tx=0x7f74f400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ab030051fa9312 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f74eb7fe640 1 -- 172.21.15.121:0/4120752873 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74f40087e0 con 0x55b80d445450 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f74eb7fe640 1 -- 172.21.15.121:0/4120752873 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f4008960 con 0x55b80d445450 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.488+0000 7f74eb7fe640 1 -- 172.21.15.121:0/4120752873 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74f4008c80 con 0x55b80d445450 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7508722800 1 -- 172.21.15.121:0/4120752873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 msgr2=0x55b80d445870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7508722800 1 --2- 172.21.15.121:0/4120752873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d445870 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f74f400a400 tx=0x7f74f400a8c0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7508722800 1 -- 172.21.15.121:0/4120752873 shutdown_connections 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7508722800 1 --2- 172.21.15.121:0/4120752873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d445870 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7508722800 1 -- 172.21.15.121:0/4120752873 >> 172.21.15.121:0/4120752873 conn(0x55b80d390550 msgr2=0x55b80d440830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7508722800 1 -- 172.21.15.121:0/4120752873 shutdown_connections 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7508722800 1 -- 172.21.15.121:0/4120752873 wait complete. 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7508722800 1 Processor -- start 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7508722800 1 -- start start 2023-12-07T21:10:18.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7508722800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d44c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7508722800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b80d235530 con 0x55b80d445450 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.489+0000 7f7504ba7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d44c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.490+0000 7f7504ba7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d44c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60422/0 (socket says 172.21.15.121:60422) 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.490+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 learned_addr learned my addr 172.21.15.121:0/2051263519 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.490+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f4005c90 con 0x55b80d445450 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.490+0000 7f7504ba7640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d44c420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f74f400a900 tx=0x7f74f4002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.490+0000 7f74e9ffb640 1 -- 172.21.15.121:0/2051263519 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74f4013780 con 0x55b80d445450 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.490+0000 7f74e9ffb640 1 -- 172.21.15.121:0/2051263519 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f40138e0 con 0x55b80d445450 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.490+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b80d44c960 con 0x55b80d445450 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.490+0000 7f74e9ffb640 1 -- 172.21.15.121:0/2051263519 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f74f4013b80 con 0x55b80d445450 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.490+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b80d44ce20 con 0x55b80d445450 2023-12-07T21:10:18.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.491+0000 7f74e9ffb640 1 -- 172.21.15.121:0/2051263519 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f74f4013ce0 con 0x55b80d445450 2023-12-07T21:10:18.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.491+0000 7f74e9ffb640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74dc036110 0x7f74dc0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.491+0000 7f74e9ffb640 1 -- 172.21.15.121:0/2051263519 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f74f404b770 con 0x55b80d445450 2023-12-07T21:10:18.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.491+0000 7f7503ba5640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74dc036110 0x7f74dc0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7508722800 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b80d457bc0 0x55b80d45a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d45a7d0 con 0x55b80d457bc0 2023-12-07T21:10:18.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7503ba5640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74dc036110 0x7f74dc0385d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f74f8054000 tx=0x7f74f804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7504ba7640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b80d457bc0 0x55b80d45a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7504ba7640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b80d457bc0 0x55b80d45a080 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7508722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7508722800 20 realm 2023-12-07T21:10:18.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d45abc0 con 0x55b80d457bc0 2023-12-07T21:10:18.506 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.492+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d45b440 con 0x55b80d457bc0 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d45b7a0 con 0x55b80d457bc0 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.507 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d45bfa0 con 0x55b80d457bc0 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 20 searching for the correct realm 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b80d45dcc0 0x55b80d460130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d45dcc0 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.493+0000 7f75043a6640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b80d45dcc0 0x55b80d460130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.494+0000 7f75043a6640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b80d45dcc0 0x55b80d460130 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.494+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.494+0000 7f75043a6640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f74fc04b050 0x7f74fc0353f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.494+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74fc04b050 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.494+0000 7f7503ba5640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f74fc04b050 0x7f74fc0353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.494+0000 7f7503ba5640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f74fc04b050 0x7f74fc0353f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.495+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f8052840 con 0x7f74fc04b050 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.495+0000 7f7503ba5640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f74f805c920 0x7f74f8009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.495+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74f805c920 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.495+0000 7f7504ba7640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f74f805c920 0x7f74f8009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.495+0000 7f7504ba7640 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f74f805c920 0x7f74f8009410 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.495+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.495+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d457bc0 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.496+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.496+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d457bc0 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.496+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.496+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74f805c920 2023-12-07T21:10:18.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.496+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.496+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74f805c920 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.496+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.496+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74fc04b050 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.497+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f8052840 con 0x7f74fc04b050 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.497+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d45dcc0 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.497+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.497+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d457bc0 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.497+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.497+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74f805c920 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.497+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.497+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d457bc0 2023-12-07T21:10:18.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.498+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.498+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74fc04b050 2023-12-07T21:10:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.498+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f74f8052840 con 0x7f74fc04b050 2023-12-07T21:10:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.498+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d45dcc0 2023-12-07T21:10:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.498+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.498+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d45dcc0 2023-12-07T21:10:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.498+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.498+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74f805c920 2023-12-07T21:10:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.499+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.499+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d45dcc0 2023-12-07T21:10:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.499+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.499+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d45dcc0 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.499+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.499+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d457bc0 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.499+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.499+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d457bc0 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.500+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.500+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74f805c920 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.500+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.500+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d45dcc0 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.500+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.500+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74fc04b050 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.501+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f8052840 con 0x7f74fc04b050 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.501+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d457bc0 2023-12-07T21:10:18.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.501+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.501+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74f805c920 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.501+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.501+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d45dcc0 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.502+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.502+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74f805c920 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.502+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.502+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74fc04b050 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.502+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f8052840 con 0x7f74fc04b050 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.502+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d45dcc0 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.502+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.502+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74f805c920 2023-12-07T21:10:18.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x55b80d457bc0 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460800 con 0x7f74fc04b050 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f74f8052840 con 0x7f74fc04b050 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7508722800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7508722800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7508722800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7508722800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7508722800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7508722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d45c8a0 con 0x55b80d457bc0 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7508722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.503+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d45d0f0 con 0x55b80d457bc0 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460c40 con 0x55b80d45dcc0 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 20 zone default found 2023-12-07T21:10:18.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 4 Realm: () 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 20 zonegroup default 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d460fa0 con 0x7f74f805c920 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d462d60 con 0x55b80d45dcc0 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.504+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d463110 con 0x55b80d45dcc0 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.505+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.505+0000 7f7508722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.505+0000 7f7508722800 20 started sync module instance, tier type = 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.505+0000 7f7508722800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.505+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d462640 con 0x7f74fc04b050 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.506+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f8052840 con 0x7f74fc04b050 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.506+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94248982630224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4629f0 con 0x7f74fc04b050 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.506+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4639d0 con 0x55b80d457bc0 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.507+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94248982630224] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.507+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.507+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94248985043360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4639d0 con 0x55b80d457bc0 2023-12-07T21:10:18.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.507+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d464450 con 0x55b80d45dcc0 2023-12-07T21:10:18.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.508+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.508+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94248985050960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d464ca0 con 0x55b80d45dcc0 2023-12-07T21:10:18.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.508+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d465670 con 0x7f74fc04b050 2023-12-07T21:10:18.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.508+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94248985043360] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.509+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.509+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94248985048368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d465ef0 con 0x7f74fc04b050 2023-12-07T21:10:18.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.509+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4666f0 con 0x55b80d457bc0 2023-12-07T21:10:18.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.509+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94248985050960] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.510+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.510+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94248985059920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d466660 con 0x55b80d457bc0 2023-12-07T21:10:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.510+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4673e0 con 0x7f74f805c920 2023-12-07T21:10:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.511+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94248985048368] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.512+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.512+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94248985057872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4673e0 con 0x7f74f805c920 2023-12-07T21:10:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.512+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94248985059920] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.512+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d466b00 con 0x7f74f805c920 2023-12-07T21:10:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.513+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94248985057872] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.513+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.513+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94248985062416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d467790 con 0x7f74f805c920 2023-12-07T21:10:18.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.513+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d467fd0 con 0x7f74f805c920 2023-12-07T21:10:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.514+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v33'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.514+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94248985065248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d468650 con 0x7f74f805c920 2023-12-07T21:10:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.514+0000 7f7508722800 20 add_watcher() i=0 2023-12-07T21:10:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.514+0000 7f7508722800 20 add_watcher() i=1 2023-12-07T21:10:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.514+0000 7f7508722800 20 add_watcher() i=2 2023-12-07T21:10:18.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.514+0000 7f7508722800 20 add_watcher() i=3 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.514+0000 7f7508722800 20 add_watcher() i=4 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.514+0000 7f7508722800 20 add_watcher() i=5 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.514+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94248985062416] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.514+0000 7f7508722800 20 add_watcher() i=6 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.515+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94248985065248] v33'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.515+0000 7f7508722800 20 add_watcher() i=7 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.515+0000 7f7508722800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.515+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d46b570 con 0x55b80d457bc0 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.515+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.515+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94248985067680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d468950 con 0x55b80d457bc0 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.516+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94248985067680] v33'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.516+0000 7f74ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:18.525 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.516+0000 7f7508722800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.516+0000 7f7508722800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.516+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4739e0 con 0x55b80d457bc0 2023-12-07T21:10:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.517+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.517+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d473ea0 con 0x7f74f805c920 2023-12-07T21:10:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.518+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.518+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4743d0 con 0x55b80d45dcc0 2023-12-07T21:10:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.519+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'28 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.519+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d474da0 con 0x55b80d457bc0 2023-12-07T21:10:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.520+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'219 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.520+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4719b0 con 0x7f74fc04b050 2023-12-07T21:10:18.526 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.521+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'68 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.521+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d475910 con 0x55b80d45dcc0 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.522+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.522+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d475e40 con 0x55b80d457bc0 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.524+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.524+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4762e0 con 0x7f74f805c920 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.525+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.525+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4762e0 con 0x7f74fc04b050 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.526+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.526+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d476ae0 con 0x55b80d45dcc0 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.527+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.527+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4709a0 con 0x7f74fc04b050 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.528+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'69 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.528+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477650 con 0x7f74f805c920 2023-12-07T21:10:18.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.529+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.529+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477650 con 0x7f74fc04b050 2023-12-07T21:10:18.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.530+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.530+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x7f74f805c920 2023-12-07T21:10:18.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.531+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'53 uv44 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.531+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d457bc0 2023-12-07T21:10:18.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.532+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'220 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.532+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d45dcc0 2023-12-07T21:10:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.533+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'62 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.533+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x7f74fc04b050 2023-12-07T21:10:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.534+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'70 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.534+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d45dcc0 2023-12-07T21:10:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.535+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.535+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d457bc0 2023-12-07T21:10:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.536+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.536+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d457bc0 2023-12-07T21:10:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.537+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'221 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.537+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d45dcc0 2023-12-07T21:10:18.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.538+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'63 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.538+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x7f74fc04b050 2023-12-07T21:10:18.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.539+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'36 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.539+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d45dcc0 2023-12-07T21:10:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.540+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.540+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d45dcc0 2023-12-07T21:10:18.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.541+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.541+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d45dcc0 2023-12-07T21:10:18.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.542+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'22 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.542+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d45dcc0 2023-12-07T21:10:18.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.542+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.543+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x7f74f805c920 2023-12-07T21:10:18.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.544+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'29 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.544+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d45dcc0 2023-12-07T21:10:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.545+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.545+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x7f74f805c920 2023-12-07T21:10:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.546+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.546+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x55b80d45dcc0 2023-12-07T21:10:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.547+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'64 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.547+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x7f74f805c920 2023-12-07T21:10:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.548+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'54 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.548+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d477af0 con 0x7f74fc04b050 2023-12-07T21:10:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.549+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.549+0000 7f74c97e2640 20 reqs_thread_entry: start 2023-12-07T21:10:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.549+0000 7f7508722800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.549+0000 7f7508722800 20 Filter name: none 2023-12-07T21:10:18.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.549+0000 7f743affd640 20 reqs_thread_entry: start 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.549+0000 7f7508722800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.549+0000 7f7508722800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.549+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4a29a0 con 0x7f74fc04b050 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.550+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(94 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.550+0000 7f7508722800 20 rados_obj.operate() r=0 bl.length=346 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.550+0000 7f7508722800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.550+0000 7f7508722800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.550+0000 7f7508722800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.550+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4a4d90 con 0x55b80d457bc0 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.550+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(95 bud.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.550+0000 7f7508722800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.550+0000 7f7508722800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2023-12-07T21:10:18.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.550+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 94248985306992 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4a5450 con 0x7f74f805c920 2023-12-07T21:10:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.551+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== watch-notify(notify (1) cookie 94248985057872 notify 141733920807 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55b80d44ce20 con 0x7f74f805c920 2023-12-07T21:10:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.551+0000 7f74eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920807 cookie 94248985057872 notifier 4672 bl.length()=170 2023-12-07T21:10:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.551+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(96 notify.5 [notify cookie 94248985306992 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.551+0000 7f74eb7fe640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f74d8004160 con 0x7f74f805c920 2023-12-07T21:10:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.551+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.551+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== watch-notify(notify_complete (2) cookie 94248985306992 notify 141733920807 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b80d44c960 con 0x7f74f805c920 2023-12-07T21:10:18.545 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.551+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:98 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4a53d0 con 0x55b80d457bc0 2023-12-07T21:10:18.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.552+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(98 NX5QOQKC6BH2IDN8HC7A [delete] v33'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.552+0000 7f7508722800 10 removing email index: 2023-12-07T21:10:18.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.552+0000 7f7508722800 10 removing user buckets index 2023-12-07T21:10:18.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.552+0000 7f7508722800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2023-12-07T21:10:18.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.552+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94248985306992 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4a5410 con 0x7f74f805c920 2023-12-07T21:10:18.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.552+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== watch-notify(notify (1) cookie 94248985062416 notify 141733920808 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55b80d44c960 con 0x7f74f805c920 2023-12-07T21:10:18.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.552+0000 7f74eb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920808 cookie 94248985062416 notifier 4672 bl.length()=160 2023-12-07T21:10:18.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.552+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(99 notify.6 [notify cookie 94248985306992 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.552+0000 7f74eb7fe640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f74d8004160 con 0x7f74f805c920 2023-12-07T21:10:18.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.553+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 30 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.553+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 31 ==== watch-notify(notify_complete (2) cookie 94248985306992 notify 141733920808 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f74f4005c90 con 0x7f74f805c920 2023-12-07T21:10:18.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.553+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:101 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4a5290 con 0x55b80d457bc0 2023-12-07T21:10:18.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.553+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(101 bud.buckets [delete] v33'4 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.553+0000 7f7508722800 10 removing user index: bud 2023-12-07T21:10:18.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.553+0000 7f7508722800 10 removing default.rgw.meta+users.uid+bud from cache 2023-12-07T21:10:18.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.553+0000 7f7508722800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2023-12-07T21:10:18.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.553+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94248985306992 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4a3d80 con 0x7f74f805c920 2023-12-07T21:10:18.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.554+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 32 ==== watch-notify(notify (1) cookie 94248985057872 notify 141733920809 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f74f4005c90 con 0x7f74f805c920 2023-12-07T21:10:18.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.554+0000 7f74eaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920809 cookie 94248985057872 notifier 4672 bl.length()=152 2023-12-07T21:10:18.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.554+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 33 ==== osd_op_reply(102 notify.5 [notify cookie 94248985306992 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.554+0000 7f74eaffd640 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f7448003280 con 0x7f74f805c920 2023-12-07T21:10:18.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.554+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 34 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.554+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 35 ==== watch-notify(notify_complete (2) cookie 94248985306992 notify 141733920809 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f74f4017030 con 0x7f74f805c920 2023-12-07T21:10:18.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.554+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:104 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4a3d80 con 0x7f74fc04b050 2023-12-07T21:10:18.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.555+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(104 bud [call,call,delete] v33'3 uv3 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.556+0000 7f74ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:18.550 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.556+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94248985067680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4550d0 con 0x55b80d457bc0 2023-12-07T21:10:18.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.557+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94248985067680] v33'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.557+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94248982630224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4550d0 con 0x7f74fc04b050 2023-12-07T21:10:18.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.558+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94248982630224] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.558+0000 7f7508722800 20 remove_watcher() i=0 2023-12-07T21:10:18.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.558+0000 7f7508722800 2 removed watcher, disabling cache 2023-12-07T21:10:18.551 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.558+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94248985043360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4550d0 con 0x55b80d457bc0 2023-12-07T21:10:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.559+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94248985043360] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.559+0000 7f7508722800 20 remove_watcher() i=1 2023-12-07T21:10:18.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.559+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94248985050960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4550d0 con 0x55b80d45dcc0 2023-12-07T21:10:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.560+0000 7f75043a6640 1 -- 172.21.15.121:0/2051263519 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94248985050960] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74fc012890 con 0x55b80d45dcc0 2023-12-07T21:10:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.560+0000 7f7508722800 20 remove_watcher() i=2 2023-12-07T21:10:18.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.561+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94248985048368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d4550d0 con 0x7f74fc04b050 2023-12-07T21:10:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.561+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94248985048368] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f8071040 con 0x7f74fc04b050 2023-12-07T21:10:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.561+0000 7f7508722800 20 remove_watcher() i=3 2023-12-07T21:10:18.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.561+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94248985059920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d463530 con 0x55b80d457bc0 2023-12-07T21:10:18.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.562+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94248985059920] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x55b80d457bc0 2023-12-07T21:10:18.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.562+0000 7f7508722800 20 remove_watcher() i=4 2023-12-07T21:10:18.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.562+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94248985057872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d466250 con 0x7f74f805c920 2023-12-07T21:10:18.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.563+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 36 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94248985057872] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.563+0000 7f7508722800 20 remove_watcher() i=5 2023-12-07T21:10:18.556 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.563+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94248985062416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d466250 con 0x7f74f805c920 2023-12-07T21:10:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.564+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 37 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94248985062416] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.564+0000 7f7508722800 20 remove_watcher() i=6 2023-12-07T21:10:18.557 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.564+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94248985065248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55b80d466c10 con 0x7f74f805c920 2023-12-07T21:10:18.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7504ba7640 1 -- 172.21.15.121:0/2051263519 <== osd.0 v2:172.21.15.89:6800/654939948 38 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94248985065248] v33'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f74f4024070 con 0x7f74f805c920 2023-12-07T21:10:18.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 20 remove_watcher() i=7 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f74f805c920 msgr2=0x7f74f8009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f74f805c920 0x7f74f8009410 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b80d457bc0 msgr2=0x55b80d45a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55b80d457bc0 0x55b80d45a080 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f74fc04b050 msgr2=0x7f74fc0353f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f74fc04b050 0x7f74fc0353f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b80d45dcc0 msgr2=0x55b80d460130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55b80d45dcc0 0x55b80d460130 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74dc036110 msgr2=0x7f74dc0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74dc036110 0x7f74dc0385d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f74f8054000 tx=0x7f74f804e000 comp rx=0 tx=0).stop 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 msgr2=0x55b80d44c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7503ba5640 1 -- 172.21.15.121:0/2051263519 reap_dead start 2023-12-07T21:10:18.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d44c420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f74f400a900 tx=0x7f74f4002ff0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 shutdown_connections 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 --2- 172.21.15.121:0/2051263519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d445450 0x55b80d44c420 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 >> 172.21.15.121:0/2051263519 conn(0x55b80d390550 msgr2=0x55b80d440400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 shutdown_connections 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/2051263519 wait complete. 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/3354859869 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f0036110 msgr2=0x7f74f00385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 --2- 172.21.15.121:0/3354859869 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f0036110 0x7f74f00385d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f74fc011ff0 tx=0x7f74fc006a20 comp rx=0 tx=0).stop 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/3354859869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 msgr2=0x55b80d439320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 --2- 172.21.15.121:0/3354859869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d439320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f74fc000f80 tx=0x7f74fc001250 comp rx=0 tx=0).stop 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/3354859869 shutdown_connections 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 --2- 172.21.15.121:0/3354859869 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f74f0036110 0x7f74f00385d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 --2- 172.21.15.121:0/3354859869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55b80d38c110 0x55b80d439320 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/3354859869 >> 172.21.15.121:0/3354859869 conn(0x55b80d387890 msgr2=0x55b80d42fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/3354859869 shutdown_connections 2023-12-07T21:10:18.562 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.566+0000 7f7508722800 1 -- 172.21.15.121:0/3354859869 wait complete. 2023-12-07T21:10:18.563 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2023-12-07T21:10:18.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2023-12-07T21:10:18.563 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2023-12-07T21:10:18.646 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:18.646 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:18.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.654+0000 7f0e33d33800 1 Processor -- start 2023-12-07T21:10:18.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.655+0000 7f0e33d33800 1 -- start start 2023-12-07T21:10:18.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.655+0000 7f0e33d33800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55bf57a84550 0x55bf57a86940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.655+0000 7f0e33d33800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bf579cd740 con 0x55bf57a80110 2023-12-07T21:10:18.647 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.655+0000 7f0e33d33800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bf57996880 con 0x55bf57a84550 2023-12-07T21:10:18.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.655+0000 7f0e2f97e640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55bf57a80110 0x55bf57a80530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:58658/0 (socket says 172.21.15.121:58658) 2023-12-07T21:10:18.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.655+0000 7f0e2f17d640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55bf57a84550 0x55bf57a86940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.655+0000 7f0e2f97e640 1 -- 172.21.15.121:0/3174277717 learned_addr learned my addr 172.21.15.121:0/3174277717 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:18.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.655+0000 7f0e2e97c640 1 -- 172.21.15.121:0/3174277717 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175068726 0 0) 0x55bf579cd740 con 0x55bf57a80110 2023-12-07T21:10:18.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.655+0000 7f0e2e97c640 1 -- 172.21.15.121:0/3174277717 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e18001e10 con 0x55bf57a80110 2023-12-07T21:10:18.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.655+0000 7f0e2f17d640 1 -- 172.21.15.121:0/3174277717 >> v1:172.21.15.89:6789/0 conn(0x55bf57a80110 legacy=0x55bf57a80530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.648 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.655+0000 7f0e2f17d640 1 -- 172.21.15.121:0/3174277717 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf57a87f70 con 0x55bf57a84550 2023-12-07T21:10:18.650 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.657+0000 7f0e2f17d640 1 --2- 172.21.15.121:0/3174277717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a84550 0x55bf57a86940 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400a470 tx=0x7f0e2401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15204bb822156282 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.657+0000 7f0e2e97c640 1 -- 172.21.15.121:0/3174277717 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e2404ad60 con 0x55bf57a84550 2023-12-07T21:10:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.657+0000 7f0e2e97c640 1 -- 172.21.15.121:0/3174277717 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e24052440 con 0x55bf57a84550 2023-12-07T21:10:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.658+0000 7f0e2e97c640 1 -- 172.21.15.121:0/3174277717 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e24052700 con 0x55bf57a84550 2023-12-07T21:10:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.658+0000 7f0e33d33800 1 -- 172.21.15.121:0/3174277717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a84550 msgr2=0x55bf57a86940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.658+0000 7f0e33d33800 1 --2- 172.21.15.121:0/3174277717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a84550 0x55bf57a86940 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400a470 tx=0x7f0e2401cc80 comp rx=0 tx=0).stop 2023-12-07T21:10:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.658+0000 7f0e33d33800 1 -- 172.21.15.121:0/3174277717 shutdown_connections 2023-12-07T21:10:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.658+0000 7f0e33d33800 1 --2- 172.21.15.121:0/3174277717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a84550 0x55bf57a86940 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.658+0000 7f0e33d33800 1 -- 172.21.15.121:0/3174277717 >> 172.21.15.121:0/3174277717 conn(0x55bf57a7b890 msgr2=0x55bf57a7dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.658+0000 7f0e33d33800 1 -- 172.21.15.121:0/3174277717 shutdown_connections 2023-12-07T21:10:18.651 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.658+0000 7f0e33d33800 1 -- 172.21.15.121:0/3174277717 wait complete. 2023-12-07T21:10:18.672 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.659+0000 7f0e33d33800 1 Processor -- start 2023-12-07T21:10:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.659+0000 7f0e33d33800 1 -- start start 2023-12-07T21:10:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.659+0000 7f0e33d33800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf57b24b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.659+0000 7f0e33d33800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf57993db0 con 0x55bf57a80110 2023-12-07T21:10:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.659+0000 7f0e2f97e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf57b24b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.659+0000 7f0e2f97e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf57b24b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60438/0 (socket says 172.21.15.121:60438) 2023-12-07T21:10:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.659+0000 7f0e2f97e640 1 -- 172.21.15.121:0/3342918158 learned_addr learned my addr 172.21.15.121:0/3342918158 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.659+0000 7f0e2f97e640 1 -- 172.21.15.121:0/3342918158 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e24005d20 con 0x55bf57a80110 2023-12-07T21:10:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e2f97e640 1 --2- 172.21.15.121:0/3342918158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf57b24b00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0e20001c20 tx=0x7f0e2000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721bbc992d888c84 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e2e17b640 1 -- 172.21.15.121:0/3342918158 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e2000e470 con 0x55bf57a80110 2023-12-07T21:10:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e2e17b640 1 -- 172.21.15.121:0/3342918158 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2000e5d0 con 0x55bf57a80110 2023-12-07T21:10:18.673 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e2e17b640 1 -- 172.21.15.121:0/3342918158 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e2000e930 con 0x55bf57a80110 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e33d33800 1 -- 172.21.15.121:0/3342918158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 msgr2=0x55bf57b24b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e33d33800 1 --2- 172.21.15.121:0/3342918158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf57b24b00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0e20001c20 tx=0x7f0e2000b6c0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e33d33800 1 -- 172.21.15.121:0/3342918158 shutdown_connections 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e33d33800 1 --2- 172.21.15.121:0/3342918158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf57b24b00 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e33d33800 1 -- 172.21.15.121:0/3342918158 >> 172.21.15.121:0/3342918158 conn(0x55bf57a7b890 msgr2=0x55bf57b20770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e33d33800 1 -- 172.21.15.121:0/3342918158 shutdown_connections 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e33d33800 1 -- 172.21.15.121:0/3342918158 wait complete. 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e33d33800 1 Processor -- start 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.660+0000 7f0e33d33800 1 -- start start 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e33d33800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf579f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e33d33800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf5798f6a0 con 0x55bf57a80110 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e2f97e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf579f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.674 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e2f97e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf579f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60454/0 (socket says 172.21.15.121:60454) 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e2f97e640 1 -- 172.21.15.121:0/1674936595 learned_addr learned my addr 172.21.15.121:0/1674936595 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e2f97e640 1 -- 172.21.15.121:0/1674936595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18001e10 con 0x55bf57a80110 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e2f97e640 1 --2- 172.21.15.121:0/1674936595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf579f5a10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0e20001080 tx=0x7f0e20000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e2d179640 1 -- 172.21.15.121:0/1674936595 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e2001f070 con 0x55bf57a80110 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e2d179640 1 -- 172.21.15.121:0/1674936595 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e20018770 con 0x55bf57a80110 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e2d179640 1 -- 172.21.15.121:0/1674936595 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e20018a50 con 0x55bf57a80110 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e33d33800 1 -- 172.21.15.121:0/1674936595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bf57b2fcc0 con 0x55bf57a80110 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.661+0000 7f0e33d33800 1 -- 172.21.15.121:0/1674936595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf57b30140 con 0x55bf57a80110 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.662+0000 7f0e33d33800 1 Processor -- start 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.662+0000 7f0e33d33800 1 -- start start 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.662+0000 7f0e2d179640 1 -- 172.21.15.121:0/1674936595 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0e20018bb0 con 0x55bf57a80110 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.662+0000 7f0e33d33800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 0x55bf57b2bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.675 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.662+0000 7f0e33d33800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf57929890 con 0x55bf57b2d740 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.662+0000 7f0e2d179640 1 --2- 172.21.15.121:0/1674936595 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0e1c036110 0x7f0e1c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.662+0000 7f0e3017f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 0x55bf57b2bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.662+0000 7f0e2d179640 1 -- 172.21.15.121:0/1674936595 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f0e2004ba90 con 0x55bf57a80110 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.662+0000 7f0e3017f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 0x55bf57b2bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60464/0 (socket says 172.21.15.121:60464) 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.662+0000 7f0e3017f640 1 -- 172.21.15.121:0/1670489750 learned_addr learned my addr 172.21.15.121:0/1670489750 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.662+0000 7f0e2f97e640 1 --2- 172.21.15.121:0/1674936595 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0e1c036110 0x7f0e1c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e3017f640 1 -- 172.21.15.121:0/1670489750 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf57b2c1d0 con 0x55bf57b2d740 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e2f97e640 1 --2- 172.21.15.121:0/1674936595 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0e1c036110 0x7f0e1c0385d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0e20001ed0 tx=0x7f0e2000de00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e3017f640 1 --2- 172.21.15.121:0/1670489750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 0x55bf57b2bc90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800a430 tx=0x7f0e2800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3db80655029d385 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e16ffd640 1 -- 172.21.15.121:0/1670489750 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e28001650 con 0x55bf57b2d740 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e16ffd640 1 -- 172.21.15.121:0/1670489750 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e280017d0 con 0x55bf57b2d740 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e16ffd640 1 -- 172.21.15.121:0/1670489750 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e28001ab0 con 0x55bf57b2d740 2023-12-07T21:10:18.676 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e33d33800 1 -- 172.21.15.121:0/1670489750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 msgr2=0x55bf57b2bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e33d33800 1 --2- 172.21.15.121:0/1670489750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 0x55bf57b2bc90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800a430 tx=0x7f0e2800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e33d33800 1 -- 172.21.15.121:0/1670489750 shutdown_connections 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e33d33800 1 --2- 172.21.15.121:0/1670489750 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 0x55bf57b2bc90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e33d33800 1 -- 172.21.15.121:0/1670489750 >> 172.21.15.121:0/1670489750 conn(0x55bf57a84550 msgr2=0x55bf57b346a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e33d33800 1 -- 172.21.15.121:0/1670489750 shutdown_connections 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.663+0000 7f0e33d33800 1 -- 172.21.15.121:0/1670489750 wait complete. 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.664+0000 7f0e33d33800 1 Processor -- start 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.664+0000 7f0e33d33800 1 -- start start 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.664+0000 7f0e33d33800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 0x55bf57b42500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.664+0000 7f0e33d33800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf57929530 con 0x55bf57b2d740 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.664+0000 7f0e3017f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 0x55bf57b42500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.664+0000 7f0e3017f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 0x55bf57b42500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:60478/0 (socket says 172.21.15.121:60478) 2023-12-07T21:10:18.677 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.664+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 learned_addr learned my addr 172.21.15.121:0/464280144 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.664+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2800a0e0 con 0x55bf57b2d740 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.665+0000 7f0e3017f640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 0x55bf57b42500 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800a930 tx=0x7f0e28003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.665+0000 7f0e157fa640 1 -- 172.21.15.121:0/464280144 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e28010900 con 0x55bf57b2d740 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.665+0000 7f0e157fa640 1 -- 172.21.15.121:0/464280144 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e28010a60 con 0x55bf57b2d740 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.665+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bf57b42a40 con 0x55bf57b2d740 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.665+0000 7f0e157fa640 1 -- 172.21.15.121:0/464280144 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e28010d20 con 0x55bf57b2d740 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.665+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf57b42ea0 con 0x55bf57b2d740 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.665+0000 7f0e157fa640 1 -- 172.21.15.121:0/464280144 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0e28017030 con 0x55bf57b2d740 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.666+0000 7f0e157fa640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0e080360c0 0x7f0e08038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.666+0000 7f0e157fa640 1 -- 172.21.15.121:0/464280144 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f0e2804ba10 con 0x55bf57b2d740 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.666+0000 7f0e2f17d640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0e080360c0 0x7f0e08038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.666+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.678 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.666+0000 7f0e2f17d640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0e080360c0 0x7f0e08038580 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e24054000 tx=0x7f0e2404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.666+0000 7f0e33d33800 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55bf57b4dc20 0x55bf57b500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.666+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b50830 con 0x55bf57b4dc20 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.666+0000 7f0e3017f640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55bf57b4dc20 0x55bf57b500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e3017f640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55bf57b4dc20 0x55bf57b500e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e33d33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e33d33800 20 realm 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b50c40 con 0x55bf57b4dc20 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e33d33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e33d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:18.679 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b514c0 con 0x55bf57b4dc20 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e33d33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.667+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b51820 con 0x55bf57b4dc20 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.668+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.668+0000 7f0e33d33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.668+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.668+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b52020 con 0x55bf57b4dc20 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.668+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.668+0000 7f0e33d33800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.668+0000 7f0e33d33800 20 searching for the correct realm 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.668+0000 7f0e33d33800 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55bf57b53d40 0x55bf57b561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.680 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.668+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b53d40 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.668+0000 7f0e2f97e640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55bf57b53d40 0x55bf57b561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.668+0000 7f0e2f97e640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55bf57b53d40 0x55bf57b561b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.669+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.669+0000 7f0e2f97e640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0e20017050 0x7f0e20009350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.669+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e20017050 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.669+0000 7f0e2f17d640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0e20017050 0x7f0e20009350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.669+0000 7f0e2f17d640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0e20017050 0x7f0e20009350 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.669+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e24059040 con 0x7f0e20017050 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.669+0000 7f0e2f17d640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0e2405c950 0x7f0e24009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.669+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e2405c950 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.670+0000 7f0e3017f640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0e2405c950 0x7f0e24009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.670+0000 7f0e3017f640 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0e2405c950 0x7f0e24009410 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.670+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x7f0e2405c950 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.670+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b4dc20 2023-12-07T21:10:18.681 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.670+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.670+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b4dc20 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.671+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.671+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e2405c950 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.671+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x7f0e2405c950 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.671+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e2405c950 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.671+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x7f0e2405c950 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.671+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e20017050 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.671+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e24059040 con 0x7f0e20017050 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.671+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b53d40 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.672+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.672+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b4dc20 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.672+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.682 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.672+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e2405c950 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.672+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x7f0e2405c950 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.672+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b4dc20 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.672+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.672+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e20017050 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.672+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f0e24059040 con 0x7f0e20017050 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.673+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b53d40 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.673+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.673+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b53d40 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.673+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.673+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e2405c950 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.673+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x7f0e2405c950 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.673+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b53d40 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.673+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.673+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b53d40 2023-12-07T21:10:18.683 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.674+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.674+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b4dc20 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.674+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.674+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b4dc20 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.674+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.674+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e2405c950 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.674+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x7f0e2405c950 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.674+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b53d40 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.675+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.675+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e20017050 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.675+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e24059040 con 0x7f0e20017050 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.675+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b4dc20 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.675+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2802ea00 con 0x55bf57b4dc20 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.675+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e2405c950 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.675+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.684 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.675+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b53d40 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.676+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.676+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e2405c950 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.676+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.676+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e20017050 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.676+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e24059040 con 0x7f0e20017050 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.676+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b53d40 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.676+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.676+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e2405c950 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x55bf57b4dc20 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b56880 con 0x7f0e20017050 2023-12-07T21:10:18.685 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e33d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e33d33800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e33d33800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e33d33800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e33d33800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e33d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b52950 con 0x55bf57b4dc20 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e33d33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.677+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b525d0 con 0x55bf57b4dc20 2023-12-07T21:10:18.686 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b53320 con 0x55bf57b53d40 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 20 zone default found 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 4 Realm: () 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 20 zonegroup default 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b57160 con 0x7f0e2405c950 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.687 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b58c60 con 0x55bf57b53d40 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.678+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.679+0000 7f0e33d33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.679+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.679+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b590b0 con 0x55bf57b53d40 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.679+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.679+0000 7f0e33d33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.679+0000 7f0e33d33800 20 started sync module instance, tier type = 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.679+0000 7f0e33d33800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.679+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b57f80 con 0x7f0e20017050 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.680+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.680+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94280296206160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b58330 con 0x7f0e20017050 2023-12-07T21:10:18.688 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.680+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b59970 con 0x55bf57b4dc20 2023-12-07T21:10:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.681+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94280296206160] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.681+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.681+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94280298625760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b59970 con 0x55bf57b4dc20 2023-12-07T21:10:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.681+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5a440 con 0x55bf57b53d40 2023-12-07T21:10:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.682+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.682+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94280298635040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5ac90 con 0x55bf57b53d40 2023-12-07T21:10:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.682+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5b660 con 0x7f0e20017050 2023-12-07T21:10:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.683+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94280298625760] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.694 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.683+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94280298635040] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.683+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.683+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94280298639712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5a900 con 0x7f0e20017050 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.684+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5c0e0 con 0x55bf57b4dc20 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.684+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.685+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94280298642400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5c960 con 0x55bf57b4dc20 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.685+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5d310 con 0x7f0e2405c950 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.685+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94280298639712] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.685+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.686+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94280298632400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5d2d0 con 0x7f0e2405c950 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.686+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5dbd0 con 0x7f0e2405c950 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.686+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94280298642400] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.686+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94280298632400] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.687+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.695 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.687+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94280298644592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5ce30 con 0x7f0e2405c950 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.687+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5ce30 con 0x7f0e2405c950 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.688+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v33'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.688+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94280298644592] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.688+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94280298650848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5e590 con 0x7f0e2405c950 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.688+0000 7f0e33d33800 20 add_watcher() i=0 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.688+0000 7f0e33d33800 20 add_watcher() i=1 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.688+0000 7f0e33d33800 20 add_watcher() i=2 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.688+0000 7f0e33d33800 20 add_watcher() i=3 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.688+0000 7f0e33d33800 20 add_watcher() i=4 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.688+0000 7f0e33d33800 20 add_watcher() i=5 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.688+0000 7f0e33d33800 20 add_watcher() i=6 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.689+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94280298650848] v33'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.689+0000 7f0e33d33800 20 add_watcher() i=7 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.689+0000 7f0e33d33800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:18.696 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.689+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b615c0 con 0x55bf57b4dc20 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.689+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.689+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94280298651888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b5e9a0 con 0x55bf57b4dc20 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.690+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94280298651888] v33'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.690+0000 7f0df5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.690+0000 7f0e33d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.690+0000 7f0e33d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.690+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b69880 con 0x55bf57b4dc20 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.691+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.691+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b69cc0 con 0x7f0e2405c950 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.692+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.693+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6a1f0 con 0x55bf57b53d40 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.693+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'29 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.694+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6abc0 con 0x55bf57b4dc20 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.694+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'224 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.697 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.694+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b678f0 con 0x7f0e20017050 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.696+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'71 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.696+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6b730 con 0x55bf57b53d40 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.696+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.697+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6bc60 con 0x55bf57b4dc20 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.698+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.698+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6c100 con 0x7f0e2405c950 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.699+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.699+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6b730 con 0x7f0e20017050 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.700+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.700+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6c770 con 0x55bf57b53d40 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.701+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.701+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b668e0 con 0x7f0e20017050 2023-12-07T21:10:18.698 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.702+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'72 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.702+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d2e0 con 0x7f0e2405c950 2023-12-07T21:10:18.699 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.703+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.703+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d370 con 0x7f0e20017050 2023-12-07T21:10:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.704+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.704+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d810 con 0x7f0e2405c950 2023-12-07T21:10:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.706+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'55 uv44 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.706+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d810 con 0x55bf57b4dc20 2023-12-07T21:10:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.707+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'225 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.707+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d780 con 0x55bf57b53d40 2023-12-07T21:10:18.700 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.708+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'65 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.708+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d950 con 0x7f0e20017050 2023-12-07T21:10:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.709+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'73 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.701 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.709+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d950 con 0x55bf57b53d40 2023-12-07T21:10:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.710+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.702 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.710+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d950 con 0x55bf57b4dc20 2023-12-07T21:10:18.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.711+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.711+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d950 con 0x55bf57b4dc20 2023-12-07T21:10:18.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.712+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'226 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.704 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.712+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d950 con 0x55bf57b53d40 2023-12-07T21:10:18.705 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.713+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'66 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.713+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d950 con 0x7f0e20017050 2023-12-07T21:10:18.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.714+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'37 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.706 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.714+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d950 con 0x55bf57b53d40 2023-12-07T21:10:18.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.715+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.707 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.715+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d950 con 0x55bf57b53d40 2023-12-07T21:10:18.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.716+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.708 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.716+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d950 con 0x55bf57b53d40 2023-12-07T21:10:18.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.717+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'23 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.709 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.717+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d950 con 0x55bf57b53d40 2023-12-07T21:10:18.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.718+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.710 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.718+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d970 con 0x7f0e2405c950 2023-12-07T21:10:18.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.719+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'30 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.711 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.719+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d970 con 0x55bf57b53d40 2023-12-07T21:10:18.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.720+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.712 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.720+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6d970 con 0x7f0e2405c950 2023-12-07T21:10:18.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.721+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.713 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.721+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6db40 con 0x55bf57b53d40 2023-12-07T21:10:18.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.722+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'67 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.715 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.722+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6db40 con 0x7f0e2405c950 2023-12-07T21:10:18.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.724+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'56 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.716 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.724+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b6db40 con 0x7f0e20017050 2023-12-07T21:10:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.725+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.725+0000 7f0df4fe1640 20 reqs_thread_entry: start 2023-12-07T21:10:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.725+0000 7f0e33d33800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.725+0000 7f0e33d33800 20 Filter name: none 2023-12-07T21:10:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.725+0000 7f0d6e7fc640 20 reqs_thread_entry: start 2023-12-07T21:10:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.725+0000 7f0e33d33800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2023-12-07T21:10:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.725+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.718 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.725+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b98a90 con 0x7f0e2405c950 2023-12-07T21:10:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.726+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.726+0000 7f0e33d33800 20 rados_obj.operate() r=0 bl.length=346 2023-12-07T21:10:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.726+0000 7f0e33d33800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2023-12-07T21:10:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.726+0000 7f0e33d33800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2023-12-07T21:10:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.726+0000 7f0e33d33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:10:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.726+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b9ac20 con 0x7f0e2405c950 2023-12-07T21:10:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.726+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv7 ondisk = 0) v8 ==== 155+0+186 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.726+0000 7f0e33d33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 : miss 2023-12-07T21:10:18.722 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.726+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.726+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:96 8.11 8:892f04bf:root::.bucket.meta.myfoo7%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b9ab60 con 0x55bf57b53d40 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.727+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(96 .bucket.meta.myfoo7:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 [call out=48b,stat out=16b,read 0~355 out=355b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 334+0+637 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.727+0000 7f0e33d33800 20 rados_obj.operate() r=0 bl.length=355 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.727+0000 7f0e33d33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 info.flags=0x17 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.727+0000 7f0e33d33800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 to cache LRU end 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.727+0000 7f0e33d33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.727+0000 7f0e33d33800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.727+0000 7f0e33d33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.727+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:97 4.27 4:e62840c3:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57c184c0 con 0x55bf57b4dc20 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.727+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(97 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.727+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:98 4.3e 4:7c78c1bc:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57c184c0 con 0x7f0e20017050 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.728+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(98 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.1 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.728+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:99 4.32 4:4ddef5d1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57c184c0 con 0x55bf57b4dc20 2023-12-07T21:10:18.723 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.728+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(99 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.2 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.728+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:100 4.7 4:e3fdd46b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57c18500 con 0x7f0e2405c950 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.728+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(100 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.728+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:101 4.d 4:b387a8a6:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57c18500 con 0x7f0e20017050 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.729+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(101 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.4 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.729+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:102 4.29 4:95e36029:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57c18500 con 0x55bf57b53d40 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.729+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 28 ==== osd_op_reply(102 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5 [call out=378b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+378 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.729+0000 7f0e33d33800 10 cls_bucket_list_unordered: got fourteen 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.729+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:103 4.3c 4:3f6bbefd:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57c18500 con 0x55bf57b4dc20 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.729+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(103 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.730+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:104 4.18 4:1be6f0ea:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57c18500 con 0x7f0e20017050 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.730+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(104 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.7 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.724 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.730+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:105 4.32 4:4fb8062a:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57c18500 con 0x55bf57b4dc20 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.730+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(105 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.8 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.730+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:106 4.3f 4:fc49d04b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57c18500 con 0x7f0e20017050 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.730+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(106 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.9 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.730+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:107 4.28 4:169c1a7b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57c18500 con 0x55bf57b4dc20 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.731+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(107 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.731+0000 7f0e33d33800 20 get_obj_state: octx=0x7f0e2404a9d0 obj=myfoo7:fourteen state=0x55bf57b9be58 s->prefetch_data=0 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.731+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:108 3.4s0 3:2232fdc7:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b9cc60 con 0x7f0e2405c950 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.731+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(108 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 239+0+874 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.731+0000 7f0e33d33800 10 manifest: total_size = 8 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.731+0000 7f0e33d33800 20 get_obj_state: setting s->obj_tag to ef4a9585-c98e-4264-8c5b-7c4065599143.4222.11250170663637861394 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.731+0000 7f0e33d33800 20 get_obj_state: octx=0x7f0e2404a9d0 obj=myfoo7:fourteen state=0x55bf57b9be58 s->prefetch_data=0 2023-12-07T21:10:18.732 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.731+0000 7f0e33d33800 20 prepare_atomic_modification: state is not atomic. state=0x55bf57b9be58 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.731+0000 7f0e33d33800 20 bucket index object: :.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.731+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:109 4.29 4:95e36029:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba1510 con 0x55bf57b53d40 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.732+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 29 ==== osd_op_reply(109 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5 [stat,call,call] v33'4 uv4 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.732+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:110 3.4s0 3:2232fdc7:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b9f4f0 con 0x7f0e2405c950 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(110 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10_fourteen [call] v33'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:111 4.29 4:95e36029:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba1510 con 0x55bf57b53d40 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 20 list_objects_ordered: starting attempt 1 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:112 4.27 4:e62840c3:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba1510 con 0x55bf57b4dc20 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:113 4.3e 4:7c78c1bc:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba1510 con 0x7f0e20017050 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:114 4.32 4:4ddef5d1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba1510 con 0x55bf57b4dc20 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:115 4.7 4:e3fdd46b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57baa0a0 con 0x7f0e2405c950 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:116 4.d 4:b387a8a6:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57bac9b0 con 0x7f0e20017050 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:117 4.29 4:95e36029:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57baf300 con 0x55bf57b53d40 2023-12-07T21:10:18.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:118 4.3c 4:3f6bbefd:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57bb2100 con 0x55bf57b4dc20 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:119 4.18 4:1be6f0ea:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57bb4ae0 con 0x7f0e20017050 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(112 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.734+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:120 4.32 4:4fb8062a:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57bb74a0 con 0x55bf57b4dc20 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(115 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 22 ==== osd_op_reply(113 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.1 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 23 ==== osd_op_reply(116 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.4 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(114 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.2 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 35 ==== osd_op_reply(118 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 36 ==== osd_op_reply(120 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.8 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:121 4.3f 4:fc49d04b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57bb74a0 con 0x7f0e20017050 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:122 4.28 4:169c1a7b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57bab9a0 con 0x55bf57b4dc20 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 24 ==== osd_op_reply(119 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.7 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 30 ==== osd_op_reply(111 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5 [stat,call,call] v33'5 uv5 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e16ffd640 20 handle_completion(): completion ok for obj=fourteen 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.735+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 25 ==== osd_op_reply(121 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.9 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 37 ==== osd_op_reply(122 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 31 ==== osd_op_reply(117 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10])"; uploads.size()=0; is_truncated=0 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:123 4.27 4:e62840c3:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57baf300 con 0x55bf57b4dc20 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:124 4.3e 4:7c78c1bc:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57bab9a0 con 0x7f0e20017050 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:125 4.32 4:4ddef5d1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57babd90 con 0x55bf57b4dc20 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:126 4.7 4:e3fdd46b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57bac180 con 0x7f0e2405c950 2023-12-07T21:10:18.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:127 4.d 4:b387a8a6:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57baf300 con 0x7f0e20017050 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:128 4.29 4:95e36029:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57bab9a0 con 0x55bf57b53d40 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:129 4.3c 4:3f6bbefd:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57baf300 con 0x55bf57b4dc20 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:130 4.18 4:1be6f0ea:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57babd90 con 0x7f0e20017050 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:131 4.32 4:4fb8062a:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57bb7400 con 0x55bf57b4dc20 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:132 4.3f 4:fc49d04b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba8d00 con 0x7f0e20017050 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:133 4.28 4:169c1a7b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba9910 con 0x55bf57b4dc20 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 26 ==== osd_op_reply(124 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.1 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 30 ==== osd_op_reply(126 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 32 ==== osd_op_reply(128 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 38 ==== osd_op_reply(123 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.0 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 39 ==== osd_op_reply(125 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.2 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 40 ==== osd_op_reply(129 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 27 ==== osd_op_reply(127 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.4 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.736 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.736+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 28 ==== osd_op_reply(130 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.7 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.737+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 29 ==== osd_op_reply(132 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.9 [call out=85b] v0'0 uv12 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.737+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 41 ==== osd_op_reply(131 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.8 [call out=85b] v0'0 uv10 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.737+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 42 ==== osd_op_reply(133 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.737+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba8d00 con 0x7f0e2405c950 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 31 ==== osd_op_reply(134 fud.buckets [call] v33'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e33d33800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba8d00 con 0x7f0e20017050 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 30 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv54 ondisk = 0) v8 ==== 192+0+216 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e33d33800 20 rados_obj.operate() r=0 bl.length=168 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e33d33800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e33d33800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e33d33800 10 removing default.rgw.meta+root+myfoo7 from cache 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e33d33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2023-12-07T21:10:18.737 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:136 7.e 7:7759931f:::notify.3:head [notify cookie 94280298972560 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba8d00 con 0x7f0e20017050 2023-12-07T21:10:18.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 31 ==== watch-notify(notify (1) cookie 94280298639712 notify 141733920792 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x55bf57a87f70 con 0x7f0e20017050 2023-12-07T21:10:18.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94280298639712 notifier 4678 bl.length()=150 2023-12-07T21:10:18.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 32 ==== osd_op_reply(136 notify.3 [notify cookie 94280298972560 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.738+0000 7f0e16ffd640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0e04004160 con 0x7f0e20017050 2023-12-07T21:10:18.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.739+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 33 ==== osd_op_reply(137 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.739+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 34 ==== watch-notify(notify_complete (2) cookie 94280298972560 notify 141733920792 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0e2404e070 con 0x7f0e20017050 2023-12-07T21:10:18.738 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.739+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:138 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba8d00 con 0x7f0e20017050 2023-12-07T21:10:18.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.740+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 35 ==== osd_op_reply(138 myfoo7 [call,call,delete] v33'55 uv55 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.740+0000 7f0e33d33800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 from cache 2023-12-07T21:10:18.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.740+0000 7f0e33d33800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10, ofs0, ns] 2023-12-07T21:10:18.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.740+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:139 7.0 7:05bf5b68:::notify.1:head [notify cookie 94280298972560 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba8d00 con 0x55bf57b4dc20 2023-12-07T21:10:18.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.740+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 43 ==== watch-notify(notify (1) cookie 94280298625760 notify 141733920791 ret 0) v3 ==== 250+0+0 (crc 0 0 0) 0x7f0e28059380 con 0x55bf57b4dc20 2023-12-07T21:10:18.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.740+0000 7f0e16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94280298625760 notifier 4678 bl.length()=208 2023-12-07T21:10:18.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.740+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 44 ==== osd_op_reply(139 notify.1 [notify cookie 94280298972560 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.740+0000 7f0e16ffd640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0e04004160 con 0x55bf57b4dc20 2023-12-07T21:10:18.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.741+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 45 ==== osd_op_reply(140 notify.1 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.745 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.741+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 46 ==== watch-notify(notify_complete (2) cookie 94280298972560 notify 141733920791 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0e28047040 con 0x55bf57b4dc20 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.741+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:141 8.11 8:892f04bf:root::.bucket.meta.myfoo7%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b9c290 con 0x55bf57b53d40 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 33 ==== osd_op_reply(141 .bucket.meta.myfoo7:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 [call,call,delete] v33'2 uv2 ondisk = 0) v8 ==== 292+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:142 4.27 4:e62840c3:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba86c0 con 0x55bf57b4dc20 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:143 4.3e 4:7c78c1bc:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba9230 con 0x7f0e20017050 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:144 4.32 4:4ddef5d1:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba9590 con 0x55bf57b4dc20 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:145 4.7 4:e3fdd46b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b99350 con 0x7f0e2405c950 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:146 4.d 4:b387a8a6:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b99bd0 con 0x7f0e20017050 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:147 4.29 4:95e36029:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba9230 con 0x55bf57b53d40 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:148 4.3c 4:3f6bbefd:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b99350 con 0x55bf57b4dc20 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:149 4.18 4:1be6f0ea:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b9bbc0 con 0x7f0e20017050 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:150 4.32 4:4fb8062a:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57baa4d0 con 0x55bf57b4dc20 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:151 4.3f 4:fc49d04b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b99350 con 0x7f0e20017050 2023-12-07T21:10:18.746 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.742+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:152 4.28 4:169c1a7b:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57bab1c0 con 0x55bf57b4dc20 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.744+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 47 ==== osd_op_reply(148 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.6 [delete] v33'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.744+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 32 ==== osd_op_reply(145 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.3 [delete] v33'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.744+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 34 ==== osd_op_reply(147 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.5 [delete] v33'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 48 ==== osd_op_reply(142 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.0 [delete] v33'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 36 ==== osd_op_reply(149 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.7 [delete] v33'13 uv13 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 49 ==== osd_op_reply(152 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.10 [delete] v33'4 uv4 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 37 ==== osd_op_reply(151 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.9 [delete] v33'13 uv13 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 38 ==== osd_op_reply(146 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.4 [delete] v33'10 uv10 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 39 ==== osd_op_reply(143 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.1 [delete] v33'5 uv5 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 50 ==== osd_op_reply(144 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.2 [delete] v33'11 uv11 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 51 ==== osd_op_reply(150 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10.8 [delete] v33'12 uv12 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e33d33800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 : miss 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e33d33800 20 rados->read ofs=0 len=0 2023-12-07T21:10:18.747 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:153 6.3 6:c4be3248:::pubsub..bucket.myfoo7%2fef4a9585-c98e-4264-8c5b-7c4065599143.4222.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba9210 con 0x7f0e20017050 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 40 ==== osd_op_reply(153 pubsub..bucket.myfoo7/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e33d33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e33d33800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 info.flags=0x0 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e33d33800 10 adding default.rgw.log++pubsub..bucket.myfoo7/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 to cache LRU end 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e33d33800 10 removing default.rgw.log++pubsub..bucket.myfoo7/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 from cache 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e33d33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo7/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10, ofs0, ns] 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.745+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:154 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94280298972560 in=217b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba9210 con 0x7f0e2405c950 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.746+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 33 ==== watch-notify(notify (1) cookie 94280298644592 notify 141733920810 ret 0) v3 ==== 247+0+0 (crc 0 0 0) 0x7f0e28047040 con 0x7f0e2405c950 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.746+0000 7f0e16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920810 cookie 94280298644592 notifier 4678 bl.length()=205 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.746+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 34 ==== osd_op_reply(154 notify.6 [notify cookie 94280298972560 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.746+0000 7f0e16ffd640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:155 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0e04004160 con 0x7f0e2405c950 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.746+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 35 ==== osd_op_reply(155 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.746+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 36 ==== watch-notify(notify_complete (2) cookie 94280298972560 notify 141733920810 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55bf57b42ea0 con 0x7f0e2405c950 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.746+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:156 6.3 6:c4be3248:::pubsub..bucket.myfoo7%2fef4a9585-c98e-4264-8c5b-7c4065599143.4222.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba9210 con 0x7f0e20017050 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.747+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 41 ==== osd_op_reply(156 pubsub..bucket.myfoo7/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.10 [delete] v33'74 uv55 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.747+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:157 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba9210 con 0x7f0e2405c950 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.748+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 37 ==== osd_op_reply(157 fud.buckets [call] v33'9 uv9 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.748+0000 7f0e33d33800 10 removing key index: p5YnriCv1nAtykxBrupQ 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.748+0000 7f0e33d33800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.748+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify cookie 94280298972560 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b9c010 con 0x55bf57b53d40 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.748+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 35 ==== watch-notify(notify (1) cookie 94280298635040 notify 141733920775 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f0e20055000 con 0x55bf57b53d40 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.748+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 36 ==== osd_op_reply(158 notify.2 [notify cookie 94280298972560 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.748+0000 7f0e167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94280298635040 notifier 4678 bl.length()=170 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.748+0000 7f0e167fc640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:159 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0d740032a0 con 0x55bf57b53d40 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.749+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 37 ==== watch-notify(notify_complete (2) cookie 94280298972560 notify 141733920775 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0e20034040 con 0x55bf57b53d40 2023-12-07T21:10:18.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.749+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 38 ==== osd_op_reply(159 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.749+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:160 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b9c010 con 0x7f0e2405c950 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 38 ==== osd_op_reply(160 p5YnriCv1nAtykxBrupQ [delete] v33'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e33d33800 10 removing email index: 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e33d33800 10 removing user buckets index 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e33d33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94280298972560 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b9c010 con 0x7f0e2405c950 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 39 ==== watch-notify(notify (1) cookie 94280298644592 notify 141733920811 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x55bf57b42ea0 con 0x7f0e2405c950 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920811 cookie 94280298644592 notifier 4678 bl.length()=160 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 40 ==== osd_op_reply(161 notify.6 [notify cookie 94280298972560 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e167fc640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:162 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0d740032a0 con 0x7f0e2405c950 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 41 ==== osd_op_reply(162 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 42 ==== watch-notify(notify_complete (2) cookie 94280298972560 notify 141733920811 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55bf57b42a40 con 0x7f0e2405c950 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.750+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:163 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba86c0 con 0x7f0e2405c950 2023-12-07T21:10:18.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.751+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 43 ==== osd_op_reply(163 fud.buckets [delete] v33'10 uv10 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.751+0000 7f0e33d33800 10 removing user index: fud 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.751+0000 7f0e33d33800 10 removing default.rgw.meta+users.uid+fud from cache 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.751+0000 7f0e33d33800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.751+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94280298972560 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba86c0 con 0x7f0e2405c950 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.751+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 44 ==== watch-notify(notify (1) cookie 94280298632400 notify 141733920812 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x55bf57b42a40 con 0x7f0e2405c950 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.751+0000 7f0e16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920812 cookie 94280298632400 notifier 4678 bl.length()=152 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.751+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 45 ==== osd_op_reply(164 notify.5 [notify cookie 94280298972560 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.751+0000 7f0e16ffd640 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0e04004160 con 0x7f0e2405c950 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.752+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 46 ==== watch-notify(notify_complete (2) cookie 94280298972560 notify 141733920812 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f0e2800a0e0 con 0x7f0e2405c950 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.752+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 47 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.752+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:166 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba86c0 con 0x7f0e2405c950 2023-12-07T21:10:18.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.753+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 48 ==== osd_op_reply(166 fud [call,call,delete] v33'9 uv9 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.754+0000 7f0df5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:18.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.754+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:167 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94280298651888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba86c0 con 0x55bf57b4dc20 2023-12-07T21:10:18.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.755+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 52 ==== osd_op_reply(167 data_loggenerations_metadata [watch unwatch cookie 94280298651888] v33'227 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.755+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:168 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94280296206160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b659b0 con 0x7f0e20017050 2023-12-07T21:10:18.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.756+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 42 ==== osd_op_reply(168 notify.0 [watch unwatch cookie 94280296206160] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.756+0000 7f0e33d33800 20 remove_watcher() i=0 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.756+0000 7f0e33d33800 2 removed watcher, disabling cache 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.756+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:169 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94280298625760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba86c0 con 0x55bf57b4dc20 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.757+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 53 ==== osd_op_reply(169 notify.1 [watch unwatch cookie 94280298625760] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.757+0000 7f0e33d33800 20 remove_watcher() i=1 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.757+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:170 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94280298635040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b659b0 con 0x55bf57b53d40 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.758+0000 7f0e2f97e640 1 -- 172.21.15.121:0/464280144 <== osd.3 v2:172.21.15.121:6800/4032235766 39 ==== osd_op_reply(170 notify.2 [watch unwatch cookie 94280298635040] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e20014070 con 0x55bf57b53d40 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.758+0000 7f0e33d33800 20 remove_watcher() i=2 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.758+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:171 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94280298639712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba86c0 con 0x7f0e20017050 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.759+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 <== osd.2 v2:172.21.15.121:6816/2557538450 43 ==== osd_op_reply(171 notify.3 [watch unwatch cookie 94280298639712] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e24070040 con 0x7f0e20017050 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.759+0000 7f0e33d33800 20 remove_watcher() i=3 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.759+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:172 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94280298642400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b659b0 con 0x55bf57b4dc20 2023-12-07T21:10:18.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.761+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.1 v2:172.21.15.121:6808/2140819418 54 ==== osd_op_reply(172 notify.4 [watch unwatch cookie 94280298642400] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x55bf57b4dc20 2023-12-07T21:10:18.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.761+0000 7f0e33d33800 20 remove_watcher() i=4 2023-12-07T21:10:18.755 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.761+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:173 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94280298632400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba86c0 con 0x7f0e2405c950 2023-12-07T21:10:18.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.762+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 49 ==== osd_op_reply(173 notify.5 [watch unwatch cookie 94280298632400] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.762+0000 7f0e33d33800 20 remove_watcher() i=5 2023-12-07T21:10:18.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.762+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:174 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94280298644592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57b659b0 con 0x7f0e2405c950 2023-12-07T21:10:18.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.763+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 50 ==== osd_op_reply(174 notify.6 [watch unwatch cookie 94280298644592] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.757 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.763+0000 7f0e33d33800 20 remove_watcher() i=6 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.763+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:175 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94280298650848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55bf57ba86c0 con 0x7f0e2405c950 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e3017f640 1 -- 172.21.15.121:0/464280144 <== osd.0 v2:172.21.15.89:6800/654939948 51 ==== osd_op_reply(175 notify.7 [watch unwatch cookie 94280298650848] v33'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0e2804bdb0 con 0x7f0e2405c950 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 20 remove_watcher() i=7 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0e2405c950 msgr2=0x7f0e24009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f0e2405c950 0x7f0e24009410 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55bf57b4dc20 msgr2=0x55bf57b500e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55bf57b4dc20 0x55bf57b500e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0e20017050 msgr2=0x7f0e20009350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f0e20017050 0x7f0e20009350 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55bf57b53d40 msgr2=0x55bf57b561b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55bf57b53d40 0x55bf57b561b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0e080360c0 msgr2=0x7f0e08038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0e080360c0 0x7f0e08038580 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0e24054000 tx=0x7f0e2404e000 comp rx=0 tx=0).stop 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 msgr2=0x55bf57b42500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.758 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 --2- 172.21.15.121:0/464280144 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57b2d740 0x55bf57b42500 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800a930 tx=0x7f0e28003370 comp rx=0 tx=0).stop 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 reap_dead start 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e2f17d640 1 -- 172.21.15.121:0/464280144 reap_dead start 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 shutdown_connections 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 >> 172.21.15.121:0/464280144 conn(0x55bf57a84550 msgr2=0x55bf57b334a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 shutdown_connections 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/464280144 wait complete. 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/1674936595 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0e1c036110 msgr2=0x7f0e1c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 --2- 172.21.15.121:0/1674936595 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0e1c036110 0x7f0e1c0385d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0e20001ed0 tx=0x7f0e2000de00 comp rx=0 tx=0).stop 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/1674936595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 msgr2=0x55bf579f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 --2- 172.21.15.121:0/1674936595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf579f5a10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0e20001080 tx=0x7f0e20000bc0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/1674936595 shutdown_connections 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 --2- 172.21.15.121:0/1674936595 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f0e1c036110 0x7f0e1c0385d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 --2- 172.21.15.121:0/1674936595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55bf57a80110 0x55bf579f5a10 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/1674936595 >> 172.21.15.121:0/1674936595 conn(0x55bf57a7b890 msgr2=0x55bf57b23810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/1674936595 shutdown_connections 2023-12-07T21:10:18.759 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:18.764+0000 7f0e33d33800 1 -- 172.21.15.121:0/1674936595 wait complete. 2023-12-07T21:10:58.762 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2023-12-07T21:10:58.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2023-12-07T21:10:58.763 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2023-12-07T21:10:58.813 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:58.813 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:58.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.822+0000 7f85c3732800 1 Processor -- start 2023-12-07T21:10:58.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.822+0000 7f85c3732800 1 -- start start 2023-12-07T21:10:58.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.822+0000 7f85c3732800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e6e93b7670 0x55e6e93b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.822+0000 7f85c3732800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e6e92ff7a0 con 0x55e6e93b3280 2023-12-07T21:10:58.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.822+0000 7f85c3732800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e6e92c8880 con 0x55e6e93b7670 2023-12-07T21:10:58.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.822+0000 7f85beb61640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e6e93b7670 0x55e6e93b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.822+0000 7f85bf362640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55e6e93b3280 0x55e6e93b36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:44482/0 (socket says 172.21.15.121:44482) 2023-12-07T21:10:58.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.822+0000 7f85bf362640 1 -- 172.21.15.121:0/2774907233 learned_addr learned my addr 172.21.15.121:0/2774907233 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:58.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.823+0000 7f85be360640 1 -- 172.21.15.121:0/2774907233 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379341526 0 0) 0x55e6e92ff7a0 con 0x55e6e93b3280 2023-12-07T21:10:58.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.823+0000 7f85be360640 1 -- 172.21.15.121:0/2774907233 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a8001e10 con 0x55e6e93b3280 2023-12-07T21:10:58.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.823+0000 7f85beb61640 1 -- 172.21.15.121:0/2774907233 >> v1:172.21.15.89:6789/0 conn(0x55e6e93b3280 legacy=0x55e6e93b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.815 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.823+0000 7f85beb61640 1 -- 172.21.15.121:0/2774907233 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6e93bb090 con 0x55e6e93b7670 2023-12-07T21:10:58.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.825+0000 7f85beb61640 1 --2- 172.21.15.121:0/2774907233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b7670 0x55e6e93b9a60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f85b400a470 tx=0x7f85b401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3046ce1caff0de8e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.825+0000 7f85be360640 1 -- 172.21.15.121:0/2774907233 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85b404ad60 con 0x55e6e93b7670 2023-12-07T21:10:58.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.825+0000 7f85be360640 1 -- 172.21.15.121:0/2774907233 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4052440 con 0x55e6e93b7670 2023-12-07T21:10:58.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.825+0000 7f85be360640 1 -- 172.21.15.121:0/2774907233 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85b4052700 con 0x55e6e93b7670 2023-12-07T21:10:58.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.826+0000 7f85c3732800 1 -- 172.21.15.121:0/2774907233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b7670 msgr2=0x55e6e93b9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.826+0000 7f85c3732800 1 --2- 172.21.15.121:0/2774907233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b7670 0x55e6e93b9a60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f85b400a470 tx=0x7f85b401cc80 comp rx=0 tx=0).stop 2023-12-07T21:10:58.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.826+0000 7f85c3732800 1 -- 172.21.15.121:0/2774907233 shutdown_connections 2023-12-07T21:10:58.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.826+0000 7f85c3732800 1 --2- 172.21.15.121:0/2774907233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b7670 0x55e6e93b9a60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.826+0000 7f85c3732800 1 -- 172.21.15.121:0/2774907233 >> 172.21.15.121:0/2774907233 conn(0x55e6e93ae980 msgr2=0x55e6e93b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:58.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.826+0000 7f85c3732800 1 -- 172.21.15.121:0/2774907233 shutdown_connections 2023-12-07T21:10:58.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.826+0000 7f85c3732800 1 -- 172.21.15.121:0/2774907233 wait complete. 2023-12-07T21:10:58.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.827+0000 7f85c3732800 1 Processor -- start 2023-12-07T21:10:58.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.827+0000 7f85c3732800 1 -- start start 2023-12-07T21:10:58.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.827+0000 7f85c3732800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e9329920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.819 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.827+0000 7f85c3732800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6e92c5db0 con 0x55e6e93b3280 2023-12-07T21:10:58.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.827+0000 7f85bf362640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e9329920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.827+0000 7f85bf362640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e9329920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55378/0 (socket says 172.21.15.121:55378) 2023-12-07T21:10:58.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.827+0000 7f85bf362640 1 -- 172.21.15.121:0/3308487606 learned_addr learned my addr 172.21.15.121:0/3308487606 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:58.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.828+0000 7f85bf362640 1 -- 172.21.15.121:0/3308487606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4005d20 con 0x55e6e93b3280 2023-12-07T21:10:58.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.828+0000 7f85bf362640 1 --2- 172.21.15.121:0/3308487606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e9329920 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f85b0001ca0 tx=0x7f85b000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f253735ac041037 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.828+0000 7f85bdb5f640 1 -- 172.21.15.121:0/3308487606 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85b000e470 con 0x55e6e93b3280 2023-12-07T21:10:58.822 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.828+0000 7f85bdb5f640 1 -- 172.21.15.121:0/3308487606 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b000e5d0 con 0x55e6e93b3280 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.828+0000 7f85bdb5f640 1 -- 172.21.15.121:0/3308487606 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85b000e8f0 con 0x55e6e93b3280 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.828+0000 7f85c3732800 1 -- 172.21.15.121:0/3308487606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 msgr2=0x55e6e9329920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.828+0000 7f85c3732800 1 --2- 172.21.15.121:0/3308487606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e9329920 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f85b0001ca0 tx=0x7f85b000b6c0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.828+0000 7f85c3732800 1 -- 172.21.15.121:0/3308487606 shutdown_connections 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.828+0000 7f85c3732800 1 --2- 172.21.15.121:0/3308487606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e9329920 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.829+0000 7f85c3732800 1 -- 172.21.15.121:0/3308487606 >> 172.21.15.121:0/3308487606 conn(0x55e6e93ae980 msgr2=0x55e6e9453900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.829+0000 7f85c3732800 1 -- 172.21.15.121:0/3308487606 shutdown_connections 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.829+0000 7f85c3732800 1 -- 172.21.15.121:0/3308487606 wait complete. 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.829+0000 7f85c3732800 1 Processor -- start 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.829+0000 7f85c3732800 1 -- start start 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.829+0000 7f85c3732800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e94612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.829+0000 7f85c3732800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6e92c16a0 con 0x55e6e93b3280 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.829+0000 7f85bf362640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e94612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.829+0000 7f85bf362640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e94612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55384/0 (socket says 172.21.15.121:55384) 2023-12-07T21:10:58.823 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.829+0000 7f85bf362640 1 -- 172.21.15.121:0/3146195773 learned_addr learned my addr 172.21.15.121:0/3146195773 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:58.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.830+0000 7f85bf362640 1 -- 172.21.15.121:0/3146195773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8001e10 con 0x55e6e93b3280 2023-12-07T21:10:58.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.830+0000 7f85bf362640 1 --2- 172.21.15.121:0/3146195773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e94612e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f85b000b700 tx=0x7f85b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.830+0000 7f85bcb5d640 1 -- 172.21.15.121:0/3146195773 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85b001f070 con 0x55e6e93b3280 2023-12-07T21:10:58.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.830+0000 7f85bcb5d640 1 -- 172.21.15.121:0/3146195773 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b0018640 con 0x55e6e93b3280 2023-12-07T21:10:58.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.830+0000 7f85c3732800 1 -- 172.21.15.121:0/3146195773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e6e9461820 con 0x55e6e93b3280 2023-12-07T21:10:58.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.830+0000 7f85bcb5d640 1 -- 172.21.15.121:0/3146195773 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85b0018980 con 0x55e6e93b3280 2023-12-07T21:10:58.824 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.830+0000 7f85c3732800 1 -- 172.21.15.121:0/3146195773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e6e9461d00 con 0x55e6e93b3280 2023-12-07T21:10:58.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.831+0000 7f85c3732800 1 Processor -- start 2023-12-07T21:10:58.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.831+0000 7f85c3732800 1 -- start start 2023-12-07T21:10:58.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.831+0000 7f85c3732800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 0x55e6e946d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.831+0000 7f85c3732800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6e925b890 con 0x55e6e946d530 2023-12-07T21:10:58.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.831+0000 7f85bcb5d640 1 -- 172.21.15.121:0/3146195773 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f85b0018ae0 con 0x55e6e93b3280 2023-12-07T21:10:58.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.831+0000 7f85bcb5d640 1 --2- 172.21.15.121:0/3146195773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85ac036110 0x7f85ac0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.830 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.831+0000 7f85bfb63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 0x55e6e946d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.831+0000 7f85bcb5d640 1 -- 172.21.15.121:0/3146195773 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f85b004ba00 con 0x55e6e93b3280 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.831+0000 7f85bfb63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 0x55e6e946d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55386/0 (socket says 172.21.15.121:55386) 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.831+0000 7f85bfb63640 1 -- 172.21.15.121:0/1027817142 learned_addr learned my addr 172.21.15.121:0/1027817142 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.831+0000 7f85bf362640 1 --2- 172.21.15.121:0/3146195773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85ac036110 0x7f85ac0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.832+0000 7f85bfb63640 1 -- 172.21.15.121:0/1027817142 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6e946de90 con 0x55e6e946d530 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.832+0000 7f85bf362640 1 --2- 172.21.15.121:0/3146195773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85ac036110 0x7f85ac0385d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f85b000dfd0 tx=0x7f85b000ef90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.832+0000 7f85bfb63640 1 --2- 172.21.15.121:0/1027817142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 0x55e6e946d950 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f85b800a430 tx=0x7f85b800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45267a8eadd764a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.832+0000 7f85a67fc640 1 -- 172.21.15.121:0/1027817142 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85b8001650 con 0x55e6e946d530 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.832+0000 7f85a67fc640 1 -- 172.21.15.121:0/1027817142 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b80017d0 con 0x55e6e946d530 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.832+0000 7f85a67fc640 1 -- 172.21.15.121:0/1027817142 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85b8001ab0 con 0x55e6e946d530 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.832+0000 7f85c3732800 1 -- 172.21.15.121:0/1027817142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 msgr2=0x55e6e946d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.832+0000 7f85c3732800 1 --2- 172.21.15.121:0/1027817142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 0x55e6e946d950 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f85b800a430 tx=0x7f85b800a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.832+0000 7f85c3732800 1 -- 172.21.15.121:0/1027817142 shutdown_connections 2023-12-07T21:10:58.831 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.832+0000 7f85c3732800 1 --2- 172.21.15.121:0/1027817142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 0x55e6e946d950 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.832+0000 7f85c3732800 1 -- 172.21.15.121:0/1027817142 >> 172.21.15.121:0/1027817142 conn(0x55e6e93b7670 msgr2=0x55e6e9468910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.833+0000 7f85c3732800 1 -- 172.21.15.121:0/1027817142 shutdown_connections 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.833+0000 7f85c3732800 1 -- 172.21.15.121:0/1027817142 wait complete. 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.833+0000 7f85c3732800 1 Processor -- start 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.833+0000 7f85c3732800 1 -- start start 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.833+0000 7f85c3732800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 0x55e6e94744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.833+0000 7f85c3732800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6e925b530 con 0x55e6e946d530 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.833+0000 7f85bfb63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 0x55e6e94744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.833+0000 7f85bfb63640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 0x55e6e94744a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55398/0 (socket says 172.21.15.121:55398) 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.833+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 learned_addr learned my addr 172.21.15.121:0/2539259833 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.834+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b800a0e0 con 0x55e6e946d530 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.834+0000 7f85bfb63640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 0x55e6e94744a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f85b800ae40 tx=0x7f85b8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.834+0000 7f85a4ff9640 1 -- 172.21.15.121:0/2539259833 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85b80109e0 con 0x55e6e946d530 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.834+0000 7f85a4ff9640 1 -- 172.21.15.121:0/2539259833 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b8010b40 con 0x55e6e946d530 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.834+0000 7f85a4ff9640 1 -- 172.21.15.121:0/2539259833 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85b8010e20 con 0x55e6e946d530 2023-12-07T21:10:58.832 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.834+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e6e94749e0 con 0x55e6e946d530 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.834+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e6e9474e40 con 0x55e6e946d530 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.835+0000 7f85a4ff9640 1 -- 172.21.15.121:0/2539259833 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f85b8017070 con 0x55e6e946d530 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.835+0000 7f85a4ff9640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85980360c0 0x7f8598038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.835+0000 7f85a4ff9640 1 -- 172.21.15.121:0/2539259833 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f85b804bb00 con 0x55e6e946d530 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.835+0000 7f85beb61640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85980360c0 0x7f8598038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.836+0000 7f85beb61640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85980360c0 0x7f8598038580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85b4054000 tx=0x7f85b404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.836+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.836+0000 7f85c3732800 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e6e947fbc0 0x55e6e9482080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.836+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e94827d0 con 0x55e6e947fbc0 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.836+0000 7f85bfb63640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e6e947fbc0 0x55e6e9482080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.836+0000 7f85bfb63640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e6e947fbc0 0x55e6e9482080 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.836+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f85b800fc50 con 0x55e6e947fbc0 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.836+0000 7f85c3732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.833 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.836+0000 7f85c3732800 20 realm 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.836+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.836+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9482be0 con 0x55e6e947fbc0 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f85b800fc50 con 0x55e6e947fbc0 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85c3732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85c3732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9483460 con 0x55e6e947fbc0 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f85b800fc50 con 0x55e6e947fbc0 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85c3732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e94837c0 con 0x55e6e947fbc0 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f85b800fc50 con 0x55e6e947fbc0 2023-12-07T21:10:58.834 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85c3732800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.837+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9483fc0 con 0x55e6e947fbc0 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.838+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f85b800fc50 con 0x55e6e947fbc0 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.838+0000 7f85c3732800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.838+0000 7f85c3732800 20 searching for the correct realm 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.838+0000 7f85c3732800 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e6e9485ce0 0x55e6e9488150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.838+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e9485ce0 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.838+0000 7f85bf362640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e6e9485ce0 0x55e6e9488150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.838+0000 7f85bf362640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e6e9485ce0 0x55e6e9488150 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.838+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.838+0000 7f85bf362640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f85b0017050 0x7f85b004b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.838+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b0017050 2023-12-07T21:10:58.835 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.838+0000 7f85beb61640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f85b0017050 0x7f85b004b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.839+0000 7f85beb61640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f85b0017050 0x7f85b004b3e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.839+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b4059040 con 0x7f85b0017050 2023-12-07T21:10:58.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.839+0000 7f85beb61640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f85b405c440 0x7f85b405c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.839+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b405c440 2023-12-07T21:10:58.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.839+0000 7f85bfb63640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f85b405c440 0x7f85b405c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.844 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.840+0000 7f85bfb63640 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f85b405c440 0x7f85b405c840 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.840+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b800fc50 con 0x7f85b405c440 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.840+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e947fbc0 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.840+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b800fc50 con 0x55e6e947fbc0 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.840+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e947fbc0 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.841+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b800fc50 con 0x55e6e947fbc0 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.841+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b405c440 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.841+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.841+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b405c440 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.841+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.841+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b0017050 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.841+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b4059040 con 0x7f85b0017050 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.841+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e9485ce0 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.842+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.845 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.842+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e947fbc0 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.842+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.842+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b405c440 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.842+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.842+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e947fbc0 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.843+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.843+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b0017050 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.843+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f85b4066040 con 0x7f85b0017050 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.843+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e9485ce0 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.843+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.843+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e9485ce0 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.843+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.843+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b405c440 2023-12-07T21:10:58.846 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.844+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.844+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e9485ce0 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.844+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.844+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e9485ce0 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.844+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.844+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e947fbc0 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.844+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.844+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e947fbc0 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.845+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.845+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b405c440 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.845+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.845+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e9485ce0 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.845+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.845+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b0017050 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.846+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b4066040 con 0x7f85b0017050 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.846+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e947fbc0 2023-12-07T21:10:58.847 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.846+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.846+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b405c440 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.846+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.846+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e9485ce0 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.847+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.847+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b405c440 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.847+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.847+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b0017050 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.847+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b4066040 con 0x7f85b0017050 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.847+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e9485ce0 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.847+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.847+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b405c440 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x55e6e947fbc0 2023-12-07T21:10:58.848 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9488820 con 0x7f85b0017050 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f85b4066040 con 0x7f85b0017050 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85c3732800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85c3732800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85c3732800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85c3732800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85c3732800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85c3732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.848+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e94848c0 con 0x55e6e947fbc0 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9484540 con 0x55e6e947fbc0 2023-12-07T21:10:58.849 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9485290 con 0x55e6e9485ce0 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 20 zone default found 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 4 Realm: () 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 20 zonegroup default 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.849+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9489100 con 0x7f85b405c440 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.850 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85c3732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948ac00 con 0x55e6e9485ce0 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85c3732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948b090 con 0x55e6e9485ce0 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85c3732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85c3732800 20 started sync module instance, tier type = 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85c3732800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.850+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948a830 con 0x7f85b0017050 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.851+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b4066040 con 0x7f85b0017050 2023-12-07T21:10:58.851 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.851+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94450242269008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9489b00 con 0x7f85b0017050 2023-12-07T21:10:58.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.852+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948b950 con 0x55e6e947fbc0 2023-12-07T21:10:58.852 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.853+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94450242269008] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b4066040 con 0x7f85b0017050 2023-12-07T21:10:58.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.853+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.853+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94450244689776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948b950 con 0x55e6e947fbc0 2023-12-07T21:10:58.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.853+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948c3e0 con 0x55e6e9485ce0 2023-12-07T21:10:58.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.854+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94450244689776] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.854+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.856 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.854+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94450244695216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948b8c0 con 0x55e6e9485ce0 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.854+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948d110 con 0x7f85b0017050 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.855+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94450244695216] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.855+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b4066040 con 0x7f85b0017050 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.856+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94450244700320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948d960 con 0x7f85b0017050 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.856+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948e160 con 0x55e6e947fbc0 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.857+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94450244700320] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b4066040 con 0x7f85b0017050 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.857+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.857+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94450244705472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948e0d0 con 0x55e6e947fbc0 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.857+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948ee90 con 0x7f85b405c440 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.858+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.858+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94450244708784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948edc0 con 0x7f85b405c440 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.858+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948fcf0 con 0x7f85b405c440 2023-12-07T21:10:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.858+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94450244705472] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.859+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94450244708784] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.859+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.859+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94450244707600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948f850 con 0x7f85b405c440 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.859+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9490540 con 0x7f85b405c440 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.860+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94450244707600] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.861+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.861+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94450244710896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948f850 con 0x7f85b405c440 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.861+0000 7f85c3732800 20 add_watcher() i=0 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.861+0000 7f85c3732800 20 add_watcher() i=1 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.861+0000 7f85c3732800 20 add_watcher() i=2 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.861+0000 7f85c3732800 20 add_watcher() i=3 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.861+0000 7f85c3732800 20 add_watcher() i=4 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.861+0000 7f85c3732800 20 add_watcher() i=5 2023-12-07T21:10:58.858 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.861+0000 7f85c3732800 20 add_watcher() i=6 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.862+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94450244710896] v33'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.862+0000 7f85c3732800 20 add_watcher() i=7 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.862+0000 7f85c3732800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.862+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9493520 con 0x55e6e947fbc0 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.862+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.862+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94450244714576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e9490900 con 0x55e6e947fbc0 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.863+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94450244714576] v33'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.863+0000 7f85857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.863+0000 7f85c3732800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.863+0000 7f85c3732800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.863+0000 7f85c3732800 5 note: GC not initialized 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f84fffff640 20 reqs_thread_entry: start 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f85c3732800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f85c3732800 20 Filter name: none 2023-12-07T21:10:58.859 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f84fdffb640 20 reqs_thread_entry: start 2023-12-07T21:10:58.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f85c3732800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:10:58.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f85c3732800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e94c63f0 con 0x55e6e947fbc0 2023-12-07T21:10:58.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f85c3732800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:10:58.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f85c3732800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:10:58.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f85c3732800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:10:58.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f85c3732800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:10:58.860 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.864+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e94c8830 con 0x7f85b405c440 2023-12-07T21:10:58.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.866+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 usage.10 [call] v33'32 uv32 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.866+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e94c8830 con 0x7f85b405c440 2023-12-07T21:10:58.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.867+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(64 usage.10 [call] v33'33 uv32 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.868+0000 7f85857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:58.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.868+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94450244714576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e947c710 con 0x55e6e947fbc0 2023-12-07T21:10:58.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.869+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94450244714576] v33'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.861 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.869+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94450242269008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e947c710 con 0x7f85b0017050 2023-12-07T21:10:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.870+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94450242269008] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b4066040 con 0x7f85b0017050 2023-12-07T21:10:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.870+0000 7f85c3732800 20 remove_watcher() i=0 2023-12-07T21:10:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.870+0000 7f85c3732800 2 removed watcher, disabling cache 2023-12-07T21:10:58.862 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.870+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94450244689776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e94c4b20 con 0x55e6e947fbc0 2023-12-07T21:10:58.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.871+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94450244689776] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.871+0000 7f85c3732800 20 remove_watcher() i=1 2023-12-07T21:10:58.863 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.871+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94450244695216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e94c4b20 con 0x55e6e9485ce0 2023-12-07T21:10:58.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.872+0000 7f85bf362640 1 -- 172.21.15.121:0/2539259833 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94450244695216] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b0014070 con 0x55e6e9485ce0 2023-12-07T21:10:58.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.872+0000 7f85c3732800 20 remove_watcher() i=2 2023-12-07T21:10:58.864 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.872+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94450244700320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e94c4e80 con 0x7f85b0017050 2023-12-07T21:10:58.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.873+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94450244700320] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b4066040 con 0x7f85b0017050 2023-12-07T21:10:58.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.873+0000 7f85c3732800 20 remove_watcher() i=3 2023-12-07T21:10:58.865 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.873+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94450244705472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e94c51e0 con 0x55e6e947fbc0 2023-12-07T21:10:58.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.874+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94450244705472] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x55e6e947fbc0 2023-12-07T21:10:58.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.874+0000 7f85c3732800 20 remove_watcher() i=4 2023-12-07T21:10:58.866 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.874+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94450244708784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e94c51e0 con 0x7f85b405c440 2023-12-07T21:10:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.875+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94450244708784] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.875+0000 7f85c3732800 20 remove_watcher() i=5 2023-12-07T21:10:58.867 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.875+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94450244707600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948e990 con 0x7f85b405c440 2023-12-07T21:10:58.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.876+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94450244707600] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.876+0000 7f85c3732800 20 remove_watcher() i=6 2023-12-07T21:10:58.868 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.876+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94450244710896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e6e948e510 con 0x7f85b405c440 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85bfb63640 1 -- 172.21.15.121:0/2539259833 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94450244710896] v33'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f85b8038040 con 0x7f85b405c440 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 20 remove_watcher() i=7 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f85b405c440 msgr2=0x7f85b405c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f85b405c440 0x7f85b405c840 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e6e947fbc0 msgr2=0x55e6e9482080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e6e947fbc0 0x55e6e9482080 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f85b0017050 msgr2=0x7f85b004b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f85b0017050 0x7f85b004b3e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e6e9485ce0 msgr2=0x55e6e9488150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e6e9485ce0 0x55e6e9488150 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85980360c0 msgr2=0x7f8598038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85980360c0 0x7f8598038580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85b4054000 tx=0x7f85b404e000 comp rx=0 tx=0).stop 2023-12-07T21:10:58.871 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 msgr2=0x55e6e94744a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 --2- 172.21.15.121:0/2539259833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e946d530 0x55e6e94744a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f85b800ae40 tx=0x7f85b8003370 comp rx=0 tx=0).stop 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 reap_dead start 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85beb61640 1 -- 172.21.15.121:0/2539259833 reap_dead start 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 shutdown_connections 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 >> 172.21.15.121:0/2539259833 conn(0x55e6e93b7670 msgr2=0x55e6e9467710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 shutdown_connections 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/2539259833 wait complete. 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/3146195773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85ac036110 msgr2=0x7f85ac0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 --2- 172.21.15.121:0/3146195773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85ac036110 0x7f85ac0385d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f85b000dfd0 tx=0x7f85b000ef90 comp rx=0 tx=0).stop 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 -- 172.21.15.121:0/3146195773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 msgr2=0x55e6e94612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.878+0000 7f85c3732800 1 --2- 172.21.15.121:0/3146195773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e94612e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f85b000b700 tx=0x7f85b0000ed0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.879+0000 7f85c3732800 1 -- 172.21.15.121:0/3146195773 shutdown_connections 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.879+0000 7f85c3732800 1 --2- 172.21.15.121:0/3146195773 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f85ac036110 0x7f85ac0385d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.879+0000 7f85c3732800 1 --2- 172.21.15.121:0/3146195773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e6e93b3280 0x55e6e94612e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.872 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.879+0000 7f85c3732800 1 -- 172.21.15.121:0/3146195773 >> 172.21.15.121:0/3146195773 conn(0x55e6e93ae980 msgr2=0x55e6e9328270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:58.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.879+0000 7f85c3732800 1 -- 172.21.15.121:0/3146195773 shutdown_connections 2023-12-07T21:10:58.873 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.879+0000 7f85c3732800 1 -- 172.21.15.121:0/3146195773 wait complete. 2023-12-07T21:10:58.874 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2023-12-07T21:10:58.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2023-12-07T21:10:58.874 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2023-12-07T21:10:58.917 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:58.917 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:58.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.926+0000 7f53bf20f800 1 Processor -- start 2023-12-07T21:10:58.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.926+0000 7f53bf20f800 1 -- start start 2023-12-07T21:10:58.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.926+0000 7f53bf20f800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562a35284100 0x562a35284520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.926+0000 7f53bf20f800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562a351d17a0 con 0x562a35285310 2023-12-07T21:10:58.918 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.926+0000 7f53bf20f800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x562a3519a880 con 0x562a35284100 2023-12-07T21:10:58.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.926+0000 7f53ba7b1640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x562a35284100 0x562a35284520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.926+0000 7f53b9fb0640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x562a35285310 0x562a35285790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:44496/0 (socket says 172.21.15.121:44496) 2023-12-07T21:10:58.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.926+0000 7f53b9fb0640 1 -- 172.21.15.121:0/3912189457 learned_addr learned my addr 172.21.15.121:0/3912189457 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:58.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.927+0000 7f53ba7b1640 1 -- 172.21.15.121:0/3912189457 >> v1:172.21.15.89:6789/0 conn(0x562a35285310 legacy=0x562a35285790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.919 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.927+0000 7f53ba7b1640 1 -- 172.21.15.121:0/3912189457 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a35284bf0 con 0x562a35284100 2023-12-07T21:10:58.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.929+0000 7f53ba7b1640 1 --2- 172.21.15.121:0/3912189457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a35284520 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00a470 tx=0x7f53ac01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6838064ccb6caac2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.929+0000 7f53b97af640 1 -- 172.21.15.121:0/3912189457 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53ac052570 con 0x562a35284100 2023-12-07T21:10:58.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.929+0000 7f53b97af640 1 -- 172.21.15.121:0/3912189457 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac0526d0 con 0x562a35284100 2023-12-07T21:10:58.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.929+0000 7f53b97af640 1 -- 172.21.15.121:0/3912189457 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53ac052990 con 0x562a35284100 2023-12-07T21:10:58.921 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.929+0000 7f53bf20f800 1 -- 172.21.15.121:0/3912189457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 msgr2=0x562a35284520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.929+0000 7f53bf20f800 1 --2- 172.21.15.121:0/3912189457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a35284520 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00a470 tx=0x7f53ac01cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:58.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.929+0000 7f53bf20f800 1 -- 172.21.15.121:0/3912189457 shutdown_connections 2023-12-07T21:10:58.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.929+0000 7f53bf20f800 1 --2- 172.21.15.121:0/3912189457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a35284520 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.929+0000 7f53bf20f800 1 -- 172.21.15.121:0/3912189457 >> 172.21.15.121:0/3912189457 conn(0x562a3527f880 msgr2=0x562a35281ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:58.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.929+0000 7f53bf20f800 1 -- 172.21.15.121:0/3912189457 shutdown_connections 2023-12-07T21:10:58.922 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.929+0000 7f53bf20f800 1 -- 172.21.15.121:0/3912189457 wait complete. 2023-12-07T21:10:58.932 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.930+0000 7f53bf20f800 1 Processor -- start 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.930+0000 7f53bf20f800 1 -- start start 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.930+0000 7f53bf20f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a351f91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.930+0000 7f53bf20f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a35197db0 con 0x562a35284100 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.930+0000 7f53ba7b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a351f91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.930+0000 7f53ba7b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a351f91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55414/0 (socket says 172.21.15.121:55414) 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.930+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2265191389 learned_addr learned my addr 172.21.15.121:0/2265191389 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.931+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2265191389 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac005d20 con 0x562a35284100 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.931+0000 7f53ba7b1640 1 --2- 172.21.15.121:0/2265191389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a351f91b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f53ac055040 tx=0x7f53ac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d009d77b2e6f7e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.931+0000 7f53b8fae640 1 -- 172.21.15.121:0/2265191389 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53ac00a180 con 0x562a35284100 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.931+0000 7f53b8fae640 1 -- 172.21.15.121:0/2265191389 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac00a2e0 con 0x562a35284100 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.931+0000 7f53b8fae640 1 -- 172.21.15.121:0/2265191389 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53ac0529b0 con 0x562a35284100 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53bf20f800 1 -- 172.21.15.121:0/2265191389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 msgr2=0x562a351f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2265191389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a351f91b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f53ac055040 tx=0x7f53ac04c000 comp rx=0 tx=0).stop 2023-12-07T21:10:58.933 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53bf20f800 1 -- 172.21.15.121:0/2265191389 shutdown_connections 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2265191389 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a351f91b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53bf20f800 1 -- 172.21.15.121:0/2265191389 >> 172.21.15.121:0/2265191389 conn(0x562a3527f880 msgr2=0x562a35324d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53bf20f800 1 -- 172.21.15.121:0/2265191389 shutdown_connections 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53bf20f800 1 -- 172.21.15.121:0/2265191389 wait complete. 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53bf20f800 1 Processor -- start 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53bf20f800 1 -- start start 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53bf20f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a3532a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53bf20f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a351936a0 con 0x562a35284100 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53ba7b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a3532a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53ba7b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a3532a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55420/0 (socket says 172.21.15.121:55420) 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.932+0000 7f53ba7b1640 1 -- 172.21.15.121:0/1637900011 learned_addr learned my addr 172.21.15.121:0/1637900011 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.933+0000 7f53ba7b1640 1 -- 172.21.15.121:0/1637900011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac04e070 con 0x562a35284100 2023-12-07T21:10:58.934 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.933+0000 7f53ba7b1640 1 --2- 172.21.15.121:0/1637900011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a3532a8c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f53ac05e040 tx=0x7f53ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.933+0000 7f53ab7fe640 1 -- 172.21.15.121:0/1637900011 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53ac06a070 con 0x562a35284100 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.933+0000 7f53ab7fe640 1 -- 172.21.15.121:0/1637900011 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac052d90 con 0x562a35284100 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.933+0000 7f53bf20f800 1 -- 172.21.15.121:0/1637900011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a3532ae00 con 0x562a35284100 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.933+0000 7f53ab7fe640 1 -- 172.21.15.121:0/1637900011 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53ac05c540 con 0x562a35284100 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.933+0000 7f53bf20f800 1 -- 172.21.15.121:0/1637900011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a353293a0 con 0x562a35284100 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.933+0000 7f53bf20f800 1 Processor -- start 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53bf20f800 1 -- start start 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53bf20f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a3533fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53bf20f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a3512d890 con 0x562a3533fa00 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53ab7fe640 1 -- 172.21.15.121:0/1637900011 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f53ac059030 con 0x562a35284100 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53ab7fe640 1 --2- 172.21.15.121:0/1637900011 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f539c036110 0x7f539c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53bafb2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a3533fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53ab7fe640 1 -- 172.21.15.121:0/1637900011 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f53ac08c980 con 0x562a35284100 2023-12-07T21:10:58.935 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53bafb2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a3533fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55422/0 (socket says 172.21.15.121:55422) 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53bafb2640 1 -- 172.21.15.121:0/2485480328 learned_addr learned my addr 172.21.15.121:0/2485480328 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53ba7b1640 1 --2- 172.21.15.121:0/1637900011 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f539c036110 0x7f539c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53bafb2640 1 -- 172.21.15.121:0/2485480328 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a35340360 con 0x562a3533fa00 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53ba7b1640 1 --2- 172.21.15.121:0/1637900011 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f539c036110 0x7f539c0385d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0529a0 tx=0x7f53ac064f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.934+0000 7f53bafb2640 1 --2- 172.21.15.121:0/2485480328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a3533fe20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f53b400a430 tx=0x7f53b400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d879a15750bbd855 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53a97fa640 1 -- 172.21.15.121:0/2485480328 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53b4001650 con 0x562a3533fa00 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53a97fa640 1 -- 172.21.15.121:0/2485480328 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b40017d0 con 0x562a3533fa00 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53a97fa640 1 -- 172.21.15.121:0/2485480328 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53b4001ab0 con 0x562a3533fa00 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53bf20f800 1 -- 172.21.15.121:0/2485480328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 msgr2=0x562a3533fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2485480328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a3533fe20 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f53b400a430 tx=0x7f53b400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53bf20f800 1 -- 172.21.15.121:0/2485480328 shutdown_connections 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2485480328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a3533fe20 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53bf20f800 1 -- 172.21.15.121:0/2485480328 >> 172.21.15.121:0/2485480328 conn(0x562a35285310 msgr2=0x562a3533ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53bf20f800 1 -- 172.21.15.121:0/2485480328 shutdown_connections 2023-12-07T21:10:58.936 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53bf20f800 1 -- 172.21.15.121:0/2485480328 wait complete. 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53bf20f800 1 Processor -- start 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.935+0000 7f53bf20f800 1 -- start start 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f53bf20f800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a35346780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f53bf20f800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a3512d530 con 0x562a3533fa00 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f53bafb2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a35346780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f53bafb2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a35346780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55434/0 (socket says 172.21.15.121:55434) 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 learned_addr learned my addr 172.21.15.121:0/2709011036 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b400a0e0 con 0x562a3533fa00 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f53bafb2640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a35346780 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f53b400ae40 tx=0x7f53b4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f539b7fe640 1 -- 172.21.15.121:0/2709011036 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53b40109e0 con 0x562a3533fa00 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f539b7fe640 1 -- 172.21.15.121:0/2709011036 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b4010b40 con 0x562a3533fa00 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a35346cc0 con 0x562a3533fa00 2023-12-07T21:10:58.937 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f539b7fe640 1 -- 172.21.15.121:0/2709011036 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53b4010e20 con 0x562a3533fa00 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.936+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a35347120 con 0x562a3533fa00 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.937+0000 7f539b7fe640 1 -- 172.21.15.121:0/2709011036 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f53b4017070 con 0x562a3533fa00 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.937+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.937+0000 7f539b7fe640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53940360c0 0x7f5394038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.937+0000 7f539b7fe640 1 -- 172.21.15.121:0/2709011036 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f53b404bb00 con 0x562a3533fa00 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.937+0000 7f53b9fb0640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53940360c0 0x7f5394038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562a35351ed0 0x562a35354340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35354a90 con 0x562a35351ed0 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bafb2640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562a35351ed0 0x562a35354340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53b9fb0640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53940360c0 0x7f5394038580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f53b0000f60 tx=0x7f53b0001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bafb2640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562a35351ed0 0x562a35354340 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53b400fc50 con 0x562a35351ed0 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bf20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.938 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bf20f800 20 realm 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35354e80 con 0x562a35351ed0 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53b400fc50 con 0x562a35351ed0 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bf20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bf20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.938+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a353556d0 con 0x562a35351ed0 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53b400fc50 con 0x562a35351ed0 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bf20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35355a30 con 0x562a35351ed0 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f53b400fc50 con 0x562a35351ed0 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bf20f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:58.939 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35355370 con 0x562a35351ed0 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f53b400fc50 con 0x562a35351ed0 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bf20f800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bf20f800 20 searching for the correct realm 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562a35357c80 0x562a3535a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35357c80 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.939+0000 7f53ba7b1640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562a35357c80 0x562a3535a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.940+0000 7f53ba7b1640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562a35357c80 0x562a3535a070 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.940+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53ac0645e0 con 0x562a35357c80 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.940+0000 7f53ba7b1640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f53ac078060 0x7f53ac05b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.940+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53ac078060 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.940+0000 7f53b9fb0640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f53ac078060 0x7f53ac05b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.940 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.940+0000 7f53b9fb0640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f53ac078060 0x7f53ac05b5a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.940+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b0006070 con 0x7f53ac078060 2023-12-07T21:10:58.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.941+0000 7f53b9fb0640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f53b000d3d0 0x7f53b000d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:58.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.941+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53b000d3d0 2023-12-07T21:10:58.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.941+0000 7f53bafb2640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f53b000d3d0 0x7f53b000d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:58.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.941+0000 7f53bafb2640 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f53b000d3d0 0x7f53b000d830 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:58.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.941+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b400fc50 con 0x7f53b000d3d0 2023-12-07T21:10:58.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.941+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35351ed0 2023-12-07T21:10:58.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.942+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b400fc50 con 0x562a35351ed0 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.942+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35351ed0 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.942+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b400fc50 con 0x562a35351ed0 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.942+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53b000d3d0 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.942+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.942+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53b000d3d0 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.942+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.942+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53ac078060 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.943+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b0006070 con 0x7f53ac078060 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.943+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35357c80 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.943+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.943+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35351ed0 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.943+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.943+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53b000d3d0 2023-12-07T21:10:58.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.944+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.944+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35351ed0 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.944+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.944+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53ac078060 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.944+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f53b0006070 con 0x7f53ac078060 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.944+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35357c80 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.944+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.944+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35357c80 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.944+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.945+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53b000d3d0 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.945+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.945+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35357c80 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.945+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.945+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35357c80 2023-12-07T21:10:58.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.945+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.945+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35351ed0 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.946+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.946+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35351ed0 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.946+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.946+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53b000d3d0 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.946+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.946+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35357c80 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.946+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.946+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53ac078060 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.947+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b0006070 con 0x7f53ac078060 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.947+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35351ed0 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.947+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.953 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.947+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53b000d3d0 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.947+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.947+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35357c80 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.947+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.947+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53b000d3d0 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.948+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.948+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53ac078060 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.948+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b0006070 con 0x7f53ac078060 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.948+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35357c80 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.948+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.948+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53b000d3d0 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x562a35351ed0 2023-12-07T21:10:58.954 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535a650 con 0x7f53ac078060 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f53b0006070 con 0x7f53ac078060 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bf20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bf20f800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bf20f800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bf20f800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bf20f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bf20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a353568c0 con 0x562a35351ed0 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bf20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.949+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35356510 con 0x562a35351ed0 2023-12-07T21:10:58.955 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a353571a0 con 0x562a35357c80 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 20 zone default found 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 4 Realm: () 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 20 zonegroup default 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535af10 con 0x7f53b000d3d0 2023-12-07T21:10:58.956 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535ca10 con 0x562a35357c80 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.950+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.951+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535ce40 con 0x562a35357c80 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.951+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.951+0000 7f53bf20f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.951+0000 7f53bf20f800 20 started sync module instance, tier type = 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.951+0000 7f53bf20f800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.951+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535bd60 con 0x7f53ac078060 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.952+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b0006070 con 0x7f53ac078060 2023-12-07T21:10:58.957 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.952+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94739278909264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535c110 con 0x7f53ac078060 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.952+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535d720 con 0x562a35351ed0 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.953+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94739278909264] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b0006070 con 0x7f53ac078060 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.953+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.953+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94739281328320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535dad0 con 0x562a35351ed0 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.953+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535e2d0 con 0x562a35357c80 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.954+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94739281328320] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.954+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.954+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94739281334848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535e630 con 0x562a35357c80 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.954+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535efa0 con 0x7f53ac078060 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.955+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94739281334848] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.955+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b0026040 con 0x7f53ac078060 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.955+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94739281337392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535f7f0 con 0x7f53ac078060 2023-12-07T21:10:58.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.956+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35360030 con 0x562a35351ed0 2023-12-07T21:10:58.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.957+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.957+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94739281337392] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b0026040 con 0x7f53ac078060 2023-12-07T21:10:58.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.957+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94739281345360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35360880 con 0x562a35351ed0 2023-12-07T21:10:58.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.957+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35360d50 con 0x7f53b000d3d0 2023-12-07T21:10:58.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.958+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94739281345360] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.958+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.958+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94739281343312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35360800 con 0x7f53b000d3d0 2023-12-07T21:10:58.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.958+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a353615e0 con 0x7f53b000d3d0 2023-12-07T21:10:58.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.959+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94739281343312] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.959+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.959+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94739281350912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a353617c0 con 0x7f53b000d3d0 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.959+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35361fc0 con 0x7f53b000d3d0 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.960+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94739281350912] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.961+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.961+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94739281352640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35362070 con 0x7f53b000d3d0 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.961+0000 7f53bf20f800 20 add_watcher() i=0 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.961+0000 7f53bf20f800 20 add_watcher() i=1 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.961+0000 7f53bf20f800 20 add_watcher() i=2 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.961+0000 7f53bf20f800 20 add_watcher() i=3 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.961+0000 7f53bf20f800 20 add_watcher() i=4 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.961+0000 7f53bf20f800 20 add_watcher() i=5 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.961+0000 7f53bf20f800 20 add_watcher() i=6 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.961+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94739281352640] v33'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.961+0000 7f53bf20f800 20 add_watcher() i=7 2023-12-07T21:10:58.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.962+0000 7f53bf20f800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.962+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a353652f0 con 0x562a35351ed0 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.962+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.962+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94739281354048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a353625f0 con 0x562a35351ed0 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.963+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94739281354048] v33'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.963+0000 7f537b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.963+0000 7f53bf20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.963+0000 7f53bf20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.963+0000 7f53bf20f800 5 note: GC not initialized 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.963+0000 7f537a7fc640 20 reqs_thread_entry: start 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.963+0000 7f53bf20f800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.963+0000 7f53bf20f800 20 Filter name: none 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.963+0000 7f52ebfff640 20 reqs_thread_entry: start 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.964+0000 7f53bf20f800 20 rados->read ofs=0 len=0 2023-12-07T21:10:58.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.964+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35397f20 con 0x562a35351ed0 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.964+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.964+0000 7f53bf20f800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.964+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35397f20 con 0x7f53b000d3d0 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.964+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.965+0000 7f537b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.965+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94739281354048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35397f20 con 0x562a35351ed0 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.966+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94739281354048] v33'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.966+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94739278909264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35397f20 con 0x7f53ac078060 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.967+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94739278909264] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b0026040 con 0x7f53ac078060 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.967+0000 7f53bf20f800 20 remove_watcher() i=0 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.967+0000 7f53bf20f800 2 removed watcher, disabling cache 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.967+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94739281328320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a353644a0 con 0x562a35351ed0 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.968+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94739281328320] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.966 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.968+0000 7f53bf20f800 20 remove_watcher() i=1 2023-12-07T21:10:58.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.968+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94739281334848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a353644a0 con 0x562a35357c80 2023-12-07T21:10:58.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.969+0000 7f53ba7b1640 1 -- 172.21.15.121:0/2709011036 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94739281334848] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53ac059dc0 con 0x562a35357c80 2023-12-07T21:10:58.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.969+0000 7f53bf20f800 20 remove_watcher() i=2 2023-12-07T21:10:58.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.969+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94739281337392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35364800 con 0x7f53ac078060 2023-12-07T21:10:58.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.970+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94739281337392] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b0026040 con 0x7f53ac078060 2023-12-07T21:10:58.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.970+0000 7f53bf20f800 20 remove_watcher() i=3 2023-12-07T21:10:58.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.970+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94739281345360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35364b60 con 0x562a35351ed0 2023-12-07T21:10:58.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.971+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94739281345360] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x562a35351ed0 2023-12-07T21:10:58.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.971+0000 7f53bf20f800 20 remove_watcher() i=4 2023-12-07T21:10:58.967 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.971+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94739281343312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35364b60 con 0x7f53b000d3d0 2023-12-07T21:10:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.972+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94739281343312] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.972+0000 7f53bf20f800 20 remove_watcher() i=5 2023-12-07T21:10:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.972+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94739281350912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a3535f350 con 0x7f53b000d3d0 2023-12-07T21:10:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.973+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94739281350912] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.973+0000 7f53bf20f800 20 remove_watcher() i=6 2023-12-07T21:10:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.973+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94739281352640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x562a35361100 con 0x7f53b000d3d0 2023-12-07T21:10:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bafb2640 1 -- 172.21.15.121:0/2709011036 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94739281352640] v33'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f53b4038040 con 0x7f53b000d3d0 2023-12-07T21:10:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 20 remove_watcher() i=7 2023-12-07T21:10:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f53b000d3d0 msgr2=0x7f53b000d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f53b000d3d0 0x7f53b000d830 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562a35351ed0 msgr2=0x562a35354340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x562a35351ed0 0x562a35354340 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f53ac078060 msgr2=0x7f53ac05b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f53ac078060 0x7f53ac05b5a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562a35357c80 msgr2=0x562a3535a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x562a35357c80 0x562a3535a070 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53940360c0 msgr2=0x7f5394038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53940360c0 0x7f5394038580 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f53b0000f60 tx=0x7f53b0001230 comp rx=0 tx=0).stop 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 msgr2=0x562a35346780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a35346780 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f53b400ae40 tx=0x7f53b4003370 comp rx=0 tx=0).stop 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.974+0000 7f53b9fb0640 1 -- 172.21.15.121:0/2709011036 reap_dead start 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 shutdown_connections 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 --2- 172.21.15.121:0/2709011036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a3533fa00 0x562a35346780 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 >> 172.21.15.121:0/2709011036 conn(0x562a35285310 msgr2=0x562a35339be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 shutdown_connections 2023-12-07T21:10:58.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 -- 172.21.15.121:0/2709011036 wait complete. 2023-12-07T21:10:58.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 -- 172.21.15.121:0/1637900011 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f539c036110 msgr2=0x7f539c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 --2- 172.21.15.121:0/1637900011 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f539c036110 0x7f539c0385d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0529a0 tx=0x7f53ac064f20 comp rx=0 tx=0).stop 2023-12-07T21:10:58.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 -- 172.21.15.121:0/1637900011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 msgr2=0x562a3532a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:58.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 --2- 172.21.15.121:0/1637900011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a3532a8c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f53ac05e040 tx=0x7f53ac002fb0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 -- 172.21.15.121:0/1637900011 shutdown_connections 2023-12-07T21:10:58.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 --2- 172.21.15.121:0/1637900011 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f539c036110 0x7f539c0385d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 --2- 172.21.15.121:0/1637900011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x562a35284100 0x562a3532a8c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:58.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 -- 172.21.15.121:0/1637900011 >> 172.21.15.121:0/1637900011 conn(0x562a3527f880 msgr2=0x562a35327de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:58.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 -- 172.21.15.121:0/1637900011 shutdown_connections 2023-12-07T21:10:58.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:58.975+0000 7f53bf20f800 1 -- 172.21.15.121:0/1637900011 wait complete. 2023-12-07T21:10:58.973 INFO:teuthology.orchestra.run.smithi121.stdout:{"entries":[],"summary":[]} 2023-12-07T21:10:58.973 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2023-12-07T21:10:58.973 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2023-12-07T21:10:58.973 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2023-12-07T21:10:58.973 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2023-12-07T21:10:59.056 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:59.056 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.065+0000 7fa778122800 1 Processor -- start 2023-12-07T21:10:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.065+0000 7fa778122800 1 -- start start 2023-12-07T21:10:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.066+0000 7fa778122800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x561142eabb60 0x561142f39e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.066+0000 7fa778122800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561142e83740 con 0x561142f3a350 2023-12-07T21:10:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.066+0000 7fa778122800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x561142e4c880 con 0x561142eabb60 2023-12-07T21:10:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.066+0000 7fa773d1c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x561142eabb60 0x561142f39e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.066+0000 7fa76b51b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x561142f3a350 0x561142f3c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:44510/0 (socket says 172.21.15.121:44510) 2023-12-07T21:10:59.058 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.066+0000 7fa76b51b640 1 -- 172.21.15.121:0/1122616954 learned_addr learned my addr 172.21.15.121:0/1122616954 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:59.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.066+0000 7fa77351b640 1 -- 172.21.15.121:0/1122616954 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870568465 0 0) 0x561142e83740 con 0x561142f3a350 2023-12-07T21:10:59.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.066+0000 7fa77351b640 1 -- 172.21.15.121:0/1122616954 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa760001e10 con 0x561142f3a350 2023-12-07T21:10:59.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.066+0000 7fa773d1c640 1 -- 172.21.15.121:0/1122616954 >> v1:172.21.15.89:6789/0 conn(0x561142f3a350 legacy=0x561142f3c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.059 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.066+0000 7fa773d1c640 1 -- 172.21.15.121:0/1122616954 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561142f3f060 con 0x561142eabb60 2023-12-07T21:10:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.068+0000 7fa773d1c640 1 --2- 172.21.15.121:0/1122616954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142eabb60 0x561142f39e10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa76400a470 tx=0x7fa76401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726bc2043770206a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.068+0000 7fa77351b640 1 -- 172.21.15.121:0/1122616954 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa76404ad60 con 0x561142eabb60 2023-12-07T21:10:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.068+0000 7fa77351b640 1 -- 172.21.15.121:0/1122616954 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa764052440 con 0x561142eabb60 2023-12-07T21:10:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.068+0000 7fa77351b640 1 -- 172.21.15.121:0/1122616954 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7640526e0 con 0x561142eabb60 2023-12-07T21:10:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.069+0000 7fa778122800 1 -- 172.21.15.121:0/1122616954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142eabb60 msgr2=0x561142f39e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.069+0000 7fa778122800 1 --2- 172.21.15.121:0/1122616954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142eabb60 0x561142f39e10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa76400a470 tx=0x7fa76401cc80 comp rx=0 tx=0).stop 2023-12-07T21:10:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.069+0000 7fa778122800 1 -- 172.21.15.121:0/1122616954 shutdown_connections 2023-12-07T21:10:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.069+0000 7fa778122800 1 --2- 172.21.15.121:0/1122616954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142eabb60 0x561142f39e10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.069+0000 7fa778122800 1 -- 172.21.15.121:0/1122616954 >> 172.21.15.121:0/1122616954 conn(0x561142f31890 msgr2=0x561142f33cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.061 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.069+0000 7fa778122800 1 -- 172.21.15.121:0/1122616954 shutdown_connections 2023-12-07T21:10:59.062 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.069+0000 7fa778122800 1 -- 172.21.15.121:0/1122616954 wait complete. 2023-12-07T21:10:59.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.070+0000 7fa778122800 1 Processor -- start 2023-12-07T21:10:59.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.070+0000 7fa778122800 1 -- start start 2023-12-07T21:10:59.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.070+0000 7fa778122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142eabb60 0x561142f37530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.070+0000 7fa778122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561142e49db0 con 0x561142eabb60 2023-12-07T21:10:59.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.070+0000 7fa773d1c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142eabb60 0x561142f37530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.070+0000 7fa773d1c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142eabb60 0x561142f37530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55458/0 (socket says 172.21.15.121:55458) 2023-12-07T21:10:59.066 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.070+0000 7fa773d1c640 1 -- 172.21.15.121:0/1540961576 learned_addr learned my addr 172.21.15.121:0/1540961576 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.070+0000 7fa773d1c640 1 -- 172.21.15.121:0/1540961576 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764005d20 con 0x561142eabb60 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa773d1c640 1 --2- 172.21.15.121:0/1540961576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142eabb60 0x561142f37530 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa76401ccc0 tx=0x7fa76404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a13e84519c3fb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa772d1a640 1 -- 172.21.15.121:0/1540961576 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa76400a050 con 0x561142eabb60 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa772d1a640 1 -- 172.21.15.121:0/1540961576 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76400a1b0 con 0x561142eabb60 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa772d1a640 1 -- 172.21.15.121:0/1540961576 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7640525b0 con 0x561142eabb60 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa778122800 1 -- 172.21.15.121:0/1540961576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142eabb60 msgr2=0x561142f37530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa778122800 1 --2- 172.21.15.121:0/1540961576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142eabb60 0x561142f37530 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa76401ccc0 tx=0x7fa76404c000 comp rx=0 tx=0).stop 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa778122800 1 -- 172.21.15.121:0/1540961576 shutdown_connections 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa778122800 1 --2- 172.21.15.121:0/1540961576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142eabb60 0x561142f37530 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa778122800 1 -- 172.21.15.121:0/1540961576 >> 172.21.15.121:0/1540961576 conn(0x561142f31890 msgr2=0x561142fd7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa778122800 1 -- 172.21.15.121:0/1540961576 shutdown_connections 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa778122800 1 -- 172.21.15.121:0/1540961576 wait complete. 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.071+0000 7fa778122800 1 Processor -- start 2023-12-07T21:10:59.067 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.072+0000 7fa778122800 1 -- start start 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.072+0000 7fa778122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142f3a350 0x561142fe54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.072+0000 7fa778122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561142e456a0 con 0x561142f3a350 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.072+0000 7fa773d1c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142f3a350 0x561142fe54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.072+0000 7fa773d1c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142f3a350 0x561142fe54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55460/0 (socket says 172.21.15.121:55460) 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.072+0000 7fa773d1c640 1 -- 172.21.15.121:0/790361728 learned_addr learned my addr 172.21.15.121:0/790361728 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.072+0000 7fa773d1c640 1 -- 172.21.15.121:0/790361728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561142f3f060 con 0x561142f3a350 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.072+0000 7fa773d1c640 1 --2- 172.21.15.121:0/790361728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142f3a350 0x561142fe54c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa76405e040 tx=0x7fa764002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.072+0000 7fa771d18640 1 -- 172.21.15.121:0/790361728 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa764052af0 con 0x561142f3a350 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.073+0000 7fa771d18640 1 -- 172.21.15.121:0/790361728 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa764052c50 con 0x561142f3a350 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.073+0000 7fa778122800 1 -- 172.21.15.121:0/790361728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561142fe5a00 con 0x561142f3a350 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.073+0000 7fa771d18640 1 -- 172.21.15.121:0/790361728 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa76406f470 con 0x561142f3a350 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.073+0000 7fa778122800 1 -- 172.21.15.121:0/790361728 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561142fe5ee0 con 0x561142f3a350 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.073+0000 7fa778122800 1 Processor -- start 2023-12-07T21:10:59.068 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.073+0000 7fa778122800 1 -- start start 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.073+0000 7fa778122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 0x561142ff2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.073+0000 7fa778122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561142ddf890 con 0x561142ff1d40 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa771d18640 1 -- 172.21.15.121:0/790361728 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa76406c070 con 0x561142f3a350 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa771d18640 1 --2- 172.21.15.121:0/790361728 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa754036110 0x7fa7540385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa77451d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 0x561142ff2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa771d18640 1 -- 172.21.15.121:0/790361728 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fa76408cf40 con 0x561142f3a350 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa77451d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 0x561142ff2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55462/0 (socket says 172.21.15.121:55462) 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa77451d640 1 -- 172.21.15.121:0/1341860690 learned_addr learned my addr 172.21.15.121:0/1341860690 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa773d1c640 1 --2- 172.21.15.121:0/790361728 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa754036110 0x7fa7540385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa77451d640 1 -- 172.21.15.121:0/1341860690 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561142ff26a0 con 0x561142ff1d40 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa773d1c640 1 --2- 172.21.15.121:0/790361728 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa754036110 0x7fa7540385d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa764052fd0 tx=0x7fa7640445e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa77451d640 1 --2- 172.21.15.121:0/1341860690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 0x561142ff2160 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00a430 tx=0x7fa76c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ad6fac4648f92e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa76ad1a640 1 -- 172.21.15.121:0/1341860690 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa76c001650 con 0x561142ff1d40 2023-12-07T21:10:59.069 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa76ad1a640 1 -- 172.21.15.121:0/1341860690 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c0017d0 con 0x561142ff1d40 2023-12-07T21:10:59.070 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.074+0000 7fa76ad1a640 1 -- 172.21.15.121:0/1341860690 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa76c001ab0 con 0x561142ff1d40 2023-12-07T21:10:59.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa778122800 1 -- 172.21.15.121:0/1341860690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 msgr2=0x561142ff2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa778122800 1 --2- 172.21.15.121:0/1341860690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 0x561142ff2160 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00a430 tx=0x7fa76c00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa778122800 1 -- 172.21.15.121:0/1341860690 shutdown_connections 2023-12-07T21:10:59.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa778122800 1 --2- 172.21.15.121:0/1341860690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 0x561142ff2160 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa778122800 1 -- 172.21.15.121:0/1341860690 >> 172.21.15.121:0/1341860690 conn(0x561142fec980 msgr2=0x561142fed860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa778122800 1 -- 172.21.15.121:0/1341860690 shutdown_connections 2023-12-07T21:10:59.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa778122800 1 -- 172.21.15.121:0/1341860690 wait complete. 2023-12-07T21:10:59.080 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa778122800 1 Processor -- start 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa778122800 1 -- start start 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa778122800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 0x561142ff8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa778122800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x561142ddf530 con 0x561142ff1d40 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa77451d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 0x561142ff8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.075+0000 7fa77451d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 0x561142ff8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55464/0 (socket says 172.21.15.121:55464) 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.076+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 learned_addr learned my addr 172.21.15.121:0/3070526015 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.076+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c00a0e0 con 0x561142ff1d40 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.076+0000 7fa77451d640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 0x561142ff8950 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00ae40 tx=0x7fa76c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.076+0000 7fa769517640 1 -- 172.21.15.121:0/3070526015 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa76c0109e0 con 0x561142ff1d40 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.076+0000 7fa769517640 1 -- 172.21.15.121:0/3070526015 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c010b40 con 0x561142ff1d40 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.076+0000 7fa769517640 1 -- 172.21.15.121:0/3070526015 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa76c010e20 con 0x561142ff1d40 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.076+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561142ff8e90 con 0x561142ff1d40 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.076+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561142ff92f0 con 0x561142ff1d40 2023-12-07T21:10:59.081 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.077+0000 7fa769517640 1 -- 172.21.15.121:0/3070526015 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa76c017070 con 0x561142ff1d40 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.077+0000 7fa769517640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa74c0360c0 0x7fa74c038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.077+0000 7fa769517640 1 -- 172.21.15.121:0/3070526015 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fa76c04bd00 con 0x561142ff1d40 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.077+0000 7fa76b51b640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa74c0360c0 0x7fa74c038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.078+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.078+0000 7fa778122800 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x561143004040 0x561143006500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.078+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143006c50 con 0x561143004040 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.078+0000 7fa76b51b640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa74c0360c0 0x7fa74c038580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa75c000f60 tx=0x7fa75c0010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.078+0000 7fa77451d640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x561143004040 0x561143006500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.078+0000 7fa77451d640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x561143004040 0x561143006500 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.078+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.078+0000 7fa778122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.078+0000 7fa778122800 20 realm 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.078+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.082 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.078+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143007060 con 0x561143004040 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430078e0 con 0x561143004040 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143007c40 con 0x561143004040 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143008440 con 0x561143004040 2023-12-07T21:10:59.083 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 20 searching for the correct realm 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56114300a160 0x56114300c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.079+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x56114300a160 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.080+0000 7fa773d1c640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56114300a160 0x56114300c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.080+0000 7fa773d1c640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56114300a160 0x56114300c5d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.080+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.080+0000 7fa773d1c640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x561142eabb60 0x7fa7640649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.080+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561142eabb60 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.080+0000 7fa76b51b640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x561142eabb60 0x7fa7640649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.080+0000 7fa76b51b640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x561142eabb60 0x7fa7640649c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.081+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.081+0000 7fa76b51b640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa75c00d3d0 0x7fa75c00d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.081+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.084 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.081+0000 7fa77451d640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa75c00d3d0 0x7fa75c00d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.082+0000 7fa77451d640 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa75c00d3d0 0x7fa75c00d830 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.082+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.082+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561143004040 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.082+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.082+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561143004040 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.082+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.082+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.082+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.082+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.083+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.083+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561142eabb60 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.083+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.083+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x56114300a160 2023-12-07T21:10:59.085 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.083+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.083+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561143004040 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.083+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.083+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.084+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.084+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561143004040 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.084+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.084+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561142eabb60 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.084+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.084+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x56114300a160 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.085+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.085+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x56114300a160 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.085+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.085+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.086 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.085+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.085+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x56114300a160 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.085+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.085+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x56114300a160 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.085+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.086+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561143004040 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.086+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.086+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561143004040 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.086+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.086+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.086+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.086+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x56114300a160 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.087+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.087+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561142eabb60 2023-12-07T21:10:59.087 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.087+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.087+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561143004040 2023-12-07T21:10:59.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.087+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.087+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.087+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.087+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x56114300a160 2023-12-07T21:10:59.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.088+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.088+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.088+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.088+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561142eabb60 2023-12-07T21:10:59.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.088+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.088 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.088+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x56114300a160 2023-12-07T21:10:59.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.088+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.089 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.088+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.095 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561143004040 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300cca0 con 0x561142eabb60 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa778122800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa778122800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa778122800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa778122800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa778122800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa778122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143008da0 con 0x561143004040 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.096 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa778122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.089+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430095f0 con 0x561143004040 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300d0e0 con 0x56114300a160 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 20 zone default found 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 4 Realm: () 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:59.097 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 20 zonegroup default 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300d480 con 0x7fa75c00d3d0 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.090+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300f260 con 0x56114300a160 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.091+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.091+0000 7fa778122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.091+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.091+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300f5c0 con 0x56114300a160 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.091+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.091+0000 7fa778122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.091+0000 7fa778122800 20 started sync module instance, tier type = 2023-12-07T21:10:59.098 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.091+0000 7fa778122800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.091+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300eb40 con 0x561142eabb60 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.092+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.092+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94632136142672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300eef0 con 0x561142eabb60 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.092+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300fe60 con 0x561143004040 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.093+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94632136142672] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.093+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.093+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94632138565280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300fe60 con 0x561143004040 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.093+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430108d0 con 0x56114300a160 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.095+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94632138565280] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.095+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.095+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94632138570176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114300fdd0 con 0x56114300a160 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.095+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430115c0 con 0x561142eabb60 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.096+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94632138570176] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.096+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.099 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.096+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94632138575280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143011e10 con 0x561142eabb60 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.096+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143012610 con 0x561143004040 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.097+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94632138575280] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.097+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.097+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94632138580336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143012580 con 0x561143004040 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.097+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143013300 con 0x7fa75c00d3d0 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.098+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94632138580336] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.099+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.099+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94632138582384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143013220 con 0x7fa75c00d3d0 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.099+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143013220 con 0x7fa75c00d3d0 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.100+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94632138582384] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.100+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.100+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94632138583424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143013c60 con 0x7fa75c00d3d0 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.100+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143013c60 con 0x7fa75c00d3d0 2023-12-07T21:10:59.100 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.101+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94632138583424] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.101+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.101+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94632138586528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143014310 con 0x7fa75c00d3d0 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.101+0000 7fa778122800 20 add_watcher() i=0 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.101+0000 7fa778122800 20 add_watcher() i=1 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.101+0000 7fa778122800 20 add_watcher() i=2 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.101+0000 7fa778122800 20 add_watcher() i=3 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.101+0000 7fa778122800 20 add_watcher() i=4 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.101+0000 7fa778122800 20 add_watcher() i=5 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.101+0000 7fa778122800 20 add_watcher() i=6 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.102+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94632138586528] v33'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.102+0000 7fa778122800 20 add_watcher() i=7 2023-12-07T21:10:59.101 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.102+0000 7fa778122800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:59.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.102+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143017810 con 0x561143004040 2023-12-07T21:10:59.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.102+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.102+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94632138587632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143014d50 con 0x561143004040 2023-12-07T21:10:59.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.103+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94632138587632] v33'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.103+0000 7fa739fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:59.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.103+0000 7fa778122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:59.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.103+0000 7fa778122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:59.102 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.103+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114301fdf0 con 0x561143004040 2023-12-07T21:10:59.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.104+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.104+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430202b0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.106+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.106+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430206d0 con 0x56114300a160 2023-12-07T21:10:59.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.107+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'30 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.107+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430210a0 con 0x561143004040 2023-12-07T21:10:59.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.107+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'233 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.108+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114301de40 con 0x561142eabb60 2023-12-07T21:10:59.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.108+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'75 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.104 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.109+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143021c10 con 0x56114300a160 2023-12-07T21:10:59.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.109+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.109+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430225e0 con 0x561143004040 2023-12-07T21:10:59.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.111+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.111+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430225e0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.112+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.105 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.112+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430225e0 con 0x561142eabb60 2023-12-07T21:10:59.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.113+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.113+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143022fb0 con 0x56114300a160 2023-12-07T21:10:59.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.114+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.114+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114301f160 con 0x561142eabb60 2023-12-07T21:10:59.106 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.115+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'76 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.115+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143023b20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.116+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'34 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.107 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.116+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143023b20 con 0x561142eabb60 2023-12-07T21:10:59.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.117+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.108 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.117+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143023fc0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.118+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'57 uv44 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.118+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143023fc0 con 0x561143004040 2023-12-07T21:10:59.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.119+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'234 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.110 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.119+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143023fc0 con 0x56114300a160 2023-12-07T21:10:59.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.120+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'68 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.112 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.120+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x561142eabb60 2023-12-07T21:10:59.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.121+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'77 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.121+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x56114300a160 2023-12-07T21:10:59.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.122+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.113 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.122+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x561143004040 2023-12-07T21:10:59.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.123+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.115 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.123+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x561143004040 2023-12-07T21:10:59.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.124+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'235 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.116 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.124+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x56114300a160 2023-12-07T21:10:59.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.125+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'69 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.117 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.125+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x561142eabb60 2023-12-07T21:10:59.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.126+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'38 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.118 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.126+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x56114300a160 2023-12-07T21:10:59.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.127+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.119 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.127+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x56114300a160 2023-12-07T21:10:59.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.128+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.120 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.128+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x56114300a160 2023-12-07T21:10:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.129+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'24 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.121 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.129+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x56114300a160 2023-12-07T21:10:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.130+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.122 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.130+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x7fa75c00d3d0 2023-12-07T21:10:59.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.131+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'31 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.123 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.131+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x56114300a160 2023-12-07T21:10:59.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.132+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.124 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.132+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x7fa75c00d3d0 2023-12-07T21:10:59.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.133+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.125 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.133+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x56114300a160 2023-12-07T21:10:59.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.134+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'70 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.126 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.134+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x7fa75c00d3d0 2023-12-07T21:10:59.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.135+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'58 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.127 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.135+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143024190 con 0x561142eabb60 2023-12-07T21:10:59.128 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.136+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa738fe1640 20 reqs_thread_entry: start 2023-12-07T21:10:59.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa778122800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:59.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa778122800 20 Filter name: none 2023-12-07T21:10:59.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa778122800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2023-12-07T21:10:59.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa6b27fc640 20 reqs_thread_entry: start 2023-12-07T21:10:59.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114304f1d0 con 0x561143004040 2023-12-07T21:10:59.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.131 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa778122800 20 rados_obj.operate() r=0 bl.length=357 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa778122800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa778122800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa778122800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.137+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114304e460 con 0x561142eabb60 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv53 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa778122800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 : miss 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:96 8.15 8:afc1d5e3:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143051360 con 0x56114300a160 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(96 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa778122800 20 rados_obj.operate() r=0 bl.length=352 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa778122800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 info.flags=0x17 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa778122800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 to cache LRU end 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa778122800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-07T21:10:59.132 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa778122800 10 updating xattr: name=user.rgw.acl bl.length()=123 2023-12-07T21:10:59.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa778122800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 2023-12-07T21:10:59.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.138+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:97 4.1 4:81be9fa0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430ce840 con 0x561142eabb60 2023-12-07T21:10:59.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.139+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(97 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.139+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:98 4.3e 4:7e7ba168:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430ce880 con 0x561142eabb60 2023-12-07T21:10:59.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.139+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(98 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.139+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:99 4.8 4:11667fb2:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430ce880 con 0x56114300a160 2023-12-07T21:10:59.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.139+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 28 ==== osd_op_reply(99 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.133 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.139+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:100 4.31 4:8f35a876:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430ce880 con 0x561143004040 2023-12-07T21:10:59.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.140+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(100 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.135 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.140+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:101 4.25 4:a7b703e6:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430ce880 con 0x56114300a160 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.140+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 29 ==== osd_op_reply(101 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4 [call out=425b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.140+0000 7fa778122800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.140+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 4.17 4:e9580091:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430cee40 con 0x7fa75c00d3d0 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.141+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(102 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.141+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 4.1c 4:3a23f5d0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430cee40 con 0x7fa75c00d3d0 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.141+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(103 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.141+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:104 4.1e 4:795475ec:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430cee40 con 0x7fa75c00d3d0 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.141+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(104 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.142+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:105 4.11 4:8b9a3403:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430cedf0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.142+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(105 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.142+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:106 4.32 4:4e70ad78:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430cedf0 con 0x561143004040 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.142+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(106 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.142+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:107 4.3c 4:3c4620ae:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430cedf0 con 0x561143004040 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.143+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(107 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.136 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.143+0000 7fa778122800 20 get_obj_state: octx=0x7fa75c001780 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5611430cc8a8 s->prefetch_data=0 2023-12-07T21:10:59.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.143+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:108 3.1s0 3:81dd16ae:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430cd6b0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.143+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(108 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.143+0000 7fa778122800 10 manifest: total_size = 6 2023-12-07T21:10:59.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.143+0000 7fa778122800 20 get_obj_state: setting s->obj_tag to ef4a9585-c98e-4264-8c5b-7c4065599143.4222.1881374992115458927 2023-12-07T21:10:59.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.143+0000 7fa778122800 20 get_obj_state: octx=0x7fa75c001780 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x5611430cc8a8 s->prefetch_data=0 2023-12-07T21:10:59.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.143+0000 7fa778122800 20 prepare_atomic_modification: state is not atomic. state=0x5611430cc8a8 2023-12-07T21:10:59.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.143+0000 7fa778122800 20 bucket index object: :.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4 2023-12-07T21:10:59.137 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.143+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:109 4.25 4:a7b703e6:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143055a00 con 0x56114300a160 2023-12-07T21:10:59.141 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.144+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 30 ==== osd_op_reply(109 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4 [stat,call,call] v33'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.144+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:110 3.1s0 3:81dd16ae:::ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430539e0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(110 ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7_15f6f8dc036519d7fe15b39338f6e5db [call] v33'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:111 4.25 4:a7b703e6:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143055a00 con 0x56114300a160 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 20 list_objects_ordered: starting attempt 1 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:112 4.1 4:81be9fa0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143055a00 con 0x561142eabb60 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:113 4.3e 4:7e7ba168:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143059d40 con 0x561142eabb60 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:114 4.8 4:11667fb2:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114305c630 con 0x56114300a160 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:115 4.31 4:8f35a876:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114305f320 con 0x561143004040 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:116 4.25 4:a7b703e6:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430620c0 con 0x56114300a160 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:117 4.17 4:e9580091:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:118 4.1c 4:3a23f5d0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143067d20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.142 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:119 4.1e 4:795475ec:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306ab20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:120 4.11 4:8b9a3403:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306d900 con 0x7fa75c00d3d0 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:121 4.32 4:4e70ad78:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114305c630 con 0x561143004040 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:122 4.3c 4:3c4620ae:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561143004040 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(112 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.146+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 31 ==== osd_op_reply(114 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 22 ==== osd_op_reply(113 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 30 ==== osd_op_reply(117 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 31 ==== osd_op_reply(119 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 32 ==== osd_op_reply(118 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 33 ==== osd_op_reply(120 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(115 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(121 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(122 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.143 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 32 ==== osd_op_reply(111 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4 [stat,call,call] v33'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa76ad1a640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 33 ==== osd_op_reply(116 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4 [call out=124b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa778122800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa778122800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa778122800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa778122800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa778122800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7])"; uploads.size()=0; is_truncated=0 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:123 4.1 4:81be9fa0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306ab20 con 0x561142eabb60 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:124 4.3e 4:7e7ba168:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561142eabb60 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:125 4.8 4:11667fb2:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430620c0 con 0x56114300a160 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:126 4.31 4:8f35a876:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306afb0 con 0x561143004040 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.147+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:127 4.25 4:a7b703e6:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306ab20 con 0x56114300a160 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:128 4.17 4:e9580091:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430620c0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:129 4.1c 4:3a23f5d0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306ab20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:130 4.1e 4:795475ec:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.144 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:131 4.11 4:8b9a3403:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114305ef20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:132 4.32 4:4e70ad78:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114305c630 con 0x561143004040 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:133 4.3c 4:3c4620ae:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306bcf0 con 0x561143004040 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 23 ==== osd_op_reply(123 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 24 ==== osd_op_reply(124 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 35 ==== osd_op_reply(126 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 34 ==== osd_op_reply(125 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.2 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 35 ==== osd_op_reply(127 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4 [call out=124b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 34 ==== osd_op_reply(129 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 36 ==== osd_op_reply(132 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.9 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 37 ==== osd_op_reply(133 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.10 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 35 ==== osd_op_reply(128 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 36 ==== osd_op_reply(130 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 37 ==== osd_op_reply(131 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.145 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.148+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430620c0 con 0x561142eabb60 2023-12-07T21:10:59.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.166+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 25 ==== osd_op_reply(134 foo.buckets [call] v33'56 uv56 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.166+0000 7fa778122800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2023-12-07T21:10:59.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.166+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.166+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430620c0 con 0x561142eabb60 2023-12-07T21:10:59.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 26 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv50 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.159 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa778122800 20 rados_obj.operate() r=0 bl.length=165 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa778122800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa778122800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa778122800 10 removing default.rgw.meta+root+myfoo from cache 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa778122800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:136 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94632138919664 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430620c0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 38 ==== watch-notify(notify (1) cookie 94632138583424 notify 141733920813 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7fa76c065060 con 0x7fa75c00d3d0 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 39 ==== osd_op_reply(136 notify.6 [notify cookie 94632138919664 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa76a519640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920813 cookie 94632138583424 notifier 4696 bl.length()=149 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa76a519640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa6b8003240 con 0x7fa75c00d3d0 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 40 ==== osd_op_reply(137 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 41 ==== watch-notify(notify_complete (2) cookie 94632138919664 notify 141733920813 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa76c057040 con 0x7fa75c00d3d0 2023-12-07T21:10:59.160 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.167+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:138 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430620c0 con 0x561142eabb60 2023-12-07T21:10:59.161 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.169+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 27 ==== osd_op_reply(138 myfoo [call,call,delete] v33'57 uv57 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.169+0000 7fa778122800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 from cache 2023-12-07T21:10:59.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.169+0000 7fa778122800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7, ofs0, ns] 2023-12-07T21:10:59.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.169+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:139 7.3 7:c609908c:::notify.5:head [notify cookie 94632138919664 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5611430620c0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.169+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 42 ==== watch-notify(notify (1) cookie 94632138582384 notify 141733920814 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x7fa76c057040 con 0x7fa75c00d3d0 2023-12-07T21:10:59.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.169+0000 7fa76a519640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920814 cookie 94632138582384 notifier 4696 bl.length()=206 2023-12-07T21:10:59.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.169+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 43 ==== osd_op_reply(139 notify.5 [notify cookie 94632138919664 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.169+0000 7fa76a519640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa6b8003290 con 0x7fa75c00d3d0 2023-12-07T21:10:59.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.169+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 44 ==== osd_op_reply(140 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.169+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 45 ==== watch-notify(notify_complete (2) cookie 94632138919664 notify 141733920814 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561142ff92f0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.162 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.169+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:141 8.15 8:afc1d5e3:root::.bucket.meta.myfoo%3aef4a9585-c98e-4264-8c5b-7c4065599143.4222.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143062080 con 0x56114300a160 2023-12-07T21:10:59.163 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.170+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 36 ==== osd_op_reply(141 .bucket.meta.myfoo:ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 [call,call,delete] v33'4 uv4 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.170+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:142 4.1 4:81be9fa0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143062050 con 0x561142eabb60 2023-12-07T21:10:59.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.170+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:143 4.3e 4:7e7ba168:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561142eabb60 2023-12-07T21:10:59.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.170+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:144 4.8 4:11667fb2:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306b370 con 0x56114300a160 2023-12-07T21:10:59.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.170+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:145 4.31 4:8f35a876:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306bbf0 con 0x561143004040 2023-12-07T21:10:59.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.170+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:146 4.25 4:a7b703e6:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143062050 con 0x56114300a160 2023-12-07T21:10:59.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.170+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:147 4.17 4:e9580091:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306b370 con 0x7fa75c00d3d0 2023-12-07T21:10:59.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.170+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:148 4.1c 4:3a23f5d0:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.170+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:149 4.1e 4:795475ec:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143062050 con 0x7fa75c00d3d0 2023-12-07T21:10:59.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.170+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:150 4.11 4:8b9a3403:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306ca70 con 0x7fa75c00d3d0 2023-12-07T21:10:59.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.171+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:151 4.32 4:4e70ad78:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306bbf0 con 0x561143004040 2023-12-07T21:10:59.164 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.171+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:152 4.3c 4:3c4620ae:::.dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114306b370 con 0x561143004040 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.172+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 37 ==== osd_op_reply(144 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.2 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.172+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 38 ==== osd_op_reply(146 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.4 [delete] v33'7 uv7 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.172+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 46 ==== osd_op_reply(149 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.7 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.172+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 47 ==== osd_op_reply(147 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.5 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.172+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 48 ==== osd_op_reply(150 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.8 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.172+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 49 ==== osd_op_reply(148 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.6 [delete] v33'3 uv3 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.172+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 38 ==== osd_op_reply(152 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.10 [delete] v33'7 uv7 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.172+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 28 ==== osd_op_reply(142 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.0 [delete] v33'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.172+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 29 ==== osd_op_reply(143 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.1 [delete] v33'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 39 ==== osd_op_reply(145 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.3 [delete] v33'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 40 ==== osd_op_reply(151 .dir.ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7.9 [delete] v33'13 uv13 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa778122800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 : miss 2023-12-07T21:10:59.167 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa778122800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:153 6.a 6:54bf30ec:::pubsub..bucket.myfoo%2fef4a9585-c98e-4264-8c5b-7c4065599143.4222.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561142eabb60 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 30 ==== osd_op_reply(153 pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa778122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa778122800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 info.flags=0x0 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa778122800 10 adding default.rgw.log++pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 to cache LRU end 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa778122800 10 removing default.rgw.log++pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 from cache 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa778122800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7, ofs0, ns] 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:154 7.d 7:b4812045:::notify.4:head [notify cookie 94632138907728 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561143004040 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 41 ==== watch-notify(notify (1) cookie 94632138580336 notify 141733920792 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x561142ff92f0 con 0x561143004040 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa76a519640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94632138580336 notifier 4696 bl.length()=203 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 42 ==== osd_op_reply(154 notify.4 [notify cookie 94632138907728 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa76a519640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:155 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa6b8003290 con 0x561143004040 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 43 ==== watch-notify(notify_complete (2) cookie 94632138907728 notify 141733920792 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561142ff8e90 con 0x561143004040 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 44 ==== osd_op_reply(155 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.168 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.173+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:156 6.a 6:54bf30ec:::pubsub..bucket.myfoo%2fef4a9585-c98e-4264-8c5b-7c4065599143.4222.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561142eabb60 2023-12-07T21:10:59.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.175+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 31 ==== osd_op_reply(156 pubsub..bucket.myfoo/ef4a9585-c98e-4264-8c5b-7c4065599143.4222.7 [delete] v33'39 uv31 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.169 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.175+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:157 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561142eabb60 2023-12-07T21:10:59.170 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.176+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 32 ==== osd_op_reply(157 foo.buckets [call] v33'58 uv58 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.176+0000 7fa778122800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.176+0000 7fa778122800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.176+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify cookie 94632138907728 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561142eabb60 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.176+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 33 ==== watch-notify(notify (1) cookie 94632138575280 notify 141733920793 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7fa75c031060 con 0x561142eabb60 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.176+0000 7fa76ad1a640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 94632138575280 notifier 4696 bl.length()=170 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.176+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 34 ==== osd_op_reply(158 notify.3 [notify cookie 94632138907728 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.176+0000 7fa76ad1a640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:159 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa748004160 con 0x561142eabb60 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.177+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 35 ==== osd_op_reply(159 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.177+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 36 ==== watch-notify(notify_complete (2) cookie 94632138907728 notify 141733920793 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa75c00de70 con 0x561142eabb60 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.177+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:160 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.178+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 50 ==== osd_op_reply(160 9te6NH5mcdcq0Tc5i8i1 [delete] v33'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.178+0000 7fa778122800 10 removing email index: foo@foo.com 2023-12-07T21:10:59.171 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.178+0000 7fa778122800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2023-12-07T21:10:59.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.178+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify cookie 94632138907728 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561142eabb60 2023-12-07T21:10:59.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.178+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 37 ==== watch-notify(notify (1) cookie 94632138575280 notify 141733920794 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x7fa75c00de70 con 0x561142eabb60 2023-12-07T21:10:59.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.178+0000 7fa76ad1a640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94632138575280 notifier 4696 bl.length()=162 2023-12-07T21:10:59.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.178+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 38 ==== osd_op_reply(161 notify.3 [notify cookie 94632138907728 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.178+0000 7fa76ad1a640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:162 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa748004160 con 0x561142eabb60 2023-12-07T21:10:59.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.178+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 39 ==== watch-notify(notify_complete (2) cookie 94632138907728 notify 141733920794 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa75c024040 con 0x561142eabb60 2023-12-07T21:10:59.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.178+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 40 ==== osd_op_reply(162 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.172 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.178+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:163 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561143004040 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.179+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 45 ==== osd_op_reply(163 foo@foo.com [delete] v33'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.179+0000 7fa778122800 10 removing user buckets index 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.179+0000 7fa778122800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.179+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94632138907728 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.180+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 51 ==== watch-notify(notify (1) cookie 94632138582384 notify 141733920815 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x561142ff8e90 con 0x7fa75c00d3d0 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.180+0000 7fa76a519640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920815 cookie 94632138582384 notifier 4696 bl.length()=160 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.180+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 52 ==== osd_op_reply(164 notify.5 [notify cookie 94632138907728 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.180+0000 7fa76a519640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa6b8003290 con 0x7fa75c00d3d0 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.180+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 53 ==== watch-notify(notify_complete (2) cookie 94632138907728 notify 141733920815 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa76c00a0e0 con 0x7fa75c00d3d0 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.180+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 54 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.180+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:166 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561142eabb60 2023-12-07T21:10:59.174 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.181+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 41 ==== osd_op_reply(166 foo.buckets [delete] v33'59 uv59 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.181+0000 7fa778122800 10 removing user index: foo 2023-12-07T21:10:59.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.181+0000 7fa778122800 10 removing default.rgw.meta+users.uid+foo from cache 2023-12-07T21:10:59.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.181+0000 7fa778122800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2023-12-07T21:10:59.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.181+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify cookie 94632138907728 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x561143064ef0 con 0x561143004040 2023-12-07T21:10:59.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.181+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 46 ==== watch-notify(notify (1) cookie 94632138580336 notify 141733920793 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7fa76c00a0e0 con 0x561143004040 2023-12-07T21:10:59.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.181+0000 7fa76a519640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 94632138580336 notifier 4696 bl.length()=152 2023-12-07T21:10:59.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.181+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 47 ==== osd_op_reply(167 notify.4 [notify cookie 94632138907728 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.181+0000 7fa76a519640 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:168 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa6b8003290 con 0x561143004040 2023-12-07T21:10:59.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.181+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 48 ==== osd_op_reply(168 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.182+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 49 ==== watch-notify(notify_complete (2) cookie 94632138907728 notify 141733920793 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561142ff26a0 con 0x561143004040 2023-12-07T21:10:59.175 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.182+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:169 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114304df90 con 0x561143004040 2023-12-07T21:10:59.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.182+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 50 ==== osd_op_reply(169 foo [call,call,delete] v33'17 uv17 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.183+0000 7fa739fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:59.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.183+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94632138587632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114304df90 con 0x561143004040 2023-12-07T21:10:59.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.184+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 51 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94632138587632] v33'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.176 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.184+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94632136142672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114301cf00 con 0x561142eabb60 2023-12-07T21:10:59.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.185+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 42 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94632136142672] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.185+0000 7fa778122800 20 remove_watcher() i=0 2023-12-07T21:10:59.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.185+0000 7fa778122800 2 removed watcher, disabling cache 2023-12-07T21:10:59.177 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.185+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94632138565280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114304df90 con 0x561143004040 2023-12-07T21:10:59.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.186+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 52 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94632138565280] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.186+0000 7fa778122800 20 remove_watcher() i=1 2023-12-07T21:10:59.178 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.186+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94632138570176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114301cf00 con 0x56114300a160 2023-12-07T21:10:59.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.187+0000 7fa773d1c640 1 -- 172.21.15.121:0/3070526015 <== osd.3 v2:172.21.15.121:6800/4032235766 39 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94632138570176] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76406b030 con 0x56114300a160 2023-12-07T21:10:59.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.187+0000 7fa778122800 20 remove_watcher() i=2 2023-12-07T21:10:59.179 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.187+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94632138575280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114304df90 con 0x561142eabb60 2023-12-07T21:10:59.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.188+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 <== osd.2 v2:172.21.15.121:6816/2557538450 43 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94632138575280] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa75c006070 con 0x561142eabb60 2023-12-07T21:10:59.180 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.189+0000 7fa778122800 20 remove_watcher() i=3 2023-12-07T21:10:59.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.189+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94632138580336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114301cf00 con 0x561143004040 2023-12-07T21:10:59.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.190+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.1 v2:172.21.15.121:6808/2140819418 53 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94632138580336] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x561143004040 2023-12-07T21:10:59.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.190+0000 7fa778122800 20 remove_watcher() i=4 2023-12-07T21:10:59.181 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.190+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94632138582384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114304df90 con 0x7fa75c00d3d0 2023-12-07T21:10:59.182 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.191+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 55 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94632138582384] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.191+0000 7fa778122800 20 remove_watcher() i=5 2023-12-07T21:10:59.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.191+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94632138583424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114301cf00 con 0x7fa75c00d3d0 2023-12-07T21:10:59.183 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.192+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 56 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94632138583424] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.192+0000 7fa778122800 20 remove_watcher() i=6 2023-12-07T21:10:59.184 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.192+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94632138586528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56114304df90 con 0x7fa75c00d3d0 2023-12-07T21:10:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa77451d640 1 -- 172.21.15.121:0/3070526015 <== osd.0 v2:172.21.15.89:6800/654939948 57 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94632138586528] v33'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa76c02ec20 con 0x7fa75c00d3d0 2023-12-07T21:10:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 20 remove_watcher() i=7 2023-12-07T21:10:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa75c00d3d0 msgr2=0x7fa75c00d830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa75c00d3d0 0x7fa75c00d830 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x561143004040 msgr2=0x561143006500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x561143004040 0x561143006500 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x561142eabb60 msgr2=0x7fa7640649c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x561142eabb60 0x7fa7640649c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56114300a160 msgr2=0x56114300c5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.186 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x56114300a160 0x56114300c5d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa74c0360c0 msgr2=0x7fa74c038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa74c0360c0 0x7fa74c038580 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa75c000f60 tx=0x7fa75c0010a0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 msgr2=0x561142ff8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 --2- 172.21.15.121:0/3070526015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142ff1d40 0x561142ff8950 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00ae40 tx=0x7fa76c003370 comp rx=0 tx=0).stop 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 reap_dead start 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa76b51b640 1 -- 172.21.15.121:0/3070526015 reap_dead start 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 shutdown_connections 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 >> 172.21.15.121:0/3070526015 conn(0x561142fec980 msgr2=0x561142fed860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 shutdown_connections 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.193+0000 7fa778122800 1 -- 172.21.15.121:0/3070526015 wait complete. 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.194+0000 7fa778122800 1 -- 172.21.15.121:0/790361728 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa754036110 msgr2=0x7fa7540385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.194+0000 7fa778122800 1 --2- 172.21.15.121:0/790361728 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa754036110 0x7fa7540385d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa764052fd0 tx=0x7fa7640445e0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.194+0000 7fa778122800 1 -- 172.21.15.121:0/790361728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142f3a350 msgr2=0x561142fe54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.187 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.194+0000 7fa778122800 1 --2- 172.21.15.121:0/790361728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142f3a350 0x561142fe54c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa76405e040 tx=0x7fa764002fb0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.194+0000 7fa778122800 1 -- 172.21.15.121:0/790361728 shutdown_connections 2023-12-07T21:10:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.194+0000 7fa778122800 1 --2- 172.21.15.121:0/790361728 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa754036110 0x7fa7540385d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.194+0000 7fa778122800 1 --2- 172.21.15.121:0/790361728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x561142f3a350 0x561142fe54c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.194+0000 7fa778122800 1 -- 172.21.15.121:0/790361728 >> 172.21.15.121:0/790361728 conn(0x561142f31890 msgr2=0x561142f35d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.194+0000 7fa778122800 1 -- 172.21.15.121:0/790361728 shutdown_connections 2023-12-07T21:10:59.188 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.194+0000 7fa778122800 1 -- 172.21.15.121:0/790361728 wait complete. 2023-12-07T21:10:59.189 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2023-12-07T21:10:59.189 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2023-12-07T21:10:59.189 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2023-12-07T21:10:59.271 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:59.271 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:59.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.280+0000 7fa94692d800 1 Processor -- start 2023-12-07T21:10:59.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.280+0000 7fa94692d800 1 -- start start 2023-12-07T21:10:59.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.280+0000 7fa94692d800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5636758f47d0 0x5636758f6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.280+0000 7fa94692d800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56367583c7a0 con 0x5636758f1840 2023-12-07T21:10:59.272 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.280+0000 7fa94692d800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x563675805880 con 0x5636758f47d0 2023-12-07T21:10:59.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.280+0000 7fa941e67640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5636758f47d0 0x5636758f6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.280+0000 7fa942668640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5636758f1840 0x5636758f1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:44520/0 (socket says 172.21.15.121:44520) 2023-12-07T21:10:59.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.281+0000 7fa942668640 1 -- 172.21.15.121:0/1836842928 learned_addr learned my addr 172.21.15.121:0/1836842928 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:59.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.281+0000 7fa941666640 1 -- 172.21.15.121:0/1836842928 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532808642 0 0) 0x56367583c7a0 con 0x5636758f1840 2023-12-07T21:10:59.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.281+0000 7fa941666640 1 -- 172.21.15.121:0/1836842928 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa92c001e10 con 0x5636758f1840 2023-12-07T21:10:59.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.281+0000 7fa941e67640 1 -- 172.21.15.121:0/1836842928 >> v1:172.21.15.89:6789/0 conn(0x5636758f1840 legacy=0x5636758f1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.273 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.281+0000 7fa941e67640 1 -- 172.21.15.121:0/1836842928 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636758f8110 con 0x5636758f47d0 2023-12-07T21:10:59.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.283+0000 7fa941e67640 1 --2- 172.21.15.121:0/1836842928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f47d0 0x5636758f6bc0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa93800a470 tx=0x7fa93801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758fa9577f307aa0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.283+0000 7fa941666640 1 -- 172.21.15.121:0/1836842928 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93804ad60 con 0x5636758f47d0 2023-12-07T21:10:59.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.283+0000 7fa941666640 1 -- 172.21.15.121:0/1836842928 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa938052440 con 0x5636758f47d0 2023-12-07T21:10:59.275 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.283+0000 7fa941666640 1 -- 172.21.15.121:0/1836842928 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9380526e0 con 0x5636758f47d0 2023-12-07T21:10:59.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.283+0000 7fa94692d800 1 -- 172.21.15.121:0/1836842928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f47d0 msgr2=0x5636758f6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.276 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.283+0000 7fa94692d800 1 --2- 172.21.15.121:0/1836842928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f47d0 0x5636758f6bc0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa93800a470 tx=0x7fa93801cc80 comp rx=0 tx=0).stop 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.283+0000 7fa94692d800 1 -- 172.21.15.121:0/1836842928 shutdown_connections 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.283+0000 7fa94692d800 1 --2- 172.21.15.121:0/1836842928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f47d0 0x5636758f6bc0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.283+0000 7fa94692d800 1 -- 172.21.15.121:0/1836842928 >> 172.21.15.121:0/1836842928 conn(0x5636758e9f60 msgr2=0x5636758ec380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.283+0000 7fa94692d800 1 -- 172.21.15.121:0/1836842928 shutdown_connections 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.283+0000 7fa94692d800 1 -- 172.21.15.121:0/1836842928 wait complete. 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.284+0000 7fa94692d800 1 Processor -- start 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.284+0000 7fa94692d800 1 -- start start 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.284+0000 7fa94692d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x563675994c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.284+0000 7fa94692d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563675802db0 con 0x5636758f1840 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.285+0000 7fa942668640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x563675994c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.285+0000 7fa942668640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x563675994c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55484/0 (socket says 172.21.15.121:55484) 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.285+0000 7fa942668640 1 -- 172.21.15.121:0/4030944920 learned_addr learned my addr 172.21.15.121:0/4030944920 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.277 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.285+0000 7fa942668640 1 -- 172.21.15.121:0/4030944920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa938005d20 con 0x5636758f1840 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.285+0000 7fa942668640 1 --2- 172.21.15.121:0/4030944920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x563675994c80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa934001c20 tx=0x7fa93400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10367fd9132d5202 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.285+0000 7fa940e65640 1 -- 172.21.15.121:0/4030944920 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93400e470 con 0x5636758f1840 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.285+0000 7fa940e65640 1 -- 172.21.15.121:0/4030944920 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93400e5d0 con 0x5636758f1840 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.285+0000 7fa940e65640 1 -- 172.21.15.121:0/4030944920 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93400e930 con 0x5636758f1840 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa94692d800 1 -- 172.21.15.121:0/4030944920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 msgr2=0x563675994c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa94692d800 1 --2- 172.21.15.121:0/4030944920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x563675994c80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa934001c20 tx=0x7fa93400b6c0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa94692d800 1 -- 172.21.15.121:0/4030944920 shutdown_connections 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa94692d800 1 --2- 172.21.15.121:0/4030944920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x563675994c80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa94692d800 1 -- 172.21.15.121:0/4030944920 >> 172.21.15.121:0/4030944920 conn(0x5636758e9f60 msgr2=0x5636759908f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa94692d800 1 -- 172.21.15.121:0/4030944920 shutdown_connections 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa94692d800 1 -- 172.21.15.121:0/4030944920 wait complete. 2023-12-07T21:10:59.287 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa94692d800 1 Processor -- start 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa94692d800 1 -- start start 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa94692d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x56367599c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa94692d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636757fe6a0 con 0x5636758f1840 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa942668640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x56367599c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa942668640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x56367599c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55488/0 (socket says 172.21.15.121:55488) 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.286+0000 7fa942668640 1 -- 172.21.15.121:0/3134567654 learned_addr learned my addr 172.21.15.121:0/3134567654 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.287+0000 7fa942668640 1 -- 172.21.15.121:0/3134567654 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c001e10 con 0x5636758f1840 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.287+0000 7fa942668640 1 --2- 172.21.15.121:0/3134567654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x56367599c130 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa934001080 tx=0x7fa934000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.287+0000 7fa9337fe640 1 -- 172.21.15.121:0/3134567654 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93401f070 con 0x5636758f1840 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.287+0000 7fa9337fe640 1 -- 172.21.15.121:0/3134567654 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934018770 con 0x5636758f1840 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.287+0000 7fa94692d800 1 -- 172.21.15.121:0/3134567654 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56367599c670 con 0x5636758f1840 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.287+0000 7fa9337fe640 1 -- 172.21.15.121:0/3134567654 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa934018a50 con 0x5636758f1840 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.287+0000 7fa94692d800 1 -- 172.21.15.121:0/3134567654 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56367599cb50 con 0x5636758f1840 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa94692d800 1 Processor -- start 2023-12-07T21:10:59.288 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa94692d800 1 -- start start 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa94692d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 0x5636759a8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa94692d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563675798890 con 0x5636759a8330 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa9337fe640 1 -- 172.21.15.121:0/3134567654 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa934018bb0 con 0x5636758f1840 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa942e69640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 0x5636759a8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa942e69640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 0x5636759a8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55496/0 (socket says 172.21.15.121:55496) 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa942e69640 1 -- 172.21.15.121:0/162211397 learned_addr learned my addr 172.21.15.121:0/162211397 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa9337fe640 1 --2- 172.21.15.121:0/3134567654 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa924036110 0x7fa9240385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa9337fe640 1 -- 172.21.15.121:0/3134567654 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fa93404b9e0 con 0x5636758f1840 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa942668640 1 --2- 172.21.15.121:0/3134567654 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa924036110 0x7fa9240385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.288+0000 7fa942e69640 1 -- 172.21.15.121:0/162211397 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636759a8c90 con 0x5636759a8330 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa942e69640 1 --2- 172.21.15.121:0/162211397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 0x5636759a8750 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00a430 tx=0x7fa93c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33a45fe80ad3248 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa942668640 1 --2- 172.21.15.121:0/3134567654 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa924036110 0x7fa9240385d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa934001710 tx=0x7fa934018e60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa9317fa640 1 -- 172.21.15.121:0/162211397 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93c001650 con 0x5636759a8330 2023-12-07T21:10:59.289 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa9317fa640 1 -- 172.21.15.121:0/162211397 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c0017d0 con 0x5636759a8330 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa9317fa640 1 -- 172.21.15.121:0/162211397 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93c001ab0 con 0x5636759a8330 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa94692d800 1 -- 172.21.15.121:0/162211397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 msgr2=0x5636759a8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa94692d800 1 --2- 172.21.15.121:0/162211397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 0x5636759a8750 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00a430 tx=0x7fa93c00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa94692d800 1 -- 172.21.15.121:0/162211397 shutdown_connections 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa94692d800 1 --2- 172.21.15.121:0/162211397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 0x5636759a8750 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa94692d800 1 -- 172.21.15.121:0/162211397 >> 172.21.15.121:0/162211397 conn(0x5636758f47d0 msgr2=0x5636759a3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa94692d800 1 -- 172.21.15.121:0/162211397 shutdown_connections 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa94692d800 1 -- 172.21.15.121:0/162211397 wait complete. 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.289+0000 7fa94692d800 1 Processor -- start 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa94692d800 1 -- start start 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa94692d800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 0x5636759af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa94692d800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563675798530 con 0x5636759a8330 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa942e69640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 0x5636759af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa942e69640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 0x5636759af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55498/0 (socket says 172.21.15.121:55498) 2023-12-07T21:10:59.290 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 learned_addr learned my addr 172.21.15.121:0/3915703246 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c00a0e0 con 0x5636759a8330 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa942e69640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 0x5636759af330 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00a930 tx=0x7fa93c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa9237fe640 1 -- 172.21.15.121:0/3915703246 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93c010900 con 0x5636759a8330 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa9237fe640 1 -- 172.21.15.121:0/3915703246 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c010a60 con 0x5636759a8330 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa9237fe640 1 -- 172.21.15.121:0/3915703246 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93c010d20 con 0x5636759a8330 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5636759af870 con 0x5636759a8330 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.290+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636759afcd0 con 0x5636759a8330 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.291+0000 7fa9237fe640 1 -- 172.21.15.121:0/3915703246 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa93c017030 con 0x5636759a8330 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa9237fe640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa91c036110 0x7fa91c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa9237fe640 1 -- 172.21.15.121:0/3915703246 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fa93c04b8a0 con 0x5636759a8330 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa941e67640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa91c036110 0x7fa91c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa94692d800 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5636759baa90 0x5636759bcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.291 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759bd6a0 con 0x5636759baa90 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa942e69640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5636759baa90 0x5636759bcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa941e67640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa91c036110 0x7fa91c0385d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa938054000 tx=0x7fa93804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa942e69640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5636759baa90 0x5636759bcf50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa94692d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa94692d800 20 realm 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.292+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759bda70 con 0x5636759baa90 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759be2c0 con 0x5636759baa90 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.292 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759be620 con 0x5636759baa90 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759bdf60 con 0x5636759baa90 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.293+0000 7fa94692d800 20 searching for the correct realm 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.294+0000 7fa94692d800 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5636759c0870 0x5636759c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.294+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759c0870 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.294+0000 7fa942668640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5636759c0870 0x5636759c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.294+0000 7fa942668640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5636759c0870 0x5636759c2c60 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.294+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.293 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.294+0000 7fa942668640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa934017050 0x7fa93404aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.294+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa934017050 2023-12-07T21:10:59.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.294+0000 7fa941e67640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa934017050 0x7fa93404aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.295+0000 7fa941e67640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa934017050 0x7fa93404aeb0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.295+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.295+0000 7fa941e67640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa93805c920 0x7fa938009410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.295+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa93805c920 2023-12-07T21:10:59.294 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.295+0000 7fa942e69640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa93805c920 0x7fa938009410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.295+0000 7fa942e69640 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa93805c920 0x7fa938009410 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.296+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.296+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759baa90 2023-12-07T21:10:59.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.296+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.296+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759baa90 2023-12-07T21:10:59.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.296+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.296+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa93805c920 2023-12-07T21:10:59.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.296+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.296+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa93805c920 2023-12-07T21:10:59.304 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.296+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.296+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa934017050 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.297+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.297+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759c0870 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.297+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.297+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759baa90 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.297+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.297+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa93805c920 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.297+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.297+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759baa90 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.298+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.298+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa934017050 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.298+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.298+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759c0870 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.298+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.305 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.298+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759c0870 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.298+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.298+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa93805c920 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.299+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.299+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759c0870 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.299+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.299+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759c0870 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.299+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.299+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759baa90 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.299+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.299+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759baa90 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.299+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.299+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa93805c920 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.300+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.306 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.300+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759c0870 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.300+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.300+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa934017050 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.300+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.300+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759baa90 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.301+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.301+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa93805c920 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.301+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.301+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759c0870 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.301+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.301+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa93805c920 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.301+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.301+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa934017050 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.302+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.302+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759c0870 2023-12-07T21:10:59.307 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.302+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.302+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x7fa93805c920 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.302+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.302+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3240 con 0x5636759baa90 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.302+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.302+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7fa93c053080 con 0x7fa934017050 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.308 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759bf480 con 0x5636759baa90 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759bf8c0 con 0x5636759baa90 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759bfca0 con 0x5636759c0870 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 zone default found 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 4 Realm: () 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:59.309 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 zonegroup default 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.303+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c3660 con 0x7fa93805c920 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.304+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.304+0000 7fa94692d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.304+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.304+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c54e0 con 0x5636759c0870 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.304+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.304+0000 7fa94692d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.304+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.304+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c5840 con 0x5636759c0870 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.305+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.305+0000 7fa94692d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.310 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.305+0000 7fa94692d800 20 started sync module instance, tier type = 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.305+0000 7fa94692d800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.305+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c4970 con 0x7fa934017050 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.306+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.306+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94791898988368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c4590 con 0x7fa934017050 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.306+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c6040 con 0x5636759baa90 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.307+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94791898988368] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.307+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.307+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94791901400352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c6040 con 0x5636759baa90 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.307+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c69b0 con 0x5636759c0870 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.308+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94791901400352] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.308+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.308+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94791901404064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c5fb0 con 0x5636759c0870 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.308+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c76c0 con 0x7fa934017050 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.309+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94791901404064] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.311 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.309+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.309+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94791901408880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c7f10 con 0x7fa934017050 2023-12-07T21:10:59.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.309+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c8710 con 0x5636759baa90 2023-12-07T21:10:59.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.310+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94791901408880] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.311+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.311+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94791901414000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c8680 con 0x5636759baa90 2023-12-07T21:10:59.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.311+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c9440 con 0x7fa93805c920 2023-12-07T21:10:59.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.312+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.312+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94791901417312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c9810 con 0x7fa93805c920 2023-12-07T21:10:59.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.312+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759ca260 con 0x7fa93805c920 2023-12-07T21:10:59.312 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.312+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94791901414000] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.313+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94791901417312] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.316 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.313+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.313+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94791901420864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c9370 con 0x7fa93805c920 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.313+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759caab0 con 0x7fa93805c920 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.314+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94791901420864] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.314+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.314+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94791901416128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c9370 con 0x7fa93805c920 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.314+0000 7fa94692d800 20 add_watcher() i=0 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.314+0000 7fa94692d800 20 add_watcher() i=1 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.314+0000 7fa94692d800 20 add_watcher() i=2 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.314+0000 7fa94692d800 20 add_watcher() i=3 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.314+0000 7fa94692d800 20 add_watcher() i=4 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.314+0000 7fa94692d800 20 add_watcher() i=5 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.314+0000 7fa94692d800 20 add_watcher() i=6 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.315+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94791901416128] v33'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.317 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.315+0000 7fa94692d800 20 add_watcher() i=7 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.315+0000 7fa94692d800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.315+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759cda50 con 0x5636759baa90 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.315+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.315+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94791901422656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759caf00 con 0x5636759baa90 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.316+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94791901422656] v33'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.316+0000 7fa9037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.316+0000 7fa94692d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.316+0000 7fa94692d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.316+0000 7fa94692d800 5 note: GC not initialized 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.317+0000 7fa9027fc640 20 reqs_thread_entry: start 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.317+0000 7fa94692d800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.317+0000 7fa94692d800 20 Filter name: none 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.317+0000 7fa873fff640 20 reqs_thread_entry: start 2023-12-07T21:10:59.318 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.317+0000 7fa94692d800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.317+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x563675a005c0 con 0x5636759baa90 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.317+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.317+0000 7fa94692d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:could not fetch user info: no user info saved 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.318+0000 7fa9037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.318+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94791901422656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563675a00580 con 0x5636759baa90 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.319+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94791901422656] v33'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.319+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94791898988368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x563675a00580 con 0x7fa934017050 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.320+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94791898988368] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.320+0000 7fa94692d800 20 remove_watcher() i=0 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.320+0000 7fa94692d800 2 removed watcher, disabling cache 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.320+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94791901400352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759fed30 con 0x5636759baa90 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.321+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94791901400352] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.319 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.321+0000 7fa94692d800 20 remove_watcher() i=1 2023-12-07T21:10:59.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.321+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94791901404064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759fed30 con 0x5636759c0870 2023-12-07T21:10:59.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.322+0000 7fa942668640 1 -- 172.21.15.121:0/3915703246 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94791901404064] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa934014070 con 0x5636759c0870 2023-12-07T21:10:59.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.322+0000 7fa94692d800 20 remove_watcher() i=2 2023-12-07T21:10:59.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.322+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94791901408880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759ff090 con 0x7fa934017050 2023-12-07T21:10:59.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.323+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94791901408880] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9380525b0 con 0x7fa934017050 2023-12-07T21:10:59.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.323+0000 7fa94692d800 20 remove_watcher() i=3 2023-12-07T21:10:59.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.323+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94791901414000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759ff3f0 con 0x5636759baa90 2023-12-07T21:10:59.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.324+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94791901414000] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x5636759baa90 2023-12-07T21:10:59.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.324+0000 7fa94692d800 20 remove_watcher() i=4 2023-12-07T21:10:59.320 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.324+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94791901417312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759ff3f0 con 0x7fa93805c920 2023-12-07T21:10:59.322 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-12-07T21:10:59.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.325+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94791901417312] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.325+0000 7fa94692d800 20 remove_watcher() i=5 2023-12-07T21:10:59.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.325+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94791901420864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c8f10 con 0x7fa93805c920 2023-12-07T21:10:59.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.326+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94791901420864] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.326+0000 7fa94692d800 20 remove_watcher() i=6 2023-12-07T21:10:59.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.326+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94791901416128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5636759c9d40 con 0x7fa93805c920 2023-12-07T21:10:59.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa942e69640 1 -- 172.21.15.121:0/3915703246 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94791901416128] v33'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa93c02e9d0 con 0x7fa93805c920 2023-12-07T21:10:59.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 20 remove_watcher() i=7 2023-12-07T21:10:59.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa93805c920 msgr2=0x7fa938009410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.323 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7fa93805c920 0x7fa938009410 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5636759baa90 msgr2=0x5636759bcf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5636759baa90 0x5636759bcf50 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa934017050 msgr2=0x7fa93404aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7fa934017050 0x7fa93404aeb0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5636759c0870 msgr2=0x5636759c2c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5636759c0870 0x5636759c2c60 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa91c036110 msgr2=0x7fa91c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa91c036110 0x7fa91c0385d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa938054000 tx=0x7fa93804e000 comp rx=0 tx=0).stop 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 msgr2=0x5636759af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 --2- 172.21.15.121:0/3915703246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636759a8330 0x5636759af330 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00a930 tx=0x7fa93c003370 comp rx=0 tx=0).stop 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 reap_dead start 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa941e67640 1 -- 172.21.15.121:0/3915703246 reap_dead start 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 shutdown_connections 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.327+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 >> 172.21.15.121:0/3915703246 conn(0x5636758f47d0 msgr2=0x5636759a2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.324 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 shutdown_connections 2023-12-07T21:10:59.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 -- 172.21.15.121:0/3915703246 wait complete. 2023-12-07T21:10:59.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 -- 172.21.15.121:0/3134567654 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa924036110 msgr2=0x7fa9240385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 --2- 172.21.15.121:0/3134567654 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa924036110 0x7fa9240385d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa934001710 tx=0x7fa934018e60 comp rx=0 tx=0).stop 2023-12-07T21:10:59.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 -- 172.21.15.121:0/3134567654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 msgr2=0x56367599c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 --2- 172.21.15.121:0/3134567654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x56367599c130 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa934001080 tx=0x7fa934000bc0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 -- 172.21.15.121:0/3134567654 shutdown_connections 2023-12-07T21:10:59.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 --2- 172.21.15.121:0/3134567654 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa924036110 0x7fa9240385d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 --2- 172.21.15.121:0/3134567654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5636758f1840 0x56367599c130 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 -- 172.21.15.121:0/3134567654 >> 172.21.15.121:0/3134567654 conn(0x5636758e9f60 msgr2=0x563675993990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 -- 172.21.15.121:0/3134567654 shutdown_connections 2023-12-07T21:10:59.325 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.328+0000 7fa94692d800 1 -- 172.21.15.121:0/3134567654 wait complete. 2023-12-07T21:10:59.325 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2023-12-07T21:10:59.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2023-12-07T21:10:59.326 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2023-12-07T21:10:59.404 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:59.404 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:59.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.413+0000 7f57bb51e800 1 Processor -- start 2023-12-07T21:10:59.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.413+0000 7f57bb51e800 1 -- start start 2023-12-07T21:10:59.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.414+0000 7f57bb51e800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55879b736580 0x55879b738a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.414+0000 7f57bb51e800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55879b67e7a0 con 0x55879b6a6ce0 2023-12-07T21:10:59.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.414+0000 7f57bb51e800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55879b647880 con 0x55879b736580 2023-12-07T21:10:59.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.414+0000 7f57b8824640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55879b736580 0x55879b738a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.414+0000 7f57b9025640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55879b6a6ce0 0x55879b734e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:44534/0 (socket says 172.21.15.121:44534) 2023-12-07T21:10:59.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.414+0000 7f57b9025640 1 -- 172.21.15.121:0/746039292 learned_addr learned my addr 172.21.15.121:0/746039292 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:59.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.414+0000 7f57b8824640 1 -- 172.21.15.121:0/746039292 >> v1:172.21.15.89:6789/0 conn(0x55879b6a6ce0 legacy=0x55879b734e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.414+0000 7f57b8824640 1 -- 172.21.15.121:0/746039292 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55879b73a100 con 0x55879b736580 2023-12-07T21:10:59.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.416+0000 7f57b8824640 1 --2- 172.21.15.121:0/746039292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b738a20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f57b000a470 tx=0x7f57b001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ff24b0798a5363 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.416+0000 7f57abfff640 1 -- 172.21.15.121:0/746039292 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57b0052570 con 0x55879b736580 2023-12-07T21:10:59.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.416+0000 7f57abfff640 1 -- 172.21.15.121:0/746039292 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b00526d0 con 0x55879b736580 2023-12-07T21:10:59.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.416+0000 7f57abfff640 1 -- 172.21.15.121:0/746039292 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57b0052990 con 0x55879b736580 2023-12-07T21:10:59.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.417+0000 7f57bb51e800 1 -- 172.21.15.121:0/746039292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 msgr2=0x55879b738a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.417+0000 7f57bb51e800 1 --2- 172.21.15.121:0/746039292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b738a20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f57b000a470 tx=0x7f57b001cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:59.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.417+0000 7f57bb51e800 1 -- 172.21.15.121:0/746039292 shutdown_connections 2023-12-07T21:10:59.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.417+0000 7f57bb51e800 1 --2- 172.21.15.121:0/746039292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b738a20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.417+0000 7f57bb51e800 1 -- 172.21.15.121:0/746039292 >> 172.21.15.121:0/746039292 conn(0x55879b72c880 msgr2=0x55879b72eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.417+0000 7f57bb51e800 1 -- 172.21.15.121:0/746039292 shutdown_connections 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.417+0000 7f57bb51e800 1 -- 172.21.15.121:0/746039292 wait complete. 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.417+0000 7f57bb51e800 1 Processor -- start 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.417+0000 7f57bb51e800 1 -- start start 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.417+0000 7f57bb51e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7d6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.418+0000 7f57bb51e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55879b644db0 con 0x55879b736580 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.418+0000 7f57b9025640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7d6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.418+0000 7f57b9025640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7d6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55514/0 (socket says 172.21.15.121:55514) 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.418+0000 7f57b9025640 1 -- 172.21.15.121:0/50122193 learned_addr learned my addr 172.21.15.121:0/50122193 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.418+0000 7f57b9025640 1 -- 172.21.15.121:0/50122193 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0005d20 con 0x55879b736580 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.418+0000 7f57b9025640 1 --2- 172.21.15.121:0/50122193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7d6f60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0014a0 tx=0x7f57ac001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf2ffad2d147172 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.418+0000 7f57ab7fe640 1 -- 172.21.15.121:0/50122193 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57ac004520 con 0x55879b736580 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.418+0000 7f57ab7fe640 1 -- 172.21.15.121:0/50122193 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac004680 con 0x55879b736580 2023-12-07T21:10:59.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.418+0000 7f57ab7fe640 1 -- 172.21.15.121:0/50122193 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57ac004980 con 0x55879b736580 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57bb51e800 1 -- 172.21.15.121:0/50122193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 msgr2=0x55879b7d6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57bb51e800 1 --2- 172.21.15.121:0/50122193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7d6f60 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0014a0 tx=0x7f57ac001960 comp rx=0 tx=0).stop 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57bb51e800 1 -- 172.21.15.121:0/50122193 shutdown_connections 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57bb51e800 1 --2- 172.21.15.121:0/50122193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7d6f60 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57bb51e800 1 -- 172.21.15.121:0/50122193 >> 172.21.15.121:0/50122193 conn(0x55879b72c880 msgr2=0x55879b7d2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57bb51e800 1 -- 172.21.15.121:0/50122193 shutdown_connections 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57bb51e800 1 -- 172.21.15.121:0/50122193 wait complete. 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57bb51e800 1 Processor -- start 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57bb51e800 1 -- start start 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57bb51e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7de460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57bb51e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55879b6406a0 con 0x55879b736580 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57b9025640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7de460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57b9025640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7de460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55524/0 (socket says 172.21.15.121:55524) 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57b9025640 1 -- 172.21.15.121:0/600599626 learned_addr learned my addr 172.21.15.121:0/600599626 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.419+0000 7f57b9025640 1 -- 172.21.15.121:0/600599626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55879b67e7a0 con 0x55879b736580 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.420+0000 7f57b9025640 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7de460 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0014a0 tx=0x7f57ac001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.420+0000 7f57aa7fc640 1 -- 172.21.15.121:0/600599626 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57ac023030 con 0x55879b736580 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.420+0000 7f57aa7fc640 1 -- 172.21.15.121:0/600599626 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac013840 con 0x55879b736580 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.420+0000 7f57bb51e800 1 -- 172.21.15.121:0/600599626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55879b7de9a0 con 0x55879b736580 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.420+0000 7f57aa7fc640 1 -- 172.21.15.121:0/600599626 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57ac013b20 con 0x55879b736580 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.420+0000 7f57bb51e800 1 -- 172.21.15.121:0/600599626 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55879b7dee80 con 0x55879b736580 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.420+0000 7f57bb51e800 1 Processor -- start 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.420+0000 7f57bb51e800 1 -- start start 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.420+0000 7f57bb51e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7eb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.420+0000 7f57aa7fc640 1 -- 172.21.15.121:0/600599626 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f57ac026070 con 0x55879b736580 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f57bb51e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55879b5da890 con 0x55879b7ead70 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f57b9826640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f57b9826640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7eb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55540/0 (socket says 172.21.15.121:55540) 2023-12-07T21:10:59.417 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f57b9826640 1 -- 172.21.15.121:0/340035001 learned_addr learned my addr 172.21.15.121:0/340035001 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f57aa7fc640 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f579c036110 0x7f579c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f57aa7fc640 1 -- 172.21.15.121:0/600599626 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f57ac024070 con 0x55879b736580 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f57b9025640 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f579c036110 0x7f579c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f57b9826640 1 -- 172.21.15.121:0/340035001 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55879b7eb6d0 con 0x55879b7ead70 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f57b9826640 1 --2- 172.21.15.121:0/340035001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7eb190 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f57b400a400 tx=0x7f57b400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59417d8a502d8bb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f57b9025640 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f579c036110 0x7f579c0385d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f57ac013fd0 tx=0x7f57ac013f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f579bfff640 1 -- 172.21.15.121:0/340035001 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57b40087e0 con 0x55879b7ead70 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f579bfff640 1 -- 172.21.15.121:0/340035001 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b4008960 con 0x55879b7ead70 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.421+0000 7f579bfff640 1 -- 172.21.15.121:0/340035001 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57b4008c80 con 0x55879b7ead70 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57bb51e800 1 -- 172.21.15.121:0/340035001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 msgr2=0x55879b7eb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57bb51e800 1 --2- 172.21.15.121:0/340035001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7eb190 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f57b400a400 tx=0x7f57b400a8c0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57bb51e800 1 -- 172.21.15.121:0/340035001 shutdown_connections 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57bb51e800 1 --2- 172.21.15.121:0/340035001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7eb190 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57bb51e800 1 -- 172.21.15.121:0/340035001 >> 172.21.15.121:0/340035001 conn(0x55879b7e59b0 msgr2=0x55879b7e6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.418 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57bb51e800 1 -- 172.21.15.121:0/340035001 shutdown_connections 2023-12-07T21:10:59.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57bb51e800 1 -- 172.21.15.121:0/340035001 wait complete. 2023-12-07T21:10:59.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57bb51e800 1 Processor -- start 2023-12-07T21:10:59.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57bb51e800 1 -- start start 2023-12-07T21:10:59.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57bb51e800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57bb51e800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55879b5da530 con 0x55879b7ead70 2023-12-07T21:10:59.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57b9826640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57b9826640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7f19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55548/0 (socket says 172.21.15.121:55548) 2023-12-07T21:10:59.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.422+0000 7f57b9826640 1 -- 172.21.15.121:0/2574738823 learned_addr learned my addr 172.21.15.121:0/2574738823 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.419 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.423+0000 7f57b9826640 1 -- 172.21.15.121:0/2574738823 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4005c90 con 0x55879b7ead70 2023-12-07T21:10:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.423+0000 7f57b9826640 1 --2- 172.21.15.121:0/2574738823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7f19f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f57b400a900 tx=0x7f57b4002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.423+0000 7f579a7fc640 1 -- 172.21.15.121:0/2574738823 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57b4013780 con 0x55879b7ead70 2023-12-07T21:10:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.423+0000 7f579a7fc640 1 -- 172.21.15.121:0/2574738823 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b40138e0 con 0x55879b7ead70 2023-12-07T21:10:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.423+0000 7f57bb51e800 1 -- 172.21.15.121:0/2574738823 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55879b7f1f30 con 0x55879b7ead70 2023-12-07T21:10:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.423+0000 7f579a7fc640 1 -- 172.21.15.121:0/2574738823 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f57b4013b80 con 0x55879b7ead70 2023-12-07T21:10:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.423+0000 7f57bb51e800 1 -- 172.21.15.121:0/2574738823 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55879b7f23f0 con 0x55879b7ead70 2023-12-07T21:10:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.424+0000 7f579a7fc640 1 -- 172.21.15.121:0/2574738823 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f57b401e420 con 0x55879b7ead70 2023-12-07T21:10:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.424+0000 7f579a7fc640 1 --2- 172.21.15.121:0/2574738823 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f57940360c0 0x7f5794038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.424+0000 7f579a7fc640 1 -- 172.21.15.121:0/2574738823 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f57b404b760 con 0x55879b7ead70 2023-12-07T21:10:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.424+0000 7f57bb51e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:59.423 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.424+0000 7f57bb51e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.424+0000 7f57b8824640 1 --2- 172.21.15.121:0/2574738823 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f57940360c0 0x7f5794038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.424+0000 7f577efe5640 20 reqs_thread_entry: start 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.424+0000 7f57bb51e800 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55879b807370 0x55879b809760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.424+0000 7f57bb51e800 1 -- 172.21.15.121:0/600599626 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55879b809ca0 con 0x55879b807370 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.424+0000 7f57b9826640 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55879b807370 0x55879b809760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.424+0000 7f57b8824640 1 --2- 172.21.15.121:0/2574738823 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f57940360c0 0x7f5794038580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f57b0054000 tx=0x7f57b004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.425+0000 7f57b9826640 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55879b807370 0x55879b809760 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.425+0000 7f57b9826640 1 -- 172.21.15.121:0/600599626 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f57b4024070 con 0x55879b807370 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.425+0000 7f57bb51e800 1 -- 172.21.15.121:0/600599626 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55879b80b010 con 0x55879b807370 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.425+0000 7f57b9826640 1 -- 172.21.15.121:0/600599626 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [call out=48b,read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f57b4024070 con 0x55879b807370 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 -- 172.21.15.121:0/2574738823 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f57940360c0 msgr2=0x7f5794038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 --2- 172.21.15.121:0/2574738823 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f57940360c0 0x7f5794038580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f57b0054000 tx=0x7f57b004e000 comp rx=0 tx=0).stop 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 -- 172.21.15.121:0/2574738823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 msgr2=0x55879b7f19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.424 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 --2- 172.21.15.121:0/2574738823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7f19f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f57b400a900 tx=0x7f57b4002ff0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 -- 172.21.15.121:0/2574738823 shutdown_connections 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 --2- 172.21.15.121:0/2574738823 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f57940360c0 0x7f5794038580 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 --2- 172.21.15.121:0/2574738823 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b7ead70 0x55879b7f19f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 -- 172.21.15.121:0/2574738823 >> 172.21.15.121:0/2574738823 conn(0x55879b7e59b0 msgr2=0x55879b7e6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 -- 172.21.15.121:0/2574738823 shutdown_connections 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 -- 172.21.15.121:0/2574738823 wait complete. 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 -- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55879b807370 msgr2=0x55879b809760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.426+0000 7f57bb51e800 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55879b807370 0x55879b809760 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.427+0000 7f57bb51e800 1 -- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f579c036110 msgr2=0x7f579c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.427+0000 7f57bb51e800 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f579c036110 0x7f579c0385d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f57ac013fd0 tx=0x7f57ac013f60 comp rx=0 tx=0).stop 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.427+0000 7f57bb51e800 1 -- 172.21.15.121:0/600599626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 msgr2=0x55879b7de460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.427+0000 7f57bb51e800 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7de460 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0014a0 tx=0x7f57ac001250 comp rx=0 tx=0).stop 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.427+0000 7f57bb51e800 1 -- 172.21.15.121:0/600599626 shutdown_connections 2023-12-07T21:10:59.425 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.427+0000 7f57bb51e800 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f579c036110 0x7f579c0385d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.427+0000 7f57bb51e800 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55879b807370 0x55879b809760 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.427+0000 7f57bb51e800 1 --2- 172.21.15.121:0/600599626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55879b736580 0x55879b7de460 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.427+0000 7f57bb51e800 1 -- 172.21.15.121:0/600599626 >> 172.21.15.121:0/600599626 conn(0x55879b72c880 msgr2=0x55879b7d5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.427+0000 7f57bb51e800 1 -- 172.21.15.121:0/600599626 shutdown_connections 2023-12-07T21:10:59.426 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.427+0000 7f57bb51e800 1 -- 172.21.15.121:0/600599626 wait complete. 2023-12-07T21:10:59.427 INFO:teuthology.orchestra.run.smithi121.stdout:{"id":"ef4a9585-c98e-4264-8c5b-7c4065599143","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-07T21:10:59.427 DEBUG:tasks.util.rgw: json result: {'id': 'ef4a9585-c98e-4264-8c5b-7c4065599143', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-07T21:10:59.427 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2023-12-07T21:10:59.427 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2023-12-07T21:10:59.427 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2023-12-07T21:10:59.507 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:59.507 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:59.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.516+0000 7f0607daf800 1 Processor -- start 2023-12-07T21:10:59.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.516+0000 7f0607daf800 1 -- start start 2023-12-07T21:10:59.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.516+0000 7f0607daf800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e0a7d4e6c0 0x55e0a7d4eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.516+0000 7f0607daf800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e0a7c9a790 con 0x55e0a7d4d380 2023-12-07T21:10:59.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.516+0000 7f0607daf800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e0a7c63880 con 0x55e0a7d4e6c0 2023-12-07T21:10:59.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.516+0000 7f06058b6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e0a7d4e6c0 0x55e0a7d4eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.516+0000 7f06058b6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55e0a7d4e6c0 0x55e0a7d4eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55550/0 (socket says 172.21.15.121:55550) 2023-12-07T21:10:59.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.516+0000 7f06050b5640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55e0a7d4d380 0x55e0a7d4d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:44536/0 (socket says 172.21.15.121:44536) 2023-12-07T21:10:59.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.516+0000 7f06058b6640 1 -- 172.21.15.121:0/1673120917 learned_addr learned my addr 172.21.15.121:0/1673120917 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.517+0000 7f06058b6640 1 -- 172.21.15.121:0/1673120917 >> v1:172.21.15.89:6789/0 conn(0x55e0a7d4d380 legacy=0x55e0a7d4d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.517+0000 7f06058b6640 1 -- 172.21.15.121:0/1673120917 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0a7d4f1b0 con 0x55e0a7d4e6c0 2023-12-07T21:10:59.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.518+0000 7f06058b6640 1 --2- 172.21.15.121:0/1673120917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4e6c0 0x55e0a7d4eae0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f05f800a6b0 tx=0x7f05f801ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc36967596d3112 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.519+0000 7f06048b4640 1 -- 172.21.15.121:0/1673120917 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f800a200 con 0x55e0a7d4e6c0 2023-12-07T21:10:59.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.519+0000 7f06048b4640 1 -- 172.21.15.121:0/1673120917 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f800a360 con 0x55e0a7d4e6c0 2023-12-07T21:10:59.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.519+0000 7f06048b4640 1 -- 172.21.15.121:0/1673120917 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f80086e0 con 0x55e0a7d4e6c0 2023-12-07T21:10:59.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.519+0000 7f0607daf800 1 -- 172.21.15.121:0/1673120917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4e6c0 msgr2=0x55e0a7d4eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.519+0000 7f0607daf800 1 --2- 172.21.15.121:0/1673120917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4e6c0 0x55e0a7d4eae0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f05f800a6b0 tx=0x7f05f801ebc0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.519+0000 7f0607daf800 1 -- 172.21.15.121:0/1673120917 shutdown_connections 2023-12-07T21:10:59.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.519+0000 7f0607daf800 1 --2- 172.21.15.121:0/1673120917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4e6c0 0x55e0a7d4eae0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.519+0000 7f0607daf800 1 -- 172.21.15.121:0/1673120917 >> 172.21.15.121:0/1673120917 conn(0x55e0a7d47f50 msgr2=0x55e0a7d4a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.519+0000 7f0607daf800 1 -- 172.21.15.121:0/1673120917 shutdown_connections 2023-12-07T21:10:59.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.519+0000 7f0607daf800 1 -- 172.21.15.121:0/1673120917 wait complete. 2023-12-07T21:10:59.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.520+0000 7f0607daf800 1 Processor -- start 2023-12-07T21:10:59.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.520+0000 7f0607daf800 1 -- start start 2023-12-07T21:10:59.512 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.520+0000 7f0607daf800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 0x55e0a7df10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.520+0000 7f0607daf800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a7c60db0 con 0x55e0a7d4d380 2023-12-07T21:10:59.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.520+0000 7f06058b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 0x55e0a7df10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.520+0000 7f06058b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 0x55e0a7df10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55554/0 (socket says 172.21.15.121:55554) 2023-12-07T21:10:59.513 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.520+0000 7f06058b6640 1 -- 172.21.15.121:0/1633347173 learned_addr learned my addr 172.21.15.121:0/1633347173 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f06058b6640 1 -- 172.21.15.121:0/1633347173 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8005de0 con 0x55e0a7d4d380 2023-12-07T21:10:59.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f06058b6640 1 --2- 172.21.15.121:0/1633347173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 0x55e0a7df10c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f05f8056040 tx=0x7f05f804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6664681afcebae server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f05f7fff640 1 -- 172.21.15.121:0/1633347173 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f8008590 con 0x55e0a7d4d380 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f05f7fff640 1 -- 172.21.15.121:0/1633347173 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f8008730 con 0x55e0a7d4d380 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f05f7fff640 1 -- 172.21.15.121:0/1633347173 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f8008a10 con 0x55e0a7d4d380 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f0607daf800 1 -- 172.21.15.121:0/1633347173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 msgr2=0x55e0a7df10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f0607daf800 1 --2- 172.21.15.121:0/1633347173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 0x55e0a7df10c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f05f8056040 tx=0x7f05f804e000 comp rx=0 tx=0).stop 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f0607daf800 1 -- 172.21.15.121:0/1633347173 shutdown_connections 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f0607daf800 1 --2- 172.21.15.121:0/1633347173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 0x55e0a7df10c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f0607daf800 1 -- 172.21.15.121:0/1633347173 >> 172.21.15.121:0/1633347173 conn(0x55e0a7d47f50 msgr2=0x55e0a7decd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f0607daf800 1 -- 172.21.15.121:0/1633347173 shutdown_connections 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.521+0000 7f0607daf800 1 -- 172.21.15.121:0/1633347173 wait complete. 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.522+0000 7f0607daf800 1 Processor -- start 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.522+0000 7f0607daf800 1 -- start start 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.522+0000 7f0607daf800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 0x55e0a7df8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.522+0000 7f0607daf800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a7c5c6a0 con 0x55e0a7d4d380 2023-12-07T21:10:59.519 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.522+0000 7f06058b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 0x55e0a7df8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.522+0000 7f06058b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 0x55e0a7df8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55562/0 (socket says 172.21.15.121:55562) 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.522+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 learned_addr learned my addr 172.21.15.121:0/3530883411 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.522+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0a7d4f1b0 con 0x55e0a7d4d380 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.523+0000 7f06058b6640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 0x55e0a7df8590 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f05f801f430 tx=0x7f05f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.523+0000 7f05f6ffd640 1 -- 172.21.15.121:0/3530883411 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f8008590 con 0x55e0a7d4d380 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.523+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0a7df8ad0 con 0x55e0a7d4d380 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.523+0000 7f05f6ffd640 1 -- 172.21.15.121:0/3530883411 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f800a190 con 0x55e0a7d4d380 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.523+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0a7df8fb0 con 0x55e0a7d4d380 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.523+0000 7f05f6ffd640 1 -- 172.21.15.121:0/3530883411 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05f80607b0 con 0x55e0a7d4d380 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.523+0000 7f0607daf800 1 Processor -- start 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f0607daf800 1 -- start start 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f05f6ffd640 1 -- 172.21.15.121:0/3530883411 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f05f8005040 con 0x55e0a7d4d380 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f0607daf800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e04bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f05f6ffd640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f05e80360c0 0x7f05e8038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f0607daf800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a7bf6890 con 0x55e0a7e047b0 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f05f6ffd640 1 -- 172.21.15.121:0/3530883411 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f05f808f480 con 0x55e0a7d4d380 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f06058b6640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f05e80360c0 0x7f05e8038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f06060b7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e04bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f06060b7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e04bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55572/0 (socket says 172.21.15.121:55572) 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f06060b7640 1 -- 172.21.15.121:0/718309805 learned_addr learned my addr 172.21.15.121:0/718309805 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f06060b7640 1 -- 172.21.15.121:0/718309805 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0a7e05110 con 0x55e0a7e047b0 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f06058b6640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f05e80360c0 0x7f05e8038580 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f05f805efd0 tx=0x7f05f800d000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f06060b7640 1 --2- 172.21.15.121:0/718309805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e04bd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f060000a430 tx=0x7f060000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5950ee63bb63771f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f05f4ff9640 1 -- 172.21.15.121:0/718309805 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0600001650 con 0x55e0a7e047b0 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f05f4ff9640 1 -- 172.21.15.121:0/718309805 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06000017d0 con 0x55e0a7e047b0 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.524+0000 7f05f4ff9640 1 -- 172.21.15.121:0/718309805 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0600001ab0 con 0x55e0a7e047b0 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.525+0000 7f0607daf800 1 -- 172.21.15.121:0/718309805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 msgr2=0x55e0a7e04bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.525+0000 7f0607daf800 1 --2- 172.21.15.121:0/718309805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e04bd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f060000a430 tx=0x7f060000a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.525+0000 7f0607daf800 1 -- 172.21.15.121:0/718309805 shutdown_connections 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.525+0000 7f0607daf800 1 --2- 172.21.15.121:0/718309805 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e04bd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.525+0000 7f0607daf800 1 -- 172.21.15.121:0/718309805 >> 172.21.15.121:0/718309805 conn(0x55e0a7d4e6c0 msgr2=0x55e0a7dffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.525+0000 7f0607daf800 1 -- 172.21.15.121:0/718309805 shutdown_connections 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.525+0000 7f0607daf800 1 -- 172.21.15.121:0/718309805 wait complete. 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.525+0000 7f0607daf800 1 Processor -- start 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.525+0000 7f0607daf800 1 -- start start 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.525+0000 7f0607daf800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e0b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.525+0000 7f0607daf800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0a7bf6530 con 0x55e0a7e047b0 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.526+0000 7f06060b7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e0b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.526+0000 7f06060b7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e0b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55580/0 (socket says 172.21.15.121:55580) 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.526+0000 7f06060b7640 1 -- 172.21.15.121:0/138302206 learned_addr learned my addr 172.21.15.121:0/138302206 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.526+0000 7f06060b7640 1 -- 172.21.15.121:0/138302206 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060000a0e0 con 0x55e0a7e047b0 2023-12-07T21:10:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.526+0000 7f06060b7640 1 --2- 172.21.15.121:0/138302206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e0b870 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f060000a930 tx=0x7f0600003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.526+0000 7f05e6ffd640 1 -- 172.21.15.121:0/138302206 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0600010900 con 0x55e0a7e047b0 2023-12-07T21:10:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.526+0000 7f05e6ffd640 1 -- 172.21.15.121:0/138302206 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600010a60 con 0x55e0a7e047b0 2023-12-07T21:10:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.526+0000 7f05e6ffd640 1 -- 172.21.15.121:0/138302206 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0600010d20 con 0x55e0a7e047b0 2023-12-07T21:10:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.526+0000 7f0607daf800 1 -- 172.21.15.121:0/138302206 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e0a7e0bdb0 con 0x55e0a7e047b0 2023-12-07T21:10:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.526+0000 7f0607daf800 1 -- 172.21.15.121:0/138302206 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0a7e0c210 con 0x55e0a7e047b0 2023-12-07T21:10:59.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.527+0000 7f05e6ffd640 1 -- 172.21.15.121:0/138302206 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f0600017030 con 0x55e0a7e047b0 2023-12-07T21:10:59.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.527+0000 7f05e6ffd640 1 --2- 172.21.15.121:0/138302206 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f05e00360c0 0x7f05e0038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.527+0000 7f05e6ffd640 1 -- 172.21.15.121:0/138302206 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f060004b920 con 0x55e0a7e047b0 2023-12-07T21:10:59.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.527+0000 7f06050b5640 1 --2- 172.21.15.121:0/138302206 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f05e00360c0 0x7f05e0038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.527+0000 7f0607daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:59.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.527+0000 7f0607daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:59.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.527+0000 7f05cb7e6640 20 reqs_thread_entry: start 2023-12-07T21:10:59.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.528+0000 7f0607daf800 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e0a7e21140 0x55e0a7e23530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.528+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e23a70 con 0x55e0a7e21140 2023-12-07T21:10:59.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.528+0000 7f06050b5640 1 --2- 172.21.15.121:0/138302206 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f05e00360c0 0x7f05e0038580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f05fc000f60 tx=0x7f05fc0012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.532 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.528+0000 7f06060b7640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e0a7e21140 0x55e0a7e23530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.528+0000 7f06060b7640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e0a7e21140 0x55e0a7e23530 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.528+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.528+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e23dd0 con 0x55e0a7e21140 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.528+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.528+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e25180 con 0x55e0a7e21140 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.529+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [call out=48b,read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.529+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e26080 con 0x55e0a7e21140 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.529+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:NOTICE: set zone's realm_id= 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.529+0000 7f0607daf800 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e0a7e2e960 0x55e0a7e2bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.529+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e2e960 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.529+0000 7f06058b6640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e0a7e2e960 0x55e0a7e2bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.530+0000 7f06058b6640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e0a7e2e960 0x55e0a7e2bf30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.530+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(5 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f8067040 con 0x55e0a7e2e960 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.530+0000 7f06058b6640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f05f8073070 0x7f05f808d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.530+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05f8073070 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.530+0000 7f06050b5640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f05f8073070 0x7f05f808d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.530+0000 7f06050b5640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f05f8073070 0x7f05f808d0c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.530+0000 7f06050b5640 1 -- 172.21.15.121:0/3530883411 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05fc00f5f0 con 0x7f05f8073070 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.530+0000 7f06050b5640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f05fc00f070 0x7f05fc00e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.530+0000 7f06050b5640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05fc00f070 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.531+0000 7f06060b7640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f05fc00f070 0x7f05fc00e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.531+0000 7f06060b7640 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f05fc00f070 0x7f05fc00e8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.531+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x7f05fc00f070 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.531+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e21140 2023-12-07T21:10:59.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.532+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.532+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e21140 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.532+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.532+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05fc00f070 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.532+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x7f05fc00f070 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.532+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05fc00f070 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.532+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x7f05fc00f070 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.532+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05f8073070 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.533+0000 7f06050b5640 1 -- 172.21.15.121:0/3530883411 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05fc00f5f0 con 0x7f05f8073070 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.533+0000 7f06050b5640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e2e960 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.533+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f8067040 con 0x55e0a7e2e960 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.533+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e21140 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.533+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.533+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05fc00f070 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.533+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x7f05fc00f070 2023-12-07T21:10:59.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.533+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e21140 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.533+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.534+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05f8073070 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.534+0000 7f06050b5640 1 -- 172.21.15.121:0/3530883411 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(17 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f05fc00f5f0 con 0x7f05f8073070 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.534+0000 7f06050b5640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e2e960 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.534+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f8067040 con 0x55e0a7e2e960 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.534+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e2e960 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.534+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f8067040 con 0x55e0a7e2e960 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.534+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05fc00f070 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.535+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x7f05fc00f070 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.535+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e2e960 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.535+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f8067040 con 0x55e0a7e2e960 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.535+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e2e960 2023-12-07T21:10:59.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.535+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f8067040 con 0x55e0a7e2e960 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.535+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e21140 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.535+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.535+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e21140 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.536+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=132b] v31'3 uv3 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.536+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05fc00f070 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.536+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x7f05fc00f070 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.536+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e2e960 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.536+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f05f8067040 con 0x55e0a7e2e960 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.536+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05f8073070 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.536+0000 7f06050b5640 1 -- 172.21.15.121:0/3530883411 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05fc00f5f0 con 0x7f05f8073070 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.536+0000 7f06050b5640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e21140 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.537+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.537+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05fc00f070 2023-12-07T21:10:59.537 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.537+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x7f05fc00f070 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.537+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e2e960 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.537+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f8067040 con 0x55e0a7e2e960 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.537+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05fc00f070 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.537+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x7f05fc00f070 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.537+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05f8073070 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.538+0000 7f06050b5640 1 -- 172.21.15.121:0/3530883411 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05fc00f5f0 con 0x7f05f8073070 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.538+0000 7f06050b5640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e2e960 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.538+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05f8067040 con 0x55e0a7e2e960 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.538+0000 7f06058b6640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x7f05fc00f070 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.538+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f060002ea00 con 0x7f05fc00f070 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.538+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e27e70 con 0x55e0a7e21140 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.539+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(35 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.539+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f0600053080 con 0x7f05f8073070 2023-12-07T21:10:59.538 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.539+0000 7f06050b5640 1 -- 172.21.15.121:0/3530883411 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(36 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f05fc00f5f0 con 0x7f05f8073070 2023-12-07T21:10:59.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.539+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e30530 con 0x55e0a7e21140 2023-12-07T21:10:59.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.539+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.539+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e30890 con 0x55e0a7e21140 2023-12-07T21:10:59.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.539+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [call out=48b,read 0~874 out=874b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.539+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [create,call version.set in=58b,writefull 0~1036 in=1036b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e2a020 con 0x55e0a7e21140 2023-12-07T21:10:59.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.540+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [create,call,writefull 0~1036] v33'4 uv4 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.540+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e2a020 con 0x55e0a7e21140 2023-12-07T21:10:59.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.542+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v33'3 uv3 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.542+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55e0a7e2c7b0 con 0x55e0a7e21140 2023-12-07T21:10:59.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.543+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v33'5 uv2 ondisk = -17 ((17) File exists)) v8 ==== 199+0+0 (crc 0 0 0) 0x7f060002ea00 con 0x55e0a7e21140 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/138302206 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f05e00360c0 msgr2=0x7f05e0038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 --2- 172.21.15.121:0/138302206 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f05e00360c0 0x7f05e0038580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f05fc000f60 tx=0x7f05fc0012f0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/138302206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 msgr2=0x55e0a7e0b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 --2- 172.21.15.121:0/138302206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e0b870 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f060000a930 tx=0x7f0600003370 comp rx=0 tx=0).stop 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/138302206 shutdown_connections 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 --2- 172.21.15.121:0/138302206 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f05e00360c0 0x7f05e0038580 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 --2- 172.21.15.121:0/138302206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7e047b0 0x55e0a7e0b870 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/138302206 >> 172.21.15.121:0/138302206 conn(0x55e0a7d4e6c0 msgr2=0x55e0a7dfe990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/138302206 shutdown_connections 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/138302206 wait complete. 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f05fc00f070 msgr2=0x7f05fc00e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f05fc00f070 0x7f05fc00e8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e0a7e21140 msgr2=0x55e0a7e23530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55e0a7e21140 0x55e0a7e23530 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f05f8073070 msgr2=0x7f05f808d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f05f8073070 0x7f05f808d0c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e0a7e2e960 msgr2=0x55e0a7e2bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x55e0a7e2e960 0x55e0a7e2bf30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f05e80360c0 msgr2=0x7f05e8038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f05e80360c0 0x7f05e8038580 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f05f805efd0 tx=0x7f05f800d000 comp rx=0 tx=0).stop 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 msgr2=0x55e0a7df8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 --2- 172.21.15.121:0/3530883411 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55e0a7d4d380 0x55e0a7df8590 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f05f801f430 tx=0x7f05f8002fb0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 reap_dead start 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f06060b7640 1 -- 172.21.15.121:0/3530883411 reap_dead start 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 shutdown_connections 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 >> 172.21.15.121:0/3530883411 conn(0x55e0a7d47f50 msgr2=0x55e0a7defdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 shutdown_connections 2023-12-07T21:10:59.544 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.544+0000 7f0607daf800 1 -- 172.21.15.121:0/3530883411 wait complete. 2023-12-07T21:10:59.544 INFO:teuthology.orchestra.run.smithi121.stdout:{"id":"ef4a9585-c98e-4264-8c5b-7c4065599143","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-07T21:10:59.544 DEBUG:tasks.util.rgw: json result: {'id': 'ef4a9585-c98e-4264-8c5b-7c4065599143', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-07T21:10:59.545 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2023-12-07T21:10:59.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2023-12-07T21:10:59.545 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2023-12-07T21:10:59.625 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:59.625 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:59.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.634+0000 7f7bbad11800 1 Processor -- start 2023-12-07T21:10:59.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.634+0000 7f7bbad11800 1 -- start start 2023-12-07T21:10:59.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.634+0000 7f7bbad11800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d99334a0f0 0x55d99334a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.634+0000 7f7bbad11800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d993297790 con 0x55d99334b300 2023-12-07T21:10:59.626 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.634+0000 7f7bbad11800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d993260880 con 0x55d99334a0f0 2023-12-07T21:10:59.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.634+0000 7f7bb8818640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d99334a0f0 0x55d99334a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.634+0000 7f7bb8818640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55d99334a0f0 0x55d99334a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55582/0 (socket says 172.21.15.121:55582) 2023-12-07T21:10:59.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.634+0000 7f7bb8818640 1 -- 172.21.15.121:0/2704782073 learned_addr learned my addr 172.21.15.121:0/2704782073 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.634+0000 7f7bb0017640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55d99334b300 0x55d99334b780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:44542/0 (socket says 172.21.15.121:44542) 2023-12-07T21:10:59.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.635+0000 7f7bb8818640 1 -- 172.21.15.121:0/2704782073 >> v1:172.21.15.89:6789/0 conn(0x55d99334b300 legacy=0x55d99334b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.627 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.635+0000 7f7bb8818640 1 -- 172.21.15.121:0/2704782073 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d99334abe0 con 0x55d99334a0f0 2023-12-07T21:10:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.636+0000 7f7bb8818640 1 --2- 172.21.15.121:0/2704782073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d99334a510 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800a520 tx=0x7f7ba801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c020ca40511ee90 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.636+0000 7f7bb3fff640 1 -- 172.21.15.121:0/2704782073 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ba8052570 con 0x55d99334a0f0 2023-12-07T21:10:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.636+0000 7f7bb3fff640 1 -- 172.21.15.121:0/2704782073 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba80526d0 con 0x55d99334a0f0 2023-12-07T21:10:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.636+0000 7f7bb3fff640 1 -- 172.21.15.121:0/2704782073 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ba8052990 con 0x55d99334a0f0 2023-12-07T21:10:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.637+0000 7f7bbad11800 1 -- 172.21.15.121:0/2704782073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 msgr2=0x55d99334a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.637+0000 7f7bbad11800 1 --2- 172.21.15.121:0/2704782073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d99334a510 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800a520 tx=0x7f7ba801cee0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.637+0000 7f7bbad11800 1 -- 172.21.15.121:0/2704782073 shutdown_connections 2023-12-07T21:10:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.637+0000 7f7bbad11800 1 --2- 172.21.15.121:0/2704782073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d99334a510 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.637+0000 7f7bbad11800 1 -- 172.21.15.121:0/2704782073 >> 172.21.15.121:0/2704782073 conn(0x55d993345870 msgr2=0x55d993347c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.637+0000 7f7bbad11800 1 -- 172.21.15.121:0/2704782073 shutdown_connections 2023-12-07T21:10:59.629 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.637+0000 7f7bbad11800 1 -- 172.21.15.121:0/2704782073 wait complete. 2023-12-07T21:10:59.635 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.638+0000 7f7bbad11800 1 Processor -- start 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.638+0000 7f7bbad11800 1 -- start start 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.638+0000 7f7bbad11800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.638+0000 7f7bbad11800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d99325ddb0 con 0x55d99334a0f0 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.638+0000 7f7bb8818640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.638+0000 7f7bb8818640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55598/0 (socket says 172.21.15.121:55598) 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.638+0000 7f7bb8818640 1 -- 172.21.15.121:0/3059855701 learned_addr learned my addr 172.21.15.121:0/3059855701 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.638+0000 7f7bb8818640 1 -- 172.21.15.121:0/3059855701 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba8005de0 con 0x55d99334a0f0 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.639+0000 7f7bb8818640 1 --2- 172.21.15.121:0/3059855701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f03c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8000c00 tx=0x7f7ba804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf57806fb60a661 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.639+0000 7f7bb37fe640 1 -- 172.21.15.121:0/3059855701 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ba8052840 con 0x55d99334a0f0 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.639+0000 7f7bb37fe640 1 -- 172.21.15.121:0/3059855701 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba80529a0 con 0x55d99334a0f0 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.639+0000 7f7bb37fe640 1 -- 172.21.15.121:0/3059855701 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ba8052c80 con 0x55d99334a0f0 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.639+0000 7f7bbad11800 1 -- 172.21.15.121:0/3059855701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 msgr2=0x55d9933f03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.636 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.639+0000 7f7bbad11800 1 --2- 172.21.15.121:0/3059855701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f03c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8000c00 tx=0x7f7ba804c000 comp rx=0 tx=0).stop 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.639+0000 7f7bbad11800 1 -- 172.21.15.121:0/3059855701 shutdown_connections 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.639+0000 7f7bbad11800 1 --2- 172.21.15.121:0/3059855701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f03c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.639+0000 7f7bbad11800 1 -- 172.21.15.121:0/3059855701 >> 172.21.15.121:0/3059855701 conn(0x55d993345870 msgr2=0x55d9933ee890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.639+0000 7f7bbad11800 1 -- 172.21.15.121:0/3059855701 shutdown_connections 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.639+0000 7f7bbad11800 1 -- 172.21.15.121:0/3059855701 wait complete. 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.640+0000 7f7bbad11800 1 Processor -- start 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.640+0000 7f7bbad11800 1 -- start start 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.640+0000 7f7bbad11800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.640+0000 7f7bbad11800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9932596a0 con 0x55d99334a0f0 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.640+0000 7f7bb8818640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.640+0000 7f7bb8818640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55608/0 (socket says 172.21.15.121:55608) 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.640+0000 7f7bb8818640 1 -- 172.21.15.121:0/3200468802 learned_addr learned my addr 172.21.15.121:0/3200468802 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.640+0000 7f7bb8818640 1 -- 172.21.15.121:0/3200468802 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba804e070 con 0x55d99334a0f0 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.640+0000 7f7bb8818640 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f7550 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7ba801ceb0 tx=0x7f7ba8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.637 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.640+0000 7f7bb27fc640 1 -- 172.21.15.121:0/3200468802 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ba806a070 con 0x55d99334a0f0 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bb27fc640 1 -- 172.21.15.121:0/3200468802 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba8052e50 con 0x55d99334a0f0 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d9933f7a90 con 0x55d99334a0f0 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bb27fc640 1 -- 172.21.15.121:0/3200468802 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ba80655c0 con 0x55d99334a0f0 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9933f7fd0 con 0x55d99334a0f0 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bbad11800 1 Processor -- start 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bbad11800 1 -- start start 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bb27fc640 1 -- 172.21.15.121:0/3200468802 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7ba8059070 con 0x55d99334a0f0 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bbad11800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d993403b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bbad11800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9931f3890 con 0x55d993403760 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bb27fc640 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b980360c0 0x7f7b98038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bb27fc640 1 -- 172.21.15.121:0/3200468802 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f7ba808cd60 con 0x55d99334a0f0 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bb9019640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d993403b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bb9019640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d993403b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55612/0 (socket says 172.21.15.121:55612) 2023-12-07T21:10:59.638 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.641+0000 7f7bb9019640 1 -- 172.21.15.121:0/618347977 learned_addr learned my addr 172.21.15.121:0/618347977 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7bb8818640 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b980360c0 0x7f7b98038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7bb9019640 1 -- 172.21.15.121:0/618347977 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9934040c0 con 0x55d993403760 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7bb8818640 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b980360c0 0x7f7b98038580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8065740 tx=0x7f7ba8079040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7bb9019640 1 --2- 172.21.15.121:0/618347977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d993403b80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400a430 tx=0x7f7bb400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff7d1bc2df688d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7baf816640 1 -- 172.21.15.121:0/618347977 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb4001650 con 0x55d993403760 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7baf816640 1 -- 172.21.15.121:0/618347977 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb40017d0 con 0x55d993403760 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7baf816640 1 -- 172.21.15.121:0/618347977 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb4001ab0 con 0x55d993403760 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7bbad11800 1 -- 172.21.15.121:0/618347977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 msgr2=0x55d993403b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7bbad11800 1 --2- 172.21.15.121:0/618347977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d993403b80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400a430 tx=0x7f7bb400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7bbad11800 1 -- 172.21.15.121:0/618347977 shutdown_connections 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7bbad11800 1 --2- 172.21.15.121:0/618347977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d993403b80 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7bbad11800 1 -- 172.21.15.121:0/618347977 >> 172.21.15.121:0/618347977 conn(0x55d99334b300 msgr2=0x55d9933feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7bbad11800 1 -- 172.21.15.121:0/618347977 shutdown_connections 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.642+0000 7f7bbad11800 1 -- 172.21.15.121:0/618347977 wait complete. 2023-12-07T21:10:59.639 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.643+0000 7f7bbad11800 1 Processor -- start 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.643+0000 7f7bbad11800 1 -- start start 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.643+0000 7f7bbad11800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d99340a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.643+0000 7f7bbad11800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9931f3530 con 0x55d993403760 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.643+0000 7f7bb9019640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d99340a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.643+0000 7f7bb9019640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d99340a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55620/0 (socket says 172.21.15.121:55620) 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.643+0000 7f7bb9019640 1 -- 172.21.15.121:0/859335078 learned_addr learned my addr 172.21.15.121:0/859335078 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.643+0000 7f7bb9019640 1 -- 172.21.15.121:0/859335078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb400a0e0 con 0x55d993403760 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.643+0000 7f7bb9019640 1 --2- 172.21.15.121:0/859335078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d99340a690 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400a930 tx=0x7f7bb4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.644+0000 7f7bae013640 1 -- 172.21.15.121:0/859335078 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb4010900 con 0x55d993403760 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.644+0000 7f7bae013640 1 -- 172.21.15.121:0/859335078 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb4010a60 con 0x55d993403760 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.644+0000 7f7bbad11800 1 -- 172.21.15.121:0/859335078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d99340abd0 con 0x55d993403760 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.644+0000 7f7bae013640 1 -- 172.21.15.121:0/859335078 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb4010d20 con 0x55d993403760 2023-12-07T21:10:59.640 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.644+0000 7f7bbad11800 1 -- 172.21.15.121:0/859335078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d99340b030 con 0x55d993403760 2023-12-07T21:10:59.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.644+0000 7f7bae013640 1 -- 172.21.15.121:0/859335078 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7bb4017030 con 0x55d993403760 2023-12-07T21:10:59.643 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.645+0000 7f7bae013640 1 --2- 172.21.15.121:0/859335078 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b90036110 0x7f7b900385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.645+0000 7f7bbad11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.645+0000 7f7bbad11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.645+0000 7f7bae013640 1 -- 172.21.15.121:0/859335078 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f7bb404b8a0 con 0x55d993403760 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.645+0000 7f7bb0017640 1 --2- 172.21.15.121:0/859335078 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b90036110 0x7f7b900385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.645+0000 7f7b7f7de640 20 reqs_thread_entry: start 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.645+0000 7f7bbad11800 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d993420010 0x55d993422400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.645+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d993422940 con 0x55d993420010 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.645+0000 7f7bb9019640 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d993420010 0x55d993422400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.645+0000 7f7bb0017640 1 --2- 172.21.15.121:0/859335078 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b90036110 0x7f7b900385d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55d9933ff780 tx=0x7f7ba0001320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.645+0000 7f7bb9019640 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d993420010 0x55d993422400 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.646+0000 7f7bb9019640 1 -- 172.21.15.121:0/3200468802 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bb402e9d0 con 0x55d993420010 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.646+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d993422ca0 con 0x55d993420010 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.646+0000 7f7bb9019640 1 -- 172.21.15.121:0/3200468802 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7bb402e9d0 con 0x55d993420010 2023-12-07T21:10:59.644 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.646+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55d993424010 con 0x55d993420010 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.646+0000 7f7bb9019640 1 -- 172.21.15.121:0/3200468802 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [call out=48b,read 0~1036 out=1036b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x7f7bb402e9d0 con 0x55d993420010 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/859335078 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b90036110 msgr2=0x7f7b900385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 --2- 172.21.15.121:0/859335078 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b90036110 0x7f7b900385d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55d9933ff780 tx=0x7f7ba0001320 comp rx=0 tx=0).stop 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/859335078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 msgr2=0x55d99340a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 --2- 172.21.15.121:0/859335078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d99340a690 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400a930 tx=0x7f7bb4003370 comp rx=0 tx=0).stop 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/859335078 shutdown_connections 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 --2- 172.21.15.121:0/859335078 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b90036110 0x7f7b900385d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 --2- 172.21.15.121:0/859335078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d993403760 0x55d99340a690 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/859335078 >> 172.21.15.121:0/859335078 conn(0x55d99334b300 msgr2=0x55d9933fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/859335078 shutdown_connections 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/859335078 wait complete. 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d993420010 msgr2=0x55d993422400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.645 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d993420010 0x55d993422400 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b980360c0 msgr2=0x7f7b98038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b980360c0 0x7f7b98038580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8065740 tx=0x7f7ba8079040 comp rx=0 tx=0).stop 2023-12-07T21:10:59.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 msgr2=0x55d9933f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f7550 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7ba801ceb0 tx=0x7f7ba8002fb0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 shutdown_connections 2023-12-07T21:10:59.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7b980360c0 0x7f7b98038580 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55d993420010 0x55d993422400 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 --2- 172.21.15.121:0/3200468802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55d99334a0f0 0x55d9933f7550 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 >> 172.21.15.121:0/3200468802 conn(0x55d993345870 msgr2=0x55d9933e9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 shutdown_connections 2023-12-07T21:10:59.646 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.647+0000 7f7bbad11800 1 -- 172.21.15.121:0/3200468802 wait complete. 2023-12-07T21:10:59.647 INFO:teuthology.orchestra.run.smithi121.stdout:{"id":"ef4a9585-c98e-4264-8c5b-7c4065599143","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-07T21:10:59.647 DEBUG:tasks.util.rgw: json result: {'id': 'ef4a9585-c98e-4264-8c5b-7c4065599143', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-07T21:10:59.647 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-12-07T21:10:59.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2023-12-07T21:10:59.648 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2023-12-07T21:10:59.731 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:59.732 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.741+0000 7f5386926800 1 Processor -- start 2023-12-07T21:10:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.741+0000 7f5386926800 1 -- start start 2023-12-07T21:10:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.741+0000 7f5386926800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f398ad9bd0 0x55f398b6a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.741+0000 7f5386926800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f398ab1740 con 0x55f398b6a760 2023-12-07T21:10:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.741+0000 7f5386926800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f398a7a880 con 0x55f398ad9bd0 2023-12-07T21:10:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.741+0000 7f5382685640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55f398ad9bd0 0x55f398b6a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.741+0000 7f5381e84640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x55f398b6a760 0x55f398b6cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:44546/0 (socket says 172.21.15.121:44546) 2023-12-07T21:10:59.733 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.741+0000 7f5381e84640 1 -- 172.21.15.121:0/3667238072 learned_addr learned my addr 172.21.15.121:0/3667238072 (peer_addr_for_me v1:172.21.15.121:0/0) 2023-12-07T21:10:59.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.741+0000 7f5382685640 1 -- 172.21.15.121:0/3667238072 >> v1:172.21.15.89:6789/0 conn(0x55f398b6a760 legacy=0x55f398b6cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.734 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.741+0000 7f5382685640 1 -- 172.21.15.121:0/3667238072 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f398b6f280 con 0x55f398ad9bd0 2023-12-07T21:10:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.743+0000 7f5382685640 1 --2- 172.21.15.121:0/3667238072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398b6a220 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f537400a470 tx=0x7f537401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471d34a98065450a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.743+0000 7f5381683640 1 -- 172.21.15.121:0/3667238072 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5374052570 con 0x55f398ad9bd0 2023-12-07T21:10:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.743+0000 7f5381683640 1 -- 172.21.15.121:0/3667238072 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53740526d0 con 0x55f398ad9bd0 2023-12-07T21:10:59.735 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.743+0000 7f5381683640 1 -- 172.21.15.121:0/3667238072 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5374052990 con 0x55f398ad9bd0 2023-12-07T21:10:59.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.744+0000 7f5386926800 1 -- 172.21.15.121:0/3667238072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 msgr2=0x55f398b6a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.744+0000 7f5386926800 1 --2- 172.21.15.121:0/3667238072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398b6a220 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f537400a470 tx=0x7f537401cd60 comp rx=0 tx=0).stop 2023-12-07T21:10:59.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.744+0000 7f5386926800 1 -- 172.21.15.121:0/3667238072 shutdown_connections 2023-12-07T21:10:59.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.744+0000 7f5386926800 1 --2- 172.21.15.121:0/3667238072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398b6a220 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.739 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.744+0000 7f5386926800 1 -- 172.21.15.121:0/3667238072 >> 172.21.15.121:0/3667238072 conn(0x55f398b5f8a0 msgr2=0x55f398b61cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.744+0000 7f5386926800 1 -- 172.21.15.121:0/3667238072 shutdown_connections 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.744+0000 7f5386926800 1 -- 172.21.15.121:0/3667238072 wait complete. 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.745+0000 7f5386926800 1 Processor -- start 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.745+0000 7f5386926800 1 -- start start 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.745+0000 7f5386926800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c0c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.745+0000 7f5386926800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f398a77db0 con 0x55f398ad9bd0 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.745+0000 7f5382685640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c0c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.745+0000 7f5382685640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c0c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55634/0 (socket says 172.21.15.121:55634) 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.745+0000 7f5382685640 1 -- 172.21.15.121:0/1915960426 learned_addr learned my addr 172.21.15.121:0/1915960426 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.745+0000 7f5382685640 1 -- 172.21.15.121:0/1915960426 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5374005d20 con 0x55f398ad9bd0 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.745+0000 7f5382685640 1 --2- 172.21.15.121:0/1915960426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c0c100 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5374055040 tx=0x7f537404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b42636b1a117fa9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.745+0000 7f5380e82640 1 -- 172.21.15.121:0/1915960426 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f537400a180 con 0x55f398ad9bd0 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5380e82640 1 -- 172.21.15.121:0/1915960426 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537400a2e0 con 0x55f398ad9bd0 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5380e82640 1 -- 172.21.15.121:0/1915960426 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53740529b0 con 0x55f398ad9bd0 2023-12-07T21:10:59.740 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5386926800 1 -- 172.21.15.121:0/1915960426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 msgr2=0x55f398c0c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5386926800 1 --2- 172.21.15.121:0/1915960426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c0c100 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5374055040 tx=0x7f537404c000 comp rx=0 tx=0).stop 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5386926800 1 -- 172.21.15.121:0/1915960426 shutdown_connections 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5386926800 1 --2- 172.21.15.121:0/1915960426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c0c100 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5386926800 1 -- 172.21.15.121:0/1915960426 >> 172.21.15.121:0/1915960426 conn(0x55f398b5f8a0 msgr2=0x55f398c07d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5386926800 1 -- 172.21.15.121:0/1915960426 shutdown_connections 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5386926800 1 -- 172.21.15.121:0/1915960426 wait complete. 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5386926800 1 Processor -- start 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5386926800 1 -- start start 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5386926800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c134d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.746+0000 7f5386926800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f398a736a0 con 0x55f398ad9bd0 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.747+0000 7f5382685640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c134d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.747+0000 7f5382685640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c134d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55640/0 (socket says 172.21.15.121:55640) 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.747+0000 7f5382685640 1 -- 172.21.15.121:0/3627109715 learned_addr learned my addr 172.21.15.121:0/3627109715 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.741 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.747+0000 7f5382685640 1 -- 172.21.15.121:0/3627109715 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f398b6f280 con 0x55f398ad9bd0 2023-12-07T21:10:59.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.747+0000 7f5382685640 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c134d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f537400a470 tx=0x7f5374002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.747+0000 7f53737fe640 1 -- 172.21.15.121:0/3627109715 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f537406a070 con 0x55f398ad9bd0 2023-12-07T21:10:59.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.747+0000 7f53737fe640 1 -- 172.21.15.121:0/3627109715 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537406f550 con 0x55f398ad9bd0 2023-12-07T21:10:59.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.747+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f398c13a10 con 0x55f398ad9bd0 2023-12-07T21:10:59.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.747+0000 7f53737fe640 1 -- 172.21.15.121:0/3627109715 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f537406f810 con 0x55f398ad9bd0 2023-12-07T21:10:59.742 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.747+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f398c13f50 con 0x55f398ad9bd0 2023-12-07T21:10:59.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.748+0000 7f5386926800 1 Processor -- start 2023-12-07T21:10:59.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.748+0000 7f5386926800 1 -- start start 2023-12-07T21:10:59.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.748+0000 7f53737fe640 1 -- 172.21.15.121:0/3627109715 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f5374059030 con 0x55f398ad9bd0 2023-12-07T21:10:59.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.748+0000 7f5386926800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c1fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.748+0000 7f5386926800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f398a0d890 con 0x55f398c1f780 2023-12-07T21:10:59.748 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.748+0000 7f53737fe640 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53640360c0 0x7f5364038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.748+0000 7f53737fe640 1 -- 172.21.15.121:0/3627109715 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f537408d170 con 0x55f398ad9bd0 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.748+0000 7f5382e86640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c1fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.748+0000 7f5382685640 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53640360c0 0x7f5364038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.748+0000 7f5382e86640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c1fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55652/0 (socket says 172.21.15.121:55652) 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.748+0000 7f5382e86640 1 -- 172.21.15.121:0/3232457483 learned_addr learned my addr 172.21.15.121:0/3232457483 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f5382e86640 1 -- 172.21.15.121:0/3232457483 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f398c200e0 con 0x55f398c1f780 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f5382685640 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53640360c0 0x7f5364038580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5374044740 tx=0x7f53740446d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f5382e86640 1 --2- 172.21.15.121:0/3232457483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c1fba0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f537c00a430 tx=0x7f537c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b20951943b8ec6a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f53717fa640 1 -- 172.21.15.121:0/3232457483 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f537c001650 con 0x55f398c1f780 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f53717fa640 1 -- 172.21.15.121:0/3232457483 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c0017d0 con 0x55f398c1f780 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f53717fa640 1 -- 172.21.15.121:0/3232457483 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f537c001ab0 con 0x55f398c1f780 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f5386926800 1 -- 172.21.15.121:0/3232457483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 msgr2=0x55f398c1fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.749 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f5386926800 1 --2- 172.21.15.121:0/3232457483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c1fba0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f537c00a430 tx=0x7f537c00a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f5386926800 1 -- 172.21.15.121:0/3232457483 shutdown_connections 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f5386926800 1 --2- 172.21.15.121:0/3232457483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c1fba0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f5386926800 1 -- 172.21.15.121:0/3232457483 >> 172.21.15.121:0/3232457483 conn(0x55f398b6a760 msgr2=0x55f398c1ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f5386926800 1 -- 172.21.15.121:0/3232457483 shutdown_connections 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.749+0000 7f5386926800 1 -- 172.21.15.121:0/3232457483 wait complete. 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.750+0000 7f5386926800 1 Processor -- start 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.750+0000 7f5386926800 1 -- start start 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.750+0000 7f5386926800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c26840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.750+0000 7f5386926800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f398a0d530 con 0x55f398c1f780 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.750+0000 7f5382e86640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c26840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.750+0000 7f5382e86640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c26840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55660/0 (socket says 172.21.15.121:55660) 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.750+0000 7f5382e86640 1 -- 172.21.15.121:0/3510542818 learned_addr learned my addr 172.21.15.121:0/3510542818 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.750 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.750+0000 7f5382e86640 1 -- 172.21.15.121:0/3510542818 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c00a0e0 con 0x55f398c1f780 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.750+0000 7f5382e86640 1 --2- 172.21.15.121:0/3510542818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c26840 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f537c00a930 tx=0x7f537c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.750+0000 7f53637fe640 1 -- 172.21.15.121:0/3510542818 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f537c010900 con 0x55f398c1f780 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.751+0000 7f53637fe640 1 -- 172.21.15.121:0/3510542818 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c010a60 con 0x55f398c1f780 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.751+0000 7f5386926800 1 -- 172.21.15.121:0/3510542818 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f398c26d80 con 0x55f398c1f780 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.751+0000 7f53637fe640 1 -- 172.21.15.121:0/3510542818 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f537c010d20 con 0x55f398c1f780 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.751+0000 7f5386926800 1 -- 172.21.15.121:0/3510542818 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f398c271e0 con 0x55f398c1f780 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.751+0000 7f53637fe640 1 -- 172.21.15.121:0/3510542818 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f537c017030 con 0x55f398c1f780 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.751+0000 7f53637fe640 1 --2- 172.21.15.121:0/3510542818 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f535c036110 0x7f535c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.752+0000 7f53637fe640 1 -- 172.21.15.121:0/3510542818 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f537c04b8a0 con 0x55f398c1f780 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.752+0000 7f5386926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.752+0000 7f5386926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.752+0000 7f5381e84640 1 --2- 172.21.15.121:0/3510542818 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f535c036110 0x7f535c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.751 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.752+0000 7f53437fe640 20 reqs_thread_entry: start 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.752+0000 7f5386926800 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f398c3c160 0x55f398c3e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.752+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f398c3ea90 con 0x55f398c3c160 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.752+0000 7f5381e84640 1 --2- 172.21.15.121:0/3510542818 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f535c036110 0x7f535c0385d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5378000f60 tx=0x7f5378001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.752+0000 7f5382e86640 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f398c3c160 0x55f398c3e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.752+0000 7f5382e86640 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f398c3c160 0x55f398c3e550 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.753+0000 7f5382e86640 1 -- 172.21.15.121:0/3627109715 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f537c02e9d0 con 0x55f398c3c160 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.753+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f398c3fe00 con 0x55f398c3c160 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.753+0000 7f5382e86640 1 -- 172.21.15.121:0/3627109715 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [call out=48b,read 0~1036 out=1036b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x7f537c02e9d0 con 0x55f398c3c160 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.753+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55f398c44870 con 0x55f398c3c160 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.754+0000 7f5382e86640 1 -- 172.21.15.121:0/3627109715 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [stat,call,call,writefull 0~874] v33'6 uv6 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f537c02e9d0 con 0x55f398c3c160 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 -- 172.21.15.121:0/3510542818 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f535c036110 msgr2=0x7f535c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 --2- 172.21.15.121:0/3510542818 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f535c036110 0x7f535c0385d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5378000f60 tx=0x7f5378001230 comp rx=0 tx=0).stop 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 -- 172.21.15.121:0/3510542818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 msgr2=0x55f398c26840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.752 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 --2- 172.21.15.121:0/3510542818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c26840 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f537c00a930 tx=0x7f537c003370 comp rx=0 tx=0).stop 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 -- 172.21.15.121:0/3510542818 shutdown_connections 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 --2- 172.21.15.121:0/3510542818 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f535c036110 0x7f535c0385d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 --2- 172.21.15.121:0/3510542818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398c1f780 0x55f398c26840 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 -- 172.21.15.121:0/3510542818 >> 172.21.15.121:0/3510542818 conn(0x55f398b6a760 msgr2=0x55f398c19960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 -- 172.21.15.121:0/3510542818 shutdown_connections 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 -- 172.21.15.121:0/3510542818 wait complete. 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f398c3c160 msgr2=0x55f398c3e550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f398c3c160 0x55f398c3e550 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53640360c0 msgr2=0x7f5364038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53640360c0 0x7f5364038580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5374044740 tx=0x7f53740446d0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 msgr2=0x55f398c134d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.755+0000 7f5386926800 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c134d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f537400a470 tx=0x7f5374002fb0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.756+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 shutdown_connections 2023-12-07T21:10:59.753 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.756+0000 7f5386926800 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f53640360c0 0x7f5364038580 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.756+0000 7f5386926800 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55f398c3c160 0x55f398c3e550 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.756+0000 7f5386926800 1 --2- 172.21.15.121:0/3627109715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55f398ad9bd0 0x55f398c134d0 secure :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f537400a470 tx=0x7f5374002fb0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.756+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 >> 172.21.15.121:0/3627109715 conn(0x55f398b5f8a0 msgr2=0x55f398c0ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.756+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 shutdown_connections 2023-12-07T21:10:59.754 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.756+0000 7f5386926800 1 -- 172.21.15.121:0/3627109715 wait complete. 2023-12-07T21:10:59.755 INFO:teuthology.orchestra.run.smithi121.stdout:{"id":"ef4a9585-c98e-4264-8c5b-7c4065599143","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-07T21:10:59.755 DEBUG:tasks.util.rgw: json result: {'id': 'ef4a9585-c98e-4264-8c5b-7c4065599143', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-07T21:10:59.755 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2023-12-07T21:10:59.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2023-12-07T21:10:59.755 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2023-12-07T21:10:59.795 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:59.795 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:59.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.804+0000 7f488f537800 1 Processor -- start 2023-12-07T21:10:59.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.804+0000 7f488f537800 1 -- start start 2023-12-07T21:10:59.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.804+0000 7f488f537800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557b07e057c0 0x557b07e07bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.804+0000 7f488f537800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557b07d4d790 con 0x557b07e02830 2023-12-07T21:10:59.796 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.804+0000 7f488f537800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x557b07d16880 con 0x557b07e057c0 2023-12-07T21:10:59.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.805+0000 7f4883fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557b07e057c0 0x557b07e07bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.805+0000 7f4883fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x557b07e057c0 0x557b07e07bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55674/0 (socket says 172.21.15.121:55674) 2023-12-07T21:10:59.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.805+0000 7f4883fff640 1 -- 172.21.15.121:0/2888305811 learned_addr learned my addr 172.21.15.121:0/2888305811 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.805+0000 7f488b2cd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x557b07e02830 0x557b07e02c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:44562/0 (socket says 172.21.15.121:44562) 2023-12-07T21:10:59.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.805+0000 7f4883fff640 1 -- 172.21.15.121:0/2888305811 >> v1:172.21.15.89:6789/0 conn(0x557b07e02830 legacy=0x557b07e02c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.797 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.805+0000 7f4883fff640 1 -- 172.21.15.121:0/2888305811 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b07e09100 con 0x557b07e057c0 2023-12-07T21:10:59.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.807+0000 7f4883fff640 1 --2- 172.21.15.121:0/2888305811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e057c0 0x557b07e07bb0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f487400a520 tx=0x7f487401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3075802822b7d0d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.807+0000 7f488aacc640 1 -- 172.21.15.121:0/2888305811 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4874052570 con 0x557b07e057c0 2023-12-07T21:10:59.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.807+0000 7f488aacc640 1 -- 172.21.15.121:0/2888305811 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48740526d0 con 0x557b07e057c0 2023-12-07T21:10:59.799 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.807+0000 7f488aacc640 1 -- 172.21.15.121:0/2888305811 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4874052990 con 0x557b07e057c0 2023-12-07T21:10:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.807+0000 7f488f537800 1 -- 172.21.15.121:0/2888305811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e057c0 msgr2=0x557b07e07bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.807+0000 7f488f537800 1 --2- 172.21.15.121:0/2888305811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e057c0 0x557b07e07bb0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f487400a520 tx=0x7f487401cee0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.807+0000 7f488f537800 1 -- 172.21.15.121:0/2888305811 shutdown_connections 2023-12-07T21:10:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.807+0000 7f488f537800 1 --2- 172.21.15.121:0/2888305811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e057c0 0x557b07e07bb0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.807+0000 7f488f537800 1 -- 172.21.15.121:0/2888305811 >> 172.21.15.121:0/2888305811 conn(0x557b07dfaf50 msgr2=0x557b07dfd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.807+0000 7f488f537800 1 -- 172.21.15.121:0/2888305811 shutdown_connections 2023-12-07T21:10:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.808+0000 7f488f537800 1 -- 172.21.15.121:0/2888305811 wait complete. 2023-12-07T21:10:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.808+0000 7f488f537800 1 Processor -- start 2023-12-07T21:10:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.808+0000 7f488f537800 1 -- start start 2023-12-07T21:10:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.808+0000 7f488f537800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07e01cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.801 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.808+0000 7f488f537800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b07d13db0 con 0x557b07e02830 2023-12-07T21:10:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.809+0000 7f488b2cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07e01cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.809+0000 7f488b2cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07e01cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55682/0 (socket says 172.21.15.121:55682) 2023-12-07T21:10:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.809+0000 7f488b2cd640 1 -- 172.21.15.121:0/3498690004 learned_addr learned my addr 172.21.15.121:0/3498690004 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.809+0000 7f488b2cd640 1 -- 172.21.15.121:0/3498690004 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874005de0 con 0x557b07e02830 2023-12-07T21:10:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.809+0000 7f488b2cd640 1 --2- 172.21.15.121:0/3498690004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07e01cc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f487c001d30 tx=0x7f487c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bf185aa8b4a6c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.809+0000 7f488a2cb640 1 -- 172.21.15.121:0/3498690004 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f487c014070 con 0x557b07e02830 2023-12-07T21:10:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.809+0000 7f488a2cb640 1 -- 172.21.15.121:0/3498690004 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c00f450 con 0x557b07e02830 2023-12-07T21:10:59.802 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.809+0000 7f488a2cb640 1 -- 172.21.15.121:0/3498690004 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f487c00f730 con 0x557b07e02830 2023-12-07T21:10:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488f537800 1 -- 172.21.15.121:0/3498690004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 msgr2=0x557b07e01cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488f537800 1 --2- 172.21.15.121:0/3498690004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07e01cc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f487c001d30 tx=0x7f487c00b600 comp rx=0 tx=0).stop 2023-12-07T21:10:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488f537800 1 -- 172.21.15.121:0/3498690004 shutdown_connections 2023-12-07T21:10:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488f537800 1 --2- 172.21.15.121:0/3498690004 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07e01cc0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488f537800 1 -- 172.21.15.121:0/3498690004 >> 172.21.15.121:0/3498690004 conn(0x557b07dfaf50 msgr2=0x557b07ea1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488f537800 1 -- 172.21.15.121:0/3498690004 shutdown_connections 2023-12-07T21:10:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488f537800 1 -- 172.21.15.121:0/3498690004 wait complete. 2023-12-07T21:10:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488f537800 1 Processor -- start 2023-12-07T21:10:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488f537800 1 -- start start 2023-12-07T21:10:59.809 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488f537800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07eaf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488f537800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b07d0f6a0 con 0x557b07e02830 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488b2cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07eaf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488b2cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07eaf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55684/0 (socket says 172.21.15.121:55684) 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488b2cd640 1 -- 172.21.15.121:0/1525874758 learned_addr learned my addr 172.21.15.121:0/1525874758 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.810+0000 7f488b2cd640 1 -- 172.21.15.121:0/1525874758 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b07d4d790 con 0x557b07e02830 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.811+0000 7f488b2cd640 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07eaf560 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f487c000c00 tx=0x7f487c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.811+0000 7f48892c9640 1 -- 172.21.15.121:0/1525874758 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f487c014070 con 0x557b07e02830 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.811+0000 7f48892c9640 1 -- 172.21.15.121:0/1525874758 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c020070 con 0x557b07e02830 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.811+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b07eafaa0 con 0x557b07e02830 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.811+0000 7f48892c9640 1 -- 172.21.15.121:0/1525874758 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f487c0198e0 con 0x557b07e02830 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.811+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b07eaff80 con 0x557b07e02830 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.811+0000 7f488f537800 1 Processor -- start 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.811+0000 7f488f537800 1 -- start start 2023-12-07T21:10:59.810 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.811+0000 7f48892c9640 1 -- 172.21.15.121:0/1525874758 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f487c019a40 con 0x557b07e02830 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.811+0000 7f488f537800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ebbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f488f537800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b07ca9890 con 0x557b07ebb720 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f48892c9640 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f486c036110 0x7f486c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f488bace640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ebbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f488bace640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ebbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55696/0 (socket says 172.21.15.121:55696) 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f488bace640 1 -- 172.21.15.121:0/3466524857 learned_addr learned my addr 172.21.15.121:0/3466524857 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f48892c9640 1 -- 172.21.15.121:0/1525874758 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f487c008030 con 0x557b07e02830 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f488b2cd640 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f486c036110 0x7f486c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f488bace640 1 -- 172.21.15.121:0/3466524857 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b07ebc080 con 0x557b07ebb720 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f488b2cd640 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f486c036110 0x7f486c0385d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f487c019e60 tx=0x7f487c034040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f488bace640 1 --2- 172.21.15.121:0/3466524857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ebbb40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f488400a430 tx=0x7f488400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d011fe53da5be633 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f48827fc640 1 -- 172.21.15.121:0/3466524857 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4884001650 con 0x557b07ebb720 2023-12-07T21:10:59.811 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f48827fc640 1 -- 172.21.15.121:0/3466524857 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48840017d0 con 0x557b07ebb720 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.812+0000 7f48827fc640 1 -- 172.21.15.121:0/3466524857 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4884001ab0 con 0x557b07ebb720 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488f537800 1 -- 172.21.15.121:0/3466524857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 msgr2=0x557b07ebbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488f537800 1 --2- 172.21.15.121:0/3466524857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ebbb40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f488400a430 tx=0x7f488400a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488f537800 1 -- 172.21.15.121:0/3466524857 shutdown_connections 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488f537800 1 --2- 172.21.15.121:0/3466524857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ebbb40 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488f537800 1 -- 172.21.15.121:0/3466524857 >> 172.21.15.121:0/3466524857 conn(0x557b07e057c0 msgr2=0x557b07eb6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488f537800 1 -- 172.21.15.121:0/3466524857 shutdown_connections 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488f537800 1 -- 172.21.15.121:0/3466524857 wait complete. 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488f537800 1 Processor -- start 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488f537800 1 -- start start 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488f537800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ec26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488f537800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b07ca9530 con 0x557b07ebb720 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488bace640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ec26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.812 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488bace640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ec26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55702/0 (socket says 172.21.15.121:55702) 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.813+0000 7f488bace640 1 -- 172.21.15.121:0/1058701705 learned_addr learned my addr 172.21.15.121:0/1058701705 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.814+0000 7f488bace640 1 -- 172.21.15.121:0/1058701705 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488400a0e0 con 0x557b07ebb720 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.814+0000 7f488bace640 1 --2- 172.21.15.121:0/1058701705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ec26f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f488400ae40 tx=0x7f4884003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.814+0000 7f4880ff9640 1 -- 172.21.15.121:0/1058701705 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48840109e0 con 0x557b07ebb720 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.814+0000 7f4880ff9640 1 -- 172.21.15.121:0/1058701705 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4884010b40 con 0x557b07ebb720 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.814+0000 7f488f537800 1 -- 172.21.15.121:0/1058701705 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557b07ec2c30 con 0x557b07ebb720 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.814+0000 7f4880ff9640 1 -- 172.21.15.121:0/1058701705 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4884010e20 con 0x557b07ebb720 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.814+0000 7f488f537800 1 -- 172.21.15.121:0/1058701705 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b07ec3090 con 0x557b07ebb720 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.815+0000 7f4880ff9640 1 -- 172.21.15.121:0/1058701705 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f4884017070 con 0x557b07ebb720 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.815+0000 7f4880ff9640 1 --2- 172.21.15.121:0/1058701705 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4864036110 0x7f48640385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.815+0000 7f4880ff9640 1 -- 172.21.15.121:0/1058701705 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f488404b670 con 0x557b07ebb720 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.815+0000 7f488f537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.815+0000 7f488f537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.815+0000 7f4883fff640 1 --2- 172.21.15.121:0/1058701705 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4864036110 0x7f48640385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.813 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.815+0000 7f48517e2640 20 reqs_thread_entry: start 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.815+0000 7f488f537800 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557b07ed8010 0x557b07eda400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.815+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b07eda940 con 0x557b07ed8010 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.815+0000 7f488bace640 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557b07ed8010 0x557b07eda400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.815+0000 7f4883fff640 1 --2- 172.21.15.121:0/1058701705 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4864036110 0x7f48640385d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4874054000 tx=0x7f487404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.816+0000 7f488bace640 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557b07ed8010 0x557b07eda400 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.816+0000 7f488bace640 1 -- 172.21.15.121:0/1525874758 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4884044db0 con 0x557b07ed8010 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.816+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b07edaca0 con 0x557b07ed8010 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.816+0000 7f488bace640 1 -- 172.21.15.121:0/1525874758 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4884044db0 con 0x557b07ed8010 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.816+0000 7f488f537800 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557b07edc520 0x557b07ede970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.816+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:3 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x557b07edf010 con 0x557b07edc520 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.816+0000 7f488b2cd640 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557b07edc520 0x557b07ede970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.817+0000 7f488b2cd640 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557b07edc520 0x557b07ede970 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.814 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.817+0000 7f488b2cd640 1 -- 172.21.15.121:0/1525874758 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(3 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f487c016070 con 0x557b07edc520 2023-12-07T21:10:59.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1058701705 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4864036110 msgr2=0x7f48640385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1058701705 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4864036110 0x7f48640385d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4874054000 tx=0x7f487404e000 comp rx=0 tx=0).stop 2023-12-07T21:10:59.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1058701705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 msgr2=0x557b07ec26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1058701705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ec26f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f488400ae40 tx=0x7f4884003370 comp rx=0 tx=0).stop 2023-12-07T21:10:59.816 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1058701705 shutdown_connections 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1058701705 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4864036110 0x7f48640385d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1058701705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07ebb720 0x557b07ec26f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1058701705 >> 172.21.15.121:0/1058701705 conn(0x557b07e057c0 msgr2=0x557b07eb5900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1058701705 shutdown_connections 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1058701705 wait complete. 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557b07ed8010 msgr2=0x557b07eda400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557b07ed8010 0x557b07eda400 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557b07edc520 msgr2=0x557b07ede970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557b07edc520 0x557b07ede970 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f486c036110 msgr2=0x7f486c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f486c036110 0x7f486c0385d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f487c019e60 tx=0x7f487c034040 comp rx=0 tx=0).stop 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 msgr2=0x557b07eaf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.817 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07eaf560 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f487c000c00 tx=0x7f487c000ed0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 shutdown_connections 2023-12-07T21:10:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x557b07edc520 0x557b07ede970 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f486c036110 0x7f486c0385d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x557b07ed8010 0x557b07eda400 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 --2- 172.21.15.121:0/1525874758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x557b07e02830 0x557b07eaf560 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 >> 172.21.15.121:0/1525874758 conn(0x557b07dfaf50 msgr2=0x557b07e00610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 shutdown_connections 2023-12-07T21:10:59.818 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.818+0000 7f488f537800 1 -- 172.21.15.121:0/1525874758 wait complete. 2023-12-07T21:10:59.819 INFO:teuthology.orchestra.run.smithi121.stdout:{"id":"209e4ade-356c-43a0-a93d-cc9500dad162","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"ef4a9585-c98e-4264-8c5b-7c4065599143","zones":[{"id":"ef4a9585-c98e-4264-8c5b-7c4065599143","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2023-12-07T21:10:59.819 DEBUG:tasks.util.rgw: json result: {'id': '209e4ade-356c-43a0-a93d-cc9500dad162', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'ef4a9585-c98e-4264-8c5b-7c4065599143', 'zones': [{'id': 'ef4a9585-c98e-4264-8c5b-7c4065599143', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['resharding']} 2023-12-07T21:10:59.822 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2023-12-07T21:10:59.838 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2023-12-07T21:10:59.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2023-12-07T21:10:59.839 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2023-12-07T21:10:59.913 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:10:59.913 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:10:59.913 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.922+0000 7f18a7ae4800 1 Processor -- start 2023-12-07T21:10:59.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.922+0000 7f18a7ae4800 1 -- start start 2023-12-07T21:10:59.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.922+0000 7f18a7ae4800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5608772dd4e0 0x5608772df8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.922+0000 7f18a7ae4800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560877226740 con 0x5608772d90a0 2023-12-07T21:10:59.914 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.922+0000 7f18a7ae4800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x5608771ef880 con 0x5608772dd4e0 2023-12-07T21:10:59.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.922+0000 7f18a4de3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5608772dd4e0 0x5608772df8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.922+0000 7f18a4de3640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x5608772dd4e0 0x5608772df8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55710/0 (socket says 172.21.15.121:55710) 2023-12-07T21:10:59.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.922+0000 7f18a4de3640 1 -- 172.21.15.121:0/2514441787 learned_addr learned my addr 172.21.15.121:0/2514441787 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.922+0000 7f18a55e4640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x5608772d90a0 0x5608772d94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:44564/0 (socket says 172.21.15.121:44564) 2023-12-07T21:10:59.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.922+0000 7f18a4de3640 1 -- 172.21.15.121:0/2514441787 >> v1:172.21.15.89:6789/0 conn(0x5608772d90a0 legacy=0x5608772d94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.915 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.922+0000 7f18a4de3640 1 -- 172.21.15.121:0/2514441787 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608772e0f00 con 0x5608772dd4e0 2023-12-07T21:10:59.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.924+0000 7f18a4de3640 1 --2- 172.21.15.121:0/2514441787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772dd4e0 0x5608772df8d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f189c00a520 tx=0x7f189c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b46fced3614dc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.924+0000 7f1897fff640 1 -- 172.21.15.121:0/2514441787 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f189c052570 con 0x5608772dd4e0 2023-12-07T21:10:59.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.924+0000 7f1897fff640 1 -- 172.21.15.121:0/2514441787 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c0526d0 con 0x5608772dd4e0 2023-12-07T21:10:59.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.924+0000 7f1897fff640 1 -- 172.21.15.121:0/2514441787 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f189c052990 con 0x5608772dd4e0 2023-12-07T21:10:59.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.925+0000 7f18a7ae4800 1 -- 172.21.15.121:0/2514441787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772dd4e0 msgr2=0x5608772df8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.925+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/2514441787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772dd4e0 0x5608772df8d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f189c00a520 tx=0x7f189c01cee0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.925+0000 7f18a7ae4800 1 -- 172.21.15.121:0/2514441787 shutdown_connections 2023-12-07T21:10:59.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.925+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/2514441787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772dd4e0 0x5608772df8d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.925+0000 7f18a7ae4800 1 -- 172.21.15.121:0/2514441787 >> 172.21.15.121:0/2514441787 conn(0x5608772d4820 msgr2=0x5608772d6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.925+0000 7f18a7ae4800 1 -- 172.21.15.121:0/2514441787 shutdown_connections 2023-12-07T21:10:59.917 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.925+0000 7f18a7ae4800 1 -- 172.21.15.121:0/2514441787 wait complete. 2023-12-07T21:10:59.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.926+0000 7f18a7ae4800 1 Processor -- start 2023-12-07T21:10:59.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.926+0000 7f18a7ae4800 1 -- start start 2023-12-07T21:10:59.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.926+0000 7f18a7ae4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x56087737cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.926+0000 7f18a7ae4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608771ecdb0 con 0x5608772d90a0 2023-12-07T21:10:59.924 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.926+0000 7f18a55e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x56087737cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.926+0000 7f18a55e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x56087737cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55712/0 (socket says 172.21.15.121:55712) 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.926+0000 7f18a55e4640 1 -- 172.21.15.121:0/2829423212 learned_addr learned my addr 172.21.15.121:0/2829423212 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.926+0000 7f18a55e4640 1 -- 172.21.15.121:0/2829423212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c005de0 con 0x5608772d90a0 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.926+0000 7f18a55e4640 1 --2- 172.21.15.121:0/2829423212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x56087737cc90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1898001d30 tx=0x7f189800b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48962ba3d3f63e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18977fe640 1 -- 172.21.15.121:0/2829423212 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1898014070 con 0x5608772d90a0 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18977fe640 1 -- 172.21.15.121:0/2829423212 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800f450 con 0x5608772d90a0 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18977fe640 1 -- 172.21.15.121:0/2829423212 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f189800f730 con 0x5608772d90a0 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18a7ae4800 1 -- 172.21.15.121:0/2829423212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 msgr2=0x56087737cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/2829423212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x56087737cc90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f1898001d30 tx=0x7f189800b600 comp rx=0 tx=0).stop 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18a7ae4800 1 -- 172.21.15.121:0/2829423212 shutdown_connections 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/2829423212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x56087737cc90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18a7ae4800 1 -- 172.21.15.121:0/2829423212 >> 172.21.15.121:0/2829423212 conn(0x5608772d4820 msgr2=0x560877378900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18a7ae4800 1 -- 172.21.15.121:0/2829423212 shutdown_connections 2023-12-07T21:10:59.925 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18a7ae4800 1 -- 172.21.15.121:0/2829423212 wait complete. 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18a7ae4800 1 Processor -- start 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18a7ae4800 1 -- start start 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18a7ae4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x560877384190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.927+0000 7f18a7ae4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608771e86a0 con 0x5608772d90a0 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.928+0000 7f18a55e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x560877384190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.928+0000 7f18a55e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x560877384190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55720/0 (socket says 172.21.15.121:55720) 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.928+0000 7f18a55e4640 1 -- 172.21.15.121:0/468484649 learned_addr learned my addr 172.21.15.121:0/468484649 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.928+0000 7f18a55e4640 1 -- 172.21.15.121:0/468484649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560877226740 con 0x5608772d90a0 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.928+0000 7f18a55e4640 1 --2- 172.21.15.121:0/468484649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x560877384190 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1898000c00 tx=0x7f1898000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.928+0000 7f18967fc640 1 -- 172.21.15.121:0/468484649 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1898014070 con 0x5608772d90a0 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.928+0000 7f18967fc640 1 -- 172.21.15.121:0/468484649 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1898020070 con 0x5608772d90a0 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.928+0000 7f18a7ae4800 1 -- 172.21.15.121:0/468484649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5608773846d0 con 0x5608772d90a0 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.928+0000 7f18967fc640 1 -- 172.21.15.121:0/468484649 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1898019900 con 0x5608772d90a0 2023-12-07T21:10:59.926 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.928+0000 7f18a7ae4800 1 -- 172.21.15.121:0/468484649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560877384b50 con 0x5608772d90a0 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.929+0000 7f18a7ae4800 1 Processor -- start 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.929+0000 7f18a7ae4800 1 -- start start 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.929+0000 7f18967fc640 1 -- 172.21.15.121:0/468484649 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f1898019a60 con 0x5608772d90a0 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.929+0000 7f18a7ae4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 0x5608773907c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.929+0000 7f18a7ae4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560877182890 con 0x5608773903a0 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.929+0000 7f18967fc640 1 --2- 172.21.15.121:0/468484649 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1888036110 0x7f18880385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.929+0000 7f18967fc640 1 -- 172.21.15.121:0/468484649 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f1898008030 con 0x5608772d90a0 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.929+0000 7f18a55e4640 1 --2- 172.21.15.121:0/468484649 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1888036110 0x7f18880385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.929+0000 7f18a5de5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 0x5608773907c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.929+0000 7f18a5de5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 0x5608773907c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55734/0 (socket says 172.21.15.121:55734) 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.929+0000 7f18a5de5640 1 -- 172.21.15.121:0/1802626793 learned_addr learned my addr 172.21.15.121:0/1802626793 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f18a55e4640 1 --2- 172.21.15.121:0/468484649 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1888036110 0x7f18880385d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f189801b020 tx=0x7f1898034040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f18a5de5640 1 -- 172.21.15.121:0/1802626793 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560877390d00 con 0x5608773903a0 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f18a5de5640 1 --2- 172.21.15.121:0/1802626793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 0x5608773907c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f18a000a430 tx=0x7f18a000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3fa11dd9d9aa8c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.927 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f1887fff640 1 -- 172.21.15.121:0/1802626793 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18a0001650 con 0x5608773903a0 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f1887fff640 1 -- 172.21.15.121:0/1802626793 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a00017d0 con 0x5608773903a0 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f1887fff640 1 -- 172.21.15.121:0/1802626793 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18a0001ab0 con 0x5608773903a0 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f18a7ae4800 1 -- 172.21.15.121:0/1802626793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 msgr2=0x5608773907c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/1802626793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 0x5608773907c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f18a000a430 tx=0x7f18a000a8f0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f18a7ae4800 1 -- 172.21.15.121:0/1802626793 shutdown_connections 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/1802626793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 0x5608773907c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f18a7ae4800 1 -- 172.21.15.121:0/1802626793 >> 172.21.15.121:0/1802626793 conn(0x5608772dd4e0 msgr2=0x56087738b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f18a7ae4800 1 -- 172.21.15.121:0/1802626793 shutdown_connections 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.930+0000 7f18a7ae4800 1 -- 172.21.15.121:0/1802626793 wait complete. 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.931+0000 7f18a7ae4800 1 Processor -- start 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.931+0000 7f18a7ae4800 1 -- start start 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.931+0000 7f18a7ae4800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 0x560877397420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.931+0000 7f18a7ae4800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x560877182530 con 0x5608773903a0 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.931+0000 7f18a5de5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 0x560877397420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.928 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.931+0000 7f18a5de5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 0x560877397420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:55736/0 (socket says 172.21.15.121:55736) 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.931+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 learned_addr learned my addr 172.21.15.121:0/285673100 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.931+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a000a0e0 con 0x5608773903a0 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.931+0000 7f18a5de5640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 0x560877397420 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f18a000a930 tx=0x7f18a0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.931+0000 7f18867fc640 1 -- 172.21.15.121:0/285673100 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18a0010900 con 0x5608773903a0 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.932+0000 7f18867fc640 1 -- 172.21.15.121:0/285673100 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a0010a60 con 0x5608773903a0 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.932+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560877397960 con 0x5608773903a0 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.932+0000 7f18867fc640 1 -- 172.21.15.121:0/285673100 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18a0010d20 con 0x5608773903a0 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.932+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560877397dc0 con 0x5608773903a0 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.932+0000 7f18867fc640 1 -- 172.21.15.121:0/285673100 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f18a0017030 con 0x5608773903a0 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.932+0000 7f18867fc640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f18800360c0 0x7f1880038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.933+0000 7f18867fc640 1 -- 172.21.15.121:0/285673100 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f18a004b9a0 con 0x5608773903a0 2023-12-07T21:10:59.929 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.933+0000 7f18a4de3640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f18800360c0 0x7f1880038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.933+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.941 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.933+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5608773a2a80 0x5608773a4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.933+0000 7f18a4de3640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f18800360c0 0x7f1880038580 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f189c054000 tx=0x7f189c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.933+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a5690 con 0x5608773a2a80 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.933+0000 7f18a5de5640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5608773a2a80 0x5608773a4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.933+0000 7f18a5de5640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5608773a2a80 0x5608773a4f40 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 20 realm 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a5aa0 con 0x5608773a2a80 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.942 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a6320 con 0x5608773a2a80 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a6680 con 0x5608773a2a80 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a6e80 con 0x5608773a2a80 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv6 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.934+0000 7f18a7ae4800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.935+0000 7f18a7ae4800 20 searching for the correct realm 2023-12-07T21:10:59.943 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.935+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5608773a8ba0 0x5608773ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.935+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a8ba0 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.935+0000 7f18a55e4640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5608773a8ba0 0x5608773ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.935+0000 7f18a55e4640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5608773a8ba0 0x5608773ab010 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.935+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1898016070 con 0x5608773a8ba0 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.935+0000 7f18a55e4640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f189800f070 0x7f18980183d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.935+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x7f189800f070 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.935+0000 7f18a4de3640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f189800f070 0x7f18980183d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.936+0000 7f18a4de3640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f189800f070 0x7f18980183d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.936+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.936+0000 7f18a4de3640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f189c0663c0 0x7f189c066800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.936+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x7f189c0663c0 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.936+0000 7f18a5de5640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f189c0663c0 0x7f189c066800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:10:59.944 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.936+0000 7f18a5de5640 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f189c0663c0 0x7f189c066800 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.937+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.937+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a2a80 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.937+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.937+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a2a80 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.937+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.937+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x7f189c0663c0 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.937+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.937+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x7f189c0663c0 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.938+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.938+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x7f189800f070 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.938+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.938+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a8ba0 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.938+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1898016070 con 0x5608773a8ba0 2023-12-07T21:10:59.945 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.938+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a2a80 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.938+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.938+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x7f189c0663c0 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.939+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.939+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a2a80 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.939+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.939+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x7f189800f070 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.939+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.939+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a8ba0 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.939+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1898016070 con 0x5608773a8ba0 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.939+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a8ba0 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.940+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1898016070 con 0x5608773a8ba0 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.940+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x7f189c0663c0 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.940+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.946 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.940+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a8ba0 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.940+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1898016070 con 0x5608773a8ba0 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.940+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a8ba0 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.940+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1898016070 con 0x5608773a8ba0 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.940+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a2a80 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.941+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.941+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x5608773a2a80 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.941+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v33'6 uv6 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.941+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ab6e0 con 0x7f189c0663c0 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.941+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.941+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18a0053040 con 0x5608773a8ba0 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.941+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1898016070 con 0x5608773a8ba0 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.941+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18a0053040 con 0x7f189800f070 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.942+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.942+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18a0053040 con 0x5608773a2a80 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.942+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.947 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.942+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18a0053040 con 0x7f189c0663c0 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.942+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.942+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18a0053040 con 0x5608773a8ba0 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.942+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1898016070 con 0x5608773a8ba0 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.942+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18a0053040 con 0x7f189c0663c0 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.942+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.942+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18a0053040 con 0x7f189800f070 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.943+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.943+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18a0053040 con 0x5608773a8ba0 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.943+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1898016070 con 0x5608773a8ba0 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.943+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18a0053040 con 0x7f189c0663c0 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.943+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.943+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18a0053040 con 0x5608773a2a80 2023-12-07T21:10:59.948 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.943+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.943+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18a0053040 con 0x7f189800f070 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a7780 con 0x5608773a2a80 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a7400 con 0x5608773a2a80 2023-12-07T21:10:59.949 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a8050 con 0x5608773a8ba0 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1898016070 con 0x5608773a8ba0 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 20 zone default found 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 4 Realm: () 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.944+0000 7f18a7ae4800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 20 zonegroup default 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.950 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773abb20 con 0x7f189c0663c0 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ad8b0 con 0x5608773a8ba0 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1898057040 con 0x5608773a8ba0 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773adc10 con 0x5608773a8ba0 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1898057040 con 0x5608773a8ba0 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.945+0000 7f18a7ae4800 20 started sync module instance, tier type = 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.946+0000 7f18a7ae4800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:10:59.951 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.946+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ad190 con 0x7f189800f070 2023-12-07T21:10:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.947+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.947+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94594357665616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ae030 con 0x7f189800f070 2023-12-07T21:10:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.947+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ae830 con 0x5608773a2a80 2023-12-07T21:10:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.948+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94594357665616] v33'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.948+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.948+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94594360069360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773ae830 con 0x5608773a2a80 2023-12-07T21:10:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.948+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773af030 con 0x5608773a8ba0 2023-12-07T21:10:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.949+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94594360069360] v33'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.949+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1898057040 con 0x5608773a8ba0 2023-12-07T21:10:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.949+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94594360075424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773af390 con 0x5608773a8ba0 2023-12-07T21:10:59.952 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.949+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773afd00 con 0x7f189800f070 2023-12-07T21:10:59.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.950+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94594360075424] v33'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1898057040 con 0x5608773a8ba0 2023-12-07T21:10:59.958 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.950+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.950+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94594360076528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b0500 con 0x7f189800f070 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.950+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b0d00 con 0x5608773a2a80 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.951+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94594360076528] v33'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.952+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.952+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94594360084576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b0c70 con 0x5608773a2a80 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.952+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b19f0 con 0x7f189c0663c0 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.953+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.953+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94594360087888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b1e00 con 0x7f189c0663c0 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.953+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b27b0 con 0x7f189c0663c0 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.953+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94594360084576] v33'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.954+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(56 notify.6 [create] v33'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.954+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94594360086704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b2770 con 0x7f189c0663c0 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.954+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b30e0 con 0x7f189c0663c0 2023-12-07T21:10:59.959 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.954+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94594360087888] v33'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.955+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94594360086704] v33'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.956+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(58 notify.7 [create] v33'240 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.956+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94594360091344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b26e0 con 0x7f189c0663c0 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.956+0000 7f18a7ae4800 20 add_watcher() i=0 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.956+0000 7f18a7ae4800 20 add_watcher() i=1 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.956+0000 7f18a7ae4800 20 add_watcher() i=2 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.956+0000 7f18a7ae4800 20 add_watcher() i=3 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.956+0000 7f18a7ae4800 20 add_watcher() i=4 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.956+0000 7f18a7ae4800 20 add_watcher() i=5 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.956+0000 7f18a7ae4800 20 add_watcher() i=6 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.958+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94594360091344] v33'241 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.958+0000 7f18a7ae4800 20 add_watcher() i=7 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.958+0000 7f18a7ae4800 2 all 8 watchers are set, enabling cache 2023-12-07T21:10:59.960 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.958+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b6110 con 0x5608773a2a80 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.958+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.958+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94594360093760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b34f0 con 0x5608773a2a80 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.959+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94594360093760] v33'239 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.959+0000 7f186afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.959+0000 7f18a7ae4800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.959+0000 7f18a7ae4800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.959+0000 7f18a7ae4800 5 note: GC not initialized 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.959+0000 7f1869fe3640 20 reqs_thread_entry: start 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.959+0000 7f18a7ae4800 20 init_complete bucket index max shards: 11 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f18a7ae4800 20 Filter name: none 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f17db7fe640 20 reqs_thread_entry: start 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f18a7ae4800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2023-12-07T21:10:59.961 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773e8f50 con 0x7f189c0663c0 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f18a7ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f18a7ae4800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f18a7ae4800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f18a7ae4800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f18a7ae4800 20 rados->read ofs=0 len=0 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.960+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773e7700 con 0x5608773a2a80 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.961+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.961+0000 7f18a7ae4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.961+0000 7f18a7ae4800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.961+0000 7f18a7ae4800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.961+0000 7f18a7ae4800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2023-12-07T21:10:59.962 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.961+0000 7f18a7ae4800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.961+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~439 in=439b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773e7fa0 con 0x7f189c0663c0 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.962+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~439] v33'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.962+0000 7f18a7ae4800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.962+0000 7f18a7ae4800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.962+0000 7f18a7ae4800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.962+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94594360310528 in=627b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773e7f50 con 0x5608773a2a80 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.962+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== watch-notify(notify (1) cookie 94594360084576 notify 141733920794 ret 0) v3 ==== 657+0+0 (crc 0 0 0) 0x560877397dc0 con 0x5608773a2a80 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.962+0000 7f1887fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94594360084576 notifier 4738 bl.length()=615 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.962+0000 7f1887fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.962+0000 7f1887fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.962+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(65 notify.4 [notify cookie 94594360310528 out=8b] v0'0 uv240 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.962+0000 7f1887fff640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18780042a0 con 0x5608773a2a80 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.963+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.963 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.963+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== watch-notify(notify_complete (2) cookie 94594360310528 notify 141733920794 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x560877397960 con 0x5608773a2a80 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.963+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773e7f10 con 0x5608773a2a80 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v33'18 uv18 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f18a7ae4800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f18a7ae4800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f18a7ae4800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94594360310528 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773eb9b0 con 0x5608773a8ba0 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== watch-notify(notify (1) cookie 94594360075424 notify 141733920776 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x560877384b50 con 0x5608773a8ba0 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f1887fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 94594360075424 notifier 4738 bl.length()=177 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f1887fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f1887fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f1887fff640 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f18780042a0 con 0x5608773a8ba0 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(68 notify.2 [notify cookie 94594360310528 out=8b] v0'0 uv240 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1898057040 con 0x5608773a8ba0 2023-12-07T21:10:59.964 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== watch-notify(notify_complete (2) cookie 94594360310528 notify 141733920776 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x5608773846d0 con 0x5608773a8ba0 2023-12-07T21:10:59.965 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.964+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1898057040 con 0x5608773a8ba0 2023-12-07T21:10:59.965 INFO:teuthology.orchestra.run.smithi121.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2023-12-07T21:10:59.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.965+0000 7f186afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:10:59.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.965+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94594360093760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56087739f8c0 con 0x5608773a2a80 2023-12-07T21:10:59.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.966+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94594360093760] v33'240 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.966+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94594357665616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x56087739fd60 con 0x7f189800f070 2023-12-07T21:10:59.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.967+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94594357665616] v33'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.967+0000 7f18a7ae4800 20 remove_watcher() i=0 2023-12-07T21:10:59.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.967+0000 7f18a7ae4800 2 removed watcher, disabling cache 2023-12-07T21:10:59.969 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.967+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94594360069360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a00c0 con 0x5608773a2a80 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.969+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94594360069360] v33'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.969+0000 7f18a7ae4800 20 remove_watcher() i=1 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.969+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94594360075424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a00c0 con 0x5608773a8ba0 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.970+0000 7f18a55e4640 1 -- 172.21.15.121:0/285673100 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94594360075424] v33'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1898057040 con 0x5608773a8ba0 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.970+0000 7f18a7ae4800 20 remove_watcher() i=2 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.970+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94594360076528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a00c0 con 0x7f189800f070 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.971+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94594360076528] v33'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f189c052b00 con 0x7f189800f070 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.971+0000 7f18a7ae4800 20 remove_watcher() i=3 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.971+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94594360084576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a0420 con 0x5608773a2a80 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.972+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94594360084576] v33'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x5608773a2a80 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.972+0000 7f18a7ae4800 20 remove_watcher() i=4 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.972+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94594360087888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773a0420 con 0x7f189c0663c0 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.973+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94594360087888] v33'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.970 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.973+0000 7f18a7ae4800 20 remove_watcher() i=5 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.973+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94594360086704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b1550 con 0x7f189c0663c0 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.974+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94594360086704] v33'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.974+0000 7f18a7ae4800 20 remove_watcher() i=6 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.974+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94594360091344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5608773b1550 con 0x7f189c0663c0 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a5de5640 1 -- 172.21.15.121:0/285673100 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94594360091344] v33'242 uv240 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f18a002ea00 con 0x7f189c0663c0 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 20 remove_watcher() i=7 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f189c0663c0 msgr2=0x7f189c066800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f189c0663c0 0x7f189c066800 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5608773a2a80 msgr2=0x5608773a4f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x5608773a2a80 0x5608773a4f40 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f189800f070 msgr2=0x7f18980183d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f189800f070 0x7f18980183d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5608773a8ba0 msgr2=0x5608773ab010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5608773a8ba0 0x5608773ab010 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.971 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f18800360c0 msgr2=0x7f1880038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f18800360c0 0x7f1880038580 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f189c054000 tx=0x7f189c04e000 comp rx=0 tx=0).stop 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 msgr2=0x560877397420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/285673100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608773903a0 0x560877397420 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f18a000a930 tx=0x7f18a0003370 comp rx=0 tx=0).stop 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 reap_dead start 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 shutdown_connections 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 >> 172.21.15.121:0/285673100 conn(0x5608772dd4e0 msgr2=0x56087738a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a4de3640 1 -- 172.21.15.121:0/285673100 reap_dead start 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 shutdown_connections 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/285673100 wait complete. 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/468484649 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1888036110 msgr2=0x7f18880385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/468484649 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1888036110 0x7f18880385d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f189801b020 tx=0x7f1898034040 comp rx=0 tx=0).stop 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/468484649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 msgr2=0x560877384190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/468484649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x560877384190 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f1898000c00 tx=0x7f1898000ed0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/468484649 shutdown_connections 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/468484649 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1888036110 0x7f18880385d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.972 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 --2- 172.21.15.121:0/468484649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5608772d90a0 0x560877384190 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:10:59.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.975+0000 7f18a7ae4800 1 -- 172.21.15.121:0/468484649 >> 172.21.15.121:0/468484649 conn(0x5608772d4820 msgr2=0x56087737b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:10:59.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.976+0000 7f18a7ae4800 1 -- 172.21.15.121:0/468484649 shutdown_connections 2023-12-07T21:10:59.973 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:10:59.976+0000 7f18a7ae4800 1 -- 172.21.15.121:0/468484649 wait complete. 2023-12-07T21:10:59.974 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:10:59.974 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:10:59.974 ERROR:root:0 2023-12-07T21:10:59.975 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2023-12-07T21:10:59.980 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000007eb98d5714f86c06-00657234e3-4222-default', 'HostId': '4222-default-default'} 2023-12-07T21:10:59.980 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2023-12-07T21:10:59.990 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2023-12-07T21:10:59.990 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2023-12-07T21:11:00.003 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2023-12-07T21:11:00.003 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2023-12-07T21:11:00.018 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2023-12-07T21:11:00.018 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2023-12-07T21:11:00.033 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2023-12-07T21:11:00.033 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/qa/tasks/radosgw_admin_rest.py", line 230, in task assert out['truncated'] == False AssertionError 2023-12-07T21:11:00.097 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7ba7907f34b141e1a57dbf83dcdd083f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_e93c2b5ccbd1e20f5140133f3f3dbf22579f27f0/qa/tasks/radosgw_admin_rest.py", line 230, in task assert out['truncated'] == False AssertionError 2023-12-07T21:11:00.098 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2023-12-07T21:11:00.110 DEBUG:tasks.rgw.client.0:waiting for process to exit 2023-12-07T21:11:00.110 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T21:11:00.114 INFO:tasks.rgw.client.0.smithi121.stdout:2023-12-07T21:11:00.119+0000 7f5e9bda9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 89681) UID: 0 2023-12-07T21:11:00.114 INFO:tasks.rgw.client.0.smithi121.stdout:2023-12-07T21:11:00.119+0000 7f5e9f608880 -1 shutting down 2023-12-07T21:11:04.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2023-12-07T21:11:06.212 INFO:tasks.rgw.client.0:Stopped 2023-12-07T21:11:06.212 DEBUG:teuthology.orchestra.run.smithi121:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2023-12-07T21:11:06.230 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/vault-root-token 2023-12-07T21:11:06.301 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2023-12-07T21:11:06.301 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2023-12-07T21:11:06.301 DEBUG:teuthology.orchestra.run.smithi121:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2023-12-07T21:11:06.387 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setuser ceph since I am not root 2023-12-07T21:11:06.387 INFO:teuthology.orchestra.run.smithi121.stderr:ignoring --setgroup ceph since I am not root 2023-12-07T21:11:06.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.396+0000 7f292d922800 1 Processor -- start 2023-12-07T21:11:06.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.397+0000 7f292d922800 1 -- start start 2023-12-07T21:11:06.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.397+0000 7f292d922800 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55588ff45b50 0x55588ffd3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.397+0000 7f292d922800 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55588ff1d7a0 con 0x55588ffd4340 2023-12-07T21:11:06.389 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.397+0000 7f292d922800 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x55588fee6880 con 0x55588ff45b50 2023-12-07T21:11:06.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.397+0000 7f29295a6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55588ff45b50 0x55588ffd3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.397+0000 7f29295a6640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x55588ff45b50 0x55588ffd3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:46434/0 (socket says 172.21.15.121:46434) 2023-12-07T21:11:06.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.397+0000 7f29295a6640 1 -- 172.21.15.121:0/1355246899 learned_addr learned my addr 172.21.15.121:0/1355246899 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:11:06.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.397+0000 7f2928da5640 1 --1- 172.21.15.121:0/1355246899 >> v1:172.21.15.89:6789/0 conn(0x55588ffd4340 0x55588ffd6790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.121:47032/0 (socket says 172.21.15.121:47032) 2023-12-07T21:11:06.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.397+0000 7f29295a6640 1 -- 172.21.15.121:0/1355246899 >> v1:172.21.15.89:6789/0 conn(0x55588ffd4340 legacy=0x55588ffd6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.390 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.397+0000 7f29295a6640 1 -- 172.21.15.121:0/1355246899 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55588ffd9050 con 0x55588ff45b50 2023-12-07T21:11:06.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.399+0000 7f29295a6640 1 --2- 172.21.15.121:0/1355246899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55588ffd3e00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f291c005fd0 tx=0x7f291c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e0dcb439f3a4f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.399+0000 7f291bfff640 1 -- 172.21.15.121:0/1355246899 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291c052540 con 0x55588ff45b50 2023-12-07T21:11:06.391 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.399+0000 7f291bfff640 1 -- 172.21.15.121:0/1355246899 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c0526a0 con 0x55588ff45b50 2023-12-07T21:11:06.392 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.400+0000 7f291bfff640 1 -- 172.21.15.121:0/1355246899 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291c0529c0 con 0x55588ff45b50 2023-12-07T21:11:06.393 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.400+0000 7f292d922800 1 -- 172.21.15.121:0/1355246899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 msgr2=0x55588ffd3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.400+0000 7f292d922800 1 --2- 172.21.15.121:0/1355246899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55588ffd3e00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f291c005fd0 tx=0x7f291c01cc50 comp rx=0 tx=0).stop 2023-12-07T21:11:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.400+0000 7f292d922800 1 -- 172.21.15.121:0/1355246899 shutdown_connections 2023-12-07T21:11:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.400+0000 7f292d922800 1 --2- 172.21.15.121:0/1355246899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55588ffd3e00 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.400+0000 7f292d922800 1 -- 172.21.15.121:0/1355246899 >> 172.21.15.121:0/1355246899 conn(0x55588ffcb880 msgr2=0x55588ffcdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.400+0000 7f292d922800 1 -- 172.21.15.121:0/1355246899 shutdown_connections 2023-12-07T21:11:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.400+0000 7f292d922800 1 -- 172.21.15.121:0/1355246899 wait complete. 2023-12-07T21:11:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.401+0000 7f292d922800 1 Processor -- start 2023-12-07T21:11:06.394 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.401+0000 7f292d922800 1 -- start start 2023-12-07T21:11:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.401+0000 7f292d922800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55588ffd1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.401+0000 7f292d922800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55588fee3db0 con 0x55588ff45b50 2023-12-07T21:11:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.401+0000 7f29295a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55588ffd1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.401+0000 7f29295a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55588ffd1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:46450/0 (socket says 172.21.15.121:46450) 2023-12-07T21:11:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.401+0000 7f29295a6640 1 -- 172.21.15.121:0/4202753803 learned_addr learned my addr 172.21.15.121:0/4202753803 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:11:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.402+0000 7f29295a6640 1 -- 172.21.15.121:0/4202753803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c00a1c0 con 0x55588ff45b50 2023-12-07T21:11:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.402+0000 7f29295a6640 1 --2- 172.21.15.121:0/4202753803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55588ffd1520 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f291c007000 tx=0x7f291c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2da602cb25e573 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.395 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.402+0000 7f291b7fe640 1 -- 172.21.15.121:0/4202753803 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291c061070 con 0x55588ff45b50 2023-12-07T21:11:06.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.402+0000 7f291b7fe640 1 -- 172.21.15.121:0/4202753803 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c052940 con 0x55588ff45b50 2023-12-07T21:11:06.396 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.402+0000 7f291b7fe640 1 -- 172.21.15.121:0/4202753803 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291c052c00 con 0x55588ff45b50 2023-12-07T21:11:06.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.402+0000 7f292d922800 1 -- 172.21.15.121:0/4202753803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 msgr2=0x55588ffd1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.402+0000 7f292d922800 1 --2- 172.21.15.121:0/4202753803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55588ffd1520 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f291c007000 tx=0x7f291c04c000 comp rx=0 tx=0).stop 2023-12-07T21:11:06.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f292d922800 1 -- 172.21.15.121:0/4202753803 shutdown_connections 2023-12-07T21:11:06.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f292d922800 1 --2- 172.21.15.121:0/4202753803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55588ffd1520 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f292d922800 1 -- 172.21.15.121:0/4202753803 >> 172.21.15.121:0/4202753803 conn(0x55588ffcb880 msgr2=0x555890071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:06.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f292d922800 1 -- 172.21.15.121:0/4202753803 shutdown_connections 2023-12-07T21:11:06.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f292d922800 1 -- 172.21.15.121:0/4202753803 wait complete. 2023-12-07T21:11:06.405 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f292d922800 1 Processor -- start 2023-12-07T21:11:06.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f292d922800 1 -- start start 2023-12-07T21:11:06.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f292d922800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55589007f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f292d922800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55588fedf6a0 con 0x55588ff45b50 2023-12-07T21:11:06.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f29295a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55589007f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f29295a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55589007f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:46452/0 (socket says 172.21.15.121:46452) 2023-12-07T21:11:06.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.403+0000 7f29295a6640 1 -- 172.21.15.121:0/3046049674 learned_addr learned my addr 172.21.15.121:0/3046049674 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:11:06.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.404+0000 7f29295a6640 1 -- 172.21.15.121:0/3046049674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55588ffd9050 con 0x55588ff45b50 2023-12-07T21:11:06.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.404+0000 7f29295a6640 1 --2- 172.21.15.121:0/3046049674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55589007f340 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f291c005c10 tx=0x7f291c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.406 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.404+0000 7f291a7fc640 1 -- 172.21.15.121:0/3046049674 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291c061040 con 0x55588ff45b50 2023-12-07T21:11:06.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.404+0000 7f291a7fc640 1 -- 172.21.15.121:0/3046049674 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c05d760 con 0x55588ff45b50 2023-12-07T21:11:06.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.404+0000 7f292d922800 1 -- 172.21.15.121:0/3046049674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55589007f880 con 0x55588ff45b50 2023-12-07T21:11:06.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.404+0000 7f291a7fc640 1 -- 172.21.15.121:0/3046049674 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f291c05da40 con 0x55588ff45b50 2023-12-07T21:11:06.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.404+0000 7f292d922800 1 -- 172.21.15.121:0/3046049674 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55589007fd60 con 0x55588ff45b50 2023-12-07T21:11:06.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f292d922800 1 Processor -- start 2023-12-07T21:11:06.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f292d922800 1 -- start start 2023-12-07T21:11:06.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f292d922800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 0x55589008b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f291a7fc640 1 -- 172.21.15.121:0/3046049674 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f291c0683f0 con 0x55588ff45b50 2023-12-07T21:11:06.407 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f292d922800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55588fe79890 con 0x55589008b470 2023-12-07T21:11:06.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f291a7fc640 1 --2- 172.21.15.121:0/3046049674 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f290c036110 0x7f290c0385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f291a7fc640 1 -- 172.21.15.121:0/3046049674 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f291c08d430 con 0x55588ff45b50 2023-12-07T21:11:06.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f2929da7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 0x55589008b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f29295a6640 1 --2- 172.21.15.121:0/3046049674 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f290c036110 0x7f290c0385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f2929da7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 0x55589008b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:46458/0 (socket says 172.21.15.121:46458) 2023-12-07T21:11:06.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f2929da7640 1 -- 172.21.15.121:0/3841403096 learned_addr learned my addr 172.21.15.121:0/3841403096 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:11:06.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f2929da7640 1 -- 172.21.15.121:0/3841403096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55589008bdd0 con 0x55589008b470 2023-12-07T21:11:06.408 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.405+0000 7f29295a6640 1 --2- 172.21.15.121:0/3046049674 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f290c036110 0x7f290c0385d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f291c08aa70 tx=0x7f291c0679b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.406+0000 7f2929da7640 1 --2- 172.21.15.121:0/3841403096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 0x55589008b890 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f292400a400 tx=0x7f292400a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751c5aa75c9abf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.406+0000 7f290bfff640 1 -- 172.21.15.121:0/3841403096 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29240087e0 con 0x55589008b470 2023-12-07T21:11:06.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.406+0000 7f290bfff640 1 -- 172.21.15.121:0/3841403096 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2924008960 con 0x55589008b470 2023-12-07T21:11:06.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.406+0000 7f290bfff640 1 -- 172.21.15.121:0/3841403096 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2924008c80 con 0x55589008b470 2023-12-07T21:11:06.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.406+0000 7f292d922800 1 -- 172.21.15.121:0/3841403096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 msgr2=0x55589008b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.406+0000 7f292d922800 1 --2- 172.21.15.121:0/3841403096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 0x55589008b890 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f292400a400 tx=0x7f292400a8c0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.406+0000 7f292d922800 1 -- 172.21.15.121:0/3841403096 shutdown_connections 2023-12-07T21:11:06.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.406+0000 7f292d922800 1 --2- 172.21.15.121:0/3841403096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 0x55589008b890 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.409 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.406+0000 7f292d922800 1 -- 172.21.15.121:0/3841403096 >> 172.21.15.121:0/3841403096 conn(0x55588ffd4340 msgr2=0x555890086850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:06.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.406+0000 7f292d922800 1 -- 172.21.15.121:0/3841403096 shutdown_connections 2023-12-07T21:11:06.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.406+0000 7f292d922800 1 -- 172.21.15.121:0/3841403096 wait complete. 2023-12-07T21:11:06.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.407+0000 7f292d922800 1 Processor -- start 2023-12-07T21:11:06.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.407+0000 7f292d922800 1 -- start start 2023-12-07T21:11:06.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.407+0000 7f292d922800 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 0x555890092470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.407+0000 7f292d922800 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55588fe79530 con 0x55589008b470 2023-12-07T21:11:06.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.407+0000 7f2929da7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 0x555890092470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.407+0000 7f2929da7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 0x555890092470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.121:46464/0 (socket says 172.21.15.121:46464) 2023-12-07T21:11:06.410 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.407+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 learned_addr learned my addr 172.21.15.121:0/2028068525 (peer_addr_for_me v2:172.21.15.121:0/0) 2023-12-07T21:11:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.408+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2924005c90 con 0x55589008b470 2023-12-07T21:11:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.408+0000 7f2929da7640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 0x555890092470 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f292400c010 tx=0x7f2924002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.408+0000 7f290a7fc640 1 -- 172.21.15.121:0/2028068525 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2924013840 con 0x55589008b470 2023-12-07T21:11:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.408+0000 7f290a7fc640 1 -- 172.21.15.121:0/2028068525 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29240139a0 con 0x55589008b470 2023-12-07T21:11:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.408+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5558900929b0 con 0x55589008b470 2023-12-07T21:11:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.408+0000 7f290a7fc640 1 -- 172.21.15.121:0/2028068525 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2924013c80 con 0x55589008b470 2023-12-07T21:11:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.408+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555890092e70 con 0x55589008b470 2023-12-07T21:11:06.411 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.409+0000 7f290a7fc640 1 -- 172.21.15.121:0/2028068525 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f292401e420 con 0x55589008b470 2023-12-07T21:11:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.409+0000 7f290a7fc640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29040360c0 0x7f2904038580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.409+0000 7f290a7fc640 1 -- 172.21.15.121:0/2028068525 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f292404ba20 con 0x55589008b470 2023-12-07T21:11:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.409+0000 7f2928da5640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29040360c0 0x7f2904038580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.410+0000 7f292d922800 20 rados->read ofs=0 len=0 2023-12-07T21:11:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.410+0000 7f292d922800 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55589009dbf0 0x5558900a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.410+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a0800 con 0x55589009dbf0 2023-12-07T21:11:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.410+0000 7f2928da5640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29040360c0 0x7f2904038580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x555890087490 tx=0x7f2920001320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.410+0000 7f2929da7640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55589009dbf0 0x5558900a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.410+0000 7f2929da7640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55589009dbf0 0x5558900a00b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.412 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.410+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.410+0000 7f292d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:11:06.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.410+0000 7f292d922800 20 realm 2023-12-07T21:11:06.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.410+0000 7f292d922800 20 rados->read ofs=0 len=0 2023-12-07T21:11:06.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.410+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a0c10 con 0x55589009dbf0 2023-12-07T21:11:06.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:11:06.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-07T21:11:06.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 20 rados->read ofs=0 len=0 2023-12-07T21:11:06.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a1490 con 0x55589009dbf0 2023-12-07T21:11:06.413 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:11:06.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 20 rados->read ofs=0 len=0 2023-12-07T21:11:06.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a17f0 con 0x55589009dbf0 2023-12-07T21:11:06.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:11:06.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 20 rados->read ofs=0 len=0 2023-12-07T21:11:06.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:5 5.19 5:9d689e6b:::zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a1ff0 con 0x55589009dbf0 2023-12-07T21:11:06.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 5 ==== osd_op_reply(5 zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 [read 0~874 out=874b] v0'0 uv6 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.414 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 20 rados_obj.operate() r=0 bl.length=874 2023-12-07T21:11:06.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.411+0000 7f292d922800 20 searching for the correct realm 2023-12-07T21:11:06.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.412+0000 7f292d922800 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5558900a3d10 0x5558900a6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.412+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a6850 con 0x5558900a3d10 2023-12-07T21:11:06.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.412+0000 7f29295a6640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5558900a3d10 0x5558900a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.412+0000 7f29295a6640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5558900a3d10 0x5558900a6180 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.412+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.412+0000 7f29295a6640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f291c087040 0x7f291c05ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.412+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a6850 con 0x7f291c087040 2023-12-07T21:11:06.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.412+0000 7f2928da5640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f291c087040 0x7f291c05ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.415 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.413+0000 7f2928da5640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f291c087040 0x7f291c05ca60 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.413+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.413+0000 7f2928da5640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f292000f070 0x7f292000e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.413+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a6850 con 0x7f292000f070 2023-12-07T21:11:06.416 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.413+0000 7f2929da7640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f292000f070 0x7f292000e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.414+0000 7f2929da7640 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f292000f070 0x7f292000e8c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.414+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.414+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a6850 con 0x55589009dbf0 2023-12-07T21:11:06.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.414+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 6 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.427 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.414+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a6850 con 0x55589009dbf0 2023-12-07T21:11:06.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.414+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 7 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.414+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a6850 con 0x7f292000f070 2023-12-07T21:11:06.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.415+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.415+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f292000f070 2023-12-07T21:11:06.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.415+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.415+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f291c087040 2023-12-07T21:11:06.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.415+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.428 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.415+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x5558900a3d10 2023-12-07T21:11:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.415+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.415+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x55589009dbf0 2023-12-07T21:11:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.416+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.416+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f292000f070 2023-12-07T21:11:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.416+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 4 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.416+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x55589009dbf0 2023-12-07T21:11:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.416+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.416+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f291c087040 2023-12-07T21:11:06.429 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.417+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=79b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.417+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x5558900a3d10 2023-12-07T21:11:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.417+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.417+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x5558900a3d10 2023-12-07T21:11:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.417+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.417+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f292000f070 2023-12-07T21:11:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.418+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.418+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x5558900a3d10 2023-12-07T21:11:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.418+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.430 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.418+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x5558900a3d10 2023-12-07T21:11:06.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.418+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.418+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x55589009dbf0 2023-12-07T21:11:06.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.418+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.418+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x55589009dbf0 2023-12-07T21:11:06.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.418+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=132b] v33'6 uv6 ondisk = 1) v8 ==== 144+0+132 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.418+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f292000f070 2023-12-07T21:11:06.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.419+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 6 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.419+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x5558900a3d10 2023-12-07T21:11:06.431 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.419+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=112b] v24'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.419+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f291c087040 2023-12-07T21:11:06.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.419+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 4 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.419+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x55589009dbf0 2023-12-07T21:11:06.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.420+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.420+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f292000f070 2023-12-07T21:11:06.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.420+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 7 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.420+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x5558900a3d10 2023-12-07T21:11:06.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.420+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.432 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.420+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f292000f070 2023-12-07T21:11:06.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.421+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 8 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.421+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f291c087040 2023-12-07T21:11:06.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.421+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 5 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.421+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x5558900a3d10 2023-12-07T21:11:06.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.421+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.421+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f292000f070 2023-12-07T21:11:06.433 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 9 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x55589009dbf0 2023-12-07T21:11:06.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) v8 -- 0x7f292403e040 con 0x7f291c087040 2023-12-07T21:11:06.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 6 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f292d922800 20 RGWRados::pool_iterate: got default.zonegroup. 2023-12-07T21:11:06.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f292d922800 20 RGWRados::pool_iterate: got zone_info.ef4a9585-c98e-4264-8c5b-7c4065599143 2023-12-07T21:11:06.434 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f292d922800 20 RGWRados::pool_iterate: got default.zone. 2023-12-07T21:11:06.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f292d922800 20 RGWRados::pool_iterate: got zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 2023-12-07T21:11:06.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f292d922800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-07T21:11:06.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f292d922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-07T21:11:06.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f292d922800 20 rados->read ofs=0 len=0 2023-12-07T21:11:06.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a2950 con 0x55589009dbf0 2023-12-07T21:11:06.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f292d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:11:06.435 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f292d922800 20 rados->read ofs=0 len=0 2023-12-07T21:11:06.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.422+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a31a0 con 0x55589009dbf0 2023-12-07T21:11:06.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 20 rados_obj.operate() r=0 bl.length=46 2023-12-07T21:11:06.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 20 rados->read ofs=0 len=0 2023-12-07T21:11:06.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:40 5.15 5:ac0decfe:::zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a31a0 con 0x5558900a3d10 2023-12-07T21:11:06.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 10 ==== osd_op_reply(40 zonegroup_info.209e4ade-356c-43a0-a93d-cc9500dad162 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 20 rados_obj.operate() r=0 bl.length=398 2023-12-07T21:11:06.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 20 zone default found 2023-12-07T21:11:06.436 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 4 Realm: () 2023-12-07T21:11:06.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 4 ZoneGroup: default (209e4ade-356c-43a0-a93d-cc9500dad162) 2023-12-07T21:11:06.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 4 Zone: default (ef4a9585-c98e-4264-8c5b-7c4065599143) 2023-12-07T21:11:06.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-07T21:11:06.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 20 zonegroup default 2023-12-07T21:11:06.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 20 rados->read ofs=0 len=0 2023-12-07T21:11:06.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a6cf0 con 0x7f292000f070 2023-12-07T21:11:06.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.437 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:11:06.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 20 rados->read ofs=0 len=0 2023-12-07T21:11:06.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.423+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a8ad0 con 0x5558900a3d10 2023-12-07T21:11:06.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.424+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.424+0000 7f292d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:11:06.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.424+0000 7f292d922800 20 rados->read ofs=0 len=0 2023-12-07T21:11:06.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.424+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a8e60 con 0x5558900a3d10 2023-12-07T21:11:06.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.424+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.424+0000 7f292d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-07T21:11:06.438 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.424+0000 7f292d922800 20 started sync module instance, tier type = 2023-12-07T21:11:06.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.424+0000 7f292d922800 20 started zone id=ef4a9585-c98e-4264-8c5b-7c4065599143 (name=default) with tier type = 2023-12-07T21:11:06.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.424+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a83b0 con 0x7f291c087040 2023-12-07T21:11:06.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.425+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 7 ==== osd_op_reply(44 notify.0 [create] v33'244 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.425+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93838859669328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a8760 con 0x7f291c087040 2023-12-07T21:11:06.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.425+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a9700 con 0x55589009dbf0 2023-12-07T21:11:06.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.426+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93838859669328] v33'245 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.426+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 16 ==== osd_op_reply(46 notify.1 [create] v33'244 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.439 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.427+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93838862090000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900a9700 con 0x55589009dbf0 2023-12-07T21:11:06.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.427+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900aa1a0 con 0x5558900a3d10 2023-12-07T21:11:06.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.428+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 13 ==== osd_op_reply(48 notify.2 [create] v33'244 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.428+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93838862097536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900aa9f0 con 0x5558900a3d10 2023-12-07T21:11:06.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.428+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900ab3f0 con 0x7f291c087040 2023-12-07T21:11:06.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.428+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93838862090000] v33'245 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.429+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 9 ==== osd_op_reply(50 notify.3 [create] v33'244 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.429+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93838862094944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900abc40 con 0x7f291c087040 2023-12-07T21:11:06.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.429+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93838862097536] v33'245 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.440 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.429+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900ac440 con 0x55589009dbf0 2023-12-07T21:11:06.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.430+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93838862094944] v33'245 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.430+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 18 ==== osd_op_reply(52 notify.4 [create] v33'244 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.430+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93838862099792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900ac440 con 0x55589009dbf0 2023-12-07T21:11:06.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.430+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900acc90 con 0x7f292000f070 2023-12-07T21:11:06.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.431+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93838862099792] v33'245 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.432+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 11 ==== osd_op_reply(54 notify.5 [create] v33'244 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.432+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93838862106800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900ac9a0 con 0x7f292000f070 2023-12-07T21:11:06.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.432+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900ad460 con 0x7f292000f070 2023-12-07T21:11:06.441 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.433+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93838862106800] v33'245 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.433+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 13 ==== osd_op_reply(56 notify.6 [create] v33'244 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.433+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93838862110496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900ad420 con 0x7f292000f070 2023-12-07T21:11:06.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.433+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900add90 con 0x7f292000f070 2023-12-07T21:11:06.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.434+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 14 ==== osd_op_reply(58 notify.7 [create] v33'244 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.434+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93838862113008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900ae1a0 con 0x7f292000f070 2023-12-07T21:11:06.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.434+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93838862110496] v33'245 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.434+0000 7f292d922800 20 add_watcher() i=0 2023-12-07T21:11:06.442 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.434+0000 7f292d922800 20 add_watcher() i=1 2023-12-07T21:11:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.434+0000 7f292d922800 20 add_watcher() i=2 2023-12-07T21:11:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.434+0000 7f292d922800 20 add_watcher() i=3 2023-12-07T21:11:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.434+0000 7f292d922800 20 add_watcher() i=4 2023-12-07T21:11:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.434+0000 7f292d922800 20 add_watcher() i=5 2023-12-07T21:11:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.434+0000 7f292d922800 20 add_watcher() i=6 2023-12-07T21:11:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.435+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93838862113008] v33'245 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.435+0000 7f292d922800 20 add_watcher() i=7 2023-12-07T21:11:06.443 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.435+0000 7f292d922800 2 all 8 watchers are set, enabling cache 2023-12-07T21:11:06.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.435+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900ae1a0 con 0x55589009dbf0 2023-12-07T21:11:06.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.435+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.444 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.435+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93838862114048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900ae140 con 0x55589009dbf0 2023-12-07T21:11:06.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.436+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93838862114048] v33'242 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.451 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.437+0000 7f28eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:11:06.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.437+0000 7f292d922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-12-07T21:11:06.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.437+0000 7f292d922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2023-12-07T21:11:06.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.437+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900b9710 con 0x55589009dbf0 2023-12-07T21:11:06.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.438+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.438+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900b9b50 con 0x7f292000f070 2023-12-07T21:11:06.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.439+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.439+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900ba080 con 0x5558900a3d10 2023-12-07T21:11:06.452 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.440+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'31 uv22 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.440+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900baa50 con 0x55589009dbf0 2023-12-07T21:11:06.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.441+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'243 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.441+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900b7760 con 0x7f291c087040 2023-12-07T21:11:06.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.442+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'78 uv51 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.442+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bb5c0 con 0x5558900a3d10 2023-12-07T21:11:06.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.443+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.443+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bbaf0 con 0x55589009dbf0 2023-12-07T21:11:06.453 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.445+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.445+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bbaf0 con 0x7f292000f070 2023-12-07T21:11:06.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.446+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.446+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bbaf0 con 0x7f291c087040 2023-12-07T21:11:06.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.447+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.447+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bc4c0 con 0x5558900a3d10 2023-12-07T21:11:06.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.448+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.448+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900b6750 con 0x7f291c087040 2023-12-07T21:11:06.454 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.449+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'79 uv53 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.449+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900b6d40 con 0x7f292000f070 2023-12-07T21:11:06.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.450+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'35 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.450+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900b6d40 con 0x7f291c087040 2023-12-07T21:11:06.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.451+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.451+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bce60 con 0x7f292000f070 2023-12-07T21:11:06.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.453+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'59 uv44 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.453+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bce60 con 0x55589009dbf0 2023-12-07T21:11:06.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.454+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'244 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.455 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.454+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bce60 con 0x5558900a3d10 2023-12-07T21:11:06.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.455+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'71 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.455+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bce60 con 0x7f291c087040 2023-12-07T21:11:06.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.456+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'80 uv55 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.456+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x5558900a3d10 2023-12-07T21:11:06.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.457+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.457+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x55589009dbf0 2023-12-07T21:11:06.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.458+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.456 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.458+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x55589009dbf0 2023-12-07T21:11:06.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.459+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'245 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.457 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.460+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x5558900a3d10 2023-12-07T21:11:06.458 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.461+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'72 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.461+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x7f291c087040 2023-12-07T21:11:06.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.462+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'40 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.462+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x5558900a3d10 2023-12-07T21:11:06.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.463+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.463+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x5558900a3d10 2023-12-07T21:11:06.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.464+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.464+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x5558900a3d10 2023-12-07T21:11:06.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.465+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'25 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.465+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x5558900a3d10 2023-12-07T21:11:06.459 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.466+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.466+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x7f292000f070 2023-12-07T21:11:06.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.467+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'32 uv24 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.460 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.467+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x5558900a3d10 2023-12-07T21:11:06.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.467+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.468+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x7f292000f070 2023-12-07T21:11:06.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.469+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.461 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.469+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x5558900a3d10 2023-12-07T21:11:06.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.470+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'73 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.462 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.470+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x7f292000f070 2023-12-07T21:11:06.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.471+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'60 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.463 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.471+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900bd300 con 0x7f291c087040 2023-12-07T21:11:06.464 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.473+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.473+0000 7f28edfe3640 20 reqs_thread_entry: start 2023-12-07T21:11:06.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.473+0000 7f292d922800 20 init_complete bucket index max shards: 11 2023-12-07T21:11:06.465 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.473+0000 7f292d922800 20 Filter name: none 2023-12-07T21:11:06.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.473+0000 7f285f7fe640 20 reqs_thread_entry: start 2023-12-07T21:11:06.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.473+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-07T21:11:06.466 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.473+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:94 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9220 con 0x7f291c087040 2023-12-07T21:11:06.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.474+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 18 ==== osd_op_reply(94 gc.12 [call] v33'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.475+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:95 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e91e0 con 0x7f291c087040 2023-12-07T21:11:06.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.475+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 19 ==== osd_op_reply(95 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.475+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.475+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:96 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f291c087040 2023-12-07T21:11:06.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.475+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 20 ==== osd_op_reply(96 gc.12 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.475+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:97 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.468 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.475+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 21 ==== osd_op_reply(97 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.475+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.475+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:98 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.476+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 22 ==== osd_op_reply(98 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.476+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.476+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:99 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.469 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.477+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 23 ==== osd_op_reply(99 gc.12 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.477+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-07T21:11:06.470 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.477+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:100 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.478+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 24 ==== osd_op_reply(100 gc.13 [call] v33'61 uv61 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.478+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:101 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.479+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 25 ==== osd_op_reply(101 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.479+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.479+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:102 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f292000f070 2023-12-07T21:11:06.471 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.479+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 26 ==== osd_op_reply(102 gc.13 [call out=24b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.479+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:103 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.479+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 27 ==== osd_op_reply(103 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.479+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.479+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:104 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.480+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 28 ==== osd_op_reply(104 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.472 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.480+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.480+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:105 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.481+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 29 ==== osd_op_reply(105 gc.13 [call] v33'62 uv62 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.473 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.481+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-07T21:11:06.474 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.481+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:106 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.482+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 28 ==== osd_op_reply(106 gc.14 [call] v33'246 uv246 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.482+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:107 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.482+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 29 ==== osd_op_reply(107 gc.14 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.475 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.482+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.483+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:108 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x55589009dbf0 2023-12-07T21:11:06.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.483+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 30 ==== osd_op_reply(108 gc.14 [call out=24b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.483+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:109 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.483+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 31 ==== osd_op_reply(109 gc.14 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.483+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.483+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:110 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.483+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 32 ==== osd_op_reply(110 gc.14 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.483+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.476 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.483+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:111 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.485+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 33 ==== osd_op_reply(111 gc.14 [call] v33'247 uv247 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.485+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-07T21:11:06.477 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.485+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:112 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.486+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 27 ==== osd_op_reply(112 gc.15 [call] v33'74 uv74 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.486+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:113 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.487+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 28 ==== osd_op_reply(113 gc.15 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.487+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.487+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:114 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.487+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 29 ==== osd_op_reply(114 gc.15 [call out=24b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.487+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:115 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.479 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.487+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 30 ==== osd_op_reply(115 gc.15 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.487+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.487+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:116 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.487+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 31 ==== osd_op_reply(116 gc.15 [call out=15b] v0'0 uv74 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.487+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.480 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.487+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:117 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.489+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 32 ==== osd_op_reply(117 gc.15 [call] v33'75 uv75 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.489+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-07T21:11:06.481 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.489+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:118 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.490+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 24 ==== osd_op_reply(118 gc.16 [call] v33'81 uv81 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.490+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:119 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.490+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 25 ==== osd_op_reply(119 gc.16 [call out=15b] v0'0 uv81 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.490+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.490+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:120 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f291c087040 2023-12-07T21:11:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.490+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 26 ==== osd_op_reply(120 gc.16 [call out=24b] v0'0 uv81 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.483 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.491+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:121 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.491+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 27 ==== osd_op_reply(121 gc.16 [call out=15b] v0'0 uv81 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.491+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.491+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:122 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.491+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 28 ==== osd_op_reply(122 gc.16 [call out=15b] v0'0 uv81 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.491+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.484 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.491+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:123 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.492+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 29 ==== osd_op_reply(123 gc.16 [call] v33'82 uv82 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.492+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-07T21:11:06.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.492+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:124 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.493+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 33 ==== osd_op_reply(124 gc.17 [call] v33'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.493+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:125 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.486 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.493+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 34 ==== osd_op_reply(125 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.493+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.493+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:126 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.493+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 35 ==== osd_op_reply(126 gc.17 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.493+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:127 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.494+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 36 ==== osd_op_reply(127 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.494+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.494+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:128 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.487 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.494+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 37 ==== osd_op_reply(128 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.494+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.488 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.494+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:129 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.495+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 38 ==== osd_op_reply(129 gc.17 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.489 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.495+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-07T21:11:06.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.495+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:130 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.496+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 34 ==== osd_op_reply(130 gc.18 [call] v33'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.496+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:131 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.496+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 35 ==== osd_op_reply(131 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.496+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.496+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:132 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x55589009dbf0 2023-12-07T21:11:06.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.497+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 36 ==== osd_op_reply(132 gc.18 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.497+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:133 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.490 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.497+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 37 ==== osd_op_reply(133 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.497+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.497+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:134 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.497+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 38 ==== osd_op_reply(134 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.497+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.491 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.497+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:135 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.498+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 39 ==== osd_op_reply(135 gc.18 [call] v33'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.498+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-07T21:11:06.493 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.498+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:136 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.499+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 40 ==== osd_op_reply(136 gc.19 [call] v33'248 uv248 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.499+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:137 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.499+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 41 ==== osd_op_reply(137 gc.19 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.499+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.499+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:138 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x55589009dbf0 2023-12-07T21:11:06.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.499+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 42 ==== osd_op_reply(138 gc.19 [call out=24b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.499+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:139 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.494 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.500+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 43 ==== osd_op_reply(139 gc.19 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.500+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.500+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:140 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.500+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 44 ==== osd_op_reply(140 gc.19 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.500+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.500+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:141 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.501+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 45 ==== osd_op_reply(141 gc.19 [call] v33'249 uv249 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.501+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-07T21:11:06.495 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.501+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:142 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.497 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.502+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 39 ==== osd_op_reply(142 gc.20 [call] v33'76 uv76 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.502+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:143 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.502+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 40 ==== osd_op_reply(143 gc.20 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.502+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.502+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:144 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.503+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 41 ==== osd_op_reply(144 gc.20 [call out=24b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.503+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:145 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.503+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 42 ==== osd_op_reply(145 gc.20 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.498 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.503+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.503+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:146 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.503+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 43 ==== osd_op_reply(146 gc.20 [call out=15b] v0'0 uv76 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.503+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.503+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:147 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.504+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 44 ==== osd_op_reply(147 gc.20 [call] v33'77 uv77 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.504+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-07T21:11:06.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.504+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:148 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.505+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 30 ==== osd_op_reply(148 gc.21 [call] v33'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.505+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:149 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.499 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.506+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 31 ==== osd_op_reply(149 gc.21 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.506+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.506+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:150 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f291c087040 2023-12-07T21:11:06.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.506+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 32 ==== osd_op_reply(150 gc.21 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.500 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.506+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:151 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.506+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 33 ==== osd_op_reply(151 gc.21 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.506+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.506+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:152 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.502 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.507+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 34 ==== osd_op_reply(152 gc.21 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.507+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.507+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:153 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.508+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 35 ==== osd_op_reply(153 gc.21 [call] v33'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.508+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-07T21:11:06.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.508+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:154 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.509+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 45 ==== osd_op_reply(154 gc.22 [call] v33'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.509+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:155 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.503 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.509+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 46 ==== osd_op_reply(155 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.509+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.509+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:156 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.509+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 47 ==== osd_op_reply(156 gc.22 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.509+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:157 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.509+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 48 ==== osd_op_reply(157 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.509+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.504 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.509+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:158 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.510+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 49 ==== osd_op_reply(158 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.510+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.510+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:159 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.510+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 50 ==== osd_op_reply(159 gc.22 [call] v33'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.510+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-07T21:11:06.505 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.510+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:160 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.511+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 51 ==== osd_op_reply(160 gc.23 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.511+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:161 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.512+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 52 ==== osd_op_reply(161 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.512+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.508 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.512+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:162 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.512+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 53 ==== osd_op_reply(162 gc.23 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.512+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.512+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 54 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.512+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.512+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.512+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 55 ==== osd_op_reply(164 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.512+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.512+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.513+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 56 ==== osd_op_reply(165 gc.23 [call] v33'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.509 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.513+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-07T21:11:06.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.513+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.514+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 57 ==== osd_op_reply(166 gc.24 [call] v33'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.514+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.514+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 58 ==== osd_op_reply(167 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.514+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.514+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.515+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 59 ==== osd_op_reply(168 gc.24 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.510 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.515+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:169 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.515+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 60 ==== osd_op_reply(169 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.515+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.515+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:170 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.515+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 61 ==== osd_op_reply(170 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.515+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.515+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:171 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.516+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 62 ==== osd_op_reply(171 gc.24 [call] v33'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.516+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-07T21:11:06.511 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.516+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:172 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.517+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 63 ==== osd_op_reply(172 gc.25 [call] v33'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.514 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.517+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:173 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.517+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 64 ==== osd_op_reply(173 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.517+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.517+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:174 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.517+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 65 ==== osd_op_reply(174 gc.25 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.517+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:175 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.518+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 66 ==== osd_op_reply(175 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.518+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.518+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:176 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.518+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 67 ==== osd_op_reply(176 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.515 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.518+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.518+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:177 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.519+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 68 ==== osd_op_reply(177 gc.25 [call] v33'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.519+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-07T21:11:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.519+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:178 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.520+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 30 ==== osd_op_reply(178 gc.26 [call] v33'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.520+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:179 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.520+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 31 ==== osd_op_reply(179 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.520+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.520+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:180 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f292000f070 2023-12-07T21:11:06.516 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.521+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 32 ==== osd_op_reply(180 gc.26 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.521+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:181 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.521+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 33 ==== osd_op_reply(181 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.521+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.521+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:182 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.521+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 34 ==== osd_op_reply(182 gc.26 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.521+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.521+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:183 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.522+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 35 ==== osd_op_reply(183 gc.26 [call] v33'34 uv34 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.517 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.522+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-07T21:11:06.518 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.522+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:184 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.523+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 69 ==== osd_op_reply(184 gc.27 [call] v33'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.520 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.523+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:185 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.523+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 70 ==== osd_op_reply(185 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.524+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.524+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:186 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.524+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 71 ==== osd_op_reply(186 gc.27 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.524+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:187 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.524+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 72 ==== osd_op_reply(187 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.524+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.524+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:188 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.521 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.524+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 73 ==== osd_op_reply(188 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.524+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.524+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:189 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.525+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 74 ==== osd_op_reply(189 gc.27 [call] v33'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.525+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-07T21:11:06.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.525+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:190 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.526+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 36 ==== osd_op_reply(190 gc.28 [call] v33'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.527+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:191 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.522 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.527+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 37 ==== osd_op_reply(191 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.527+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.527+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:192 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f292000f070 2023-12-07T21:11:06.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.527+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 38 ==== osd_op_reply(192 gc.28 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.527+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:193 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f292000f070 2023-12-07T21:11:06.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.527+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 39 ==== osd_op_reply(193 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.527+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.527+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:194 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f292000f070 2023-12-07T21:11:06.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.528+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 40 ==== osd_op_reply(194 gc.28 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.523 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.528+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.528+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:195 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.529+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 41 ==== osd_op_reply(195 gc.28 [call] v33'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.529+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-07T21:11:06.524 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.529+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:196 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.530+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 75 ==== osd_op_reply(196 gc.29 [call] v33'78 uv78 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.530+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:197 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.530+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 76 ==== osd_op_reply(197 gc.29 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.530+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.527 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.530+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:198 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.530+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 77 ==== osd_op_reply(198 gc.29 [call out=24b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.530+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:199 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.530+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 78 ==== osd_op_reply(199 gc.29 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.530+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.530+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:200 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.531+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 79 ==== osd_op_reply(200 gc.29 [call out=15b] v0'0 uv78 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.531+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.528 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.531+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:201 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.531+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 80 ==== osd_op_reply(201 gc.29 [call] v33'79 uv79 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.531+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-07T21:11:06.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.531+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:202 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.533+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 42 ==== osd_op_reply(202 gc.30 [call] v33'63 uv63 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.533+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:203 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.533+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 43 ==== osd_op_reply(203 gc.30 [call out=15b] v0'0 uv63 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.533+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.533+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:204 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f292000f070 2023-12-07T21:11:06.529 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.533+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 44 ==== osd_op_reply(204 gc.30 [call out=24b] v0'0 uv63 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.533+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:205 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.534+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 45 ==== osd_op_reply(205 gc.30 [call out=15b] v0'0 uv63 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.534+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.534+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:206 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.534+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 46 ==== osd_op_reply(206 gc.30 [call out=15b] v0'0 uv63 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.534+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.534+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:207 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.535+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 47 ==== osd_op_reply(207 gc.30 [call] v33'64 uv64 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.530 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.535+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-07T21:11:06.531 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.535+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:208 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.536+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 36 ==== osd_op_reply(208 gc.31 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.536+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:209 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.536+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 37 ==== osd_op_reply(209 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.536+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.533 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.536+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:210 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f291c087040 2023-12-07T21:11:06.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.536+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 38 ==== osd_op_reply(210 gc.31 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.536+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:211 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.536+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 39 ==== osd_op_reply(211 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.537+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.537+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:212 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.537+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 40 ==== osd_op_reply(212 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.537+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.534 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.537+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:213 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.538+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 41 ==== osd_op_reply(213 gc.31 [call] v33'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.538+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-07T21:11:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.538+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:214 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.539+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 46 ==== osd_op_reply(214 gc.0 [call] v33'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.539+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:215 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.539+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 47 ==== osd_op_reply(215 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.539+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.539+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:216 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x55589009dbf0 2023-12-07T21:11:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.539+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 48 ==== osd_op_reply(216 gc.0 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.535 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.539+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:217 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.539+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 49 ==== osd_op_reply(217 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.539+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.539+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:218 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.540+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 50 ==== osd_op_reply(218 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.540+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.540+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:219 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.541+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 51 ==== osd_op_reply(219 gc.0 [call] v33'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.541+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-07T21:11:06.536 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.541+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:220 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.542+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 48 ==== osd_op_reply(220 gc.1 [call] v33'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.539 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.542+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:221 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.543+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 49 ==== osd_op_reply(221 gc.1 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.543+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.543+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:222 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f292000f070 2023-12-07T21:11:06.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.543+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 50 ==== osd_op_reply(222 gc.1 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.543+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:223 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.543+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 51 ==== osd_op_reply(223 gc.1 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.543+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.543+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:224 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.540 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.544+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 52 ==== osd_op_reply(224 gc.1 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.544+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.544+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:225 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.545+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 53 ==== osd_op_reply(225 gc.1 [call] v33'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.545+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-07T21:11:06.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.545+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:226 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.546+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 81 ==== osd_op_reply(226 gc.2 [call] v33'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.546+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:227 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.546+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 82 ==== osd_op_reply(227 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.541 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.546+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.546+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:228 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.546+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 83 ==== osd_op_reply(228 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.546+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:229 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.546+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 84 ==== osd_op_reply(229 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.547+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.547+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:230 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.547+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 85 ==== osd_op_reply(230 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.542 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.547+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.547+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:231 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.548+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 86 ==== osd_op_reply(231 gc.2 [call] v33'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.548+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-07T21:11:06.543 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.548+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:232 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.549+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 52 ==== osd_op_reply(232 gc.3 [call] v33'250 uv250 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.549+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:233 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.549+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 53 ==== osd_op_reply(233 gc.3 [call out=15b] v0'0 uv250 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.549+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.549+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:234 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x55589009dbf0 2023-12-07T21:11:06.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.549+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 54 ==== osd_op_reply(234 gc.3 [call out=24b] v0'0 uv250 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.546 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.549+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:235 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.550+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 55 ==== osd_op_reply(235 gc.3 [call out=15b] v0'0 uv250 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.550+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.550+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:236 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.550+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 56 ==== osd_op_reply(236 gc.3 [call out=15b] v0'0 uv250 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.550+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.550+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:237 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.551+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 57 ==== osd_op_reply(237 gc.3 [call] v33'251 uv251 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.551+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-07T21:11:06.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.551+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:238 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.547 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.552+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 42 ==== osd_op_reply(238 gc.4 [call] v33'83 uv83 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.552+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:239 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.552+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 43 ==== osd_op_reply(239 gc.4 [call out=15b] v0'0 uv83 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.552+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.552+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:240 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f291c087040 2023-12-07T21:11:06.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.552+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 44 ==== osd_op_reply(240 gc.4 [call out=24b] v0'0 uv83 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.552+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:241 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.548 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.553+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 45 ==== osd_op_reply(241 gc.4 [call out=15b] v0'0 uv83 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.553+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.553+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:242 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.553+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 46 ==== osd_op_reply(242 gc.4 [call out=15b] v0'0 uv83 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.553+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.553+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:243 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.554+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 47 ==== osd_op_reply(243 gc.4 [call] v33'84 uv84 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.554+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-07T21:11:06.549 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.554+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:244 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.555+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 87 ==== osd_op_reply(244 gc.5 [call] v33'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.555+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:245 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.555+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 88 ==== osd_op_reply(245 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.555+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.552 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.555+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:246 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.555+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 89 ==== osd_op_reply(246 gc.5 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.555+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:247 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.555+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 90 ==== osd_op_reply(247 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.555+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.555+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:248 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.556+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 91 ==== osd_op_reply(248 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.556+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.556+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:249 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.553 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.557+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 92 ==== osd_op_reply(249 gc.5 [call] v33'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.557+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-07T21:11:06.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.557+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:250 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.558+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 58 ==== osd_op_reply(250 gc.6 [call] v33'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.558+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:251 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.558+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 59 ==== osd_op_reply(251 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.558+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.558+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:252 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x55589009dbf0 2023-12-07T21:11:06.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.559+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 60 ==== osd_op_reply(252 gc.6 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.559+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:253 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x55589009dbf0 2023-12-07T21:11:06.554 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.559+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 61 ==== osd_op_reply(253 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.559+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.559+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:254 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x55589009dbf0 2023-12-07T21:11:06.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.559+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 62 ==== osd_op_reply(254 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.559+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.559+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:255 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x55589009dbf0 2023-12-07T21:11:06.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.560+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 63 ==== osd_op_reply(255 gc.6 [call] v33'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.560+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-07T21:11:06.555 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.560+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:256 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.561+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 54 ==== osd_op_reply(256 gc.7 [call] v33'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.561+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:257 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.562+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 55 ==== osd_op_reply(257 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.558 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.562+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.562+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:258 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f292000f070 2023-12-07T21:11:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.562+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 56 ==== osd_op_reply(258 gc.7 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.562+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:259 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.562+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 57 ==== osd_op_reply(259 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.562+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.562+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:260 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.562+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 58 ==== osd_op_reply(260 gc.7 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.562+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.559 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.562+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:261 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.563+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 59 ==== osd_op_reply(261 gc.7 [call] v33'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.563+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-07T21:11:06.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.563+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:262 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.564+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 48 ==== osd_op_reply(262 gc.8 [call] v33'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.564+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:263 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.565+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 49 ==== osd_op_reply(263 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.565+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.565+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:264 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f291c087040 2023-12-07T21:11:06.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.565+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 50 ==== osd_op_reply(264 gc.8 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.560 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.565+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:265 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.565+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 51 ==== osd_op_reply(265 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.565+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.565+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:266 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.565+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 52 ==== osd_op_reply(266 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.565+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.565+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:267 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.566+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 53 ==== osd_op_reply(267 gc.8 [call] v33'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.566+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-07T21:11:06.561 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.566+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:268 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.567+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 93 ==== osd_op_reply(268 gc.9 [call] v33'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.567+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:269 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.568+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 94 ==== osd_op_reply(269 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.568+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.568+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:270 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x5558900a3d10 2023-12-07T21:11:06.564 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.568+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 95 ==== osd_op_reply(270 gc.9 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.568+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:271 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.568+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 96 ==== osd_op_reply(271 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.568+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.568+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:272 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.568+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 97 ==== osd_op_reply(272 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.568+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.568+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:273 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x5558900a3d10 2023-12-07T21:11:06.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.569+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 98 ==== osd_op_reply(273 gc.9 [call] v33'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.569+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-07T21:11:06.565 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.569+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:274 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.570+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 54 ==== osd_op_reply(274 gc.10 [call] v33'85 uv85 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.570+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:275 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.570+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 55 ==== osd_op_reply(275 gc.10 [call out=15b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.570+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.570+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:276 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f291c087040 2023-12-07T21:11:06.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.571+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 56 ==== osd_op_reply(276 gc.10 [call out=24b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.571+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:277 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.571+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 57 ==== osd_op_reply(277 gc.10 [call out=15b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.566 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.571+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.571+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:278 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.571+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 58 ==== osd_op_reply(278 gc.10 [call out=15b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.571+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.571+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:279 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f291c087040 2023-12-07T21:11:06.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.572+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 59 ==== osd_op_reply(279 gc.10 [call] v33'86 uv86 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.572+0000 7f292d922800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-07T21:11:06.567 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.572+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:280 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.573+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 60 ==== osd_op_reply(280 gc.11 [call] v33'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.573+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:281 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.574+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 61 ==== osd_op_reply(281 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.574+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.574+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:282 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e8160 con 0x7f292000f070 2023-12-07T21:11:06.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.574+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 62 ==== osd_op_reply(282 gc.11 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.569 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.574+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:283 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.574+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 63 ==== osd_op_reply(283 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.574+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-07T21:11:06.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.574+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:284 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.574+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 64 ==== osd_op_reply(284 gc.11 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.574+0000 7f292d922800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-07T21:11:06.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.574+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:285 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900e9170 con 0x7f292000f070 2023-12-07T21:11:06.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.575+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 65 ==== osd_op_reply(285 gc.11 [call] v33'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.576+0000 7f28eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-07T21:11:06.570 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.576+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:286 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93838862114048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589009b5c0 con 0x55589009dbf0 2023-12-07T21:11:06.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.577+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 64 ==== osd_op_reply(286 data_loggenerations_metadata [watch unwatch cookie 93838862114048] v33'252 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.571 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.577+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:287 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93838859669328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589009b5c0 con 0x7f291c087040 2023-12-07T21:11:06.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.578+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 60 ==== osd_op_reply(287 notify.0 [watch unwatch cookie 93838859669328] v33'246 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.578+0000 7f292d922800 20 remove_watcher() i=0 2023-12-07T21:11:06.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.578+0000 7f292d922800 2 removed watcher, disabling cache 2023-12-07T21:11:06.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.578+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:288 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93838862090000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589009b5c0 con 0x55589009dbf0 2023-12-07T21:11:06.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.579+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 65 ==== osd_op_reply(288 notify.1 [watch unwatch cookie 93838862090000] v33'246 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.579+0000 7f292d922800 20 remove_watcher() i=1 2023-12-07T21:11:06.572 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.579+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- osd_op(unknown.0.0:289 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93838862097536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589009b5c0 con 0x5558900a3d10 2023-12-07T21:11:06.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.580+0000 7f29295a6640 1 -- 172.21.15.121:0/2028068525 <== osd.3 v2:172.21.15.121:6800/4032235766 99 ==== osd_op_reply(289 notify.2 [watch unwatch cookie 93838862097536] v33'246 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f291c04f070 con 0x5558900a3d10 2023-12-07T21:11:06.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.580+0000 7f292d922800 20 remove_watcher() i=2 2023-12-07T21:11:06.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.580+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- osd_op(unknown.0.0:290 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93838862094944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589009b5c0 con 0x7f291c087040 2023-12-07T21:11:06.573 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.581+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 <== osd.2 v2:172.21.15.121:6816/2557538450 61 ==== osd_op_reply(290 notify.3 [watch unwatch cookie 93838862094944] v33'246 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f292000f610 con 0x7f291c087040 2023-12-07T21:11:06.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.581+0000 7f292d922800 20 remove_watcher() i=3 2023-12-07T21:11:06.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.581+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- osd_op(unknown.0.0:291 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93838862099792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x55589009b5c0 con 0x55589009dbf0 2023-12-07T21:11:06.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.583+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.1 v2:172.21.15.121:6808/2140819418 66 ==== osd_op_reply(291 notify.4 [watch unwatch cookie 93838862099792] v33'246 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x55589009dbf0 2023-12-07T21:11:06.574 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.583+0000 7f292d922800 20 remove_watcher() i=4 2023-12-07T21:11:06.575 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.583+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:292 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93838862106800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900aa550 con 0x7f292000f070 2023-12-07T21:11:06.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.584+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 66 ==== osd_op_reply(292 notify.5 [watch unwatch cookie 93838862106800] v33'246 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.584+0000 7f292d922800 20 remove_watcher() i=5 2023-12-07T21:11:06.576 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.584+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:293 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93838862110496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900aa550 con 0x7f292000f070 2023-12-07T21:11:06.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.585+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 67 ==== osd_op_reply(293 notify.6 [watch unwatch cookie 93838862110496] v33'246 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.585+0000 7f292d922800 20 remove_watcher() i=6 2023-12-07T21:11:06.577 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.585+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- osd_op(unknown.0.0:294 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93838862113008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) v8 -- 0x5558900aa550 con 0x7f292000f070 2023-12-07T21:11:06.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f2929da7640 1 -- 172.21.15.121:0/2028068525 <== osd.0 v2:172.21.15.89:6800/654939948 68 ==== osd_op_reply(294 notify.7 [watch unwatch cookie 93838862113008] v33'246 uv244 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2924024070 con 0x7f292000f070 2023-12-07T21:11:06.579 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 20 remove_watcher() i=7 2023-12-07T21:11:06.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f292000f070 msgr2=0x7f292000e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f292000f070 0x7f292000e8c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55589009dbf0 msgr2=0x5558900a00b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x55589009dbf0 0x5558900a00b0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f291c087040 msgr2=0x7f291c05ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f291c087040 0x7f291c05ca60 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5558900a3d10 msgr2=0x5558900a6180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x5558900a3d10 0x5558900a6180 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.580 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29040360c0 msgr2=0x7f2904038580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f29040360c0 0x7f2904038580 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x555890087490 tx=0x7f2920001320 comp rx=0 tx=0).stop 2023-12-07T21:11:06.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 msgr2=0x555890092470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f292d922800 1 --2- 172.21.15.121:0/2028068525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55589008b470 0x555890092470 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f292400c010 tx=0x7f2924002ff0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.586+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 reap_dead start 2023-12-07T21:11:06.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f2928da5640 1 -- 172.21.15.121:0/2028068525 reap_dead start 2023-12-07T21:11:06.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 shutdown_connections 2023-12-07T21:11:06.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 >> 172.21.15.121:0/2028068525 conn(0x55588ffd4340 msgr2=0x555890086420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:06.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 shutdown_connections 2023-12-07T21:11:06.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 -- 172.21.15.121:0/2028068525 wait complete. 2023-12-07T21:11:06.581 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 -- 172.21.15.121:0/3046049674 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f290c036110 msgr2=0x7f290c0385d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 --2- 172.21.15.121:0/3046049674 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f290c036110 0x7f290c0385d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f291c08aa70 tx=0x7f291c0679b0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 -- 172.21.15.121:0/3046049674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 msgr2=0x55589007f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 --2- 172.21.15.121:0/3046049674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55589007f340 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f291c005c10 tx=0x7f291c003330 comp rx=0 tx=0).stop 2023-12-07T21:11:06.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 -- 172.21.15.121:0/3046049674 shutdown_connections 2023-12-07T21:11:06.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 --2- 172.21.15.121:0/3046049674 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f290c036110 0x7f290c0385d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 --2- 172.21.15.121:0/3046049674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55588ff45b50 0x55589007f340 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 -- 172.21.15.121:0/3046049674 >> 172.21.15.121:0/3046049674 conn(0x55588ffcb880 msgr2=0x55588ffcfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:06.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 -- 172.21.15.121:0/3046049674 shutdown_connections 2023-12-07T21:11:06.582 INFO:teuthology.orchestra.run.smithi121.stderr:2023-12-07T21:11:06.587+0000 7f292d922800 1 -- 172.21.15.121:0/3046049674 wait complete. 2023-12-07T21:11:06.583 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-07T21:11:06.592 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-07T21:11:06.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:11:06.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.703+0000 7f2d83d90640 1 Processor -- start 2023-12-07T21:11:06.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.703+0000 7f2d83d90640 1 -- start start 2023-12-07T21:11:06.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.704+0000 7f2d83d90640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2d7c070610 0x7f2d7c0709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.704+0000 7f2d83d90640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c06e240 con 0x7f2d7c06cc90 2023-12-07T21:11:06.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.704+0000 7f2d83d90640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c070140 con 0x7f2d7c070610 2023-12-07T21:11:06.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.704+0000 7f2d81b2c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2d7c070610 0x7f2d7c0709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.704+0000 7f2d8132b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2d7c06cc90 0x7f2d7c06d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39480/0 (socket says 172.21.15.89:39480) 2023-12-07T21:11:06.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.704+0000 7f2d8132b640 1 -- 172.21.15.89:0/3254158305 learned_addr learned my addr 172.21.15.89:0/3254158305 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:06.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.704+0000 7f2d80b2a640 1 -- 172.21.15.89:0/3254158305 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399286245 0 0) 0x7f2d7c06e240 con 0x7f2d7c06cc90 2023-12-07T21:11:06.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.704+0000 7f2d80b2a640 1 -- 172.21.15.89:0/3254158305 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d68003440 con 0x7f2d7c06cc90 2023-12-07T21:11:06.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.704+0000 7f2d81b2c640 1 -- 172.21.15.89:0/3254158305 >> v1:172.21.15.89:6789/0 conn(0x7f2d7c06cc90 legacy=0x7f2d7c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.704+0000 7f2d81b2c640 1 -- 172.21.15.89:0/3254158305 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c06e9a0 con 0x7f2d7c070610 2023-12-07T21:11:06.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.705+0000 7f2d81b2c640 1 --2- 172.21.15.89:0/3254158305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7c070610 0x7f2d7c0709f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009d90 tx=0x7f2d7802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872404b57ed49321 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.705+0000 7f2d80b2a640 1 -- 172.21.15.89:0/3254158305 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d7802cb10 con 0x7f2d7c070610 2023-12-07T21:11:06.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.705+0000 7f2d80b2a640 1 -- 172.21.15.89:0/3254158305 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7802cc70 con 0x7f2d7c070610 2023-12-07T21:11:06.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.705+0000 7f2d80b2a640 1 -- 172.21.15.89:0/3254158305 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d78034440 con 0x7f2d7c070610 2023-12-07T21:11:06.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.705+0000 7f2d83d90640 1 -- 172.21.15.89:0/3254158305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7c070610 msgr2=0x7f2d7c0709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.705+0000 7f2d83d90640 1 --2- 172.21.15.89:0/3254158305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7c070610 0x7f2d7c0709f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009d90 tx=0x7f2d7802beb0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.705+0000 7f2d83d90640 1 -- 172.21.15.89:0/3254158305 shutdown_connections 2023-12-07T21:11:06.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.705+0000 7f2d83d90640 1 --2- 172.21.15.89:0/3254158305 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7c070610 0x7f2d7c0709f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.705+0000 7f2d83d90640 1 -- 172.21.15.89:0/3254158305 >> 172.21.15.89:0/3254158305 conn(0x7f2d7c0987f0 msgr2=0x7f2d7c098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:06.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.706+0000 7f2d83d90640 1 -- 172.21.15.89:0/3254158305 shutdown_connections 2023-12-07T21:11:06.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.706+0000 7f2d83d90640 1 -- 172.21.15.89:0/3254158305 wait complete. 2023-12-07T21:11:06.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.706+0000 7f2d83d90640 1 Processor -- start 2023-12-07T21:11:06.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.706+0000 7f2d83d90640 1 -- start start 2023-12-07T21:11:06.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d83d90640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7c06cc90 0x7f2d7c089260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d83d90640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c08bdc0 con 0x7f2d7c06cc90 2023-12-07T21:11:06.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d81b2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7c06cc90 0x7f2d7c089260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d81b2c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7c06cc90 0x7f2d7c089260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38212/0 (socket says 172.21.15.89:38212) 2023-12-07T21:11:06.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d81b2c640 1 -- 172.21.15.89:0/2649846552 learned_addr learned my addr 172.21.15.89:0/2649846552 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:06.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d81b2c640 1 -- 172.21.15.89:0/2649846552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d78009a70 con 0x7f2d7c06cc90 2023-12-07T21:11:06.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d81b2c640 1 --2- 172.21.15.89:0/2649846552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7c06cc90 0x7f2d7c089260 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2d78000f80 tx=0x7f2d78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d727fc640 1 -- 172.21.15.89:0/2649846552 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d78040580 con 0x7f2d7c06cc90 2023-12-07T21:11:06.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d727fc640 1 -- 172.21.15.89:0/2649846552 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d780406e0 con 0x7f2d7c06cc90 2023-12-07T21:11:06.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d727fc640 1 -- 172.21.15.89:0/2649846552 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d780409c0 con 0x7f2d7c06cc90 2023-12-07T21:11:06.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d83d90640 1 -- 172.21.15.89:0/2649846552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7c08b520 con 0x7f2d7c06cc90 2023-12-07T21:11:06.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.707+0000 7f2d83d90640 1 -- 172.21.15.89:0/2649846552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7c08c150 con 0x7f2d7c06cc90 2023-12-07T21:11:06.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.708+0000 7f2d727fc640 1 -- 172.21.15.89:0/2649846552 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f2d78040b20 con 0x7f2d7c06cc90 2023-12-07T21:11:06.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.708+0000 7f2d83d90640 1 -- 172.21.15.89:0/2649846552 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7c062110 con 0x7f2d7c06cc90 2023-12-07T21:11:06.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.708+0000 7f2d727fc640 1 --2- 172.21.15.89:0/2649846552 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2d60037820 0x7f2d60039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:06.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.708+0000 7f2d727fc640 1 -- 172.21.15.89:0/2649846552 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f2d7806dc70 con 0x7f2d7c06cc90 2023-12-07T21:11:06.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.708+0000 7f2d8132b640 1 --2- 172.21.15.89:0/2649846552 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2d60037820 0x7f2d60039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:06.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.709+0000 7f2d8132b640 1 --2- 172.21.15.89:0/2649846552 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2d60037820 0x7f2d60039ce0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c001610 tx=0x7f2d6c007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:06.705 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.713+0000 7f2d727fc640 1 -- 172.21.15.89:0/2649846552 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d78033bd0 con 0x7f2d7c06cc90 2023-12-07T21:11:06.868 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.876+0000 7f2d83d90640 1 -- 172.21.15.89:0/2649846552 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d7c06f8b0 con 0x7f2d60037820 2023-12-07T21:11:06.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.893+0000 7f2d727fc640 1 -- 172.21.15.89:0/2649846552 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673370 (secure 0 0 0) 0x7f2d6c0058b0 con 0x7f2d60037820 2023-12-07T21:11:06.893 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:11:06.899 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:11:06.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.898+0000 7f2d83d90640 1 -- 172.21.15.89:0/2649846552 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2d60037820 msgr2=0x7f2d60039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.898+0000 7f2d83d90640 1 --2- 172.21.15.89:0/2649846552 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2d60037820 0x7f2d60039ce0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c001610 tx=0x7f2d6c007970 comp rx=0 tx=0).stop 2023-12-07T21:11:06.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.898+0000 7f2d83d90640 1 -- 172.21.15.89:0/2649846552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7c06cc90 msgr2=0x7f2d7c089260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:06.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.898+0000 7f2d83d90640 1 --2- 172.21.15.89:0/2649846552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7c06cc90 0x7f2d7c089260 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2d78000f80 tx=0x7f2d78004a40 comp rx=0 tx=0).stop 2023-12-07T21:11:06.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.898+0000 7f2d83d90640 1 -- 172.21.15.89:0/2649846552 shutdown_connections 2023-12-07T21:11:06.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.898+0000 7f2d83d90640 1 --2- 172.21.15.89:0/2649846552 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2d60037820 0x7f2d60039ce0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.898+0000 7f2d83d90640 1 --2- 172.21.15.89:0/2649846552 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7c06cc90 0x7f2d7c089260 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:06.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.898+0000 7f2d83d90640 1 -- 172.21.15.89:0/2649846552 >> 172.21.15.89:0/2649846552 conn(0x7f2d7c0987f0 msgr2=0x7f2d7c122ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:06.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.898+0000 7f2d83d90640 1 -- 172.21.15.89:0/2649846552 shutdown_connections 2023-12-07T21:11:06.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:06.899+0000 7f2d83d90640 1 -- 172.21.15.89:0/2649846552 wait complete. 2023-12-07T21:11:06.903 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-12-07T21:11:06.089316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3322,"num_read_kb":2967,"num_write":1456,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3704,"ondisk_log_size":3704,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-77,"num_objects":-13,"num_object_clones":0,"num_object_copies":-27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":148,"num_read_kb":145,"num_write":51,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004171"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944900+0000","last_change":"2023-12-07T21:08:54.882968+0000","last_active":"2023-12-07T21:09:35.944900+0000","last_peered":"2023-12-07T21:09:35.944900+0000","last_clean":"2023-12-07T21:09:35.944900+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:09:35.944900+0000","last_undegraded":"2023-12-07T21:09:35.944900+0000","last_fullsized":"2023-12-07T21:09:35.944900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937447+0000","last_change":"2023-12-07T21:08:56.887127+0000","last_active":"2023-12-07T21:09:34.937447+0000","last_peered":"2023-12-07T21:09:34.937447+0000","last_clean":"2023-12-07T21:09:34.937447+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:09:34.937447+0000","last_undegraded":"2023-12-07T21:09:34.937447+0000","last_fullsized":"2023-12-07T21:09:34.937447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.595639+0000","last_change":"2023-12-07T21:08:54.890832+0000","last_active":"2023-12-07T21:09:36.595639+0000","last_peered":"2023-12-07T21:09:36.595639+0000","last_clean":"2023-12-07T21:09:36.595639+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:09:36.595639+0000","last_undegraded":"2023-12-07T21:09:36.595639+0000","last_fullsized":"2023-12-07T21:09:36.595639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:26.381861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.028116+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:09:37.028116+0000","last_peered":"2023-12-07T21:09:37.028116+0000","last_clean":"2023-12-07T21:09:37.028116+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:09:37.028116+0000","last_undegraded":"2023-12-07T21:09:37.028116+0000","last_fullsized":"2023-12-07T21:09:37.028116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:04:30.142969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.600004+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:09:36.600004+0000","last_peered":"2023-12-07T21:09:36.600004+0000","last_clean":"2023-12-07T21:09:36.600004+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:09:36.600004+0000","last_undegraded":"2023-12-07T21:09:36.600004+0000","last_fullsized":"2023-12-07T21:09:36.600004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:44.944890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946396+0000","last_change":"2023-12-07T21:08:56.873919+0000","last_active":"2023-12-07T21:09:34.946396+0000","last_peered":"2023-12-07T21:09:34.946396+0000","last_clean":"2023-12-07T21:09:34.946396+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:09:34.946396+0000","last_undegraded":"2023-12-07T21:09:34.946396+0000","last_fullsized":"2023-12-07T21:09:34.946396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:25:16.160841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942772+0000","last_change":"2023-12-07T21:08:54.880442+0000","last_active":"2023-12-07T21:09:35.942772+0000","last_peered":"2023-12-07T21:09:35.942772+0000","last_clean":"2023-12-07T21:09:35.942772+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:09:35.942772+0000","last_undegraded":"2023-12-07T21:09:35.942772+0000","last_fullsized":"2023-12-07T21:09:35.942772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946759+0000","last_change":"2023-12-07T21:08:56.874751+0000","last_active":"2023-12-07T21:09:34.946759+0000","last_peered":"2023-12-07T21:09:34.946759+0000","last_clean":"2023-12-07T21:09:34.946759+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:09:34.946759+0000","last_undegraded":"2023-12-07T21:09:34.946759+0000","last_fullsized":"2023-12-07T21:09:34.946759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:14.099961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945805+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:09:34.945805+0000","last_peered":"2023-12-07T21:09:34.945805+0000","last_clean":"2023-12-07T21:09:34.945805+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:09:34.945805+0000","last_undegraded":"2023-12-07T21:09:34.945805+0000","last_fullsized":"2023-12-07T21:09:34.945805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:18.585963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'7","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149300+0000","last_change":"2023-12-07T21:08:56.873414+0000","last_active":"2023-12-07T21:10:59.149300+0000","last_peered":"2023-12-07T21:10:59.149300+0000","last_clean":"2023-12-07T21:10:59.149300+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:10:59.149300+0000","last_undegraded":"2023-12-07T21:10:59.149300+0000","last_fullsized":"2023-12-07T21:10:59.149300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:46.057644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942843+0000","last_change":"2023-12-07T21:08:54.880274+0000","last_active":"2023-12-07T21:09:34.942843+0000","last_peered":"2023-12-07T21:09:34.942843+0000","last_clean":"2023-12-07T21:09:34.942843+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:09:34.942843+0000","last_undegraded":"2023-12-07T21:09:34.942843+0000","last_fullsized":"2023-12-07T21:09:34.942843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:18.078984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173549+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:10:18.173549+0000","last_peered":"2023-12-07T21:10:18.173549+0000","last_clean":"2023-12-07T21:10:18.173549+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:10:18.173549+0000","last_undegraded":"2023-12-07T21:10:18.173549+0000","last_fullsized":"2023-12-07T21:10:18.173549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:12.509153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945158+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:09:34.945158+0000","last_peered":"2023-12-07T21:09:34.945158+0000","last_clean":"2023-12-07T21:09:34.945158+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:09:34.945158+0000","last_undegraded":"2023-12-07T21:09:34.945158+0000","last_fullsized":"2023-12-07T21:09:34.945158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:55:25.782947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173686+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:10:59.173686+0000","last_peered":"2023-12-07T21:10:59.173686+0000","last_clean":"2023-12-07T21:10:59.173686+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:10:59.173686+0000","last_undegraded":"2023-12-07T21:10:59.173686+0000","last_fullsized":"2023-12-07T21:10:59.173686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943504+0000","last_change":"2023-12-07T21:08:54.891021+0000","last_active":"2023-12-07T21:09:34.943504+0000","last_peered":"2023-12-07T21:09:34.943504+0000","last_clean":"2023-12-07T21:09:34.943504+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:09:34.943504+0000","last_undegraded":"2023-12-07T21:09:34.943504+0000","last_fullsized":"2023-12-07T21:09:34.943504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'13","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.745821+0000","last_change":"2023-12-07T21:08:56.874321+0000","last_active":"2023-12-07T21:10:18.745821+0000","last_peered":"2023-12-07T21:10:18.745821+0000","last_clean":"2023-12-07T21:10:18.745821+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:10:18.745821+0000","last_undegraded":"2023-12-07T21:10:18.745821+0000","last_fullsized":"2023-12-07T21:10:18.745821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.602232+0000","last_change":"2023-12-07T21:08:56.874409+0000","last_active":"2023-12-07T21:09:36.602232+0000","last_peered":"2023-12-07T21:09:36.602232+0000","last_clean":"2023-12-07T21:09:36.602232+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:09:36.602232+0000","last_undegraded":"2023-12-07T21:09:36.602232+0000","last_fullsized":"2023-12-07T21:09:36.602232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:58.215716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939442+0000","last_change":"2023-12-07T21:08:54.887766+0000","last_active":"2023-12-07T21:09:34.939442+0000","last_peered":"2023-12-07T21:09:34.939442+0000","last_clean":"2023-12-07T21:09:34.939442+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:09:34.939442+0000","last_undegraded":"2023-12-07T21:09:34.939442+0000","last_fullsized":"2023-12-07T21:09:34.939442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149056+0000","last_change":"2023-12-07T21:08:56.876692+0000","last_active":"2023-12-07T21:10:59.149056+0000","last_peered":"2023-12-07T21:10:59.149056+0000","last_clean":"2023-12-07T21:10:59.149056+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:10:59.149056+0000","last_undegraded":"2023-12-07T21:10:59.149056+0000","last_fullsized":"2023-12-07T21:10:59.149056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945726+0000","last_change":"2023-12-07T21:08:54.885605+0000","last_active":"2023-12-07T21:09:34.945726+0000","last_peered":"2023-12-07T21:09:34.945726+0000","last_clean":"2023-12-07T21:09:34.945726+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:09:34.945726+0000","last_undegraded":"2023-12-07T21:09:34.945726+0000","last_fullsized":"2023-12-07T21:09:34.945726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'13","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149284+0000","last_change":"2023-12-07T21:08:56.882602+0000","last_active":"2023-12-07T21:10:59.149284+0000","last_peered":"2023-12-07T21:10:59.149284+0000","last_clean":"2023-12-07T21:10:59.149284+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:10:59.149284+0000","last_undegraded":"2023-12-07T21:10:59.149284+0000","last_fullsized":"2023-12-07T21:10:59.149284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:35.042292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939428+0000","last_change":"2023-12-07T21:08:54.889812+0000","last_active":"2023-12-07T21:09:34.939428+0000","last_peered":"2023-12-07T21:09:34.939428+0000","last_clean":"2023-12-07T21:09:34.939428+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:09:34.939428+0000","last_undegraded":"2023-12-07T21:09:34.939428+0000","last_fullsized":"2023-12-07T21:09:34.939428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.609048+0000","last_change":"2023-12-07T21:08:56.875989+0000","last_active":"2023-12-07T21:09:36.609048+0000","last_peered":"2023-12-07T21:09:36.609048+0000","last_clean":"2023-12-07T21:09:36.609048+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:09:36.609048+0000","last_undegraded":"2023-12-07T21:09:36.609048+0000","last_fullsized":"2023-12-07T21:09:36.609048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938981+0000","last_change":"2023-12-07T21:08:54.878784+0000","last_active":"2023-12-07T21:09:34.938981+0000","last_peered":"2023-12-07T21:09:34.938981+0000","last_clean":"2023-12-07T21:09:34.938981+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:09:34.938981+0000","last_undegraded":"2023-12-07T21:09:34.938981+0000","last_fullsized":"2023-12-07T21:09:34.938981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.022134+0000","last_change":"2023-12-07T21:08:56.875039+0000","last_active":"2023-12-07T21:09:37.022134+0000","last_peered":"2023-12-07T21:09:37.022134+0000","last_clean":"2023-12-07T21:09:37.022134+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:09:37.022134+0000","last_undegraded":"2023-12-07T21:09:37.022134+0000","last_fullsized":"2023-12-07T21:09:37.022134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944921+0000","last_change":"2023-12-07T21:08:54.890574+0000","last_active":"2023-12-07T21:09:34.944921+0000","last_peered":"2023-12-07T21:09:34.944921+0000","last_clean":"2023-12-07T21:09:34.944921+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:09:34.944921+0000","last_undegraded":"2023-12-07T21:09:34.944921+0000","last_fullsized":"2023-12-07T21:09:34.944921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939610+0000","last_change":"2023-12-07T21:08:56.883504+0000","last_active":"2023-12-07T21:09:34.939610+0000","last_peered":"2023-12-07T21:09:34.939610+0000","last_clean":"2023-12-07T21:09:34.939610+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:09:34.939610+0000","last_undegraded":"2023-12-07T21:09:34.939610+0000","last_fullsized":"2023-12-07T21:09:34.939610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:51.305185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946035+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:09:34.946035+0000","last_peered":"2023-12-07T21:09:34.946035+0000","last_clean":"2023-12-07T21:09:34.946035+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:09:34.946035+0000","last_undegraded":"2023-12-07T21:09:34.946035+0000","last_fullsized":"2023-12-07T21:09:34.946035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:50:11.989738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.964931+0000","last_change":"2023-12-07T21:09:04.931981+0000","last_active":"2023-12-07T21:10:59.964931+0000","last_peered":"2023-12-07T21:10:59.964931+0000","last_clean":"2023-12-07T21:10:59.964931+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:10:59.964931+0000","last_undegraded":"2023-12-07T21:10:59.964931+0000","last_fullsized":"2023-12-07T21:10:59.964931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:53.521686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.021786+0000","last_change":"2023-12-07T21:08:56.873551+0000","last_active":"2023-12-07T21:09:37.021786+0000","last_peered":"2023-12-07T21:09:37.021786+0000","last_clean":"2023-12-07T21:09:37.021786+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:09:37.021786+0000","last_undegraded":"2023-12-07T21:09:37.021786+0000","last_fullsized":"2023-12-07T21:09:37.021786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:25.387074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945597+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:09:34.945597+0000","last_peered":"2023-12-07T21:09:34.945597+0000","last_clean":"2023-12-07T21:09:34.945597+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:09:34.945597+0000","last_undegraded":"2023-12-07T21:09:34.945597+0000","last_fullsized":"2023-12-07T21:09:34.945597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:43.001000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"24'1","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.818090+0000","last_change":"2023-12-07T21:08:58.878371+0000","last_active":"2023-12-07T21:10:59.818090+0000","last_peered":"2023-12-07T21:10:59.818090+0000","last_clean":"2023-12-07T21:10:59.818090+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:10:59.818090+0000","last_undegraded":"2023-12-07T21:10:59.818090+0000","last_fullsized":"2023-12-07T21:10:59.818090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:31.248934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.711024+0000","last_change":"2023-12-07T21:09:00.895835+0000","last_active":"2023-12-07T21:10:18.711024+0000","last_peered":"2023-12-07T21:10:18.711024+0000","last_clean":"2023-12-07T21:10:18.711024+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:10:18.711024+0000","last_undegraded":"2023-12-07T21:10:18.711024+0000","last_fullsized":"2023-12-07T21:10:18.711024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:04:34.159776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939365+0000","last_change":"2023-12-07T21:09:02.907297+0000","last_active":"2023-12-07T21:09:34.939365+0000","last_peered":"2023-12-07T21:09:34.939365+0000","last_clean":"2023-12-07T21:09:34.939365+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:09:34.939365+0000","last_undegraded":"2023-12-07T21:09:34.939365+0000","last_fullsized":"2023-12-07T21:09:34.939365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:14.963344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.099231+0000","last_change":"2023-12-07T21:09:04.931948+0000","last_active":"2023-12-07T21:10:13.099231+0000","last_peered":"2023-12-07T21:10:13.099231+0000","last_clean":"2023-12-07T21:10:13.099231+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:10:13.099231+0000","last_undegraded":"2023-12-07T21:10:13.099231+0000","last_fullsized":"2023-12-07T21:10:13.099231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:01:26.083720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948422+0000","last_change":"2023-12-07T21:08:56.874761+0000","last_active":"2023-12-07T21:09:34.948422+0000","last_peered":"2023-12-07T21:09:34.948422+0000","last_clean":"2023-12-07T21:09:34.948422+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:09:34.948422+0000","last_undegraded":"2023-12-07T21:09:34.948422+0000","last_fullsized":"2023-12-07T21:09:34.948422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:15.592836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942644+0000","last_change":"2023-12-07T21:08:54.880632+0000","last_active":"2023-12-07T21:09:34.942644+0000","last_peered":"2023-12-07T21:09:34.942644+0000","last_clean":"2023-12-07T21:09:34.942644+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:09:34.942644+0000","last_undegraded":"2023-12-07T21:09:34.942644+0000","last_fullsized":"2023-12-07T21:09:34.942644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943879+0000","last_change":"2023-12-07T21:08:58.877458+0000","last_active":"2023-12-07T21:09:34.943879+0000","last_peered":"2023-12-07T21:09:34.943879+0000","last_clean":"2023-12-07T21:09:34.943879+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:09:34.943879+0000","last_undegraded":"2023-12-07T21:09:34.943879+0000","last_fullsized":"2023-12-07T21:09:34.943879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:26.789220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938986+0000","last_change":"2023-12-07T21:09:00.893179+0000","last_active":"2023-12-07T21:09:34.938986+0000","last_peered":"2023-12-07T21:09:34.938986+0000","last_clean":"2023-12-07T21:09:34.938986+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:09:34.938986+0000","last_undegraded":"2023-12-07T21:09:34.938986+0000","last_fullsized":"2023-12-07T21:09:34.938986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:01:24.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938667+0000","last_change":"2023-12-07T21:09:02.901036+0000","last_active":"2023-12-07T21:09:34.938667+0000","last_peered":"2023-12-07T21:09:34.938667+0000","last_clean":"2023-12-07T21:09:34.938667+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:09:34.938667+0000","last_undegraded":"2023-12-07T21:09:34.938667+0000","last_fullsized":"2023-12-07T21:09:34.938667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:43.815906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943377+0000","last_change":"2023-12-07T21:09:04.925464+0000","last_active":"2023-12-07T21:09:34.943377+0000","last_peered":"2023-12-07T21:09:34.943377+0000","last_clean":"2023-12-07T21:09:34.943377+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:09:34.943377+0000","last_undegraded":"2023-12-07T21:09:34.943377+0000","last_fullsized":"2023-12-07T21:09:34.943377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:05.623664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173385+0000","last_change":"2023-12-07T21:08:56.875484+0000","last_active":"2023-12-07T21:10:18.173385+0000","last_peered":"2023-12-07T21:10:18.173385+0000","last_clean":"2023-12-07T21:10:18.173385+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:10:18.173385+0000","last_undegraded":"2023-12-07T21:10:18.173385+0000","last_fullsized":"2023-12-07T21:10:18.173385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:53.554840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944843+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:09:34.944843+0000","last_peered":"2023-12-07T21:09:34.944843+0000","last_clean":"2023-12-07T21:09:34.944843+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:09:34.944843+0000","last_undegraded":"2023-12-07T21:09:34.944843+0000","last_fullsized":"2023-12-07T21:09:34.944843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:44:12.242883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945726+0000","last_change":"2023-12-07T21:08:58.880158+0000","last_active":"2023-12-07T21:09:34.945726+0000","last_peered":"2023-12-07T21:09:34.945726+0000","last_clean":"2023-12-07T21:09:34.945726+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:09:34.945726+0000","last_undegraded":"2023-12-07T21:09:34.945726+0000","last_fullsized":"2023-12-07T21:09:34.945726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:46:42.407725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943564+0000","last_change":"2023-12-07T21:09:00.890726+0000","last_active":"2023-12-07T21:09:34.943564+0000","last_peered":"2023-12-07T21:09:34.943564+0000","last_clean":"2023-12-07T21:09:34.943564+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:09:34.943564+0000","last_undegraded":"2023-12-07T21:09:34.943564+0000","last_fullsized":"2023-12-07T21:09:34.943564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:46:44.418058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'243","reported_seq":309,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.970866+0000","last_change":"2023-12-07T21:09:02.906250+0000","last_active":"2023-12-07T21:10:59.970866+0000","last_peered":"2023-12-07T21:10:59.970866+0000","last_clean":"2023-12-07T21:10:59.970866+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:10:59.970866+0000","last_undegraded":"2023-12-07T21:10:59.970866+0000","last_fullsized":"2023-12-07T21:10:59.970866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:09.157302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942609+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:09:34.942609+0000","last_peered":"2023-12-07T21:09:34.942609+0000","last_clean":"2023-12-07T21:09:34.942609+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:09:34.942609+0000","last_undegraded":"2023-12-07T21:09:34.942609+0000","last_fullsized":"2023-12-07T21:09:34.942609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:38.570544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149295+0000","last_change":"2023-12-07T21:08:56.885545+0000","last_active":"2023-12-07T21:10:59.149295+0000","last_peered":"2023-12-07T21:10:59.149295+0000","last_clean":"2023-12-07T21:10:59.149295+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:10:59.149295+0000","last_undegraded":"2023-12-07T21:10:59.149295+0000","last_fullsized":"2023-12-07T21:10:59.149295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937355+0000","last_change":"2023-12-07T21:08:54.878527+0000","last_active":"2023-12-07T21:09:34.937355+0000","last_peered":"2023-12-07T21:09:34.937355+0000","last_clean":"2023-12-07T21:09:34.937355+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:09:34.937355+0000","last_undegraded":"2023-12-07T21:09:34.937355+0000","last_fullsized":"2023-12-07T21:09:34.937355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:44:21.586858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.950706+0000","last_change":"2023-12-07T21:09:35.950706+0000","last_active":"2023-12-07T21:09:35.950706+0000","last_peered":"2023-12-07T21:09:35.950706+0000","last_clean":"2023-12-07T21:09:35.950706+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:09:35.950706+0000","last_undegraded":"2023-12-07T21:09:35.950706+0000","last_fullsized":"2023-12-07T21:09:35.950706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:55.202208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.705204+0000","last_change":"2023-12-07T21:09:00.892788+0000","last_active":"2023-12-07T21:10:18.705204+0000","last_peered":"2023-12-07T21:10:18.705204+0000","last_clean":"2023-12-07T21:10:18.705204+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:10:18.705204+0000","last_undegraded":"2023-12-07T21:10:18.705204+0000","last_fullsized":"2023-12-07T21:10:18.705204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:02.232524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":326,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.974960+0000","last_change":"2023-12-07T21:09:02.901266+0000","last_active":"2023-12-07T21:10:59.974960+0000","last_peered":"2023-12-07T21:10:59.974960+0000","last_clean":"2023-12-07T21:10:59.974960+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:10:59.974960+0000","last_undegraded":"2023-12-07T21:10:59.974960+0000","last_fullsized":"2023-12-07T21:10:59.974960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:00.730866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149018+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:10:59.149018+0000","last_peered":"2023-12-07T21:10:59.149018+0000","last_clean":"2023-12-07T21:10:59.149018+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:10:59.149018+0000","last_undegraded":"2023-12-07T21:10:59.149018+0000","last_fullsized":"2023-12-07T21:10:59.149018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:05.147754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946220+0000","last_change":"2023-12-07T21:08:54.880253+0000","last_active":"2023-12-07T21:09:34.946220+0000","last_peered":"2023-12-07T21:09:34.946220+0000","last_clean":"2023-12-07T21:09:34.946220+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:09:34.946220+0000","last_undegraded":"2023-12-07T21:09:34.946220+0000","last_fullsized":"2023-12-07T21:09:34.946220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937686+0000","last_change":"2023-12-07T21:08:58.877986+0000","last_active":"2023-12-07T21:09:34.937686+0000","last_peered":"2023-12-07T21:09:34.937686+0000","last_clean":"2023-12-07T21:09:34.937686+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:09:34.937686+0000","last_undegraded":"2023-12-07T21:09:34.937686+0000","last_fullsized":"2023-12-07T21:09:34.937686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:07.154229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'39","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.127461+0000","last_change":"2023-12-07T21:09:00.888749+0000","last_active":"2023-12-07T21:10:59.127461+0000","last_peered":"2023-12-07T21:10:59.127461+0000","last_clean":"2023-12-07T21:10:59.127461+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:10:59.127461+0000","last_undegraded":"2023-12-07T21:10:59.127461+0000","last_fullsized":"2023-12-07T21:10:59.127461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:09.164561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944403+0000","last_change":"2023-12-07T21:09:02.897538+0000","last_active":"2023-12-07T21:09:34.944403+0000","last_peered":"2023-12-07T21:09:34.944403+0000","last_clean":"2023-12-07T21:09:34.944403+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:09:34.944403+0000","last_undegraded":"2023-12-07T21:09:34.944403+0000","last_fullsized":"2023-12-07T21:09:34.944403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:14.963344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.550827+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:10:18.550827+0000","last_peered":"2023-12-07T21:10:18.550827+0000","last_clean":"2023-12-07T21:10:18.550827+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:10:18.550827+0000","last_undegraded":"2023-12-07T21:10:18.550827+0000","last_fullsized":"2023-12-07T21:10:18.550827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:02.886090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'21","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173496+0000","last_change":"2023-12-07T21:08:56.871222+0000","last_active":"2023-12-07T21:10:18.173496+0000","last_peered":"2023-12-07T21:10:18.173496+0000","last_clean":"2023-12-07T21:10:18.173496+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:10:18.173496+0000","last_undegraded":"2023-12-07T21:10:18.173496+0000","last_fullsized":"2023-12-07T21:10:18.173496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:00:00.778558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944073+0000","last_change":"2023-12-07T21:08:54.885249+0000","last_active":"2023-12-07T21:09:34.944073+0000","last_peered":"2023-12-07T21:09:34.944073+0000","last_clean":"2023-12-07T21:09:34.944073+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:09:34.944073+0000","last_undegraded":"2023-12-07T21:09:34.944073+0000","last_fullsized":"2023-12-07T21:09:34.944073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:59.087021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943751+0000","last_change":"2023-12-07T21:08:58.880254+0000","last_active":"2023-12-07T21:09:34.943751+0000","last_peered":"2023-12-07T21:09:34.943751+0000","last_clean":"2023-12-07T21:09:34.943751+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:09:34.943751+0000","last_undegraded":"2023-12-07T21:09:34.943751+0000","last_fullsized":"2023-12-07T21:09:34.943751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:59:22.011218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'30","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.694667+0000","last_change":"2023-12-07T21:09:00.895444+0000","last_active":"2023-12-07T21:10:18.694667+0000","last_peered":"2023-12-07T21:10:18.694667+0000","last_clean":"2023-12-07T21:10:18.694667+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:10:18.694667+0000","last_undegraded":"2023-12-07T21:10:18.694667+0000","last_fullsized":"2023-12-07T21:10:18.694667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:09:52.225596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943466+0000","last_change":"2023-12-07T21:09:02.906821+0000","last_active":"2023-12-07T21:09:34.943466+0000","last_peered":"2023-12-07T21:09:34.943466+0000","last_clean":"2023-12-07T21:09:34.943466+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:09:34.943466+0000","last_undegraded":"2023-12-07T21:09:34.943466+0000","last_fullsized":"2023-12-07T21:09:34.943466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:00.871254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.004149+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:10:13.004149+0000","last_peered":"2023-12-07T21:10:13.004149+0000","last_clean":"2023-12-07T21:10:13.004149+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:10:13.004149+0000","last_undegraded":"2023-12-07T21:10:13.004149+0000","last_fullsized":"2023-12-07T21:10:13.004149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:03.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943008+0000","last_change":"2023-12-07T21:08:56.879742+0000","last_active":"2023-12-07T21:09:34.943008+0000","last_peered":"2023-12-07T21:09:34.943008+0000","last_clean":"2023-12-07T21:09:34.943008+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:09:34.943008+0000","last_undegraded":"2023-12-07T21:09:34.943008+0000","last_fullsized":"2023-12-07T21:09:34.943008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:28:08.424793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948569+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:09:34.948569+0000","last_peered":"2023-12-07T21:09:34.948569+0000","last_clean":"2023-12-07T21:09:34.948569+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:09:34.948569+0000","last_undegraded":"2023-12-07T21:09:34.948569+0000","last_fullsized":"2023-12-07T21:09:34.948569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:29.350180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945631+0000","last_change":"2023-12-07T21:08:58.874569+0000","last_active":"2023-12-07T21:09:34.945631+0000","last_peered":"2023-12-07T21:09:34.945631+0000","last_clean":"2023-12-07T21:09:34.945631+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:09:34.945631+0000","last_undegraded":"2023-12-07T21:09:34.945631+0000","last_fullsized":"2023-12-07T21:09:34.945631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:25:29.329795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.717375+0000","last_change":"2023-12-07T21:09:00.889539+0000","last_active":"2023-12-07T21:10:18.717375+0000","last_peered":"2023-12-07T21:10:18.717375+0000","last_clean":"2023-12-07T21:10:18.717375+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:10:18.717375+0000","last_undegraded":"2023-12-07T21:10:18.717375+0000","last_fullsized":"2023-12-07T21:10:18.717375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:23.846766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":294,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.975948+0000","last_change":"2023-12-07T21:09:02.905689+0000","last_active":"2023-12-07T21:10:59.975948+0000","last_peered":"2023-12-07T21:10:59.975948+0000","last_clean":"2023-12-07T21:10:59.975948+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:10:59.975948+0000","last_undegraded":"2023-12-07T21:10:59.975948+0000","last_fullsized":"2023-12-07T21:10:59.975948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:43.815906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944612+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:09:34.944612+0000","last_peered":"2023-12-07T21:09:34.944612+0000","last_clean":"2023-12-07T21:09:34.944612+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:09:34.944612+0000","last_undegraded":"2023-12-07T21:09:34.944612+0000","last_fullsized":"2023-12-07T21:09:34.944612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:27.874660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.602318+0000","last_change":"2023-12-07T21:08:56.870949+0000","last_active":"2023-12-07T21:09:36.602318+0000","last_peered":"2023-12-07T21:09:36.602318+0000","last_clean":"2023-12-07T21:09:36.602318+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:09:36.602318+0000","last_undegraded":"2023-12-07T21:09:36.602318+0000","last_fullsized":"2023-12-07T21:09:36.602318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:50.983783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947454+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:09:34.947454+0000","last_peered":"2023-12-07T21:09:34.947454+0000","last_clean":"2023-12-07T21:09:34.947454+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:09:34.947454+0000","last_undegraded":"2023-12-07T21:09:34.947454+0000","last_fullsized":"2023-12-07T21:09:34.947454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:48.971381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943934+0000","last_change":"2023-12-07T21:08:58.880111+0000","last_active":"2023-12-07T21:09:34.943934+0000","last_peered":"2023-12-07T21:09:34.943934+0000","last_clean":"2023-12-07T21:09:34.943934+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:09:34.943934+0000","last_undegraded":"2023-12-07T21:09:34.943934+0000","last_fullsized":"2023-12-07T21:09:34.943934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:06:27.005217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.110642+0000","last_change":"2023-12-07T21:09:00.894678+0000","last_active":"2023-12-07T21:10:59.110642+0000","last_peered":"2023-12-07T21:10:59.110642+0000","last_clean":"2023-12-07T21:10:59.110642+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:10:59.110642+0000","last_undegraded":"2023-12-07T21:10:59.110642+0000","last_fullsized":"2023-12-07T21:10:59.110642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:55:22.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943349+0000","last_change":"2023-12-07T21:09:02.901382+0000","last_active":"2023-12-07T21:09:34.943349+0000","last_peered":"2023-12-07T21:09:34.943349+0000","last_clean":"2023-12-07T21:09:34.943349+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:09:34.943349+0000","last_undegraded":"2023-12-07T21:09:34.943349+0000","last_fullsized":"2023-12-07T21:09:34.943349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:36.555708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.963309+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:10:59.963309+0000","last_peered":"2023-12-07T21:10:59.963309+0000","last_clean":"2023-12-07T21:10:59.963309+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:10:59.963309+0000","last_undegraded":"2023-12-07T21:10:59.963309+0000","last_fullsized":"2023-12-07T21:10:59.963309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:58.709847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.952362+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:09:35.952362+0000","last_peered":"2023-12-07T21:09:35.952362+0000","last_clean":"2023-12-07T21:09:35.952362+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:09:35.952362+0000","last_undegraded":"2023-12-07T21:09:35.952362+0000","last_fullsized":"2023-12-07T21:09:35.952362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:06:39.417736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944094+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:09:34.944094+0000","last_peered":"2023-12-07T21:09:34.944094+0000","last_clean":"2023-12-07T21:09:34.944094+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:09:34.944094+0000","last_undegraded":"2023-12-07T21:09:34.944094+0000","last_fullsized":"2023-12-07T21:09:34.944094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943794+0000","last_change":"2023-12-07T21:08:58.878003+0000","last_active":"2023-12-07T21:09:34.943794+0000","last_peered":"2023-12-07T21:09:34.943794+0000","last_clean":"2023-12-07T21:09:34.943794+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:09:34.943794+0000","last_undegraded":"2023-12-07T21:09:34.943794+0000","last_fullsized":"2023-12-07T21:09:34.943794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:31.868475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'30","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.698790+0000","last_change":"2023-12-07T21:09:00.892793+0000","last_active":"2023-12-07T21:10:18.698790+0000","last_peered":"2023-12-07T21:10:18.698790+0000","last_clean":"2023-12-07T21:10:18.698790+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:10:18.698790+0000","last_undegraded":"2023-12-07T21:10:18.698790+0000","last_fullsized":"2023-12-07T21:10:18.698790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:40:44.335329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948507+0000","last_change":"2023-12-07T21:09:02.906350+0000","last_active":"2023-12-07T21:09:34.948507+0000","last_peered":"2023-12-07T21:09:34.948507+0000","last_clean":"2023-12-07T21:09:34.948507+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:09:34.948507+0000","last_undegraded":"2023-12-07T21:09:34.948507+0000","last_fullsized":"2023-12-07T21:09:34.948507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:37:53.231631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944316+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:09:34.944316+0000","last_peered":"2023-12-07T21:09:34.944316+0000","last_clean":"2023-12-07T21:09:34.944316+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:09:34.944316+0000","last_undegraded":"2023-12-07T21:09:34.944316+0000","last_fullsized":"2023-12-07T21:09:34.944316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:08:05.985163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737413+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:10:18.737413+0000","last_peered":"2023-12-07T21:10:18.737413+0000","last_clean":"2023-12-07T21:10:18.737413+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:10:18.737413+0000","last_undegraded":"2023-12-07T21:10:18.737413+0000","last_fullsized":"2023-12-07T21:10:18.737413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:45.476986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946531+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:09:34.946531+0000","last_peered":"2023-12-07T21:09:34.946531+0000","last_clean":"2023-12-07T21:09:34.946531+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:09:34.946531+0000","last_undegraded":"2023-12-07T21:09:34.946531+0000","last_fullsized":"2023-12-07T21:09:34.946531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:50.838564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943971+0000","last_change":"2023-12-07T21:08:58.880054+0000","last_active":"2023-12-07T21:09:34.943971+0000","last_peered":"2023-12-07T21:09:34.943971+0000","last_clean":"2023-12-07T21:09:34.943971+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:09:34.943971+0000","last_undegraded":"2023-12-07T21:09:34.943971+0000","last_fullsized":"2023-12-07T21:09:34.943971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:06:16.756883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.725885+0000","last_change":"2023-12-07T21:09:00.884835+0000","last_active":"2023-12-07T21:10:18.725885+0000","last_peered":"2023-12-07T21:10:18.725885+0000","last_clean":"2023-12-07T21:10:18.725885+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:10:18.725885+0000","last_undegraded":"2023-12-07T21:10:18.725885+0000","last_fullsized":"2023-12-07T21:10:18.725885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:46:31.016107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":323,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.999246+0000","last_change":"2023-12-07T21:09:02.897993+0000","last_active":"2023-12-07T21:10:59.999246+0000","last_peered":"2023-12-07T21:10:59.999246+0000","last_clean":"2023-12-07T21:10:59.999246+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:10:59.999246+0000","last_undegraded":"2023-12-07T21:10:59.999246+0000","last_fullsized":"2023-12-07T21:10:59.999246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:07:07.411571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.749284+0000","last_change":"2023-12-07T21:09:04.919388+0000","last_active":"2023-12-07T21:10:18.749284+0000","last_peered":"2023-12-07T21:10:18.749284+0000","last_clean":"2023-12-07T21:10:18.749284+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:10:18.749284+0000","last_undegraded":"2023-12-07T21:10:18.749284+0000","last_fullsized":"2023-12-07T21:10:18.749284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:08.715985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.066420+0000","last_change":"2023-12-07T21:08:56.880261+0000","last_active":"2023-12-07T21:09:36.066420+0000","last_peered":"2023-12-07T21:09:36.066420+0000","last_clean":"2023-12-07T21:09:36.066420+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:09:36.066420+0000","last_undegraded":"2023-12-07T21:09:36.066420+0000","last_fullsized":"2023-12-07T21:09:36.066420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.585971+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:09:36.585971+0000","last_peered":"2023-12-07T21:09:36.585971+0000","last_clean":"2023-12-07T21:09:36.585971+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:09:36.585971+0000","last_undegraded":"2023-12-07T21:09:36.585971+0000","last_fullsized":"2023-12-07T21:09:36.585971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:55:05.877689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.935504+0000","last_change":"2023-12-07T21:08:58.876612+0000","last_active":"2023-12-07T21:10:59.935504+0000","last_peered":"2023-12-07T21:10:59.935504+0000","last_clean":"2023-12-07T21:10:59.935504+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:10:59.935504+0000","last_undegraded":"2023-12-07T21:10:59.935504+0000","last_fullsized":"2023-12-07T21:10:59.935504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:09.272727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":169,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947872+0000","last_change":"2023-12-07T21:09:00.895566+0000","last_active":"2023-12-07T21:09:34.947872+0000","last_peered":"2023-12-07T21:09:34.947872+0000","last_clean":"2023-12-07T21:09:34.947872+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:09:34.947872+0000","last_undegraded":"2023-12-07T21:09:34.947872+0000","last_fullsized":"2023-12-07T21:09:34.947872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:26:26.503427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":358,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.995871+0000","last_change":"2023-12-07T21:09:02.900092+0000","last_active":"2023-12-07T21:10:59.995871+0000","last_peered":"2023-12-07T21:10:59.995871+0000","last_clean":"2023-12-07T21:10:59.995871+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:10:59.995871+0000","last_undegraded":"2023-12-07T21:10:59.995871+0000","last_fullsized":"2023-12-07T21:10:59.995871+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:58.034650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.362471+0000","last_change":"2023-12-07T21:09:04.923396+0000","last_active":"2023-12-07T21:09:36.362471+0000","last_peered":"2023-12-07T21:09:36.362471+0000","last_clean":"2023-12-07T21:09:36.362471+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:09:36.362471+0000","last_undegraded":"2023-12-07T21:09:36.362471+0000","last_fullsized":"2023-12-07T21:09:36.362471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:15:15.500097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939613+0000","last_change":"2023-12-07T21:08:56.889238+0000","last_active":"2023-12-07T21:09:34.939613+0000","last_peered":"2023-12-07T21:09:34.939613+0000","last_clean":"2023-12-07T21:09:34.939613+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:09:34.939613+0000","last_undegraded":"2023-12-07T21:09:34.939613+0000","last_fullsized":"2023-12-07T21:09:34.939613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:06:26.241158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945162+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:09:34.945162+0000","last_peered":"2023-12-07T21:09:34.945162+0000","last_clean":"2023-12-07T21:09:34.945162+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:09:34.945162+0000","last_undegraded":"2023-12-07T21:09:34.945162+0000","last_fullsized":"2023-12-07T21:09:34.945162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:48.585124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948807+0000","last_change":"2023-12-07T21:08:58.879899+0000","last_active":"2023-12-07T21:09:34.948807+0000","last_peered":"2023-12-07T21:09:34.948807+0000","last_clean":"2023-12-07T21:09:34.948807+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:09:34.948807+0000","last_undegraded":"2023-12-07T21:09:34.948807+0000","last_fullsized":"2023-12-07T21:09:34.948807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:56.707476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.712555+0000","last_change":"2023-12-07T21:09:00.892694+0000","last_active":"2023-12-07T21:10:18.712555+0000","last_peered":"2023-12-07T21:10:18.712555+0000","last_clean":"2023-12-07T21:10:18.712555+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:10:18.712555+0000","last_undegraded":"2023-12-07T21:10:18.712555+0000","last_fullsized":"2023-12-07T21:10:18.712555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:54.775039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943470+0000","last_change":"2023-12-07T21:09:02.906473+0000","last_active":"2023-12-07T21:09:34.943470+0000","last_peered":"2023-12-07T21:09:34.943470+0000","last_clean":"2023-12-07T21:09:34.943470+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:09:34.943470+0000","last_undegraded":"2023-12-07T21:09:34.943470+0000","last_fullsized":"2023-12-07T21:09:34.943470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:41.421690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.180594+0000","last_change":"2023-12-07T21:09:04.920277+0000","last_active":"2023-12-07T21:10:59.180594+0000","last_peered":"2023-12-07T21:10:59.180594+0000","last_clean":"2023-12-07T21:10:59.180594+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:10:59.180594+0000","last_undegraded":"2023-12-07T21:10:59.180594+0000","last_fullsized":"2023-12-07T21:10:59.180594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:05.623664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.947251+0000","last_change":"2023-12-07T21:08:56.875185+0000","last_active":"2023-12-07T21:09:35.947251+0000","last_peered":"2023-12-07T21:09:35.947251+0000","last_clean":"2023-12-07T21:09:35.947251+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:09:35.947251+0000","last_undegraded":"2023-12-07T21:09:35.947251+0000","last_fullsized":"2023-12-07T21:09:35.947251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:07:01.381707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948511+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:09:35.948511+0000","last_peered":"2023-12-07T21:09:35.948511+0000","last_clean":"2023-12-07T21:09:35.948511+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:09:35.948511+0000","last_undegraded":"2023-12-07T21:09:35.948511+0000","last_fullsized":"2023-12-07T21:09:35.948511+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:17.092202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944755+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:09:35.944755+0000","last_peered":"2023-12-07T21:09:35.944755+0000","last_clean":"2023-12-07T21:09:35.944755+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:09:35.944755+0000","last_undegraded":"2023-12-07T21:09:35.944755+0000","last_fullsized":"2023-12-07T21:09:35.944755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:39:44.793585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942701+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:09:35.942701+0000","last_peered":"2023-12-07T21:09:35.942701+0000","last_clean":"2023-12-07T21:09:35.942701+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:09:35.942701+0000","last_undegraded":"2023-12-07T21:09:35.942701+0000","last_fullsized":"2023-12-07T21:09:35.942701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:28:06.412391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.952567+0000","last_change":"2023-12-07T21:08:58.875656+0000","last_active":"2023-12-07T21:09:35.952567+0000","last_peered":"2023-12-07T21:09:35.952567+0000","last_clean":"2023-12-07T21:09:35.952567+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:09:35.952567+0000","last_undegraded":"2023-12-07T21:09:35.952567+0000","last_fullsized":"2023-12-07T21:09:35.952567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:55.354113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'70","reported_seq":131,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.126427+0000","last_change":"2023-12-07T21:09:00.891338+0000","last_active":"2023-12-07T21:10:59.126427+0000","last_peered":"2023-12-07T21:10:59.126427+0000","last_clean":"2023-12-07T21:10:59.126427+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:10:59.126427+0000","last_undegraded":"2023-12-07T21:10:59.126427+0000","last_fullsized":"2023-12-07T21:10:59.126427+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:47.241395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944698+0000","last_change":"2023-12-07T21:09:02.905666+0000","last_active":"2023-12-07T21:09:34.944698+0000","last_peered":"2023-12-07T21:09:34.944698+0000","last_clean":"2023-12-07T21:09:34.944698+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:09:34.944698+0000","last_undegraded":"2023-12-07T21:09:34.944698+0000","last_fullsized":"2023-12-07T21:09:34.944698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:02.230683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.177244+0000","last_change":"2023-12-07T21:09:04.924703+0000","last_active":"2023-12-07T21:10:59.177244+0000","last_peered":"2023-12-07T21:10:59.177244+0000","last_clean":"2023-12-07T21:10:59.177244+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:10:59.177244+0000","last_undegraded":"2023-12-07T21:10:59.177244+0000","last_fullsized":"2023-12-07T21:10:59.177244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:31.414632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.360739+0000","last_change":"2023-12-07T21:08:56.872420+0000","last_active":"2023-12-07T21:09:36.360739+0000","last_peered":"2023-12-07T21:09:36.360739+0000","last_clean":"2023-12-07T21:09:36.360739+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:09:36.360739+0000","last_undegraded":"2023-12-07T21:09:36.360739+0000","last_fullsized":"2023-12-07T21:09:36.360739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:35.391826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946195+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:09:35.946195+0000","last_peered":"2023-12-07T21:09:35.946195+0000","last_clean":"2023-12-07T21:09:35.946195+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:09:35.946195+0000","last_undegraded":"2023-12-07T21:09:35.946195+0000","last_fullsized":"2023-12-07T21:09:35.946195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:38.020788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.147003+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:10:59.147003+0000","last_peered":"2023-12-07T21:10:59.147003+0000","last_clean":"2023-12-07T21:10:59.147003+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:10:59.147003+0000","last_undegraded":"2023-12-07T21:10:59.147003+0000","last_fullsized":"2023-12-07T21:10:59.147003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.949153+0000","last_change":"2023-12-07T21:08:58.879144+0000","last_active":"2023-12-07T21:09:34.949153+0000","last_peered":"2023-12-07T21:09:34.949153+0000","last_clean":"2023-12-07T21:09:34.949153+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:09:34.949153+0000","last_undegraded":"2023-12-07T21:09:34.949153+0000","last_fullsized":"2023-12-07T21:09:34.949153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:10.939955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'241","reported_seq":410,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.967308+0000","last_change":"2023-12-07T21:09:00.892118+0000","last_active":"2023-12-07T21:10:59.967308+0000","last_peered":"2023-12-07T21:10:59.967308+0000","last_clean":"2023-12-07T21:10:59.967308+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:10:59.967308+0000","last_undegraded":"2023-12-07T21:10:59.967308+0000","last_fullsized":"2023-12-07T21:10:59.967308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:03:54.253378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":318,"num_read_kb":303,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947700+0000","last_change":"2023-12-07T21:09:02.905387+0000","last_active":"2023-12-07T21:09:34.947700+0000","last_peered":"2023-12-07T21:09:34.947700+0000","last_clean":"2023-12-07T21:09:34.947700+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:09:34.947700+0000","last_undegraded":"2023-12-07T21:09:34.947700+0000","last_fullsized":"2023-12-07T21:09:34.947700+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:01:07.430200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.153282+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:10:13.153282+0000","last_peered":"2023-12-07T21:10:13.153282+0000","last_clean":"2023-12-07T21:10:13.153282+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:10:13.153282+0000","last_undegraded":"2023-12-07T21:10:13.153282+0000","last_fullsized":"2023-12-07T21:10:13.153282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:03.815279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737328+0000","last_change":"2023-12-07T21:08:56.883281+0000","last_active":"2023-12-07T21:10:18.737328+0000","last_peered":"2023-12-07T21:10:18.737328+0000","last_clean":"2023-12-07T21:10:18.737328+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:10:18.737328+0000","last_undegraded":"2023-12-07T21:10:18.737328+0000","last_fullsized":"2023-12-07T21:10:18.737328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:11:43.198377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941657+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:09:35.941657+0000","last_peered":"2023-12-07T21:09:35.941657+0000","last_clean":"2023-12-07T21:09:35.941657+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:09:35.941657+0000","last_undegraded":"2023-12-07T21:09:35.941657+0000","last_fullsized":"2023-12-07T21:09:35.941657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:49:28.884695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941524+0000","last_change":"2023-12-07T21:08:54.881937+0000","last_active":"2023-12-07T21:09:35.941524+0000","last_peered":"2023-12-07T21:09:35.941524+0000","last_clean":"2023-12-07T21:09:35.941524+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:09:35.941524+0000","last_undegraded":"2023-12-07T21:09:35.941524+0000","last_fullsized":"2023-12-07T21:09:35.941524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943947+0000","last_change":"2023-12-07T21:08:58.875724+0000","last_active":"2023-12-07T21:09:34.943947+0000","last_peered":"2023-12-07T21:09:34.943947+0000","last_clean":"2023-12-07T21:09:34.943947+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:09:34.943947+0000","last_undegraded":"2023-12-07T21:09:34.943947+0000","last_fullsized":"2023-12-07T21:09:34.943947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:38:36.911470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.928507+0000","last_change":"2023-12-07T21:09:00.888461+0000","last_active":"2023-12-07T21:10:58.928507+0000","last_peered":"2023-12-07T21:10:58.928507+0000","last_clean":"2023-12-07T21:10:58.928507+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:10:58.928507+0000","last_undegraded":"2023-12-07T21:10:58.928507+0000","last_fullsized":"2023-12-07T21:10:58.928507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:25:31.340127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944508+0000","last_change":"2023-12-07T21:09:02.905583+0000","last_active":"2023-12-07T21:09:34.944508+0000","last_peered":"2023-12-07T21:09:34.944508+0000","last_clean":"2023-12-07T21:09:34.944508+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:09:34.944508+0000","last_undegraded":"2023-12-07T21:09:34.944508+0000","last_fullsized":"2023-12-07T21:09:34.944508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:59:50.067921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945302+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:09:34.945302+0000","last_peered":"2023-12-07T21:09:34.945302+0000","last_clean":"2023-12-07T21:09:34.945302+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:09:34.945302+0000","last_undegraded":"2023-12-07T21:09:34.945302+0000","last_fullsized":"2023-12-07T21:09:34.945302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:25:58.505646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.609344+0000","last_change":"2023-12-07T21:08:56.872455+0000","last_active":"2023-12-07T21:09:36.609344+0000","last_peered":"2023-12-07T21:09:36.609344+0000","last_clean":"2023-12-07T21:09:36.609344+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:09:36.609344+0000","last_undegraded":"2023-12-07T21:09:36.609344+0000","last_fullsized":"2023-12-07T21:09:36.609344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:23.887277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942558+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:09:35.942558+0000","last_peered":"2023-12-07T21:09:35.942558+0000","last_clean":"2023-12-07T21:09:35.942558+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:09:35.942558+0000","last_undegraded":"2023-12-07T21:09:35.942558+0000","last_fullsized":"2023-12-07T21:09:35.942558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:34.117128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946583+0000","last_change":"2023-12-07T21:08:54.880674+0000","last_active":"2023-12-07T21:09:35.946583+0000","last_peered":"2023-12-07T21:09:35.946583+0000","last_clean":"2023-12-07T21:09:35.946583+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:09:35.946583+0000","last_undegraded":"2023-12-07T21:09:35.946583+0000","last_fullsized":"2023-12-07T21:09:35.946583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943247+0000","last_change":"2023-12-07T21:08:58.881871+0000","last_active":"2023-12-07T21:09:35.943247+0000","last_peered":"2023-12-07T21:09:35.943247+0000","last_clean":"2023-12-07T21:09:35.943247+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:09:35.943247+0000","last_undegraded":"2023-12-07T21:09:35.943247+0000","last_fullsized":"2023-12-07T21:09:35.943247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:38.827449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943744+0000","last_change":"2023-12-07T21:09:00.892022+0000","last_active":"2023-12-07T21:09:35.943744+0000","last_peered":"2023-12-07T21:09:35.943744+0000","last_clean":"2023-12-07T21:09:35.943744+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:09:35.943744+0000","last_undegraded":"2023-12-07T21:09:35.943744+0000","last_fullsized":"2023-12-07T21:09:35.943744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:20:22.542933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948794+0000","last_change":"2023-12-07T21:09:02.907037+0000","last_active":"2023-12-07T21:09:34.948794+0000","last_peered":"2023-12-07T21:09:34.948794+0000","last_clean":"2023-12-07T21:09:34.948794+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:09:34.948794+0000","last_undegraded":"2023-12-07T21:09:34.948794+0000","last_fullsized":"2023-12-07T21:09:34.948794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:47:48.082744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937984+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:09:34.937984+0000","last_peered":"2023-12-07T21:09:34.937984+0000","last_clean":"2023-12-07T21:09:34.937984+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:09:34.937984+0000","last_undegraded":"2023-12-07T21:09:34.937984+0000","last_fullsized":"2023-12-07T21:09:34.937984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:02:06.112301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.950132+0000","last_change":"2023-12-07T21:08:56.882954+0000","last_active":"2023-12-07T21:09:35.950132+0000","last_peered":"2023-12-07T21:09:35.950132+0000","last_clean":"2023-12-07T21:09:35.950132+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:09:35.950132+0000","last_undegraded":"2023-12-07T21:09:35.950132+0000","last_fullsized":"2023-12-07T21:09:35.950132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:07:51.158690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.592742+0000","last_change":"2023-12-07T21:08:54.881143+0000","last_active":"2023-12-07T21:09:36.592742+0000","last_peered":"2023-12-07T21:09:36.592742+0000","last_clean":"2023-12-07T21:09:36.592742+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:09:36.592742+0000","last_undegraded":"2023-12-07T21:09:36.592742+0000","last_fullsized":"2023-12-07T21:09:36.592742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942847+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:09:35.942847+0000","last_peered":"2023-12-07T21:09:35.942847+0000","last_clean":"2023-12-07T21:09:35.942847+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:09:35.942847+0000","last_undegraded":"2023-12-07T21:09:35.942847+0000","last_fullsized":"2023-12-07T21:09:35.942847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:24.297087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943063+0000","last_change":"2023-12-07T21:08:58.881942+0000","last_active":"2023-12-07T21:09:35.943063+0000","last_peered":"2023-12-07T21:09:35.943063+0000","last_clean":"2023-12-07T21:09:35.943063+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:09:35.943063+0000","last_undegraded":"2023-12-07T21:09:35.943063+0000","last_fullsized":"2023-12-07T21:09:35.943063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:41:45.408620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'58","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.136121+0000","last_change":"2023-12-07T21:09:00.892917+0000","last_active":"2023-12-07T21:10:59.136121+0000","last_peered":"2023-12-07T21:10:59.136121+0000","last_clean":"2023-12-07T21:10:59.136121+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:10:59.136121+0000","last_undegraded":"2023-12-07T21:10:59.136121+0000","last_fullsized":"2023-12-07T21:10:59.136121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:08:10.091706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":64,"num_read_kb":67,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943132+0000","last_change":"2023-12-07T21:09:02.897497+0000","last_active":"2023-12-07T21:09:34.943132+0000","last_peered":"2023-12-07T21:09:34.943132+0000","last_clean":"2023-12-07T21:09:34.943132+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:09:34.943132+0000","last_undegraded":"2023-12-07T21:09:34.943132+0000","last_fullsized":"2023-12-07T21:09:34.943132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:21.622701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.727098+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:10:18.727098+0000","last_peered":"2023-12-07T21:10:18.727098+0000","last_clean":"2023-12-07T21:10:18.727098+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:10:18.727098+0000","last_undegraded":"2023-12-07T21:10:18.727098+0000","last_fullsized":"2023-12-07T21:10:18.727098+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:02:58.721630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948690+0000","last_change":"2023-12-07T21:08:56.878924+0000","last_active":"2023-12-07T21:09:35.948690+0000","last_peered":"2023-12-07T21:09:35.948690+0000","last_clean":"2023-12-07T21:09:35.948690+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:09:35.948690+0000","last_undegraded":"2023-12-07T21:09:35.948690+0000","last_fullsized":"2023-12-07T21:09:35.948690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:11:43.198377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.735075+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:10:18.735075+0000","last_peered":"2023-12-07T21:10:18.735075+0000","last_clean":"2023-12-07T21:10:18.735075+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:10:18.735075+0000","last_undegraded":"2023-12-07T21:10:18.735075+0000","last_fullsized":"2023-12-07T21:10:18.735075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:32.542770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946376+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:09:35.946376+0000","last_peered":"2023-12-07T21:09:35.946376+0000","last_clean":"2023-12-07T21:09:35.946376+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:09:35.946376+0000","last_undegraded":"2023-12-07T21:09:35.946376+0000","last_fullsized":"2023-12-07T21:09:35.946376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:30:53.269300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942447+0000","last_change":"2023-12-07T21:08:58.879797+0000","last_active":"2023-12-07T21:09:35.942447+0000","last_peered":"2023-12-07T21:09:35.942447+0000","last_clean":"2023-12-07T21:09:35.942447+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:09:35.942447+0000","last_undegraded":"2023-12-07T21:09:35.942447+0000","last_fullsized":"2023-12-07T21:09:35.942447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:57:59.211719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937819+0000","last_change":"2023-12-07T21:09:00.890696+0000","last_active":"2023-12-07T21:09:34.937819+0000","last_peered":"2023-12-07T21:09:34.937819+0000","last_clean":"2023-12-07T21:09:34.937819+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:09:34.937819+0000","last_undegraded":"2023-12-07T21:09:34.937819+0000","last_fullsized":"2023-12-07T21:09:34.937819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:57.571647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":288,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:00.233748+0000","last_change":"2023-12-07T21:09:02.900501+0000","last_active":"2023-12-07T21:11:00.233748+0000","last_peered":"2023-12-07T21:11:00.233748+0000","last_clean":"2023-12-07T21:11:00.233748+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:00.233748+0000","last_undegraded":"2023-12-07T21:11:00.233748+0000","last_fullsized":"2023-12-07T21:11:00.233748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:07.330523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948599+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:09:34.948599+0000","last_peered":"2023-12-07T21:09:34.948599+0000","last_clean":"2023-12-07T21:09:34.948599+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:09:34.948599+0000","last_undegraded":"2023-12-07T21:09:34.948599+0000","last_fullsized":"2023-12-07T21:09:34.948599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:41.901371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.027809+0000","last_change":"2023-12-07T21:08:56.887962+0000","last_active":"2023-12-07T21:09:37.027809+0000","last_peered":"2023-12-07T21:09:37.027809+0000","last_clean":"2023-12-07T21:09:37.027809+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:09:37.027809+0000","last_undegraded":"2023-12-07T21:09:37.027809+0000","last_fullsized":"2023-12-07T21:09:37.027809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:38.589260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.949138+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:09:34.949138+0000","last_peered":"2023-12-07T21:09:34.949138+0000","last_clean":"2023-12-07T21:09:34.949138+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:09:34.949138+0000","last_undegraded":"2023-12-07T21:09:34.949138+0000","last_fullsized":"2023-12-07T21:09:34.949138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:21.874874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943546+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:09:35.943546+0000","last_peered":"2023-12-07T21:09:35.943546+0000","last_clean":"2023-12-07T21:09:35.943546+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:09:35.943546+0000","last_undegraded":"2023-12-07T21:09:35.943546+0000","last_fullsized":"2023-12-07T21:09:35.943546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:02:32.429314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948547+0000","last_change":"2023-12-07T21:08:58.878642+0000","last_active":"2023-12-07T21:09:35.948547+0000","last_peered":"2023-12-07T21:09:35.948547+0000","last_clean":"2023-12-07T21:09:35.948547+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:09:35.948547+0000","last_undegraded":"2023-12-07T21:09:35.948547+0000","last_fullsized":"2023-12-07T21:09:35.948547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:03.307133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946636+0000","last_change":"2023-12-07T21:09:00.896503+0000","last_active":"2023-12-07T21:09:34.946636+0000","last_peered":"2023-12-07T21:09:34.946636+0000","last_clean":"2023-12-07T21:09:34.946636+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:09:34.946636+0000","last_undegraded":"2023-12-07T21:09:34.946636+0000","last_fullsized":"2023-12-07T21:09:34.946636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:54.681953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":355,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.973822+0000","last_change":"2023-12-07T21:09:02.897351+0000","last_active":"2023-12-07T21:10:59.973822+0000","last_peered":"2023-12-07T21:10:59.973822+0000","last_clean":"2023-12-07T21:10:59.973822+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:10:59.973822+0000","last_undegraded":"2023-12-07T21:10:59.973822+0000","last_fullsized":"2023-12-07T21:10:59.973822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:58:03.235109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938213+0000","last_change":"2023-12-07T21:09:04.929420+0000","last_active":"2023-12-07T21:09:34.938213+0000","last_peered":"2023-12-07T21:09:34.938213+0000","last_clean":"2023-12-07T21:09:34.938213+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:09:34.938213+0000","last_undegraded":"2023-12-07T21:09:34.938213+0000","last_fullsized":"2023-12-07T21:09:34.938213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:08.715985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173660+0000","last_change":"2023-12-07T21:08:56.874336+0000","last_active":"2023-12-07T21:10:59.173660+0000","last_peered":"2023-12-07T21:10:59.173660+0000","last_clean":"2023-12-07T21:10:59.173660+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:10:59.173660+0000","last_undegraded":"2023-12-07T21:10:59.173660+0000","last_fullsized":"2023-12-07T21:10:59.173660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:22.142967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939208+0000","last_change":"2023-12-07T21:08:54.888557+0000","last_active":"2023-12-07T21:09:34.939208+0000","last_peered":"2023-12-07T21:09:34.939208+0000","last_clean":"2023-12-07T21:09:34.939208+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:09:34.939208+0000","last_undegraded":"2023-12-07T21:09:34.939208+0000","last_fullsized":"2023-12-07T21:09:34.939208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944629+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:09:35.944629+0000","last_peered":"2023-12-07T21:09:35.944629+0000","last_clean":"2023-12-07T21:09:35.944629+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:09:35.944629+0000","last_undegraded":"2023-12-07T21:09:35.944629+0000","last_fullsized":"2023-12-07T21:09:35.944629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:13:59.600730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.953920+0000","last_change":"2023-12-07T21:09:35.953149+0000","last_active":"2023-12-07T21:09:35.953920+0000","last_peered":"2023-12-07T21:09:35.953920+0000","last_clean":"2023-12-07T21:09:35.953920+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:09:35.953920+0000","last_undegraded":"2023-12-07T21:09:35.953920+0000","last_fullsized":"2023-12-07T21:09:35.953920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:00:15.189655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'77","reported_seq":141,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.115830+0000","last_change":"2023-12-07T21:09:00.891723+0000","last_active":"2023-12-07T21:10:59.115830+0000","last_peered":"2023-12-07T21:10:59.115830+0000","last_clean":"2023-12-07T21:10:59.115830+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:10:59.115830+0000","last_undegraded":"2023-12-07T21:10:59.115830+0000","last_fullsized":"2023-12-07T21:10:59.115830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:57.364445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944006+0000","last_change":"2023-12-07T21:09:02.898050+0000","last_active":"2023-12-07T21:09:34.944006+0000","last_peered":"2023-12-07T21:09:34.944006+0000","last_clean":"2023-12-07T21:09:34.944006+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:09:34.944006+0000","last_undegraded":"2023-12-07T21:09:34.944006+0000","last_fullsized":"2023-12-07T21:09:34.944006+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:07.330523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943933+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:09:34.943933+0000","last_peered":"2023-12-07T21:09:34.943933+0000","last_clean":"2023-12-07T21:09:34.943933+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:09:34.943933+0000","last_undegraded":"2023-12-07T21:09:34.943933+0000","last_fullsized":"2023-12-07T21:09:34.943933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:45.830742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943689+0000","last_change":"2023-12-07T21:09:04.926451+0000","last_active":"2023-12-07T21:09:34.943689+0000","last_peered":"2023-12-07T21:09:34.943689+0000","last_clean":"2023-12-07T21:09:34.943689+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:09:34.943689+0000","last_undegraded":"2023-12-07T21:09:34.943689+0000","last_fullsized":"2023-12-07T21:09:34.943689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:00.049486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943172+0000","last_change":"2023-12-07T21:08:56.877160+0000","last_active":"2023-12-07T21:09:34.943172+0000","last_peered":"2023-12-07T21:09:34.943172+0000","last_clean":"2023-12-07T21:09:34.943172+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:09:34.943172+0000","last_undegraded":"2023-12-07T21:09:34.943172+0000","last_fullsized":"2023-12-07T21:09:34.943172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:20.598365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947455+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:09:34.947455+0000","last_peered":"2023-12-07T21:09:34.947455+0000","last_clean":"2023-12-07T21:09:34.947455+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:09:34.947455+0000","last_undegraded":"2023-12-07T21:09:34.947455+0000","last_fullsized":"2023-12-07T21:09:34.947455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:24.731856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938592+0000","last_change":"2023-12-07T21:08:58.876828+0000","last_active":"2023-12-07T21:09:34.938592+0000","last_peered":"2023-12-07T21:09:34.938592+0000","last_clean":"2023-12-07T21:09:34.938592+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:09:34.938592+0000","last_undegraded":"2023-12-07T21:09:34.938592+0000","last_fullsized":"2023-12-07T21:09:34.938592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:25:18.167316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.716368+0000","last_change":"2023-12-07T21:09:00.893775+0000","last_active":"2023-12-07T21:10:18.716368+0000","last_peered":"2023-12-07T21:10:18.716368+0000","last_clean":"2023-12-07T21:10:18.716368+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:10:18.716368+0000","last_undegraded":"2023-12-07T21:10:18.716368+0000","last_fullsized":"2023-12-07T21:10:18.716368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:36:18.746987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945519+0000","last_change":"2023-12-07T21:09:02.907875+0000","last_active":"2023-12-07T21:09:34.945519+0000","last_peered":"2023-12-07T21:09:34.945519+0000","last_clean":"2023-12-07T21:09:34.945519+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:09:34.945519+0000","last_undegraded":"2023-12-07T21:09:34.945519+0000","last_fullsized":"2023-12-07T21:09:34.945519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:44:51.015892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944425+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:09:34.944425+0000","last_peered":"2023-12-07T21:09:34.944425+0000","last_clean":"2023-12-07T21:09:34.944425+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:09:34.944425+0000","last_undegraded":"2023-12-07T21:09:34.944425+0000","last_fullsized":"2023-12-07T21:09:34.944425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:13:50.090324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937989+0000","last_change":"2023-12-07T21:08:56.879187+0000","last_active":"2023-12-07T21:09:34.937989+0000","last_peered":"2023-12-07T21:09:34.937989+0000","last_clean":"2023-12-07T21:09:34.937989+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:09:34.937989+0000","last_undegraded":"2023-12-07T21:09:34.937989+0000","last_fullsized":"2023-12-07T21:09:34.937989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943278+0000","last_change":"2023-12-07T21:08:54.880755+0000","last_active":"2023-12-07T21:09:34.943278+0000","last_peered":"2023-12-07T21:09:34.943278+0000","last_clean":"2023-12-07T21:09:34.943278+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:09:34.943278+0000","last_undegraded":"2023-12-07T21:09:34.943278+0000","last_fullsized":"2023-12-07T21:09:34.943278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947289+0000","last_change":"2023-12-07T21:08:58.882787+0000","last_active":"2023-12-07T21:09:34.947289+0000","last_peered":"2023-12-07T21:09:34.947289+0000","last_clean":"2023-12-07T21:09:34.947289+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:09:34.947289+0000","last_undegraded":"2023-12-07T21:09:34.947289+0000","last_fullsized":"2023-12-07T21:09:34.947289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:04:04.292611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:12.139450+0000","last_change":"2023-12-07T21:09:00.886499+0000","last_active":"2023-12-07T21:10:12.139450+0000","last_peered":"2023-12-07T21:10:12.139450+0000","last_clean":"2023-12-07T21:10:12.139450+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:10:12.139450+0000","last_undegraded":"2023-12-07T21:10:12.139450+0000","last_fullsized":"2023-12-07T21:10:12.139450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:11.283059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942852+0000","last_change":"2023-12-07T21:09:02.906677+0000","last_active":"2023-12-07T21:09:34.942852+0000","last_peered":"2023-12-07T21:09:34.942852+0000","last_clean":"2023-12-07T21:09:34.942852+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:09:34.942852+0000","last_undegraded":"2023-12-07T21:09:34.942852+0000","last_fullsized":"2023-12-07T21:09:34.942852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:00.642632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944148+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:09:34.944148+0000","last_peered":"2023-12-07T21:09:34.944148+0000","last_clean":"2023-12-07T21:09:34.944148+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:09:34.944148+0000","last_undegraded":"2023-12-07T21:09:34.944148+0000","last_fullsized":"2023-12-07T21:09:34.944148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:03.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149349+0000","last_change":"2023-12-07T21:08:56.874712+0000","last_active":"2023-12-07T21:10:59.149349+0000","last_peered":"2023-12-07T21:10:59.149349+0000","last_clean":"2023-12-07T21:10:59.149349+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:10:59.149349+0000","last_undegraded":"2023-12-07T21:10:59.149349+0000","last_fullsized":"2023-12-07T21:10:59.149349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:20.598365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945370+0000","last_change":"2023-12-07T21:08:54.885182+0000","last_active":"2023-12-07T21:09:34.945370+0000","last_peered":"2023-12-07T21:09:34.945370+0000","last_clean":"2023-12-07T21:09:34.945370+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:09:34.945370+0000","last_undegraded":"2023-12-07T21:09:34.945370+0000","last_fullsized":"2023-12-07T21:09:34.945370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:26.381861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942456+0000","last_change":"2023-12-07T21:08:58.873698+0000","last_active":"2023-12-07T21:09:34.942456+0000","last_peered":"2023-12-07T21:09:34.942456+0000","last_clean":"2023-12-07T21:09:34.942456+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:09:34.942456+0000","last_undegraded":"2023-12-07T21:09:34.942456+0000","last_fullsized":"2023-12-07T21:09:34.942456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:28:17.747275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'34","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.965525+0000","last_change":"2023-12-07T21:09:00.892175+0000","last_active":"2023-12-07T21:10:58.965525+0000","last_peered":"2023-12-07T21:10:58.965525+0000","last_clean":"2023-12-07T21:10:58.965525+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:10:58.965525+0000","last_undegraded":"2023-12-07T21:10:58.965525+0000","last_fullsized":"2023-12-07T21:10:58.965525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:29.403881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937776+0000","last_change":"2023-12-07T21:09:02.900618+0000","last_active":"2023-12-07T21:09:34.937776+0000","last_peered":"2023-12-07T21:09:34.937776+0000","last_clean":"2023-12-07T21:09:34.937776+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:09:34.937776+0000","last_undegraded":"2023-12-07T21:09:34.937776+0000","last_fullsized":"2023-12-07T21:09:34.937776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:00.871254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948117+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:09:34.948117+0000","last_peered":"2023-12-07T21:09:34.948117+0000","last_clean":"2023-12-07T21:09:34.948117+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:09:34.948117+0000","last_undegraded":"2023-12-07T21:09:34.948117+0000","last_fullsized":"2023-12-07T21:09:34.948117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:37:58.338488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944992+0000","last_change":"2023-12-07T21:08:56.887184+0000","last_active":"2023-12-07T21:09:34.944992+0000","last_peered":"2023-12-07T21:09:34.944992+0000","last_clean":"2023-12-07T21:09:34.944992+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:09:34.944992+0000","last_undegraded":"2023-12-07T21:09:34.944992+0000","last_fullsized":"2023-12-07T21:09:34.944992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:07.266252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939265+0000","last_change":"2023-12-07T21:08:54.878542+0000","last_active":"2023-12-07T21:09:34.939265+0000","last_peered":"2023-12-07T21:09:34.939265+0000","last_clean":"2023-12-07T21:09:34.939265+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:09:34.939265+0000","last_undegraded":"2023-12-07T21:09:34.939265+0000","last_fullsized":"2023-12-07T21:09:34.939265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944756+0000","last_change":"2023-12-07T21:08:58.878455+0000","last_active":"2023-12-07T21:09:34.944756+0000","last_peered":"2023-12-07T21:09:34.944756+0000","last_clean":"2023-12-07T21:09:34.944756+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:09:34.944756+0000","last_undegraded":"2023-12-07T21:09:34.944756+0000","last_fullsized":"2023-12-07T21:09:34.944756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:39.792516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.700847+0000","last_change":"2023-12-07T21:09:00.885534+0000","last_active":"2023-12-07T21:10:18.700847+0000","last_peered":"2023-12-07T21:10:18.700847+0000","last_clean":"2023-12-07T21:10:18.700847+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:10:18.700847+0000","last_undegraded":"2023-12-07T21:10:18.700847+0000","last_fullsized":"2023-12-07T21:10:18.700847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:07.128867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942727+0000","last_change":"2023-12-07T21:09:02.899870+0000","last_active":"2023-12-07T21:09:34.942727+0000","last_peered":"2023-12-07T21:09:34.942727+0000","last_clean":"2023-12-07T21:09:34.942727+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:09:34.942727+0000","last_undegraded":"2023-12-07T21:09:34.942727+0000","last_fullsized":"2023-12-07T21:09:34.942727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:59.584704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946337+0000","last_change":"2023-12-07T21:08:56.873185+0000","last_active":"2023-12-07T21:09:35.946337+0000","last_peered":"2023-12-07T21:09:35.946337+0000","last_clean":"2023-12-07T21:09:35.946337+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:09:35.946337+0000","last_undegraded":"2023-12-07T21:09:35.946337+0000","last_fullsized":"2023-12-07T21:09:35.946337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:03:50.236571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944921+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:09:34.944921+0000","last_peered":"2023-12-07T21:09:34.944921+0000","last_clean":"2023-12-07T21:09:34.944921+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:09:34.944921+0000","last_undegraded":"2023-12-07T21:09:34.944921+0000","last_fullsized":"2023-12-07T21:09:34.944921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:44:52.381066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944424+0000","last_change":"2023-12-07T21:08:58.879555+0000","last_active":"2023-12-07T21:09:35.944424+0000","last_peered":"2023-12-07T21:09:35.944424+0000","last_clean":"2023-12-07T21:09:35.944424+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:09:35.944424+0000","last_undegraded":"2023-12-07T21:09:35.944424+0000","last_fullsized":"2023-12-07T21:09:35.944424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:05.118535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'50","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.112986+0000","last_change":"2023-12-07T21:09:00.886089+0000","last_active":"2023-12-07T21:10:59.112986+0000","last_peered":"2023-12-07T21:10:59.112986+0000","last_clean":"2023-12-07T21:10:59.112986+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:10:59.112986+0000","last_undegraded":"2023-12-07T21:10:59.112986+0000","last_fullsized":"2023-12-07T21:10:59.112986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:58.629575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942969+0000","last_change":"2023-12-07T21:09:02.900412+0000","last_active":"2023-12-07T21:09:34.942969+0000","last_peered":"2023-12-07T21:09:34.942969+0000","last_clean":"2023-12-07T21:09:34.942969+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:09:34.942969+0000","last_undegraded":"2023-12-07T21:09:34.942969+0000","last_fullsized":"2023-12-07T21:09:34.942969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:16:17.076025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.282119+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:10:18.282119+0000","last_peered":"2023-12-07T21:10:18.282119+0000","last_clean":"2023-12-07T21:10:18.282119+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:10:18.282119+0000","last_undegraded":"2023-12-07T21:10:18.282119+0000","last_fullsized":"2023-12-07T21:10:18.282119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:03.815279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149298+0000","last_change":"2023-12-07T21:08:56.877115+0000","last_active":"2023-12-07T21:10:59.149298+0000","last_peered":"2023-12-07T21:10:59.149298+0000","last_clean":"2023-12-07T21:10:59.149298+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:10:59.149298+0000","last_undegraded":"2023-12-07T21:10:59.149298+0000","last_fullsized":"2023-12-07T21:10:59.149298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:47.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937462+0000","last_change":"2023-12-07T21:08:54.882363+0000","last_active":"2023-12-07T21:09:34.937462+0000","last_peered":"2023-12-07T21:09:34.937462+0000","last_clean":"2023-12-07T21:09:34.937462+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:09:34.937462+0000","last_undegraded":"2023-12-07T21:09:34.937462+0000","last_fullsized":"2023-12-07T21:09:34.937462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:47:51.435614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.954233+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:09:35.954233+0000","last_peered":"2023-12-07T21:09:35.954233+0000","last_clean":"2023-12-07T21:09:35.954233+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:09:35.954233+0000","last_undegraded":"2023-12-07T21:09:35.954233+0000","last_fullsized":"2023-12-07T21:09:35.954233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:01:20.045494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.701913+0000","last_change":"2023-12-07T21:09:00.887309+0000","last_active":"2023-12-07T21:10:18.701913+0000","last_peered":"2023-12-07T21:10:18.701913+0000","last_clean":"2023-12-07T21:10:18.701913+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:10:18.701913+0000","last_undegraded":"2023-12-07T21:10:18.701913+0000","last_fullsized":"2023-12-07T21:10:18.701913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:31:21.189550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938397+0000","last_change":"2023-12-07T21:09:02.907306+0000","last_active":"2023-12-07T21:09:34.938397+0000","last_peered":"2023-12-07T21:09:34.938397+0000","last_clean":"2023-12-07T21:09:34.938397+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:09:34.938397+0000","last_undegraded":"2023-12-07T21:09:34.938397+0000","last_fullsized":"2023-12-07T21:09:34.938397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:58:03.235109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944816+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:09:34.944816+0000","last_peered":"2023-12-07T21:09:34.944816+0000","last_clean":"2023-12-07T21:09:34.944816+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:09:34.944816+0000","last_undegraded":"2023-12-07T21:09:34.944816+0000","last_fullsized":"2023-12-07T21:09:34.944816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:45:57.610751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.028328+0000","last_change":"2023-12-07T21:08:56.885223+0000","last_active":"2023-12-07T21:09:37.028328+0000","last_peered":"2023-12-07T21:09:37.028328+0000","last_clean":"2023-12-07T21:09:37.028328+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:09:37.028328+0000","last_undegraded":"2023-12-07T21:09:37.028328+0000","last_fullsized":"2023-12-07T21:09:37.028328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:16:11.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937906+0000","last_change":"2023-12-07T21:08:54.887587+0000","last_active":"2023-12-07T21:09:34.937906+0000","last_peered":"2023-12-07T21:09:34.937906+0000","last_clean":"2023-12-07T21:09:34.937906+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:09:34.937906+0000","last_undegraded":"2023-12-07T21:09:34.937906+0000","last_fullsized":"2023-12-07T21:09:34.937906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943211+0000","last_change":"2023-12-07T21:08:58.876479+0000","last_active":"2023-12-07T21:09:34.943211+0000","last_peered":"2023-12-07T21:09:34.943211+0000","last_clean":"2023-12-07T21:09:34.943211+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:09:34.943211+0000","last_undegraded":"2023-12-07T21:09:34.943211+0000","last_fullsized":"2023-12-07T21:09:34.943211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:37.048767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'31","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.720307+0000","last_change":"2023-12-07T21:09:00.890134+0000","last_active":"2023-12-07T21:10:18.720307+0000","last_peered":"2023-12-07T21:10:18.720307+0000","last_clean":"2023-12-07T21:10:18.720307+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:10:18.720307+0000","last_undegraded":"2023-12-07T21:10:18.720307+0000","last_fullsized":"2023-12-07T21:10:18.720307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:19.609643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943191+0000","last_change":"2023-12-07T21:09:02.901229+0000","last_active":"2023-12-07T21:09:35.943191+0000","last_peered":"2023-12-07T21:09:35.943191+0000","last_clean":"2023-12-07T21:09:35.943191+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:09:35.943191+0000","last_undegraded":"2023-12-07T21:09:35.943191+0000","last_fullsized":"2023-12-07T21:09:35.943191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:35.272324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.728070+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:10:18.728070+0000","last_peered":"2023-12-07T21:10:18.728070+0000","last_clean":"2023-12-07T21:10:18.728070+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:10:18.728070+0000","last_undegraded":"2023-12-07T21:10:18.728070+0000","last_fullsized":"2023-12-07T21:10:18.728070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:13:44.983457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149269+0000","last_change":"2023-12-07T21:08:56.872465+0000","last_active":"2023-12-07T21:10:59.149269+0000","last_peered":"2023-12-07T21:10:59.149269+0000","last_clean":"2023-12-07T21:10:59.149269+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:10:59.149269+0000","last_undegraded":"2023-12-07T21:10:59.149269+0000","last_fullsized":"2023-12-07T21:10:59.149269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:46.057644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945674+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:09:34.945674+0000","last_peered":"2023-12-07T21:09:34.945674+0000","last_clean":"2023-12-07T21:09:34.945674+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:09:34.945674+0000","last_undegraded":"2023-12-07T21:09:34.945674+0000","last_fullsized":"2023-12-07T21:09:34.945674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:27.280985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.940467+0000","last_change":"2023-12-07T21:08:58.875630+0000","last_active":"2023-12-07T21:09:34.940467+0000","last_peered":"2023-12-07T21:09:34.940467+0000","last_clean":"2023-12-07T21:09:34.940467+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:09:34.940467+0000","last_undegraded":"2023-12-07T21:09:34.940467+0000","last_fullsized":"2023-12-07T21:09:34.940467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:16.106436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944106+0000","last_change":"2023-12-07T21:09:00.896323+0000","last_active":"2023-12-07T21:09:35.944106+0000","last_peered":"2023-12-07T21:09:35.944106+0000","last_clean":"2023-12-07T21:09:35.944106+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:09:35.944106+0000","last_undegraded":"2023-12-07T21:09:35.944106+0000","last_fullsized":"2023-12-07T21:09:35.944106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:28:31.952243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":311,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.968298+0000","last_change":"2023-12-07T21:09:02.908092+0000","last_active":"2023-12-07T21:10:59.968298+0000","last_peered":"2023-12-07T21:10:59.968298+0000","last_clean":"2023-12-07T21:10:59.968298+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:10:59.968298+0000","last_undegraded":"2023-12-07T21:10:59.968298+0000","last_fullsized":"2023-12-07T21:10:59.968298+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:04:20.531570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944255+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:09:34.944255+0000","last_peered":"2023-12-07T21:09:34.944255+0000","last_clean":"2023-12-07T21:09:34.944255+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:09:34.944255+0000","last_undegraded":"2023-12-07T21:09:34.944255+0000","last_fullsized":"2023-12-07T21:09:34.944255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:14:35.831401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943322+0000","last_change":"2023-12-07T21:08:56.871124+0000","last_active":"2023-12-07T21:09:34.943322+0000","last_peered":"2023-12-07T21:09:34.943322+0000","last_clean":"2023-12-07T21:09:34.943322+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:09:34.943322+0000","last_undegraded":"2023-12-07T21:09:34.943322+0000","last_fullsized":"2023-12-07T21:09:34.943322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:26.744258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939061+0000","last_change":"2023-12-07T21:08:54.876774+0000","last_active":"2023-12-07T21:09:34.939061+0000","last_peered":"2023-12-07T21:09:34.939061+0000","last_clean":"2023-12-07T21:09:34.939061+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:09:34.939061+0000","last_undegraded":"2023-12-07T21:09:34.939061+0000","last_fullsized":"2023-12-07T21:09:34.939061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938263+0000","last_change":"2023-12-07T21:08:58.876085+0000","last_active":"2023-12-07T21:09:34.938263+0000","last_peered":"2023-12-07T21:09:34.938263+0000","last_clean":"2023-12-07T21:09:34.938263+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:09:34.938263+0000","last_undegraded":"2023-12-07T21:09:34.938263+0000","last_fullsized":"2023-12-07T21:09:34.938263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:40.595735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.692578+0000","last_change":"2023-12-07T21:09:00.892353+0000","last_active":"2023-12-07T21:10:18.692578+0000","last_peered":"2023-12-07T21:10:18.692578+0000","last_clean":"2023-12-07T21:10:18.692578+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:10:18.692578+0000","last_undegraded":"2023-12-07T21:10:18.692578+0000","last_fullsized":"2023-12-07T21:10:18.692578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:39.408633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943238+0000","last_change":"2023-12-07T21:09:02.906845+0000","last_active":"2023-12-07T21:09:34.943238+0000","last_peered":"2023-12-07T21:09:34.943238+0000","last_clean":"2023-12-07T21:09:34.943238+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:09:34.943238+0000","last_undegraded":"2023-12-07T21:09:34.943238+0000","last_fullsized":"2023-12-07T21:09:34.943238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:15:13.485261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939444+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:09:34.939444+0000","last_peered":"2023-12-07T21:09:34.939444+0000","last_clean":"2023-12-07T21:09:34.939444+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:09:34.939444+0000","last_undegraded":"2023-12-07T21:09:34.939444+0000","last_fullsized":"2023-12-07T21:09:34.939444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:13:50.090324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942745+0000","last_change":"2023-12-07T21:08:56.870984+0000","last_active":"2023-12-07T21:09:34.942745+0000","last_peered":"2023-12-07T21:09:34.942745+0000","last_clean":"2023-12-07T21:09:34.942745+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:09:34.942745+0000","last_undegraded":"2023-12-07T21:09:34.942745+0000","last_fullsized":"2023-12-07T21:09:34.942745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:19.739101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948342+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:09:34.948342+0000","last_peered":"2023-12-07T21:09:34.948342+0000","last_clean":"2023-12-07T21:09:34.948342+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:09:34.948342+0000","last_undegraded":"2023-12-07T21:09:34.948342+0000","last_fullsized":"2023-12-07T21:09:34.948342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:17.726699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943410+0000","last_change":"2023-12-07T21:08:58.881984+0000","last_active":"2023-12-07T21:09:34.943410+0000","last_peered":"2023-12-07T21:09:34.943410+0000","last_clean":"2023-12-07T21:09:34.943410+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:09:34.943410+0000","last_undegraded":"2023-12-07T21:09:34.943410+0000","last_fullsized":"2023-12-07T21:09:34.943410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:53.311660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.693633+0000","last_change":"2023-12-07T21:09:00.894601+0000","last_active":"2023-12-07T21:10:18.693633+0000","last_peered":"2023-12-07T21:10:18.693633+0000","last_clean":"2023-12-07T21:10:18.693633+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:10:18.693633+0000","last_undegraded":"2023-12-07T21:10:18.693633+0000","last_fullsized":"2023-12-07T21:10:18.693633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:18.116768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944508+0000","last_change":"2023-12-07T21:09:02.907688+0000","last_active":"2023-12-07T21:09:34.944508+0000","last_peered":"2023-12-07T21:09:34.944508+0000","last_clean":"2023-12-07T21:09:34.944508+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:09:34.944508+0000","last_undegraded":"2023-12-07T21:09:34.944508+0000","last_fullsized":"2023-12-07T21:09:34.944508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:45.243063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.096317+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:10:13.096317+0000","last_peered":"2023-12-07T21:10:13.096317+0000","last_clean":"2023-12-07T21:10:13.096317+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:10:13.096317+0000","last_undegraded":"2023-12-07T21:10:13.096317+0000","last_fullsized":"2023-12-07T21:10:13.096317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:30:05.746781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.608964+0000","last_change":"2023-12-07T21:08:56.873059+0000","last_active":"2023-12-07T21:09:36.608964+0000","last_peered":"2023-12-07T21:09:36.608964+0000","last_clean":"2023-12-07T21:09:36.608964+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:09:36.608964+0000","last_undegraded":"2023-12-07T21:09:36.608964+0000","last_fullsized":"2023-12-07T21:09:36.608964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:17:57.351679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.429429+0000","last_change":"2023-12-07T21:08:54.890887+0000","last_active":"2023-12-07T21:10:18.429429+0000","last_peered":"2023-12-07T21:10:18.429429+0000","last_clean":"2023-12-07T21:10:18.429429+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:10:18.429429+0000","last_undegraded":"2023-12-07T21:10:18.429429+0000","last_fullsized":"2023-12-07T21:10:18.429429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:13.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938058+0000","last_change":"2023-12-07T21:08:58.878440+0000","last_active":"2023-12-07T21:09:34.938058+0000","last_peered":"2023-12-07T21:09:34.938058+0000","last_clean":"2023-12-07T21:09:34.938058+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:09:34.938058+0000","last_undegraded":"2023-12-07T21:09:34.938058+0000","last_fullsized":"2023-12-07T21:09:34.938058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:17:59.358154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'24","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.718296+0000","last_change":"2023-12-07T21:09:00.889913+0000","last_active":"2023-12-07T21:10:18.718296+0000","last_peered":"2023-12-07T21:10:18.718296+0000","last_clean":"2023-12-07T21:10:18.718296+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:10:18.718296+0000","last_undegraded":"2023-12-07T21:10:18.718296+0000","last_fullsized":"2023-12-07T21:10:18.718296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:30.350522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945073+0000","last_change":"2023-12-07T21:09:02.906202+0000","last_active":"2023-12-07T21:09:34.945073+0000","last_peered":"2023-12-07T21:09:34.945073+0000","last_clean":"2023-12-07T21:09:34.945073+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:09:34.945073+0000","last_undegraded":"2023-12-07T21:09:34.945073+0000","last_fullsized":"2023-12-07T21:09:34.945073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:43.263341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.139472+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:10:59.139472+0000","last_peered":"2023-12-07T21:10:59.139472+0000","last_clean":"2023-12-07T21:10:59.139472+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:10:59.139472+0000","last_undegraded":"2023-12-07T21:10:59.139472+0000","last_fullsized":"2023-12-07T21:10:59.139472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:54:20.029030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'13","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737703+0000","last_change":"2023-12-07T21:08:56.869733+0000","last_active":"2023-12-07T21:10:18.737703+0000","last_peered":"2023-12-07T21:10:18.737703+0000","last_clean":"2023-12-07T21:10:18.737703+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:10:18.737703+0000","last_undegraded":"2023-12-07T21:10:18.737703+0000","last_fullsized":"2023-12-07T21:10:18.737703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:52.850966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.951401+0000","last_change":"2023-12-07T21:08:54.878825+0000","last_active":"2023-12-07T21:09:35.951401+0000","last_peered":"2023-12-07T21:09:35.951401+0000","last_clean":"2023-12-07T21:09:35.951401+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:09:35.951401+0000","last_undegraded":"2023-12-07T21:09:35.951401+0000","last_fullsized":"2023-12-07T21:09:35.951401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'6","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.755566+0000","last_change":"2023-12-07T21:08:58.877654+0000","last_active":"2023-12-07T21:10:59.755566+0000","last_peered":"2023-12-07T21:10:59.755566+0000","last_clean":"2023-12-07T21:10:59.755566+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:10:59.755566+0000","last_undegraded":"2023-12-07T21:10:59.755566+0000","last_fullsized":"2023-12-07T21:10:59.755566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:46:29.005775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:36.028017+0000","last_change":"2023-12-07T21:09:00.887872+0000","last_active":"2023-12-07T21:10:36.028017+0000","last_peered":"2023-12-07T21:10:36.028017+0000","last_clean":"2023-12-07T21:10:36.028017+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:10:36.028017+0000","last_undegraded":"2023-12-07T21:10:36.028017+0000","last_fullsized":"2023-12-07T21:10:36.028017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:24:17.551615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943699+0000","last_change":"2023-12-07T21:09:02.906870+0000","last_active":"2023-12-07T21:09:34.943699+0000","last_peered":"2023-12-07T21:09:34.943699+0000","last_clean":"2023-12-07T21:09:34.943699+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:09:34.943699+0000","last_undegraded":"2023-12-07T21:09:34.943699+0000","last_fullsized":"2023-12-07T21:09:34.943699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:58.034650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947166+0000","last_change":"2023-12-07T21:09:04.928655+0000","last_active":"2023-12-07T21:09:34.947166+0000","last_peered":"2023-12-07T21:09:34.947166+0000","last_clean":"2023-12-07T21:09:34.947166+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:09:34.947166+0000","last_undegraded":"2023-12-07T21:09:34.947166+0000","last_fullsized":"2023-12-07T21:09:34.947166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:38.068718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737343+0000","last_change":"2023-12-07T21:08:56.884246+0000","last_active":"2023-12-07T21:10:18.737343+0000","last_peered":"2023-12-07T21:10:18.737343+0000","last_clean":"2023-12-07T21:10:18.737343+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:10:18.737343+0000","last_undegraded":"2023-12-07T21:10:18.737343+0000","last_fullsized":"2023-12-07T21:10:18.737343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:59:20.004743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941027+0000","last_change":"2023-12-07T21:08:54.888408+0000","last_active":"2023-12-07T21:09:35.941027+0000","last_peered":"2023-12-07T21:09:35.941027+0000","last_clean":"2023-12-07T21:09:35.941027+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:09:35.941027+0000","last_undegraded":"2023-12-07T21:09:35.941027+0000","last_fullsized":"2023-12-07T21:09:35.941027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:47:51.435614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.366183+0000","last_change":"2023-12-07T21:08:56.873286+0000","last_active":"2023-12-07T21:09:36.366183+0000","last_peered":"2023-12-07T21:09:36.366183+0000","last_clean":"2023-12-07T21:09:36.366183+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:09:36.366183+0000","last_undegraded":"2023-12-07T21:09:36.366183+0000","last_fullsized":"2023-12-07T21:09:36.366183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:46.957293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941789+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:09:35.941789+0000","last_peered":"2023-12-07T21:09:35.941789+0000","last_clean":"2023-12-07T21:09:35.941789+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:09:35.941789+0000","last_undegraded":"2023-12-07T21:09:35.941789+0000","last_fullsized":"2023-12-07T21:09:35.941789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149073+0000","last_change":"2023-12-07T21:08:56.874905+0000","last_active":"2023-12-07T21:10:59.149073+0000","last_peered":"2023-12-07T21:10:59.149073+0000","last_clean":"2023-12-07T21:10:59.149073+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:10:59.149073+0000","last_undegraded":"2023-12-07T21:10:59.149073+0000","last_fullsized":"2023-12-07T21:10:59.149073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:54.612768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942708+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:09:35.942708+0000","last_peered":"2023-12-07T21:09:35.942708+0000","last_clean":"2023-12-07T21:09:35.942708+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:09:35.942708+0000","last_undegraded":"2023-12-07T21:09:35.942708+0000","last_fullsized":"2023-12-07T21:09:35.942708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:08:13.065644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944625+0000","last_change":"2023-12-07T21:08:56.872273+0000","last_active":"2023-12-07T21:09:34.944625+0000","last_peered":"2023-12-07T21:09:34.944625+0000","last_clean":"2023-12-07T21:09:34.944625+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:09:34.944625+0000","last_undegraded":"2023-12-07T21:09:34.944625+0000","last_fullsized":"2023-12-07T21:09:34.944625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:50.983783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942688+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:09:35.942688+0000","last_peered":"2023-12-07T21:09:35.942688+0000","last_clean":"2023-12-07T21:09:35.942688+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:09:35.942688+0000","last_undegraded":"2023-12-07T21:09:35.942688+0000","last_fullsized":"2023-12-07T21:09:35.942688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942566+0000","last_change":"2023-12-07T21:08:56.876070+0000","last_active":"2023-12-07T21:09:35.942566+0000","last_peered":"2023-12-07T21:09:35.942566+0000","last_clean":"2023-12-07T21:09:35.942566+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:09:35.942566+0000","last_undegraded":"2023-12-07T21:09:35.942566+0000","last_fullsized":"2023-12-07T21:09:35.942566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:19.739101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944830+0000","last_change":"2023-12-07T21:08:54.874578+0000","last_active":"2023-12-07T21:09:34.944830+0000","last_peered":"2023-12-07T21:09:34.944830+0000","last_clean":"2023-12-07T21:09:34.944830+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:09:34.944830+0000","last_undegraded":"2023-12-07T21:09:34.944830+0000","last_fullsized":"2023-12-07T21:09:34.944830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.366353+0000","last_change":"2023-12-07T21:08:56.883348+0000","last_active":"2023-12-07T21:09:36.366353+0000","last_peered":"2023-12-07T21:09:36.366353+0000","last_clean":"2023-12-07T21:09:36.366353+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:09:36.366353+0000","last_undegraded":"2023-12-07T21:09:36.366353+0000","last_fullsized":"2023-12-07T21:09:36.366353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:38:34.904995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938504+0000","last_change":"2023-12-07T21:08:54.887259+0000","last_active":"2023-12-07T21:09:34.938504+0000","last_peered":"2023-12-07T21:09:34.938504+0000","last_clean":"2023-12-07T21:09:34.938504+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:09:34.938504+0000","last_undegraded":"2023-12-07T21:09:34.938504+0000","last_fullsized":"2023-12-07T21:09:34.938504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942527+0000","last_change":"2023-12-07T21:08:56.876299+0000","last_active":"2023-12-07T21:09:35.942527+0000","last_peered":"2023-12-07T21:09:35.942527+0000","last_clean":"2023-12-07T21:09:35.942527+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:09:35.942527+0000","last_undegraded":"2023-12-07T21:09:35.942527+0000","last_fullsized":"2023-12-07T21:09:35.942527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:26.744258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945448+0000","last_change":"2023-12-07T21:08:54.885457+0000","last_active":"2023-12-07T21:09:34.945448+0000","last_peered":"2023-12-07T21:09:34.945448+0000","last_clean":"2023-12-07T21:09:34.945448+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:09:34.945448+0000","last_undegraded":"2023-12-07T21:09:34.945448+0000","last_fullsized":"2023-12-07T21:09:34.945448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.949262+0000","last_change":"2023-12-07T21:08:56.887101+0000","last_active":"2023-12-07T21:09:35.949262+0000","last_peered":"2023-12-07T21:09:35.949262+0000","last_clean":"2023-12-07T21:09:35.949262+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:09:35.949262+0000","last_undegraded":"2023-12-07T21:09:35.949262+0000","last_fullsized":"2023-12-07T21:09:35.949262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944921+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:09:34.944921+0000","last_peered":"2023-12-07T21:09:34.944921+0000","last_clean":"2023-12-07T21:09:34.944921+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:09:34.944921+0000","last_undegraded":"2023-12-07T21:09:34.944921+0000","last_fullsized":"2023-12-07T21:09:34.944921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:59.087021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939689+0000","last_change":"2023-12-07T21:08:56.882240+0000","last_active":"2023-12-07T21:09:34.939689+0000","last_peered":"2023-12-07T21:09:34.939689+0000","last_clean":"2023-12-07T21:09:34.939689+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:09:34.939689+0000","last_undegraded":"2023-12-07T21:09:34.939689+0000","last_fullsized":"2023-12-07T21:09:34.939689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:06:24.998742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945083+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:09:34.945083+0000","last_peered":"2023-12-07T21:09:34.945083+0000","last_clean":"2023-12-07T21:09:34.945083+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:09:34.945083+0000","last_undegraded":"2023-12-07T21:09:34.945083+0000","last_fullsized":"2023-12-07T21:09:34.945083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:45.038325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173489+0000","last_change":"2023-12-07T21:08:56.875906+0000","last_active":"2023-12-07T21:10:18.173489+0000","last_peered":"2023-12-07T21:10:18.173489+0000","last_clean":"2023-12-07T21:10:18.173489+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:10:18.173489+0000","last_undegraded":"2023-12-07T21:10:18.173489+0000","last_fullsized":"2023-12-07T21:10:18.173489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:40:40.318522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.582974+0000","last_change":"2023-12-07T21:08:54.883629+0000","last_active":"2023-12-07T21:09:36.582974+0000","last_peered":"2023-12-07T21:09:36.582974+0000","last_clean":"2023-12-07T21:09:36.582974+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:09:36.582974+0000","last_undegraded":"2023-12-07T21:09:36.582974+0000","last_fullsized":"2023-12-07T21:09:36.582974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945789+0000","last_change":"2023-12-07T21:08:56.876309+0000","last_active":"2023-12-07T21:09:34.945789+0000","last_peered":"2023-12-07T21:09:34.945789+0000","last_clean":"2023-12-07T21:09:34.945789+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:09:34.945789+0000","last_undegraded":"2023-12-07T21:09:34.945789+0000","last_fullsized":"2023-12-07T21:09:34.945789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938005+0000","last_change":"2023-12-07T21:08:54.887130+0000","last_active":"2023-12-07T21:09:34.938005+0000","last_peered":"2023-12-07T21:09:34.938005+0000","last_clean":"2023-12-07T21:09:34.938005+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:09:34.938005+0000","last_undegraded":"2023-12-07T21:09:34.938005+0000","last_fullsized":"2023-12-07T21:09:34.938005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:18.078984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.359942+0000","last_change":"2023-12-07T21:08:56.871205+0000","last_active":"2023-12-07T21:09:36.359942+0000","last_peered":"2023-12-07T21:09:36.359942+0000","last_clean":"2023-12-07T21:09:36.359942+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:09:36.359942+0000","last_undegraded":"2023-12-07T21:09:36.359942+0000","last_fullsized":"2023-12-07T21:09:36.359942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:28:15.740800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938315+0000","last_change":"2023-12-07T21:08:54.884013+0000","last_active":"2023-12-07T21:09:34.938315+0000","last_peered":"2023-12-07T21:09:34.938315+0000","last_clean":"2023-12-07T21:09:34.938315+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:09:34.938315+0000","last_undegraded":"2023-12-07T21:09:34.938315+0000","last_fullsized":"2023-12-07T21:09:34.938315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.021932+0000","last_change":"2023-12-07T21:08:56.879513+0000","last_active":"2023-12-07T21:09:37.021932+0000","last_peered":"2023-12-07T21:09:37.021932+0000","last_clean":"2023-12-07T21:09:37.021932+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:09:37.021932+0000","last_undegraded":"2023-12-07T21:09:37.021932+0000","last_fullsized":"2023-12-07T21:09:37.021932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:46.957293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947567+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:09:34.947567+0000","last_peered":"2023-12-07T21:09:34.947567+0000","last_clean":"2023-12-07T21:09:34.947567+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:09:34.947567+0000","last_undegraded":"2023-12-07T21:09:34.947567+0000","last_fullsized":"2023-12-07T21:09:34.947567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:20.130565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'15","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173409+0000","last_change":"2023-12-07T21:08:56.882760+0000","last_active":"2023-12-07T21:10:18.173409+0000","last_peered":"2023-12-07T21:10:18.173409+0000","last_clean":"2023-12-07T21:10:18.173409+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:10:18.173409+0000","last_undegraded":"2023-12-07T21:10:18.173409+0000","last_fullsized":"2023-12-07T21:10:18.173409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:19:53.055254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948503+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:09:34.948503+0000","last_peered":"2023-12-07T21:09:34.948503+0000","last_clean":"2023-12-07T21:09:34.948503+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:09:34.948503+0000","last_undegraded":"2023-12-07T21:09:34.948503+0000","last_fullsized":"2023-12-07T21:09:34.948503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:57.843520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737487+0000","last_change":"2023-12-07T21:08:56.876875+0000","last_active":"2023-12-07T21:10:18.737487+0000","last_peered":"2023-12-07T21:10:18.737487+0000","last_clean":"2023-12-07T21:10:18.737487+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:10:18.737487+0000","last_undegraded":"2023-12-07T21:10:18.737487+0000","last_fullsized":"2023-12-07T21:10:18.737487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:53.347638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945653+0000","last_change":"2023-12-07T21:08:54.885432+0000","last_active":"2023-12-07T21:09:34.945653+0000","last_peered":"2023-12-07T21:09:34.945653+0000","last_clean":"2023-12-07T21:09:34.945653+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:09:34.945653+0000","last_undegraded":"2023-12-07T21:09:34.945653+0000","last_fullsized":"2023-12-07T21:09:34.945653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737853+0000","last_change":"2023-12-07T21:08:56.889380+0000","last_active":"2023-12-07T21:10:18.737853+0000","last_peered":"2023-12-07T21:10:18.737853+0000","last_clean":"2023-12-07T21:10:18.737853+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:10:18.737853+0000","last_undegraded":"2023-12-07T21:10:18.737853+0000","last_fullsized":"2023-12-07T21:10:18.737853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:47.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948829+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:09:34.948829+0000","last_peered":"2023-12-07T21:09:34.948829+0000","last_clean":"2023-12-07T21:09:34.948829+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:09:34.948829+0000","last_undegraded":"2023-12-07T21:09:34.948829+0000","last_fullsized":"2023-12-07T21:09:34.948829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:45.814396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945250+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:09:34.945250+0000","last_peered":"2023-12-07T21:09:34.945250+0000","last_clean":"2023-12-07T21:09:34.945250+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:09:34.945250+0000","last_undegraded":"2023-12-07T21:09:34.945250+0000","last_fullsized":"2023-12-07T21:09:34.945250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:24.756037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.066771+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:09:36.066771+0000","last_peered":"2023-12-07T21:09:36.066771+0000","last_clean":"2023-12-07T21:09:36.066771+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:09:36.066771+0000","last_undegraded":"2023-12-07T21:09:36.066771+0000","last_fullsized":"2023-12-07T21:09:36.066771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943662+0000","last_change":"2023-12-07T21:08:54.883760+0000","last_active":"2023-12-07T21:09:34.943662+0000","last_peered":"2023-12-07T21:09:34.943662+0000","last_clean":"2023-12-07T21:09:34.943662+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:09:34.943662+0000","last_undegraded":"2023-12-07T21:09:34.943662+0000","last_fullsized":"2023-12-07T21:09:34.943662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938907+0000","last_change":"2023-12-07T21:08:56.881838+0000","last_active":"2023-12-07T21:09:34.938907+0000","last_peered":"2023-12-07T21:09:34.938907+0000","last_clean":"2023-12-07T21:09:34.938907+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:09:34.938907+0000","last_undegraded":"2023-12-07T21:09:34.938907+0000","last_fullsized":"2023-12-07T21:09:34.938907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:29.862000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1340,"num_read_kb":1123,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1173,"ondisk_log_size":1173,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":351,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705697,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.35099999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54300000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.34499999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56899999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34300000000000003,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.44400000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52500000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.375},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.34599999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33300000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.50800000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.219,"15min":0.219},"max":{"1min":0.58699999999999997,"5min":0.621,"15min":0.621},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.318,"15min":0.318},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.39100000000000001,"5min":0.436,"15min":0.436},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.247,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.307}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28000000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.434},{"interface":"front","average":{"1min":0.442,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.23799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.54200000000000004,"5min":0.629,"15min":0.629},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.373},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.38},"min":{"1min":0.25900000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.48399999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.39000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68300000000000005,"5min":0.747,"15min":0.747},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:11:06.914 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:11:07.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb9c1f640 1 Processor -- start 2023-12-07T21:11:07.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb9c1f640 1 -- start start 2023-12-07T21:11:07.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb9c1f640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdfb406cc90 0x7fdfb406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:07.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb9c1f640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb4070340 con 0x7fdfb406d5b0 2023-12-07T21:11:07.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb9c1f640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb4097940 con 0x7fdfb406cc90 2023-12-07T21:11:07.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb37fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdfb406cc90 0x7fdfb406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:07.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb2ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdfb406d5b0 0x7fdfb40950b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39486/0 (socket says 172.21.15.89:39486) 2023-12-07T21:11:07.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb2ffd640 1 -- 172.21.15.89:0/2147622575 learned_addr learned my addr 172.21.15.89:0/2147622575 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:07.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb27fc640 1 -- 172.21.15.89:0/2147622575 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402578309 0 0) 0x7fdfb4070340 con 0x7fdfb406d5b0 2023-12-07T21:11:07.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb27fc640 1 -- 172.21.15.89:0/2147622575 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf9c003520 con 0x7fdfb406d5b0 2023-12-07T21:11:07.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb37fe640 1 -- 172.21.15.89:0/2147622575 >> v1:172.21.15.89:6789/0 conn(0x7fdfb406d5b0 legacy=0x7fdfb40950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.048+0000 7fdfb37fe640 1 -- 172.21.15.89:0/2147622575 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb4071900 con 0x7fdfb406cc90 2023-12-07T21:11:07.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.049+0000 7fdfb37fe640 1 --2- 172.21.15.89:0/2147622575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb406cc90 0x7fdfb406d070 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009720 tx=0x7fdfa402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b34db1689a14e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.049+0000 7fdfb27fc640 1 -- 172.21.15.89:0/2147622575 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfa402e070 con 0x7fdfb406cc90 2023-12-07T21:11:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.049+0000 7fdfb27fc640 1 -- 172.21.15.89:0/2147622575 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa40316d0 con 0x7fdfb406cc90 2023-12-07T21:11:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.049+0000 7fdfb27fc640 1 -- 172.21.15.89:0/2147622575 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfa4031990 con 0x7fdfb406cc90 2023-12-07T21:11:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.050+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2147622575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb406cc90 msgr2=0x7fdfb406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.050+0000 7fdfb9c1f640 1 --2- 172.21.15.89:0/2147622575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb406cc90 0x7fdfb406d070 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009720 tx=0x7fdfa402b840 comp rx=0 tx=0).stop 2023-12-07T21:11:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.050+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2147622575 shutdown_connections 2023-12-07T21:11:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.050+0000 7fdfb9c1f640 1 --2- 172.21.15.89:0/2147622575 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb406cc90 0x7fdfb406d070 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.050+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2147622575 >> 172.21.15.89:0/2147622575 conn(0x7fdfb40987f0 msgr2=0x7fdfb4098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.050+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2147622575 shutdown_connections 2023-12-07T21:11:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.050+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2147622575 wait complete. 2023-12-07T21:11:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.051+0000 7fdfb9c1f640 1 Processor -- start 2023-12-07T21:11:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.051+0000 7fdfb9c1f640 1 -- start start 2023-12-07T21:11:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.051+0000 7fdfb9c1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb406cc90 0x7fdfb41bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.051+0000 7fdfb9c1f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4088ff0 con 0x7fdfb406cc90 2023-12-07T21:11:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.051+0000 7fdfb37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb406cc90 0x7fdfb41bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.051+0000 7fdfb37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb406cc90 0x7fdfb41bfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38232/0 (socket says 172.21.15.89:38232) 2023-12-07T21:11:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.051+0000 7fdfb37fe640 1 -- 172.21.15.89:0/2582499366 learned_addr learned my addr 172.21.15.89:0/2582499366 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:07.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.051+0000 7fdfb37fe640 1 -- 172.21.15.89:0/2582499366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa4009400 con 0x7fdfb406cc90 2023-12-07T21:11:07.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.052+0000 7fdfb37fe640 1 --2- 172.21.15.89:0/2582499366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb406cc90 0x7fdfb41bfc60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000c00 tx=0x7fdfa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:07.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.052+0000 7fdf9bfff640 1 -- 172.21.15.89:0/2582499366 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfa4032770 con 0x7fdfb406cc90 2023-12-07T21:11:07.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.052+0000 7fdf9bfff640 1 -- 172.21.15.89:0/2582499366 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa40328d0 con 0x7fdfb406cc90 2023-12-07T21:11:07.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.052+0000 7fdf9bfff640 1 -- 172.21.15.89:0/2582499366 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdfa4032b90 con 0x7fdfb406cc90 2023-12-07T21:11:07.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.052+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2582499366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb4124f20 con 0x7fdfb406cc90 2023-12-07T21:11:07.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.052+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2582499366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb4125690 con 0x7fdfb406cc90 2023-12-07T21:11:07.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.052+0000 7fdf9bfff640 1 -- 172.21.15.89:0/2582499366 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fdfa4032cf0 con 0x7fdfb406cc90 2023-12-07T21:11:07.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.053+0000 7fdf9bfff640 1 --2- 172.21.15.89:0/2582499366 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdfa0037850 0x7fdfa0039d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:07.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.053+0000 7fdf9bfff640 1 -- 172.21.15.89:0/2582499366 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fdfa406c910 con 0x7fdfb406cc90 2023-12-07T21:11:07.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.053+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2582499366 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb408b8c0 con 0x7fdfb406cc90 2023-12-07T21:11:07.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.053+0000 7fdfb2ffd640 1 --2- 172.21.15.89:0/2582499366 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdfa0037850 0x7fdfa0039d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:07.048 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.053+0000 7fdfb2ffd640 1 --2- 172.21.15.89:0/2582499366 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdfa0037850 0x7fdfa0039d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8001610 tx=0x7fdfa8007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:07.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.057+0000 7fdf9bfff640 1 -- 172.21.15.89:0/2582499366 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdfa403b3f0 con 0x7fdfb406cc90 2023-12-07T21:11:07.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.219+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2582499366 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdfb4070bf0 con 0x7fdfa0037850 2023-12-07T21:11:07.226 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.234+0000 7fdf9bfff640 1 -- 172.21.15.89:0/2582499366 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673370 (secure 0 0 0) 0x7fdfa80058b0 con 0x7fdfa0037850 2023-12-07T21:11:07.233 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:11:07.239 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:11:07.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.239+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2582499366 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdfa0037850 msgr2=0x7fdfa0039d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.239+0000 7fdfb9c1f640 1 --2- 172.21.15.89:0/2582499366 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdfa0037850 0x7fdfa0039d10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8001610 tx=0x7fdfa8007970 comp rx=0 tx=0).stop 2023-12-07T21:11:07.241 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.239+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2582499366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb406cc90 msgr2=0x7fdfb41bfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.239+0000 7fdfb9c1f640 1 --2- 172.21.15.89:0/2582499366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb406cc90 0x7fdfb41bfc60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000c00 tx=0x7fdfa40046c0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.239+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2582499366 shutdown_connections 2023-12-07T21:11:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.239+0000 7fdfb9c1f640 1 --2- 172.21.15.89:0/2582499366 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdfa0037850 0x7fdfa0039d10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.239+0000 7fdfb9c1f640 1 --2- 172.21.15.89:0/2582499366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfb406cc90 0x7fdfb41bfc60 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.239+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2582499366 >> 172.21.15.89:0/2582499366 conn(0x7fdfb40987f0 msgr2=0x7fdfb409a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.239+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2582499366 shutdown_connections 2023-12-07T21:11:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.239+0000 7fdfb9c1f640 1 -- 172.21.15.89:0/2582499366 wait complete. 2023-12-07T21:11:07.243 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-12-07T21:11:06.089316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3322,"num_read_kb":2967,"num_write":1456,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3704,"ondisk_log_size":3704,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-77,"num_objects":-13,"num_object_clones":0,"num_object_copies":-27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":148,"num_read_kb":145,"num_write":51,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004171"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944900+0000","last_change":"2023-12-07T21:08:54.882968+0000","last_active":"2023-12-07T21:09:35.944900+0000","last_peered":"2023-12-07T21:09:35.944900+0000","last_clean":"2023-12-07T21:09:35.944900+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:09:35.944900+0000","last_undegraded":"2023-12-07T21:09:35.944900+0000","last_fullsized":"2023-12-07T21:09:35.944900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937447+0000","last_change":"2023-12-07T21:08:56.887127+0000","last_active":"2023-12-07T21:09:34.937447+0000","last_peered":"2023-12-07T21:09:34.937447+0000","last_clean":"2023-12-07T21:09:34.937447+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:09:34.937447+0000","last_undegraded":"2023-12-07T21:09:34.937447+0000","last_fullsized":"2023-12-07T21:09:34.937447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.595639+0000","last_change":"2023-12-07T21:08:54.890832+0000","last_active":"2023-12-07T21:09:36.595639+0000","last_peered":"2023-12-07T21:09:36.595639+0000","last_clean":"2023-12-07T21:09:36.595639+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:09:36.595639+0000","last_undegraded":"2023-12-07T21:09:36.595639+0000","last_fullsized":"2023-12-07T21:09:36.595639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:26.381861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.028116+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:09:37.028116+0000","last_peered":"2023-12-07T21:09:37.028116+0000","last_clean":"2023-12-07T21:09:37.028116+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:09:37.028116+0000","last_undegraded":"2023-12-07T21:09:37.028116+0000","last_fullsized":"2023-12-07T21:09:37.028116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:04:30.142969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.600004+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:09:36.600004+0000","last_peered":"2023-12-07T21:09:36.600004+0000","last_clean":"2023-12-07T21:09:36.600004+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:09:36.600004+0000","last_undegraded":"2023-12-07T21:09:36.600004+0000","last_fullsized":"2023-12-07T21:09:36.600004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:44.944890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946396+0000","last_change":"2023-12-07T21:08:56.873919+0000","last_active":"2023-12-07T21:09:34.946396+0000","last_peered":"2023-12-07T21:09:34.946396+0000","last_clean":"2023-12-07T21:09:34.946396+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:09:34.946396+0000","last_undegraded":"2023-12-07T21:09:34.946396+0000","last_fullsized":"2023-12-07T21:09:34.946396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:25:16.160841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942772+0000","last_change":"2023-12-07T21:08:54.880442+0000","last_active":"2023-12-07T21:09:35.942772+0000","last_peered":"2023-12-07T21:09:35.942772+0000","last_clean":"2023-12-07T21:09:35.942772+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:09:35.942772+0000","last_undegraded":"2023-12-07T21:09:35.942772+0000","last_fullsized":"2023-12-07T21:09:35.942772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946759+0000","last_change":"2023-12-07T21:08:56.874751+0000","last_active":"2023-12-07T21:09:34.946759+0000","last_peered":"2023-12-07T21:09:34.946759+0000","last_clean":"2023-12-07T21:09:34.946759+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:09:34.946759+0000","last_undegraded":"2023-12-07T21:09:34.946759+0000","last_fullsized":"2023-12-07T21:09:34.946759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:14.099961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945805+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:09:34.945805+0000","last_peered":"2023-12-07T21:09:34.945805+0000","last_clean":"2023-12-07T21:09:34.945805+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:09:34.945805+0000","last_undegraded":"2023-12-07T21:09:34.945805+0000","last_fullsized":"2023-12-07T21:09:34.945805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:18.585963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'7","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149300+0000","last_change":"2023-12-07T21:08:56.873414+0000","last_active":"2023-12-07T21:10:59.149300+0000","last_peered":"2023-12-07T21:10:59.149300+0000","last_clean":"2023-12-07T21:10:59.149300+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:10:59.149300+0000","last_undegraded":"2023-12-07T21:10:59.149300+0000","last_fullsized":"2023-12-07T21:10:59.149300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:46.057644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942843+0000","last_change":"2023-12-07T21:08:54.880274+0000","last_active":"2023-12-07T21:09:34.942843+0000","last_peered":"2023-12-07T21:09:34.942843+0000","last_clean":"2023-12-07T21:09:34.942843+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:09:34.942843+0000","last_undegraded":"2023-12-07T21:09:34.942843+0000","last_fullsized":"2023-12-07T21:09:34.942843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:18.078984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173549+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:10:18.173549+0000","last_peered":"2023-12-07T21:10:18.173549+0000","last_clean":"2023-12-07T21:10:18.173549+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:10:18.173549+0000","last_undegraded":"2023-12-07T21:10:18.173549+0000","last_fullsized":"2023-12-07T21:10:18.173549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:12.509153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945158+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:09:34.945158+0000","last_peered":"2023-12-07T21:09:34.945158+0000","last_clean":"2023-12-07T21:09:34.945158+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:09:34.945158+0000","last_undegraded":"2023-12-07T21:09:34.945158+0000","last_fullsized":"2023-12-07T21:09:34.945158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:55:25.782947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173686+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:10:59.173686+0000","last_peered":"2023-12-07T21:10:59.173686+0000","last_clean":"2023-12-07T21:10:59.173686+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:10:59.173686+0000","last_undegraded":"2023-12-07T21:10:59.173686+0000","last_fullsized":"2023-12-07T21:10:59.173686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943504+0000","last_change":"2023-12-07T21:08:54.891021+0000","last_active":"2023-12-07T21:09:34.943504+0000","last_peered":"2023-12-07T21:09:34.943504+0000","last_clean":"2023-12-07T21:09:34.943504+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:09:34.943504+0000","last_undegraded":"2023-12-07T21:09:34.943504+0000","last_fullsized":"2023-12-07T21:09:34.943504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'13","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.745821+0000","last_change":"2023-12-07T21:08:56.874321+0000","last_active":"2023-12-07T21:10:18.745821+0000","last_peered":"2023-12-07T21:10:18.745821+0000","last_clean":"2023-12-07T21:10:18.745821+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:10:18.745821+0000","last_undegraded":"2023-12-07T21:10:18.745821+0000","last_fullsized":"2023-12-07T21:10:18.745821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.602232+0000","last_change":"2023-12-07T21:08:56.874409+0000","last_active":"2023-12-07T21:09:36.602232+0000","last_peered":"2023-12-07T21:09:36.602232+0000","last_clean":"2023-12-07T21:09:36.602232+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:09:36.602232+0000","last_undegraded":"2023-12-07T21:09:36.602232+0000","last_fullsized":"2023-12-07T21:09:36.602232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:58.215716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939442+0000","last_change":"2023-12-07T21:08:54.887766+0000","last_active":"2023-12-07T21:09:34.939442+0000","last_peered":"2023-12-07T21:09:34.939442+0000","last_clean":"2023-12-07T21:09:34.939442+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:09:34.939442+0000","last_undegraded":"2023-12-07T21:09:34.939442+0000","last_fullsized":"2023-12-07T21:09:34.939442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149056+0000","last_change":"2023-12-07T21:08:56.876692+0000","last_active":"2023-12-07T21:10:59.149056+0000","last_peered":"2023-12-07T21:10:59.149056+0000","last_clean":"2023-12-07T21:10:59.149056+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:10:59.149056+0000","last_undegraded":"2023-12-07T21:10:59.149056+0000","last_fullsized":"2023-12-07T21:10:59.149056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945726+0000","last_change":"2023-12-07T21:08:54.885605+0000","last_active":"2023-12-07T21:09:34.945726+0000","last_peered":"2023-12-07T21:09:34.945726+0000","last_clean":"2023-12-07T21:09:34.945726+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:09:34.945726+0000","last_undegraded":"2023-12-07T21:09:34.945726+0000","last_fullsized":"2023-12-07T21:09:34.945726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'13","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149284+0000","last_change":"2023-12-07T21:08:56.882602+0000","last_active":"2023-12-07T21:10:59.149284+0000","last_peered":"2023-12-07T21:10:59.149284+0000","last_clean":"2023-12-07T21:10:59.149284+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:10:59.149284+0000","last_undegraded":"2023-12-07T21:10:59.149284+0000","last_fullsized":"2023-12-07T21:10:59.149284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:35.042292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939428+0000","last_change":"2023-12-07T21:08:54.889812+0000","last_active":"2023-12-07T21:09:34.939428+0000","last_peered":"2023-12-07T21:09:34.939428+0000","last_clean":"2023-12-07T21:09:34.939428+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:09:34.939428+0000","last_undegraded":"2023-12-07T21:09:34.939428+0000","last_fullsized":"2023-12-07T21:09:34.939428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.609048+0000","last_change":"2023-12-07T21:08:56.875989+0000","last_active":"2023-12-07T21:09:36.609048+0000","last_peered":"2023-12-07T21:09:36.609048+0000","last_clean":"2023-12-07T21:09:36.609048+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:09:36.609048+0000","last_undegraded":"2023-12-07T21:09:36.609048+0000","last_fullsized":"2023-12-07T21:09:36.609048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938981+0000","last_change":"2023-12-07T21:08:54.878784+0000","last_active":"2023-12-07T21:09:34.938981+0000","last_peered":"2023-12-07T21:09:34.938981+0000","last_clean":"2023-12-07T21:09:34.938981+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:09:34.938981+0000","last_undegraded":"2023-12-07T21:09:34.938981+0000","last_fullsized":"2023-12-07T21:09:34.938981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.022134+0000","last_change":"2023-12-07T21:08:56.875039+0000","last_active":"2023-12-07T21:09:37.022134+0000","last_peered":"2023-12-07T21:09:37.022134+0000","last_clean":"2023-12-07T21:09:37.022134+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:09:37.022134+0000","last_undegraded":"2023-12-07T21:09:37.022134+0000","last_fullsized":"2023-12-07T21:09:37.022134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944921+0000","last_change":"2023-12-07T21:08:54.890574+0000","last_active":"2023-12-07T21:09:34.944921+0000","last_peered":"2023-12-07T21:09:34.944921+0000","last_clean":"2023-12-07T21:09:34.944921+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:09:34.944921+0000","last_undegraded":"2023-12-07T21:09:34.944921+0000","last_fullsized":"2023-12-07T21:09:34.944921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939610+0000","last_change":"2023-12-07T21:08:56.883504+0000","last_active":"2023-12-07T21:09:34.939610+0000","last_peered":"2023-12-07T21:09:34.939610+0000","last_clean":"2023-12-07T21:09:34.939610+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:09:34.939610+0000","last_undegraded":"2023-12-07T21:09:34.939610+0000","last_fullsized":"2023-12-07T21:09:34.939610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:51.305185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946035+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:09:34.946035+0000","last_peered":"2023-12-07T21:09:34.946035+0000","last_clean":"2023-12-07T21:09:34.946035+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:09:34.946035+0000","last_undegraded":"2023-12-07T21:09:34.946035+0000","last_fullsized":"2023-12-07T21:09:34.946035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:50:11.989738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.964931+0000","last_change":"2023-12-07T21:09:04.931981+0000","last_active":"2023-12-07T21:10:59.964931+0000","last_peered":"2023-12-07T21:10:59.964931+0000","last_clean":"2023-12-07T21:10:59.964931+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:10:59.964931+0000","last_undegraded":"2023-12-07T21:10:59.964931+0000","last_fullsized":"2023-12-07T21:10:59.964931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:53.521686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.021786+0000","last_change":"2023-12-07T21:08:56.873551+0000","last_active":"2023-12-07T21:09:37.021786+0000","last_peered":"2023-12-07T21:09:37.021786+0000","last_clean":"2023-12-07T21:09:37.021786+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:09:37.021786+0000","last_undegraded":"2023-12-07T21:09:37.021786+0000","last_fullsized":"2023-12-07T21:09:37.021786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:25.387074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945597+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:09:34.945597+0000","last_peered":"2023-12-07T21:09:34.945597+0000","last_clean":"2023-12-07T21:09:34.945597+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:09:34.945597+0000","last_undegraded":"2023-12-07T21:09:34.945597+0000","last_fullsized":"2023-12-07T21:09:34.945597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:43.001000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"24'1","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.818090+0000","last_change":"2023-12-07T21:08:58.878371+0000","last_active":"2023-12-07T21:10:59.818090+0000","last_peered":"2023-12-07T21:10:59.818090+0000","last_clean":"2023-12-07T21:10:59.818090+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:10:59.818090+0000","last_undegraded":"2023-12-07T21:10:59.818090+0000","last_fullsized":"2023-12-07T21:10:59.818090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:31.248934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.711024+0000","last_change":"2023-12-07T21:09:00.895835+0000","last_active":"2023-12-07T21:10:18.711024+0000","last_peered":"2023-12-07T21:10:18.711024+0000","last_clean":"2023-12-07T21:10:18.711024+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:10:18.711024+0000","last_undegraded":"2023-12-07T21:10:18.711024+0000","last_fullsized":"2023-12-07T21:10:18.711024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:04:34.159776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939365+0000","last_change":"2023-12-07T21:09:02.907297+0000","last_active":"2023-12-07T21:09:34.939365+0000","last_peered":"2023-12-07T21:09:34.939365+0000","last_clean":"2023-12-07T21:09:34.939365+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:09:34.939365+0000","last_undegraded":"2023-12-07T21:09:34.939365+0000","last_fullsized":"2023-12-07T21:09:34.939365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:14.963344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.099231+0000","last_change":"2023-12-07T21:09:04.931948+0000","last_active":"2023-12-07T21:10:13.099231+0000","last_peered":"2023-12-07T21:10:13.099231+0000","last_clean":"2023-12-07T21:10:13.099231+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:10:13.099231+0000","last_undegraded":"2023-12-07T21:10:13.099231+0000","last_fullsized":"2023-12-07T21:10:13.099231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:01:26.083720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948422+0000","last_change":"2023-12-07T21:08:56.874761+0000","last_active":"2023-12-07T21:09:34.948422+0000","last_peered":"2023-12-07T21:09:34.948422+0000","last_clean":"2023-12-07T21:09:34.948422+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:09:34.948422+0000","last_undegraded":"2023-12-07T21:09:34.948422+0000","last_fullsized":"2023-12-07T21:09:34.948422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:15.592836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942644+0000","last_change":"2023-12-07T21:08:54.880632+0000","last_active":"2023-12-07T21:09:34.942644+0000","last_peered":"2023-12-07T21:09:34.942644+0000","last_clean":"2023-12-07T21:09:34.942644+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:09:34.942644+0000","last_undegraded":"2023-12-07T21:09:34.942644+0000","last_fullsized":"2023-12-07T21:09:34.942644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943879+0000","last_change":"2023-12-07T21:08:58.877458+0000","last_active":"2023-12-07T21:09:34.943879+0000","last_peered":"2023-12-07T21:09:34.943879+0000","last_clean":"2023-12-07T21:09:34.943879+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:09:34.943879+0000","last_undegraded":"2023-12-07T21:09:34.943879+0000","last_fullsized":"2023-12-07T21:09:34.943879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:26.789220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938986+0000","last_change":"2023-12-07T21:09:00.893179+0000","last_active":"2023-12-07T21:09:34.938986+0000","last_peered":"2023-12-07T21:09:34.938986+0000","last_clean":"2023-12-07T21:09:34.938986+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:09:34.938986+0000","last_undegraded":"2023-12-07T21:09:34.938986+0000","last_fullsized":"2023-12-07T21:09:34.938986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:01:24.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938667+0000","last_change":"2023-12-07T21:09:02.901036+0000","last_active":"2023-12-07T21:09:34.938667+0000","last_peered":"2023-12-07T21:09:34.938667+0000","last_clean":"2023-12-07T21:09:34.938667+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:09:34.938667+0000","last_undegraded":"2023-12-07T21:09:34.938667+0000","last_fullsized":"2023-12-07T21:09:34.938667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:43.815906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943377+0000","last_change":"2023-12-07T21:09:04.925464+0000","last_active":"2023-12-07T21:09:34.943377+0000","last_peered":"2023-12-07T21:09:34.943377+0000","last_clean":"2023-12-07T21:09:34.943377+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:09:34.943377+0000","last_undegraded":"2023-12-07T21:09:34.943377+0000","last_fullsized":"2023-12-07T21:09:34.943377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:05.623664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173385+0000","last_change":"2023-12-07T21:08:56.875484+0000","last_active":"2023-12-07T21:10:18.173385+0000","last_peered":"2023-12-07T21:10:18.173385+0000","last_clean":"2023-12-07T21:10:18.173385+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:10:18.173385+0000","last_undegraded":"2023-12-07T21:10:18.173385+0000","last_fullsized":"2023-12-07T21:10:18.173385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:53.554840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944843+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:09:34.944843+0000","last_peered":"2023-12-07T21:09:34.944843+0000","last_clean":"2023-12-07T21:09:34.944843+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:09:34.944843+0000","last_undegraded":"2023-12-07T21:09:34.944843+0000","last_fullsized":"2023-12-07T21:09:34.944843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:44:12.242883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945726+0000","last_change":"2023-12-07T21:08:58.880158+0000","last_active":"2023-12-07T21:09:34.945726+0000","last_peered":"2023-12-07T21:09:34.945726+0000","last_clean":"2023-12-07T21:09:34.945726+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:09:34.945726+0000","last_undegraded":"2023-12-07T21:09:34.945726+0000","last_fullsized":"2023-12-07T21:09:34.945726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:46:42.407725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943564+0000","last_change":"2023-12-07T21:09:00.890726+0000","last_active":"2023-12-07T21:09:34.943564+0000","last_peered":"2023-12-07T21:09:34.943564+0000","last_clean":"2023-12-07T21:09:34.943564+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:09:34.943564+0000","last_undegraded":"2023-12-07T21:09:34.943564+0000","last_fullsized":"2023-12-07T21:09:34.943564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:46:44.418058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'243","reported_seq":309,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.970866+0000","last_change":"2023-12-07T21:09:02.906250+0000","last_active":"2023-12-07T21:10:59.970866+0000","last_peered":"2023-12-07T21:10:59.970866+0000","last_clean":"2023-12-07T21:10:59.970866+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:10:59.970866+0000","last_undegraded":"2023-12-07T21:10:59.970866+0000","last_fullsized":"2023-12-07T21:10:59.970866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:09.157302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942609+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:09:34.942609+0000","last_peered":"2023-12-07T21:09:34.942609+0000","last_clean":"2023-12-07T21:09:34.942609+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:09:34.942609+0000","last_undegraded":"2023-12-07T21:09:34.942609+0000","last_fullsized":"2023-12-07T21:09:34.942609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:38.570544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149295+0000","last_change":"2023-12-07T21:08:56.885545+0000","last_active":"2023-12-07T21:10:59.149295+0000","last_peered":"2023-12-07T21:10:59.149295+0000","last_clean":"2023-12-07T21:10:59.149295+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:10:59.149295+0000","last_undegraded":"2023-12-07T21:10:59.149295+0000","last_fullsized":"2023-12-07T21:10:59.149295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937355+0000","last_change":"2023-12-07T21:08:54.878527+0000","last_active":"2023-12-07T21:09:34.937355+0000","last_peered":"2023-12-07T21:09:34.937355+0000","last_clean":"2023-12-07T21:09:34.937355+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:09:34.937355+0000","last_undegraded":"2023-12-07T21:09:34.937355+0000","last_fullsized":"2023-12-07T21:09:34.937355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:44:21.586858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.950706+0000","last_change":"2023-12-07T21:09:35.950706+0000","last_active":"2023-12-07T21:09:35.950706+0000","last_peered":"2023-12-07T21:09:35.950706+0000","last_clean":"2023-12-07T21:09:35.950706+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:09:35.950706+0000","last_undegraded":"2023-12-07T21:09:35.950706+0000","last_fullsized":"2023-12-07T21:09:35.950706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:55.202208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.705204+0000","last_change":"2023-12-07T21:09:00.892788+0000","last_active":"2023-12-07T21:10:18.705204+0000","last_peered":"2023-12-07T21:10:18.705204+0000","last_clean":"2023-12-07T21:10:18.705204+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:10:18.705204+0000","last_undegraded":"2023-12-07T21:10:18.705204+0000","last_fullsized":"2023-12-07T21:10:18.705204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:02.232524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":326,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.974960+0000","last_change":"2023-12-07T21:09:02.901266+0000","last_active":"2023-12-07T21:10:59.974960+0000","last_peered":"2023-12-07T21:10:59.974960+0000","last_clean":"2023-12-07T21:10:59.974960+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:10:59.974960+0000","last_undegraded":"2023-12-07T21:10:59.974960+0000","last_fullsized":"2023-12-07T21:10:59.974960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:00.730866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149018+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:10:59.149018+0000","last_peered":"2023-12-07T21:10:59.149018+0000","last_clean":"2023-12-07T21:10:59.149018+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:10:59.149018+0000","last_undegraded":"2023-12-07T21:10:59.149018+0000","last_fullsized":"2023-12-07T21:10:59.149018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:05.147754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946220+0000","last_change":"2023-12-07T21:08:54.880253+0000","last_active":"2023-12-07T21:09:34.946220+0000","last_peered":"2023-12-07T21:09:34.946220+0000","last_clean":"2023-12-07T21:09:34.946220+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:09:34.946220+0000","last_undegraded":"2023-12-07T21:09:34.946220+0000","last_fullsized":"2023-12-07T21:09:34.946220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937686+0000","last_change":"2023-12-07T21:08:58.877986+0000","last_active":"2023-12-07T21:09:34.937686+0000","last_peered":"2023-12-07T21:09:34.937686+0000","last_clean":"2023-12-07T21:09:34.937686+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:09:34.937686+0000","last_undegraded":"2023-12-07T21:09:34.937686+0000","last_fullsized":"2023-12-07T21:09:34.937686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:07.154229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'39","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.127461+0000","last_change":"2023-12-07T21:09:00.888749+0000","last_active":"2023-12-07T21:10:59.127461+0000","last_peered":"2023-12-07T21:10:59.127461+0000","last_clean":"2023-12-07T21:10:59.127461+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:10:59.127461+0000","last_undegraded":"2023-12-07T21:10:59.127461+0000","last_fullsized":"2023-12-07T21:10:59.127461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:09.164561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944403+0000","last_change":"2023-12-07T21:09:02.897538+0000","last_active":"2023-12-07T21:09:34.944403+0000","last_peered":"2023-12-07T21:09:34.944403+0000","last_clean":"2023-12-07T21:09:34.944403+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:09:34.944403+0000","last_undegraded":"2023-12-07T21:09:34.944403+0000","last_fullsized":"2023-12-07T21:09:34.944403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:14.963344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.550827+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:10:18.550827+0000","last_peered":"2023-12-07T21:10:18.550827+0000","last_clean":"2023-12-07T21:10:18.550827+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:10:18.550827+0000","last_undegraded":"2023-12-07T21:10:18.550827+0000","last_fullsized":"2023-12-07T21:10:18.550827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:02.886090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'21","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173496+0000","last_change":"2023-12-07T21:08:56.871222+0000","last_active":"2023-12-07T21:10:18.173496+0000","last_peered":"2023-12-07T21:10:18.173496+0000","last_clean":"2023-12-07T21:10:18.173496+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:10:18.173496+0000","last_undegraded":"2023-12-07T21:10:18.173496+0000","last_fullsized":"2023-12-07T21:10:18.173496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:00:00.778558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944073+0000","last_change":"2023-12-07T21:08:54.885249+0000","last_active":"2023-12-07T21:09:34.944073+0000","last_peered":"2023-12-07T21:09:34.944073+0000","last_clean":"2023-12-07T21:09:34.944073+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:09:34.944073+0000","last_undegraded":"2023-12-07T21:09:34.944073+0000","last_fullsized":"2023-12-07T21:09:34.944073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:59.087021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943751+0000","last_change":"2023-12-07T21:08:58.880254+0000","last_active":"2023-12-07T21:09:34.943751+0000","last_peered":"2023-12-07T21:09:34.943751+0000","last_clean":"2023-12-07T21:09:34.943751+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:09:34.943751+0000","last_undegraded":"2023-12-07T21:09:34.943751+0000","last_fullsized":"2023-12-07T21:09:34.943751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:59:22.011218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'30","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.694667+0000","last_change":"2023-12-07T21:09:00.895444+0000","last_active":"2023-12-07T21:10:18.694667+0000","last_peered":"2023-12-07T21:10:18.694667+0000","last_clean":"2023-12-07T21:10:18.694667+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:10:18.694667+0000","last_undegraded":"2023-12-07T21:10:18.694667+0000","last_fullsized":"2023-12-07T21:10:18.694667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:09:52.225596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943466+0000","last_change":"2023-12-07T21:09:02.906821+0000","last_active":"2023-12-07T21:09:34.943466+0000","last_peered":"2023-12-07T21:09:34.943466+0000","last_clean":"2023-12-07T21:09:34.943466+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:09:34.943466+0000","last_undegraded":"2023-12-07T21:09:34.943466+0000","last_fullsized":"2023-12-07T21:09:34.943466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:00.871254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.004149+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:10:13.004149+0000","last_peered":"2023-12-07T21:10:13.004149+0000","last_clean":"2023-12-07T21:10:13.004149+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:10:13.004149+0000","last_undegraded":"2023-12-07T21:10:13.004149+0000","last_fullsized":"2023-12-07T21:10:13.004149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:03.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943008+0000","last_change":"2023-12-07T21:08:56.879742+0000","last_active":"2023-12-07T21:09:34.943008+0000","last_peered":"2023-12-07T21:09:34.943008+0000","last_clean":"2023-12-07T21:09:34.943008+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:09:34.943008+0000","last_undegraded":"2023-12-07T21:09:34.943008+0000","last_fullsized":"2023-12-07T21:09:34.943008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:28:08.424793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948569+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:09:34.948569+0000","last_peered":"2023-12-07T21:09:34.948569+0000","last_clean":"2023-12-07T21:09:34.948569+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:09:34.948569+0000","last_undegraded":"2023-12-07T21:09:34.948569+0000","last_fullsized":"2023-12-07T21:09:34.948569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:29.350180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945631+0000","last_change":"2023-12-07T21:08:58.874569+0000","last_active":"2023-12-07T21:09:34.945631+0000","last_peered":"2023-12-07T21:09:34.945631+0000","last_clean":"2023-12-07T21:09:34.945631+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:09:34.945631+0000","last_undegraded":"2023-12-07T21:09:34.945631+0000","last_fullsized":"2023-12-07T21:09:34.945631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:25:29.329795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.717375+0000","last_change":"2023-12-07T21:09:00.889539+0000","last_active":"2023-12-07T21:10:18.717375+0000","last_peered":"2023-12-07T21:10:18.717375+0000","last_clean":"2023-12-07T21:10:18.717375+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:10:18.717375+0000","last_undegraded":"2023-12-07T21:10:18.717375+0000","last_fullsized":"2023-12-07T21:10:18.717375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:23.846766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":294,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.975948+0000","last_change":"2023-12-07T21:09:02.905689+0000","last_active":"2023-12-07T21:10:59.975948+0000","last_peered":"2023-12-07T21:10:59.975948+0000","last_clean":"2023-12-07T21:10:59.975948+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:10:59.975948+0000","last_undegraded":"2023-12-07T21:10:59.975948+0000","last_fullsized":"2023-12-07T21:10:59.975948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:43.815906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944612+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:09:34.944612+0000","last_peered":"2023-12-07T21:09:34.944612+0000","last_clean":"2023-12-07T21:09:34.944612+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:09:34.944612+0000","last_undegraded":"2023-12-07T21:09:34.944612+0000","last_fullsized":"2023-12-07T21:09:34.944612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:27.874660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.602318+0000","last_change":"2023-12-07T21:08:56.870949+0000","last_active":"2023-12-07T21:09:36.602318+0000","last_peered":"2023-12-07T21:09:36.602318+0000","last_clean":"2023-12-07T21:09:36.602318+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:09:36.602318+0000","last_undegraded":"2023-12-07T21:09:36.602318+0000","last_fullsized":"2023-12-07T21:09:36.602318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:50.983783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947454+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:09:34.947454+0000","last_peered":"2023-12-07T21:09:34.947454+0000","last_clean":"2023-12-07T21:09:34.947454+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:09:34.947454+0000","last_undegraded":"2023-12-07T21:09:34.947454+0000","last_fullsized":"2023-12-07T21:09:34.947454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:48.971381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943934+0000","last_change":"2023-12-07T21:08:58.880111+0000","last_active":"2023-12-07T21:09:34.943934+0000","last_peered":"2023-12-07T21:09:34.943934+0000","last_clean":"2023-12-07T21:09:34.943934+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:09:34.943934+0000","last_undegraded":"2023-12-07T21:09:34.943934+0000","last_fullsized":"2023-12-07T21:09:34.943934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:06:27.005217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.110642+0000","last_change":"2023-12-07T21:09:00.894678+0000","last_active":"2023-12-07T21:10:59.110642+0000","last_peered":"2023-12-07T21:10:59.110642+0000","last_clean":"2023-12-07T21:10:59.110642+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:10:59.110642+0000","last_undegraded":"2023-12-07T21:10:59.110642+0000","last_fullsized":"2023-12-07T21:10:59.110642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:55:22.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943349+0000","last_change":"2023-12-07T21:09:02.901382+0000","last_active":"2023-12-07T21:09:34.943349+0000","last_peered":"2023-12-07T21:09:34.943349+0000","last_clean":"2023-12-07T21:09:34.943349+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:09:34.943349+0000","last_undegraded":"2023-12-07T21:09:34.943349+0000","last_fullsized":"2023-12-07T21:09:34.943349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:36.555708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.963309+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:10:59.963309+0000","last_peered":"2023-12-07T21:10:59.963309+0000","last_clean":"2023-12-07T21:10:59.963309+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:10:59.963309+0000","last_undegraded":"2023-12-07T21:10:59.963309+0000","last_fullsized":"2023-12-07T21:10:59.963309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:58.709847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.952362+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:09:35.952362+0000","last_peered":"2023-12-07T21:09:35.952362+0000","last_clean":"2023-12-07T21:09:35.952362+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:09:35.952362+0000","last_undegraded":"2023-12-07T21:09:35.952362+0000","last_fullsized":"2023-12-07T21:09:35.952362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:06:39.417736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944094+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:09:34.944094+0000","last_peered":"2023-12-07T21:09:34.944094+0000","last_clean":"2023-12-07T21:09:34.944094+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:09:34.944094+0000","last_undegraded":"2023-12-07T21:09:34.944094+0000","last_fullsized":"2023-12-07T21:09:34.944094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943794+0000","last_change":"2023-12-07T21:08:58.878003+0000","last_active":"2023-12-07T21:09:34.943794+0000","last_peered":"2023-12-07T21:09:34.943794+0000","last_clean":"2023-12-07T21:09:34.943794+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:09:34.943794+0000","last_undegraded":"2023-12-07T21:09:34.943794+0000","last_fullsized":"2023-12-07T21:09:34.943794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:31.868475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'30","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.698790+0000","last_change":"2023-12-07T21:09:00.892793+0000","last_active":"2023-12-07T21:10:18.698790+0000","last_peered":"2023-12-07T21:10:18.698790+0000","last_clean":"2023-12-07T21:10:18.698790+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:10:18.698790+0000","last_undegraded":"2023-12-07T21:10:18.698790+0000","last_fullsized":"2023-12-07T21:10:18.698790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:40:44.335329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948507+0000","last_change":"2023-12-07T21:09:02.906350+0000","last_active":"2023-12-07T21:09:34.948507+0000","last_peered":"2023-12-07T21:09:34.948507+0000","last_clean":"2023-12-07T21:09:34.948507+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:09:34.948507+0000","last_undegraded":"2023-12-07T21:09:34.948507+0000","last_fullsized":"2023-12-07T21:09:34.948507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:37:53.231631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944316+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:09:34.944316+0000","last_peered":"2023-12-07T21:09:34.944316+0000","last_clean":"2023-12-07T21:09:34.944316+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:09:34.944316+0000","last_undegraded":"2023-12-07T21:09:34.944316+0000","last_fullsized":"2023-12-07T21:09:34.944316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:08:05.985163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737413+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:10:18.737413+0000","last_peered":"2023-12-07T21:10:18.737413+0000","last_clean":"2023-12-07T21:10:18.737413+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:10:18.737413+0000","last_undegraded":"2023-12-07T21:10:18.737413+0000","last_fullsized":"2023-12-07T21:10:18.737413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:45.476986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946531+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:09:34.946531+0000","last_peered":"2023-12-07T21:09:34.946531+0000","last_clean":"2023-12-07T21:09:34.946531+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:09:34.946531+0000","last_undegraded":"2023-12-07T21:09:34.946531+0000","last_fullsized":"2023-12-07T21:09:34.946531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:50.838564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943971+0000","last_change":"2023-12-07T21:08:58.880054+0000","last_active":"2023-12-07T21:09:34.943971+0000","last_peered":"2023-12-07T21:09:34.943971+0000","last_clean":"2023-12-07T21:09:34.943971+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:09:34.943971+0000","last_undegraded":"2023-12-07T21:09:34.943971+0000","last_fullsized":"2023-12-07T21:09:34.943971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:06:16.756883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.725885+0000","last_change":"2023-12-07T21:09:00.884835+0000","last_active":"2023-12-07T21:10:18.725885+0000","last_peered":"2023-12-07T21:10:18.725885+0000","last_clean":"2023-12-07T21:10:18.725885+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:10:18.725885+0000","last_undegraded":"2023-12-07T21:10:18.725885+0000","last_fullsized":"2023-12-07T21:10:18.725885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:46:31.016107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":323,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.999246+0000","last_change":"2023-12-07T21:09:02.897993+0000","last_active":"2023-12-07T21:10:59.999246+0000","last_peered":"2023-12-07T21:10:59.999246+0000","last_clean":"2023-12-07T21:10:59.999246+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:10:59.999246+0000","last_undegraded":"2023-12-07T21:10:59.999246+0000","last_fullsized":"2023-12-07T21:10:59.999246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:07:07.411571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.749284+0000","last_change":"2023-12-07T21:09:04.919388+0000","last_active":"2023-12-07T21:10:18.749284+0000","last_peered":"2023-12-07T21:10:18.749284+0000","last_clean":"2023-12-07T21:10:18.749284+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:10:18.749284+0000","last_undegraded":"2023-12-07T21:10:18.749284+0000","last_fullsized":"2023-12-07T21:10:18.749284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:08.715985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.066420+0000","last_change":"2023-12-07T21:08:56.880261+0000","last_active":"2023-12-07T21:09:36.066420+0000","last_peered":"2023-12-07T21:09:36.066420+0000","last_clean":"2023-12-07T21:09:36.066420+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:09:36.066420+0000","last_undegraded":"2023-12-07T21:09:36.066420+0000","last_fullsized":"2023-12-07T21:09:36.066420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.585971+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:09:36.585971+0000","last_peered":"2023-12-07T21:09:36.585971+0000","last_clean":"2023-12-07T21:09:36.585971+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:09:36.585971+0000","last_undegraded":"2023-12-07T21:09:36.585971+0000","last_fullsized":"2023-12-07T21:09:36.585971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:55:05.877689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.935504+0000","last_change":"2023-12-07T21:08:58.876612+0000","last_active":"2023-12-07T21:10:59.935504+0000","last_peered":"2023-12-07T21:10:59.935504+0000","last_clean":"2023-12-07T21:10:59.935504+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:10:59.935504+0000","last_undegraded":"2023-12-07T21:10:59.935504+0000","last_fullsized":"2023-12-07T21:10:59.935504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:09.272727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":169,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947872+0000","last_change":"2023-12-07T21:09:00.895566+0000","last_active":"2023-12-07T21:09:34.947872+0000","last_peered":"2023-12-07T21:09:34.947872+0000","last_clean":"2023-12-07T21:09:34.947872+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:09:34.947872+0000","last_undegraded":"2023-12-07T21:09:34.947872+0000","last_fullsized":"2023-12-07T21:09:34.947872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:26:26.503427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":358,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.995871+0000","last_change":"2023-12-07T21:09:02.900092+0000","last_active":"2023-12-07T21:10:59.995871+0000","last_peered":"2023-12-07T21:10:59.995871+0000","last_clean":"2023-12-07T21:10:59.995871+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:10:59.995871+0000","last_undegraded":"2023-12-07T21:10:59.995871+0000","last_fullsized":"2023-12-07T21:10:59.995871+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:58.034650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.362471+0000","last_change":"2023-12-07T21:09:04.923396+0000","last_active":"2023-12-07T21:09:36.362471+0000","last_peered":"2023-12-07T21:09:36.362471+0000","last_clean":"2023-12-07T21:09:36.362471+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:09:36.362471+0000","last_undegraded":"2023-12-07T21:09:36.362471+0000","last_fullsized":"2023-12-07T21:09:36.362471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:15:15.500097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939613+0000","last_change":"2023-12-07T21:08:56.889238+0000","last_active":"2023-12-07T21:09:34.939613+0000","last_peered":"2023-12-07T21:09:34.939613+0000","last_clean":"2023-12-07T21:09:34.939613+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:09:34.939613+0000","last_undegraded":"2023-12-07T21:09:34.939613+0000","last_fullsized":"2023-12-07T21:09:34.939613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:06:26.241158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945162+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:09:34.945162+0000","last_peered":"2023-12-07T21:09:34.945162+0000","last_clean":"2023-12-07T21:09:34.945162+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:09:34.945162+0000","last_undegraded":"2023-12-07T21:09:34.945162+0000","last_fullsized":"2023-12-07T21:09:34.945162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:48.585124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948807+0000","last_change":"2023-12-07T21:08:58.879899+0000","last_active":"2023-12-07T21:09:34.948807+0000","last_peered":"2023-12-07T21:09:34.948807+0000","last_clean":"2023-12-07T21:09:34.948807+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:09:34.948807+0000","last_undegraded":"2023-12-07T21:09:34.948807+0000","last_fullsized":"2023-12-07T21:09:34.948807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:56.707476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.712555+0000","last_change":"2023-12-07T21:09:00.892694+0000","last_active":"2023-12-07T21:10:18.712555+0000","last_peered":"2023-12-07T21:10:18.712555+0000","last_clean":"2023-12-07T21:10:18.712555+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:10:18.712555+0000","last_undegraded":"2023-12-07T21:10:18.712555+0000","last_fullsized":"2023-12-07T21:10:18.712555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:54.775039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943470+0000","last_change":"2023-12-07T21:09:02.906473+0000","last_active":"2023-12-07T21:09:34.943470+0000","last_peered":"2023-12-07T21:09:34.943470+0000","last_clean":"2023-12-07T21:09:34.943470+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:09:34.943470+0000","last_undegraded":"2023-12-07T21:09:34.943470+0000","last_fullsized":"2023-12-07T21:09:34.943470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:41.421690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.180594+0000","last_change":"2023-12-07T21:09:04.920277+0000","last_active":"2023-12-07T21:10:59.180594+0000","last_peered":"2023-12-07T21:10:59.180594+0000","last_clean":"2023-12-07T21:10:59.180594+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:10:59.180594+0000","last_undegraded":"2023-12-07T21:10:59.180594+0000","last_fullsized":"2023-12-07T21:10:59.180594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:05.623664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.947251+0000","last_change":"2023-12-07T21:08:56.875185+0000","last_active":"2023-12-07T21:09:35.947251+0000","last_peered":"2023-12-07T21:09:35.947251+0000","last_clean":"2023-12-07T21:09:35.947251+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:09:35.947251+0000","last_undegraded":"2023-12-07T21:09:35.947251+0000","last_fullsized":"2023-12-07T21:09:35.947251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:07:01.381707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948511+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:09:35.948511+0000","last_peered":"2023-12-07T21:09:35.948511+0000","last_clean":"2023-12-07T21:09:35.948511+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:09:35.948511+0000","last_undegraded":"2023-12-07T21:09:35.948511+0000","last_fullsized":"2023-12-07T21:09:35.948511+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:17.092202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944755+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:09:35.944755+0000","last_peered":"2023-12-07T21:09:35.944755+0000","last_clean":"2023-12-07T21:09:35.944755+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:09:35.944755+0000","last_undegraded":"2023-12-07T21:09:35.944755+0000","last_fullsized":"2023-12-07T21:09:35.944755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:39:44.793585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942701+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:09:35.942701+0000","last_peered":"2023-12-07T21:09:35.942701+0000","last_clean":"2023-12-07T21:09:35.942701+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:09:35.942701+0000","last_undegraded":"2023-12-07T21:09:35.942701+0000","last_fullsized":"2023-12-07T21:09:35.942701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:28:06.412391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.952567+0000","last_change":"2023-12-07T21:08:58.875656+0000","last_active":"2023-12-07T21:09:35.952567+0000","last_peered":"2023-12-07T21:09:35.952567+0000","last_clean":"2023-12-07T21:09:35.952567+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:09:35.952567+0000","last_undegraded":"2023-12-07T21:09:35.952567+0000","last_fullsized":"2023-12-07T21:09:35.952567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:55.354113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'70","reported_seq":131,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.126427+0000","last_change":"2023-12-07T21:09:00.891338+0000","last_active":"2023-12-07T21:10:59.126427+0000","last_peered":"2023-12-07T21:10:59.126427+0000","last_clean":"2023-12-07T21:10:59.126427+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:10:59.126427+0000","last_undegraded":"2023-12-07T21:10:59.126427+0000","last_fullsized":"2023-12-07T21:10:59.126427+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:47.241395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944698+0000","last_change":"2023-12-07T21:09:02.905666+0000","last_active":"2023-12-07T21:09:34.944698+0000","last_peered":"2023-12-07T21:09:34.944698+0000","last_clean":"2023-12-07T21:09:34.944698+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:09:34.944698+0000","last_undegraded":"2023-12-07T21:09:34.944698+0000","last_fullsized":"2023-12-07T21:09:34.944698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:02.230683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.177244+0000","last_change":"2023-12-07T21:09:04.924703+0000","last_active":"2023-12-07T21:10:59.177244+0000","last_peered":"2023-12-07T21:10:59.177244+0000","last_clean":"2023-12-07T21:10:59.177244+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:10:59.177244+0000","last_undegraded":"2023-12-07T21:10:59.177244+0000","last_fullsized":"2023-12-07T21:10:59.177244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:31.414632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.360739+0000","last_change":"2023-12-07T21:08:56.872420+0000","last_active":"2023-12-07T21:09:36.360739+0000","last_peered":"2023-12-07T21:09:36.360739+0000","last_clean":"2023-12-07T21:09:36.360739+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:09:36.360739+0000","last_undegraded":"2023-12-07T21:09:36.360739+0000","last_fullsized":"2023-12-07T21:09:36.360739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:35.391826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946195+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:09:35.946195+0000","last_peered":"2023-12-07T21:09:35.946195+0000","last_clean":"2023-12-07T21:09:35.946195+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:09:35.946195+0000","last_undegraded":"2023-12-07T21:09:35.946195+0000","last_fullsized":"2023-12-07T21:09:35.946195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:38.020788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.147003+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:10:59.147003+0000","last_peered":"2023-12-07T21:10:59.147003+0000","last_clean":"2023-12-07T21:10:59.147003+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:10:59.147003+0000","last_undegraded":"2023-12-07T21:10:59.147003+0000","last_fullsized":"2023-12-07T21:10:59.147003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.949153+0000","last_change":"2023-12-07T21:08:58.879144+0000","last_active":"2023-12-07T21:09:34.949153+0000","last_peered":"2023-12-07T21:09:34.949153+0000","last_clean":"2023-12-07T21:09:34.949153+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:09:34.949153+0000","last_undegraded":"2023-12-07T21:09:34.949153+0000","last_fullsized":"2023-12-07T21:09:34.949153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:10.939955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'241","reported_seq":410,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.967308+0000","last_change":"2023-12-07T21:09:00.892118+0000","last_active":"2023-12-07T21:10:59.967308+0000","last_peered":"2023-12-07T21:10:59.967308+0000","last_clean":"2023-12-07T21:10:59.967308+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:10:59.967308+0000","last_undegraded":"2023-12-07T21:10:59.967308+0000","last_fullsized":"2023-12-07T21:10:59.967308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:03:54.253378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":318,"num_read_kb":303,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947700+0000","last_change":"2023-12-07T21:09:02.905387+0000","last_active":"2023-12-07T21:09:34.947700+0000","last_peered":"2023-12-07T21:09:34.947700+0000","last_clean":"2023-12-07T21:09:34.947700+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:09:34.947700+0000","last_undegraded":"2023-12-07T21:09:34.947700+0000","last_fullsized":"2023-12-07T21:09:34.947700+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:01:07.430200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.153282+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:10:13.153282+0000","last_peered":"2023-12-07T21:10:13.153282+0000","last_clean":"2023-12-07T21:10:13.153282+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:10:13.153282+0000","last_undegraded":"2023-12-07T21:10:13.153282+0000","last_fullsized":"2023-12-07T21:10:13.153282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:03.815279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737328+0000","last_change":"2023-12-07T21:08:56.883281+0000","last_active":"2023-12-07T21:10:18.737328+0000","last_peered":"2023-12-07T21:10:18.737328+0000","last_clean":"2023-12-07T21:10:18.737328+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:10:18.737328+0000","last_undegraded":"2023-12-07T21:10:18.737328+0000","last_fullsized":"2023-12-07T21:10:18.737328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:11:43.198377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941657+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:09:35.941657+0000","last_peered":"2023-12-07T21:09:35.941657+0000","last_clean":"2023-12-07T21:09:35.941657+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:09:35.941657+0000","last_undegraded":"2023-12-07T21:09:35.941657+0000","last_fullsized":"2023-12-07T21:09:35.941657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:49:28.884695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941524+0000","last_change":"2023-12-07T21:08:54.881937+0000","last_active":"2023-12-07T21:09:35.941524+0000","last_peered":"2023-12-07T21:09:35.941524+0000","last_clean":"2023-12-07T21:09:35.941524+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:09:35.941524+0000","last_undegraded":"2023-12-07T21:09:35.941524+0000","last_fullsized":"2023-12-07T21:09:35.941524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943947+0000","last_change":"2023-12-07T21:08:58.875724+0000","last_active":"2023-12-07T21:09:34.943947+0000","last_peered":"2023-12-07T21:09:34.943947+0000","last_clean":"2023-12-07T21:09:34.943947+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:09:34.943947+0000","last_undegraded":"2023-12-07T21:09:34.943947+0000","last_fullsized":"2023-12-07T21:09:34.943947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:38:36.911470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.928507+0000","last_change":"2023-12-07T21:09:00.888461+0000","last_active":"2023-12-07T21:10:58.928507+0000","last_peered":"2023-12-07T21:10:58.928507+0000","last_clean":"2023-12-07T21:10:58.928507+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:10:58.928507+0000","last_undegraded":"2023-12-07T21:10:58.928507+0000","last_fullsized":"2023-12-07T21:10:58.928507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:25:31.340127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944508+0000","last_change":"2023-12-07T21:09:02.905583+0000","last_active":"2023-12-07T21:09:34.944508+0000","last_peered":"2023-12-07T21:09:34.944508+0000","last_clean":"2023-12-07T21:09:34.944508+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:09:34.944508+0000","last_undegraded":"2023-12-07T21:09:34.944508+0000","last_fullsized":"2023-12-07T21:09:34.944508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:59:50.067921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945302+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:09:34.945302+0000","last_peered":"2023-12-07T21:09:34.945302+0000","last_clean":"2023-12-07T21:09:34.945302+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:09:34.945302+0000","last_undegraded":"2023-12-07T21:09:34.945302+0000","last_fullsized":"2023-12-07T21:09:34.945302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:25:58.505646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.609344+0000","last_change":"2023-12-07T21:08:56.872455+0000","last_active":"2023-12-07T21:09:36.609344+0000","last_peered":"2023-12-07T21:09:36.609344+0000","last_clean":"2023-12-07T21:09:36.609344+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:09:36.609344+0000","last_undegraded":"2023-12-07T21:09:36.609344+0000","last_fullsized":"2023-12-07T21:09:36.609344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:23.887277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942558+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:09:35.942558+0000","last_peered":"2023-12-07T21:09:35.942558+0000","last_clean":"2023-12-07T21:09:35.942558+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:09:35.942558+0000","last_undegraded":"2023-12-07T21:09:35.942558+0000","last_fullsized":"2023-12-07T21:09:35.942558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:34.117128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946583+0000","last_change":"2023-12-07T21:08:54.880674+0000","last_active":"2023-12-07T21:09:35.946583+0000","last_peered":"2023-12-07T21:09:35.946583+0000","last_clean":"2023-12-07T21:09:35.946583+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:09:35.946583+0000","last_undegraded":"2023-12-07T21:09:35.946583+0000","last_fullsized":"2023-12-07T21:09:35.946583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943247+0000","last_change":"2023-12-07T21:08:58.881871+0000","last_active":"2023-12-07T21:09:35.943247+0000","last_peered":"2023-12-07T21:09:35.943247+0000","last_clean":"2023-12-07T21:09:35.943247+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:09:35.943247+0000","last_undegraded":"2023-12-07T21:09:35.943247+0000","last_fullsized":"2023-12-07T21:09:35.943247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:38.827449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943744+0000","last_change":"2023-12-07T21:09:00.892022+0000","last_active":"2023-12-07T21:09:35.943744+0000","last_peered":"2023-12-07T21:09:35.943744+0000","last_clean":"2023-12-07T21:09:35.943744+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:09:35.943744+0000","last_undegraded":"2023-12-07T21:09:35.943744+0000","last_fullsized":"2023-12-07T21:09:35.943744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:20:22.542933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948794+0000","last_change":"2023-12-07T21:09:02.907037+0000","last_active":"2023-12-07T21:09:34.948794+0000","last_peered":"2023-12-07T21:09:34.948794+0000","last_clean":"2023-12-07T21:09:34.948794+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:09:34.948794+0000","last_undegraded":"2023-12-07T21:09:34.948794+0000","last_fullsized":"2023-12-07T21:09:34.948794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:47:48.082744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937984+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:09:34.937984+0000","last_peered":"2023-12-07T21:09:34.937984+0000","last_clean":"2023-12-07T21:09:34.937984+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:09:34.937984+0000","last_undegraded":"2023-12-07T21:09:34.937984+0000","last_fullsized":"2023-12-07T21:09:34.937984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:02:06.112301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.950132+0000","last_change":"2023-12-07T21:08:56.882954+0000","last_active":"2023-12-07T21:09:35.950132+0000","last_peered":"2023-12-07T21:09:35.950132+0000","last_clean":"2023-12-07T21:09:35.950132+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:09:35.950132+0000","last_undegraded":"2023-12-07T21:09:35.950132+0000","last_fullsized":"2023-12-07T21:09:35.950132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:07:51.158690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.592742+0000","last_change":"2023-12-07T21:08:54.881143+0000","last_active":"2023-12-07T21:09:36.592742+0000","last_peered":"2023-12-07T21:09:36.592742+0000","last_clean":"2023-12-07T21:09:36.592742+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:09:36.592742+0000","last_undegraded":"2023-12-07T21:09:36.592742+0000","last_fullsized":"2023-12-07T21:09:36.592742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942847+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:09:35.942847+0000","last_peered":"2023-12-07T21:09:35.942847+0000","last_clean":"2023-12-07T21:09:35.942847+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:09:35.942847+0000","last_undegraded":"2023-12-07T21:09:35.942847+0000","last_fullsized":"2023-12-07T21:09:35.942847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:24.297087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943063+0000","last_change":"2023-12-07T21:08:58.881942+0000","last_active":"2023-12-07T21:09:35.943063+0000","last_peered":"2023-12-07T21:09:35.943063+0000","last_clean":"2023-12-07T21:09:35.943063+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:09:35.943063+0000","last_undegraded":"2023-12-07T21:09:35.943063+0000","last_fullsized":"2023-12-07T21:09:35.943063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:41:45.408620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'58","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.136121+0000","last_change":"2023-12-07T21:09:00.892917+0000","last_active":"2023-12-07T21:10:59.136121+0000","last_peered":"2023-12-07T21:10:59.136121+0000","last_clean":"2023-12-07T21:10:59.136121+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:10:59.136121+0000","last_undegraded":"2023-12-07T21:10:59.136121+0000","last_fullsized":"2023-12-07T21:10:59.136121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:08:10.091706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":64,"num_read_kb":67,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943132+0000","last_change":"2023-12-07T21:09:02.897497+0000","last_active":"2023-12-07T21:09:34.943132+0000","last_peered":"2023-12-07T21:09:34.943132+0000","last_clean":"2023-12-07T21:09:34.943132+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:09:34.943132+0000","last_undegraded":"2023-12-07T21:09:34.943132+0000","last_fullsized":"2023-12-07T21:09:34.943132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:21.622701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.727098+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:10:18.727098+0000","last_peered":"2023-12-07T21:10:18.727098+0000","last_clean":"2023-12-07T21:10:18.727098+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:10:18.727098+0000","last_undegraded":"2023-12-07T21:10:18.727098+0000","last_fullsized":"2023-12-07T21:10:18.727098+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:02:58.721630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948690+0000","last_change":"2023-12-07T21:08:56.878924+0000","last_active":"2023-12-07T21:09:35.948690+0000","last_peered":"2023-12-07T21:09:35.948690+0000","last_clean":"2023-12-07T21:09:35.948690+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:09:35.948690+0000","last_undegraded":"2023-12-07T21:09:35.948690+0000","last_fullsized":"2023-12-07T21:09:35.948690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:11:43.198377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.735075+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:10:18.735075+0000","last_peered":"2023-12-07T21:10:18.735075+0000","last_clean":"2023-12-07T21:10:18.735075+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:10:18.735075+0000","last_undegraded":"2023-12-07T21:10:18.735075+0000","last_fullsized":"2023-12-07T21:10:18.735075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:32.542770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946376+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:09:35.946376+0000","last_peered":"2023-12-07T21:09:35.946376+0000","last_clean":"2023-12-07T21:09:35.946376+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:09:35.946376+0000","last_undegraded":"2023-12-07T21:09:35.946376+0000","last_fullsized":"2023-12-07T21:09:35.946376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:30:53.269300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942447+0000","last_change":"2023-12-07T21:08:58.879797+0000","last_active":"2023-12-07T21:09:35.942447+0000","last_peered":"2023-12-07T21:09:35.942447+0000","last_clean":"2023-12-07T21:09:35.942447+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:09:35.942447+0000","last_undegraded":"2023-12-07T21:09:35.942447+0000","last_fullsized":"2023-12-07T21:09:35.942447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:57:59.211719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937819+0000","last_change":"2023-12-07T21:09:00.890696+0000","last_active":"2023-12-07T21:09:34.937819+0000","last_peered":"2023-12-07T21:09:34.937819+0000","last_clean":"2023-12-07T21:09:34.937819+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:09:34.937819+0000","last_undegraded":"2023-12-07T21:09:34.937819+0000","last_fullsized":"2023-12-07T21:09:34.937819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:57.571647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":288,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:00.233748+0000","last_change":"2023-12-07T21:09:02.900501+0000","last_active":"2023-12-07T21:11:00.233748+0000","last_peered":"2023-12-07T21:11:00.233748+0000","last_clean":"2023-12-07T21:11:00.233748+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:00.233748+0000","last_undegraded":"2023-12-07T21:11:00.233748+0000","last_fullsized":"2023-12-07T21:11:00.233748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:07.330523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948599+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:09:34.948599+0000","last_peered":"2023-12-07T21:09:34.948599+0000","last_clean":"2023-12-07T21:09:34.948599+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:09:34.948599+0000","last_undegraded":"2023-12-07T21:09:34.948599+0000","last_fullsized":"2023-12-07T21:09:34.948599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:41.901371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.027809+0000","last_change":"2023-12-07T21:08:56.887962+0000","last_active":"2023-12-07T21:09:37.027809+0000","last_peered":"2023-12-07T21:09:37.027809+0000","last_clean":"2023-12-07T21:09:37.027809+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:09:37.027809+0000","last_undegraded":"2023-12-07T21:09:37.027809+0000","last_fullsized":"2023-12-07T21:09:37.027809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:38.589260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.949138+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:09:34.949138+0000","last_peered":"2023-12-07T21:09:34.949138+0000","last_clean":"2023-12-07T21:09:34.949138+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:09:34.949138+0000","last_undegraded":"2023-12-07T21:09:34.949138+0000","last_fullsized":"2023-12-07T21:09:34.949138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:21.874874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943546+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:09:35.943546+0000","last_peered":"2023-12-07T21:09:35.943546+0000","last_clean":"2023-12-07T21:09:35.943546+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:09:35.943546+0000","last_undegraded":"2023-12-07T21:09:35.943546+0000","last_fullsized":"2023-12-07T21:09:35.943546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:02:32.429314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948547+0000","last_change":"2023-12-07T21:08:58.878642+0000","last_active":"2023-12-07T21:09:35.948547+0000","last_peered":"2023-12-07T21:09:35.948547+0000","last_clean":"2023-12-07T21:09:35.948547+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:09:35.948547+0000","last_undegraded":"2023-12-07T21:09:35.948547+0000","last_fullsized":"2023-12-07T21:09:35.948547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:03.307133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946636+0000","last_change":"2023-12-07T21:09:00.896503+0000","last_active":"2023-12-07T21:09:34.946636+0000","last_peered":"2023-12-07T21:09:34.946636+0000","last_clean":"2023-12-07T21:09:34.946636+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:09:34.946636+0000","last_undegraded":"2023-12-07T21:09:34.946636+0000","last_fullsized":"2023-12-07T21:09:34.946636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:54.681953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":355,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.973822+0000","last_change":"2023-12-07T21:09:02.897351+0000","last_active":"2023-12-07T21:10:59.973822+0000","last_peered":"2023-12-07T21:10:59.973822+0000","last_clean":"2023-12-07T21:10:59.973822+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:10:59.973822+0000","last_undegraded":"2023-12-07T21:10:59.973822+0000","last_fullsized":"2023-12-07T21:10:59.973822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:58:03.235109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938213+0000","last_change":"2023-12-07T21:09:04.929420+0000","last_active":"2023-12-07T21:09:34.938213+0000","last_peered":"2023-12-07T21:09:34.938213+0000","last_clean":"2023-12-07T21:09:34.938213+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:09:34.938213+0000","last_undegraded":"2023-12-07T21:09:34.938213+0000","last_fullsized":"2023-12-07T21:09:34.938213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:08.715985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173660+0000","last_change":"2023-12-07T21:08:56.874336+0000","last_active":"2023-12-07T21:10:59.173660+0000","last_peered":"2023-12-07T21:10:59.173660+0000","last_clean":"2023-12-07T21:10:59.173660+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:10:59.173660+0000","last_undegraded":"2023-12-07T21:10:59.173660+0000","last_fullsized":"2023-12-07T21:10:59.173660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:22.142967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939208+0000","last_change":"2023-12-07T21:08:54.888557+0000","last_active":"2023-12-07T21:09:34.939208+0000","last_peered":"2023-12-07T21:09:34.939208+0000","last_clean":"2023-12-07T21:09:34.939208+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:09:34.939208+0000","last_undegraded":"2023-12-07T21:09:34.939208+0000","last_fullsized":"2023-12-07T21:09:34.939208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944629+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:09:35.944629+0000","last_peered":"2023-12-07T21:09:35.944629+0000","last_clean":"2023-12-07T21:09:35.944629+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:09:35.944629+0000","last_undegraded":"2023-12-07T21:09:35.944629+0000","last_fullsized":"2023-12-07T21:09:35.944629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:13:59.600730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.953920+0000","last_change":"2023-12-07T21:09:35.953149+0000","last_active":"2023-12-07T21:09:35.953920+0000","last_peered":"2023-12-07T21:09:35.953920+0000","last_clean":"2023-12-07T21:09:35.953920+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:09:35.953920+0000","last_undegraded":"2023-12-07T21:09:35.953920+0000","last_fullsized":"2023-12-07T21:09:35.953920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:00:15.189655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'77","reported_seq":141,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.115830+0000","last_change":"2023-12-07T21:09:00.891723+0000","last_active":"2023-12-07T21:10:59.115830+0000","last_peered":"2023-12-07T21:10:59.115830+0000","last_clean":"2023-12-07T21:10:59.115830+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:10:59.115830+0000","last_undegraded":"2023-12-07T21:10:59.115830+0000","last_fullsized":"2023-12-07T21:10:59.115830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:57.364445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944006+0000","last_change":"2023-12-07T21:09:02.898050+0000","last_active":"2023-12-07T21:09:34.944006+0000","last_peered":"2023-12-07T21:09:34.944006+0000","last_clean":"2023-12-07T21:09:34.944006+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:09:34.944006+0000","last_undegraded":"2023-12-07T21:09:34.944006+0000","last_fullsized":"2023-12-07T21:09:34.944006+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:07.330523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943933+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:09:34.943933+0000","last_peered":"2023-12-07T21:09:34.943933+0000","last_clean":"2023-12-07T21:09:34.943933+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:09:34.943933+0000","last_undegraded":"2023-12-07T21:09:34.943933+0000","last_fullsized":"2023-12-07T21:09:34.943933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:45.830742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943689+0000","last_change":"2023-12-07T21:09:04.926451+0000","last_active":"2023-12-07T21:09:34.943689+0000","last_peered":"2023-12-07T21:09:34.943689+0000","last_clean":"2023-12-07T21:09:34.943689+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:09:34.943689+0000","last_undegraded":"2023-12-07T21:09:34.943689+0000","last_fullsized":"2023-12-07T21:09:34.943689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:00.049486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943172+0000","last_change":"2023-12-07T21:08:56.877160+0000","last_active":"2023-12-07T21:09:34.943172+0000","last_peered":"2023-12-07T21:09:34.943172+0000","last_clean":"2023-12-07T21:09:34.943172+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:09:34.943172+0000","last_undegraded":"2023-12-07T21:09:34.943172+0000","last_fullsized":"2023-12-07T21:09:34.943172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:20.598365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947455+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:09:34.947455+0000","last_peered":"2023-12-07T21:09:34.947455+0000","last_clean":"2023-12-07T21:09:34.947455+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:09:34.947455+0000","last_undegraded":"2023-12-07T21:09:34.947455+0000","last_fullsized":"2023-12-07T21:09:34.947455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:24.731856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938592+0000","last_change":"2023-12-07T21:08:58.876828+0000","last_active":"2023-12-07T21:09:34.938592+0000","last_peered":"2023-12-07T21:09:34.938592+0000","last_clean":"2023-12-07T21:09:34.938592+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:09:34.938592+0000","last_undegraded":"2023-12-07T21:09:34.938592+0000","last_fullsized":"2023-12-07T21:09:34.938592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:25:18.167316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.716368+0000","last_change":"2023-12-07T21:09:00.893775+0000","last_active":"2023-12-07T21:10:18.716368+0000","last_peered":"2023-12-07T21:10:18.716368+0000","last_clean":"2023-12-07T21:10:18.716368+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:10:18.716368+0000","last_undegraded":"2023-12-07T21:10:18.716368+0000","last_fullsized":"2023-12-07T21:10:18.716368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:36:18.746987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945519+0000","last_change":"2023-12-07T21:09:02.907875+0000","last_active":"2023-12-07T21:09:34.945519+0000","last_peered":"2023-12-07T21:09:34.945519+0000","last_clean":"2023-12-07T21:09:34.945519+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:09:34.945519+0000","last_undegraded":"2023-12-07T21:09:34.945519+0000","last_fullsized":"2023-12-07T21:09:34.945519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:44:51.015892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944425+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:09:34.944425+0000","last_peered":"2023-12-07T21:09:34.944425+0000","last_clean":"2023-12-07T21:09:34.944425+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:09:34.944425+0000","last_undegraded":"2023-12-07T21:09:34.944425+0000","last_fullsized":"2023-12-07T21:09:34.944425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:13:50.090324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937989+0000","last_change":"2023-12-07T21:08:56.879187+0000","last_active":"2023-12-07T21:09:34.937989+0000","last_peered":"2023-12-07T21:09:34.937989+0000","last_clean":"2023-12-07T21:09:34.937989+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:09:34.937989+0000","last_undegraded":"2023-12-07T21:09:34.937989+0000","last_fullsized":"2023-12-07T21:09:34.937989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943278+0000","last_change":"2023-12-07T21:08:54.880755+0000","last_active":"2023-12-07T21:09:34.943278+0000","last_peered":"2023-12-07T21:09:34.943278+0000","last_clean":"2023-12-07T21:09:34.943278+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:09:34.943278+0000","last_undegraded":"2023-12-07T21:09:34.943278+0000","last_fullsized":"2023-12-07T21:09:34.943278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947289+0000","last_change":"2023-12-07T21:08:58.882787+0000","last_active":"2023-12-07T21:09:34.947289+0000","last_peered":"2023-12-07T21:09:34.947289+0000","last_clean":"2023-12-07T21:09:34.947289+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:09:34.947289+0000","last_undegraded":"2023-12-07T21:09:34.947289+0000","last_fullsized":"2023-12-07T21:09:34.947289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:04:04.292611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:12.139450+0000","last_change":"2023-12-07T21:09:00.886499+0000","last_active":"2023-12-07T21:10:12.139450+0000","last_peered":"2023-12-07T21:10:12.139450+0000","last_clean":"2023-12-07T21:10:12.139450+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:10:12.139450+0000","last_undegraded":"2023-12-07T21:10:12.139450+0000","last_fullsized":"2023-12-07T21:10:12.139450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:11.283059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942852+0000","last_change":"2023-12-07T21:09:02.906677+0000","last_active":"2023-12-07T21:09:34.942852+0000","last_peered":"2023-12-07T21:09:34.942852+0000","last_clean":"2023-12-07T21:09:34.942852+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:09:34.942852+0000","last_undegraded":"2023-12-07T21:09:34.942852+0000","last_fullsized":"2023-12-07T21:09:34.942852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:00.642632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944148+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:09:34.944148+0000","last_peered":"2023-12-07T21:09:34.944148+0000","last_clean":"2023-12-07T21:09:34.944148+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:09:34.944148+0000","last_undegraded":"2023-12-07T21:09:34.944148+0000","last_fullsized":"2023-12-07T21:09:34.944148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:03.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149349+0000","last_change":"2023-12-07T21:08:56.874712+0000","last_active":"2023-12-07T21:10:59.149349+0000","last_peered":"2023-12-07T21:10:59.149349+0000","last_clean":"2023-12-07T21:10:59.149349+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:10:59.149349+0000","last_undegraded":"2023-12-07T21:10:59.149349+0000","last_fullsized":"2023-12-07T21:10:59.149349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:20.598365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945370+0000","last_change":"2023-12-07T21:08:54.885182+0000","last_active":"2023-12-07T21:09:34.945370+0000","last_peered":"2023-12-07T21:09:34.945370+0000","last_clean":"2023-12-07T21:09:34.945370+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:09:34.945370+0000","last_undegraded":"2023-12-07T21:09:34.945370+0000","last_fullsized":"2023-12-07T21:09:34.945370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:26.381861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942456+0000","last_change":"2023-12-07T21:08:58.873698+0000","last_active":"2023-12-07T21:09:34.942456+0000","last_peered":"2023-12-07T21:09:34.942456+0000","last_clean":"2023-12-07T21:09:34.942456+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:09:34.942456+0000","last_undegraded":"2023-12-07T21:09:34.942456+0000","last_fullsized":"2023-12-07T21:09:34.942456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:28:17.747275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'34","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.965525+0000","last_change":"2023-12-07T21:09:00.892175+0000","last_active":"2023-12-07T21:10:58.965525+0000","last_peered":"2023-12-07T21:10:58.965525+0000","last_clean":"2023-12-07T21:10:58.965525+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:10:58.965525+0000","last_undegraded":"2023-12-07T21:10:58.965525+0000","last_fullsized":"2023-12-07T21:10:58.965525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:29.403881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937776+0000","last_change":"2023-12-07T21:09:02.900618+0000","last_active":"2023-12-07T21:09:34.937776+0000","last_peered":"2023-12-07T21:09:34.937776+0000","last_clean":"2023-12-07T21:09:34.937776+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:09:34.937776+0000","last_undegraded":"2023-12-07T21:09:34.937776+0000","last_fullsized":"2023-12-07T21:09:34.937776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:00.871254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948117+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:09:34.948117+0000","last_peered":"2023-12-07T21:09:34.948117+0000","last_clean":"2023-12-07T21:09:34.948117+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:09:34.948117+0000","last_undegraded":"2023-12-07T21:09:34.948117+0000","last_fullsized":"2023-12-07T21:09:34.948117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:37:58.338488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944992+0000","last_change":"2023-12-07T21:08:56.887184+0000","last_active":"2023-12-07T21:09:34.944992+0000","last_peered":"2023-12-07T21:09:34.944992+0000","last_clean":"2023-12-07T21:09:34.944992+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:09:34.944992+0000","last_undegraded":"2023-12-07T21:09:34.944992+0000","last_fullsized":"2023-12-07T21:09:34.944992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:07.266252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939265+0000","last_change":"2023-12-07T21:08:54.878542+0000","last_active":"2023-12-07T21:09:34.939265+0000","last_peered":"2023-12-07T21:09:34.939265+0000","last_clean":"2023-12-07T21:09:34.939265+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:09:34.939265+0000","last_undegraded":"2023-12-07T21:09:34.939265+0000","last_fullsized":"2023-12-07T21:09:34.939265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944756+0000","last_change":"2023-12-07T21:08:58.878455+0000","last_active":"2023-12-07T21:09:34.944756+0000","last_peered":"2023-12-07T21:09:34.944756+0000","last_clean":"2023-12-07T21:09:34.944756+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:09:34.944756+0000","last_undegraded":"2023-12-07T21:09:34.944756+0000","last_fullsized":"2023-12-07T21:09:34.944756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:39.792516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.700847+0000","last_change":"2023-12-07T21:09:00.885534+0000","last_active":"2023-12-07T21:10:18.700847+0000","last_peered":"2023-12-07T21:10:18.700847+0000","last_clean":"2023-12-07T21:10:18.700847+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:10:18.700847+0000","last_undegraded":"2023-12-07T21:10:18.700847+0000","last_fullsized":"2023-12-07T21:10:18.700847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:07.128867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942727+0000","last_change":"2023-12-07T21:09:02.899870+0000","last_active":"2023-12-07T21:09:34.942727+0000","last_peered":"2023-12-07T21:09:34.942727+0000","last_clean":"2023-12-07T21:09:34.942727+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:09:34.942727+0000","last_undegraded":"2023-12-07T21:09:34.942727+0000","last_fullsized":"2023-12-07T21:09:34.942727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:59.584704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946337+0000","last_change":"2023-12-07T21:08:56.873185+0000","last_active":"2023-12-07T21:09:35.946337+0000","last_peered":"2023-12-07T21:09:35.946337+0000","last_clean":"2023-12-07T21:09:35.946337+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:09:35.946337+0000","last_undegraded":"2023-12-07T21:09:35.946337+0000","last_fullsized":"2023-12-07T21:09:35.946337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:03:50.236571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944921+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:09:34.944921+0000","last_peered":"2023-12-07T21:09:34.944921+0000","last_clean":"2023-12-07T21:09:34.944921+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:09:34.944921+0000","last_undegraded":"2023-12-07T21:09:34.944921+0000","last_fullsized":"2023-12-07T21:09:34.944921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:44:52.381066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944424+0000","last_change":"2023-12-07T21:08:58.879555+0000","last_active":"2023-12-07T21:09:35.944424+0000","last_peered":"2023-12-07T21:09:35.944424+0000","last_clean":"2023-12-07T21:09:35.944424+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:09:35.944424+0000","last_undegraded":"2023-12-07T21:09:35.944424+0000","last_fullsized":"2023-12-07T21:09:35.944424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:05.118535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'50","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.112986+0000","last_change":"2023-12-07T21:09:00.886089+0000","last_active":"2023-12-07T21:10:59.112986+0000","last_peered":"2023-12-07T21:10:59.112986+0000","last_clean":"2023-12-07T21:10:59.112986+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:10:59.112986+0000","last_undegraded":"2023-12-07T21:10:59.112986+0000","last_fullsized":"2023-12-07T21:10:59.112986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:58.629575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942969+0000","last_change":"2023-12-07T21:09:02.900412+0000","last_active":"2023-12-07T21:09:34.942969+0000","last_peered":"2023-12-07T21:09:34.942969+0000","last_clean":"2023-12-07T21:09:34.942969+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:09:34.942969+0000","last_undegraded":"2023-12-07T21:09:34.942969+0000","last_fullsized":"2023-12-07T21:09:34.942969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:16:17.076025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.282119+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:10:18.282119+0000","last_peered":"2023-12-07T21:10:18.282119+0000","last_clean":"2023-12-07T21:10:18.282119+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:10:18.282119+0000","last_undegraded":"2023-12-07T21:10:18.282119+0000","last_fullsized":"2023-12-07T21:10:18.282119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:03.815279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149298+0000","last_change":"2023-12-07T21:08:56.877115+0000","last_active":"2023-12-07T21:10:59.149298+0000","last_peered":"2023-12-07T21:10:59.149298+0000","last_clean":"2023-12-07T21:10:59.149298+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:10:59.149298+0000","last_undegraded":"2023-12-07T21:10:59.149298+0000","last_fullsized":"2023-12-07T21:10:59.149298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:47.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937462+0000","last_change":"2023-12-07T21:08:54.882363+0000","last_active":"2023-12-07T21:09:34.937462+0000","last_peered":"2023-12-07T21:09:34.937462+0000","last_clean":"2023-12-07T21:09:34.937462+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:09:34.937462+0000","last_undegraded":"2023-12-07T21:09:34.937462+0000","last_fullsized":"2023-12-07T21:09:34.937462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:47:51.435614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.954233+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:09:35.954233+0000","last_peered":"2023-12-07T21:09:35.954233+0000","last_clean":"2023-12-07T21:09:35.954233+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:09:35.954233+0000","last_undegraded":"2023-12-07T21:09:35.954233+0000","last_fullsized":"2023-12-07T21:09:35.954233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:01:20.045494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.701913+0000","last_change":"2023-12-07T21:09:00.887309+0000","last_active":"2023-12-07T21:10:18.701913+0000","last_peered":"2023-12-07T21:10:18.701913+0000","last_clean":"2023-12-07T21:10:18.701913+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:10:18.701913+0000","last_undegraded":"2023-12-07T21:10:18.701913+0000","last_fullsized":"2023-12-07T21:10:18.701913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:31:21.189550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938397+0000","last_change":"2023-12-07T21:09:02.907306+0000","last_active":"2023-12-07T21:09:34.938397+0000","last_peered":"2023-12-07T21:09:34.938397+0000","last_clean":"2023-12-07T21:09:34.938397+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:09:34.938397+0000","last_undegraded":"2023-12-07T21:09:34.938397+0000","last_fullsized":"2023-12-07T21:09:34.938397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:58:03.235109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944816+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:09:34.944816+0000","last_peered":"2023-12-07T21:09:34.944816+0000","last_clean":"2023-12-07T21:09:34.944816+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:09:34.944816+0000","last_undegraded":"2023-12-07T21:09:34.944816+0000","last_fullsized":"2023-12-07T21:09:34.944816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:45:57.610751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.028328+0000","last_change":"2023-12-07T21:08:56.885223+0000","last_active":"2023-12-07T21:09:37.028328+0000","last_peered":"2023-12-07T21:09:37.028328+0000","last_clean":"2023-12-07T21:09:37.028328+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:09:37.028328+0000","last_undegraded":"2023-12-07T21:09:37.028328+0000","last_fullsized":"2023-12-07T21:09:37.028328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:16:11.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937906+0000","last_change":"2023-12-07T21:08:54.887587+0000","last_active":"2023-12-07T21:09:34.937906+0000","last_peered":"2023-12-07T21:09:34.937906+0000","last_clean":"2023-12-07T21:09:34.937906+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:09:34.937906+0000","last_undegraded":"2023-12-07T21:09:34.937906+0000","last_fullsized":"2023-12-07T21:09:34.937906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943211+0000","last_change":"2023-12-07T21:08:58.876479+0000","last_active":"2023-12-07T21:09:34.943211+0000","last_peered":"2023-12-07T21:09:34.943211+0000","last_clean":"2023-12-07T21:09:34.943211+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:09:34.943211+0000","last_undegraded":"2023-12-07T21:09:34.943211+0000","last_fullsized":"2023-12-07T21:09:34.943211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:37.048767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'31","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.720307+0000","last_change":"2023-12-07T21:09:00.890134+0000","last_active":"2023-12-07T21:10:18.720307+0000","last_peered":"2023-12-07T21:10:18.720307+0000","last_clean":"2023-12-07T21:10:18.720307+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:10:18.720307+0000","last_undegraded":"2023-12-07T21:10:18.720307+0000","last_fullsized":"2023-12-07T21:10:18.720307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:19.609643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943191+0000","last_change":"2023-12-07T21:09:02.901229+0000","last_active":"2023-12-07T21:09:35.943191+0000","last_peered":"2023-12-07T21:09:35.943191+0000","last_clean":"2023-12-07T21:09:35.943191+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:09:35.943191+0000","last_undegraded":"2023-12-07T21:09:35.943191+0000","last_fullsized":"2023-12-07T21:09:35.943191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:35.272324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.728070+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:10:18.728070+0000","last_peered":"2023-12-07T21:10:18.728070+0000","last_clean":"2023-12-07T21:10:18.728070+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:10:18.728070+0000","last_undegraded":"2023-12-07T21:10:18.728070+0000","last_fullsized":"2023-12-07T21:10:18.728070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:13:44.983457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149269+0000","last_change":"2023-12-07T21:08:56.872465+0000","last_active":"2023-12-07T21:10:59.149269+0000","last_peered":"2023-12-07T21:10:59.149269+0000","last_clean":"2023-12-07T21:10:59.149269+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:10:59.149269+0000","last_undegraded":"2023-12-07T21:10:59.149269+0000","last_fullsized":"2023-12-07T21:10:59.149269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:46.057644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945674+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:09:34.945674+0000","last_peered":"2023-12-07T21:09:34.945674+0000","last_clean":"2023-12-07T21:09:34.945674+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:09:34.945674+0000","last_undegraded":"2023-12-07T21:09:34.945674+0000","last_fullsized":"2023-12-07T21:09:34.945674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:27.280985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.940467+0000","last_change":"2023-12-07T21:08:58.875630+0000","last_active":"2023-12-07T21:09:34.940467+0000","last_peered":"2023-12-07T21:09:34.940467+0000","last_clean":"2023-12-07T21:09:34.940467+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:09:34.940467+0000","last_undegraded":"2023-12-07T21:09:34.940467+0000","last_fullsized":"2023-12-07T21:09:34.940467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:16.106436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944106+0000","last_change":"2023-12-07T21:09:00.896323+0000","last_active":"2023-12-07T21:09:35.944106+0000","last_peered":"2023-12-07T21:09:35.944106+0000","last_clean":"2023-12-07T21:09:35.944106+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:09:35.944106+0000","last_undegraded":"2023-12-07T21:09:35.944106+0000","last_fullsized":"2023-12-07T21:09:35.944106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:28:31.952243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":311,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.968298+0000","last_change":"2023-12-07T21:09:02.908092+0000","last_active":"2023-12-07T21:10:59.968298+0000","last_peered":"2023-12-07T21:10:59.968298+0000","last_clean":"2023-12-07T21:10:59.968298+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:10:59.968298+0000","last_undegraded":"2023-12-07T21:10:59.968298+0000","last_fullsized":"2023-12-07T21:10:59.968298+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:04:20.531570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944255+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:09:34.944255+0000","last_peered":"2023-12-07T21:09:34.944255+0000","last_clean":"2023-12-07T21:09:34.944255+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:09:34.944255+0000","last_undegraded":"2023-12-07T21:09:34.944255+0000","last_fullsized":"2023-12-07T21:09:34.944255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:14:35.831401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943322+0000","last_change":"2023-12-07T21:08:56.871124+0000","last_active":"2023-12-07T21:09:34.943322+0000","last_peered":"2023-12-07T21:09:34.943322+0000","last_clean":"2023-12-07T21:09:34.943322+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:09:34.943322+0000","last_undegraded":"2023-12-07T21:09:34.943322+0000","last_fullsized":"2023-12-07T21:09:34.943322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:26.744258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939061+0000","last_change":"2023-12-07T21:08:54.876774+0000","last_active":"2023-12-07T21:09:34.939061+0000","last_peered":"2023-12-07T21:09:34.939061+0000","last_clean":"2023-12-07T21:09:34.939061+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:09:34.939061+0000","last_undegraded":"2023-12-07T21:09:34.939061+0000","last_fullsized":"2023-12-07T21:09:34.939061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938263+0000","last_change":"2023-12-07T21:08:58.876085+0000","last_active":"2023-12-07T21:09:34.938263+0000","last_peered":"2023-12-07T21:09:34.938263+0000","last_clean":"2023-12-07T21:09:34.938263+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:09:34.938263+0000","last_undegraded":"2023-12-07T21:09:34.938263+0000","last_fullsized":"2023-12-07T21:09:34.938263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:40.595735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.692578+0000","last_change":"2023-12-07T21:09:00.892353+0000","last_active":"2023-12-07T21:10:18.692578+0000","last_peered":"2023-12-07T21:10:18.692578+0000","last_clean":"2023-12-07T21:10:18.692578+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:10:18.692578+0000","last_undegraded":"2023-12-07T21:10:18.692578+0000","last_fullsized":"2023-12-07T21:10:18.692578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:39.408633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943238+0000","last_change":"2023-12-07T21:09:02.906845+0000","last_active":"2023-12-07T21:09:34.943238+0000","last_peered":"2023-12-07T21:09:34.943238+0000","last_clean":"2023-12-07T21:09:34.943238+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:09:34.943238+0000","last_undegraded":"2023-12-07T21:09:34.943238+0000","last_fullsized":"2023-12-07T21:09:34.943238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:15:13.485261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939444+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:09:34.939444+0000","last_peered":"2023-12-07T21:09:34.939444+0000","last_clean":"2023-12-07T21:09:34.939444+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:09:34.939444+0000","last_undegraded":"2023-12-07T21:09:34.939444+0000","last_fullsized":"2023-12-07T21:09:34.939444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:13:50.090324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942745+0000","last_change":"2023-12-07T21:08:56.870984+0000","last_active":"2023-12-07T21:09:34.942745+0000","last_peered":"2023-12-07T21:09:34.942745+0000","last_clean":"2023-12-07T21:09:34.942745+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:09:34.942745+0000","last_undegraded":"2023-12-07T21:09:34.942745+0000","last_fullsized":"2023-12-07T21:09:34.942745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:19.739101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948342+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:09:34.948342+0000","last_peered":"2023-12-07T21:09:34.948342+0000","last_clean":"2023-12-07T21:09:34.948342+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:09:34.948342+0000","last_undegraded":"2023-12-07T21:09:34.948342+0000","last_fullsized":"2023-12-07T21:09:34.948342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:17.726699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943410+0000","last_change":"2023-12-07T21:08:58.881984+0000","last_active":"2023-12-07T21:09:34.943410+0000","last_peered":"2023-12-07T21:09:34.943410+0000","last_clean":"2023-12-07T21:09:34.943410+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:09:34.943410+0000","last_undegraded":"2023-12-07T21:09:34.943410+0000","last_fullsized":"2023-12-07T21:09:34.943410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:53.311660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.693633+0000","last_change":"2023-12-07T21:09:00.894601+0000","last_active":"2023-12-07T21:10:18.693633+0000","last_peered":"2023-12-07T21:10:18.693633+0000","last_clean":"2023-12-07T21:10:18.693633+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:10:18.693633+0000","last_undegraded":"2023-12-07T21:10:18.693633+0000","last_fullsized":"2023-12-07T21:10:18.693633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:18.116768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944508+0000","last_change":"2023-12-07T21:09:02.907688+0000","last_active":"2023-12-07T21:09:34.944508+0000","last_peered":"2023-12-07T21:09:34.944508+0000","last_clean":"2023-12-07T21:09:34.944508+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:09:34.944508+0000","last_undegraded":"2023-12-07T21:09:34.944508+0000","last_fullsized":"2023-12-07T21:09:34.944508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:45.243063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.096317+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:10:13.096317+0000","last_peered":"2023-12-07T21:10:13.096317+0000","last_clean":"2023-12-07T21:10:13.096317+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:10:13.096317+0000","last_undegraded":"2023-12-07T21:10:13.096317+0000","last_fullsized":"2023-12-07T21:10:13.096317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:30:05.746781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.608964+0000","last_change":"2023-12-07T21:08:56.873059+0000","last_active":"2023-12-07T21:09:36.608964+0000","last_peered":"2023-12-07T21:09:36.608964+0000","last_clean":"2023-12-07T21:09:36.608964+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:09:36.608964+0000","last_undegraded":"2023-12-07T21:09:36.608964+0000","last_fullsized":"2023-12-07T21:09:36.608964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:17:57.351679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.429429+0000","last_change":"2023-12-07T21:08:54.890887+0000","last_active":"2023-12-07T21:10:18.429429+0000","last_peered":"2023-12-07T21:10:18.429429+0000","last_clean":"2023-12-07T21:10:18.429429+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:10:18.429429+0000","last_undegraded":"2023-12-07T21:10:18.429429+0000","last_fullsized":"2023-12-07T21:10:18.429429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:13.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938058+0000","last_change":"2023-12-07T21:08:58.878440+0000","last_active":"2023-12-07T21:09:34.938058+0000","last_peered":"2023-12-07T21:09:34.938058+0000","last_clean":"2023-12-07T21:09:34.938058+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:09:34.938058+0000","last_undegraded":"2023-12-07T21:09:34.938058+0000","last_fullsized":"2023-12-07T21:09:34.938058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:17:59.358154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'24","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.718296+0000","last_change":"2023-12-07T21:09:00.889913+0000","last_active":"2023-12-07T21:10:18.718296+0000","last_peered":"2023-12-07T21:10:18.718296+0000","last_clean":"2023-12-07T21:10:18.718296+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:10:18.718296+0000","last_undegraded":"2023-12-07T21:10:18.718296+0000","last_fullsized":"2023-12-07T21:10:18.718296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:30.350522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945073+0000","last_change":"2023-12-07T21:09:02.906202+0000","last_active":"2023-12-07T21:09:34.945073+0000","last_peered":"2023-12-07T21:09:34.945073+0000","last_clean":"2023-12-07T21:09:34.945073+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:09:34.945073+0000","last_undegraded":"2023-12-07T21:09:34.945073+0000","last_fullsized":"2023-12-07T21:09:34.945073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:43.263341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.139472+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:10:59.139472+0000","last_peered":"2023-12-07T21:10:59.139472+0000","last_clean":"2023-12-07T21:10:59.139472+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:10:59.139472+0000","last_undegraded":"2023-12-07T21:10:59.139472+0000","last_fullsized":"2023-12-07T21:10:59.139472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:54:20.029030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'13","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737703+0000","last_change":"2023-12-07T21:08:56.869733+0000","last_active":"2023-12-07T21:10:18.737703+0000","last_peered":"2023-12-07T21:10:18.737703+0000","last_clean":"2023-12-07T21:10:18.737703+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:10:18.737703+0000","last_undegraded":"2023-12-07T21:10:18.737703+0000","last_fullsized":"2023-12-07T21:10:18.737703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:52.850966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.951401+0000","last_change":"2023-12-07T21:08:54.878825+0000","last_active":"2023-12-07T21:09:35.951401+0000","last_peered":"2023-12-07T21:09:35.951401+0000","last_clean":"2023-12-07T21:09:35.951401+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:09:35.951401+0000","last_undegraded":"2023-12-07T21:09:35.951401+0000","last_fullsized":"2023-12-07T21:09:35.951401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'6","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.755566+0000","last_change":"2023-12-07T21:08:58.877654+0000","last_active":"2023-12-07T21:10:59.755566+0000","last_peered":"2023-12-07T21:10:59.755566+0000","last_clean":"2023-12-07T21:10:59.755566+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:10:59.755566+0000","last_undegraded":"2023-12-07T21:10:59.755566+0000","last_fullsized":"2023-12-07T21:10:59.755566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:46:29.005775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:36.028017+0000","last_change":"2023-12-07T21:09:00.887872+0000","last_active":"2023-12-07T21:10:36.028017+0000","last_peered":"2023-12-07T21:10:36.028017+0000","last_clean":"2023-12-07T21:10:36.028017+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:10:36.028017+0000","last_undegraded":"2023-12-07T21:10:36.028017+0000","last_fullsized":"2023-12-07T21:10:36.028017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:24:17.551615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943699+0000","last_change":"2023-12-07T21:09:02.906870+0000","last_active":"2023-12-07T21:09:34.943699+0000","last_peered":"2023-12-07T21:09:34.943699+0000","last_clean":"2023-12-07T21:09:34.943699+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:09:34.943699+0000","last_undegraded":"2023-12-07T21:09:34.943699+0000","last_fullsized":"2023-12-07T21:09:34.943699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:58.034650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947166+0000","last_change":"2023-12-07T21:09:04.928655+0000","last_active":"2023-12-07T21:09:34.947166+0000","last_peered":"2023-12-07T21:09:34.947166+0000","last_clean":"2023-12-07T21:09:34.947166+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:09:34.947166+0000","last_undegraded":"2023-12-07T21:09:34.947166+0000","last_fullsized":"2023-12-07T21:09:34.947166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:38.068718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737343+0000","last_change":"2023-12-07T21:08:56.884246+0000","last_active":"2023-12-07T21:10:18.737343+0000","last_peered":"2023-12-07T21:10:18.737343+0000","last_clean":"2023-12-07T21:10:18.737343+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:10:18.737343+0000","last_undegraded":"2023-12-07T21:10:18.737343+0000","last_fullsized":"2023-12-07T21:10:18.737343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:59:20.004743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941027+0000","last_change":"2023-12-07T21:08:54.888408+0000","last_active":"2023-12-07T21:09:35.941027+0000","last_peered":"2023-12-07T21:09:35.941027+0000","last_clean":"2023-12-07T21:09:35.941027+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:09:35.941027+0000","last_undegraded":"2023-12-07T21:09:35.941027+0000","last_fullsized":"2023-12-07T21:09:35.941027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:47:51.435614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.366183+0000","last_change":"2023-12-07T21:08:56.873286+0000","last_active":"2023-12-07T21:09:36.366183+0000","last_peered":"2023-12-07T21:09:36.366183+0000","last_clean":"2023-12-07T21:09:36.366183+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:09:36.366183+0000","last_undegraded":"2023-12-07T21:09:36.366183+0000","last_fullsized":"2023-12-07T21:09:36.366183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:46.957293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941789+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:09:35.941789+0000","last_peered":"2023-12-07T21:09:35.941789+0000","last_clean":"2023-12-07T21:09:35.941789+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:09:35.941789+0000","last_undegraded":"2023-12-07T21:09:35.941789+0000","last_fullsized":"2023-12-07T21:09:35.941789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149073+0000","last_change":"2023-12-07T21:08:56.874905+0000","last_active":"2023-12-07T21:10:59.149073+0000","last_peered":"2023-12-07T21:10:59.149073+0000","last_clean":"2023-12-07T21:10:59.149073+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:10:59.149073+0000","last_undegraded":"2023-12-07T21:10:59.149073+0000","last_fullsized":"2023-12-07T21:10:59.149073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:54.612768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942708+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:09:35.942708+0000","last_peered":"2023-12-07T21:09:35.942708+0000","last_clean":"2023-12-07T21:09:35.942708+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:09:35.942708+0000","last_undegraded":"2023-12-07T21:09:35.942708+0000","last_fullsized":"2023-12-07T21:09:35.942708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:08:13.065644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944625+0000","last_change":"2023-12-07T21:08:56.872273+0000","last_active":"2023-12-07T21:09:34.944625+0000","last_peered":"2023-12-07T21:09:34.944625+0000","last_clean":"2023-12-07T21:09:34.944625+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:09:34.944625+0000","last_undegraded":"2023-12-07T21:09:34.944625+0000","last_fullsized":"2023-12-07T21:09:34.944625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:50.983783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942688+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:09:35.942688+0000","last_peered":"2023-12-07T21:09:35.942688+0000","last_clean":"2023-12-07T21:09:35.942688+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:09:35.942688+0000","last_undegraded":"2023-12-07T21:09:35.942688+0000","last_fullsized":"2023-12-07T21:09:35.942688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942566+0000","last_change":"2023-12-07T21:08:56.876070+0000","last_active":"2023-12-07T21:09:35.942566+0000","last_peered":"2023-12-07T21:09:35.942566+0000","last_clean":"2023-12-07T21:09:35.942566+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:09:35.942566+0000","last_undegraded":"2023-12-07T21:09:35.942566+0000","last_fullsized":"2023-12-07T21:09:35.942566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:19.739101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944830+0000","last_change":"2023-12-07T21:08:54.874578+0000","last_active":"2023-12-07T21:09:34.944830+0000","last_peered":"2023-12-07T21:09:34.944830+0000","last_clean":"2023-12-07T21:09:34.944830+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:09:34.944830+0000","last_undegraded":"2023-12-07T21:09:34.944830+0000","last_fullsized":"2023-12-07T21:09:34.944830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.366353+0000","last_change":"2023-12-07T21:08:56.883348+0000","last_active":"2023-12-07T21:09:36.366353+0000","last_peered":"2023-12-07T21:09:36.366353+0000","last_clean":"2023-12-07T21:09:36.366353+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:09:36.366353+0000","last_undegraded":"2023-12-07T21:09:36.366353+0000","last_fullsized":"2023-12-07T21:09:36.366353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:38:34.904995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938504+0000","last_change":"2023-12-07T21:08:54.887259+0000","last_active":"2023-12-07T21:09:34.938504+0000","last_peered":"2023-12-07T21:09:34.938504+0000","last_clean":"2023-12-07T21:09:34.938504+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:09:34.938504+0000","last_undegraded":"2023-12-07T21:09:34.938504+0000","last_fullsized":"2023-12-07T21:09:34.938504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942527+0000","last_change":"2023-12-07T21:08:56.876299+0000","last_active":"2023-12-07T21:09:35.942527+0000","last_peered":"2023-12-07T21:09:35.942527+0000","last_clean":"2023-12-07T21:09:35.942527+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:09:35.942527+0000","last_undegraded":"2023-12-07T21:09:35.942527+0000","last_fullsized":"2023-12-07T21:09:35.942527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:26.744258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945448+0000","last_change":"2023-12-07T21:08:54.885457+0000","last_active":"2023-12-07T21:09:34.945448+0000","last_peered":"2023-12-07T21:09:34.945448+0000","last_clean":"2023-12-07T21:09:34.945448+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:09:34.945448+0000","last_undegraded":"2023-12-07T21:09:34.945448+0000","last_fullsized":"2023-12-07T21:09:34.945448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.949262+0000","last_change":"2023-12-07T21:08:56.887101+0000","last_active":"2023-12-07T21:09:35.949262+0000","last_peered":"2023-12-07T21:09:35.949262+0000","last_clean":"2023-12-07T21:09:35.949262+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:09:35.949262+0000","last_undegraded":"2023-12-07T21:09:35.949262+0000","last_fullsized":"2023-12-07T21:09:35.949262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944921+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:09:34.944921+0000","last_peered":"2023-12-07T21:09:34.944921+0000","last_clean":"2023-12-07T21:09:34.944921+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:09:34.944921+0000","last_undegraded":"2023-12-07T21:09:34.944921+0000","last_fullsized":"2023-12-07T21:09:34.944921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:59.087021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939689+0000","last_change":"2023-12-07T21:08:56.882240+0000","last_active":"2023-12-07T21:09:34.939689+0000","last_peered":"2023-12-07T21:09:34.939689+0000","last_clean":"2023-12-07T21:09:34.939689+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:09:34.939689+0000","last_undegraded":"2023-12-07T21:09:34.939689+0000","last_fullsized":"2023-12-07T21:09:34.939689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:06:24.998742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945083+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:09:34.945083+0000","last_peered":"2023-12-07T21:09:34.945083+0000","last_clean":"2023-12-07T21:09:34.945083+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:09:34.945083+0000","last_undegraded":"2023-12-07T21:09:34.945083+0000","last_fullsized":"2023-12-07T21:09:34.945083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:45.038325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173489+0000","last_change":"2023-12-07T21:08:56.875906+0000","last_active":"2023-12-07T21:10:18.173489+0000","last_peered":"2023-12-07T21:10:18.173489+0000","last_clean":"2023-12-07T21:10:18.173489+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:10:18.173489+0000","last_undegraded":"2023-12-07T21:10:18.173489+0000","last_fullsized":"2023-12-07T21:10:18.173489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:40:40.318522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.582974+0000","last_change":"2023-12-07T21:08:54.883629+0000","last_active":"2023-12-07T21:09:36.582974+0000","last_peered":"2023-12-07T21:09:36.582974+0000","last_clean":"2023-12-07T21:09:36.582974+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:09:36.582974+0000","last_undegraded":"2023-12-07T21:09:36.582974+0000","last_fullsized":"2023-12-07T21:09:36.582974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945789+0000","last_change":"2023-12-07T21:08:56.876309+0000","last_active":"2023-12-07T21:09:34.945789+0000","last_peered":"2023-12-07T21:09:34.945789+0000","last_clean":"2023-12-07T21:09:34.945789+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:09:34.945789+0000","last_undegraded":"2023-12-07T21:09:34.945789+0000","last_fullsized":"2023-12-07T21:09:34.945789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938005+0000","last_change":"2023-12-07T21:08:54.887130+0000","last_active":"2023-12-07T21:09:34.938005+0000","last_peered":"2023-12-07T21:09:34.938005+0000","last_clean":"2023-12-07T21:09:34.938005+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:09:34.938005+0000","last_undegraded":"2023-12-07T21:09:34.938005+0000","last_fullsized":"2023-12-07T21:09:34.938005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:18.078984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.359942+0000","last_change":"2023-12-07T21:08:56.871205+0000","last_active":"2023-12-07T21:09:36.359942+0000","last_peered":"2023-12-07T21:09:36.359942+0000","last_clean":"2023-12-07T21:09:36.359942+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:09:36.359942+0000","last_undegraded":"2023-12-07T21:09:36.359942+0000","last_fullsized":"2023-12-07T21:09:36.359942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:28:15.740800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938315+0000","last_change":"2023-12-07T21:08:54.884013+0000","last_active":"2023-12-07T21:09:34.938315+0000","last_peered":"2023-12-07T21:09:34.938315+0000","last_clean":"2023-12-07T21:09:34.938315+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:09:34.938315+0000","last_undegraded":"2023-12-07T21:09:34.938315+0000","last_fullsized":"2023-12-07T21:09:34.938315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.021932+0000","last_change":"2023-12-07T21:08:56.879513+0000","last_active":"2023-12-07T21:09:37.021932+0000","last_peered":"2023-12-07T21:09:37.021932+0000","last_clean":"2023-12-07T21:09:37.021932+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:09:37.021932+0000","last_undegraded":"2023-12-07T21:09:37.021932+0000","last_fullsized":"2023-12-07T21:09:37.021932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:46.957293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947567+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:09:34.947567+0000","last_peered":"2023-12-07T21:09:34.947567+0000","last_clean":"2023-12-07T21:09:34.947567+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:09:34.947567+0000","last_undegraded":"2023-12-07T21:09:34.947567+0000","last_fullsized":"2023-12-07T21:09:34.947567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:20.130565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'15","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173409+0000","last_change":"2023-12-07T21:08:56.882760+0000","last_active":"2023-12-07T21:10:18.173409+0000","last_peered":"2023-12-07T21:10:18.173409+0000","last_clean":"2023-12-07T21:10:18.173409+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:10:18.173409+0000","last_undegraded":"2023-12-07T21:10:18.173409+0000","last_fullsized":"2023-12-07T21:10:18.173409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:19:53.055254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948503+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:09:34.948503+0000","last_peered":"2023-12-07T21:09:34.948503+0000","last_clean":"2023-12-07T21:09:34.948503+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:09:34.948503+0000","last_undegraded":"2023-12-07T21:09:34.948503+0000","last_fullsized":"2023-12-07T21:09:34.948503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:57.843520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737487+0000","last_change":"2023-12-07T21:08:56.876875+0000","last_active":"2023-12-07T21:10:18.737487+0000","last_peered":"2023-12-07T21:10:18.737487+0000","last_clean":"2023-12-07T21:10:18.737487+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:10:18.737487+0000","last_undegraded":"2023-12-07T21:10:18.737487+0000","last_fullsized":"2023-12-07T21:10:18.737487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:53.347638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945653+0000","last_change":"2023-12-07T21:08:54.885432+0000","last_active":"2023-12-07T21:09:34.945653+0000","last_peered":"2023-12-07T21:09:34.945653+0000","last_clean":"2023-12-07T21:09:34.945653+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:09:34.945653+0000","last_undegraded":"2023-12-07T21:09:34.945653+0000","last_fullsized":"2023-12-07T21:09:34.945653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737853+0000","last_change":"2023-12-07T21:08:56.889380+0000","last_active":"2023-12-07T21:10:18.737853+0000","last_peered":"2023-12-07T21:10:18.737853+0000","last_clean":"2023-12-07T21:10:18.737853+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:10:18.737853+0000","last_undegraded":"2023-12-07T21:10:18.737853+0000","last_fullsized":"2023-12-07T21:10:18.737853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:47.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948829+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:09:34.948829+0000","last_peered":"2023-12-07T21:09:34.948829+0000","last_clean":"2023-12-07T21:09:34.948829+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:09:34.948829+0000","last_undegraded":"2023-12-07T21:09:34.948829+0000","last_fullsized":"2023-12-07T21:09:34.948829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:45.814396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945250+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:09:34.945250+0000","last_peered":"2023-12-07T21:09:34.945250+0000","last_clean":"2023-12-07T21:09:34.945250+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:09:34.945250+0000","last_undegraded":"2023-12-07T21:09:34.945250+0000","last_fullsized":"2023-12-07T21:09:34.945250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:24.756037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.066771+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:09:36.066771+0000","last_peered":"2023-12-07T21:09:36.066771+0000","last_clean":"2023-12-07T21:09:36.066771+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:09:36.066771+0000","last_undegraded":"2023-12-07T21:09:36.066771+0000","last_fullsized":"2023-12-07T21:09:36.066771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943662+0000","last_change":"2023-12-07T21:08:54.883760+0000","last_active":"2023-12-07T21:09:34.943662+0000","last_peered":"2023-12-07T21:09:34.943662+0000","last_clean":"2023-12-07T21:09:34.943662+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:09:34.943662+0000","last_undegraded":"2023-12-07T21:09:34.943662+0000","last_fullsized":"2023-12-07T21:09:34.943662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938907+0000","last_change":"2023-12-07T21:08:56.881838+0000","last_active":"2023-12-07T21:09:34.938907+0000","last_peered":"2023-12-07T21:09:34.938907+0000","last_clean":"2023-12-07T21:09:34.938907+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:09:34.938907+0000","last_undegraded":"2023-12-07T21:09:34.938907+0000","last_fullsized":"2023-12-07T21:09:34.938907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:29.862000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1340,"num_read_kb":1123,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1173,"ondisk_log_size":1173,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":351,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705697,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.35099999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54300000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.34499999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56899999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34300000000000003,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.44400000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52500000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.375},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.34599999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33300000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.50800000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.219,"15min":0.219},"max":{"1min":0.58699999999999997,"5min":0.621,"15min":0.621},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.318,"15min":0.318},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.39100000000000001,"5min":0.436,"15min":0.436},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.247,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.307}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28000000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.434},{"interface":"front","average":{"1min":0.442,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.23799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.54200000000000004,"5min":0.629,"15min":0.629},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.373},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.38},"min":{"1min":0.25900000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.48399999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.39000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68300000000000005,"5min":0.747,"15min":0.747},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:11:07.253 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-07T21:11:07.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:11:07.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.388+0000 7f420e475640 1 Processor -- start 2023-12-07T21:11:07.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.388+0000 7f420e475640 1 -- start start 2023-12-07T21:11:07.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.388+0000 7f420e475640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f420806cc90 0x7f420806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:07.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.388+0000 7f420e475640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4208070340 con 0x7f420806d5b0 2023-12-07T21:11:07.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.388+0000 7f420e475640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4208097940 con 0x7f420806cc90 2023-12-07T21:11:07.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.389+0000 7f4207fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f420806cc90 0x7f420806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:07.381 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.389+0000 7f42077fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f420806d5b0 0x7f42080950b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39492/0 (socket says 172.21.15.89:39492) 2023-12-07T21:11:07.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.389+0000 7f42077fe640 1 -- 172.21.15.89:0/446828949 learned_addr learned my addr 172.21.15.89:0/446828949 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:07.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.389+0000 7f4207fff640 1 -- 172.21.15.89:0/446828949 >> v1:172.21.15.89:6789/0 conn(0x7f420806d5b0 legacy=0x7f42080950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.382 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.389+0000 7f4207fff640 1 -- 172.21.15.89:0/446828949 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208071900 con 0x7f420806cc90 2023-12-07T21:11:07.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.390+0000 7f4207fff640 1 --2- 172.21.15.89:0/446828949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420806cc90 0x7f420806d070 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009720 tx=0x7f41f802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536db63d41f98274 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:07.384 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.390+0000 7f4206ffd640 1 -- 172.21.15.89:0/446828949 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41f802e070 con 0x7f420806cc90 2023-12-07T21:11:07.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.390+0000 7f4206ffd640 1 -- 172.21.15.89:0/446828949 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f80316d0 con 0x7f420806cc90 2023-12-07T21:11:07.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.390+0000 7f4206ffd640 1 -- 172.21.15.89:0/446828949 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41f8031990 con 0x7f420806cc90 2023-12-07T21:11:07.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.390+0000 7f420e475640 1 -- 172.21.15.89:0/446828949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420806cc90 msgr2=0x7f420806d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.390+0000 7f420e475640 1 --2- 172.21.15.89:0/446828949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420806cc90 0x7f420806d070 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009720 tx=0x7f41f802b840 comp rx=0 tx=0).stop 2023-12-07T21:11:07.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.390+0000 7f420e475640 1 -- 172.21.15.89:0/446828949 shutdown_connections 2023-12-07T21:11:07.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.390+0000 7f420e475640 1 --2- 172.21.15.89:0/446828949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420806cc90 0x7f420806d070 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.390+0000 7f420e475640 1 -- 172.21.15.89:0/446828949 >> 172.21.15.89:0/446828949 conn(0x7f42080987f0 msgr2=0x7f4208098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:07.385 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.390+0000 7f420e475640 1 -- 172.21.15.89:0/446828949 shutdown_connections 2023-12-07T21:11:07.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.390+0000 7f420e475640 1 -- 172.21.15.89:0/446828949 wait complete. 2023-12-07T21:11:07.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.391+0000 7f420e475640 1 Processor -- start 2023-12-07T21:11:07.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.391+0000 7f420e475640 1 -- start start 2023-12-07T21:11:07.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f420e475640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420806cc90 0x7f4208088ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:07.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f420e475640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420808b670 con 0x7f420806cc90 2023-12-07T21:11:07.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f4207fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420806cc90 0x7f4208088ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:07.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f4207fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420806cc90 0x7f4208088ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38248/0 (socket says 172.21.15.89:38248) 2023-12-07T21:11:07.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f4207fff640 1 -- 172.21.15.89:0/996437623 learned_addr learned my addr 172.21.15.89:0/996437623 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:07.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f4207fff640 1 -- 172.21.15.89:0/996437623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8009400 con 0x7f420806cc90 2023-12-07T21:11:07.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f4207fff640 1 --2- 172.21.15.89:0/996437623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420806cc90 0x7f4208088ff0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f41f8034040 tx=0x7f41f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:07.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f4204ff9640 1 -- 172.21.15.89:0/996437623 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41f8032830 con 0x7f420806cc90 2023-12-07T21:11:07.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f4204ff9640 1 -- 172.21.15.89:0/996437623 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f8032990 con 0x7f420806cc90 2023-12-07T21:11:07.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f420e475640 1 -- 172.21.15.89:0/996437623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420808aa20 con 0x7f420806cc90 2023-12-07T21:11:07.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f4204ff9640 1 -- 172.21.15.89:0/996437623 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41f8032c50 con 0x7f420806cc90 2023-12-07T21:11:07.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.392+0000 7f420e475640 1 -- 172.21.15.89:0/996437623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42080951d0 con 0x7f420806cc90 2023-12-07T21:11:07.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.393+0000 7f4204ff9640 1 -- 172.21.15.89:0/996437623 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f41f804d3f0 con 0x7f420806cc90 2023-12-07T21:11:07.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.393+0000 7f4204ff9640 1 --2- 172.21.15.89:0/996437623 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f41f4037820 0x7f41f4039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:07.388 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.393+0000 7f4204ff9640 1 -- 172.21.15.89:0/996437623 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f41f806c9f0 con 0x7f420806cc90 2023-12-07T21:11:07.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.393+0000 7f420e475640 1 -- 172.21.15.89:0/996437623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4208062110 con 0x7f420806cc90 2023-12-07T21:11:07.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.393+0000 7f42077fe640 1 --2- 172.21.15.89:0/996437623 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f41f4037820 0x7f41f4039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:07.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.394+0000 7f42077fe640 1 --2- 172.21.15.89:0/996437623 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f41f4037820 0x7f41f4039ce0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f41fc007fd0 tx=0x7f41fc007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:07.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.398+0000 7f4204ff9640 1 -- 172.21.15.89:0/996437623 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41f8032db0 con 0x7f420806cc90 2023-12-07T21:11:07.551 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.559+0000 7f420e475640 1 -- 172.21.15.89:0/996437623 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4208070bf0 con 0x7f41f4037820 2023-12-07T21:11:07.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.575+0000 7f4204ff9640 1 -- 172.21.15.89:0/996437623 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673370 (secure 0 0 0) 0x7f41fc0012f0 con 0x7f41f4037820 2023-12-07T21:11:07.573 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:11:07.579 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:11:07.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.579+0000 7f420e475640 1 -- 172.21.15.89:0/996437623 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f41f4037820 msgr2=0x7f41f4039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.579+0000 7f420e475640 1 --2- 172.21.15.89:0/996437623 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f41f4037820 0x7f41f4039ce0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f41fc007fd0 tx=0x7f41fc007ac0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.579+0000 7f420e475640 1 -- 172.21.15.89:0/996437623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420806cc90 msgr2=0x7f4208088ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.579+0000 7f420e475640 1 --2- 172.21.15.89:0/996437623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420806cc90 0x7f4208088ff0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f41f8034040 tx=0x7f41f80046c0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.579+0000 7f420e475640 1 -- 172.21.15.89:0/996437623 shutdown_connections 2023-12-07T21:11:07.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.579+0000 7f420e475640 1 --2- 172.21.15.89:0/996437623 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f41f4037820 0x7f41f4039ce0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.579+0000 7f420e475640 1 --2- 172.21.15.89:0/996437623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420806cc90 0x7f4208088ff0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.579+0000 7f420e475640 1 -- 172.21.15.89:0/996437623 >> 172.21.15.89:0/996437623 conn(0x7f42080987f0 msgr2=0x7f420809a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:07.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.579+0000 7f420e475640 1 -- 172.21.15.89:0/996437623 shutdown_connections 2023-12-07T21:11:07.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.579+0000 7f420e475640 1 -- 172.21.15.89:0/996437623 wait complete. 2023-12-07T21:11:07.582 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-12-07T21:11:06.089316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3322,"num_read_kb":2967,"num_write":1456,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3704,"ondisk_log_size":3704,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-77,"num_objects":-13,"num_object_clones":0,"num_object_copies":-27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":148,"num_read_kb":145,"num_write":51,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004171"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944900+0000","last_change":"2023-12-07T21:08:54.882968+0000","last_active":"2023-12-07T21:09:35.944900+0000","last_peered":"2023-12-07T21:09:35.944900+0000","last_clean":"2023-12-07T21:09:35.944900+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:09:35.944900+0000","last_undegraded":"2023-12-07T21:09:35.944900+0000","last_fullsized":"2023-12-07T21:09:35.944900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937447+0000","last_change":"2023-12-07T21:08:56.887127+0000","last_active":"2023-12-07T21:09:34.937447+0000","last_peered":"2023-12-07T21:09:34.937447+0000","last_clean":"2023-12-07T21:09:34.937447+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:09:34.937447+0000","last_undegraded":"2023-12-07T21:09:34.937447+0000","last_fullsized":"2023-12-07T21:09:34.937447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.595639+0000","last_change":"2023-12-07T21:08:54.890832+0000","last_active":"2023-12-07T21:09:36.595639+0000","last_peered":"2023-12-07T21:09:36.595639+0000","last_clean":"2023-12-07T21:09:36.595639+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:09:36.595639+0000","last_undegraded":"2023-12-07T21:09:36.595639+0000","last_fullsized":"2023-12-07T21:09:36.595639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:26.381861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.028116+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:09:37.028116+0000","last_peered":"2023-12-07T21:09:37.028116+0000","last_clean":"2023-12-07T21:09:37.028116+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:09:37.028116+0000","last_undegraded":"2023-12-07T21:09:37.028116+0000","last_fullsized":"2023-12-07T21:09:37.028116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:04:30.142969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.600004+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:09:36.600004+0000","last_peered":"2023-12-07T21:09:36.600004+0000","last_clean":"2023-12-07T21:09:36.600004+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:09:36.600004+0000","last_undegraded":"2023-12-07T21:09:36.600004+0000","last_fullsized":"2023-12-07T21:09:36.600004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:44.944890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946396+0000","last_change":"2023-12-07T21:08:56.873919+0000","last_active":"2023-12-07T21:09:34.946396+0000","last_peered":"2023-12-07T21:09:34.946396+0000","last_clean":"2023-12-07T21:09:34.946396+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:09:34.946396+0000","last_undegraded":"2023-12-07T21:09:34.946396+0000","last_fullsized":"2023-12-07T21:09:34.946396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:25:16.160841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942772+0000","last_change":"2023-12-07T21:08:54.880442+0000","last_active":"2023-12-07T21:09:35.942772+0000","last_peered":"2023-12-07T21:09:35.942772+0000","last_clean":"2023-12-07T21:09:35.942772+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:09:35.942772+0000","last_undegraded":"2023-12-07T21:09:35.942772+0000","last_fullsized":"2023-12-07T21:09:35.942772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946759+0000","last_change":"2023-12-07T21:08:56.874751+0000","last_active":"2023-12-07T21:09:34.946759+0000","last_peered":"2023-12-07T21:09:34.946759+0000","last_clean":"2023-12-07T21:09:34.946759+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:09:34.946759+0000","last_undegraded":"2023-12-07T21:09:34.946759+0000","last_fullsized":"2023-12-07T21:09:34.946759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:14.099961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945805+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:09:34.945805+0000","last_peered":"2023-12-07T21:09:34.945805+0000","last_clean":"2023-12-07T21:09:34.945805+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:09:34.945805+0000","last_undegraded":"2023-12-07T21:09:34.945805+0000","last_fullsized":"2023-12-07T21:09:34.945805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:18.585963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'7","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149300+0000","last_change":"2023-12-07T21:08:56.873414+0000","last_active":"2023-12-07T21:10:59.149300+0000","last_peered":"2023-12-07T21:10:59.149300+0000","last_clean":"2023-12-07T21:10:59.149300+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:10:59.149300+0000","last_undegraded":"2023-12-07T21:10:59.149300+0000","last_fullsized":"2023-12-07T21:10:59.149300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:46.057644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942843+0000","last_change":"2023-12-07T21:08:54.880274+0000","last_active":"2023-12-07T21:09:34.942843+0000","last_peered":"2023-12-07T21:09:34.942843+0000","last_clean":"2023-12-07T21:09:34.942843+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:09:34.942843+0000","last_undegraded":"2023-12-07T21:09:34.942843+0000","last_fullsized":"2023-12-07T21:09:34.942843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:18.078984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173549+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:10:18.173549+0000","last_peered":"2023-12-07T21:10:18.173549+0000","last_clean":"2023-12-07T21:10:18.173549+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:10:18.173549+0000","last_undegraded":"2023-12-07T21:10:18.173549+0000","last_fullsized":"2023-12-07T21:10:18.173549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:12.509153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945158+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:09:34.945158+0000","last_peered":"2023-12-07T21:09:34.945158+0000","last_clean":"2023-12-07T21:09:34.945158+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:09:34.945158+0000","last_undegraded":"2023-12-07T21:09:34.945158+0000","last_fullsized":"2023-12-07T21:09:34.945158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:55:25.782947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173686+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:10:59.173686+0000","last_peered":"2023-12-07T21:10:59.173686+0000","last_clean":"2023-12-07T21:10:59.173686+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:10:59.173686+0000","last_undegraded":"2023-12-07T21:10:59.173686+0000","last_fullsized":"2023-12-07T21:10:59.173686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943504+0000","last_change":"2023-12-07T21:08:54.891021+0000","last_active":"2023-12-07T21:09:34.943504+0000","last_peered":"2023-12-07T21:09:34.943504+0000","last_clean":"2023-12-07T21:09:34.943504+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:09:34.943504+0000","last_undegraded":"2023-12-07T21:09:34.943504+0000","last_fullsized":"2023-12-07T21:09:34.943504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'13","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.745821+0000","last_change":"2023-12-07T21:08:56.874321+0000","last_active":"2023-12-07T21:10:18.745821+0000","last_peered":"2023-12-07T21:10:18.745821+0000","last_clean":"2023-12-07T21:10:18.745821+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:10:18.745821+0000","last_undegraded":"2023-12-07T21:10:18.745821+0000","last_fullsized":"2023-12-07T21:10:18.745821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.602232+0000","last_change":"2023-12-07T21:08:56.874409+0000","last_active":"2023-12-07T21:09:36.602232+0000","last_peered":"2023-12-07T21:09:36.602232+0000","last_clean":"2023-12-07T21:09:36.602232+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:09:36.602232+0000","last_undegraded":"2023-12-07T21:09:36.602232+0000","last_fullsized":"2023-12-07T21:09:36.602232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:58.215716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939442+0000","last_change":"2023-12-07T21:08:54.887766+0000","last_active":"2023-12-07T21:09:34.939442+0000","last_peered":"2023-12-07T21:09:34.939442+0000","last_clean":"2023-12-07T21:09:34.939442+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:09:34.939442+0000","last_undegraded":"2023-12-07T21:09:34.939442+0000","last_fullsized":"2023-12-07T21:09:34.939442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149056+0000","last_change":"2023-12-07T21:08:56.876692+0000","last_active":"2023-12-07T21:10:59.149056+0000","last_peered":"2023-12-07T21:10:59.149056+0000","last_clean":"2023-12-07T21:10:59.149056+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:10:59.149056+0000","last_undegraded":"2023-12-07T21:10:59.149056+0000","last_fullsized":"2023-12-07T21:10:59.149056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945726+0000","last_change":"2023-12-07T21:08:54.885605+0000","last_active":"2023-12-07T21:09:34.945726+0000","last_peered":"2023-12-07T21:09:34.945726+0000","last_clean":"2023-12-07T21:09:34.945726+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:09:34.945726+0000","last_undegraded":"2023-12-07T21:09:34.945726+0000","last_fullsized":"2023-12-07T21:09:34.945726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'13","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149284+0000","last_change":"2023-12-07T21:08:56.882602+0000","last_active":"2023-12-07T21:10:59.149284+0000","last_peered":"2023-12-07T21:10:59.149284+0000","last_clean":"2023-12-07T21:10:59.149284+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:10:59.149284+0000","last_undegraded":"2023-12-07T21:10:59.149284+0000","last_fullsized":"2023-12-07T21:10:59.149284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:35.042292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939428+0000","last_change":"2023-12-07T21:08:54.889812+0000","last_active":"2023-12-07T21:09:34.939428+0000","last_peered":"2023-12-07T21:09:34.939428+0000","last_clean":"2023-12-07T21:09:34.939428+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:09:34.939428+0000","last_undegraded":"2023-12-07T21:09:34.939428+0000","last_fullsized":"2023-12-07T21:09:34.939428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.609048+0000","last_change":"2023-12-07T21:08:56.875989+0000","last_active":"2023-12-07T21:09:36.609048+0000","last_peered":"2023-12-07T21:09:36.609048+0000","last_clean":"2023-12-07T21:09:36.609048+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:09:36.609048+0000","last_undegraded":"2023-12-07T21:09:36.609048+0000","last_fullsized":"2023-12-07T21:09:36.609048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938981+0000","last_change":"2023-12-07T21:08:54.878784+0000","last_active":"2023-12-07T21:09:34.938981+0000","last_peered":"2023-12-07T21:09:34.938981+0000","last_clean":"2023-12-07T21:09:34.938981+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:09:34.938981+0000","last_undegraded":"2023-12-07T21:09:34.938981+0000","last_fullsized":"2023-12-07T21:09:34.938981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.022134+0000","last_change":"2023-12-07T21:08:56.875039+0000","last_active":"2023-12-07T21:09:37.022134+0000","last_peered":"2023-12-07T21:09:37.022134+0000","last_clean":"2023-12-07T21:09:37.022134+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:09:37.022134+0000","last_undegraded":"2023-12-07T21:09:37.022134+0000","last_fullsized":"2023-12-07T21:09:37.022134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944921+0000","last_change":"2023-12-07T21:08:54.890574+0000","last_active":"2023-12-07T21:09:34.944921+0000","last_peered":"2023-12-07T21:09:34.944921+0000","last_clean":"2023-12-07T21:09:34.944921+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:09:34.944921+0000","last_undegraded":"2023-12-07T21:09:34.944921+0000","last_fullsized":"2023-12-07T21:09:34.944921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939610+0000","last_change":"2023-12-07T21:08:56.883504+0000","last_active":"2023-12-07T21:09:34.939610+0000","last_peered":"2023-12-07T21:09:34.939610+0000","last_clean":"2023-12-07T21:09:34.939610+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:09:34.939610+0000","last_undegraded":"2023-12-07T21:09:34.939610+0000","last_fullsized":"2023-12-07T21:09:34.939610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:51.305185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946035+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:09:34.946035+0000","last_peered":"2023-12-07T21:09:34.946035+0000","last_clean":"2023-12-07T21:09:34.946035+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:09:34.946035+0000","last_undegraded":"2023-12-07T21:09:34.946035+0000","last_fullsized":"2023-12-07T21:09:34.946035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:50:11.989738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.964931+0000","last_change":"2023-12-07T21:09:04.931981+0000","last_active":"2023-12-07T21:10:59.964931+0000","last_peered":"2023-12-07T21:10:59.964931+0000","last_clean":"2023-12-07T21:10:59.964931+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:10:59.964931+0000","last_undegraded":"2023-12-07T21:10:59.964931+0000","last_fullsized":"2023-12-07T21:10:59.964931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:53.521686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.021786+0000","last_change":"2023-12-07T21:08:56.873551+0000","last_active":"2023-12-07T21:09:37.021786+0000","last_peered":"2023-12-07T21:09:37.021786+0000","last_clean":"2023-12-07T21:09:37.021786+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:09:37.021786+0000","last_undegraded":"2023-12-07T21:09:37.021786+0000","last_fullsized":"2023-12-07T21:09:37.021786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:25.387074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945597+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:09:34.945597+0000","last_peered":"2023-12-07T21:09:34.945597+0000","last_clean":"2023-12-07T21:09:34.945597+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:09:34.945597+0000","last_undegraded":"2023-12-07T21:09:34.945597+0000","last_fullsized":"2023-12-07T21:09:34.945597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:43.001000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"24'1","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.818090+0000","last_change":"2023-12-07T21:08:58.878371+0000","last_active":"2023-12-07T21:10:59.818090+0000","last_peered":"2023-12-07T21:10:59.818090+0000","last_clean":"2023-12-07T21:10:59.818090+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:10:59.818090+0000","last_undegraded":"2023-12-07T21:10:59.818090+0000","last_fullsized":"2023-12-07T21:10:59.818090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:31.248934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.711024+0000","last_change":"2023-12-07T21:09:00.895835+0000","last_active":"2023-12-07T21:10:18.711024+0000","last_peered":"2023-12-07T21:10:18.711024+0000","last_clean":"2023-12-07T21:10:18.711024+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:10:18.711024+0000","last_undegraded":"2023-12-07T21:10:18.711024+0000","last_fullsized":"2023-12-07T21:10:18.711024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:04:34.159776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939365+0000","last_change":"2023-12-07T21:09:02.907297+0000","last_active":"2023-12-07T21:09:34.939365+0000","last_peered":"2023-12-07T21:09:34.939365+0000","last_clean":"2023-12-07T21:09:34.939365+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:09:34.939365+0000","last_undegraded":"2023-12-07T21:09:34.939365+0000","last_fullsized":"2023-12-07T21:09:34.939365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:14.963344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.099231+0000","last_change":"2023-12-07T21:09:04.931948+0000","last_active":"2023-12-07T21:10:13.099231+0000","last_peered":"2023-12-07T21:10:13.099231+0000","last_clean":"2023-12-07T21:10:13.099231+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:10:13.099231+0000","last_undegraded":"2023-12-07T21:10:13.099231+0000","last_fullsized":"2023-12-07T21:10:13.099231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:01:26.083720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948422+0000","last_change":"2023-12-07T21:08:56.874761+0000","last_active":"2023-12-07T21:09:34.948422+0000","last_peered":"2023-12-07T21:09:34.948422+0000","last_clean":"2023-12-07T21:09:34.948422+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:09:34.948422+0000","last_undegraded":"2023-12-07T21:09:34.948422+0000","last_fullsized":"2023-12-07T21:09:34.948422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:15.592836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942644+0000","last_change":"2023-12-07T21:08:54.880632+0000","last_active":"2023-12-07T21:09:34.942644+0000","last_peered":"2023-12-07T21:09:34.942644+0000","last_clean":"2023-12-07T21:09:34.942644+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:09:34.942644+0000","last_undegraded":"2023-12-07T21:09:34.942644+0000","last_fullsized":"2023-12-07T21:09:34.942644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943879+0000","last_change":"2023-12-07T21:08:58.877458+0000","last_active":"2023-12-07T21:09:34.943879+0000","last_peered":"2023-12-07T21:09:34.943879+0000","last_clean":"2023-12-07T21:09:34.943879+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:09:34.943879+0000","last_undegraded":"2023-12-07T21:09:34.943879+0000","last_fullsized":"2023-12-07T21:09:34.943879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:26.789220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938986+0000","last_change":"2023-12-07T21:09:00.893179+0000","last_active":"2023-12-07T21:09:34.938986+0000","last_peered":"2023-12-07T21:09:34.938986+0000","last_clean":"2023-12-07T21:09:34.938986+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:09:34.938986+0000","last_undegraded":"2023-12-07T21:09:34.938986+0000","last_fullsized":"2023-12-07T21:09:34.938986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:01:24.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938667+0000","last_change":"2023-12-07T21:09:02.901036+0000","last_active":"2023-12-07T21:09:34.938667+0000","last_peered":"2023-12-07T21:09:34.938667+0000","last_clean":"2023-12-07T21:09:34.938667+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:09:34.938667+0000","last_undegraded":"2023-12-07T21:09:34.938667+0000","last_fullsized":"2023-12-07T21:09:34.938667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:43.815906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943377+0000","last_change":"2023-12-07T21:09:04.925464+0000","last_active":"2023-12-07T21:09:34.943377+0000","last_peered":"2023-12-07T21:09:34.943377+0000","last_clean":"2023-12-07T21:09:34.943377+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:09:34.943377+0000","last_undegraded":"2023-12-07T21:09:34.943377+0000","last_fullsized":"2023-12-07T21:09:34.943377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:05.623664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173385+0000","last_change":"2023-12-07T21:08:56.875484+0000","last_active":"2023-12-07T21:10:18.173385+0000","last_peered":"2023-12-07T21:10:18.173385+0000","last_clean":"2023-12-07T21:10:18.173385+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:10:18.173385+0000","last_undegraded":"2023-12-07T21:10:18.173385+0000","last_fullsized":"2023-12-07T21:10:18.173385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:53.554840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944843+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:09:34.944843+0000","last_peered":"2023-12-07T21:09:34.944843+0000","last_clean":"2023-12-07T21:09:34.944843+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:09:34.944843+0000","last_undegraded":"2023-12-07T21:09:34.944843+0000","last_fullsized":"2023-12-07T21:09:34.944843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:44:12.242883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945726+0000","last_change":"2023-12-07T21:08:58.880158+0000","last_active":"2023-12-07T21:09:34.945726+0000","last_peered":"2023-12-07T21:09:34.945726+0000","last_clean":"2023-12-07T21:09:34.945726+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:09:34.945726+0000","last_undegraded":"2023-12-07T21:09:34.945726+0000","last_fullsized":"2023-12-07T21:09:34.945726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:46:42.407725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943564+0000","last_change":"2023-12-07T21:09:00.890726+0000","last_active":"2023-12-07T21:09:34.943564+0000","last_peered":"2023-12-07T21:09:34.943564+0000","last_clean":"2023-12-07T21:09:34.943564+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:09:34.943564+0000","last_undegraded":"2023-12-07T21:09:34.943564+0000","last_fullsized":"2023-12-07T21:09:34.943564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:46:44.418058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'243","reported_seq":309,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.970866+0000","last_change":"2023-12-07T21:09:02.906250+0000","last_active":"2023-12-07T21:10:59.970866+0000","last_peered":"2023-12-07T21:10:59.970866+0000","last_clean":"2023-12-07T21:10:59.970866+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:10:59.970866+0000","last_undegraded":"2023-12-07T21:10:59.970866+0000","last_fullsized":"2023-12-07T21:10:59.970866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:09.157302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942609+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:09:34.942609+0000","last_peered":"2023-12-07T21:09:34.942609+0000","last_clean":"2023-12-07T21:09:34.942609+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:09:34.942609+0000","last_undegraded":"2023-12-07T21:09:34.942609+0000","last_fullsized":"2023-12-07T21:09:34.942609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:38.570544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149295+0000","last_change":"2023-12-07T21:08:56.885545+0000","last_active":"2023-12-07T21:10:59.149295+0000","last_peered":"2023-12-07T21:10:59.149295+0000","last_clean":"2023-12-07T21:10:59.149295+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:10:59.149295+0000","last_undegraded":"2023-12-07T21:10:59.149295+0000","last_fullsized":"2023-12-07T21:10:59.149295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937355+0000","last_change":"2023-12-07T21:08:54.878527+0000","last_active":"2023-12-07T21:09:34.937355+0000","last_peered":"2023-12-07T21:09:34.937355+0000","last_clean":"2023-12-07T21:09:34.937355+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:09:34.937355+0000","last_undegraded":"2023-12-07T21:09:34.937355+0000","last_fullsized":"2023-12-07T21:09:34.937355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:44:21.586858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.950706+0000","last_change":"2023-12-07T21:09:35.950706+0000","last_active":"2023-12-07T21:09:35.950706+0000","last_peered":"2023-12-07T21:09:35.950706+0000","last_clean":"2023-12-07T21:09:35.950706+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:09:35.950706+0000","last_undegraded":"2023-12-07T21:09:35.950706+0000","last_fullsized":"2023-12-07T21:09:35.950706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:55.202208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.705204+0000","last_change":"2023-12-07T21:09:00.892788+0000","last_active":"2023-12-07T21:10:18.705204+0000","last_peered":"2023-12-07T21:10:18.705204+0000","last_clean":"2023-12-07T21:10:18.705204+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:10:18.705204+0000","last_undegraded":"2023-12-07T21:10:18.705204+0000","last_fullsized":"2023-12-07T21:10:18.705204+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:02.232524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'243","reported_seq":326,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.974960+0000","last_change":"2023-12-07T21:09:02.901266+0000","last_active":"2023-12-07T21:10:59.974960+0000","last_peered":"2023-12-07T21:10:59.974960+0000","last_clean":"2023-12-07T21:10:59.974960+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:10:59.974960+0000","last_undegraded":"2023-12-07T21:10:59.974960+0000","last_fullsized":"2023-12-07T21:10:59.974960+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:00.730866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149018+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:10:59.149018+0000","last_peered":"2023-12-07T21:10:59.149018+0000","last_clean":"2023-12-07T21:10:59.149018+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:10:59.149018+0000","last_undegraded":"2023-12-07T21:10:59.149018+0000","last_fullsized":"2023-12-07T21:10:59.149018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:05.147754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946220+0000","last_change":"2023-12-07T21:08:54.880253+0000","last_active":"2023-12-07T21:09:34.946220+0000","last_peered":"2023-12-07T21:09:34.946220+0000","last_clean":"2023-12-07T21:09:34.946220+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:09:34.946220+0000","last_undegraded":"2023-12-07T21:09:34.946220+0000","last_fullsized":"2023-12-07T21:09:34.946220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937686+0000","last_change":"2023-12-07T21:08:58.877986+0000","last_active":"2023-12-07T21:09:34.937686+0000","last_peered":"2023-12-07T21:09:34.937686+0000","last_clean":"2023-12-07T21:09:34.937686+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:09:34.937686+0000","last_undegraded":"2023-12-07T21:09:34.937686+0000","last_fullsized":"2023-12-07T21:09:34.937686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:07.154229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'39","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.127461+0000","last_change":"2023-12-07T21:09:00.888749+0000","last_active":"2023-12-07T21:10:59.127461+0000","last_peered":"2023-12-07T21:10:59.127461+0000","last_clean":"2023-12-07T21:10:59.127461+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:10:59.127461+0000","last_undegraded":"2023-12-07T21:10:59.127461+0000","last_fullsized":"2023-12-07T21:10:59.127461+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:09.164561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944403+0000","last_change":"2023-12-07T21:09:02.897538+0000","last_active":"2023-12-07T21:09:34.944403+0000","last_peered":"2023-12-07T21:09:34.944403+0000","last_clean":"2023-12-07T21:09:34.944403+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:09:34.944403+0000","last_undegraded":"2023-12-07T21:09:34.944403+0000","last_fullsized":"2023-12-07T21:09:34.944403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:14.963344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.550827+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:10:18.550827+0000","last_peered":"2023-12-07T21:10:18.550827+0000","last_clean":"2023-12-07T21:10:18.550827+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:10:18.550827+0000","last_undegraded":"2023-12-07T21:10:18.550827+0000","last_fullsized":"2023-12-07T21:10:18.550827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:02.886090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'21","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173496+0000","last_change":"2023-12-07T21:08:56.871222+0000","last_active":"2023-12-07T21:10:18.173496+0000","last_peered":"2023-12-07T21:10:18.173496+0000","last_clean":"2023-12-07T21:10:18.173496+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:10:18.173496+0000","last_undegraded":"2023-12-07T21:10:18.173496+0000","last_fullsized":"2023-12-07T21:10:18.173496+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:00:00.778558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944073+0000","last_change":"2023-12-07T21:08:54.885249+0000","last_active":"2023-12-07T21:09:34.944073+0000","last_peered":"2023-12-07T21:09:34.944073+0000","last_clean":"2023-12-07T21:09:34.944073+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:09:34.944073+0000","last_undegraded":"2023-12-07T21:09:34.944073+0000","last_fullsized":"2023-12-07T21:09:34.944073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:59.087021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943751+0000","last_change":"2023-12-07T21:08:58.880254+0000","last_active":"2023-12-07T21:09:34.943751+0000","last_peered":"2023-12-07T21:09:34.943751+0000","last_clean":"2023-12-07T21:09:34.943751+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:09:34.943751+0000","last_undegraded":"2023-12-07T21:09:34.943751+0000","last_fullsized":"2023-12-07T21:09:34.943751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:59:22.011218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'30","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.694667+0000","last_change":"2023-12-07T21:09:00.895444+0000","last_active":"2023-12-07T21:10:18.694667+0000","last_peered":"2023-12-07T21:10:18.694667+0000","last_clean":"2023-12-07T21:10:18.694667+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:10:18.694667+0000","last_undegraded":"2023-12-07T21:10:18.694667+0000","last_fullsized":"2023-12-07T21:10:18.694667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:09:52.225596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943466+0000","last_change":"2023-12-07T21:09:02.906821+0000","last_active":"2023-12-07T21:09:34.943466+0000","last_peered":"2023-12-07T21:09:34.943466+0000","last_clean":"2023-12-07T21:09:34.943466+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:09:34.943466+0000","last_undegraded":"2023-12-07T21:09:34.943466+0000","last_fullsized":"2023-12-07T21:09:34.943466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:00.871254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.004149+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:10:13.004149+0000","last_peered":"2023-12-07T21:10:13.004149+0000","last_clean":"2023-12-07T21:10:13.004149+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:10:13.004149+0000","last_undegraded":"2023-12-07T21:10:13.004149+0000","last_fullsized":"2023-12-07T21:10:13.004149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:03.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943008+0000","last_change":"2023-12-07T21:08:56.879742+0000","last_active":"2023-12-07T21:09:34.943008+0000","last_peered":"2023-12-07T21:09:34.943008+0000","last_clean":"2023-12-07T21:09:34.943008+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:09:34.943008+0000","last_undegraded":"2023-12-07T21:09:34.943008+0000","last_fullsized":"2023-12-07T21:09:34.943008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:28:08.424793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948569+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:09:34.948569+0000","last_peered":"2023-12-07T21:09:34.948569+0000","last_clean":"2023-12-07T21:09:34.948569+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:09:34.948569+0000","last_undegraded":"2023-12-07T21:09:34.948569+0000","last_fullsized":"2023-12-07T21:09:34.948569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:29.350180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945631+0000","last_change":"2023-12-07T21:08:58.874569+0000","last_active":"2023-12-07T21:09:34.945631+0000","last_peered":"2023-12-07T21:09:34.945631+0000","last_clean":"2023-12-07T21:09:34.945631+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:09:34.945631+0000","last_undegraded":"2023-12-07T21:09:34.945631+0000","last_fullsized":"2023-12-07T21:09:34.945631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:25:29.329795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.717375+0000","last_change":"2023-12-07T21:09:00.889539+0000","last_active":"2023-12-07T21:10:18.717375+0000","last_peered":"2023-12-07T21:10:18.717375+0000","last_clean":"2023-12-07T21:10:18.717375+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:10:18.717375+0000","last_undegraded":"2023-12-07T21:10:18.717375+0000","last_fullsized":"2023-12-07T21:10:18.717375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:23.846766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'243","reported_seq":294,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.975948+0000","last_change":"2023-12-07T21:09:02.905689+0000","last_active":"2023-12-07T21:10:59.975948+0000","last_peered":"2023-12-07T21:10:59.975948+0000","last_clean":"2023-12-07T21:10:59.975948+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:10:59.975948+0000","last_undegraded":"2023-12-07T21:10:59.975948+0000","last_fullsized":"2023-12-07T21:10:59.975948+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:43.815906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944612+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:09:34.944612+0000","last_peered":"2023-12-07T21:09:34.944612+0000","last_clean":"2023-12-07T21:09:34.944612+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:09:34.944612+0000","last_undegraded":"2023-12-07T21:09:34.944612+0000","last_fullsized":"2023-12-07T21:09:34.944612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:27.874660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.602318+0000","last_change":"2023-12-07T21:08:56.870949+0000","last_active":"2023-12-07T21:09:36.602318+0000","last_peered":"2023-12-07T21:09:36.602318+0000","last_clean":"2023-12-07T21:09:36.602318+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:09:36.602318+0000","last_undegraded":"2023-12-07T21:09:36.602318+0000","last_fullsized":"2023-12-07T21:09:36.602318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:50.983783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947454+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:09:34.947454+0000","last_peered":"2023-12-07T21:09:34.947454+0000","last_clean":"2023-12-07T21:09:34.947454+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:09:34.947454+0000","last_undegraded":"2023-12-07T21:09:34.947454+0000","last_fullsized":"2023-12-07T21:09:34.947454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:48.971381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943934+0000","last_change":"2023-12-07T21:08:58.880111+0000","last_active":"2023-12-07T21:09:34.943934+0000","last_peered":"2023-12-07T21:09:34.943934+0000","last_clean":"2023-12-07T21:09:34.943934+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:09:34.943934+0000","last_undegraded":"2023-12-07T21:09:34.943934+0000","last_fullsized":"2023-12-07T21:09:34.943934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:06:27.005217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'50","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.110642+0000","last_change":"2023-12-07T21:09:00.894678+0000","last_active":"2023-12-07T21:10:59.110642+0000","last_peered":"2023-12-07T21:10:59.110642+0000","last_clean":"2023-12-07T21:10:59.110642+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:10:59.110642+0000","last_undegraded":"2023-12-07T21:10:59.110642+0000","last_fullsized":"2023-12-07T21:10:59.110642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:55:22.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943349+0000","last_change":"2023-12-07T21:09:02.901382+0000","last_active":"2023-12-07T21:09:34.943349+0000","last_peered":"2023-12-07T21:09:34.943349+0000","last_clean":"2023-12-07T21:09:34.943349+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:09:34.943349+0000","last_undegraded":"2023-12-07T21:09:34.943349+0000","last_fullsized":"2023-12-07T21:09:34.943349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:36.555708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.963309+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:10:59.963309+0000","last_peered":"2023-12-07T21:10:59.963309+0000","last_clean":"2023-12-07T21:10:59.963309+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:10:59.963309+0000","last_undegraded":"2023-12-07T21:10:59.963309+0000","last_fullsized":"2023-12-07T21:10:59.963309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:58.709847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.952362+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:09:35.952362+0000","last_peered":"2023-12-07T21:09:35.952362+0000","last_clean":"2023-12-07T21:09:35.952362+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:09:35.952362+0000","last_undegraded":"2023-12-07T21:09:35.952362+0000","last_fullsized":"2023-12-07T21:09:35.952362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:06:39.417736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944094+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:09:34.944094+0000","last_peered":"2023-12-07T21:09:34.944094+0000","last_clean":"2023-12-07T21:09:34.944094+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:09:34.944094+0000","last_undegraded":"2023-12-07T21:09:34.944094+0000","last_fullsized":"2023-12-07T21:09:34.944094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943794+0000","last_change":"2023-12-07T21:08:58.878003+0000","last_active":"2023-12-07T21:09:34.943794+0000","last_peered":"2023-12-07T21:09:34.943794+0000","last_clean":"2023-12-07T21:09:34.943794+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:09:34.943794+0000","last_undegraded":"2023-12-07T21:09:34.943794+0000","last_fullsized":"2023-12-07T21:09:34.943794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:31.868475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'30","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.698790+0000","last_change":"2023-12-07T21:09:00.892793+0000","last_active":"2023-12-07T21:10:18.698790+0000","last_peered":"2023-12-07T21:10:18.698790+0000","last_clean":"2023-12-07T21:10:18.698790+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:10:18.698790+0000","last_undegraded":"2023-12-07T21:10:18.698790+0000","last_fullsized":"2023-12-07T21:10:18.698790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:40:44.335329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948507+0000","last_change":"2023-12-07T21:09:02.906350+0000","last_active":"2023-12-07T21:09:34.948507+0000","last_peered":"2023-12-07T21:09:34.948507+0000","last_clean":"2023-12-07T21:09:34.948507+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:09:34.948507+0000","last_undegraded":"2023-12-07T21:09:34.948507+0000","last_fullsized":"2023-12-07T21:09:34.948507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:37:53.231631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944316+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:09:34.944316+0000","last_peered":"2023-12-07T21:09:34.944316+0000","last_clean":"2023-12-07T21:09:34.944316+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:09:34.944316+0000","last_undegraded":"2023-12-07T21:09:34.944316+0000","last_fullsized":"2023-12-07T21:09:34.944316+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:08:05.985163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737413+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:10:18.737413+0000","last_peered":"2023-12-07T21:10:18.737413+0000","last_clean":"2023-12-07T21:10:18.737413+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:10:18.737413+0000","last_undegraded":"2023-12-07T21:10:18.737413+0000","last_fullsized":"2023-12-07T21:10:18.737413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:45.476986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946531+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:09:34.946531+0000","last_peered":"2023-12-07T21:09:34.946531+0000","last_clean":"2023-12-07T21:09:34.946531+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:09:34.946531+0000","last_undegraded":"2023-12-07T21:09:34.946531+0000","last_fullsized":"2023-12-07T21:09:34.946531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:50.838564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943971+0000","last_change":"2023-12-07T21:08:58.880054+0000","last_active":"2023-12-07T21:09:34.943971+0000","last_peered":"2023-12-07T21:09:34.943971+0000","last_clean":"2023-12-07T21:09:34.943971+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:09:34.943971+0000","last_undegraded":"2023-12-07T21:09:34.943971+0000","last_fullsized":"2023-12-07T21:09:34.943971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:06:16.756883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.725885+0000","last_change":"2023-12-07T21:09:00.884835+0000","last_active":"2023-12-07T21:10:18.725885+0000","last_peered":"2023-12-07T21:10:18.725885+0000","last_clean":"2023-12-07T21:10:18.725885+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:10:18.725885+0000","last_undegraded":"2023-12-07T21:10:18.725885+0000","last_fullsized":"2023-12-07T21:10:18.725885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:46:31.016107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'243","reported_seq":323,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.999246+0000","last_change":"2023-12-07T21:09:02.897993+0000","last_active":"2023-12-07T21:10:59.999246+0000","last_peered":"2023-12-07T21:10:59.999246+0000","last_clean":"2023-12-07T21:10:59.999246+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:10:59.999246+0000","last_undegraded":"2023-12-07T21:10:59.999246+0000","last_fullsized":"2023-12-07T21:10:59.999246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:07:07.411571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.749284+0000","last_change":"2023-12-07T21:09:04.919388+0000","last_active":"2023-12-07T21:10:18.749284+0000","last_peered":"2023-12-07T21:10:18.749284+0000","last_clean":"2023-12-07T21:10:18.749284+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:10:18.749284+0000","last_undegraded":"2023-12-07T21:10:18.749284+0000","last_fullsized":"2023-12-07T21:10:18.749284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:08.715985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.066420+0000","last_change":"2023-12-07T21:08:56.880261+0000","last_active":"2023-12-07T21:09:36.066420+0000","last_peered":"2023-12-07T21:09:36.066420+0000","last_clean":"2023-12-07T21:09:36.066420+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:09:36.066420+0000","last_undegraded":"2023-12-07T21:09:36.066420+0000","last_fullsized":"2023-12-07T21:09:36.066420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.585971+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:09:36.585971+0000","last_peered":"2023-12-07T21:09:36.585971+0000","last_clean":"2023-12-07T21:09:36.585971+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:09:36.585971+0000","last_undegraded":"2023-12-07T21:09:36.585971+0000","last_fullsized":"2023-12-07T21:09:36.585971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:55:05.877689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.935504+0000","last_change":"2023-12-07T21:08:58.876612+0000","last_active":"2023-12-07T21:10:59.935504+0000","last_peered":"2023-12-07T21:10:59.935504+0000","last_clean":"2023-12-07T21:10:59.935504+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:10:59.935504+0000","last_undegraded":"2023-12-07T21:10:59.935504+0000","last_fullsized":"2023-12-07T21:10:59.935504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:09.272727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":169,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947872+0000","last_change":"2023-12-07T21:09:00.895566+0000","last_active":"2023-12-07T21:09:34.947872+0000","last_peered":"2023-12-07T21:09:34.947872+0000","last_clean":"2023-12-07T21:09:34.947872+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:09:34.947872+0000","last_undegraded":"2023-12-07T21:09:34.947872+0000","last_fullsized":"2023-12-07T21:09:34.947872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:26:26.503427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'243","reported_seq":358,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.995871+0000","last_change":"2023-12-07T21:09:02.900092+0000","last_active":"2023-12-07T21:10:59.995871+0000","last_peered":"2023-12-07T21:10:59.995871+0000","last_clean":"2023-12-07T21:10:59.995871+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:10:59.995871+0000","last_undegraded":"2023-12-07T21:10:59.995871+0000","last_fullsized":"2023-12-07T21:10:59.995871+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:58.034650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.362471+0000","last_change":"2023-12-07T21:09:04.923396+0000","last_active":"2023-12-07T21:09:36.362471+0000","last_peered":"2023-12-07T21:09:36.362471+0000","last_clean":"2023-12-07T21:09:36.362471+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:09:36.362471+0000","last_undegraded":"2023-12-07T21:09:36.362471+0000","last_fullsized":"2023-12-07T21:09:36.362471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:15:15.500097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939613+0000","last_change":"2023-12-07T21:08:56.889238+0000","last_active":"2023-12-07T21:09:34.939613+0000","last_peered":"2023-12-07T21:09:34.939613+0000","last_clean":"2023-12-07T21:09:34.939613+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:09:34.939613+0000","last_undegraded":"2023-12-07T21:09:34.939613+0000","last_fullsized":"2023-12-07T21:09:34.939613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:06:26.241158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945162+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:09:34.945162+0000","last_peered":"2023-12-07T21:09:34.945162+0000","last_clean":"2023-12-07T21:09:34.945162+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:09:34.945162+0000","last_undegraded":"2023-12-07T21:09:34.945162+0000","last_fullsized":"2023-12-07T21:09:34.945162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:48.585124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948807+0000","last_change":"2023-12-07T21:08:58.879899+0000","last_active":"2023-12-07T21:09:34.948807+0000","last_peered":"2023-12-07T21:09:34.948807+0000","last_clean":"2023-12-07T21:09:34.948807+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:09:34.948807+0000","last_undegraded":"2023-12-07T21:09:34.948807+0000","last_fullsized":"2023-12-07T21:09:34.948807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:56.707476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'36","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.712555+0000","last_change":"2023-12-07T21:09:00.892694+0000","last_active":"2023-12-07T21:10:18.712555+0000","last_peered":"2023-12-07T21:10:18.712555+0000","last_clean":"2023-12-07T21:10:18.712555+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:10:18.712555+0000","last_undegraded":"2023-12-07T21:10:18.712555+0000","last_fullsized":"2023-12-07T21:10:18.712555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:54.775039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943470+0000","last_change":"2023-12-07T21:09:02.906473+0000","last_active":"2023-12-07T21:09:34.943470+0000","last_peered":"2023-12-07T21:09:34.943470+0000","last_clean":"2023-12-07T21:09:34.943470+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:09:34.943470+0000","last_undegraded":"2023-12-07T21:09:34.943470+0000","last_fullsized":"2023-12-07T21:09:34.943470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:41.421690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.180594+0000","last_change":"2023-12-07T21:09:04.920277+0000","last_active":"2023-12-07T21:10:59.180594+0000","last_peered":"2023-12-07T21:10:59.180594+0000","last_clean":"2023-12-07T21:10:59.180594+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:10:59.180594+0000","last_undegraded":"2023-12-07T21:10:59.180594+0000","last_fullsized":"2023-12-07T21:10:59.180594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:05.623664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.947251+0000","last_change":"2023-12-07T21:08:56.875185+0000","last_active":"2023-12-07T21:09:35.947251+0000","last_peered":"2023-12-07T21:09:35.947251+0000","last_clean":"2023-12-07T21:09:35.947251+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:09:35.947251+0000","last_undegraded":"2023-12-07T21:09:35.947251+0000","last_fullsized":"2023-12-07T21:09:35.947251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:07:01.381707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948511+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:09:35.948511+0000","last_peered":"2023-12-07T21:09:35.948511+0000","last_clean":"2023-12-07T21:09:35.948511+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:09:35.948511+0000","last_undegraded":"2023-12-07T21:09:35.948511+0000","last_fullsized":"2023-12-07T21:09:35.948511+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:17.092202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944755+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:09:35.944755+0000","last_peered":"2023-12-07T21:09:35.944755+0000","last_clean":"2023-12-07T21:09:35.944755+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:09:35.944755+0000","last_undegraded":"2023-12-07T21:09:35.944755+0000","last_fullsized":"2023-12-07T21:09:35.944755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:39:44.793585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942701+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:09:35.942701+0000","last_peered":"2023-12-07T21:09:35.942701+0000","last_clean":"2023-12-07T21:09:35.942701+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:09:35.942701+0000","last_undegraded":"2023-12-07T21:09:35.942701+0000","last_fullsized":"2023-12-07T21:09:35.942701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:28:06.412391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.952567+0000","last_change":"2023-12-07T21:08:58.875656+0000","last_active":"2023-12-07T21:09:35.952567+0000","last_peered":"2023-12-07T21:09:35.952567+0000","last_clean":"2023-12-07T21:09:35.952567+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:09:35.952567+0000","last_undegraded":"2023-12-07T21:09:35.952567+0000","last_fullsized":"2023-12-07T21:09:35.952567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:55.354113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'70","reported_seq":131,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.126427+0000","last_change":"2023-12-07T21:09:00.891338+0000","last_active":"2023-12-07T21:10:59.126427+0000","last_peered":"2023-12-07T21:10:59.126427+0000","last_clean":"2023-12-07T21:10:59.126427+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:10:59.126427+0000","last_undegraded":"2023-12-07T21:10:59.126427+0000","last_fullsized":"2023-12-07T21:10:59.126427+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:47.241395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944698+0000","last_change":"2023-12-07T21:09:02.905666+0000","last_active":"2023-12-07T21:09:34.944698+0000","last_peered":"2023-12-07T21:09:34.944698+0000","last_clean":"2023-12-07T21:09:34.944698+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:09:34.944698+0000","last_undegraded":"2023-12-07T21:09:34.944698+0000","last_fullsized":"2023-12-07T21:09:34.944698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:02.230683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.177244+0000","last_change":"2023-12-07T21:09:04.924703+0000","last_active":"2023-12-07T21:10:59.177244+0000","last_peered":"2023-12-07T21:10:59.177244+0000","last_clean":"2023-12-07T21:10:59.177244+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:10:59.177244+0000","last_undegraded":"2023-12-07T21:10:59.177244+0000","last_fullsized":"2023-12-07T21:10:59.177244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:31.414632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.360739+0000","last_change":"2023-12-07T21:08:56.872420+0000","last_active":"2023-12-07T21:09:36.360739+0000","last_peered":"2023-12-07T21:09:36.360739+0000","last_clean":"2023-12-07T21:09:36.360739+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:09:36.360739+0000","last_undegraded":"2023-12-07T21:09:36.360739+0000","last_fullsized":"2023-12-07T21:09:36.360739+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:35.391826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946195+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:09:35.946195+0000","last_peered":"2023-12-07T21:09:35.946195+0000","last_clean":"2023-12-07T21:09:35.946195+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:09:35.946195+0000","last_undegraded":"2023-12-07T21:09:35.946195+0000","last_fullsized":"2023-12-07T21:09:35.946195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:38.020788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.147003+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:10:59.147003+0000","last_peered":"2023-12-07T21:10:59.147003+0000","last_clean":"2023-12-07T21:10:59.147003+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:10:59.147003+0000","last_undegraded":"2023-12-07T21:10:59.147003+0000","last_fullsized":"2023-12-07T21:10:59.147003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.949153+0000","last_change":"2023-12-07T21:08:58.879144+0000","last_active":"2023-12-07T21:09:34.949153+0000","last_peered":"2023-12-07T21:09:34.949153+0000","last_clean":"2023-12-07T21:09:34.949153+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:09:34.949153+0000","last_undegraded":"2023-12-07T21:09:34.949153+0000","last_fullsized":"2023-12-07T21:09:34.949153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:10.939955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'241","reported_seq":410,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.967308+0000","last_change":"2023-12-07T21:09:00.892118+0000","last_active":"2023-12-07T21:10:59.967308+0000","last_peered":"2023-12-07T21:10:59.967308+0000","last_clean":"2023-12-07T21:10:59.967308+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:10:59.967308+0000","last_undegraded":"2023-12-07T21:10:59.967308+0000","last_fullsized":"2023-12-07T21:10:59.967308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":241,"log_dups_size":0,"ondisk_log_size":241,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:03:54.253378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":318,"num_read_kb":303,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947700+0000","last_change":"2023-12-07T21:09:02.905387+0000","last_active":"2023-12-07T21:09:34.947700+0000","last_peered":"2023-12-07T21:09:34.947700+0000","last_clean":"2023-12-07T21:09:34.947700+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:09:34.947700+0000","last_undegraded":"2023-12-07T21:09:34.947700+0000","last_fullsized":"2023-12-07T21:09:34.947700+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:01:07.430200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.153282+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:10:13.153282+0000","last_peered":"2023-12-07T21:10:13.153282+0000","last_clean":"2023-12-07T21:10:13.153282+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:10:13.153282+0000","last_undegraded":"2023-12-07T21:10:13.153282+0000","last_fullsized":"2023-12-07T21:10:13.153282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:03.815279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737328+0000","last_change":"2023-12-07T21:08:56.883281+0000","last_active":"2023-12-07T21:10:18.737328+0000","last_peered":"2023-12-07T21:10:18.737328+0000","last_clean":"2023-12-07T21:10:18.737328+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:10:18.737328+0000","last_undegraded":"2023-12-07T21:10:18.737328+0000","last_fullsized":"2023-12-07T21:10:18.737328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:11:43.198377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941657+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:09:35.941657+0000","last_peered":"2023-12-07T21:09:35.941657+0000","last_clean":"2023-12-07T21:09:35.941657+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:09:35.941657+0000","last_undegraded":"2023-12-07T21:09:35.941657+0000","last_fullsized":"2023-12-07T21:09:35.941657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:49:28.884695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941524+0000","last_change":"2023-12-07T21:08:54.881937+0000","last_active":"2023-12-07T21:09:35.941524+0000","last_peered":"2023-12-07T21:09:35.941524+0000","last_clean":"2023-12-07T21:09:35.941524+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:09:35.941524+0000","last_undegraded":"2023-12-07T21:09:35.941524+0000","last_fullsized":"2023-12-07T21:09:35.941524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943947+0000","last_change":"2023-12-07T21:08:58.875724+0000","last_active":"2023-12-07T21:09:34.943947+0000","last_peered":"2023-12-07T21:09:34.943947+0000","last_clean":"2023-12-07T21:09:34.943947+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:09:34.943947+0000","last_undegraded":"2023-12-07T21:09:34.943947+0000","last_fullsized":"2023-12-07T21:09:34.943947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:38:36.911470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.928507+0000","last_change":"2023-12-07T21:09:00.888461+0000","last_active":"2023-12-07T21:10:58.928507+0000","last_peered":"2023-12-07T21:10:58.928507+0000","last_clean":"2023-12-07T21:10:58.928507+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:10:58.928507+0000","last_undegraded":"2023-12-07T21:10:58.928507+0000","last_fullsized":"2023-12-07T21:10:58.928507+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:25:31.340127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944508+0000","last_change":"2023-12-07T21:09:02.905583+0000","last_active":"2023-12-07T21:09:34.944508+0000","last_peered":"2023-12-07T21:09:34.944508+0000","last_clean":"2023-12-07T21:09:34.944508+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:09:34.944508+0000","last_undegraded":"2023-12-07T21:09:34.944508+0000","last_fullsized":"2023-12-07T21:09:34.944508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:59:50.067921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945302+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:09:34.945302+0000","last_peered":"2023-12-07T21:09:34.945302+0000","last_clean":"2023-12-07T21:09:34.945302+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:09:34.945302+0000","last_undegraded":"2023-12-07T21:09:34.945302+0000","last_fullsized":"2023-12-07T21:09:34.945302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:25:58.505646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.609344+0000","last_change":"2023-12-07T21:08:56.872455+0000","last_active":"2023-12-07T21:09:36.609344+0000","last_peered":"2023-12-07T21:09:36.609344+0000","last_clean":"2023-12-07T21:09:36.609344+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:09:36.609344+0000","last_undegraded":"2023-12-07T21:09:36.609344+0000","last_fullsized":"2023-12-07T21:09:36.609344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:23.887277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942558+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:09:35.942558+0000","last_peered":"2023-12-07T21:09:35.942558+0000","last_clean":"2023-12-07T21:09:35.942558+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:09:35.942558+0000","last_undegraded":"2023-12-07T21:09:35.942558+0000","last_fullsized":"2023-12-07T21:09:35.942558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:34.117128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946583+0000","last_change":"2023-12-07T21:08:54.880674+0000","last_active":"2023-12-07T21:09:35.946583+0000","last_peered":"2023-12-07T21:09:35.946583+0000","last_clean":"2023-12-07T21:09:35.946583+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:09:35.946583+0000","last_undegraded":"2023-12-07T21:09:35.946583+0000","last_fullsized":"2023-12-07T21:09:35.946583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943247+0000","last_change":"2023-12-07T21:08:58.881871+0000","last_active":"2023-12-07T21:09:35.943247+0000","last_peered":"2023-12-07T21:09:35.943247+0000","last_clean":"2023-12-07T21:09:35.943247+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:09:35.943247+0000","last_undegraded":"2023-12-07T21:09:35.943247+0000","last_fullsized":"2023-12-07T21:09:35.943247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:38.827449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943744+0000","last_change":"2023-12-07T21:09:00.892022+0000","last_active":"2023-12-07T21:09:35.943744+0000","last_peered":"2023-12-07T21:09:35.943744+0000","last_clean":"2023-12-07T21:09:35.943744+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:09:35.943744+0000","last_undegraded":"2023-12-07T21:09:35.943744+0000","last_fullsized":"2023-12-07T21:09:35.943744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:20:22.542933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948794+0000","last_change":"2023-12-07T21:09:02.907037+0000","last_active":"2023-12-07T21:09:34.948794+0000","last_peered":"2023-12-07T21:09:34.948794+0000","last_clean":"2023-12-07T21:09:34.948794+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:09:34.948794+0000","last_undegraded":"2023-12-07T21:09:34.948794+0000","last_fullsized":"2023-12-07T21:09:34.948794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:47:48.082744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937984+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:09:34.937984+0000","last_peered":"2023-12-07T21:09:34.937984+0000","last_clean":"2023-12-07T21:09:34.937984+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:09:34.937984+0000","last_undegraded":"2023-12-07T21:09:34.937984+0000","last_fullsized":"2023-12-07T21:09:34.937984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:02:06.112301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.950132+0000","last_change":"2023-12-07T21:08:56.882954+0000","last_active":"2023-12-07T21:09:35.950132+0000","last_peered":"2023-12-07T21:09:35.950132+0000","last_clean":"2023-12-07T21:09:35.950132+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:09:35.950132+0000","last_undegraded":"2023-12-07T21:09:35.950132+0000","last_fullsized":"2023-12-07T21:09:35.950132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:07:51.158690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.592742+0000","last_change":"2023-12-07T21:08:54.881143+0000","last_active":"2023-12-07T21:09:36.592742+0000","last_peered":"2023-12-07T21:09:36.592742+0000","last_clean":"2023-12-07T21:09:36.592742+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:09:36.592742+0000","last_undegraded":"2023-12-07T21:09:36.592742+0000","last_fullsized":"2023-12-07T21:09:36.592742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942847+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:09:35.942847+0000","last_peered":"2023-12-07T21:09:35.942847+0000","last_clean":"2023-12-07T21:09:35.942847+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:09:35.942847+0000","last_undegraded":"2023-12-07T21:09:35.942847+0000","last_fullsized":"2023-12-07T21:09:35.942847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:24.297087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943063+0000","last_change":"2023-12-07T21:08:58.881942+0000","last_active":"2023-12-07T21:09:35.943063+0000","last_peered":"2023-12-07T21:09:35.943063+0000","last_clean":"2023-12-07T21:09:35.943063+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:09:35.943063+0000","last_undegraded":"2023-12-07T21:09:35.943063+0000","last_fullsized":"2023-12-07T21:09:35.943063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:41:45.408620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'58","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.136121+0000","last_change":"2023-12-07T21:09:00.892917+0000","last_active":"2023-12-07T21:10:59.136121+0000","last_peered":"2023-12-07T21:10:59.136121+0000","last_clean":"2023-12-07T21:10:59.136121+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:10:59.136121+0000","last_undegraded":"2023-12-07T21:10:59.136121+0000","last_fullsized":"2023-12-07T21:10:59.136121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:08:10.091706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":64,"num_read_kb":67,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943132+0000","last_change":"2023-12-07T21:09:02.897497+0000","last_active":"2023-12-07T21:09:34.943132+0000","last_peered":"2023-12-07T21:09:34.943132+0000","last_clean":"2023-12-07T21:09:34.943132+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:09:34.943132+0000","last_undegraded":"2023-12-07T21:09:34.943132+0000","last_fullsized":"2023-12-07T21:09:34.943132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:21.622701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.727098+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:10:18.727098+0000","last_peered":"2023-12-07T21:10:18.727098+0000","last_clean":"2023-12-07T21:10:18.727098+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:10:18.727098+0000","last_undegraded":"2023-12-07T21:10:18.727098+0000","last_fullsized":"2023-12-07T21:10:18.727098+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:02:58.721630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948690+0000","last_change":"2023-12-07T21:08:56.878924+0000","last_active":"2023-12-07T21:09:35.948690+0000","last_peered":"2023-12-07T21:09:35.948690+0000","last_clean":"2023-12-07T21:09:35.948690+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:09:35.948690+0000","last_undegraded":"2023-12-07T21:09:35.948690+0000","last_fullsized":"2023-12-07T21:09:35.948690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:11:43.198377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.735075+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:10:18.735075+0000","last_peered":"2023-12-07T21:10:18.735075+0000","last_clean":"2023-12-07T21:10:18.735075+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:10:18.735075+0000","last_undegraded":"2023-12-07T21:10:18.735075+0000","last_fullsized":"2023-12-07T21:10:18.735075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:32.542770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946376+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:09:35.946376+0000","last_peered":"2023-12-07T21:09:35.946376+0000","last_clean":"2023-12-07T21:09:35.946376+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:09:35.946376+0000","last_undegraded":"2023-12-07T21:09:35.946376+0000","last_fullsized":"2023-12-07T21:09:35.946376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:30:53.269300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942447+0000","last_change":"2023-12-07T21:08:58.879797+0000","last_active":"2023-12-07T21:09:35.942447+0000","last_peered":"2023-12-07T21:09:35.942447+0000","last_clean":"2023-12-07T21:09:35.942447+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:09:35.942447+0000","last_undegraded":"2023-12-07T21:09:35.942447+0000","last_fullsized":"2023-12-07T21:09:35.942447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:57:59.211719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937819+0000","last_change":"2023-12-07T21:09:00.890696+0000","last_active":"2023-12-07T21:09:34.937819+0000","last_peered":"2023-12-07T21:09:34.937819+0000","last_clean":"2023-12-07T21:09:34.937819+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:09:34.937819+0000","last_undegraded":"2023-12-07T21:09:34.937819+0000","last_fullsized":"2023-12-07T21:09:34.937819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:57.571647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'243","reported_seq":288,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:00.233748+0000","last_change":"2023-12-07T21:09:02.900501+0000","last_active":"2023-12-07T21:11:00.233748+0000","last_peered":"2023-12-07T21:11:00.233748+0000","last_clean":"2023-12-07T21:11:00.233748+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:00.233748+0000","last_undegraded":"2023-12-07T21:11:00.233748+0000","last_fullsized":"2023-12-07T21:11:00.233748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:07.330523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948599+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:09:34.948599+0000","last_peered":"2023-12-07T21:09:34.948599+0000","last_clean":"2023-12-07T21:09:34.948599+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:09:34.948599+0000","last_undegraded":"2023-12-07T21:09:34.948599+0000","last_fullsized":"2023-12-07T21:09:34.948599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:41.901371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.027809+0000","last_change":"2023-12-07T21:08:56.887962+0000","last_active":"2023-12-07T21:09:37.027809+0000","last_peered":"2023-12-07T21:09:37.027809+0000","last_clean":"2023-12-07T21:09:37.027809+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:09:37.027809+0000","last_undegraded":"2023-12-07T21:09:37.027809+0000","last_fullsized":"2023-12-07T21:09:37.027809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:38.589260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.949138+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:09:34.949138+0000","last_peered":"2023-12-07T21:09:34.949138+0000","last_clean":"2023-12-07T21:09:34.949138+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:09:34.949138+0000","last_undegraded":"2023-12-07T21:09:34.949138+0000","last_fullsized":"2023-12-07T21:09:34.949138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:21.874874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943546+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:09:35.943546+0000","last_peered":"2023-12-07T21:09:35.943546+0000","last_clean":"2023-12-07T21:09:35.943546+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:09:35.943546+0000","last_undegraded":"2023-12-07T21:09:35.943546+0000","last_fullsized":"2023-12-07T21:09:35.943546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:02:32.429314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948547+0000","last_change":"2023-12-07T21:08:58.878642+0000","last_active":"2023-12-07T21:09:35.948547+0000","last_peered":"2023-12-07T21:09:35.948547+0000","last_clean":"2023-12-07T21:09:35.948547+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:09:35.948547+0000","last_undegraded":"2023-12-07T21:09:35.948547+0000","last_fullsized":"2023-12-07T21:09:35.948547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:03.307133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946636+0000","last_change":"2023-12-07T21:09:00.896503+0000","last_active":"2023-12-07T21:09:34.946636+0000","last_peered":"2023-12-07T21:09:34.946636+0000","last_clean":"2023-12-07T21:09:34.946636+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:09:34.946636+0000","last_undegraded":"2023-12-07T21:09:34.946636+0000","last_fullsized":"2023-12-07T21:09:34.946636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:54.681953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'243","reported_seq":355,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.973822+0000","last_change":"2023-12-07T21:09:02.897351+0000","last_active":"2023-12-07T21:10:59.973822+0000","last_peered":"2023-12-07T21:10:59.973822+0000","last_clean":"2023-12-07T21:10:59.973822+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:10:59.973822+0000","last_undegraded":"2023-12-07T21:10:59.973822+0000","last_fullsized":"2023-12-07T21:10:59.973822+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:58:03.235109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938213+0000","last_change":"2023-12-07T21:09:04.929420+0000","last_active":"2023-12-07T21:09:34.938213+0000","last_peered":"2023-12-07T21:09:34.938213+0000","last_clean":"2023-12-07T21:09:34.938213+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:09:34.938213+0000","last_undegraded":"2023-12-07T21:09:34.938213+0000","last_fullsized":"2023-12-07T21:09:34.938213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:08.715985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173660+0000","last_change":"2023-12-07T21:08:56.874336+0000","last_active":"2023-12-07T21:10:59.173660+0000","last_peered":"2023-12-07T21:10:59.173660+0000","last_clean":"2023-12-07T21:10:59.173660+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:10:59.173660+0000","last_undegraded":"2023-12-07T21:10:59.173660+0000","last_fullsized":"2023-12-07T21:10:59.173660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:22.142967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939208+0000","last_change":"2023-12-07T21:08:54.888557+0000","last_active":"2023-12-07T21:09:34.939208+0000","last_peered":"2023-12-07T21:09:34.939208+0000","last_clean":"2023-12-07T21:09:34.939208+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:09:34.939208+0000","last_undegraded":"2023-12-07T21:09:34.939208+0000","last_fullsized":"2023-12-07T21:09:34.939208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944629+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:09:35.944629+0000","last_peered":"2023-12-07T21:09:35.944629+0000","last_clean":"2023-12-07T21:09:35.944629+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:09:35.944629+0000","last_undegraded":"2023-12-07T21:09:35.944629+0000","last_fullsized":"2023-12-07T21:09:35.944629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:13:59.600730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.953920+0000","last_change":"2023-12-07T21:09:35.953149+0000","last_active":"2023-12-07T21:09:35.953920+0000","last_peered":"2023-12-07T21:09:35.953920+0000","last_clean":"2023-12-07T21:09:35.953920+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:09:35.953920+0000","last_undegraded":"2023-12-07T21:09:35.953920+0000","last_fullsized":"2023-12-07T21:09:35.953920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:00:15.189655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'77","reported_seq":141,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.115830+0000","last_change":"2023-12-07T21:09:00.891723+0000","last_active":"2023-12-07T21:10:59.115830+0000","last_peered":"2023-12-07T21:10:59.115830+0000","last_clean":"2023-12-07T21:10:59.115830+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:10:59.115830+0000","last_undegraded":"2023-12-07T21:10:59.115830+0000","last_fullsized":"2023-12-07T21:10:59.115830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:57.364445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944006+0000","last_change":"2023-12-07T21:09:02.898050+0000","last_active":"2023-12-07T21:09:34.944006+0000","last_peered":"2023-12-07T21:09:34.944006+0000","last_clean":"2023-12-07T21:09:34.944006+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:09:34.944006+0000","last_undegraded":"2023-12-07T21:09:34.944006+0000","last_fullsized":"2023-12-07T21:09:34.944006+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:07.330523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943933+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:09:34.943933+0000","last_peered":"2023-12-07T21:09:34.943933+0000","last_clean":"2023-12-07T21:09:34.943933+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:09:34.943933+0000","last_undegraded":"2023-12-07T21:09:34.943933+0000","last_fullsized":"2023-12-07T21:09:34.943933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:45.830742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943689+0000","last_change":"2023-12-07T21:09:04.926451+0000","last_active":"2023-12-07T21:09:34.943689+0000","last_peered":"2023-12-07T21:09:34.943689+0000","last_clean":"2023-12-07T21:09:34.943689+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:09:34.943689+0000","last_undegraded":"2023-12-07T21:09:34.943689+0000","last_fullsized":"2023-12-07T21:09:34.943689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:00.049486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943172+0000","last_change":"2023-12-07T21:08:56.877160+0000","last_active":"2023-12-07T21:09:34.943172+0000","last_peered":"2023-12-07T21:09:34.943172+0000","last_clean":"2023-12-07T21:09:34.943172+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:09:34.943172+0000","last_undegraded":"2023-12-07T21:09:34.943172+0000","last_fullsized":"2023-12-07T21:09:34.943172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:20.598365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947455+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:09:34.947455+0000","last_peered":"2023-12-07T21:09:34.947455+0000","last_clean":"2023-12-07T21:09:34.947455+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:09:34.947455+0000","last_undegraded":"2023-12-07T21:09:34.947455+0000","last_fullsized":"2023-12-07T21:09:34.947455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:24.731856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938592+0000","last_change":"2023-12-07T21:08:58.876828+0000","last_active":"2023-12-07T21:09:34.938592+0000","last_peered":"2023-12-07T21:09:34.938592+0000","last_clean":"2023-12-07T21:09:34.938592+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:09:34.938592+0000","last_undegraded":"2023-12-07T21:09:34.938592+0000","last_fullsized":"2023-12-07T21:09:34.938592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:25:18.167316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'30","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.716368+0000","last_change":"2023-12-07T21:09:00.893775+0000","last_active":"2023-12-07T21:10:18.716368+0000","last_peered":"2023-12-07T21:10:18.716368+0000","last_clean":"2023-12-07T21:10:18.716368+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:10:18.716368+0000","last_undegraded":"2023-12-07T21:10:18.716368+0000","last_fullsized":"2023-12-07T21:10:18.716368+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:36:18.746987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945519+0000","last_change":"2023-12-07T21:09:02.907875+0000","last_active":"2023-12-07T21:09:34.945519+0000","last_peered":"2023-12-07T21:09:34.945519+0000","last_clean":"2023-12-07T21:09:34.945519+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:09:34.945519+0000","last_undegraded":"2023-12-07T21:09:34.945519+0000","last_fullsized":"2023-12-07T21:09:34.945519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:44:51.015892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944425+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:09:34.944425+0000","last_peered":"2023-12-07T21:09:34.944425+0000","last_clean":"2023-12-07T21:09:34.944425+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:09:34.944425+0000","last_undegraded":"2023-12-07T21:09:34.944425+0000","last_fullsized":"2023-12-07T21:09:34.944425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:13:50.090324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937989+0000","last_change":"2023-12-07T21:08:56.879187+0000","last_active":"2023-12-07T21:09:34.937989+0000","last_peered":"2023-12-07T21:09:34.937989+0000","last_clean":"2023-12-07T21:09:34.937989+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:09:34.937989+0000","last_undegraded":"2023-12-07T21:09:34.937989+0000","last_fullsized":"2023-12-07T21:09:34.937989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943278+0000","last_change":"2023-12-07T21:08:54.880755+0000","last_active":"2023-12-07T21:09:34.943278+0000","last_peered":"2023-12-07T21:09:34.943278+0000","last_clean":"2023-12-07T21:09:34.943278+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:09:34.943278+0000","last_undegraded":"2023-12-07T21:09:34.943278+0000","last_fullsized":"2023-12-07T21:09:34.943278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947289+0000","last_change":"2023-12-07T21:08:58.882787+0000","last_active":"2023-12-07T21:09:34.947289+0000","last_peered":"2023-12-07T21:09:34.947289+0000","last_clean":"2023-12-07T21:09:34.947289+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:09:34.947289+0000","last_undegraded":"2023-12-07T21:09:34.947289+0000","last_fullsized":"2023-12-07T21:09:34.947289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:04:04.292611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:12.139450+0000","last_change":"2023-12-07T21:09:00.886499+0000","last_active":"2023-12-07T21:10:12.139450+0000","last_peered":"2023-12-07T21:10:12.139450+0000","last_clean":"2023-12-07T21:10:12.139450+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:10:12.139450+0000","last_undegraded":"2023-12-07T21:10:12.139450+0000","last_fullsized":"2023-12-07T21:10:12.139450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:11.283059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942852+0000","last_change":"2023-12-07T21:09:02.906677+0000","last_active":"2023-12-07T21:09:34.942852+0000","last_peered":"2023-12-07T21:09:34.942852+0000","last_clean":"2023-12-07T21:09:34.942852+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:09:34.942852+0000","last_undegraded":"2023-12-07T21:09:34.942852+0000","last_fullsized":"2023-12-07T21:09:34.942852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:00.642632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944148+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:09:34.944148+0000","last_peered":"2023-12-07T21:09:34.944148+0000","last_clean":"2023-12-07T21:09:34.944148+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:09:34.944148+0000","last_undegraded":"2023-12-07T21:09:34.944148+0000","last_fullsized":"2023-12-07T21:09:34.944148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:03.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149349+0000","last_change":"2023-12-07T21:08:56.874712+0000","last_active":"2023-12-07T21:10:59.149349+0000","last_peered":"2023-12-07T21:10:59.149349+0000","last_clean":"2023-12-07T21:10:59.149349+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:10:59.149349+0000","last_undegraded":"2023-12-07T21:10:59.149349+0000","last_fullsized":"2023-12-07T21:10:59.149349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:20.598365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945370+0000","last_change":"2023-12-07T21:08:54.885182+0000","last_active":"2023-12-07T21:09:34.945370+0000","last_peered":"2023-12-07T21:09:34.945370+0000","last_clean":"2023-12-07T21:09:34.945370+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:09:34.945370+0000","last_undegraded":"2023-12-07T21:09:34.945370+0000","last_fullsized":"2023-12-07T21:09:34.945370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:26.381861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942456+0000","last_change":"2023-12-07T21:08:58.873698+0000","last_active":"2023-12-07T21:09:34.942456+0000","last_peered":"2023-12-07T21:09:34.942456+0000","last_clean":"2023-12-07T21:09:34.942456+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:09:34.942456+0000","last_undegraded":"2023-12-07T21:09:34.942456+0000","last_fullsized":"2023-12-07T21:09:34.942456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:28:17.747275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'34","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.965525+0000","last_change":"2023-12-07T21:09:00.892175+0000","last_active":"2023-12-07T21:10:58.965525+0000","last_peered":"2023-12-07T21:10:58.965525+0000","last_clean":"2023-12-07T21:10:58.965525+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:10:58.965525+0000","last_undegraded":"2023-12-07T21:10:58.965525+0000","last_fullsized":"2023-12-07T21:10:58.965525+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:29.403881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937776+0000","last_change":"2023-12-07T21:09:02.900618+0000","last_active":"2023-12-07T21:09:34.937776+0000","last_peered":"2023-12-07T21:09:34.937776+0000","last_clean":"2023-12-07T21:09:34.937776+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:09:34.937776+0000","last_undegraded":"2023-12-07T21:09:34.937776+0000","last_fullsized":"2023-12-07T21:09:34.937776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:00.871254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948117+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:09:34.948117+0000","last_peered":"2023-12-07T21:09:34.948117+0000","last_clean":"2023-12-07T21:09:34.948117+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:09:34.948117+0000","last_undegraded":"2023-12-07T21:09:34.948117+0000","last_fullsized":"2023-12-07T21:09:34.948117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:37:58.338488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944992+0000","last_change":"2023-12-07T21:08:56.887184+0000","last_active":"2023-12-07T21:09:34.944992+0000","last_peered":"2023-12-07T21:09:34.944992+0000","last_clean":"2023-12-07T21:09:34.944992+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:09:34.944992+0000","last_undegraded":"2023-12-07T21:09:34.944992+0000","last_fullsized":"2023-12-07T21:09:34.944992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:07.266252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939265+0000","last_change":"2023-12-07T21:08:54.878542+0000","last_active":"2023-12-07T21:09:34.939265+0000","last_peered":"2023-12-07T21:09:34.939265+0000","last_clean":"2023-12-07T21:09:34.939265+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:09:34.939265+0000","last_undegraded":"2023-12-07T21:09:34.939265+0000","last_fullsized":"2023-12-07T21:09:34.939265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944756+0000","last_change":"2023-12-07T21:08:58.878455+0000","last_active":"2023-12-07T21:09:34.944756+0000","last_peered":"2023-12-07T21:09:34.944756+0000","last_clean":"2023-12-07T21:09:34.944756+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:09:34.944756+0000","last_undegraded":"2023-12-07T21:09:34.944756+0000","last_fullsized":"2023-12-07T21:09:34.944756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:39.792516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.700847+0000","last_change":"2023-12-07T21:09:00.885534+0000","last_active":"2023-12-07T21:10:18.700847+0000","last_peered":"2023-12-07T21:10:18.700847+0000","last_clean":"2023-12-07T21:10:18.700847+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:10:18.700847+0000","last_undegraded":"2023-12-07T21:10:18.700847+0000","last_fullsized":"2023-12-07T21:10:18.700847+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:07.128867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942727+0000","last_change":"2023-12-07T21:09:02.899870+0000","last_active":"2023-12-07T21:09:34.942727+0000","last_peered":"2023-12-07T21:09:34.942727+0000","last_clean":"2023-12-07T21:09:34.942727+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:09:34.942727+0000","last_undegraded":"2023-12-07T21:09:34.942727+0000","last_fullsized":"2023-12-07T21:09:34.942727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:59.584704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946337+0000","last_change":"2023-12-07T21:08:56.873185+0000","last_active":"2023-12-07T21:09:35.946337+0000","last_peered":"2023-12-07T21:09:35.946337+0000","last_clean":"2023-12-07T21:09:35.946337+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:09:35.946337+0000","last_undegraded":"2023-12-07T21:09:35.946337+0000","last_fullsized":"2023-12-07T21:09:35.946337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:03:50.236571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944921+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:09:34.944921+0000","last_peered":"2023-12-07T21:09:34.944921+0000","last_clean":"2023-12-07T21:09:34.944921+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:09:34.944921+0000","last_undegraded":"2023-12-07T21:09:34.944921+0000","last_fullsized":"2023-12-07T21:09:34.944921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:44:52.381066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944424+0000","last_change":"2023-12-07T21:08:58.879555+0000","last_active":"2023-12-07T21:09:35.944424+0000","last_peered":"2023-12-07T21:09:35.944424+0000","last_clean":"2023-12-07T21:09:35.944424+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:09:35.944424+0000","last_undegraded":"2023-12-07T21:09:35.944424+0000","last_fullsized":"2023-12-07T21:09:35.944424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:05.118535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'50","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.112986+0000","last_change":"2023-12-07T21:09:00.886089+0000","last_active":"2023-12-07T21:10:59.112986+0000","last_peered":"2023-12-07T21:10:59.112986+0000","last_clean":"2023-12-07T21:10:59.112986+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:10:59.112986+0000","last_undegraded":"2023-12-07T21:10:59.112986+0000","last_fullsized":"2023-12-07T21:10:59.112986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:58.629575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942969+0000","last_change":"2023-12-07T21:09:02.900412+0000","last_active":"2023-12-07T21:09:34.942969+0000","last_peered":"2023-12-07T21:09:34.942969+0000","last_clean":"2023-12-07T21:09:34.942969+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:09:34.942969+0000","last_undegraded":"2023-12-07T21:09:34.942969+0000","last_fullsized":"2023-12-07T21:09:34.942969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:16:17.076025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.282119+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:10:18.282119+0000","last_peered":"2023-12-07T21:10:18.282119+0000","last_clean":"2023-12-07T21:10:18.282119+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:10:18.282119+0000","last_undegraded":"2023-12-07T21:10:18.282119+0000","last_fullsized":"2023-12-07T21:10:18.282119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:03.815279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149298+0000","last_change":"2023-12-07T21:08:56.877115+0000","last_active":"2023-12-07T21:10:59.149298+0000","last_peered":"2023-12-07T21:10:59.149298+0000","last_clean":"2023-12-07T21:10:59.149298+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:10:59.149298+0000","last_undegraded":"2023-12-07T21:10:59.149298+0000","last_fullsized":"2023-12-07T21:10:59.149298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:47.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937462+0000","last_change":"2023-12-07T21:08:54.882363+0000","last_active":"2023-12-07T21:09:34.937462+0000","last_peered":"2023-12-07T21:09:34.937462+0000","last_clean":"2023-12-07T21:09:34.937462+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:09:34.937462+0000","last_undegraded":"2023-12-07T21:09:34.937462+0000","last_fullsized":"2023-12-07T21:09:34.937462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:47:51.435614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.954233+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:09:35.954233+0000","last_peered":"2023-12-07T21:09:35.954233+0000","last_clean":"2023-12-07T21:09:35.954233+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:09:35.954233+0000","last_undegraded":"2023-12-07T21:09:35.954233+0000","last_fullsized":"2023-12-07T21:09:35.954233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:01:20.045494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.701913+0000","last_change":"2023-12-07T21:09:00.887309+0000","last_active":"2023-12-07T21:10:18.701913+0000","last_peered":"2023-12-07T21:10:18.701913+0000","last_clean":"2023-12-07T21:10:18.701913+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:10:18.701913+0000","last_undegraded":"2023-12-07T21:10:18.701913+0000","last_fullsized":"2023-12-07T21:10:18.701913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:31:21.189550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938397+0000","last_change":"2023-12-07T21:09:02.907306+0000","last_active":"2023-12-07T21:09:34.938397+0000","last_peered":"2023-12-07T21:09:34.938397+0000","last_clean":"2023-12-07T21:09:34.938397+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:09:34.938397+0000","last_undegraded":"2023-12-07T21:09:34.938397+0000","last_fullsized":"2023-12-07T21:09:34.938397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:58:03.235109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944816+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:09:34.944816+0000","last_peered":"2023-12-07T21:09:34.944816+0000","last_clean":"2023-12-07T21:09:34.944816+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:09:34.944816+0000","last_undegraded":"2023-12-07T21:09:34.944816+0000","last_fullsized":"2023-12-07T21:09:34.944816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:45:57.610751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.028328+0000","last_change":"2023-12-07T21:08:56.885223+0000","last_active":"2023-12-07T21:09:37.028328+0000","last_peered":"2023-12-07T21:09:37.028328+0000","last_clean":"2023-12-07T21:09:37.028328+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:09:37.028328+0000","last_undegraded":"2023-12-07T21:09:37.028328+0000","last_fullsized":"2023-12-07T21:09:37.028328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:16:11.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937906+0000","last_change":"2023-12-07T21:08:54.887587+0000","last_active":"2023-12-07T21:09:34.937906+0000","last_peered":"2023-12-07T21:09:34.937906+0000","last_clean":"2023-12-07T21:09:34.937906+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:09:34.937906+0000","last_undegraded":"2023-12-07T21:09:34.937906+0000","last_fullsized":"2023-12-07T21:09:34.937906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943211+0000","last_change":"2023-12-07T21:08:58.876479+0000","last_active":"2023-12-07T21:09:34.943211+0000","last_peered":"2023-12-07T21:09:34.943211+0000","last_clean":"2023-12-07T21:09:34.943211+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:09:34.943211+0000","last_undegraded":"2023-12-07T21:09:34.943211+0000","last_fullsized":"2023-12-07T21:09:34.943211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:37.048767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'31","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.720307+0000","last_change":"2023-12-07T21:09:00.890134+0000","last_active":"2023-12-07T21:10:18.720307+0000","last_peered":"2023-12-07T21:10:18.720307+0000","last_clean":"2023-12-07T21:10:18.720307+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:10:18.720307+0000","last_undegraded":"2023-12-07T21:10:18.720307+0000","last_fullsized":"2023-12-07T21:10:18.720307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:19.609643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943191+0000","last_change":"2023-12-07T21:09:02.901229+0000","last_active":"2023-12-07T21:09:35.943191+0000","last_peered":"2023-12-07T21:09:35.943191+0000","last_clean":"2023-12-07T21:09:35.943191+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:09:35.943191+0000","last_undegraded":"2023-12-07T21:09:35.943191+0000","last_fullsized":"2023-12-07T21:09:35.943191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:35.272324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.728070+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:10:18.728070+0000","last_peered":"2023-12-07T21:10:18.728070+0000","last_clean":"2023-12-07T21:10:18.728070+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:10:18.728070+0000","last_undegraded":"2023-12-07T21:10:18.728070+0000","last_fullsized":"2023-12-07T21:10:18.728070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:13:44.983457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149269+0000","last_change":"2023-12-07T21:08:56.872465+0000","last_active":"2023-12-07T21:10:59.149269+0000","last_peered":"2023-12-07T21:10:59.149269+0000","last_clean":"2023-12-07T21:10:59.149269+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:10:59.149269+0000","last_undegraded":"2023-12-07T21:10:59.149269+0000","last_fullsized":"2023-12-07T21:10:59.149269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:46.057644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945674+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:09:34.945674+0000","last_peered":"2023-12-07T21:09:34.945674+0000","last_clean":"2023-12-07T21:09:34.945674+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:09:34.945674+0000","last_undegraded":"2023-12-07T21:09:34.945674+0000","last_fullsized":"2023-12-07T21:09:34.945674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:27.280985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.940467+0000","last_change":"2023-12-07T21:08:58.875630+0000","last_active":"2023-12-07T21:09:34.940467+0000","last_peered":"2023-12-07T21:09:34.940467+0000","last_clean":"2023-12-07T21:09:34.940467+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:09:34.940467+0000","last_undegraded":"2023-12-07T21:09:34.940467+0000","last_fullsized":"2023-12-07T21:09:34.940467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:16.106436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944106+0000","last_change":"2023-12-07T21:09:00.896323+0000","last_active":"2023-12-07T21:09:35.944106+0000","last_peered":"2023-12-07T21:09:35.944106+0000","last_clean":"2023-12-07T21:09:35.944106+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:09:35.944106+0000","last_undegraded":"2023-12-07T21:09:35.944106+0000","last_fullsized":"2023-12-07T21:09:35.944106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:28:31.952243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'243","reported_seq":311,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.968298+0000","last_change":"2023-12-07T21:09:02.908092+0000","last_active":"2023-12-07T21:10:59.968298+0000","last_peered":"2023-12-07T21:10:59.968298+0000","last_clean":"2023-12-07T21:10:59.968298+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:10:59.968298+0000","last_undegraded":"2023-12-07T21:10:59.968298+0000","last_fullsized":"2023-12-07T21:10:59.968298+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:04:20.531570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944255+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:09:34.944255+0000","last_peered":"2023-12-07T21:09:34.944255+0000","last_clean":"2023-12-07T21:09:34.944255+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:09:34.944255+0000","last_undegraded":"2023-12-07T21:09:34.944255+0000","last_fullsized":"2023-12-07T21:09:34.944255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:14:35.831401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943322+0000","last_change":"2023-12-07T21:08:56.871124+0000","last_active":"2023-12-07T21:09:34.943322+0000","last_peered":"2023-12-07T21:09:34.943322+0000","last_clean":"2023-12-07T21:09:34.943322+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:09:34.943322+0000","last_undegraded":"2023-12-07T21:09:34.943322+0000","last_fullsized":"2023-12-07T21:09:34.943322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:26.744258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939061+0000","last_change":"2023-12-07T21:08:54.876774+0000","last_active":"2023-12-07T21:09:34.939061+0000","last_peered":"2023-12-07T21:09:34.939061+0000","last_clean":"2023-12-07T21:09:34.939061+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:09:34.939061+0000","last_undegraded":"2023-12-07T21:09:34.939061+0000","last_fullsized":"2023-12-07T21:09:34.939061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938263+0000","last_change":"2023-12-07T21:08:58.876085+0000","last_active":"2023-12-07T21:09:34.938263+0000","last_peered":"2023-12-07T21:09:34.938263+0000","last_clean":"2023-12-07T21:09:34.938263+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:09:34.938263+0000","last_undegraded":"2023-12-07T21:09:34.938263+0000","last_fullsized":"2023-12-07T21:09:34.938263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:40.595735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'34","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.692578+0000","last_change":"2023-12-07T21:09:00.892353+0000","last_active":"2023-12-07T21:10:18.692578+0000","last_peered":"2023-12-07T21:10:18.692578+0000","last_clean":"2023-12-07T21:10:18.692578+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:10:18.692578+0000","last_undegraded":"2023-12-07T21:10:18.692578+0000","last_fullsized":"2023-12-07T21:10:18.692578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:39.408633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943238+0000","last_change":"2023-12-07T21:09:02.906845+0000","last_active":"2023-12-07T21:09:34.943238+0000","last_peered":"2023-12-07T21:09:34.943238+0000","last_clean":"2023-12-07T21:09:34.943238+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:09:34.943238+0000","last_undegraded":"2023-12-07T21:09:34.943238+0000","last_fullsized":"2023-12-07T21:09:34.943238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:15:13.485261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939444+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:09:34.939444+0000","last_peered":"2023-12-07T21:09:34.939444+0000","last_clean":"2023-12-07T21:09:34.939444+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:09:34.939444+0000","last_undegraded":"2023-12-07T21:09:34.939444+0000","last_fullsized":"2023-12-07T21:09:34.939444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:13:50.090324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942745+0000","last_change":"2023-12-07T21:08:56.870984+0000","last_active":"2023-12-07T21:09:34.942745+0000","last_peered":"2023-12-07T21:09:34.942745+0000","last_clean":"2023-12-07T21:09:34.942745+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:09:34.942745+0000","last_undegraded":"2023-12-07T21:09:34.942745+0000","last_fullsized":"2023-12-07T21:09:34.942745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:19.739101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948342+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:09:34.948342+0000","last_peered":"2023-12-07T21:09:34.948342+0000","last_clean":"2023-12-07T21:09:34.948342+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:09:34.948342+0000","last_undegraded":"2023-12-07T21:09:34.948342+0000","last_fullsized":"2023-12-07T21:09:34.948342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:17.726699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943410+0000","last_change":"2023-12-07T21:08:58.881984+0000","last_active":"2023-12-07T21:09:34.943410+0000","last_peered":"2023-12-07T21:09:34.943410+0000","last_clean":"2023-12-07T21:09:34.943410+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:09:34.943410+0000","last_undegraded":"2023-12-07T21:09:34.943410+0000","last_fullsized":"2023-12-07T21:09:34.943410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:53.311660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'28","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.693633+0000","last_change":"2023-12-07T21:09:00.894601+0000","last_active":"2023-12-07T21:10:18.693633+0000","last_peered":"2023-12-07T21:10:18.693633+0000","last_clean":"2023-12-07T21:10:18.693633+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:10:18.693633+0000","last_undegraded":"2023-12-07T21:10:18.693633+0000","last_fullsized":"2023-12-07T21:10:18.693633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:18.116768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944508+0000","last_change":"2023-12-07T21:09:02.907688+0000","last_active":"2023-12-07T21:09:34.944508+0000","last_peered":"2023-12-07T21:09:34.944508+0000","last_clean":"2023-12-07T21:09:34.944508+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:09:34.944508+0000","last_undegraded":"2023-12-07T21:09:34.944508+0000","last_fullsized":"2023-12-07T21:09:34.944508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:45.243063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.096317+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:10:13.096317+0000","last_peered":"2023-12-07T21:10:13.096317+0000","last_clean":"2023-12-07T21:10:13.096317+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:10:13.096317+0000","last_undegraded":"2023-12-07T21:10:13.096317+0000","last_fullsized":"2023-12-07T21:10:13.096317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:30:05.746781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.608964+0000","last_change":"2023-12-07T21:08:56.873059+0000","last_active":"2023-12-07T21:09:36.608964+0000","last_peered":"2023-12-07T21:09:36.608964+0000","last_clean":"2023-12-07T21:09:36.608964+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:09:36.608964+0000","last_undegraded":"2023-12-07T21:09:36.608964+0000","last_fullsized":"2023-12-07T21:09:36.608964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:17:57.351679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.429429+0000","last_change":"2023-12-07T21:08:54.890887+0000","last_active":"2023-12-07T21:10:18.429429+0000","last_peered":"2023-12-07T21:10:18.429429+0000","last_clean":"2023-12-07T21:10:18.429429+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:10:18.429429+0000","last_undegraded":"2023-12-07T21:10:18.429429+0000","last_fullsized":"2023-12-07T21:10:18.429429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:13.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938058+0000","last_change":"2023-12-07T21:08:58.878440+0000","last_active":"2023-12-07T21:09:34.938058+0000","last_peered":"2023-12-07T21:09:34.938058+0000","last_clean":"2023-12-07T21:09:34.938058+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:09:34.938058+0000","last_undegraded":"2023-12-07T21:09:34.938058+0000","last_fullsized":"2023-12-07T21:09:34.938058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:17:59.358154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'24","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.718296+0000","last_change":"2023-12-07T21:09:00.889913+0000","last_active":"2023-12-07T21:10:18.718296+0000","last_peered":"2023-12-07T21:10:18.718296+0000","last_clean":"2023-12-07T21:10:18.718296+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:10:18.718296+0000","last_undegraded":"2023-12-07T21:10:18.718296+0000","last_fullsized":"2023-12-07T21:10:18.718296+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:30.350522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945073+0000","last_change":"2023-12-07T21:09:02.906202+0000","last_active":"2023-12-07T21:09:34.945073+0000","last_peered":"2023-12-07T21:09:34.945073+0000","last_clean":"2023-12-07T21:09:34.945073+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:09:34.945073+0000","last_undegraded":"2023-12-07T21:09:34.945073+0000","last_fullsized":"2023-12-07T21:09:34.945073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:43.263341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.139472+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:10:59.139472+0000","last_peered":"2023-12-07T21:10:59.139472+0000","last_clean":"2023-12-07T21:10:59.139472+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:10:59.139472+0000","last_undegraded":"2023-12-07T21:10:59.139472+0000","last_fullsized":"2023-12-07T21:10:59.139472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:54:20.029030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'13","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737703+0000","last_change":"2023-12-07T21:08:56.869733+0000","last_active":"2023-12-07T21:10:18.737703+0000","last_peered":"2023-12-07T21:10:18.737703+0000","last_clean":"2023-12-07T21:10:18.737703+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:10:18.737703+0000","last_undegraded":"2023-12-07T21:10:18.737703+0000","last_fullsized":"2023-12-07T21:10:18.737703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:52.850966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.951401+0000","last_change":"2023-12-07T21:08:54.878825+0000","last_active":"2023-12-07T21:09:35.951401+0000","last_peered":"2023-12-07T21:09:35.951401+0000","last_clean":"2023-12-07T21:09:35.951401+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:09:35.951401+0000","last_undegraded":"2023-12-07T21:09:35.951401+0000","last_fullsized":"2023-12-07T21:09:35.951401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'6","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.755566+0000","last_change":"2023-12-07T21:08:58.877654+0000","last_active":"2023-12-07T21:10:59.755566+0000","last_peered":"2023-12-07T21:10:59.755566+0000","last_clean":"2023-12-07T21:10:59.755566+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:10:59.755566+0000","last_undegraded":"2023-12-07T21:10:59.755566+0000","last_fullsized":"2023-12-07T21:10:59.755566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:46:29.005775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'29","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:36.028017+0000","last_change":"2023-12-07T21:09:00.887872+0000","last_active":"2023-12-07T21:10:36.028017+0000","last_peered":"2023-12-07T21:10:36.028017+0000","last_clean":"2023-12-07T21:10:36.028017+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:10:36.028017+0000","last_undegraded":"2023-12-07T21:10:36.028017+0000","last_fullsized":"2023-12-07T21:10:36.028017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:24:17.551615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943699+0000","last_change":"2023-12-07T21:09:02.906870+0000","last_active":"2023-12-07T21:09:34.943699+0000","last_peered":"2023-12-07T21:09:34.943699+0000","last_clean":"2023-12-07T21:09:34.943699+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:09:34.943699+0000","last_undegraded":"2023-12-07T21:09:34.943699+0000","last_fullsized":"2023-12-07T21:09:34.943699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:58.034650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947166+0000","last_change":"2023-12-07T21:09:04.928655+0000","last_active":"2023-12-07T21:09:34.947166+0000","last_peered":"2023-12-07T21:09:34.947166+0000","last_clean":"2023-12-07T21:09:34.947166+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:09:34.947166+0000","last_undegraded":"2023-12-07T21:09:34.947166+0000","last_fullsized":"2023-12-07T21:09:34.947166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:38.068718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737343+0000","last_change":"2023-12-07T21:08:56.884246+0000","last_active":"2023-12-07T21:10:18.737343+0000","last_peered":"2023-12-07T21:10:18.737343+0000","last_clean":"2023-12-07T21:10:18.737343+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:10:18.737343+0000","last_undegraded":"2023-12-07T21:10:18.737343+0000","last_fullsized":"2023-12-07T21:10:18.737343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:59:20.004743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941027+0000","last_change":"2023-12-07T21:08:54.888408+0000","last_active":"2023-12-07T21:09:35.941027+0000","last_peered":"2023-12-07T21:09:35.941027+0000","last_clean":"2023-12-07T21:09:35.941027+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:09:35.941027+0000","last_undegraded":"2023-12-07T21:09:35.941027+0000","last_fullsized":"2023-12-07T21:09:35.941027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:47:51.435614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.366183+0000","last_change":"2023-12-07T21:08:56.873286+0000","last_active":"2023-12-07T21:09:36.366183+0000","last_peered":"2023-12-07T21:09:36.366183+0000","last_clean":"2023-12-07T21:09:36.366183+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:09:36.366183+0000","last_undegraded":"2023-12-07T21:09:36.366183+0000","last_fullsized":"2023-12-07T21:09:36.366183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:46.957293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941789+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:09:35.941789+0000","last_peered":"2023-12-07T21:09:35.941789+0000","last_clean":"2023-12-07T21:09:35.941789+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:09:35.941789+0000","last_undegraded":"2023-12-07T21:09:35.941789+0000","last_fullsized":"2023-12-07T21:09:35.941789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149073+0000","last_change":"2023-12-07T21:08:56.874905+0000","last_active":"2023-12-07T21:10:59.149073+0000","last_peered":"2023-12-07T21:10:59.149073+0000","last_clean":"2023-12-07T21:10:59.149073+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:10:59.149073+0000","last_undegraded":"2023-12-07T21:10:59.149073+0000","last_fullsized":"2023-12-07T21:10:59.149073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:54.612768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942708+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:09:35.942708+0000","last_peered":"2023-12-07T21:09:35.942708+0000","last_clean":"2023-12-07T21:09:35.942708+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:09:35.942708+0000","last_undegraded":"2023-12-07T21:09:35.942708+0000","last_fullsized":"2023-12-07T21:09:35.942708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:08:13.065644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944625+0000","last_change":"2023-12-07T21:08:56.872273+0000","last_active":"2023-12-07T21:09:34.944625+0000","last_peered":"2023-12-07T21:09:34.944625+0000","last_clean":"2023-12-07T21:09:34.944625+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:09:34.944625+0000","last_undegraded":"2023-12-07T21:09:34.944625+0000","last_fullsized":"2023-12-07T21:09:34.944625+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:50.983783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942688+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:09:35.942688+0000","last_peered":"2023-12-07T21:09:35.942688+0000","last_clean":"2023-12-07T21:09:35.942688+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:09:35.942688+0000","last_undegraded":"2023-12-07T21:09:35.942688+0000","last_fullsized":"2023-12-07T21:09:35.942688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942566+0000","last_change":"2023-12-07T21:08:56.876070+0000","last_active":"2023-12-07T21:09:35.942566+0000","last_peered":"2023-12-07T21:09:35.942566+0000","last_clean":"2023-12-07T21:09:35.942566+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:09:35.942566+0000","last_undegraded":"2023-12-07T21:09:35.942566+0000","last_fullsized":"2023-12-07T21:09:35.942566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:19.739101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944830+0000","last_change":"2023-12-07T21:08:54.874578+0000","last_active":"2023-12-07T21:09:34.944830+0000","last_peered":"2023-12-07T21:09:34.944830+0000","last_clean":"2023-12-07T21:09:34.944830+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:09:34.944830+0000","last_undegraded":"2023-12-07T21:09:34.944830+0000","last_fullsized":"2023-12-07T21:09:34.944830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.366353+0000","last_change":"2023-12-07T21:08:56.883348+0000","last_active":"2023-12-07T21:09:36.366353+0000","last_peered":"2023-12-07T21:09:36.366353+0000","last_clean":"2023-12-07T21:09:36.366353+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:09:36.366353+0000","last_undegraded":"2023-12-07T21:09:36.366353+0000","last_fullsized":"2023-12-07T21:09:36.366353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:38:34.904995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938504+0000","last_change":"2023-12-07T21:08:54.887259+0000","last_active":"2023-12-07T21:09:34.938504+0000","last_peered":"2023-12-07T21:09:34.938504+0000","last_clean":"2023-12-07T21:09:34.938504+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:09:34.938504+0000","last_undegraded":"2023-12-07T21:09:34.938504+0000","last_fullsized":"2023-12-07T21:09:34.938504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942527+0000","last_change":"2023-12-07T21:08:56.876299+0000","last_active":"2023-12-07T21:09:35.942527+0000","last_peered":"2023-12-07T21:09:35.942527+0000","last_clean":"2023-12-07T21:09:35.942527+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:09:35.942527+0000","last_undegraded":"2023-12-07T21:09:35.942527+0000","last_fullsized":"2023-12-07T21:09:35.942527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:26.744258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945448+0000","last_change":"2023-12-07T21:08:54.885457+0000","last_active":"2023-12-07T21:09:34.945448+0000","last_peered":"2023-12-07T21:09:34.945448+0000","last_clean":"2023-12-07T21:09:34.945448+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:09:34.945448+0000","last_undegraded":"2023-12-07T21:09:34.945448+0000","last_fullsized":"2023-12-07T21:09:34.945448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.949262+0000","last_change":"2023-12-07T21:08:56.887101+0000","last_active":"2023-12-07T21:09:35.949262+0000","last_peered":"2023-12-07T21:09:35.949262+0000","last_clean":"2023-12-07T21:09:35.949262+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:09:35.949262+0000","last_undegraded":"2023-12-07T21:09:35.949262+0000","last_fullsized":"2023-12-07T21:09:35.949262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944921+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:09:34.944921+0000","last_peered":"2023-12-07T21:09:34.944921+0000","last_clean":"2023-12-07T21:09:34.944921+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:09:34.944921+0000","last_undegraded":"2023-12-07T21:09:34.944921+0000","last_fullsized":"2023-12-07T21:09:34.944921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:59.087021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939689+0000","last_change":"2023-12-07T21:08:56.882240+0000","last_active":"2023-12-07T21:09:34.939689+0000","last_peered":"2023-12-07T21:09:34.939689+0000","last_clean":"2023-12-07T21:09:34.939689+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:09:34.939689+0000","last_undegraded":"2023-12-07T21:09:34.939689+0000","last_fullsized":"2023-12-07T21:09:34.939689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:06:24.998742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945083+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:09:34.945083+0000","last_peered":"2023-12-07T21:09:34.945083+0000","last_clean":"2023-12-07T21:09:34.945083+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:09:34.945083+0000","last_undegraded":"2023-12-07T21:09:34.945083+0000","last_fullsized":"2023-12-07T21:09:34.945083+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:45.038325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173489+0000","last_change":"2023-12-07T21:08:56.875906+0000","last_active":"2023-12-07T21:10:18.173489+0000","last_peered":"2023-12-07T21:10:18.173489+0000","last_clean":"2023-12-07T21:10:18.173489+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:10:18.173489+0000","last_undegraded":"2023-12-07T21:10:18.173489+0000","last_fullsized":"2023-12-07T21:10:18.173489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:40:40.318522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.582974+0000","last_change":"2023-12-07T21:08:54.883629+0000","last_active":"2023-12-07T21:09:36.582974+0000","last_peered":"2023-12-07T21:09:36.582974+0000","last_clean":"2023-12-07T21:09:36.582974+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:09:36.582974+0000","last_undegraded":"2023-12-07T21:09:36.582974+0000","last_fullsized":"2023-12-07T21:09:36.582974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945789+0000","last_change":"2023-12-07T21:08:56.876309+0000","last_active":"2023-12-07T21:09:34.945789+0000","last_peered":"2023-12-07T21:09:34.945789+0000","last_clean":"2023-12-07T21:09:34.945789+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:09:34.945789+0000","last_undegraded":"2023-12-07T21:09:34.945789+0000","last_fullsized":"2023-12-07T21:09:34.945789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938005+0000","last_change":"2023-12-07T21:08:54.887130+0000","last_active":"2023-12-07T21:09:34.938005+0000","last_peered":"2023-12-07T21:09:34.938005+0000","last_clean":"2023-12-07T21:09:34.938005+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:09:34.938005+0000","last_undegraded":"2023-12-07T21:09:34.938005+0000","last_fullsized":"2023-12-07T21:09:34.938005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:18.078984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.359942+0000","last_change":"2023-12-07T21:08:56.871205+0000","last_active":"2023-12-07T21:09:36.359942+0000","last_peered":"2023-12-07T21:09:36.359942+0000","last_clean":"2023-12-07T21:09:36.359942+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:09:36.359942+0000","last_undegraded":"2023-12-07T21:09:36.359942+0000","last_fullsized":"2023-12-07T21:09:36.359942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:28:15.740800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938315+0000","last_change":"2023-12-07T21:08:54.884013+0000","last_active":"2023-12-07T21:09:34.938315+0000","last_peered":"2023-12-07T21:09:34.938315+0000","last_clean":"2023-12-07T21:09:34.938315+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:09:34.938315+0000","last_undegraded":"2023-12-07T21:09:34.938315+0000","last_fullsized":"2023-12-07T21:09:34.938315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.021932+0000","last_change":"2023-12-07T21:08:56.879513+0000","last_active":"2023-12-07T21:09:37.021932+0000","last_peered":"2023-12-07T21:09:37.021932+0000","last_clean":"2023-12-07T21:09:37.021932+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:09:37.021932+0000","last_undegraded":"2023-12-07T21:09:37.021932+0000","last_fullsized":"2023-12-07T21:09:37.021932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:46.957293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947567+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:09:34.947567+0000","last_peered":"2023-12-07T21:09:34.947567+0000","last_clean":"2023-12-07T21:09:34.947567+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:09:34.947567+0000","last_undegraded":"2023-12-07T21:09:34.947567+0000","last_fullsized":"2023-12-07T21:09:34.947567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:20.130565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'15","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173409+0000","last_change":"2023-12-07T21:08:56.882760+0000","last_active":"2023-12-07T21:10:18.173409+0000","last_peered":"2023-12-07T21:10:18.173409+0000","last_clean":"2023-12-07T21:10:18.173409+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:10:18.173409+0000","last_undegraded":"2023-12-07T21:10:18.173409+0000","last_fullsized":"2023-12-07T21:10:18.173409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:19:53.055254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948503+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:09:34.948503+0000","last_peered":"2023-12-07T21:09:34.948503+0000","last_clean":"2023-12-07T21:09:34.948503+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:09:34.948503+0000","last_undegraded":"2023-12-07T21:09:34.948503+0000","last_fullsized":"2023-12-07T21:09:34.948503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:57.843520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737487+0000","last_change":"2023-12-07T21:08:56.876875+0000","last_active":"2023-12-07T21:10:18.737487+0000","last_peered":"2023-12-07T21:10:18.737487+0000","last_clean":"2023-12-07T21:10:18.737487+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:10:18.737487+0000","last_undegraded":"2023-12-07T21:10:18.737487+0000","last_fullsized":"2023-12-07T21:10:18.737487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:53.347638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945653+0000","last_change":"2023-12-07T21:08:54.885432+0000","last_active":"2023-12-07T21:09:34.945653+0000","last_peered":"2023-12-07T21:09:34.945653+0000","last_clean":"2023-12-07T21:09:34.945653+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:09:34.945653+0000","last_undegraded":"2023-12-07T21:09:34.945653+0000","last_fullsized":"2023-12-07T21:09:34.945653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737853+0000","last_change":"2023-12-07T21:08:56.889380+0000","last_active":"2023-12-07T21:10:18.737853+0000","last_peered":"2023-12-07T21:10:18.737853+0000","last_clean":"2023-12-07T21:10:18.737853+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:10:18.737853+0000","last_undegraded":"2023-12-07T21:10:18.737853+0000","last_fullsized":"2023-12-07T21:10:18.737853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:47.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948829+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:09:34.948829+0000","last_peered":"2023-12-07T21:09:34.948829+0000","last_clean":"2023-12-07T21:09:34.948829+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:09:34.948829+0000","last_undegraded":"2023-12-07T21:09:34.948829+0000","last_fullsized":"2023-12-07T21:09:34.948829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:45.814396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945250+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:09:34.945250+0000","last_peered":"2023-12-07T21:09:34.945250+0000","last_clean":"2023-12-07T21:09:34.945250+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:09:34.945250+0000","last_undegraded":"2023-12-07T21:09:34.945250+0000","last_fullsized":"2023-12-07T21:09:34.945250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:24.756037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.066771+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:09:36.066771+0000","last_peered":"2023-12-07T21:09:36.066771+0000","last_clean":"2023-12-07T21:09:36.066771+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:09:36.066771+0000","last_undegraded":"2023-12-07T21:09:36.066771+0000","last_fullsized":"2023-12-07T21:09:36.066771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943662+0000","last_change":"2023-12-07T21:08:54.883760+0000","last_active":"2023-12-07T21:09:34.943662+0000","last_peered":"2023-12-07T21:09:34.943662+0000","last_clean":"2023-12-07T21:09:34.943662+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:09:34.943662+0000","last_undegraded":"2023-12-07T21:09:34.943662+0000","last_fullsized":"2023-12-07T21:09:34.943662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938907+0000","last_change":"2023-12-07T21:08:56.881838+0000","last_active":"2023-12-07T21:09:34.938907+0000","last_peered":"2023-12-07T21:09:34.938907+0000","last_clean":"2023-12-07T21:09:34.938907+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:09:34.938907+0000","last_undegraded":"2023-12-07T21:09:34.938907+0000","last_fullsized":"2023-12-07T21:09:34.938907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:29.862000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1340,"num_read_kb":1123,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1173,"ondisk_log_size":1173,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":351,"num_read_kb":351,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705697,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.35099999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54300000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.34499999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56899999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34300000000000003,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.44400000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52500000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.375},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.34599999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33300000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.50800000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.219,"15min":0.219},"max":{"1min":0.58699999999999997,"5min":0.621,"15min":0.621},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.318,"15min":0.318},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.39100000000000001,"5min":0.436,"15min":0.436},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.247,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.307}]}]},{"osd":1,"up_from":9,"seq":38654705696,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28000000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.434},{"interface":"front","average":{"1min":0.442,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.23799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.54200000000000004,"5min":0.629,"15min":0.629},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.373},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.38},"min":{"1min":0.25900000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.48399999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.39000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705697,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68300000000000005,"5min":0.747,"15min":0.747},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.504}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:11:07.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T21:11:07.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.729+0000 7fca47609640 1 Processor -- start 2023-12-07T21:11:07.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.729+0000 7fca47609640 1 -- start start 2023-12-07T21:11:07.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.729+0000 7fca47609640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca4012d530 0x7fca4012f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:07.722 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.729+0000 7fca47609640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4012a1e0 con 0x7fca4012a5a0 2023-12-07T21:11:07.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.729+0000 7fca47609640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4006f890 con 0x7fca4012d530 2023-12-07T21:11:07.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.729+0000 7fca44ba4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fca4012d530 0x7fca4012f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:07.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.729+0000 7fca453a5640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fca4012a5a0 0x7fca4012a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39498/0 (socket says 172.21.15.89:39498) 2023-12-07T21:11:07.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.729+0000 7fca453a5640 1 -- 172.21.15.89:0/3818549430 learned_addr learned my addr 172.21.15.89:0/3818549430 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:07.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.730+0000 7fca44ba4640 1 -- 172.21.15.89:0/3818549430 >> v1:172.21.15.89:6789/0 conn(0x7fca4012a5a0 legacy=0x7fca4012a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.730+0000 7fca44ba4640 1 -- 172.21.15.89:0/3818549430 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4006f220 con 0x7fca4012d530 2023-12-07T21:11:07.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.730+0000 7fca44ba4640 1 --2- 172.21.15.89:0/3818549430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca4012d530 0x7fca4012f920 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fca30009720 tx=0x7fca3002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ed1da68cb813f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:07.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.731+0000 7fca37fff640 1 -- 172.21.15.89:0/3818549430 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca30031760 con 0x7fca4012d530 2023-12-07T21:11:07.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.731+0000 7fca37fff640 1 -- 172.21.15.89:0/3818549430 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca300318c0 con 0x7fca4012d530 2023-12-07T21:11:07.724 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.731+0000 7fca37fff640 1 -- 172.21.15.89:0/3818549430 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca30031b80 con 0x7fca4012d530 2023-12-07T21:11:07.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.731+0000 7fca47609640 1 -- 172.21.15.89:0/3818549430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca4012d530 msgr2=0x7fca4012f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.731+0000 7fca47609640 1 --2- 172.21.15.89:0/3818549430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca4012d530 0x7fca4012f920 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fca30009720 tx=0x7fca3002b8d0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.731+0000 7fca47609640 1 -- 172.21.15.89:0/3818549430 shutdown_connections 2023-12-07T21:11:07.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.731+0000 7fca47609640 1 --2- 172.21.15.89:0/3818549430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca4012d530 0x7fca4012f920 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.731+0000 7fca47609640 1 -- 172.21.15.89:0/3818549430 >> 172.21.15.89:0/3818549430 conn(0x7fca400987f0 msgr2=0x7fca40098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.731+0000 7fca47609640 1 -- 172.21.15.89:0/3818549430 shutdown_connections 2023-12-07T21:11:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.731+0000 7fca47609640 1 -- 172.21.15.89:0/3818549430 wait complete. 2023-12-07T21:11:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.732+0000 7fca47609640 1 Processor -- start 2023-12-07T21:11:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.732+0000 7fca47609640 1 -- start start 2023-12-07T21:11:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.732+0000 7fca47609640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca4012a5a0 0x7fca40121f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.732+0000 7fca47609640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca40129320 con 0x7fca4012a5a0 2023-12-07T21:11:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.732+0000 7fca453a5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca4012a5a0 0x7fca40121f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:07.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.732+0000 7fca453a5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca4012a5a0 0x7fca40121f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38270/0 (socket says 172.21.15.89:38270) 2023-12-07T21:11:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.732+0000 7fca453a5640 1 -- 172.21.15.89:0/608007015 learned_addr learned my addr 172.21.15.89:0/608007015 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.733+0000 7fca453a5640 1 -- 172.21.15.89:0/608007015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30009400 con 0x7fca4012a5a0 2023-12-07T21:11:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.733+0000 7fca453a5640 1 --2- 172.21.15.89:0/608007015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca4012a5a0 0x7fca40121f20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00c4a0 tx=0x7fca3c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.733+0000 7fca35ffb640 1 -- 172.21.15.89:0/608007015 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca3c005c10 con 0x7fca4012a5a0 2023-12-07T21:11:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.733+0000 7fca35ffb640 1 -- 172.21.15.89:0/608007015 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c005d70 con 0x7fca4012a5a0 2023-12-07T21:11:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.733+0000 7fca47609640 1 -- 172.21.15.89:0/608007015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca40089540 con 0x7fca4012a5a0 2023-12-07T21:11:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.733+0000 7fca35ffb640 1 -- 172.21.15.89:0/608007015 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca3c0071a0 con 0x7fca4012a5a0 2023-12-07T21:11:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.733+0000 7fca47609640 1 -- 172.21.15.89:0/608007015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca40124680 con 0x7fca4012a5a0 2023-12-07T21:11:07.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.734+0000 7fca35ffb640 1 -- 172.21.15.89:0/608007015 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fca3c007300 con 0x7fca4012a5a0 2023-12-07T21:11:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.734+0000 7fca35ffb640 1 --2- 172.21.15.89:0/608007015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca24037820 0x7fca24039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.734+0000 7fca35ffb640 1 -- 172.21.15.89:0/608007015 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fca3c04a070 con 0x7fca4012a5a0 2023-12-07T21:11:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.734+0000 7fca47609640 1 -- 172.21.15.89:0/608007015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca400897b0 con 0x7fca4012a5a0 2023-12-07T21:11:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.734+0000 7fca44ba4640 1 --2- 172.21.15.89:0/608007015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca24037820 0x7fca24039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:07.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.735+0000 7fca44ba4640 1 --2- 172.21.15.89:0/608007015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca24037820 0x7fca24039ce0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca30036000 tx=0x7fca30008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:07.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.739+0000 7fca35ffb640 1 -- 172.21.15.89:0/608007015 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca400897b0 con 0x7fca4012a5a0 2023-12-07T21:11:07.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.908+0000 7fca47609640 1 -- 172.21.15.89:0/608007015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca400897b0 con 0x7fca4012a5a0 2023-12-07T21:11:07.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.909+0000 7fca35ffb640 1 -- 172.21.15.89:0/608007015 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+20711 (secure 0 0 0) 0x7fca400897b0 con 0x7fca4012a5a0 2023-12-07T21:11:07.902 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:11:07.902 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":33,"fsid":"49fe948c-b519-4268-9cf3-54fad381ce79","created":"2023-12-07T21:08:29.796839+0000","modified":"2023-12-07T21:09:35.935802+0000","last_up_change":"2023-12-07T21:08:38.626187+0000","last_in_change":"2023-12-07T21:08:30.921504+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T21:08:40.087062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-07T21:08:45.355151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2023-12-07T21:08:52.863253+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2023-12-07T21:08:55.182221+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.190000057220459,"score_stable":1.190000057220459,"optimal_score":1,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2023-12-07T21:08:57.056674+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2023-12-07T21:08:58.942702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2023-12-07T21:09:00.915103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2023-12-07T21:09:02.992871+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c7d49515-b2a2-4323-9af0-d3ba338a0dc8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6801","nonce":654939948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6803","nonce":654939948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6807","nonce":654939948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":654939948},{"type":"v1","addr":"172.21.15.89:6805","nonce":654939948}]},"public_addr":"172.21.15.89:6801/654939948","cluster_addr":"172.21.15.89:6803/654939948","heartbeat_back_addr":"172.21.15.89:6807/654939948","heartbeat_front_addr":"172.21.15.89:6805/654939948","state":["exists","up"]},{"osd":1,"uuid":"ab1d5fe6-a976-4a30-abd1-a28b2c6de703","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6809","nonce":2140819418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6811","nonce":2140819418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6815","nonce":2140819418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":2140819418},{"type":"v1","addr":"172.21.15.121:6813","nonce":2140819418}]},"public_addr":"172.21.15.121:6809/2140819418","cluster_addr":"172.21.15.121:6811/2140819418","heartbeat_back_addr":"172.21.15.121:6815/2140819418","heartbeat_front_addr":"172.21.15.121:6813/2140819418","state":["exists","up"]},{"osd":2,"uuid":"9426627e-2a0c-4ce2-9f5d-57bb763a881c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6817","nonce":2557538450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6819","nonce":2557538450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6823","nonce":2557538450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2557538450},{"type":"v1","addr":"172.21.15.121:6821","nonce":2557538450}]},"public_addr":"172.21.15.121:6817/2557538450","cluster_addr":"172.21.15.121:6819/2557538450","heartbeat_back_addr":"172.21.15.121:6823/2557538450","heartbeat_front_addr":"172.21.15.121:6821/2557538450","state":["exists","up"]},{"osd":3,"uuid":"02e748fb-1486-4c5c-8d34-7221bdfca701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6801","nonce":4032235766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6803","nonce":4032235766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6807","nonce":4032235766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":4032235766},{"type":"v1","addr":"172.21.15.121:6805","nonce":4032235766}]},"public_addr":"172.21.15.121:6801/4032235766","cluster_addr":"172.21.15.121:6803/4032235766","heartbeat_back_addr":"172.21.15.121:6807/4032235766","heartbeat_front_addr":"172.21.15.121:6805/4032235766","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:35.919729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:36.084357+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:36.076845+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T21:08:35.994710+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":0}]},{"pgid":"4.3d","mappings":[{"from":3,"to":2}]},{"pgid":"5.0","mappings":[{"from":0,"to":2}]},{"pgid":"5.16","mappings":[{"from":0,"to":2}]},{"pgid":"5.1f","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T21:11:07.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.911+0000 7fca47609640 1 -- 172.21.15.89:0/608007015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca24037820 msgr2=0x7fca24039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.911+0000 7fca47609640 1 --2- 172.21.15.89:0/608007015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca24037820 0x7fca24039ce0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca30036000 tx=0x7fca30008030 comp rx=0 tx=0).stop 2023-12-07T21:11:07.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.911+0000 7fca47609640 1 -- 172.21.15.89:0/608007015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca4012a5a0 msgr2=0x7fca40121f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:07.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.911+0000 7fca47609640 1 --2- 172.21.15.89:0/608007015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca4012a5a0 0x7fca40121f20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00c4a0 tx=0x7fca3c00c960 comp rx=0 tx=0).stop 2023-12-07T21:11:07.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.911+0000 7fca47609640 1 -- 172.21.15.89:0/608007015 shutdown_connections 2023-12-07T21:11:07.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.911+0000 7fca47609640 1 --2- 172.21.15.89:0/608007015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fca24037820 0x7fca24039ce0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.911+0000 7fca47609640 1 --2- 172.21.15.89:0/608007015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca4012a5a0 0x7fca40121f20 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:07.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.911+0000 7fca47609640 1 -- 172.21.15.89:0/608007015 >> 172.21.15.89:0/608007015 conn(0x7fca400987f0 msgr2=0x7fca400997d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:07.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.911+0000 7fca47609640 1 -- 172.21.15.89:0/608007015 shutdown_connections 2023-12-07T21:11:07.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:07.911+0000 7fca47609640 1 -- 172.21.15.89:0/608007015 wait complete. 2023-12-07T21:11:08.914 INFO:tasks.ceph:Scrubbing osd.0 2023-12-07T21:11:08.915 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-07T21:11:09.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.037+0000 7f178d5c0640 1 Processor -- start 2023-12-07T21:11:09.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.037+0000 7f178d5c0640 1 -- start start 2023-12-07T21:11:09.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.038+0000 7f178d5c0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f178812d890 0x7f178812df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.038+0000 7f178d5c0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178806e280 con 0x7f178812e480 2023-12-07T21:11:09.030 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.038+0000 7f178d5c0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178812dc70 con 0x7f178812d890 2023-12-07T21:11:09.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.038+0000 7f1786ffd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f178812d890 0x7f178812df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.038+0000 7f17867fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f178812e480 0x7f178812a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39692/0 (socket says 172.21.15.89:39692) 2023-12-07T21:11:09.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.038+0000 7f17867fc640 1 -- 172.21.15.89:0/1162269923 learned_addr learned my addr 172.21.15.89:0/1162269923 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:09.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.038+0000 7f1786ffd640 1 -- 172.21.15.89:0/1162269923 >> v1:172.21.15.89:6789/0 conn(0x7f178812e480 legacy=0x7f178812a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.038+0000 7f1786ffd640 1 -- 172.21.15.89:0/1162269923 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178806f980 con 0x7f178812d890 2023-12-07T21:11:09.031 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.038+0000 7f1785ffb640 1 -- 172.21.15.89:0/1162269923 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794596940 0 0) 0x7f178806e280 con 0x7f178812e480 2023-12-07T21:11:09.033 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.039+0000 7f1786ffd640 1 --2- 172.21.15.89:0/1162269923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178812d890 0x7f178812df40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1778009720 tx=0x7f177802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93d72ecfd96514d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.039+0000 7f1785ffb640 1 -- 172.21.15.89:0/1162269923 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f177802e070 con 0x7f178812d890 2023-12-07T21:11:09.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.039+0000 7f1785ffb640 1 -- 172.21.15.89:0/1162269923 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17780316d0 con 0x7f178812d890 2023-12-07T21:11:09.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.039+0000 7f1785ffb640 1 -- 172.21.15.89:0/1162269923 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1778031990 con 0x7f178812d890 2023-12-07T21:11:09.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.039+0000 7f178d5c0640 1 -- 172.21.15.89:0/1162269923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178812d890 msgr2=0x7f178812df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.039+0000 7f178d5c0640 1 --2- 172.21.15.89:0/1162269923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178812d890 0x7f178812df40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1778009720 tx=0x7f177802b840 comp rx=0 tx=0).stop 2023-12-07T21:11:09.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.039+0000 7f178d5c0640 1 -- 172.21.15.89:0/1162269923 shutdown_connections 2023-12-07T21:11:09.034 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.039+0000 7f178d5c0640 1 --2- 172.21.15.89:0/1162269923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178812d890 0x7f178812df40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.039+0000 7f178d5c0640 1 -- 172.21.15.89:0/1162269923 >> 172.21.15.89:0/1162269923 conn(0x7f178809fc00 msgr2=0x7f17880a0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:09.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.040+0000 7f178d5c0640 1 -- 172.21.15.89:0/1162269923 shutdown_connections 2023-12-07T21:11:09.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.040+0000 7f178d5c0640 1 -- 172.21.15.89:0/1162269923 wait complete. 2023-12-07T21:11:09.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.040+0000 7f178d5c0640 1 Processor -- start 2023-12-07T21:11:09.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.041+0000 7f178d5c0640 1 -- start start 2023-12-07T21:11:09.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.041+0000 7f178d5c0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178812d890 0x7f1788125380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.041+0000 7f178d5c0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178809a240 con 0x7f178812d890 2023-12-07T21:11:09.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.041+0000 7f1786ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178812d890 0x7f1788125380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.041+0000 7f1786ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178812d890 0x7f1788125380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46390/0 (socket says 172.21.15.89:46390) 2023-12-07T21:11:09.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.041+0000 7f1786ffd640 1 -- 172.21.15.89:0/241333210 learned_addr learned my addr 172.21.15.89:0/241333210 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:09.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.041+0000 7f1786ffd640 1 -- 172.21.15.89:0/241333210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1778009400 con 0x7f178812d890 2023-12-07T21:11:09.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.041+0000 7f1786ffd640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178812d890 0x7f1788125380 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1778034040 tx=0x7f17780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.042+0000 7f176f7fe640 1 -- 172.21.15.89:0/241333210 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1778032830 con 0x7f178812d890 2023-12-07T21:11:09.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.042+0000 7f176f7fe640 1 -- 172.21.15.89:0/241333210 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1778032990 con 0x7f178812d890 2023-12-07T21:11:09.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.042+0000 7f176f7fe640 1 -- 172.21.15.89:0/241333210 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1778032c50 con 0x7f178812d890 2023-12-07T21:11:09.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.042+0000 7f178d5c0640 1 -- 172.21.15.89:0/241333210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1788127d50 con 0x7f178812d890 2023-12-07T21:11:09.036 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.042+0000 7f178d5c0640 1 -- 172.21.15.89:0/241333210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1788127130 con 0x7f178812d890 2023-12-07T21:11:09.037 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.042+0000 7f176f7fe640 1 -- 172.21.15.89:0/241333210 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f177804e450 con 0x7f178812d890 2023-12-07T21:11:09.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.043+0000 7f178d5c0640 1 -- 172.21.15.89:0/241333210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1788073f10 con 0x7f178812d890 2023-12-07T21:11:09.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.043+0000 7f176f7fe640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1774037820 0x7f1774039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.043+0000 7f176f7fe640 1 -- 172.21.15.89:0/241333210 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f177806cf20 con 0x7f178812d890 2023-12-07T21:11:09.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.043+0000 7f176f7fe640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f1774043a60 0x7f1774045f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.043+0000 7f176f7fe640 1 -- 172.21.15.89:0/241333210 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17740465d0 con 0x7f1774043a60 2023-12-07T21:11:09.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.043+0000 7f176f7fe640 1 -- 172.21.15.89:0/241333210 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1778032db0 con 0x7f178812d890 2023-12-07T21:11:09.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.043+0000 7f17877fe640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f1774043a60 0x7f1774045f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.038 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.043+0000 7f17867fc640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1774037820 0x7f1774039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.043+0000 7f17877fe640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f1774043a60 0x7f1774045f00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.043+0000 7f17867fc640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1774037820 0x7f1774039ce0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f177c000c00 tx=0x7f177c007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.039 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.044+0000 7f176f7fe640 1 -- 172.21.15.89:0/241333210 <== osd.0 v2:172.21.15.89:6800/654939948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f17740465d0 con 0x7f1774043a60 2023-12-07T21:11:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 -- 172.21.15.89:0/241333210 --> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1788126de0 con 0x7f1774043a60 2023-12-07T21:11:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f176f7fe640 1 -- 172.21.15.89:0/241333210 <== osd.0 v2:172.21.15.89:6800/654939948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1780011040 con 0x7f1774043a60 2023-12-07T21:11:09.049 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T21:11:09.049 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T21:11:09.049 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T21:11:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 -- 172.21.15.89:0/241333210 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f1774043a60 msgr2=0x7f1774045f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f1774043a60 0x7f1774045f00 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 -- 172.21.15.89:0/241333210 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1774037820 msgr2=0x7f1774039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1774037820 0x7f1774039ce0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f177c000c00 tx=0x7f177c007970 comp rx=0 tx=0).stop 2023-12-07T21:11:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 -- 172.21.15.89:0/241333210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178812d890 msgr2=0x7f1788125380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178812d890 0x7f1788125380 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1778034040 tx=0x7f17780046c0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 -- 172.21.15.89:0/241333210 shutdown_connections 2023-12-07T21:11:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.89:6800/654939948,v1:172.21.15.89:6801/654939948] conn(0x7f1774043a60 0x7f1774045f00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1774037820 0x7f1774039ce0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 --2- 172.21.15.89:0/241333210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178812d890 0x7f1788125380 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 -- 172.21.15.89:0/241333210 >> 172.21.15.89:0/241333210 conn(0x7f178809fc00 msgr2=0x7f178806fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 -- 172.21.15.89:0/241333210 shutdown_connections 2023-12-07T21:11:09.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.057+0000 7f178d5c0640 1 -- 172.21.15.89:0/241333210 wait complete. 2023-12-07T21:11:09.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-07T21:11:09.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.167+0000 7f380a675640 1 Processor -- start 2023-12-07T21:11:09.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.167+0000 7f380a675640 1 -- start start 2023-12-07T21:11:09.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.167+0000 7f380a675640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f380406cc70 0x7f380406d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.167+0000 7f380a675640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3804070320 con 0x7f380406d590 2023-12-07T21:11:09.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.167+0000 7f380a675640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380409ad20 con 0x7f380406cc70 2023-12-07T21:11:09.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.167+0000 7f3803fff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f380406cc70 0x7f380406d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.167+0000 7f38037fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f380406d590 0x7f38040950b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39708/0 (socket says 172.21.15.89:39708) 2023-12-07T21:11:09.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.167+0000 7f38037fe640 1 -- 172.21.15.89:0/4225964199 learned_addr learned my addr 172.21.15.89:0/4225964199 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:09.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.167+0000 7f3803fff640 1 -- 172.21.15.89:0/4225964199 >> v1:172.21.15.89:6789/0 conn(0x7f380406d590 legacy=0x7f38040950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.167+0000 7f3803fff640 1 -- 172.21.15.89:0/4225964199 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3804071540 con 0x7f380406cc70 2023-12-07T21:11:09.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.168+0000 7f3803fff640 1 --2- 172.21.15.89:0/4225964199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380406cc70 0x7f380406d050 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009720 tx=0x7f37f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54477fd4f34e370 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.168+0000 7f3802ffd640 1 -- 172.21.15.89:0/4225964199 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37f402e070 con 0x7f380406cc70 2023-12-07T21:11:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.168+0000 7f3802ffd640 1 -- 172.21.15.89:0/4225964199 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f40316d0 con 0x7f380406cc70 2023-12-07T21:11:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.168+0000 7f3802ffd640 1 -- 172.21.15.89:0/4225964199 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37f4031990 con 0x7f380406cc70 2023-12-07T21:11:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.169+0000 7f380a675640 1 -- 172.21.15.89:0/4225964199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380406cc70 msgr2=0x7f380406d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.169+0000 7f380a675640 1 --2- 172.21.15.89:0/4225964199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380406cc70 0x7f380406d050 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009720 tx=0x7f37f402b840 comp rx=0 tx=0).stop 2023-12-07T21:11:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.169+0000 7f380a675640 1 -- 172.21.15.89:0/4225964199 shutdown_connections 2023-12-07T21:11:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.169+0000 7f380a675640 1 --2- 172.21.15.89:0/4225964199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380406cc70 0x7f380406d050 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.169+0000 7f380a675640 1 -- 172.21.15.89:0/4225964199 >> 172.21.15.89:0/4225964199 conn(0x7f38040986a0 msgr2=0x7f3804098ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:09.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.169+0000 7f380a675640 1 -- 172.21.15.89:0/4225964199 shutdown_connections 2023-12-07T21:11:09.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.169+0000 7f380a675640 1 -- 172.21.15.89:0/4225964199 wait complete. 2023-12-07T21:11:09.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.170+0000 7f380a675640 1 Processor -- start 2023-12-07T21:11:09.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.170+0000 7f380a675640 1 -- start start 2023-12-07T21:11:09.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.170+0000 7f380a675640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380406cc70 0x7f3804122b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.170+0000 7f380a675640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3804123d00 con 0x7f380406cc70 2023-12-07T21:11:09.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.170+0000 7f3803fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380406cc70 0x7f3804122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.170+0000 7f3803fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380406cc70 0x7f3804122b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46414/0 (socket says 172.21.15.89:46414) 2023-12-07T21:11:09.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.170+0000 7f3803fff640 1 -- 172.21.15.89:0/2320109901 learned_addr learned my addr 172.21.15.89:0/2320109901 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:09.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.170+0000 7f3803fff640 1 -- 172.21.15.89:0/2320109901 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f4009400 con 0x7f380406cc70 2023-12-07T21:11:09.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.171+0000 7f3803fff640 1 --2- 172.21.15.89:0/2320109901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380406cc70 0x7f3804122b30 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f37f4034040 tx=0x7f37f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.171+0000 7f3800ff9640 1 -- 172.21.15.89:0/2320109901 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37f4032830 con 0x7f380406cc70 2023-12-07T21:11:09.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.171+0000 7f3800ff9640 1 -- 172.21.15.89:0/2320109901 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f4032990 con 0x7f380406cc70 2023-12-07T21:11:09.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.171+0000 7f3800ff9640 1 -- 172.21.15.89:0/2320109901 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37f4032c50 con 0x7f380406cc70 2023-12-07T21:11:09.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.171+0000 7f380a675640 1 -- 172.21.15.89:0/2320109901 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38041243c0 con 0x7f380406cc70 2023-12-07T21:11:09.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.171+0000 7f380a675640 1 -- 172.21.15.89:0/2320109901 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38041b37b0 con 0x7f380406cc70 2023-12-07T21:11:09.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.172+0000 7f3800ff9640 1 -- 172.21.15.89:0/2320109901 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f37f404d3f0 con 0x7f380406cc70 2023-12-07T21:11:09.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.172+0000 7f380a675640 1 -- 172.21.15.89:0/2320109901 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3804062110 con 0x7f380406cc70 2023-12-07T21:11:09.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.172+0000 7f3800ff9640 1 --2- 172.21.15.89:0/2320109901 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f0037820 0x7f37f0039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.172+0000 7f3800ff9640 1 -- 172.21.15.89:0/2320109901 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f37f406c770 con 0x7f380406cc70 2023-12-07T21:11:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.172+0000 7f38037fe640 1 --2- 172.21.15.89:0/2320109901 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f0037820 0x7f37f0039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.173+0000 7f38037fe640 1 --2- 172.21.15.89:0/2320109901 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f0037820 0x7f37f0039ce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007fd0 tx=0x7f37f8007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.176+0000 7f3800ff9640 1 -- 172.21.15.89:0/2320109901 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37f404d6a0 con 0x7f380406cc70 2023-12-07T21:11:09.334 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.342+0000 7f380a675640 1 -- 172.21.15.89:0/2320109901 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f380406d9e0 con 0x7f37f0037820 2023-12-07T21:11:09.335 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.343+0000 7f3800ff9640 1 -- 172.21.15.89:0/2320109901 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f37f80012f0 con 0x7f37f0037820 2023-12-07T21:11:09.335 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 0 to deep-scrub 2023-12-07T21:11:09.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.346+0000 7f380a675640 1 -- 172.21.15.89:0/2320109901 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f0037820 msgr2=0x7f37f0039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.346+0000 7f380a675640 1 --2- 172.21.15.89:0/2320109901 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f0037820 0x7f37f0039ce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007fd0 tx=0x7f37f8007ac0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.346+0000 7f380a675640 1 -- 172.21.15.89:0/2320109901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380406cc70 msgr2=0x7f3804122b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.346+0000 7f380a675640 1 --2- 172.21.15.89:0/2320109901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380406cc70 0x7f3804122b30 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f37f4034040 tx=0x7f37f40046c0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.346+0000 7f380a675640 1 -- 172.21.15.89:0/2320109901 shutdown_connections 2023-12-07T21:11:09.338 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.346+0000 7f380a675640 1 --2- 172.21.15.89:0/2320109901 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f37f0037820 0x7f37f0039ce0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.346+0000 7f380a675640 1 --2- 172.21.15.89:0/2320109901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380406cc70 0x7f3804122b30 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.346+0000 7f380a675640 1 -- 172.21.15.89:0/2320109901 >> 172.21.15.89:0/2320109901 conn(0x7f38040986a0 msgr2=0x7f3804127a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:09.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.346+0000 7f380a675640 1 -- 172.21.15.89:0/2320109901 shutdown_connections 2023-12-07T21:11:09.339 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.346+0000 7f380a675640 1 -- 172.21.15.89:0/2320109901 wait complete. 2023-12-07T21:11:09.348 INFO:tasks.ceph:Scrubbing osd.1 2023-12-07T21:11:09.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-07T21:11:09.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.459+0000 7feea6ab4640 1 Processor -- start 2023-12-07T21:11:09.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.459+0000 7feea6ab4640 1 -- start start 2023-12-07T21:11:09.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.459+0000 7feea6ab4640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feea012d560 0x7feea012f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.459+0000 7feea6ab4640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea0126d50 con 0x7feea01271a0 2023-12-07T21:11:09.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.459+0000 7feea6ab4640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea0072140 con 0x7feea012d560 2023-12-07T21:11:09.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.459+0000 7fee9ffff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feea012d560 0x7feea012f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.459+0000 7feea4850640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7feea01271a0 0x7feea0127580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39710/0 (socket says 172.21.15.89:39710) 2023-12-07T21:11:09.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.459+0000 7feea4850640 1 -- 172.21.15.89:0/3991660342 learned_addr learned my addr 172.21.15.89:0/3991660342 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:09.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.460+0000 7fee9ffff640 1 -- 172.21.15.89:0/3991660342 >> v1:172.21.15.89:6789/0 conn(0x7feea01271a0 legacy=0x7feea0127580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.460+0000 7fee9ffff640 1 -- 172.21.15.89:0/3991660342 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea0127c90 con 0x7feea012d560 2023-12-07T21:11:09.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.460+0000 7fee9ffff640 1 --2- 172.21.15.89:0/3991660342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feea012d560 0x7feea012f950 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009750 tx=0x7fee8c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04f7c206381e90f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.455 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.460+0000 7fee9f7fe640 1 -- 172.21.15.89:0/3991660342 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee8c02e070 con 0x7feea012d560 2023-12-07T21:11:09.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.460+0000 7fee9f7fe640 1 -- 172.21.15.89:0/3991660342 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c0316d0 con 0x7feea012d560 2023-12-07T21:11:09.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.460+0000 7fee9f7fe640 1 -- 172.21.15.89:0/3991660342 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee8c031990 con 0x7feea012d560 2023-12-07T21:11:09.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.461+0000 7feea6ab4640 1 -- 172.21.15.89:0/3991660342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feea012d560 msgr2=0x7feea012f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.461+0000 7feea6ab4640 1 --2- 172.21.15.89:0/3991660342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feea012d560 0x7feea012f950 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009750 tx=0x7fee8c02b840 comp rx=0 tx=0).stop 2023-12-07T21:11:09.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.461+0000 7feea6ab4640 1 -- 172.21.15.89:0/3991660342 shutdown_connections 2023-12-07T21:11:09.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.461+0000 7feea6ab4640 1 --2- 172.21.15.89:0/3991660342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feea012d560 0x7feea012f950 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.461+0000 7feea6ab4640 1 -- 172.21.15.89:0/3991660342 >> 172.21.15.89:0/3991660342 conn(0x7feea00997d0 msgr2=0x7feea0099be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:09.456 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.461+0000 7feea6ab4640 1 -- 172.21.15.89:0/3991660342 shutdown_connections 2023-12-07T21:11:09.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.461+0000 7feea6ab4640 1 -- 172.21.15.89:0/3991660342 wait complete. 2023-12-07T21:11:09.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.462+0000 7feea6ab4640 1 Processor -- start 2023-12-07T21:11:09.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.462+0000 7feea6ab4640 1 -- start start 2023-12-07T21:11:09.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.462+0000 7feea6ab4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feea01271a0 0x7feea012a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.462+0000 7feea6ab4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea0089170 con 0x7feea01271a0 2023-12-07T21:11:09.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.462+0000 7feea4850640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feea01271a0 0x7feea012a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.462+0000 7feea4850640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feea01271a0 0x7feea012a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46438/0 (socket says 172.21.15.89:46438) 2023-12-07T21:11:09.457 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.462+0000 7feea4850640 1 -- 172.21.15.89:0/3742597261 learned_addr learned my addr 172.21.15.89:0/3742597261 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:09.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.463+0000 7feea4850640 1 -- 172.21.15.89:0/3742597261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c009400 con 0x7feea01271a0 2023-12-07T21:11:09.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.463+0000 7feea4850640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feea01271a0 0x7feea012a730 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fee9400c4a0 tx=0x7fee9400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.463+0000 7fee9d7fa640 1 -- 172.21.15.89:0/3742597261 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee94005c10 con 0x7feea01271a0 2023-12-07T21:11:09.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.463+0000 7fee9d7fa640 1 -- 172.21.15.89:0/3742597261 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee94005d70 con 0x7feea01271a0 2023-12-07T21:11:09.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.463+0000 7fee9d7fa640 1 -- 172.21.15.89:0/3742597261 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee940071a0 con 0x7feea01271a0 2023-12-07T21:11:09.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.463+0000 7feea6ab4640 1 -- 172.21.15.89:0/3742597261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea0089c20 con 0x7feea01271a0 2023-12-07T21:11:09.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.463+0000 7feea6ab4640 1 -- 172.21.15.89:0/3742597261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea012c630 con 0x7feea01271a0 2023-12-07T21:11:09.458 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.464+0000 7feea6ab4640 1 -- 172.21.15.89:0/3742597261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feea006d890 con 0x7feea01271a0 2023-12-07T21:11:09.459 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.464+0000 7fee9d7fa640 1 -- 172.21.15.89:0/3742597261 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fee94007300 con 0x7feea01271a0 2023-12-07T21:11:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.464+0000 7fee9d7fa640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fee84037820 0x7fee84039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.464+0000 7fee9d7fa640 1 -- 172.21.15.89:0/3742597261 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fee9404a0a0 con 0x7feea01271a0 2023-12-07T21:11:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.464+0000 7fee9d7fa640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fee84043ae0 0x7fee84045f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.464+0000 7fee9d7fa640 1 -- 172.21.15.89:0/3742597261 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee84046650 con 0x7fee84043ae0 2023-12-07T21:11:09.460 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.464+0000 7fee9d7fa640 1 -- 172.21.15.89:0/3742597261 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee9404c710 con 0x7feea01271a0 2023-12-07T21:11:09.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.464+0000 7fee9ffff640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fee84037820 0x7fee84039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.464+0000 7feea5051640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fee84043ae0 0x7fee84045f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.465+0000 7fee9ffff640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fee84037820 0x7fee84039ce0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fee8c036000 tx=0x7fee8c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.465+0000 7feea5051640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fee84043ae0 0x7fee84045f80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.461 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.466+0000 7fee9d7fa640 1 -- 172.21.15.89:0/3742597261 <== osd.1 v2:172.21.15.121:6808/2140819418 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fee84046650 con 0x7fee84043ae0 2023-12-07T21:11:09.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.478+0000 7feea6ab4640 1 -- 172.21.15.89:0/3742597261 --> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7feea0070860 con 0x7fee84043ae0 2023-12-07T21:11:09.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.479+0000 7fee9d7fa640 1 -- 172.21.15.89:0/3742597261 <== osd.1 v2:172.21.15.121:6808/2140819418 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7feea0070860 con 0x7fee84043ae0 2023-12-07T21:11:09.471 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T21:11:09.471 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T21:11:09.471 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T21:11:09.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.479+0000 7feea6ab4640 1 -- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fee84043ae0 msgr2=0x7fee84045f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.479+0000 7feea6ab4640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fee84043ae0 0x7fee84045f80 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.479+0000 7feea6ab4640 1 -- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fee84037820 msgr2=0x7fee84039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.479+0000 7feea6ab4640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fee84037820 0x7fee84039ce0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fee8c036000 tx=0x7fee8c008030 comp rx=0 tx=0).stop 2023-12-07T21:11:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.479+0000 7feea6ab4640 1 -- 172.21.15.89:0/3742597261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feea01271a0 msgr2=0x7feea012a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.479+0000 7feea6ab4640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feea01271a0 0x7feea012a730 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fee9400c4a0 tx=0x7fee9400c960 comp rx=0 tx=0).stop 2023-12-07T21:11:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.480+0000 7feea6ab4640 1 -- 172.21.15.89:0/3742597261 shutdown_connections 2023-12-07T21:11:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.480+0000 7feea6ab4640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fee84037820 0x7fee84039ce0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.473 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.480+0000 7feea6ab4640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.121:6808/2140819418,v1:172.21.15.121:6809/2140819418] conn(0x7fee84043ae0 0x7fee84045f80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.480+0000 7feea6ab4640 1 --2- 172.21.15.89:0/3742597261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feea01271a0 0x7feea012a730 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.480+0000 7feea6ab4640 1 -- 172.21.15.89:0/3742597261 >> 172.21.15.89:0/3742597261 conn(0x7feea00997d0 msgr2=0x7feea0099bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.480+0000 7feea6ab4640 1 -- 172.21.15.89:0/3742597261 shutdown_connections 2023-12-07T21:11:09.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.480+0000 7feea6ab4640 1 -- 172.21.15.89:0/3742597261 wait complete. 2023-12-07T21:11:09.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-07T21:11:09.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.589+0000 7f6d4ccde640 1 Processor -- start 2023-12-07T21:11:09.581 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.589+0000 7f6d4ccde640 1 -- start start 2023-12-07T21:11:09.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.589+0000 7f6d4ccde640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6d48095500 0x7f6d480958e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.589+0000 7f6d4ccde640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4806e940 con 0x7f6d4806cc70 2023-12-07T21:11:09.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.589+0000 7f6d4ccde640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4806f390 con 0x7f6d48095500 2023-12-07T21:11:09.582 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.589+0000 7f6d4659c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6d48095500 0x7f6d480958e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.589+0000 7f6d45d9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f6d4806cc70 0x7f6d4806d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39722/0 (socket says 172.21.15.89:39722) 2023-12-07T21:11:09.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.589+0000 7f6d45d9b640 1 -- 172.21.15.89:0/429285115 learned_addr learned my addr 172.21.15.89:0/429285115 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:09.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.589+0000 7f6d4659c640 1 -- 172.21.15.89:0/429285115 >> v1:172.21.15.89:6789/0 conn(0x7f6d4806cc70 legacy=0x7f6d4806d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.590+0000 7f6d4659c640 1 -- 172.21.15.89:0/429285115 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4806e1e0 con 0x7f6d48095500 2023-12-07T21:11:09.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.590+0000 7f6d4559a640 1 -- 172.21.15.89:0/429285115 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232387415 0 0) 0x7f6d4806e940 con 0x7f6d4806cc70 2023-12-07T21:11:09.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.590+0000 7f6d4659c640 1 --2- 172.21.15.89:0/429285115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d48095500 0x7f6d480958e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009d90 tx=0x7f6d3802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ec422a0828f101 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.590+0000 7f6d4559a640 1 -- 172.21.15.89:0/429285115 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d3802cbb0 con 0x7f6d48095500 2023-12-07T21:11:09.583 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.590+0000 7f6d4559a640 1 -- 172.21.15.89:0/429285115 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3802cd10 con 0x7f6d48095500 2023-12-07T21:11:09.584 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.590+0000 7f6d4559a640 1 -- 172.21.15.89:0/429285115 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d38034440 con 0x7f6d48095500 2023-12-07T21:11:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.591+0000 7f6d4ccde640 1 -- 172.21.15.89:0/429285115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d48095500 msgr2=0x7f6d480958e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.591+0000 7f6d4ccde640 1 --2- 172.21.15.89:0/429285115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d48095500 0x7f6d480958e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009d90 tx=0x7f6d3802bf50 comp rx=0 tx=0).stop 2023-12-07T21:11:09.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.591+0000 7f6d4ccde640 1 -- 172.21.15.89:0/429285115 shutdown_connections 2023-12-07T21:11:09.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.591+0000 7f6d4ccde640 1 --2- 172.21.15.89:0/429285115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d48095500 0x7f6d480958e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.591+0000 7f6d4ccde640 1 -- 172.21.15.89:0/429285115 >> 172.21.15.89:0/429285115 conn(0x7f6d480986a0 msgr2=0x7f6d48098ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:09.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.591+0000 7f6d4ccde640 1 -- 172.21.15.89:0/429285115 shutdown_connections 2023-12-07T21:11:09.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.591+0000 7f6d4ccde640 1 -- 172.21.15.89:0/429285115 wait complete. 2023-12-07T21:11:09.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.592+0000 7f6d4ccde640 1 Processor -- start 2023-12-07T21:11:09.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.592+0000 7f6d4ccde640 1 -- start start 2023-12-07T21:11:09.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.592+0000 7f6d4ccde640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4806cc70 0x7f6d48092850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.592+0000 7f6d4ccde640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480944d0 con 0x7f6d4806cc70 2023-12-07T21:11:09.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.592+0000 7f6d4659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4806cc70 0x7f6d48092850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.592+0000 7f6d4659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4806cc70 0x7f6d48092850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46454/0 (socket says 172.21.15.89:46454) 2023-12-07T21:11:09.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.592+0000 7f6d4659c640 1 -- 172.21.15.89:0/117322157 learned_addr learned my addr 172.21.15.89:0/117322157 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:09.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.593+0000 7f6d4659c640 1 -- 172.21.15.89:0/117322157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38009a70 con 0x7f6d4806cc70 2023-12-07T21:11:09.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.593+0000 7f6d4659c640 1 --2- 172.21.15.89:0/117322157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4806cc70 0x7f6d48092850 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6d38037040 tx=0x7f6d38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.593+0000 7f6d3effd640 1 -- 172.21.15.89:0/117322157 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d3803e540 con 0x7f6d4806cc70 2023-12-07T21:11:09.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.593+0000 7f6d3effd640 1 -- 172.21.15.89:0/117322157 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3803e6a0 con 0x7f6d4806cc70 2023-12-07T21:11:09.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.593+0000 7f6d3effd640 1 -- 172.21.15.89:0/117322157 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6d3803e980 con 0x7f6d4806cc70 2023-12-07T21:11:09.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.593+0000 7f6d4ccde640 1 -- 172.21.15.89:0/117322157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d481a5cb0 con 0x7f6d4806cc70 2023-12-07T21:11:09.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.593+0000 7f6d4ccde640 1 -- 172.21.15.89:0/117322157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d481a5fc0 con 0x7f6d4806cc70 2023-12-07T21:11:09.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.594+0000 7f6d3effd640 1 -- 172.21.15.89:0/117322157 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f6d3803b050 con 0x7f6d4806cc70 2023-12-07T21:11:09.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.594+0000 7f6d3effd640 1 --2- 172.21.15.89:0/117322157 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6d28037820 0x7f6d28039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.594+0000 7f6d4ccde640 1 -- 172.21.15.89:0/117322157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d48093cd0 con 0x7f6d4806cc70 2023-12-07T21:11:09.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.594+0000 7f6d3effd640 1 -- 172.21.15.89:0/117322157 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f6d3806d7a0 con 0x7f6d4806cc70 2023-12-07T21:11:09.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.594+0000 7f6d45d9b640 1 --2- 172.21.15.89:0/117322157 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6d28037820 0x7f6d28039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.595+0000 7f6d45d9b640 1 --2- 172.21.15.89:0/117322157 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6d28037820 0x7f6d28039ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6d30000c00 tx=0x7f6d30007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.590 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.599+0000 7f6d3effd640 1 -- 172.21.15.89:0/117322157 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d3804e020 con 0x7f6d4806cc70 2023-12-07T21:11:09.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.764+0000 7f6d4ccde640 1 -- 172.21.15.89:0/117322157 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d4809abe0 con 0x7f6d28037820 2023-12-07T21:11:09.757 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.765+0000 7f6d3effd640 1 -- 172.21.15.89:0/117322157 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6d4809abe0 con 0x7f6d28037820 2023-12-07T21:11:09.757 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 1 to deep-scrub 2023-12-07T21:11:09.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.767+0000 7f6d4ccde640 1 -- 172.21.15.89:0/117322157 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6d28037820 msgr2=0x7f6d28039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.767+0000 7f6d4ccde640 1 --2- 172.21.15.89:0/117322157 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6d28037820 0x7f6d28039ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6d30000c00 tx=0x7f6d30007a40 comp rx=0 tx=0).stop 2023-12-07T21:11:09.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.767+0000 7f6d4ccde640 1 -- 172.21.15.89:0/117322157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4806cc70 msgr2=0x7f6d48092850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.759 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.767+0000 7f6d4ccde640 1 --2- 172.21.15.89:0/117322157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4806cc70 0x7f6d48092850 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6d38037040 tx=0x7f6d38004a40 comp rx=0 tx=0).stop 2023-12-07T21:11:09.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.767+0000 7f6d4ccde640 1 -- 172.21.15.89:0/117322157 shutdown_connections 2023-12-07T21:11:09.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.767+0000 7f6d4ccde640 1 --2- 172.21.15.89:0/117322157 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f6d28037820 0x7f6d28039ce0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.767+0000 7f6d4ccde640 1 --2- 172.21.15.89:0/117322157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6d4806cc70 0x7f6d48092850 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.767+0000 7f6d4ccde640 1 -- 172.21.15.89:0/117322157 >> 172.21.15.89:0/117322157 conn(0x7f6d480986a0 msgr2=0x7f6d4808b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:09.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.767+0000 7f6d4ccde640 1 -- 172.21.15.89:0/117322157 shutdown_connections 2023-12-07T21:11:09.760 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.767+0000 7f6d4ccde640 1 -- 172.21.15.89:0/117322157 wait complete. 2023-12-07T21:11:09.769 INFO:tasks.ceph:Scrubbing osd.2 2023-12-07T21:11:09.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-07T21:11:09.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2023-12-07T21:11:09.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.880+0000 7f30443f0640 1 Processor -- start 2023-12-07T21:11:09.872 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.880+0000 7f30443f0640 1 -- start start 2023-12-07T21:11:09.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.881+0000 7f30443f0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f303c130c00 0x7f303c132ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.881+0000 7f30443f0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c06e280 con 0x7f303c12d890 2023-12-07T21:11:09.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.881+0000 7f30443f0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c12dc70 con 0x7f303c130c00 2023-12-07T21:11:09.873 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.881+0000 7f304198b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f303c130c00 0x7f303c132ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.881+0000 7f304218c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f303c12d890 0x7f303c12df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39726/0 (socket says 172.21.15.89:39726) 2023-12-07T21:11:09.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.881+0000 7f304218c640 1 -- 172.21.15.89:0/3517888220 learned_addr learned my addr 172.21.15.89:0/3517888220 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:09.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.881+0000 7f304198b640 1 -- 172.21.15.89:0/3517888220 >> v1:172.21.15.89:6789/0 conn(0x7f303c12d890 legacy=0x7f303c12df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.881+0000 7f304198b640 1 -- 172.21.15.89:0/3517888220 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c06f980 con 0x7f303c130c00 2023-12-07T21:11:09.874 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.881+0000 7f304118a640 1 -- 172.21.15.89:0/3517888220 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256110995 0 0) 0x7f303c06e280 con 0x7f303c12d890 2023-12-07T21:11:09.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.882+0000 7f304198b640 1 --2- 172.21.15.89:0/3517888220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f303c130c00 0x7f303c132ff0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f302c009720 tx=0x7f302c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74b6cc9747b478a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.882+0000 7f304118a640 1 -- 172.21.15.89:0/3517888220 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f302c02e070 con 0x7f303c130c00 2023-12-07T21:11:09.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.882+0000 7f304118a640 1 -- 172.21.15.89:0/3517888220 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c0316d0 con 0x7f303c130c00 2023-12-07T21:11:09.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.882+0000 7f304118a640 1 -- 172.21.15.89:0/3517888220 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f302c031990 con 0x7f303c130c00 2023-12-07T21:11:09.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.882+0000 7f30443f0640 1 -- 172.21.15.89:0/3517888220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f303c130c00 msgr2=0x7f303c132ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.882+0000 7f30443f0640 1 --2- 172.21.15.89:0/3517888220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f303c130c00 0x7f303c132ff0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f302c009720 tx=0x7f302c02b840 comp rx=0 tx=0).stop 2023-12-07T21:11:09.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.883+0000 7f30443f0640 1 -- 172.21.15.89:0/3517888220 shutdown_connections 2023-12-07T21:11:09.878 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.883+0000 7f30443f0640 1 --2- 172.21.15.89:0/3517888220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f303c130c00 0x7f303c132ff0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.883+0000 7f30443f0640 1 -- 172.21.15.89:0/3517888220 >> 172.21.15.89:0/3517888220 conn(0x7f303c09fc00 msgr2=0x7f303c0a0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:09.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.883+0000 7f30443f0640 1 -- 172.21.15.89:0/3517888220 shutdown_connections 2023-12-07T21:11:09.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.883+0000 7f30443f0640 1 -- 172.21.15.89:0/3517888220 wait complete. 2023-12-07T21:11:09.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.883+0000 7f30443f0640 1 Processor -- start 2023-12-07T21:11:09.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.883+0000 7f30443f0640 1 -- start start 2023-12-07T21:11:09.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f30443f0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f303c12d890 0x7f303c125e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f30443f0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c12c2c0 con 0x7f303c12d890 2023-12-07T21:11:09.879 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f304218c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f303c12d890 0x7f303c125e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f304218c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f303c12d890 0x7f303c125e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46464/0 (socket says 172.21.15.89:46464) 2023-12-07T21:11:09.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f304218c640 1 -- 172.21.15.89:0/3023659744 learned_addr learned my addr 172.21.15.89:0/3023659744 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:09.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f304218c640 1 -- 172.21.15.89:0/3023659744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c009400 con 0x7f303c12d890 2023-12-07T21:11:09.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f304218c640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f303c12d890 0x7f303c125e50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f303800c840 tx=0x7f303800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f3032ffd640 1 -- 172.21.15.89:0/3023659744 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3038004ea0 con 0x7f303c12d890 2023-12-07T21:11:09.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f3032ffd640 1 -- 172.21.15.89:0/3023659744 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303800a660 con 0x7f303c12d890 2023-12-07T21:11:09.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f30443f0640 1 -- 172.21.15.89:0/3023659744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c08de50 con 0x7f303c12d890 2023-12-07T21:11:09.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f3032ffd640 1 -- 172.21.15.89:0/3023659744 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f303800a920 con 0x7f303c12d890 2023-12-07T21:11:09.880 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.884+0000 7f30443f0640 1 -- 172.21.15.89:0/3023659744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c08e6f0 con 0x7f303c12d890 2023-12-07T21:11:09.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.885+0000 7f30443f0640 1 -- 172.21.15.89:0/3023659744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f303c0a0090 con 0x7f303c12d890 2023-12-07T21:11:09.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.885+0000 7f3032ffd640 1 -- 172.21.15.89:0/3023659744 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f303800aa80 con 0x7f303c12d890 2023-12-07T21:11:09.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.885+0000 7f3032ffd640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3020037820 0x7f3020039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.885+0000 7f3032ffd640 1 -- 172.21.15.89:0/3023659744 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f303804a530 con 0x7f303c12d890 2023-12-07T21:11:09.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.885+0000 7f3032ffd640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3020043ae0 0x7f3020045f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:09.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.885+0000 7f3032ffd640 1 -- 172.21.15.89:0/3023659744 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3020046650 con 0x7f3020043ae0 2023-12-07T21:11:09.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.885+0000 7f3032ffd640 1 -- 172.21.15.89:0/3023659744 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f303804cba0 con 0x7f303c12d890 2023-12-07T21:11:09.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.886+0000 7f304198b640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3020037820 0x7f3020039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.886+0000 7f304298d640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3020043ae0 0x7f3020045f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:09.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.886+0000 7f304198b640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3020037820 0x7f3020039ce0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f302c036000 tx=0x7f302c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.886+0000 7f304298d640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3020043ae0 0x7f3020045f80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:09.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.887+0000 7f3032ffd640 1 -- 172.21.15.89:0/3023659744 <== osd.2 v2:172.21.15.121:6816/2557538450 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3020046650 con 0x7f3020043ae0 2023-12-07T21:11:09.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.899+0000 7f30443f0640 1 -- 172.21.15.89:0/3023659744 --> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f303c08da50 con 0x7f3020043ae0 2023-12-07T21:11:09.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f3032ffd640 1 -- 172.21.15.89:0/3023659744 <== osd.2 v2:172.21.15.121:6816/2557538450 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f30340097a0 con 0x7f3020043ae0 2023-12-07T21:11:09.892 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T21:11:09.892 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T21:11:09.893 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T21:11:09.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 -- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3020043ae0 msgr2=0x7f3020045f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3020043ae0 0x7f3020045f80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 -- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3020037820 msgr2=0x7f3020039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3020037820 0x7f3020039ce0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f302c036000 tx=0x7f302c008030 comp rx=0 tx=0).stop 2023-12-07T21:11:09.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 -- 172.21.15.89:0/3023659744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f303c12d890 msgr2=0x7f303c125e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:09.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f303c12d890 0x7f303c125e50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f303800c840 tx=0x7f303800cd00 comp rx=0 tx=0).stop 2023-12-07T21:11:09.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 -- 172.21.15.89:0/3023659744 shutdown_connections 2023-12-07T21:11:09.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6816/2557538450,v1:172.21.15.121:6817/2557538450] conn(0x7f3020043ae0 0x7f3020045f80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3020037820 0x7f3020039ce0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 --2- 172.21.15.89:0/3023659744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f303c12d890 0x7f303c125e50 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:09.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 -- 172.21.15.89:0/3023659744 >> 172.21.15.89:0/3023659744 conn(0x7f303c09fc00 msgr2=0x7f303c1281f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:09.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 -- 172.21.15.89:0/3023659744 shutdown_connections 2023-12-07T21:11:09.895 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:09.900+0000 7f30443f0640 1 -- 172.21.15.89:0/3023659744 wait complete. 2023-12-07T21:11:09.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-07T21:11:10.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.009+0000 7fadaffb0640 1 Processor -- start 2023-12-07T21:11:10.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.009+0000 7fadaffb0640 1 -- start start 2023-12-07T21:11:10.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.010+0000 7fadaffb0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fada81308e0 0x7fada8132cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.010+0000 7fadaffb0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada809be20 con 0x7fada812dac0 2023-12-07T21:11:10.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.010+0000 7fadaffb0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada806d7c0 con 0x7fada81308e0 2023-12-07T21:11:10.003 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.010+0000 7fadad54b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fada81308e0 0x7fada8132cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.010+0000 7fadadd4c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fada812dac0 0x7fada812dea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39732/0 (socket says 172.21.15.89:39732) 2023-12-07T21:11:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.010+0000 7fadadd4c640 1 -- 172.21.15.89:0/534296901 learned_addr learned my addr 172.21.15.89:0/534296901 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.010+0000 7fadacd4a640 1 -- 172.21.15.89:0/534296901 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684739823 0 0) 0x7fada809be20 con 0x7fada812dac0 2023-12-07T21:11:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.010+0000 7fadacd4a640 1 -- 172.21.15.89:0/534296901 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad94003520 con 0x7fada812dac0 2023-12-07T21:11:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.010+0000 7fadad54b640 1 -- 172.21.15.89:0/534296901 >> v1:172.21.15.89:6789/0 conn(0x7fada812dac0 legacy=0x7fada812dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.010+0000 7fadad54b640 1 -- 172.21.15.89:0/534296901 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada8098970 con 0x7fada81308e0 2023-12-07T21:11:10.004 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.011+0000 7fadad54b640 1 --2- 172.21.15.89:0/534296901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada81308e0 0x7fada8132cd0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fad98009720 tx=0x7fad9802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e359a37498fa14 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.011+0000 7fadacd4a640 1 -- 172.21.15.89:0/534296901 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad9802e070 con 0x7fada81308e0 2023-12-07T21:11:10.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.011+0000 7fadacd4a640 1 -- 172.21.15.89:0/534296901 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad980316d0 con 0x7fada81308e0 2023-12-07T21:11:10.005 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.011+0000 7fadacd4a640 1 -- 172.21.15.89:0/534296901 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad98031990 con 0x7fada81308e0 2023-12-07T21:11:10.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.011+0000 7fadaffb0640 1 -- 172.21.15.89:0/534296901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada81308e0 msgr2=0x7fada8132cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.011+0000 7fadaffb0640 1 --2- 172.21.15.89:0/534296901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada81308e0 0x7fada8132cd0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fad98009720 tx=0x7fad9802b840 comp rx=0 tx=0).stop 2023-12-07T21:11:10.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.012+0000 7fadaffb0640 1 -- 172.21.15.89:0/534296901 shutdown_connections 2023-12-07T21:11:10.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.012+0000 7fadaffb0640 1 --2- 172.21.15.89:0/534296901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada81308e0 0x7fada8132cd0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.012+0000 7fadaffb0640 1 -- 172.21.15.89:0/534296901 >> 172.21.15.89:0/534296901 conn(0x7fada809c940 msgr2=0x7fada809cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:10.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.012+0000 7fadaffb0640 1 -- 172.21.15.89:0/534296901 shutdown_connections 2023-12-07T21:11:10.008 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.012+0000 7fadaffb0640 1 -- 172.21.15.89:0/534296901 wait complete. 2023-12-07T21:11:10.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.012+0000 7fadaffb0640 1 Processor -- start 2023-12-07T21:11:10.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.012+0000 7fadaffb0640 1 -- start start 2023-12-07T21:11:10.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fadaffb0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada812dac0 0x7fada81c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fadaffb0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada81c1fa0 con 0x7fada812dac0 2023-12-07T21:11:10.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fadadd4c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada812dac0 0x7fada81c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fadadd4c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada812dac0 0x7fada81c22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46480/0 (socket says 172.21.15.89:46480) 2023-12-07T21:11:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fadadd4c640 1 -- 172.21.15.89:0/1061460017 learned_addr learned my addr 172.21.15.89:0/1061460017 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fadadd4c640 1 -- 172.21.15.89:0/1061460017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98009400 con 0x7fada812dac0 2023-12-07T21:11:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fadadd4c640 1 --2- 172.21.15.89:0/1061460017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada812dac0 0x7fada81c22c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fada400c480 tx=0x7fada400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fad9e7fc640 1 -- 172.21.15.89:0/1061460017 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fada4005c10 con 0x7fada812dac0 2023-12-07T21:11:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fad9e7fc640 1 -- 172.21.15.89:0/1061460017 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada4005d70 con 0x7fada812dac0 2023-12-07T21:11:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fadaffb0640 1 -- 172.21.15.89:0/1061460017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada812a530 con 0x7fada812dac0 2023-12-07T21:11:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fad9e7fc640 1 -- 172.21.15.89:0/1061460017 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fada40071e0 con 0x7fada812dac0 2023-12-07T21:11:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.013+0000 7fadaffb0640 1 -- 172.21.15.89:0/1061460017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada812ad40 con 0x7fada812dac0 2023-12-07T21:11:10.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.014+0000 7fad9e7fc640 1 -- 172.21.15.89:0/1061460017 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fada4007340 con 0x7fada812dac0 2023-12-07T21:11:10.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.014+0000 7fadaffb0640 1 -- 172.21.15.89:0/1061460017 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada808b6c0 con 0x7fada812dac0 2023-12-07T21:11:10.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.014+0000 7fad9e7fc640 1 --2- 172.21.15.89:0/1061460017 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fad8c037820 0x7fad8c039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.014+0000 7fad9e7fc640 1 -- 172.21.15.89:0/1061460017 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fada404a120 con 0x7fada812dac0 2023-12-07T21:11:10.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.015+0000 7fadad54b640 1 --2- 172.21.15.89:0/1061460017 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fad8c037820 0x7fad8c039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.015+0000 7fadad54b640 1 --2- 172.21.15.89:0/1061460017 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fad8c037820 0x7fad8c039ce0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fad98036000 tx=0x7fad98008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.019+0000 7fad9e7fc640 1 -- 172.21.15.89:0/1061460017 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fada808b6c0 con 0x7fada812dac0 2023-12-07T21:11:10.177 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.185+0000 7fadaffb0640 1 -- 172.21.15.89:0/1061460017 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fada809db60 con 0x7fad8c037820 2023-12-07T21:11:10.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.186+0000 7fad9e7fc640 1 -- 172.21.15.89:0/1061460017 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fada809db60 con 0x7fad8c037820 2023-12-07T21:11:10.178 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 2 to deep-scrub 2023-12-07T21:11:10.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.188+0000 7fadaffb0640 1 -- 172.21.15.89:0/1061460017 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fad8c037820 msgr2=0x7fad8c039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.188+0000 7fadaffb0640 1 --2- 172.21.15.89:0/1061460017 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fad8c037820 0x7fad8c039ce0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fad98036000 tx=0x7fad98008030 comp rx=0 tx=0).stop 2023-12-07T21:11:10.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.188+0000 7fadaffb0640 1 -- 172.21.15.89:0/1061460017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada812dac0 msgr2=0x7fada81c22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.188+0000 7fadaffb0640 1 --2- 172.21.15.89:0/1061460017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada812dac0 0x7fada81c22c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fada400c480 tx=0x7fada400c940 comp rx=0 tx=0).stop 2023-12-07T21:11:10.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.188+0000 7fadaffb0640 1 -- 172.21.15.89:0/1061460017 shutdown_connections 2023-12-07T21:11:10.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.188+0000 7fadaffb0640 1 --2- 172.21.15.89:0/1061460017 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fad8c037820 0x7fad8c039ce0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.188+0000 7fadaffb0640 1 --2- 172.21.15.89:0/1061460017 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada812dac0 0x7fada81c22c0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.188+0000 7fadaffb0640 1 -- 172.21.15.89:0/1061460017 >> 172.21.15.89:0/1061460017 conn(0x7fada809c940 msgr2=0x7fada812e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:10.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.188+0000 7fadaffb0640 1 -- 172.21.15.89:0/1061460017 shutdown_connections 2023-12-07T21:11:10.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.188+0000 7fadaffb0640 1 -- 172.21.15.89:0/1061460017 wait complete. 2023-12-07T21:11:10.190 INFO:tasks.ceph:Scrubbing osd.3 2023-12-07T21:11:10.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-07T21:11:10.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.300+0000 7f5e58c15640 1 Processor -- start 2023-12-07T21:11:10.292 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.301+0000 7f5e58c15640 1 -- start start 2023-12-07T21:11:10.293 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.301+0000 7f5e58c15640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5e5412d560 0x7f5e5412f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.301+0000 7f5e58c15640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e54126d50 con 0x7f5e541271a0 2023-12-07T21:11:10.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.301+0000 7f5e58c15640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e54072140 con 0x7f5e5412d560 2023-12-07T21:11:10.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.301+0000 7f5e4bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5e5412d560 0x7f5e5412f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.301+0000 7f5e5259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5e541271a0 0x7f5e54127580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39740/0 (socket says 172.21.15.89:39740) 2023-12-07T21:11:10.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.301+0000 7f5e5259c640 1 -- 172.21.15.89:0/1908698904 learned_addr learned my addr 172.21.15.89:0/1908698904 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:10.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.301+0000 7f5e4bfff640 1 -- 172.21.15.89:0/1908698904 >> v1:172.21.15.89:6789/0 conn(0x7f5e541271a0 legacy=0x7f5e54127580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.294 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.301+0000 7f5e4bfff640 1 -- 172.21.15.89:0/1908698904 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54127c90 con 0x7f5e5412d560 2023-12-07T21:11:10.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.302+0000 7f5e4bfff640 1 --2- 172.21.15.89:0/1908698904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e5412d560 0x7f5e5412f950 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009750 tx=0x7f5e3c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8bd464da1dd053 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.302+0000 7f5e51d9b640 1 -- 172.21.15.89:0/1908698904 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c02e070 con 0x7f5e5412d560 2023-12-07T21:11:10.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.302+0000 7f5e51d9b640 1 -- 172.21.15.89:0/1908698904 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c0316d0 con 0x7f5e5412d560 2023-12-07T21:11:10.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.302+0000 7f5e51d9b640 1 -- 172.21.15.89:0/1908698904 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e3c031990 con 0x7f5e5412d560 2023-12-07T21:11:10.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.303+0000 7f5e58c15640 1 -- 172.21.15.89:0/1908698904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e5412d560 msgr2=0x7f5e5412f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.303+0000 7f5e58c15640 1 --2- 172.21.15.89:0/1908698904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e5412d560 0x7f5e5412f950 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009750 tx=0x7f5e3c02b840 comp rx=0 tx=0).stop 2023-12-07T21:11:10.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.303+0000 7f5e58c15640 1 -- 172.21.15.89:0/1908698904 shutdown_connections 2023-12-07T21:11:10.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.303+0000 7f5e58c15640 1 --2- 172.21.15.89:0/1908698904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e5412d560 0x7f5e5412f950 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.303+0000 7f5e58c15640 1 -- 172.21.15.89:0/1908698904 >> 172.21.15.89:0/1908698904 conn(0x7f5e540997d0 msgr2=0x7f5e54099be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:10.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.303+0000 7f5e58c15640 1 -- 172.21.15.89:0/1908698904 shutdown_connections 2023-12-07T21:11:10.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.303+0000 7f5e58c15640 1 -- 172.21.15.89:0/1908698904 wait complete. 2023-12-07T21:11:10.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.304+0000 7f5e58c15640 1 Processor -- start 2023-12-07T21:11:10.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.304+0000 7f5e58c15640 1 -- start start 2023-12-07T21:11:10.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.304+0000 7f5e58c15640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e541271a0 0x7f5e5412b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.304+0000 7f5e58c15640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5408a7f0 con 0x7f5e541271a0 2023-12-07T21:11:10.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.304+0000 7f5e5259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e541271a0 0x7f5e5412b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.304+0000 7f5e5259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e541271a0 0x7f5e5412b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46502/0 (socket says 172.21.15.89:46502) 2023-12-07T21:11:10.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.304+0000 7f5e5259c640 1 -- 172.21.15.89:0/2235508015 learned_addr learned my addr 172.21.15.89:0/2235508015 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:10.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.304+0000 7f5e5259c640 1 -- 172.21.15.89:0/2235508015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c009400 con 0x7f5e541271a0 2023-12-07T21:11:10.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.305+0000 7f5e5259c640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e541271a0 0x7f5e5412b140 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400e8c0 tx=0x7f5e4400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.305+0000 7f5e4affd640 1 -- 172.21.15.89:0/2235508015 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e44005ae0 con 0x7f5e541271a0 2023-12-07T21:11:10.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.305+0000 7f5e4affd640 1 -- 172.21.15.89:0/2235508015 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e44005c40 con 0x7f5e541271a0 2023-12-07T21:11:10.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.305+0000 7f5e58c15640 1 -- 172.21.15.89:0/2235508015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e540895f0 con 0x7f5e541271a0 2023-12-07T21:11:10.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.305+0000 7f5e4affd640 1 -- 172.21.15.89:0/2235508015 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e440016a0 con 0x7f5e541271a0 2023-12-07T21:11:10.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.305+0000 7f5e58c15640 1 -- 172.21.15.89:0/2235508015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e54089080 con 0x7f5e541271a0 2023-12-07T21:11:10.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.306+0000 7f5e4affd640 1 -- 172.21.15.89:0/2235508015 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f5e44001800 con 0x7f5e541271a0 2023-12-07T21:11:10.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.306+0000 7f5e58c15640 1 -- 172.21.15.89:0/2235508015 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e5406fcb0 con 0x7f5e541271a0 2023-12-07T21:11:10.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.306+0000 7f5e4affd640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5e34037820 0x7f5e34039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.306+0000 7f5e4affd640 1 -- 172.21.15.89:0/2235508015 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f5e4404d320 con 0x7f5e541271a0 2023-12-07T21:11:10.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.306+0000 7f5e4affd640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f5e34043ae0 0x7f5e34045f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.306+0000 7f5e4affd640 1 -- 172.21.15.89:0/2235508015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e34046650 con 0x7f5e34043ae0 2023-12-07T21:11:10.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.306+0000 7f5e4affd640 1 -- 172.21.15.89:0/2235508015 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e4404f990 con 0x7f5e541271a0 2023-12-07T21:11:10.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.306+0000 7f5e4bfff640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5e34037820 0x7f5e34039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.306+0000 7f5e52d9d640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f5e34043ae0 0x7f5e34045f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.307+0000 7f5e4bfff640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5e34037820 0x7f5e34039ce0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c036000 tx=0x7f5e3c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.307+0000 7f5e52d9d640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f5e34043ae0 0x7f5e34045f80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.307+0000 7f5e4affd640 1 -- 172.21.15.89:0/2235508015 <== osd.3 v2:172.21.15.121:6800/4032235766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5e34046650 con 0x7f5e34043ae0 2023-12-07T21:11:10.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.320+0000 7f5e58c15640 1 -- 172.21.15.89:0/2235508015 --> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5e5406cee0 con 0x7f5e34043ae0 2023-12-07T21:11:10.312 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e4affd640 1 -- 172.21.15.89:0/2235508015 <== osd.3 v2:172.21.15.121:6800/4032235766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5e4c011040 con 0x7f5e34043ae0 2023-12-07T21:11:10.313 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-12-07T21:11:10.313 INFO:teuthology.orchestra.run.smithi089.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-07T21:11:10.313 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-12-07T21:11:10.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 -- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f5e34043ae0 msgr2=0x7f5e34045f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f5e34043ae0 0x7f5e34045f80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 -- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5e34037820 msgr2=0x7f5e34039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5e34037820 0x7f5e34039ce0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c036000 tx=0x7f5e3c008030 comp rx=0 tx=0).stop 2023-12-07T21:11:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 -- 172.21.15.89:0/2235508015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e541271a0 msgr2=0x7f5e5412b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e541271a0 0x7f5e5412b140 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5e4400e8c0 tx=0x7f5e4400ed80 comp rx=0 tx=0).stop 2023-12-07T21:11:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 -- 172.21.15.89:0/2235508015 shutdown_connections 2023-12-07T21:11:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6800/4032235766,v1:172.21.15.121:6801/4032235766] conn(0x7f5e34043ae0 0x7f5e34045f80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f5e34037820 0x7f5e34039ce0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 --2- 172.21.15.89:0/2235508015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e541271a0 0x7f5e5412b140 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 -- 172.21.15.89:0/2235508015 >> 172.21.15.89:0/2235508015 conn(0x7f5e540997d0 msgr2=0x7f5e54120990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 -- 172.21.15.89:0/2235508015 shutdown_connections 2023-12-07T21:11:10.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.321+0000 7f5e58c15640 1 -- 172.21.15.89:0/2235508015 wait complete. 2023-12-07T21:11:10.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-07T21:11:10.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.430+0000 7f44a1541640 1 Processor -- start 2023-12-07T21:11:10.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.430+0000 7f44a1541640 1 -- start start 2023-12-07T21:11:10.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.431+0000 7f44a1541640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f449c06cc70 0x7f449c06d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.423 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.431+0000 7f44a1541640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c070320 con 0x7f449c06d590 2023-12-07T21:11:10.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.431+0000 7f44a1541640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c09ad20 con 0x7f449c06cc70 2023-12-07T21:11:10.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.431+0000 7f449affd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f449c06cc70 0x7f449c06d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.431+0000 7f449a7fc640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f449c06d590 0x7f449c0950b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39750/0 (socket says 172.21.15.89:39750) 2023-12-07T21:11:10.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.431+0000 7f449a7fc640 1 -- 172.21.15.89:0/499592107 learned_addr learned my addr 172.21.15.89:0/499592107 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:10.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.431+0000 7f449affd640 1 -- 172.21.15.89:0/499592107 >> v1:172.21.15.89:6789/0 conn(0x7f449c06d590 legacy=0x7f449c0950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.431+0000 7f449affd640 1 -- 172.21.15.89:0/499592107 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c071540 con 0x7f449c06cc70 2023-12-07T21:11:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.432+0000 7f449affd640 1 --2- 172.21.15.89:0/499592107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f449c06cc70 0x7f449c06d050 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f448c009d90 tx=0x7f448c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84ea48ae4f16b03 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.432+0000 7f4499ffb640 1 -- 172.21.15.89:0/499592107 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f448c02cb10 con 0x7f449c06cc70 2023-12-07T21:11:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.432+0000 7f4499ffb640 1 -- 172.21.15.89:0/499592107 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c02cc70 con 0x7f449c06cc70 2023-12-07T21:11:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.432+0000 7f4499ffb640 1 -- 172.21.15.89:0/499592107 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f448c034440 con 0x7f449c06cc70 2023-12-07T21:11:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.433+0000 7f44a1541640 1 -- 172.21.15.89:0/499592107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f449c06cc70 msgr2=0x7f449c06d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.433+0000 7f44a1541640 1 --2- 172.21.15.89:0/499592107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f449c06cc70 0x7f449c06d050 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f448c009d90 tx=0x7f448c02beb0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.433+0000 7f44a1541640 1 -- 172.21.15.89:0/499592107 shutdown_connections 2023-12-07T21:11:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.433+0000 7f44a1541640 1 --2- 172.21.15.89:0/499592107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f449c06cc70 0x7f449c06d050 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.433+0000 7f44a1541640 1 -- 172.21.15.89:0/499592107 >> 172.21.15.89:0/499592107 conn(0x7f449c0986a0 msgr2=0x7f449c098ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.433+0000 7f44a1541640 1 -- 172.21.15.89:0/499592107 shutdown_connections 2023-12-07T21:11:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.433+0000 7f44a1541640 1 -- 172.21.15.89:0/499592107 wait complete. 2023-12-07T21:11:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.434+0000 7f44a1541640 1 Processor -- start 2023-12-07T21:11:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.434+0000 7f44a1541640 1 -- start start 2023-12-07T21:11:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.434+0000 7f44a1541640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f449c06cc70 0x7f449c122b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.434+0000 7f44a1541640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c123d00 con 0x7f449c06cc70 2023-12-07T21:11:10.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.434+0000 7f449affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f449c06cc70 0x7f449c122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.434+0000 7f449affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f449c06cc70 0x7f449c122b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46524/0 (socket says 172.21.15.89:46524) 2023-12-07T21:11:10.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.434+0000 7f449affd640 1 -- 172.21.15.89:0/1426298453 learned_addr learned my addr 172.21.15.89:0/1426298453 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:10.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.434+0000 7f449affd640 1 -- 172.21.15.89:0/1426298453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c009a70 con 0x7f449c06cc70 2023-12-07T21:11:10.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.434+0000 7f449affd640 1 --2- 172.21.15.89:0/1426298453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f449c06cc70 0x7f449c122b30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f448c037040 tx=0x7f448c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.435+0000 7f44837fe640 1 -- 172.21.15.89:0/1426298453 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f448c03e540 con 0x7f449c06cc70 2023-12-07T21:11:10.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.435+0000 7f44837fe640 1 -- 172.21.15.89:0/1426298453 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c03e6a0 con 0x7f449c06cc70 2023-12-07T21:11:10.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.435+0000 7f44a1541640 1 -- 172.21.15.89:0/1426298453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c1243c0 con 0x7f449c06cc70 2023-12-07T21:11:10.429 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.435+0000 7f44837fe640 1 -- 172.21.15.89:0/1426298453 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f448c03e960 con 0x7f449c06cc70 2023-12-07T21:11:10.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.435+0000 7f44a1541640 1 -- 172.21.15.89:0/1426298453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c1b37b0 con 0x7f449c06cc70 2023-12-07T21:11:10.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.435+0000 7f44837fe640 1 -- 172.21.15.89:0/1426298453 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f448c03b050 con 0x7f449c06cc70 2023-12-07T21:11:10.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.436+0000 7f44837fe640 1 --2- 172.21.15.89:0/1426298453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4488037820 0x7f4488039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.436+0000 7f44837fe640 1 -- 172.21.15.89:0/1426298453 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f448c06d7a0 con 0x7f449c06cc70 2023-12-07T21:11:10.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.436+0000 7f44a1541640 1 -- 172.21.15.89:0/1426298453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c1b37b0 con 0x7f449c06cc70 2023-12-07T21:11:10.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.436+0000 7f449a7fc640 1 --2- 172.21.15.89:0/1426298453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4488037820 0x7f4488039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.436+0000 7f449a7fc640 1 --2- 172.21.15.89:0/1426298453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4488037820 0x7f4488039ce0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4490000f60 tx=0x7f4490007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.440+0000 7f44837fe640 1 -- 172.21.15.89:0/1426298453 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f449c1b37b0 con 0x7f449c06cc70 2023-12-07T21:11:10.597 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.605+0000 7f44a1541640 1 -- 172.21.15.89:0/1426298453 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f449c06d9e0 con 0x7f4488037820 2023-12-07T21:11:10.598 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.606+0000 7f44837fe640 1 -- 172.21.15.89:0/1426298453 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f44900058b0 con 0x7f4488037820 2023-12-07T21:11:10.598 INFO:teuthology.orchestra.run.smithi089.stderr:instructed osd(s) 3 to deep-scrub 2023-12-07T21:11:10.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.608+0000 7f44a1541640 1 -- 172.21.15.89:0/1426298453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4488037820 msgr2=0x7f4488039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.608+0000 7f44a1541640 1 --2- 172.21.15.89:0/1426298453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4488037820 0x7f4488039ce0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4490000f60 tx=0x7f4490007a80 comp rx=0 tx=0).stop 2023-12-07T21:11:10.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.608+0000 7f44a1541640 1 -- 172.21.15.89:0/1426298453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f449c06cc70 msgr2=0x7f449c122b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.608+0000 7f44a1541640 1 --2- 172.21.15.89:0/1426298453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f449c06cc70 0x7f449c122b30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f448c037040 tx=0x7f448c004a40 comp rx=0 tx=0).stop 2023-12-07T21:11:10.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.608+0000 7f44a1541640 1 -- 172.21.15.89:0/1426298453 shutdown_connections 2023-12-07T21:11:10.600 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.608+0000 7f44a1541640 1 --2- 172.21.15.89:0/1426298453 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f4488037820 0x7f4488039ce0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.608+0000 7f44a1541640 1 --2- 172.21.15.89:0/1426298453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f449c06cc70 0x7f449c122b30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.608+0000 7f44a1541640 1 -- 172.21.15.89:0/1426298453 >> 172.21.15.89:0/1426298453 conn(0x7f449c0986a0 msgr2=0x7f449c127a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:10.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.608+0000 7f44a1541640 1 -- 172.21.15.89:0/1426298453 shutdown_connections 2023-12-07T21:11:10.601 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.608+0000 7f44a1541640 1 -- 172.21.15.89:0/1426298453 wait complete. 2023-12-07T21:11:10.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:11:10.708 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.716+0000 7f9f87cbb640 1 Processor -- start 2023-12-07T21:11:10.709 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.717+0000 7f9f87cbb640 1 -- start start 2023-12-07T21:11:10.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.717+0000 7f9f87cbb640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f8006d780 0x7f9f80130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.717+0000 7f9f87cbb640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f80070340 con 0x7f9f8006cc90 2023-12-07T21:11:10.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.717+0000 7f9f87cbb640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f80097940 con 0x7f9f8006d780 2023-12-07T21:11:10.710 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.717+0000 7f9f85256640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f8006d780 0x7f9f80130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.717+0000 7f9f85a57640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f9f8006cc90 0x7f9f8006d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39764/0 (socket says 172.21.15.89:39764) 2023-12-07T21:11:10.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.717+0000 7f9f85a57640 1 -- 172.21.15.89:0/4222409072 learned_addr learned my addr 172.21.15.89:0/4222409072 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:10.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.717+0000 7f9f85256640 1 -- 172.21.15.89:0/4222409072 >> v1:172.21.15.89:6789/0 conn(0x7f9f8006cc90 legacy=0x7f9f8006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.718+0000 7f9f85256640 1 -- 172.21.15.89:0/4222409072 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80071900 con 0x7f9f8006d780 2023-12-07T21:11:10.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.718+0000 7f9f85256640 1 --2- 172.21.15.89:0/4222409072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8006d780 0x7f9f80130910 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009720 tx=0x7f9f7c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11df1e7ed71a21b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.711 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.718+0000 7f9f84a55640 1 -- 172.21.15.89:0/4222409072 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f7c02e070 con 0x7f9f8006d780 2023-12-07T21:11:10.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.718+0000 7f9f84a55640 1 -- 172.21.15.89:0/4222409072 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c0316d0 con 0x7f9f8006d780 2023-12-07T21:11:10.712 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.718+0000 7f9f84a55640 1 -- 172.21.15.89:0/4222409072 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f7c031990 con 0x7f9f8006d780 2023-12-07T21:11:10.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.719+0000 7f9f87cbb640 1 -- 172.21.15.89:0/4222409072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8006d780 msgr2=0x7f9f80130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.719+0000 7f9f87cbb640 1 --2- 172.21.15.89:0/4222409072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8006d780 0x7f9f80130910 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009720 tx=0x7f9f7c02b840 comp rx=0 tx=0).stop 2023-12-07T21:11:10.714 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.719+0000 7f9f87cbb640 1 -- 172.21.15.89:0/4222409072 shutdown_connections 2023-12-07T21:11:10.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.719+0000 7f9f87cbb640 1 --2- 172.21.15.89:0/4222409072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8006d780 0x7f9f80130910 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.719+0000 7f9f87cbb640 1 -- 172.21.15.89:0/4222409072 >> 172.21.15.89:0/4222409072 conn(0x7f9f800987f0 msgr2=0x7f9f80098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:10.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.719+0000 7f9f87cbb640 1 -- 172.21.15.89:0/4222409072 shutdown_connections 2023-12-07T21:11:10.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.719+0000 7f9f87cbb640 1 -- 172.21.15.89:0/4222409072 wait complete. 2023-12-07T21:11:10.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.720+0000 7f9f87cbb640 1 Processor -- start 2023-12-07T21:11:10.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.720+0000 7f9f87cbb640 1 -- start start 2023-12-07T21:11:10.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.720+0000 7f9f87cbb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8006cc90 0x7f9f801c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.715 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.720+0000 7f9f87cbb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f80124bf0 con 0x7f9f8006cc90 2023-12-07T21:11:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.720+0000 7f9f85a57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8006cc90 0x7f9f801c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.720+0000 7f9f85a57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8006cc90 0x7f9f801c01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46550/0 (socket says 172.21.15.89:46550) 2023-12-07T21:11:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.720+0000 7f9f85a57640 1 -- 172.21.15.89:0/797786780 learned_addr learned my addr 172.21.15.89:0/797786780 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.720+0000 7f9f85a57640 1 -- 172.21.15.89:0/797786780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c009400 con 0x7f9f8006cc90 2023-12-07T21:11:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.720+0000 7f9f85a57640 1 --2- 172.21.15.89:0/797786780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8006cc90 0x7f9f801c01f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000c4a0 tx=0x7f9f7000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.721+0000 7f9f767fc640 1 -- 172.21.15.89:0/797786780 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f70005c10 con 0x7f9f8006cc90 2023-12-07T21:11:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.721+0000 7f9f767fc640 1 -- 172.21.15.89:0/797786780 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f70005d70 con 0x7f9f8006cc90 2023-12-07T21:11:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.721+0000 7f9f87cbb640 1 -- 172.21.15.89:0/797786780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f80124e00 con 0x7f9f8006cc90 2023-12-07T21:11:10.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.721+0000 7f9f767fc640 1 -- 172.21.15.89:0/797786780 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f700071a0 con 0x7f9f8006cc90 2023-12-07T21:11:10.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.721+0000 7f9f87cbb640 1 -- 172.21.15.89:0/797786780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f801247f0 con 0x7f9f8006cc90 2023-12-07T21:11:10.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.721+0000 7f9f767fc640 1 -- 172.21.15.89:0/797786780 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f9f70007300 con 0x7f9f8006cc90 2023-12-07T21:11:10.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.721+0000 7f9f87cbb640 1 -- 172.21.15.89:0/797786780 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f801235f0 con 0x7f9f8006cc90 2023-12-07T21:11:10.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.722+0000 7f9f767fc640 1 --2- 172.21.15.89:0/797786780 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9f64037820 0x7f9f64039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:10.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.722+0000 7f9f767fc640 1 -- 172.21.15.89:0/797786780 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f9f7004a0a0 con 0x7f9f8006cc90 2023-12-07T21:11:10.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.722+0000 7f9f85256640 1 --2- 172.21.15.89:0/797786780 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9f64037820 0x7f9f64039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:10.717 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.722+0000 7f9f85256640 1 --2- 172.21.15.89:0/797786780 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9f64037820 0x7f9f64039ce0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c036000 tx=0x7f9f7c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:10.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.726+0000 7f9f767fc640 1 -- 172.21.15.89:0/797786780 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f700196e0 con 0x7f9f8006cc90 2023-12-07T21:11:10.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.893+0000 7f9f87cbb640 1 -- 172.21.15.89:0/797786780 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f80070bf0 con 0x7f9f64037820 2023-12-07T21:11:10.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.911+0000 7f9f767fc640 1 -- 172.21.15.89:0/797786780 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673336 (secure 0 0 0) 0x7f9f7c031ba0 con 0x7f9f64037820 2023-12-07T21:11:10.910 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:11:10.916 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:11:10.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.916+0000 7f9f87cbb640 1 -- 172.21.15.89:0/797786780 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9f64037820 msgr2=0x7f9f64039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.916+0000 7f9f87cbb640 1 --2- 172.21.15.89:0/797786780 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9f64037820 0x7f9f64039ce0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c036000 tx=0x7f9f7c008030 comp rx=0 tx=0).stop 2023-12-07T21:11:10.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.916+0000 7f9f87cbb640 1 -- 172.21.15.89:0/797786780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8006cc90 msgr2=0x7f9f801c01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:10.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.916+0000 7f9f87cbb640 1 --2- 172.21.15.89:0/797786780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8006cc90 0x7f9f801c01f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000c4a0 tx=0x7f9f7000c960 comp rx=0 tx=0).stop 2023-12-07T21:11:10.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.916+0000 7f9f87cbb640 1 -- 172.21.15.89:0/797786780 shutdown_connections 2023-12-07T21:11:10.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.916+0000 7f9f87cbb640 1 --2- 172.21.15.89:0/797786780 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f9f64037820 0x7f9f64039ce0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.916+0000 7f9f87cbb640 1 --2- 172.21.15.89:0/797786780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f8006cc90 0x7f9f801c01f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:10.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.916+0000 7f9f87cbb640 1 -- 172.21.15.89:0/797786780 >> 172.21.15.89:0/797786780 conn(0x7f9f800987f0 msgr2=0x7f9f8012aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:10.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.916+0000 7f9f87cbb640 1 -- 172.21.15.89:0/797786780 shutdown_connections 2023-12-07T21:11:10.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:10.916+0000 7f9f87cbb640 1 -- 172.21.15.89:0/797786780 wait complete. 2023-12-07T21:11:10.920 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2023-12-07T21:11:10.090330+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3826,"ondisk_log_size":3826,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-77,"num_objects":-13,"num_object_clones":0,"num_object_copies":-27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":347,"num_read_kb":347,"num_write":115,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003664"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944900+0000","last_change":"2023-12-07T21:08:54.882968+0000","last_active":"2023-12-07T21:09:35.944900+0000","last_peered":"2023-12-07T21:09:35.944900+0000","last_clean":"2023-12-07T21:09:35.944900+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:09:35.944900+0000","last_undegraded":"2023-12-07T21:09:35.944900+0000","last_fullsized":"2023-12-07T21:09:35.944900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937447+0000","last_change":"2023-12-07T21:08:56.887127+0000","last_active":"2023-12-07T21:09:34.937447+0000","last_peered":"2023-12-07T21:09:34.937447+0000","last_clean":"2023-12-07T21:09:34.937447+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:09:34.937447+0000","last_undegraded":"2023-12-07T21:09:34.937447+0000","last_fullsized":"2023-12-07T21:09:34.937447+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.595639+0000","last_change":"2023-12-07T21:08:54.890832+0000","last_active":"2023-12-07T21:09:36.595639+0000","last_peered":"2023-12-07T21:09:36.595639+0000","last_clean":"2023-12-07T21:09:36.595639+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:09:36.595639+0000","last_undegraded":"2023-12-07T21:09:36.595639+0000","last_fullsized":"2023-12-07T21:09:36.595639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:26.381861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.028116+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:09:37.028116+0000","last_peered":"2023-12-07T21:09:37.028116+0000","last_clean":"2023-12-07T21:09:37.028116+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:09:37.028116+0000","last_undegraded":"2023-12-07T21:09:37.028116+0000","last_fullsized":"2023-12-07T21:09:37.028116+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:04:30.142969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.600004+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:09:36.600004+0000","last_peered":"2023-12-07T21:09:36.600004+0000","last_clean":"2023-12-07T21:09:36.600004+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:09:36.600004+0000","last_undegraded":"2023-12-07T21:09:36.600004+0000","last_fullsized":"2023-12-07T21:09:36.600004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:44.944890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946396+0000","last_change":"2023-12-07T21:08:56.873919+0000","last_active":"2023-12-07T21:09:34.946396+0000","last_peered":"2023-12-07T21:09:34.946396+0000","last_clean":"2023-12-07T21:09:34.946396+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:09:34.946396+0000","last_undegraded":"2023-12-07T21:09:34.946396+0000","last_fullsized":"2023-12-07T21:09:34.946396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:25:16.160841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942772+0000","last_change":"2023-12-07T21:08:54.880442+0000","last_active":"2023-12-07T21:09:35.942772+0000","last_peered":"2023-12-07T21:09:35.942772+0000","last_clean":"2023-12-07T21:09:35.942772+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:09:35.942772+0000","last_undegraded":"2023-12-07T21:09:35.942772+0000","last_fullsized":"2023-12-07T21:09:35.942772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946759+0000","last_change":"2023-12-07T21:08:56.874751+0000","last_active":"2023-12-07T21:09:34.946759+0000","last_peered":"2023-12-07T21:09:34.946759+0000","last_clean":"2023-12-07T21:09:34.946759+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:09:34.946759+0000","last_undegraded":"2023-12-07T21:09:34.946759+0000","last_fullsized":"2023-12-07T21:09:34.946759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:14.099961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945805+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:09:34.945805+0000","last_peered":"2023-12-07T21:09:34.945805+0000","last_clean":"2023-12-07T21:09:34.945805+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:09:34.945805+0000","last_undegraded":"2023-12-07T21:09:34.945805+0000","last_fullsized":"2023-12-07T21:09:34.945805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:18.585963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'7","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149300+0000","last_change":"2023-12-07T21:08:56.873414+0000","last_active":"2023-12-07T21:10:59.149300+0000","last_peered":"2023-12-07T21:10:59.149300+0000","last_clean":"2023-12-07T21:10:59.149300+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:10:59.149300+0000","last_undegraded":"2023-12-07T21:10:59.149300+0000","last_fullsized":"2023-12-07T21:10:59.149300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:46.057644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942843+0000","last_change":"2023-12-07T21:08:54.880274+0000","last_active":"2023-12-07T21:09:34.942843+0000","last_peered":"2023-12-07T21:09:34.942843+0000","last_clean":"2023-12-07T21:09:34.942843+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:09:34.942843+0000","last_undegraded":"2023-12-07T21:09:34.942843+0000","last_fullsized":"2023-12-07T21:09:34.942843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:18.078984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173549+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:10:18.173549+0000","last_peered":"2023-12-07T21:10:18.173549+0000","last_clean":"2023-12-07T21:10:18.173549+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:10:18.173549+0000","last_undegraded":"2023-12-07T21:10:18.173549+0000","last_fullsized":"2023-12-07T21:10:18.173549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:12.509153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945158+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:09:34.945158+0000","last_peered":"2023-12-07T21:09:34.945158+0000","last_clean":"2023-12-07T21:09:34.945158+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:09:34.945158+0000","last_undegraded":"2023-12-07T21:09:34.945158+0000","last_fullsized":"2023-12-07T21:09:34.945158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:55:25.782947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173686+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:10:59.173686+0000","last_peered":"2023-12-07T21:10:59.173686+0000","last_clean":"2023-12-07T21:10:59.173686+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:10:59.173686+0000","last_undegraded":"2023-12-07T21:10:59.173686+0000","last_fullsized":"2023-12-07T21:10:59.173686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943504+0000","last_change":"2023-12-07T21:08:54.891021+0000","last_active":"2023-12-07T21:09:34.943504+0000","last_peered":"2023-12-07T21:09:34.943504+0000","last_clean":"2023-12-07T21:09:34.943504+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:09:34.943504+0000","last_undegraded":"2023-12-07T21:09:34.943504+0000","last_fullsized":"2023-12-07T21:09:34.943504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'13","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.745821+0000","last_change":"2023-12-07T21:08:56.874321+0000","last_active":"2023-12-07T21:10:18.745821+0000","last_peered":"2023-12-07T21:10:18.745821+0000","last_clean":"2023-12-07T21:10:18.745821+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:10:18.745821+0000","last_undegraded":"2023-12-07T21:10:18.745821+0000","last_fullsized":"2023-12-07T21:10:18.745821+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.602232+0000","last_change":"2023-12-07T21:08:56.874409+0000","last_active":"2023-12-07T21:09:36.602232+0000","last_peered":"2023-12-07T21:09:36.602232+0000","last_clean":"2023-12-07T21:09:36.602232+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:09:36.602232+0000","last_undegraded":"2023-12-07T21:09:36.602232+0000","last_fullsized":"2023-12-07T21:09:36.602232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:58.215716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939442+0000","last_change":"2023-12-07T21:08:54.887766+0000","last_active":"2023-12-07T21:09:34.939442+0000","last_peered":"2023-12-07T21:09:34.939442+0000","last_clean":"2023-12-07T21:09:34.939442+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:09:34.939442+0000","last_undegraded":"2023-12-07T21:09:34.939442+0000","last_fullsized":"2023-12-07T21:09:34.939442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149056+0000","last_change":"2023-12-07T21:08:56.876692+0000","last_active":"2023-12-07T21:10:59.149056+0000","last_peered":"2023-12-07T21:10:59.149056+0000","last_clean":"2023-12-07T21:10:59.149056+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:10:59.149056+0000","last_undegraded":"2023-12-07T21:10:59.149056+0000","last_fullsized":"2023-12-07T21:10:59.149056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945726+0000","last_change":"2023-12-07T21:08:54.885605+0000","last_active":"2023-12-07T21:09:34.945726+0000","last_peered":"2023-12-07T21:09:34.945726+0000","last_clean":"2023-12-07T21:09:34.945726+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:09:34.945726+0000","last_undegraded":"2023-12-07T21:09:34.945726+0000","last_fullsized":"2023-12-07T21:09:34.945726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'13","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149284+0000","last_change":"2023-12-07T21:08:56.882602+0000","last_active":"2023-12-07T21:10:59.149284+0000","last_peered":"2023-12-07T21:10:59.149284+0000","last_clean":"2023-12-07T21:10:59.149284+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:10:59.149284+0000","last_undegraded":"2023-12-07T21:10:59.149284+0000","last_fullsized":"2023-12-07T21:10:59.149284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:35.042292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939428+0000","last_change":"2023-12-07T21:08:54.889812+0000","last_active":"2023-12-07T21:09:34.939428+0000","last_peered":"2023-12-07T21:09:34.939428+0000","last_clean":"2023-12-07T21:09:34.939428+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:09:34.939428+0000","last_undegraded":"2023-12-07T21:09:34.939428+0000","last_fullsized":"2023-12-07T21:09:34.939428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.609048+0000","last_change":"2023-12-07T21:08:56.875989+0000","last_active":"2023-12-07T21:09:36.609048+0000","last_peered":"2023-12-07T21:09:36.609048+0000","last_clean":"2023-12-07T21:09:36.609048+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:09:36.609048+0000","last_undegraded":"2023-12-07T21:09:36.609048+0000","last_fullsized":"2023-12-07T21:09:36.609048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:45.013403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938981+0000","last_change":"2023-12-07T21:08:54.878784+0000","last_active":"2023-12-07T21:09:34.938981+0000","last_peered":"2023-12-07T21:09:34.938981+0000","last_clean":"2023-12-07T21:09:34.938981+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:09:34.938981+0000","last_undegraded":"2023-12-07T21:09:34.938981+0000","last_fullsized":"2023-12-07T21:09:34.938981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.022134+0000","last_change":"2023-12-07T21:08:56.875039+0000","last_active":"2023-12-07T21:09:37.022134+0000","last_peered":"2023-12-07T21:09:37.022134+0000","last_clean":"2023-12-07T21:09:37.022134+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:09:37.022134+0000","last_undegraded":"2023-12-07T21:09:37.022134+0000","last_fullsized":"2023-12-07T21:09:37.022134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944921+0000","last_change":"2023-12-07T21:08:54.890574+0000","last_active":"2023-12-07T21:09:34.944921+0000","last_peered":"2023-12-07T21:09:34.944921+0000","last_clean":"2023-12-07T21:09:34.944921+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:09:34.944921+0000","last_undegraded":"2023-12-07T21:09:34.944921+0000","last_fullsized":"2023-12-07T21:09:34.944921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939610+0000","last_change":"2023-12-07T21:08:56.883504+0000","last_active":"2023-12-07T21:09:34.939610+0000","last_peered":"2023-12-07T21:09:34.939610+0000","last_clean":"2023-12-07T21:09:34.939610+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:09:34.939610+0000","last_undegraded":"2023-12-07T21:09:34.939610+0000","last_fullsized":"2023-12-07T21:09:34.939610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:51.305185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946035+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:09:34.946035+0000","last_peered":"2023-12-07T21:09:34.946035+0000","last_clean":"2023-12-07T21:09:34.946035+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:09:34.946035+0000","last_undegraded":"2023-12-07T21:09:34.946035+0000","last_fullsized":"2023-12-07T21:09:34.946035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:50:11.989738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.964931+0000","last_change":"2023-12-07T21:09:04.931981+0000","last_active":"2023-12-07T21:10:59.964931+0000","last_peered":"2023-12-07T21:10:59.964931+0000","last_clean":"2023-12-07T21:10:59.964931+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:10:59.964931+0000","last_undegraded":"2023-12-07T21:10:59.964931+0000","last_fullsized":"2023-12-07T21:10:59.964931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:53.521686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.021786+0000","last_change":"2023-12-07T21:08:56.873551+0000","last_active":"2023-12-07T21:09:37.021786+0000","last_peered":"2023-12-07T21:09:37.021786+0000","last_clean":"2023-12-07T21:09:37.021786+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:09:37.021786+0000","last_undegraded":"2023-12-07T21:09:37.021786+0000","last_fullsized":"2023-12-07T21:09:37.021786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:25.387074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945597+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:09:34.945597+0000","last_peered":"2023-12-07T21:09:34.945597+0000","last_clean":"2023-12-07T21:09:34.945597+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:09:34.945597+0000","last_undegraded":"2023-12-07T21:09:34.945597+0000","last_fullsized":"2023-12-07T21:09:34.945597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:47:43.001000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"24'1","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.945686+0000","last_change":"2023-12-07T21:08:58.878371+0000","last_active":"2023-12-07T21:10:59.945686+0000","last_peered":"2023-12-07T21:10:59.945686+0000","last_clean":"2023-12-07T21:10:59.945686+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:10:59.945686+0000","last_undegraded":"2023-12-07T21:10:59.945686+0000","last_fullsized":"2023-12-07T21:10:59.945686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:31.248934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'31","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.495113+0000","last_change":"2023-12-07T21:09:00.895835+0000","last_active":"2023-12-07T21:11:06.495113+0000","last_peered":"2023-12-07T21:11:06.495113+0000","last_clean":"2023-12-07T21:11:06.495113+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:11:06.495113+0000","last_undegraded":"2023-12-07T21:11:06.495113+0000","last_fullsized":"2023-12-07T21:11:06.495113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:04:34.159776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939365+0000","last_change":"2023-12-07T21:09:02.907297+0000","last_active":"2023-12-07T21:09:34.939365+0000","last_peered":"2023-12-07T21:09:34.939365+0000","last_clean":"2023-12-07T21:09:34.939365+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:09:34.939365+0000","last_undegraded":"2023-12-07T21:09:34.939365+0000","last_fullsized":"2023-12-07T21:09:34.939365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:14.963344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.099231+0000","last_change":"2023-12-07T21:09:04.931948+0000","last_active":"2023-12-07T21:10:13.099231+0000","last_peered":"2023-12-07T21:10:13.099231+0000","last_clean":"2023-12-07T21:10:13.099231+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:10:13.099231+0000","last_undegraded":"2023-12-07T21:10:13.099231+0000","last_fullsized":"2023-12-07T21:10:13.099231+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:01:26.083720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948422+0000","last_change":"2023-12-07T21:08:56.874761+0000","last_active":"2023-12-07T21:09:34.948422+0000","last_peered":"2023-12-07T21:09:34.948422+0000","last_clean":"2023-12-07T21:09:34.948422+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:09:34.948422+0000","last_undegraded":"2023-12-07T21:09:34.948422+0000","last_fullsized":"2023-12-07T21:09:34.948422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:15.592836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942644+0000","last_change":"2023-12-07T21:08:54.880632+0000","last_active":"2023-12-07T21:09:34.942644+0000","last_peered":"2023-12-07T21:09:34.942644+0000","last_clean":"2023-12-07T21:09:34.942644+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:09:34.942644+0000","last_undegraded":"2023-12-07T21:09:34.942644+0000","last_fullsized":"2023-12-07T21:09:34.942644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943879+0000","last_change":"2023-12-07T21:08:58.877458+0000","last_active":"2023-12-07T21:09:34.943879+0000","last_peered":"2023-12-07T21:09:34.943879+0000","last_clean":"2023-12-07T21:09:34.943879+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:09:34.943879+0000","last_undegraded":"2023-12-07T21:09:34.943879+0000","last_fullsized":"2023-12-07T21:09:34.943879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:26.789220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938986+0000","last_change":"2023-12-07T21:09:00.893179+0000","last_active":"2023-12-07T21:09:34.938986+0000","last_peered":"2023-12-07T21:09:34.938986+0000","last_clean":"2023-12-07T21:09:34.938986+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:09:34.938986+0000","last_undegraded":"2023-12-07T21:09:34.938986+0000","last_fullsized":"2023-12-07T21:09:34.938986+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:01:24.642654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938667+0000","last_change":"2023-12-07T21:09:02.901036+0000","last_active":"2023-12-07T21:09:34.938667+0000","last_peered":"2023-12-07T21:09:34.938667+0000","last_clean":"2023-12-07T21:09:34.938667+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:09:34.938667+0000","last_undegraded":"2023-12-07T21:09:34.938667+0000","last_fullsized":"2023-12-07T21:09:34.938667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:43.815906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943377+0000","last_change":"2023-12-07T21:09:04.925464+0000","last_active":"2023-12-07T21:09:34.943377+0000","last_peered":"2023-12-07T21:09:34.943377+0000","last_clean":"2023-12-07T21:09:34.943377+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:09:34.943377+0000","last_undegraded":"2023-12-07T21:09:34.943377+0000","last_fullsized":"2023-12-07T21:09:34.943377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:05.623664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'1","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173385+0000","last_change":"2023-12-07T21:08:56.875484+0000","last_active":"2023-12-07T21:10:18.173385+0000","last_peered":"2023-12-07T21:10:18.173385+0000","last_clean":"2023-12-07T21:10:18.173385+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:10:18.173385+0000","last_undegraded":"2023-12-07T21:10:18.173385+0000","last_fullsized":"2023-12-07T21:10:18.173385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:53.554840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944843+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:09:34.944843+0000","last_peered":"2023-12-07T21:09:34.944843+0000","last_clean":"2023-12-07T21:09:34.944843+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:09:34.944843+0000","last_undegraded":"2023-12-07T21:09:34.944843+0000","last_fullsized":"2023-12-07T21:09:34.944843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:44:12.242883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945726+0000","last_change":"2023-12-07T21:08:58.880158+0000","last_active":"2023-12-07T21:09:34.945726+0000","last_peered":"2023-12-07T21:09:34.945726+0000","last_clean":"2023-12-07T21:09:34.945726+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:09:34.945726+0000","last_undegraded":"2023-12-07T21:09:34.945726+0000","last_fullsized":"2023-12-07T21:09:34.945726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:46:42.407725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943564+0000","last_change":"2023-12-07T21:09:00.890726+0000","last_active":"2023-12-07T21:09:34.943564+0000","last_peered":"2023-12-07T21:09:34.943564+0000","last_clean":"2023-12-07T21:09:34.943564+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:09:34.943564+0000","last_undegraded":"2023-12-07T21:09:34.943564+0000","last_fullsized":"2023-12-07T21:09:34.943564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:46:44.418058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'246","reported_seq":312,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.430314+0000","last_change":"2023-12-07T21:09:02.906250+0000","last_active":"2023-12-07T21:11:06.430314+0000","last_peered":"2023-12-07T21:11:06.430314+0000","last_clean":"2023-12-07T21:11:06.430314+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:11:06.430314+0000","last_undegraded":"2023-12-07T21:11:06.430314+0000","last_fullsized":"2023-12-07T21:11:06.430314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:09.157302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942609+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:09:34.942609+0000","last_peered":"2023-12-07T21:09:34.942609+0000","last_clean":"2023-12-07T21:09:34.942609+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:09:34.942609+0000","last_undegraded":"2023-12-07T21:09:34.942609+0000","last_fullsized":"2023-12-07T21:09:34.942609+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:38.570544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149295+0000","last_change":"2023-12-07T21:08:56.885545+0000","last_active":"2023-12-07T21:10:59.149295+0000","last_peered":"2023-12-07T21:10:59.149295+0000","last_clean":"2023-12-07T21:10:59.149295+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:10:59.149295+0000","last_undegraded":"2023-12-07T21:10:59.149295+0000","last_fullsized":"2023-12-07T21:10:59.149295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937355+0000","last_change":"2023-12-07T21:08:54.878527+0000","last_active":"2023-12-07T21:09:34.937355+0000","last_peered":"2023-12-07T21:09:34.937355+0000","last_clean":"2023-12-07T21:09:34.937355+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:09:34.937355+0000","last_undegraded":"2023-12-07T21:09:34.937355+0000","last_fullsized":"2023-12-07T21:09:34.937355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:44:21.586858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.950706+0000","last_change":"2023-12-07T21:09:35.950706+0000","last_active":"2023-12-07T21:09:35.950706+0000","last_peered":"2023-12-07T21:09:35.950706+0000","last_clean":"2023-12-07T21:09:35.950706+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:09:35.950706+0000","last_undegraded":"2023-12-07T21:09:35.950706+0000","last_fullsized":"2023-12-07T21:09:35.950706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:55.202208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'31","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.476809+0000","last_change":"2023-12-07T21:09:00.892788+0000","last_active":"2023-12-07T21:11:06.476809+0000","last_peered":"2023-12-07T21:11:06.476809+0000","last_clean":"2023-12-07T21:11:06.476809+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:06.476809+0000","last_undegraded":"2023-12-07T21:11:06.476809+0000","last_fullsized":"2023-12-07T21:11:06.476809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:02.232524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'246","reported_seq":329,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.435315+0000","last_change":"2023-12-07T21:09:02.901266+0000","last_active":"2023-12-07T21:11:06.435315+0000","last_peered":"2023-12-07T21:11:06.435315+0000","last_clean":"2023-12-07T21:11:06.435315+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:11:06.435315+0000","last_undegraded":"2023-12-07T21:11:06.435315+0000","last_fullsized":"2023-12-07T21:11:06.435315+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:00.730866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173374+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:10:59.173374+0000","last_peered":"2023-12-07T21:10:59.173374+0000","last_clean":"2023-12-07T21:10:59.173374+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:10:59.173374+0000","last_undegraded":"2023-12-07T21:10:59.173374+0000","last_fullsized":"2023-12-07T21:10:59.173374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:05.147754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.946220+0000","last_change":"2023-12-07T21:08:54.880253+0000","last_active":"2023-12-07T21:09:34.946220+0000","last_peered":"2023-12-07T21:09:34.946220+0000","last_clean":"2023-12-07T21:09:34.946220+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:09:34.946220+0000","last_undegraded":"2023-12-07T21:09:34.946220+0000","last_fullsized":"2023-12-07T21:09:34.946220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.951194+0000","last_change":"2023-12-07T21:08:58.877986+0000","last_active":"2023-12-07T21:09:35.951194+0000","last_peered":"2023-12-07T21:09:35.951194+0000","last_clean":"2023-12-07T21:09:35.951194+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:09:35.951194+0000","last_undegraded":"2023-12-07T21:09:35.951194+0000","last_fullsized":"2023-12-07T21:09:35.951194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:07.154229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'42","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.507863+0000","last_change":"2023-12-07T21:09:00.888749+0000","last_active":"2023-12-07T21:11:06.507863+0000","last_peered":"2023-12-07T21:11:06.507863+0000","last_clean":"2023-12-07T21:11:06.507863+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:06.507863+0000","last_undegraded":"2023-12-07T21:11:06.507863+0000","last_fullsized":"2023-12-07T21:11:06.507863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:09.164561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944403+0000","last_change":"2023-12-07T21:09:02.897538+0000","last_active":"2023-12-07T21:09:34.944403+0000","last_peered":"2023-12-07T21:09:34.944403+0000","last_clean":"2023-12-07T21:09:34.944403+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:09:34.944403+0000","last_undegraded":"2023-12-07T21:09:34.944403+0000","last_fullsized":"2023-12-07T21:09:34.944403+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:14.963344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.550827+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:10:18.550827+0000","last_peered":"2023-12-07T21:10:18.550827+0000","last_clean":"2023-12-07T21:10:18.550827+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:10:18.550827+0000","last_undegraded":"2023-12-07T21:10:18.550827+0000","last_fullsized":"2023-12-07T21:10:18.550827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:02.886090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'21","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.426823+0000","last_change":"2023-12-07T21:08:56.871222+0000","last_active":"2023-12-07T21:10:18.426823+0000","last_peered":"2023-12-07T21:10:18.426823+0000","last_clean":"2023-12-07T21:10:18.426823+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:10:18.426823+0000","last_undegraded":"2023-12-07T21:10:18.426823+0000","last_fullsized":"2023-12-07T21:10:18.426823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:00:00.778558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944073+0000","last_change":"2023-12-07T21:08:54.885249+0000","last_active":"2023-12-07T21:09:34.944073+0000","last_peered":"2023-12-07T21:09:34.944073+0000","last_clean":"2023-12-07T21:09:34.944073+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:09:34.944073+0000","last_undegraded":"2023-12-07T21:09:34.944073+0000","last_fullsized":"2023-12-07T21:09:34.944073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:59.087021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942345+0000","last_change":"2023-12-07T21:08:58.880254+0000","last_active":"2023-12-07T21:09:35.942345+0000","last_peered":"2023-12-07T21:09:35.942345+0000","last_clean":"2023-12-07T21:09:35.942345+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:09:35.942345+0000","last_undegraded":"2023-12-07T21:09:35.942345+0000","last_fullsized":"2023-12-07T21:09:35.942345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:59:22.011218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'33","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.547981+0000","last_change":"2023-12-07T21:09:00.895444+0000","last_active":"2023-12-07T21:11:06.547981+0000","last_peered":"2023-12-07T21:11:06.547981+0000","last_clean":"2023-12-07T21:11:06.547981+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:11:06.547981+0000","last_undegraded":"2023-12-07T21:11:06.547981+0000","last_fullsized":"2023-12-07T21:11:06.547981+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:09:52.225596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943466+0000","last_change":"2023-12-07T21:09:02.906821+0000","last_active":"2023-12-07T21:09:34.943466+0000","last_peered":"2023-12-07T21:09:34.943466+0000","last_clean":"2023-12-07T21:09:34.943466+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:09:34.943466+0000","last_undegraded":"2023-12-07T21:09:34.943466+0000","last_fullsized":"2023-12-07T21:09:34.943466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:00.871254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.004149+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:10:13.004149+0000","last_peered":"2023-12-07T21:10:13.004149+0000","last_clean":"2023-12-07T21:10:13.004149+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:10:13.004149+0000","last_undegraded":"2023-12-07T21:10:13.004149+0000","last_fullsized":"2023-12-07T21:10:13.004149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:03.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942209+0000","last_change":"2023-12-07T21:08:56.879742+0000","last_active":"2023-12-07T21:09:35.942209+0000","last_peered":"2023-12-07T21:09:35.942209+0000","last_clean":"2023-12-07T21:09:35.942209+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:09:35.942209+0000","last_undegraded":"2023-12-07T21:09:35.942209+0000","last_fullsized":"2023-12-07T21:09:35.942209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:28:08.424793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948569+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:09:34.948569+0000","last_peered":"2023-12-07T21:09:34.948569+0000","last_clean":"2023-12-07T21:09:34.948569+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:09:34.948569+0000","last_undegraded":"2023-12-07T21:09:34.948569+0000","last_fullsized":"2023-12-07T21:09:34.948569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:29.350180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945631+0000","last_change":"2023-12-07T21:08:58.874569+0000","last_active":"2023-12-07T21:09:34.945631+0000","last_peered":"2023-12-07T21:09:34.945631+0000","last_clean":"2023-12-07T21:09:34.945631+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:09:34.945631+0000","last_undegraded":"2023-12-07T21:09:34.945631+0000","last_fullsized":"2023-12-07T21:09:34.945631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:25:29.329795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'37","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.513616+0000","last_change":"2023-12-07T21:09:00.889539+0000","last_active":"2023-12-07T21:11:06.513616+0000","last_peered":"2023-12-07T21:11:06.513616+0000","last_clean":"2023-12-07T21:11:06.513616+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:06.513616+0000","last_undegraded":"2023-12-07T21:11:06.513616+0000","last_fullsized":"2023-12-07T21:11:06.513616+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:23.846766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":297,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.436253+0000","last_change":"2023-12-07T21:09:02.905689+0000","last_active":"2023-12-07T21:11:06.436253+0000","last_peered":"2023-12-07T21:11:06.436253+0000","last_clean":"2023-12-07T21:11:06.436253+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:06.436253+0000","last_undegraded":"2023-12-07T21:11:06.436253+0000","last_fullsized":"2023-12-07T21:11:06.436253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:43.815906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944612+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:09:34.944612+0000","last_peered":"2023-12-07T21:09:34.944612+0000","last_clean":"2023-12-07T21:09:34.944612+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:09:34.944612+0000","last_undegraded":"2023-12-07T21:09:34.944612+0000","last_fullsized":"2023-12-07T21:09:34.944612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:27.874660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.602318+0000","last_change":"2023-12-07T21:08:56.870949+0000","last_active":"2023-12-07T21:09:36.602318+0000","last_peered":"2023-12-07T21:09:36.602318+0000","last_clean":"2023-12-07T21:09:36.602318+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:09:36.602318+0000","last_undegraded":"2023-12-07T21:09:36.602318+0000","last_fullsized":"2023-12-07T21:09:36.602318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:50.983783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947454+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:09:34.947454+0000","last_peered":"2023-12-07T21:09:34.947454+0000","last_clean":"2023-12-07T21:09:34.947454+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:09:34.947454+0000","last_undegraded":"2023-12-07T21:09:34.947454+0000","last_fullsized":"2023-12-07T21:09:34.947454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:48.971381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942120+0000","last_change":"2023-12-07T21:08:58.880111+0000","last_active":"2023-12-07T21:09:35.942120+0000","last_peered":"2023-12-07T21:09:35.942120+0000","last_clean":"2023-12-07T21:09:35.942120+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:09:35.942120+0000","last_undegraded":"2023-12-07T21:09:35.942120+0000","last_fullsized":"2023-12-07T21:09:35.942120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:06:27.005217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'56","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.556819+0000","last_change":"2023-12-07T21:09:00.894678+0000","last_active":"2023-12-07T21:11:06.556819+0000","last_peered":"2023-12-07T21:11:06.556819+0000","last_clean":"2023-12-07T21:11:06.556819+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:06.556819+0000","last_undegraded":"2023-12-07T21:11:06.556819+0000","last_fullsized":"2023-12-07T21:11:06.556819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:55:22.200023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943349+0000","last_change":"2023-12-07T21:09:02.901382+0000","last_active":"2023-12-07T21:09:34.943349+0000","last_peered":"2023-12-07T21:09:34.943349+0000","last_clean":"2023-12-07T21:09:34.943349+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:09:34.943349+0000","last_undegraded":"2023-12-07T21:09:34.943349+0000","last_fullsized":"2023-12-07T21:09:34.943349+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:36.555708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.963309+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:10:59.963309+0000","last_peered":"2023-12-07T21:10:59.963309+0000","last_clean":"2023-12-07T21:10:59.963309+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:10:59.963309+0000","last_undegraded":"2023-12-07T21:10:59.963309+0000","last_fullsized":"2023-12-07T21:10:59.963309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:58.709847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.952362+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:09:35.952362+0000","last_peered":"2023-12-07T21:09:35.952362+0000","last_clean":"2023-12-07T21:09:35.952362+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:09:35.952362+0000","last_undegraded":"2023-12-07T21:09:35.952362+0000","last_fullsized":"2023-12-07T21:09:35.952362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:06:39.417736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944094+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:09:34.944094+0000","last_peered":"2023-12-07T21:09:34.944094+0000","last_clean":"2023-12-07T21:09:34.944094+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:09:34.944094+0000","last_undegraded":"2023-12-07T21:09:34.944094+0000","last_fullsized":"2023-12-07T21:09:34.944094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943794+0000","last_change":"2023-12-07T21:08:58.878003+0000","last_active":"2023-12-07T21:09:34.943794+0000","last_peered":"2023-12-07T21:09:34.943794+0000","last_clean":"2023-12-07T21:09:34.943794+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:09:34.943794+0000","last_undegraded":"2023-12-07T21:09:34.943794+0000","last_fullsized":"2023-12-07T21:09:34.943794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:31.868475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'33","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.560225+0000","last_change":"2023-12-07T21:09:00.892793+0000","last_active":"2023-12-07T21:11:06.560225+0000","last_peered":"2023-12-07T21:11:06.560225+0000","last_clean":"2023-12-07T21:11:06.560225+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:06.560225+0000","last_undegraded":"2023-12-07T21:11:06.560225+0000","last_fullsized":"2023-12-07T21:11:06.560225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:40:44.335329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948507+0000","last_change":"2023-12-07T21:09:02.906350+0000","last_active":"2023-12-07T21:09:34.948507+0000","last_peered":"2023-12-07T21:09:34.948507+0000","last_clean":"2023-12-07T21:09:34.948507+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:09:34.948507+0000","last_undegraded":"2023-12-07T21:09:34.948507+0000","last_fullsized":"2023-12-07T21:09:34.948507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:37:53.231631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.945851+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:09:35.945851+0000","last_peered":"2023-12-07T21:09:35.945851+0000","last_clean":"2023-12-07T21:09:35.945851+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:09:35.945851+0000","last_undegraded":"2023-12-07T21:09:35.945851+0000","last_fullsized":"2023-12-07T21:09:35.945851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:08:05.985163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737413+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:10:18.737413+0000","last_peered":"2023-12-07T21:10:18.737413+0000","last_clean":"2023-12-07T21:10:18.737413+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:10:18.737413+0000","last_undegraded":"2023-12-07T21:10:18.737413+0000","last_fullsized":"2023-12-07T21:10:18.737413+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:45.476986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943737+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:09:35.943737+0000","last_peered":"2023-12-07T21:09:35.943737+0000","last_clean":"2023-12-07T21:09:35.943737+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:09:35.943737+0000","last_undegraded":"2023-12-07T21:09:35.943737+0000","last_fullsized":"2023-12-07T21:09:35.943737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:50.838564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943971+0000","last_change":"2023-12-07T21:08:58.880054+0000","last_active":"2023-12-07T21:09:34.943971+0000","last_peered":"2023-12-07T21:09:34.943971+0000","last_clean":"2023-12-07T21:09:34.943971+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:09:34.943971+0000","last_undegraded":"2023-12-07T21:09:34.943971+0000","last_fullsized":"2023-12-07T21:09:34.943971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:06:16.756883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.537959+0000","last_change":"2023-12-07T21:09:00.884835+0000","last_active":"2023-12-07T21:11:06.537959+0000","last_peered":"2023-12-07T21:11:06.537959+0000","last_clean":"2023-12-07T21:11:06.537959+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:06.537959+0000","last_undegraded":"2023-12-07T21:11:06.537959+0000","last_fullsized":"2023-12-07T21:11:06.537959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:46:31.016107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":326,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.431297+0000","last_change":"2023-12-07T21:09:02.897993+0000","last_active":"2023-12-07T21:11:06.431297+0000","last_peered":"2023-12-07T21:11:06.431297+0000","last_clean":"2023-12-07T21:11:06.431297+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:06.431297+0000","last_undegraded":"2023-12-07T21:11:06.431297+0000","last_fullsized":"2023-12-07T21:11:06.431297+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:07:07.411571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.749284+0000","last_change":"2023-12-07T21:09:04.919388+0000","last_active":"2023-12-07T21:10:18.749284+0000","last_peered":"2023-12-07T21:10:18.749284+0000","last_clean":"2023-12-07T21:10:18.749284+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:10:18.749284+0000","last_undegraded":"2023-12-07T21:10:18.749284+0000","last_fullsized":"2023-12-07T21:10:18.749284+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:08.715985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.066420+0000","last_change":"2023-12-07T21:08:56.880261+0000","last_active":"2023-12-07T21:09:36.066420+0000","last_peered":"2023-12-07T21:09:36.066420+0000","last_clean":"2023-12-07T21:09:36.066420+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:09:36.066420+0000","last_undegraded":"2023-12-07T21:09:36.066420+0000","last_fullsized":"2023-12-07T21:09:36.066420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.588834+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:09:36.588834+0000","last_peered":"2023-12-07T21:09:36.588834+0000","last_clean":"2023-12-07T21:09:36.588834+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:09:36.588834+0000","last_undegraded":"2023-12-07T21:09:36.588834+0000","last_fullsized":"2023-12-07T21:09:36.588834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:55:05.877689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":193,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.412373+0000","last_change":"2023-12-07T21:08:58.876612+0000","last_active":"2023-12-07T21:11:06.412373+0000","last_peered":"2023-12-07T21:11:06.412373+0000","last_clean":"2023-12-07T21:11:06.412373+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:06.412373+0000","last_undegraded":"2023-12-07T21:11:06.412373+0000","last_fullsized":"2023-12-07T21:11:06.412373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:09.272727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947872+0000","last_change":"2023-12-07T21:09:00.895566+0000","last_active":"2023-12-07T21:09:34.947872+0000","last_peered":"2023-12-07T21:09:34.947872+0000","last_clean":"2023-12-07T21:09:34.947872+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:09:34.947872+0000","last_undegraded":"2023-12-07T21:09:34.947872+0000","last_fullsized":"2023-12-07T21:09:34.947872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:26:26.503427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'246","reported_seq":361,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.432627+0000","last_change":"2023-12-07T21:09:02.900092+0000","last_active":"2023-12-07T21:11:06.432627+0000","last_peered":"2023-12-07T21:11:06.432627+0000","last_clean":"2023-12-07T21:11:06.432627+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:06.432627+0000","last_undegraded":"2023-12-07T21:11:06.432627+0000","last_fullsized":"2023-12-07T21:11:06.432627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:58.034650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.362471+0000","last_change":"2023-12-07T21:09:04.923396+0000","last_active":"2023-12-07T21:09:36.362471+0000","last_peered":"2023-12-07T21:09:36.362471+0000","last_clean":"2023-12-07T21:09:36.362471+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:09:36.362471+0000","last_undegraded":"2023-12-07T21:09:36.362471+0000","last_fullsized":"2023-12-07T21:09:36.362471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:15:15.500097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939613+0000","last_change":"2023-12-07T21:08:56.889238+0000","last_active":"2023-12-07T21:09:34.939613+0000","last_peered":"2023-12-07T21:09:34.939613+0000","last_clean":"2023-12-07T21:09:34.939613+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:09:34.939613+0000","last_undegraded":"2023-12-07T21:09:34.939613+0000","last_fullsized":"2023-12-07T21:09:34.939613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:06:26.241158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.947642+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:09:35.947642+0000","last_peered":"2023-12-07T21:09:35.947642+0000","last_clean":"2023-12-07T21:09:35.947642+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:09:35.947642+0000","last_undegraded":"2023-12-07T21:09:35.947642+0000","last_fullsized":"2023-12-07T21:09:35.947642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:48.585124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948807+0000","last_change":"2023-12-07T21:08:58.879899+0000","last_active":"2023-12-07T21:09:34.948807+0000","last_peered":"2023-12-07T21:09:34.948807+0000","last_clean":"2023-12-07T21:09:34.948807+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:09:34.948807+0000","last_undegraded":"2023-12-07T21:09:34.948807+0000","last_fullsized":"2023-12-07T21:09:34.948807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:56.707476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'39","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.498298+0000","last_change":"2023-12-07T21:09:00.892694+0000","last_active":"2023-12-07T21:11:06.498298+0000","last_peered":"2023-12-07T21:11:06.498298+0000","last_clean":"2023-12-07T21:11:06.498298+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:06.498298+0000","last_undegraded":"2023-12-07T21:11:06.498298+0000","last_fullsized":"2023-12-07T21:11:06.498298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:54.775039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943470+0000","last_change":"2023-12-07T21:09:02.906473+0000","last_active":"2023-12-07T21:09:34.943470+0000","last_peered":"2023-12-07T21:09:34.943470+0000","last_clean":"2023-12-07T21:09:34.943470+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:09:34.943470+0000","last_undegraded":"2023-12-07T21:09:34.943470+0000","last_fullsized":"2023-12-07T21:09:34.943470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:41.421690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.180594+0000","last_change":"2023-12-07T21:09:04.920277+0000","last_active":"2023-12-07T21:10:59.180594+0000","last_peered":"2023-12-07T21:10:59.180594+0000","last_clean":"2023-12-07T21:10:59.180594+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:10:59.180594+0000","last_undegraded":"2023-12-07T21:10:59.180594+0000","last_fullsized":"2023-12-07T21:10:59.180594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:05.623664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.947251+0000","last_change":"2023-12-07T21:08:56.875185+0000","last_active":"2023-12-07T21:09:35.947251+0000","last_peered":"2023-12-07T21:09:35.947251+0000","last_clean":"2023-12-07T21:09:35.947251+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:09:35.947251+0000","last_undegraded":"2023-12-07T21:09:35.947251+0000","last_fullsized":"2023-12-07T21:09:35.947251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:07:01.381707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948511+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:09:35.948511+0000","last_peered":"2023-12-07T21:09:35.948511+0000","last_clean":"2023-12-07T21:09:35.948511+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:09:35.948511+0000","last_undegraded":"2023-12-07T21:09:35.948511+0000","last_fullsized":"2023-12-07T21:09:35.948511+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:17.092202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944755+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:09:35.944755+0000","last_peered":"2023-12-07T21:09:35.944755+0000","last_clean":"2023-12-07T21:09:35.944755+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:09:35.944755+0000","last_undegraded":"2023-12-07T21:09:35.944755+0000","last_fullsized":"2023-12-07T21:09:35.944755+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:39:44.793585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942701+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:09:35.942701+0000","last_peered":"2023-12-07T21:09:35.942701+0000","last_clean":"2023-12-07T21:09:35.942701+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:09:35.942701+0000","last_undegraded":"2023-12-07T21:09:35.942701+0000","last_fullsized":"2023-12-07T21:09:35.942701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:28:06.412391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.952567+0000","last_change":"2023-12-07T21:08:58.875656+0000","last_active":"2023-12-07T21:09:35.952567+0000","last_peered":"2023-12-07T21:09:35.952567+0000","last_clean":"2023-12-07T21:09:35.952567+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:09:35.952567+0000","last_undegraded":"2023-12-07T21:09:35.952567+0000","last_fullsized":"2023-12-07T21:09:35.952567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:55.354113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'79","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.531752+0000","last_change":"2023-12-07T21:09:00.891338+0000","last_active":"2023-12-07T21:11:06.531752+0000","last_peered":"2023-12-07T21:11:06.531752+0000","last_clean":"2023-12-07T21:11:06.531752+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:11:06.531752+0000","last_undegraded":"2023-12-07T21:11:06.531752+0000","last_fullsized":"2023-12-07T21:11:06.531752+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:47.241395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944698+0000","last_change":"2023-12-07T21:09:02.905666+0000","last_active":"2023-12-07T21:09:34.944698+0000","last_peered":"2023-12-07T21:09:34.944698+0000","last_clean":"2023-12-07T21:09:34.944698+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:09:34.944698+0000","last_undegraded":"2023-12-07T21:09:34.944698+0000","last_fullsized":"2023-12-07T21:09:34.944698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:02.230683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.177244+0000","last_change":"2023-12-07T21:09:04.924703+0000","last_active":"2023-12-07T21:10:59.177244+0000","last_peered":"2023-12-07T21:10:59.177244+0000","last_clean":"2023-12-07T21:10:59.177244+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:10:59.177244+0000","last_undegraded":"2023-12-07T21:10:59.177244+0000","last_fullsized":"2023-12-07T21:10:59.177244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:31.414632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.366048+0000","last_change":"2023-12-07T21:08:56.872420+0000","last_active":"2023-12-07T21:09:36.366048+0000","last_peered":"2023-12-07T21:09:36.366048+0000","last_clean":"2023-12-07T21:09:36.366048+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:09:36.366048+0000","last_undegraded":"2023-12-07T21:09:36.366048+0000","last_fullsized":"2023-12-07T21:09:36.366048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:35.391826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946195+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:09:35.946195+0000","last_peered":"2023-12-07T21:09:35.946195+0000","last_clean":"2023-12-07T21:09:35.946195+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:09:35.946195+0000","last_undegraded":"2023-12-07T21:09:35.946195+0000","last_fullsized":"2023-12-07T21:09:35.946195+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:38.020788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.147003+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:10:59.147003+0000","last_peered":"2023-12-07T21:10:59.147003+0000","last_clean":"2023-12-07T21:10:59.147003+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:10:59.147003+0000","last_undegraded":"2023-12-07T21:10:59.147003+0000","last_fullsized":"2023-12-07T21:10:59.147003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:40:17.870834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946353+0000","last_change":"2023-12-07T21:08:58.879144+0000","last_active":"2023-12-07T21:09:35.946353+0000","last_peered":"2023-12-07T21:09:35.946353+0000","last_clean":"2023-12-07T21:09:35.946353+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:09:35.946353+0000","last_undegraded":"2023-12-07T21:09:35.946353+0000","last_fullsized":"2023-12-07T21:09:35.946353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:41:10.939955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'252","reported_seq":435,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.578207+0000","last_change":"2023-12-07T21:09:00.892118+0000","last_active":"2023-12-07T21:11:06.578207+0000","last_peered":"2023-12-07T21:11:06.578207+0000","last_clean":"2023-12-07T21:11:06.578207+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:06.578207+0000","last_undegraded":"2023-12-07T21:11:06.578207+0000","last_fullsized":"2023-12-07T21:11:06.578207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:03:54.253378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943312+0000","last_change":"2023-12-07T21:09:02.905387+0000","last_active":"2023-12-07T21:09:35.943312+0000","last_peered":"2023-12-07T21:09:35.943312+0000","last_clean":"2023-12-07T21:09:35.943312+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:09:35.943312+0000","last_undegraded":"2023-12-07T21:09:35.943312+0000","last_fullsized":"2023-12-07T21:09:35.943312+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:01:07.430200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.153282+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:10:13.153282+0000","last_peered":"2023-12-07T21:10:13.153282+0000","last_clean":"2023-12-07T21:10:13.153282+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:10:13.153282+0000","last_undegraded":"2023-12-07T21:10:13.153282+0000","last_fullsized":"2023-12-07T21:10:13.153282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:03.815279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.745057+0000","last_change":"2023-12-07T21:08:56.883281+0000","last_active":"2023-12-07T21:10:18.745057+0000","last_peered":"2023-12-07T21:10:18.745057+0000","last_clean":"2023-12-07T21:10:18.745057+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:10:18.745057+0000","last_undegraded":"2023-12-07T21:10:18.745057+0000","last_fullsized":"2023-12-07T21:10:18.745057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:11:43.198377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941657+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:09:35.941657+0000","last_peered":"2023-12-07T21:09:35.941657+0000","last_clean":"2023-12-07T21:09:35.941657+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:09:35.941657+0000","last_undegraded":"2023-12-07T21:09:35.941657+0000","last_fullsized":"2023-12-07T21:09:35.941657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:49:28.884695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941524+0000","last_change":"2023-12-07T21:08:54.881937+0000","last_active":"2023-12-07T21:09:35.941524+0000","last_peered":"2023-12-07T21:09:35.941524+0000","last_clean":"2023-12-07T21:09:35.941524+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:09:35.941524+0000","last_undegraded":"2023-12-07T21:09:35.941524+0000","last_fullsized":"2023-12-07T21:09:35.941524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944444+0000","last_change":"2023-12-07T21:08:58.875724+0000","last_active":"2023-12-07T21:09:35.944444+0000","last_peered":"2023-12-07T21:09:35.944444+0000","last_clean":"2023-12-07T21:09:35.944444+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:09:35.944444+0000","last_undegraded":"2023-12-07T21:09:35.944444+0000","last_fullsized":"2023-12-07T21:09:35.944444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:38:36.911470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:00.121092+0000","last_change":"2023-12-07T21:09:00.888461+0000","last_active":"2023-12-07T21:11:00.121092+0000","last_peered":"2023-12-07T21:11:00.121092+0000","last_clean":"2023-12-07T21:11:00.121092+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:00.121092+0000","last_undegraded":"2023-12-07T21:11:00.121092+0000","last_fullsized":"2023-12-07T21:11:00.121092+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:25:31.340127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942988+0000","last_change":"2023-12-07T21:09:02.905583+0000","last_active":"2023-12-07T21:09:35.942988+0000","last_peered":"2023-12-07T21:09:35.942988+0000","last_clean":"2023-12-07T21:09:35.942988+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:09:35.942988+0000","last_undegraded":"2023-12-07T21:09:35.942988+0000","last_fullsized":"2023-12-07T21:09:35.942988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:59:50.067921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945302+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:09:34.945302+0000","last_peered":"2023-12-07T21:09:34.945302+0000","last_clean":"2023-12-07T21:09:34.945302+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:09:34.945302+0000","last_undegraded":"2023-12-07T21:09:34.945302+0000","last_fullsized":"2023-12-07T21:09:34.945302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:25:58.505646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.609344+0000","last_change":"2023-12-07T21:08:56.872455+0000","last_active":"2023-12-07T21:09:36.609344+0000","last_peered":"2023-12-07T21:09:36.609344+0000","last_clean":"2023-12-07T21:09:36.609344+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:09:36.609344+0000","last_undegraded":"2023-12-07T21:09:36.609344+0000","last_fullsized":"2023-12-07T21:09:36.609344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:23.887277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942558+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:09:35.942558+0000","last_peered":"2023-12-07T21:09:35.942558+0000","last_clean":"2023-12-07T21:09:35.942558+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:09:35.942558+0000","last_undegraded":"2023-12-07T21:09:35.942558+0000","last_fullsized":"2023-12-07T21:09:35.942558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:34.117128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946583+0000","last_change":"2023-12-07T21:08:54.880674+0000","last_active":"2023-12-07T21:09:35.946583+0000","last_peered":"2023-12-07T21:09:35.946583+0000","last_clean":"2023-12-07T21:09:35.946583+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:09:35.946583+0000","last_undegraded":"2023-12-07T21:09:35.946583+0000","last_fullsized":"2023-12-07T21:09:35.946583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943247+0000","last_change":"2023-12-07T21:08:58.881871+0000","last_active":"2023-12-07T21:09:35.943247+0000","last_peered":"2023-12-07T21:09:35.943247+0000","last_clean":"2023-12-07T21:09:35.943247+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:09:35.943247+0000","last_undegraded":"2023-12-07T21:09:35.943247+0000","last_fullsized":"2023-12-07T21:09:35.943247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:38.827449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943744+0000","last_change":"2023-12-07T21:09:00.892022+0000","last_active":"2023-12-07T21:09:35.943744+0000","last_peered":"2023-12-07T21:09:35.943744+0000","last_clean":"2023-12-07T21:09:35.943744+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:09:35.943744+0000","last_undegraded":"2023-12-07T21:09:35.943744+0000","last_fullsized":"2023-12-07T21:09:35.943744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:20:22.542933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948794+0000","last_change":"2023-12-07T21:09:02.907037+0000","last_active":"2023-12-07T21:09:34.948794+0000","last_peered":"2023-12-07T21:09:34.948794+0000","last_clean":"2023-12-07T21:09:34.948794+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:09:34.948794+0000","last_undegraded":"2023-12-07T21:09:34.948794+0000","last_fullsized":"2023-12-07T21:09:34.948794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:47:48.082744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937984+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:09:34.937984+0000","last_peered":"2023-12-07T21:09:34.937984+0000","last_clean":"2023-12-07T21:09:34.937984+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:09:34.937984+0000","last_undegraded":"2023-12-07T21:09:34.937984+0000","last_fullsized":"2023-12-07T21:09:34.937984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:02:06.112301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.950132+0000","last_change":"2023-12-07T21:08:56.882954+0000","last_active":"2023-12-07T21:09:35.950132+0000","last_peered":"2023-12-07T21:09:35.950132+0000","last_clean":"2023-12-07T21:09:35.950132+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:09:35.950132+0000","last_undegraded":"2023-12-07T21:09:35.950132+0000","last_fullsized":"2023-12-07T21:09:35.950132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:07:51.158690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.592742+0000","last_change":"2023-12-07T21:08:54.881143+0000","last_active":"2023-12-07T21:09:36.592742+0000","last_peered":"2023-12-07T21:09:36.592742+0000","last_clean":"2023-12-07T21:09:36.592742+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:09:36.592742+0000","last_undegraded":"2023-12-07T21:09:36.592742+0000","last_fullsized":"2023-12-07T21:09:36.592742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942847+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:09:35.942847+0000","last_peered":"2023-12-07T21:09:35.942847+0000","last_clean":"2023-12-07T21:09:35.942847+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:09:35.942847+0000","last_undegraded":"2023-12-07T21:09:35.942847+0000","last_fullsized":"2023-12-07T21:09:35.942847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:42:24.297087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943063+0000","last_change":"2023-12-07T21:08:58.881942+0000","last_active":"2023-12-07T21:09:35.943063+0000","last_peered":"2023-12-07T21:09:35.943063+0000","last_clean":"2023-12-07T21:09:35.943063+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:09:35.943063+0000","last_undegraded":"2023-12-07T21:09:35.943063+0000","last_fullsized":"2023-12-07T21:09:35.943063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:41:45.408620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'64","reported_seq":124,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.535138+0000","last_change":"2023-12-07T21:09:00.892917+0000","last_active":"2023-12-07T21:11:06.535138+0000","last_peered":"2023-12-07T21:11:06.535138+0000","last_clean":"2023-12-07T21:11:06.535138+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:06.535138+0000","last_undegraded":"2023-12-07T21:11:06.535138+0000","last_fullsized":"2023-12-07T21:11:06.535138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:08:10.091706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942640+0000","last_change":"2023-12-07T21:09:02.897497+0000","last_active":"2023-12-07T21:09:35.942640+0000","last_peered":"2023-12-07T21:09:35.942640+0000","last_clean":"2023-12-07T21:09:35.942640+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:09:35.942640+0000","last_undegraded":"2023-12-07T21:09:35.942640+0000","last_fullsized":"2023-12-07T21:09:35.942640+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:21.622701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.727098+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:10:18.727098+0000","last_peered":"2023-12-07T21:10:18.727098+0000","last_clean":"2023-12-07T21:10:18.727098+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:10:18.727098+0000","last_undegraded":"2023-12-07T21:10:18.727098+0000","last_fullsized":"2023-12-07T21:10:18.727098+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:02:58.721630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948690+0000","last_change":"2023-12-07T21:08:56.878924+0000","last_active":"2023-12-07T21:09:35.948690+0000","last_peered":"2023-12-07T21:09:35.948690+0000","last_clean":"2023-12-07T21:09:35.948690+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:09:35.948690+0000","last_undegraded":"2023-12-07T21:09:35.948690+0000","last_fullsized":"2023-12-07T21:09:35.948690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:11:43.198377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.735075+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:10:18.735075+0000","last_peered":"2023-12-07T21:10:18.735075+0000","last_clean":"2023-12-07T21:10:18.735075+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:10:18.735075+0000","last_undegraded":"2023-12-07T21:10:18.735075+0000","last_fullsized":"2023-12-07T21:10:18.735075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:32.542770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946376+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:09:35.946376+0000","last_peered":"2023-12-07T21:09:35.946376+0000","last_clean":"2023-12-07T21:09:35.946376+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:09:35.946376+0000","last_undegraded":"2023-12-07T21:09:35.946376+0000","last_fullsized":"2023-12-07T21:09:35.946376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:30:53.269300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942447+0000","last_change":"2023-12-07T21:08:58.879797+0000","last_active":"2023-12-07T21:09:35.942447+0000","last_peered":"2023-12-07T21:09:35.942447+0000","last_clean":"2023-12-07T21:09:35.942447+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:09:35.942447+0000","last_undegraded":"2023-12-07T21:09:35.942447+0000","last_fullsized":"2023-12-07T21:09:35.942447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:57:59.211719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.951431+0000","last_change":"2023-12-07T21:09:00.890696+0000","last_active":"2023-12-07T21:09:35.951431+0000","last_peered":"2023-12-07T21:09:35.951431+0000","last_clean":"2023-12-07T21:09:35.951431+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:09:35.951431+0000","last_undegraded":"2023-12-07T21:09:35.951431+0000","last_fullsized":"2023-12-07T21:09:35.951431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:57.571647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":291,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.429263+0000","last_change":"2023-12-07T21:09:02.900501+0000","last_active":"2023-12-07T21:11:06.429263+0000","last_peered":"2023-12-07T21:11:06.429263+0000","last_clean":"2023-12-07T21:11:06.429263+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:06.429263+0000","last_undegraded":"2023-12-07T21:11:06.429263+0000","last_fullsized":"2023-12-07T21:11:06.429263+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:07.330523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948599+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:09:34.948599+0000","last_peered":"2023-12-07T21:09:34.948599+0000","last_clean":"2023-12-07T21:09:34.948599+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:09:34.948599+0000","last_undegraded":"2023-12-07T21:09:34.948599+0000","last_fullsized":"2023-12-07T21:09:34.948599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:41.901371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.027809+0000","last_change":"2023-12-07T21:08:56.887962+0000","last_active":"2023-12-07T21:09:37.027809+0000","last_peered":"2023-12-07T21:09:37.027809+0000","last_clean":"2023-12-07T21:09:37.027809+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:09:37.027809+0000","last_undegraded":"2023-12-07T21:09:37.027809+0000","last_fullsized":"2023-12-07T21:09:37.027809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:38.589260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.945764+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:09:35.945764+0000","last_peered":"2023-12-07T21:09:35.945764+0000","last_clean":"2023-12-07T21:09:35.945764+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:09:35.945764+0000","last_undegraded":"2023-12-07T21:09:35.945764+0000","last_fullsized":"2023-12-07T21:09:35.945764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:21:21.874874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943546+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:09:35.943546+0000","last_peered":"2023-12-07T21:09:35.943546+0000","last_clean":"2023-12-07T21:09:35.943546+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:09:35.943546+0000","last_undegraded":"2023-12-07T21:09:35.943546+0000","last_fullsized":"2023-12-07T21:09:35.943546+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:02:32.429314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948547+0000","last_change":"2023-12-07T21:08:58.878642+0000","last_active":"2023-12-07T21:09:35.948547+0000","last_peered":"2023-12-07T21:09:35.948547+0000","last_clean":"2023-12-07T21:09:35.948547+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:09:35.948547+0000","last_undegraded":"2023-12-07T21:09:35.948547+0000","last_fullsized":"2023-12-07T21:09:35.948547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:03.307133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943060+0000","last_change":"2023-12-07T21:09:00.896503+0000","last_active":"2023-12-07T21:09:35.943060+0000","last_peered":"2023-12-07T21:09:35.943060+0000","last_clean":"2023-12-07T21:09:35.943060+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:09:35.943060+0000","last_undegraded":"2023-12-07T21:09:35.943060+0000","last_fullsized":"2023-12-07T21:09:35.943060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:54.681953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":359,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.585240+0000","last_change":"2023-12-07T21:09:02.897351+0000","last_active":"2023-12-07T21:11:06.585240+0000","last_peered":"2023-12-07T21:11:06.585240+0000","last_clean":"2023-12-07T21:11:06.585240+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:06.585240+0000","last_undegraded":"2023-12-07T21:11:06.585240+0000","last_fullsized":"2023-12-07T21:11:06.585240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:58:03.235109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938213+0000","last_change":"2023-12-07T21:09:04.929420+0000","last_active":"2023-12-07T21:09:34.938213+0000","last_peered":"2023-12-07T21:09:34.938213+0000","last_clean":"2023-12-07T21:09:34.938213+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:09:34.938213+0000","last_undegraded":"2023-12-07T21:09:34.938213+0000","last_fullsized":"2023-12-07T21:09:34.938213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:08.715985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173660+0000","last_change":"2023-12-07T21:08:56.874336+0000","last_active":"2023-12-07T21:10:59.173660+0000","last_peered":"2023-12-07T21:10:59.173660+0000","last_clean":"2023-12-07T21:10:59.173660+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:10:59.173660+0000","last_undegraded":"2023-12-07T21:10:59.173660+0000","last_fullsized":"2023-12-07T21:10:59.173660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:22.142967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.951161+0000","last_change":"2023-12-07T21:08:54.888557+0000","last_active":"2023-12-07T21:09:35.951161+0000","last_peered":"2023-12-07T21:09:35.951161+0000","last_clean":"2023-12-07T21:09:35.951161+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:09:35.951161+0000","last_undegraded":"2023-12-07T21:09:35.951161+0000","last_fullsized":"2023-12-07T21:09:35.951161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944629+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:09:35.944629+0000","last_peered":"2023-12-07T21:09:35.944629+0000","last_clean":"2023-12-07T21:09:35.944629+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:09:35.944629+0000","last_undegraded":"2023-12-07T21:09:35.944629+0000","last_fullsized":"2023-12-07T21:09:35.944629+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:13:59.600730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.953920+0000","last_change":"2023-12-07T21:09:35.953149+0000","last_active":"2023-12-07T21:09:35.953920+0000","last_peered":"2023-12-07T21:09:35.953920+0000","last_clean":"2023-12-07T21:09:35.953920+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:09:35.953920+0000","last_undegraded":"2023-12-07T21:09:35.953920+0000","last_fullsized":"2023-12-07T21:09:35.953920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:00:15.189655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'86","reported_seq":163,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.573178+0000","last_change":"2023-12-07T21:09:00.891723+0000","last_active":"2023-12-07T21:11:06.573178+0000","last_peered":"2023-12-07T21:11:06.573178+0000","last_clean":"2023-12-07T21:11:06.573178+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:11:06.573178+0000","last_undegraded":"2023-12-07T21:11:06.573178+0000","last_fullsized":"2023-12-07T21:11:06.573178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:57.364445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942210+0000","last_change":"2023-12-07T21:09:02.898050+0000","last_active":"2023-12-07T21:09:35.942210+0000","last_peered":"2023-12-07T21:09:35.942210+0000","last_clean":"2023-12-07T21:09:35.942210+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:09:35.942210+0000","last_undegraded":"2023-12-07T21:09:35.942210+0000","last_fullsized":"2023-12-07T21:09:35.942210+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:11:07.330523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943933+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:09:34.943933+0000","last_peered":"2023-12-07T21:09:34.943933+0000","last_clean":"2023-12-07T21:09:34.943933+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:09:34.943933+0000","last_undegraded":"2023-12-07T21:09:34.943933+0000","last_fullsized":"2023-12-07T21:09:34.943933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:45.830742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943689+0000","last_change":"2023-12-07T21:09:04.926451+0000","last_active":"2023-12-07T21:09:34.943689+0000","last_peered":"2023-12-07T21:09:34.943689+0000","last_clean":"2023-12-07T21:09:34.943689+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:09:34.943689+0000","last_undegraded":"2023-12-07T21:09:34.943689+0000","last_fullsized":"2023-12-07T21:09:34.943689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:53:00.049486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943172+0000","last_change":"2023-12-07T21:08:56.877160+0000","last_active":"2023-12-07T21:09:34.943172+0000","last_peered":"2023-12-07T21:09:34.943172+0000","last_clean":"2023-12-07T21:09:34.943172+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:09:34.943172+0000","last_undegraded":"2023-12-07T21:09:34.943172+0000","last_fullsized":"2023-12-07T21:09:34.943172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:20.598365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947455+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:09:34.947455+0000","last_peered":"2023-12-07T21:09:34.947455+0000","last_clean":"2023-12-07T21:09:34.947455+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:09:34.947455+0000","last_undegraded":"2023-12-07T21:09:34.947455+0000","last_fullsized":"2023-12-07T21:09:34.947455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:24.731856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938592+0000","last_change":"2023-12-07T21:08:58.876828+0000","last_active":"2023-12-07T21:09:34.938592+0000","last_peered":"2023-12-07T21:09:34.938592+0000","last_clean":"2023-12-07T21:09:34.938592+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:09:34.938592+0000","last_undegraded":"2023-12-07T21:09:34.938592+0000","last_fullsized":"2023-12-07T21:09:34.938592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:25:18.167316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'33","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.510761+0000","last_change":"2023-12-07T21:09:00.893775+0000","last_active":"2023-12-07T21:11:06.510761+0000","last_peered":"2023-12-07T21:11:06.510761+0000","last_clean":"2023-12-07T21:11:06.510761+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:06.510761+0000","last_undegraded":"2023-12-07T21:11:06.510761+0000","last_fullsized":"2023-12-07T21:11:06.510761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:36:18.746987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945519+0000","last_change":"2023-12-07T21:09:02.907875+0000","last_active":"2023-12-07T21:09:34.945519+0000","last_peered":"2023-12-07T21:09:34.945519+0000","last_clean":"2023-12-07T21:09:34.945519+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:09:34.945519+0000","last_undegraded":"2023-12-07T21:09:34.945519+0000","last_fullsized":"2023-12-07T21:09:34.945519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:44:51.015892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943049+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:09:35.943049+0000","last_peered":"2023-12-07T21:09:35.943049+0000","last_clean":"2023-12-07T21:09:35.943049+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:09:35.943049+0000","last_undegraded":"2023-12-07T21:09:35.943049+0000","last_fullsized":"2023-12-07T21:09:35.943049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:13:50.090324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937989+0000","last_change":"2023-12-07T21:08:56.879187+0000","last_active":"2023-12-07T21:09:34.937989+0000","last_peered":"2023-12-07T21:09:34.937989+0000","last_clean":"2023-12-07T21:09:34.937989+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:09:34.937989+0000","last_undegraded":"2023-12-07T21:09:34.937989+0000","last_fullsized":"2023-12-07T21:09:34.937989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:59.855922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943278+0000","last_change":"2023-12-07T21:08:54.880755+0000","last_active":"2023-12-07T21:09:34.943278+0000","last_peered":"2023-12-07T21:09:34.943278+0000","last_clean":"2023-12-07T21:09:34.943278+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:09:34.943278+0000","last_undegraded":"2023-12-07T21:09:34.943278+0000","last_fullsized":"2023-12-07T21:09:34.943278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947289+0000","last_change":"2023-12-07T21:08:58.882787+0000","last_active":"2023-12-07T21:09:34.947289+0000","last_peered":"2023-12-07T21:09:34.947289+0000","last_clean":"2023-12-07T21:09:34.947289+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:09:34.947289+0000","last_undegraded":"2023-12-07T21:09:34.947289+0000","last_fullsized":"2023-12-07T21:09:34.947289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:04:04.292611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:12.139450+0000","last_change":"2023-12-07T21:09:00.886499+0000","last_active":"2023-12-07T21:10:12.139450+0000","last_peered":"2023-12-07T21:10:12.139450+0000","last_clean":"2023-12-07T21:10:12.139450+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:10:12.139450+0000","last_undegraded":"2023-12-07T21:10:12.139450+0000","last_fullsized":"2023-12-07T21:10:12.139450+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:11.283059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942852+0000","last_change":"2023-12-07T21:09:02.906677+0000","last_active":"2023-12-07T21:09:34.942852+0000","last_peered":"2023-12-07T21:09:34.942852+0000","last_clean":"2023-12-07T21:09:34.942852+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:09:34.942852+0000","last_undegraded":"2023-12-07T21:09:34.942852+0000","last_fullsized":"2023-12-07T21:09:34.942852+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:00.642632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944148+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:09:34.944148+0000","last_peered":"2023-12-07T21:09:34.944148+0000","last_clean":"2023-12-07T21:09:34.944148+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:09:34.944148+0000","last_undegraded":"2023-12-07T21:09:34.944148+0000","last_fullsized":"2023-12-07T21:09:34.944148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:03.100674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149349+0000","last_change":"2023-12-07T21:08:56.874712+0000","last_active":"2023-12-07T21:10:59.149349+0000","last_peered":"2023-12-07T21:10:59.149349+0000","last_clean":"2023-12-07T21:10:59.149349+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:10:59.149349+0000","last_undegraded":"2023-12-07T21:10:59.149349+0000","last_fullsized":"2023-12-07T21:10:59.149349+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:49:20.598365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945370+0000","last_change":"2023-12-07T21:08:54.885182+0000","last_active":"2023-12-07T21:09:34.945370+0000","last_peered":"2023-12-07T21:09:34.945370+0000","last_clean":"2023-12-07T21:09:34.945370+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:09:34.945370+0000","last_undegraded":"2023-12-07T21:09:34.945370+0000","last_fullsized":"2023-12-07T21:09:34.945370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:25:26.381861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942456+0000","last_change":"2023-12-07T21:08:58.873698+0000","last_active":"2023-12-07T21:09:34.942456+0000","last_peered":"2023-12-07T21:09:34.942456+0000","last_clean":"2023-12-07T21:09:34.942456+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:09:34.942456+0000","last_undegraded":"2023-12-07T21:09:34.942456+0000","last_fullsized":"2023-12-07T21:09:34.942456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:28:17.747275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'37","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.575505+0000","last_change":"2023-12-07T21:09:00.892175+0000","last_active":"2023-12-07T21:11:06.575505+0000","last_peered":"2023-12-07T21:11:06.575505+0000","last_clean":"2023-12-07T21:11:06.575505+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:06.575505+0000","last_undegraded":"2023-12-07T21:11:06.575505+0000","last_fullsized":"2023-12-07T21:11:06.575505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:29.403881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937776+0000","last_change":"2023-12-07T21:09:02.900618+0000","last_active":"2023-12-07T21:09:34.937776+0000","last_peered":"2023-12-07T21:09:34.937776+0000","last_clean":"2023-12-07T21:09:34.937776+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:09:34.937776+0000","last_undegraded":"2023-12-07T21:09:34.937776+0000","last_fullsized":"2023-12-07T21:09:34.937776+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:00.871254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948117+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:09:34.948117+0000","last_peered":"2023-12-07T21:09:34.948117+0000","last_clean":"2023-12-07T21:09:34.948117+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:09:34.948117+0000","last_undegraded":"2023-12-07T21:09:34.948117+0000","last_fullsized":"2023-12-07T21:09:34.948117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:37:58.338488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944992+0000","last_change":"2023-12-07T21:08:56.887184+0000","last_active":"2023-12-07T21:09:34.944992+0000","last_peered":"2023-12-07T21:09:34.944992+0000","last_clean":"2023-12-07T21:09:34.944992+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:09:34.944992+0000","last_undegraded":"2023-12-07T21:09:34.944992+0000","last_fullsized":"2023-12-07T21:09:34.944992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:42:07.266252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939265+0000","last_change":"2023-12-07T21:08:54.878542+0000","last_active":"2023-12-07T21:09:34.939265+0000","last_peered":"2023-12-07T21:09:34.939265+0000","last_clean":"2023-12-07T21:09:34.939265+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:09:34.939265+0000","last_undegraded":"2023-12-07T21:09:34.939265+0000","last_fullsized":"2023-12-07T21:09:34.939265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944756+0000","last_change":"2023-12-07T21:08:58.878455+0000","last_active":"2023-12-07T21:09:34.944756+0000","last_peered":"2023-12-07T21:09:34.944756+0000","last_clean":"2023-12-07T21:09:34.944756+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:09:34.944756+0000","last_undegraded":"2023-12-07T21:09:34.944756+0000","last_fullsized":"2023-12-07T21:09:34.944756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:39.792516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'31","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.566493+0000","last_change":"2023-12-07T21:09:00.885534+0000","last_active":"2023-12-07T21:11:06.566493+0000","last_peered":"2023-12-07T21:11:06.566493+0000","last_clean":"2023-12-07T21:11:06.566493+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:06.566493+0000","last_undegraded":"2023-12-07T21:11:06.566493+0000","last_fullsized":"2023-12-07T21:11:06.566493+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:07.128867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942727+0000","last_change":"2023-12-07T21:09:02.899870+0000","last_active":"2023-12-07T21:09:34.942727+0000","last_peered":"2023-12-07T21:09:34.942727+0000","last_clean":"2023-12-07T21:09:34.942727+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:09:34.942727+0000","last_undegraded":"2023-12-07T21:09:34.942727+0000","last_fullsized":"2023-12-07T21:09:34.942727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:59.584704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946337+0000","last_change":"2023-12-07T21:08:56.873185+0000","last_active":"2023-12-07T21:09:35.946337+0000","last_peered":"2023-12-07T21:09:35.946337+0000","last_clean":"2023-12-07T21:09:35.946337+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:09:35.946337+0000","last_undegraded":"2023-12-07T21:09:35.946337+0000","last_fullsized":"2023-12-07T21:09:35.946337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:03:50.236571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944921+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:09:34.944921+0000","last_peered":"2023-12-07T21:09:34.944921+0000","last_clean":"2023-12-07T21:09:34.944921+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:09:34.944921+0000","last_undegraded":"2023-12-07T21:09:34.944921+0000","last_fullsized":"2023-12-07T21:09:34.944921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:44:52.381066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944424+0000","last_change":"2023-12-07T21:08:58.879555+0000","last_active":"2023-12-07T21:09:35.944424+0000","last_peered":"2023-12-07T21:09:35.944424+0000","last_clean":"2023-12-07T21:09:35.944424+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:09:35.944424+0000","last_undegraded":"2023-12-07T21:09:35.944424+0000","last_fullsized":"2023-12-07T21:09:35.944424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:05.118535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'56","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.563607+0000","last_change":"2023-12-07T21:09:00.886089+0000","last_active":"2023-12-07T21:11:06.563607+0000","last_peered":"2023-12-07T21:11:06.563607+0000","last_clean":"2023-12-07T21:11:06.563607+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:06.563607+0000","last_undegraded":"2023-12-07T21:11:06.563607+0000","last_fullsized":"2023-12-07T21:11:06.563607+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:58.629575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942969+0000","last_change":"2023-12-07T21:09:02.900412+0000","last_active":"2023-12-07T21:09:34.942969+0000","last_peered":"2023-12-07T21:09:34.942969+0000","last_clean":"2023-12-07T21:09:34.942969+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:09:34.942969+0000","last_undegraded":"2023-12-07T21:09:34.942969+0000","last_fullsized":"2023-12-07T21:09:34.942969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:16:17.076025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.282119+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:10:18.282119+0000","last_peered":"2023-12-07T21:10:18.282119+0000","last_clean":"2023-12-07T21:10:18.282119+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:10:18.282119+0000","last_undegraded":"2023-12-07T21:10:18.282119+0000","last_fullsized":"2023-12-07T21:10:18.282119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:27:03.815279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149298+0000","last_change":"2023-12-07T21:08:56.877115+0000","last_active":"2023-12-07T21:10:59.149298+0000","last_peered":"2023-12-07T21:10:59.149298+0000","last_clean":"2023-12-07T21:10:59.149298+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:10:59.149298+0000","last_undegraded":"2023-12-07T21:10:59.149298+0000","last_fullsized":"2023-12-07T21:10:59.149298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:47.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937462+0000","last_change":"2023-12-07T21:08:54.882363+0000","last_active":"2023-12-07T21:09:34.937462+0000","last_peered":"2023-12-07T21:09:34.937462+0000","last_clean":"2023-12-07T21:09:34.937462+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:09:34.937462+0000","last_undegraded":"2023-12-07T21:09:34.937462+0000","last_fullsized":"2023-12-07T21:09:34.937462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:47:51.435614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.954233+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:09:35.954233+0000","last_peered":"2023-12-07T21:09:35.954233+0000","last_clean":"2023-12-07T21:09:35.954233+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:09:35.954233+0000","last_undegraded":"2023-12-07T21:09:35.954233+0000","last_fullsized":"2023-12-07T21:09:35.954233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:01:20.045494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'37","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.569443+0000","last_change":"2023-12-07T21:09:00.887309+0000","last_active":"2023-12-07T21:11:06.569443+0000","last_peered":"2023-12-07T21:11:06.569443+0000","last_clean":"2023-12-07T21:11:06.569443+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:11:06.569443+0000","last_undegraded":"2023-12-07T21:11:06.569443+0000","last_fullsized":"2023-12-07T21:11:06.569443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:31:21.189550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938397+0000","last_change":"2023-12-07T21:09:02.907306+0000","last_active":"2023-12-07T21:09:34.938397+0000","last_peered":"2023-12-07T21:09:34.938397+0000","last_clean":"2023-12-07T21:09:34.938397+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:09:34.938397+0000","last_undegraded":"2023-12-07T21:09:34.938397+0000","last_fullsized":"2023-12-07T21:09:34.938397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:58:03.235109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944816+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:09:34.944816+0000","last_peered":"2023-12-07T21:09:34.944816+0000","last_clean":"2023-12-07T21:09:34.944816+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:09:34.944816+0000","last_undegraded":"2023-12-07T21:09:34.944816+0000","last_fullsized":"2023-12-07T21:09:34.944816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:45:57.610751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.028328+0000","last_change":"2023-12-07T21:08:56.885223+0000","last_active":"2023-12-07T21:09:37.028328+0000","last_peered":"2023-12-07T21:09:37.028328+0000","last_clean":"2023-12-07T21:09:37.028328+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:09:37.028328+0000","last_undegraded":"2023-12-07T21:09:37.028328+0000","last_fullsized":"2023-12-07T21:09:37.028328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:16:11.046160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.937906+0000","last_change":"2023-12-07T21:08:54.887587+0000","last_active":"2023-12-07T21:09:34.937906+0000","last_peered":"2023-12-07T21:09:34.937906+0000","last_clean":"2023-12-07T21:09:34.937906+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:09:34.937906+0000","last_undegraded":"2023-12-07T21:09:34.937906+0000","last_fullsized":"2023-12-07T21:09:34.937906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:59:02.534482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943211+0000","last_change":"2023-12-07T21:08:58.876479+0000","last_active":"2023-12-07T21:09:34.943211+0000","last_peered":"2023-12-07T21:09:34.943211+0000","last_clean":"2023-12-07T21:09:34.943211+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:09:34.943211+0000","last_undegraded":"2023-12-07T21:09:34.943211+0000","last_fullsized":"2023-12-07T21:09:34.943211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:37.048767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'34","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.523500+0000","last_change":"2023-12-07T21:09:00.890134+0000","last_active":"2023-12-07T21:11:06.523500+0000","last_peered":"2023-12-07T21:11:06.523500+0000","last_clean":"2023-12-07T21:11:06.523500+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:06.523500+0000","last_undegraded":"2023-12-07T21:11:06.523500+0000","last_fullsized":"2023-12-07T21:11:06.523500+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:16:19.609643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943191+0000","last_change":"2023-12-07T21:09:02.901229+0000","last_active":"2023-12-07T21:09:35.943191+0000","last_peered":"2023-12-07T21:09:35.943191+0000","last_clean":"2023-12-07T21:09:35.943191+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:09:35.943191+0000","last_undegraded":"2023-12-07T21:09:35.943191+0000","last_fullsized":"2023-12-07T21:09:35.943191+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:35.272324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.728070+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:10:18.728070+0000","last_peered":"2023-12-07T21:10:18.728070+0000","last_clean":"2023-12-07T21:10:18.728070+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:10:18.728070+0000","last_undegraded":"2023-12-07T21:10:18.728070+0000","last_fullsized":"2023-12-07T21:10:18.728070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:13:44.983457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.149269+0000","last_change":"2023-12-07T21:08:56.872465+0000","last_active":"2023-12-07T21:10:59.149269+0000","last_peered":"2023-12-07T21:10:59.149269+0000","last_clean":"2023-12-07T21:10:59.149269+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:10:59.149269+0000","last_undegraded":"2023-12-07T21:10:59.149269+0000","last_fullsized":"2023-12-07T21:10:59.149269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:46.057644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945674+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:09:34.945674+0000","last_peered":"2023-12-07T21:09:34.945674+0000","last_clean":"2023-12-07T21:09:34.945674+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:09:34.945674+0000","last_undegraded":"2023-12-07T21:09:34.945674+0000","last_fullsized":"2023-12-07T21:09:34.945674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:27.280985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.940467+0000","last_change":"2023-12-07T21:08:58.875630+0000","last_active":"2023-12-07T21:09:34.940467+0000","last_peered":"2023-12-07T21:09:34.940467+0000","last_clean":"2023-12-07T21:09:34.940467+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:09:34.940467+0000","last_undegraded":"2023-12-07T21:09:34.940467+0000","last_fullsized":"2023-12-07T21:09:34.940467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:16.106436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944106+0000","last_change":"2023-12-07T21:09:00.896323+0000","last_active":"2023-12-07T21:09:35.944106+0000","last_peered":"2023-12-07T21:09:35.944106+0000","last_clean":"2023-12-07T21:09:35.944106+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:09:35.944106+0000","last_undegraded":"2023-12-07T21:09:35.944106+0000","last_fullsized":"2023-12-07T21:09:35.944106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:28:31.952243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":315,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.579180+0000","last_change":"2023-12-07T21:09:02.908092+0000","last_active":"2023-12-07T21:11:06.579180+0000","last_peered":"2023-12-07T21:11:06.579180+0000","last_clean":"2023-12-07T21:11:06.579180+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:06.579180+0000","last_undegraded":"2023-12-07T21:11:06.579180+0000","last_fullsized":"2023-12-07T21:11:06.579180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:04:20.531570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944255+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:09:34.944255+0000","last_peered":"2023-12-07T21:09:34.944255+0000","last_clean":"2023-12-07T21:09:34.944255+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:09:34.944255+0000","last_undegraded":"2023-12-07T21:09:34.944255+0000","last_fullsized":"2023-12-07T21:09:34.944255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:14:35.831401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943322+0000","last_change":"2023-12-07T21:08:56.871124+0000","last_active":"2023-12-07T21:09:34.943322+0000","last_peered":"2023-12-07T21:09:34.943322+0000","last_clean":"2023-12-07T21:09:34.943322+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:09:34.943322+0000","last_undegraded":"2023-12-07T21:09:34.943322+0000","last_fullsized":"2023-12-07T21:09:34.943322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:26.744258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939061+0000","last_change":"2023-12-07T21:08:54.876774+0000","last_active":"2023-12-07T21:09:34.939061+0000","last_peered":"2023-12-07T21:09:34.939061+0000","last_clean":"2023-12-07T21:09:34.939061+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:09:34.939061+0000","last_undegraded":"2023-12-07T21:09:34.939061+0000","last_fullsized":"2023-12-07T21:09:34.939061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938263+0000","last_change":"2023-12-07T21:08:58.876085+0000","last_active":"2023-12-07T21:09:34.938263+0000","last_peered":"2023-12-07T21:09:34.938263+0000","last_clean":"2023-12-07T21:09:34.938263+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:09:34.938263+0000","last_undegraded":"2023-12-07T21:09:34.938263+0000","last_fullsized":"2023-12-07T21:09:34.938263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:57:40.595735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'37","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.540925+0000","last_change":"2023-12-07T21:09:00.892353+0000","last_active":"2023-12-07T21:11:06.540925+0000","last_peered":"2023-12-07T21:11:06.540925+0000","last_clean":"2023-12-07T21:11:06.540925+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:06.540925+0000","last_undegraded":"2023-12-07T21:11:06.540925+0000","last_fullsized":"2023-12-07T21:11:06.540925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:49:39.408633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943238+0000","last_change":"2023-12-07T21:09:02.906845+0000","last_active":"2023-12-07T21:09:34.943238+0000","last_peered":"2023-12-07T21:09:34.943238+0000","last_clean":"2023-12-07T21:09:34.943238+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:09:34.943238+0000","last_undegraded":"2023-12-07T21:09:34.943238+0000","last_fullsized":"2023-12-07T21:09:34.943238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:15:13.485261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939444+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:09:34.939444+0000","last_peered":"2023-12-07T21:09:34.939444+0000","last_clean":"2023-12-07T21:09:34.939444+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:09:34.939444+0000","last_undegraded":"2023-12-07T21:09:34.939444+0000","last_fullsized":"2023-12-07T21:09:34.939444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:13:50.090324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.942745+0000","last_change":"2023-12-07T21:08:56.870984+0000","last_active":"2023-12-07T21:09:34.942745+0000","last_peered":"2023-12-07T21:09:34.942745+0000","last_clean":"2023-12-07T21:09:34.942745+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:09:34.942745+0000","last_undegraded":"2023-12-07T21:09:34.942745+0000","last_fullsized":"2023-12-07T21:09:34.942745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:19.739101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948342+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:09:34.948342+0000","last_peered":"2023-12-07T21:09:34.948342+0000","last_clean":"2023-12-07T21:09:34.948342+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:09:34.948342+0000","last_undegraded":"2023-12-07T21:09:34.948342+0000","last_fullsized":"2023-12-07T21:09:34.948342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:17.726699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943410+0000","last_change":"2023-12-07T21:08:58.881984+0000","last_active":"2023-12-07T21:09:34.943410+0000","last_peered":"2023-12-07T21:09:34.943410+0000","last_clean":"2023-12-07T21:09:34.943410+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:09:34.943410+0000","last_undegraded":"2023-12-07T21:09:34.943410+0000","last_fullsized":"2023-12-07T21:09:34.943410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:53.311660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'31","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.544779+0000","last_change":"2023-12-07T21:09:00.894601+0000","last_active":"2023-12-07T21:11:06.544779+0000","last_peered":"2023-12-07T21:11:06.544779+0000","last_clean":"2023-12-07T21:11:06.544779+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:06.544779+0000","last_undegraded":"2023-12-07T21:11:06.544779+0000","last_fullsized":"2023-12-07T21:11:06.544779+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:18.116768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.944508+0000","last_change":"2023-12-07T21:09:02.907688+0000","last_active":"2023-12-07T21:09:34.944508+0000","last_peered":"2023-12-07T21:09:34.944508+0000","last_clean":"2023-12-07T21:09:34.944508+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:09:34.944508+0000","last_undegraded":"2023-12-07T21:09:34.944508+0000","last_fullsized":"2023-12-07T21:09:34.944508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:45.243063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.096317+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:10:13.096317+0000","last_peered":"2023-12-07T21:10:13.096317+0000","last_clean":"2023-12-07T21:10:13.096317+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:10:13.096317+0000","last_undegraded":"2023-12-07T21:10:13.096317+0000","last_fullsized":"2023-12-07T21:10:13.096317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:30:05.746781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.608964+0000","last_change":"2023-12-07T21:08:56.873059+0000","last_active":"2023-12-07T21:09:36.608964+0000","last_peered":"2023-12-07T21:09:36.608964+0000","last_clean":"2023-12-07T21:09:36.608964+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:09:36.608964+0000","last_undegraded":"2023-12-07T21:09:36.608964+0000","last_fullsized":"2023-12-07T21:09:36.608964+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:17:57.351679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.429429+0000","last_change":"2023-12-07T21:08:54.890887+0000","last_active":"2023-12-07T21:10:18.429429+0000","last_peered":"2023-12-07T21:10:18.429429+0000","last_clean":"2023-12-07T21:10:18.429429+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:10:18.429429+0000","last_undegraded":"2023-12-07T21:10:18.429429+0000","last_fullsized":"2023-12-07T21:10:18.429429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:13.003654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938058+0000","last_change":"2023-12-07T21:08:58.878440+0000","last_active":"2023-12-07T21:09:34.938058+0000","last_peered":"2023-12-07T21:09:34.938058+0000","last_clean":"2023-12-07T21:09:34.938058+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:09:34.938058+0000","last_undegraded":"2023-12-07T21:09:34.938058+0000","last_fullsized":"2023-12-07T21:09:34.938058+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:17:59.358154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'27","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.516385+0000","last_change":"2023-12-07T21:09:00.889913+0000","last_active":"2023-12-07T21:11:06.516385+0000","last_peered":"2023-12-07T21:11:06.516385+0000","last_clean":"2023-12-07T21:11:06.516385+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:11:06.516385+0000","last_undegraded":"2023-12-07T21:11:06.516385+0000","last_fullsized":"2023-12-07T21:11:06.516385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:30.350522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945073+0000","last_change":"2023-12-07T21:09:02.906202+0000","last_active":"2023-12-07T21:09:34.945073+0000","last_peered":"2023-12-07T21:09:34.945073+0000","last_clean":"2023-12-07T21:09:34.945073+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:09:34.945073+0000","last_undegraded":"2023-12-07T21:09:34.945073+0000","last_fullsized":"2023-12-07T21:09:34.945073+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:45:43.263341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.139472+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:10:59.139472+0000","last_peered":"2023-12-07T21:10:59.139472+0000","last_clean":"2023-12-07T21:10:59.139472+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:10:59.139472+0000","last_undegraded":"2023-12-07T21:10:59.139472+0000","last_fullsized":"2023-12-07T21:10:59.139472+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:54:20.029030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'13","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737703+0000","last_change":"2023-12-07T21:08:56.869733+0000","last_active":"2023-12-07T21:10:18.737703+0000","last_peered":"2023-12-07T21:10:18.737703+0000","last_clean":"2023-12-07T21:10:18.737703+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:10:18.737703+0000","last_undegraded":"2023-12-07T21:10:18.737703+0000","last_fullsized":"2023-12-07T21:10:18.737703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:52.850966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.951401+0000","last_change":"2023-12-07T21:08:54.878825+0000","last_active":"2023-12-07T21:09:35.951401+0000","last_peered":"2023-12-07T21:09:35.951401+0000","last_clean":"2023-12-07T21:09:35.951401+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:09:35.951401+0000","last_undegraded":"2023-12-07T21:09:35.951401+0000","last_fullsized":"2023-12-07T21:09:35.951401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:50.080564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'6","reported_seq":113,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.935730+0000","last_change":"2023-12-07T21:08:58.877654+0000","last_active":"2023-12-07T21:10:59.935730+0000","last_peered":"2023-12-07T21:10:59.935730+0000","last_clean":"2023-12-07T21:10:59.935730+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:10:59.935730+0000","last_undegraded":"2023-12-07T21:10:59.935730+0000","last_fullsized":"2023-12-07T21:10:59.935730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:46:29.005775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.525399+0000","last_change":"2023-12-07T21:09:00.887872+0000","last_active":"2023-12-07T21:11:06.525399+0000","last_peered":"2023-12-07T21:11:06.525399+0000","last_clean":"2023-12-07T21:11:06.525399+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:11:06.525399+0000","last_undegraded":"2023-12-07T21:11:06.525399+0000","last_fullsized":"2023-12-07T21:11:06.525399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:24:17.551615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943699+0000","last_change":"2023-12-07T21:09:02.906870+0000","last_active":"2023-12-07T21:09:34.943699+0000","last_peered":"2023-12-07T21:09:34.943699+0000","last_clean":"2023-12-07T21:09:34.943699+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:09:34.943699+0000","last_undegraded":"2023-12-07T21:09:34.943699+0000","last_fullsized":"2023-12-07T21:09:34.943699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:52:58.034650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947166+0000","last_change":"2023-12-07T21:09:04.928655+0000","last_active":"2023-12-07T21:09:34.947166+0000","last_peered":"2023-12-07T21:09:34.947166+0000","last_clean":"2023-12-07T21:09:34.947166+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:09:34.947166+0000","last_undegraded":"2023-12-07T21:09:34.947166+0000","last_fullsized":"2023-12-07T21:09:34.947166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:38.068718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.745772+0000","last_change":"2023-12-07T21:08:56.884246+0000","last_active":"2023-12-07T21:10:18.745772+0000","last_peered":"2023-12-07T21:10:18.745772+0000","last_clean":"2023-12-07T21:10:18.745772+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:10:18.745772+0000","last_undegraded":"2023-12-07T21:10:18.745772+0000","last_fullsized":"2023-12-07T21:10:18.745772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:59:20.004743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941027+0000","last_change":"2023-12-07T21:08:54.888408+0000","last_active":"2023-12-07T21:09:35.941027+0000","last_peered":"2023-12-07T21:09:35.941027+0000","last_clean":"2023-12-07T21:09:35.941027+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:09:35.941027+0000","last_undegraded":"2023-12-07T21:09:35.941027+0000","last_fullsized":"2023-12-07T21:09:35.941027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:47:51.435614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.366375+0000","last_change":"2023-12-07T21:08:56.873286+0000","last_active":"2023-12-07T21:09:36.366375+0000","last_peered":"2023-12-07T21:09:36.366375+0000","last_clean":"2023-12-07T21:09:36.366375+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:09:36.366375+0000","last_undegraded":"2023-12-07T21:09:36.366375+0000","last_fullsized":"2023-12-07T21:09:36.366375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:46.957293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941789+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:09:35.941789+0000","last_peered":"2023-12-07T21:09:35.941789+0000","last_clean":"2023-12-07T21:09:35.941789+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:09:35.941789+0000","last_undegraded":"2023-12-07T21:09:35.941789+0000","last_fullsized":"2023-12-07T21:09:35.941789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:55.908674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173387+0000","last_change":"2023-12-07T21:08:56.874905+0000","last_active":"2023-12-07T21:10:59.173387+0000","last_peered":"2023-12-07T21:10:59.173387+0000","last_clean":"2023-12-07T21:10:59.173387+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:10:59.173387+0000","last_undegraded":"2023-12-07T21:10:59.173387+0000","last_fullsized":"2023-12-07T21:10:59.173387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:44:54.612768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942708+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:09:35.942708+0000","last_peered":"2023-12-07T21:09:35.942708+0000","last_clean":"2023-12-07T21:09:35.942708+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:09:35.942708+0000","last_undegraded":"2023-12-07T21:09:35.942708+0000","last_fullsized":"2023-12-07T21:09:35.942708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:08:13.065644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943005+0000","last_change":"2023-12-07T21:08:56.872273+0000","last_active":"2023-12-07T21:09:35.943005+0000","last_peered":"2023-12-07T21:09:35.943005+0000","last_clean":"2023-12-07T21:09:35.943005+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:09:35.943005+0000","last_undegraded":"2023-12-07T21:09:35.943005+0000","last_fullsized":"2023-12-07T21:09:35.943005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:23:50.983783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942688+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:09:35.942688+0000","last_peered":"2023-12-07T21:09:35.942688+0000","last_clean":"2023-12-07T21:09:35.942688+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:09:35.942688+0000","last_undegraded":"2023-12-07T21:09:35.942688+0000","last_fullsized":"2023-12-07T21:09:35.942688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:46:55.783329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942566+0000","last_change":"2023-12-07T21:08:56.876070+0000","last_active":"2023-12-07T21:09:35.942566+0000","last_peered":"2023-12-07T21:09:35.942566+0000","last_clean":"2023-12-07T21:09:35.942566+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:09:35.942566+0000","last_undegraded":"2023-12-07T21:09:35.942566+0000","last_fullsized":"2023-12-07T21:09:35.942566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:37:19.739101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943127+0000","last_change":"2023-12-07T21:08:54.874578+0000","last_active":"2023-12-07T21:09:35.943127+0000","last_peered":"2023-12-07T21:09:35.943127+0000","last_clean":"2023-12-07T21:09:35.943127+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:09:35.943127+0000","last_undegraded":"2023-12-07T21:09:35.943127+0000","last_fullsized":"2023-12-07T21:09:35.943127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.366353+0000","last_change":"2023-12-07T21:08:56.883348+0000","last_active":"2023-12-07T21:09:36.366353+0000","last_peered":"2023-12-07T21:09:36.366353+0000","last_clean":"2023-12-07T21:09:36.366353+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:09:36.366353+0000","last_undegraded":"2023-12-07T21:09:36.366353+0000","last_fullsized":"2023-12-07T21:09:36.366353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:38:34.904995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948487+0000","last_change":"2023-12-07T21:08:54.887259+0000","last_active":"2023-12-07T21:09:35.948487+0000","last_peered":"2023-12-07T21:09:35.948487+0000","last_clean":"2023-12-07T21:09:35.948487+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:09:35.948487+0000","last_undegraded":"2023-12-07T21:09:35.948487+0000","last_fullsized":"2023-12-07T21:09:35.948487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:48:10.303695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942527+0000","last_change":"2023-12-07T21:08:56.876299+0000","last_active":"2023-12-07T21:09:35.942527+0000","last_peered":"2023-12-07T21:09:35.942527+0000","last_clean":"2023-12-07T21:09:35.942527+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:09:35.942527+0000","last_undegraded":"2023-12-07T21:09:35.942527+0000","last_fullsized":"2023-12-07T21:09:35.942527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:26.744258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.944829+0000","last_change":"2023-12-07T21:08:54.885457+0000","last_active":"2023-12-07T21:09:35.944829+0000","last_peered":"2023-12-07T21:09:35.944829+0000","last_clean":"2023-12-07T21:09:35.944829+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:09:35.944829+0000","last_undegraded":"2023-12-07T21:09:35.944829+0000","last_fullsized":"2023-12-07T21:09:35.944829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.949262+0000","last_change":"2023-12-07T21:08:56.887101+0000","last_active":"2023-12-07T21:09:35.949262+0000","last_peered":"2023-12-07T21:09:35.949262+0000","last_clean":"2023-12-07T21:09:35.949262+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:09:35.949262+0000","last_undegraded":"2023-12-07T21:09:35.949262+0000","last_fullsized":"2023-12-07T21:09:35.949262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.943607+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:09:35.943607+0000","last_peered":"2023-12-07T21:09:35.943607+0000","last_clean":"2023-12-07T21:09:35.943607+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:09:35.943607+0000","last_undegraded":"2023-12-07T21:09:35.943607+0000","last_fullsized":"2023-12-07T21:09:35.943607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:22:59.087021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.939689+0000","last_change":"2023-12-07T21:08:56.882240+0000","last_active":"2023-12-07T21:09:34.939689+0000","last_peered":"2023-12-07T21:09:34.939689+0000","last_clean":"2023-12-07T21:09:34.939689+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:09:34.939689+0000","last_undegraded":"2023-12-07T21:09:34.939689+0000","last_fullsized":"2023-12-07T21:09:34.939689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:06:24.998742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.946632+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:09:35.946632+0000","last_peered":"2023-12-07T21:09:35.946632+0000","last_clean":"2023-12-07T21:09:35.946632+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:09:35.946632+0000","last_undegraded":"2023-12-07T21:09:35.946632+0000","last_fullsized":"2023-12-07T21:09:35.946632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:18:45.038325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173489+0000","last_change":"2023-12-07T21:08:56.875906+0000","last_active":"2023-12-07T21:10:18.173489+0000","last_peered":"2023-12-07T21:10:18.173489+0000","last_clean":"2023-12-07T21:10:18.173489+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:10:18.173489+0000","last_undegraded":"2023-12-07T21:10:18.173489+0000","last_fullsized":"2023-12-07T21:10:18.173489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:40:40.318522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.582974+0000","last_change":"2023-12-07T21:08:54.883629+0000","last_active":"2023-12-07T21:09:36.582974+0000","last_peered":"2023-12-07T21:09:36.582974+0000","last_clean":"2023-12-07T21:09:36.582974+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:09:36.582974+0000","last_undegraded":"2023-12-07T21:09:36.582974+0000","last_fullsized":"2023-12-07T21:09:36.582974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:35:02.711578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945789+0000","last_change":"2023-12-07T21:08:56.876309+0000","last_active":"2023-12-07T21:09:34.945789+0000","last_peered":"2023-12-07T21:09:34.945789+0000","last_clean":"2023-12-07T21:09:34.945789+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:09:34.945789+0000","last_undegraded":"2023-12-07T21:09:34.945789+0000","last_fullsized":"2023-12-07T21:09:34.945789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:39:29.293388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938005+0000","last_change":"2023-12-07T21:08:54.887130+0000","last_active":"2023-12-07T21:09:34.938005+0000","last_peered":"2023-12-07T21:09:34.938005+0000","last_clean":"2023-12-07T21:09:34.938005+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:09:34.938005+0000","last_undegraded":"2023-12-07T21:09:34.938005+0000","last_fullsized":"2023-12-07T21:09:34.938005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:27:18.078984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.359942+0000","last_change":"2023-12-07T21:08:56.871205+0000","last_active":"2023-12-07T21:09:36.359942+0000","last_peered":"2023-12-07T21:09:36.359942+0000","last_clean":"2023-12-07T21:09:36.359942+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:09:36.359942+0000","last_undegraded":"2023-12-07T21:09:36.359942+0000","last_fullsized":"2023-12-07T21:09:36.359942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:28:15.740800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938315+0000","last_change":"2023-12-07T21:08:54.884013+0000","last_active":"2023-12-07T21:09:34.938315+0000","last_peered":"2023-12-07T21:09:34.938315+0000","last_clean":"2023-12-07T21:09:34.938315+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:09:34.938315+0000","last_undegraded":"2023-12-07T21:09:34.938315+0000","last_fullsized":"2023-12-07T21:09:34.938315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:57.171350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:37.021932+0000","last_change":"2023-12-07T21:08:56.879513+0000","last_active":"2023-12-07T21:09:37.021932+0000","last_peered":"2023-12-07T21:09:37.021932+0000","last_clean":"2023-12-07T21:09:37.021932+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:09:37.021932+0000","last_undegraded":"2023-12-07T21:09:37.021932+0000","last_fullsized":"2023-12-07T21:09:37.021932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:25:46.957293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.947567+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:09:34.947567+0000","last_peered":"2023-12-07T21:09:34.947567+0000","last_clean":"2023-12-07T21:09:34.947567+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:09:34.947567+0000","last_undegraded":"2023-12-07T21:09:34.947567+0000","last_fullsized":"2023-12-07T21:09:34.947567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:20.130565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'15","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.173409+0000","last_change":"2023-12-07T21:08:56.882760+0000","last_active":"2023-12-07T21:10:18.173409+0000","last_peered":"2023-12-07T21:10:18.173409+0000","last_clean":"2023-12-07T21:10:18.173409+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:10:18.173409+0000","last_undegraded":"2023-12-07T21:10:18.173409+0000","last_fullsized":"2023-12-07T21:10:18.173409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:19:53.055254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948503+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:09:34.948503+0000","last_peered":"2023-12-07T21:09:34.948503+0000","last_clean":"2023-12-07T21:09:34.948503+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:09:34.948503+0000","last_undegraded":"2023-12-07T21:09:34.948503+0000","last_fullsized":"2023-12-07T21:09:34.948503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:49:57.843520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.737487+0000","last_change":"2023-12-07T21:08:56.876875+0000","last_active":"2023-12-07T21:10:18.737487+0000","last_peered":"2023-12-07T21:10:18.737487+0000","last_clean":"2023-12-07T21:10:18.737487+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:10:18.737487+0000","last_undegraded":"2023-12-07T21:10:18.737487+0000","last_fullsized":"2023-12-07T21:10:18.737487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:36:53.347638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945653+0000","last_change":"2023-12-07T21:08:54.885432+0000","last_active":"2023-12-07T21:09:34.945653+0000","last_peered":"2023-12-07T21:09:34.945653+0000","last_clean":"2023-12-07T21:09:34.945653+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:09:34.945653+0000","last_undegraded":"2023-12-07T21:09:34.945653+0000","last_fullsized":"2023-12-07T21:09:34.945653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:42:16.009846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.745806+0000","last_change":"2023-12-07T21:08:56.889380+0000","last_active":"2023-12-07T21:10:18.745806+0000","last_peered":"2023-12-07T21:10:18.745806+0000","last_clean":"2023-12-07T21:10:18.745806+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:10:18.745806+0000","last_undegraded":"2023-12-07T21:10:18.745806+0000","last_fullsized":"2023-12-07T21:10:18.745806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:47.826799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.948829+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:09:34.948829+0000","last_peered":"2023-12-07T21:09:34.948829+0000","last_clean":"2023-12-07T21:09:34.948829+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:09:34.948829+0000","last_undegraded":"2023-12-07T21:09:34.948829+0000","last_fullsized":"2023-12-07T21:09:34.948829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:03:45.814396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.945250+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:09:34.945250+0000","last_peered":"2023-12-07T21:09:34.945250+0000","last_clean":"2023-12-07T21:09:34.945250+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:09:34.945250+0000","last_undegraded":"2023-12-07T21:09:34.945250+0000","last_fullsized":"2023-12-07T21:09:34.945250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:24.756037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:36.066771+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:09:36.066771+0000","last_peered":"2023-12-07T21:09:36.066771+0000","last_clean":"2023-12-07T21:09:36.066771+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:09:36.066771+0000","last_undegraded":"2023-12-07T21:09:36.066771+0000","last_fullsized":"2023-12-07T21:09:36.066771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:24:31.362583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.943662+0000","last_change":"2023-12-07T21:08:54.883760+0000","last_active":"2023-12-07T21:09:34.943662+0000","last_peered":"2023-12-07T21:09:34.943662+0000","last_clean":"2023-12-07T21:09:34.943662+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:09:34.943662+0000","last_undegraded":"2023-12-07T21:09:34.943662+0000","last_fullsized":"2023-12-07T21:09:34.943662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:19.113760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-07T21:09:34.938907+0000","last_change":"2023-12-07T21:08:56.881838+0000","last_active":"2023-12-07T21:09:34.938907+0000","last_peered":"2023-12-07T21:09:34.938907+0000","last_clean":"2023-12-07T21:09:34.938907+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:09:34.938907+0000","last_undegraded":"2023-12-07T21:09:34.938907+0000","last_fullsized":"2023-12-07T21:09:34.938907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:29.862000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1968,"ondisk_log_size":1968,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1271,"ondisk_log_size":1271,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705698,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.35099999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54300000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.182},{"interface":"front","average":{"1min":0.435,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.34499999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56899999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.23400000000000001}]},{"osd":1,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34300000000000003,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.44400000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.19400000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52500000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.223},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.247}]}]},{"osd":2,"up_from":9,"seq":38654705697,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33300000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.50800000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.219,"15min":0.219},"max":{"1min":0.58699999999999997,"5min":0.621,"15min":0.621},"last":0.372}]},{"osd":1,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.318,"15min":0.318},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.39100000000000001,"5min":0.436,"15min":0.436},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.247,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.317},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.35099999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705697,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28000000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.182},{"interface":"front","average":{"1min":0.442,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.315}]},{"osd":2,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.23799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.54200000000000004,"5min":0.629,"15min":0.629},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.22900000000000001}]},{"osd":3,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.38},"min":{"1min":0.25900000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.48399999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.29099999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68300000000000005,"5min":0.747,"15min":0.747},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.435},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.38800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:11:10.972 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.973 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.973 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.973 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.973 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.973 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.973 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.974 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.974 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.974 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.974 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.974 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.974 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.975 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.975 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.975 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.975 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.975 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.975 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.976 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.976 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.976 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.976 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.976 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.976 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.976 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.977 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.977 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.977 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.977 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.977 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.977 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.978 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.978 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.978 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.978 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.978 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.978 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.979 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.979 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.979 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.979 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.979 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.979 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.980 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.980 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.980 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.980 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.980 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.980 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.981 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.981 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.981 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.981 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.981 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.981 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.981 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.982 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.982 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.982 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.982 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.982 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.982 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.983 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.983 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.983 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.983 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.983 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.983 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.983 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.984 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.984 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.984 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.984 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.984 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.984 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.985 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.985 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.985 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.985 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.985 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.985 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.985 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.986 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.986 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.986 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.986 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.986 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.986 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.987 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.987 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.987 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.987 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.987 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.987 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.987 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.988 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.988 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.988 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.988 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.988 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.988 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-07T21:08:40.790884+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=40, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.989 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.989 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.989 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.989 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.989 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.989 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.990 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.990 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.990 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.990 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.990 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.990 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.991 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.991 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.991 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.991 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.991 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.991 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.992 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.992 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.992 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.992 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.992 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.992 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.992 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.993 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.993 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.993 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.993 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.993 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.993 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.994 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.994 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.994 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.994 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.994 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.994 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.995 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.995 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.995 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.995 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.995 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.996 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.996 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.996 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.996 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.996 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.996 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.996 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.997 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.997 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.997 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.997 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.997 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.998 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.998 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.998 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.998 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.998 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.998 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.999 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.999 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.999 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.999 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.999 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:10.999 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.000 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.000 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.000 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.000 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.000 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.000 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.001 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.001 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.001 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.001 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.001 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.001 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.001 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.002 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.002 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.002 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.002 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.002 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.002 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.003 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.003 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.003 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.003 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.003 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.003 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.004 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.004 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.004 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.004 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.004 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.004 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.004 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.005 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.005 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.005 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.005 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.005 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.006 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.006 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.006 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.006 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.006 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.006 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.007 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.007 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.007 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.007 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.007 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.007 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.007 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.008 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.008 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.008 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.008 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.008 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.008 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.008 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.009 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.009 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.009 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.009 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.009 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.009 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.009 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.010 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.010 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.010 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.010 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.010 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.010 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.011 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.011 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.011 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.011 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.011 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.011 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.011 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.012 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.012 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.012 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.012 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.012 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.012 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.013 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.013 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.013 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.013 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.013 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.013 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.013 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.014 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.014 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.014 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.014 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.014 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.014 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.014 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:11.015 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:11:31.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:11:31.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.133+0000 7f7a6896c640 1 Processor -- start 2023-12-07T21:11:31.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.133+0000 7f7a6896c640 1 -- start start 2023-12-07T21:11:31.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.134+0000 7f7a6896c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7a6406d3a0 0x7f7a64132ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:31.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.134+0000 7f7a6896c640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6406ea60 con 0x7f7a64097760 2023-12-07T21:11:31.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.134+0000 7f7a6896c640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a64098070 con 0x7f7a6406d3a0 2023-12-07T21:11:31.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.134+0000 7f7a61d9b640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7a6406d3a0 0x7f7a64132ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:31.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.134+0000 7f7a6259c640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7a64097760 0x7f7a6406cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:40584/0 (socket says 172.21.15.89:40584) 2023-12-07T21:11:31.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.134+0000 7f7a6259c640 1 -- 172.21.15.89:0/472590799 learned_addr learned my addr 172.21.15.89:0/472590799 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:31.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.134+0000 7f7a61d9b640 1 -- 172.21.15.89:0/472590799 >> v1:172.21.15.89:6789/0 conn(0x7f7a64097760 legacy=0x7f7a6406cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:31.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.134+0000 7f7a61d9b640 1 -- 172.21.15.89:0/472590799 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6406f330 con 0x7f7a6406d3a0 2023-12-07T21:11:31.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.135+0000 7f7a61d9b640 1 --2- 172.21.15.89:0/472590799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a6406d3a0 0x7f7a64132ca0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009720 tx=0x7f7a4c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f62c7fa3ee3702b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:31.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.135+0000 7f7a6159a640 1 -- 172.21.15.89:0/472590799 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c02e070 con 0x7f7a6406d3a0 2023-12-07T21:11:31.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.135+0000 7f7a6159a640 1 -- 172.21.15.89:0/472590799 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0316d0 con 0x7f7a6406d3a0 2023-12-07T21:11:31.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.135+0000 7f7a6159a640 1 -- 172.21.15.89:0/472590799 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c031990 con 0x7f7a6406d3a0 2023-12-07T21:11:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.136+0000 7f7a6896c640 1 -- 172.21.15.89:0/472590799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a6406d3a0 msgr2=0x7f7a64132ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.136+0000 7f7a6896c640 1 --2- 172.21.15.89:0/472590799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a6406d3a0 0x7f7a64132ca0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009720 tx=0x7f7a4c02b840 comp rx=0 tx=0).stop 2023-12-07T21:11:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.136+0000 7f7a6896c640 1 -- 172.21.15.89:0/472590799 shutdown_connections 2023-12-07T21:11:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.136+0000 7f7a6896c640 1 --2- 172.21.15.89:0/472590799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a6406d3a0 0x7f7a64132ca0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.136+0000 7f7a6896c640 1 -- 172.21.15.89:0/472590799 >> 172.21.15.89:0/472590799 conn(0x7f7a640987f0 msgr2=0x7f7a64098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.136+0000 7f7a6896c640 1 -- 172.21.15.89:0/472590799 shutdown_connections 2023-12-07T21:11:31.131 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.136+0000 7f7a6896c640 1 -- 172.21.15.89:0/472590799 wait complete. 2023-12-07T21:11:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.137+0000 7f7a6896c640 1 Processor -- start 2023-12-07T21:11:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.137+0000 7f7a6896c640 1 -- start start 2023-12-07T21:11:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.137+0000 7f7a6896c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a6406d3a0 0x7f7a64120990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.137+0000 7f7a6896c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a64122d40 con 0x7f7a6406d3a0 2023-12-07T21:11:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.137+0000 7f7a6259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a6406d3a0 0x7f7a64120990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.137+0000 7f7a6259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a6406d3a0 0x7f7a64120990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35840/0 (socket says 172.21.15.89:35840) 2023-12-07T21:11:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.137+0000 7f7a6259c640 1 -- 172.21.15.89:0/2457484275 learned_addr learned my addr 172.21.15.89:0/2457484275 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.138+0000 7f7a6259c640 1 -- 172.21.15.89:0/2457484275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c009400 con 0x7f7a6406d3a0 2023-12-07T21:11:31.132 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.138+0000 7f7a6259c640 1 --2- 172.21.15.89:0/2457484275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a6406d3a0 0x7f7a64120990 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00cb20 tx=0x7f7a5c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.138+0000 7f7a5affd640 1 -- 172.21.15.89:0/2457484275 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c00abf0 con 0x7f7a6406d3a0 2023-12-07T21:11:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.138+0000 7f7a5affd640 1 -- 172.21.15.89:0/2457484275 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c00ad50 con 0x7f7a6406d3a0 2023-12-07T21:11:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.138+0000 7f7a5affd640 1 -- 172.21.15.89:0/2457484275 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a5c012400 con 0x7f7a6406d3a0 2023-12-07T21:11:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.138+0000 7f7a6896c640 1 -- 172.21.15.89:0/2457484275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a64094620 con 0x7f7a6406d3a0 2023-12-07T21:11:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.138+0000 7f7a6896c640 1 -- 172.21.15.89:0/2457484275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a64121c50 con 0x7f7a6406d3a0 2023-12-07T21:11:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.139+0000 7f7a5affd640 1 -- 172.21.15.89:0/2457484275 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7a5c012560 con 0x7f7a6406d3a0 2023-12-07T21:11:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.139+0000 7f7a5affd640 1 --2- 172.21.15.89:0/2457484275 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7a44037820 0x7f7a44039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.139+0000 7f7a5affd640 1 -- 172.21.15.89:0/2457484275 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f7a5c04ab00 con 0x7f7a6406d3a0 2023-12-07T21:11:31.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.139+0000 7f7a6896c640 1 -- 172.21.15.89:0/2457484275 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a64123170 con 0x7f7a6406d3a0 2023-12-07T21:11:31.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.139+0000 7f7a61d9b640 1 --2- 172.21.15.89:0/2457484275 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7a44037820 0x7f7a44039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:31.134 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.140+0000 7f7a61d9b640 1 --2- 172.21.15.89:0/2457484275 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7a44037820 0x7f7a44039ce0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c036000 tx=0x7f7a4c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:31.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.144+0000 7f7a5affd640 1 -- 172.21.15.89:0/2457484275 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7a5c017020 con 0x7f7a6406d3a0 2023-12-07T21:11:31.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.306+0000 7f7a6896c640 1 -- 172.21.15.89:0/2457484275 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a64071b90 con 0x7f7a44037820 2023-12-07T21:11:31.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.321+0000 7f7a5affd640 1 -- 172.21.15.89:0/2457484275 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+664815 (secure 0 0 0) 0x7f7a4c031ba0 con 0x7f7a44037820 2023-12-07T21:11:31.320 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:11:31.325 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:11:31.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.326+0000 7f7a6896c640 1 -- 172.21.15.89:0/2457484275 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7a44037820 msgr2=0x7f7a44039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:31.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.326+0000 7f7a6896c640 1 --2- 172.21.15.89:0/2457484275 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7a44037820 0x7f7a44039ce0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c036000 tx=0x7f7a4c008030 comp rx=0 tx=0).stop 2023-12-07T21:11:31.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.326+0000 7f7a6896c640 1 -- 172.21.15.89:0/2457484275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a6406d3a0 msgr2=0x7f7a64120990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:31.327 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.326+0000 7f7a6896c640 1 --2- 172.21.15.89:0/2457484275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a6406d3a0 0x7f7a64120990 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c00cb20 tx=0x7f7a5c00a060 comp rx=0 tx=0).stop 2023-12-07T21:11:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.326+0000 7f7a6896c640 1 -- 172.21.15.89:0/2457484275 shutdown_connections 2023-12-07T21:11:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.326+0000 7f7a6896c640 1 --2- 172.21.15.89:0/2457484275 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7a44037820 0x7f7a44039ce0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.326+0000 7f7a6896c640 1 --2- 172.21.15.89:0/2457484275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a6406d3a0 0x7f7a64120990 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.326+0000 7f7a6896c640 1 -- 172.21.15.89:0/2457484275 >> 172.21.15.89:0/2457484275 conn(0x7f7a640987f0 msgr2=0x7f7a6408d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.326+0000 7f7a6896c640 1 -- 172.21.15.89:0/2457484275 shutdown_connections 2023-12-07T21:11:31.328 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:31.326+0000 7f7a6896c640 1 -- 172.21.15.89:0/2457484275 wait complete. 2023-12-07T21:11:31.329 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-12-07T21:11:30.096422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3857,"ondisk_log_size":3857,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003578"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807400+0000","last_change":"2023-12-07T21:08:54.882968+0000","last_active":"2023-12-07T21:11:03.807400+0000","last_peered":"2023-12-07T21:11:03.807400+0000","last_clean":"2023-12-07T21:11:03.807400+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:11:03.807400+0000","last_undegraded":"2023-12-07T21:11:03.807400+0000","last_fullsized":"2023-12-07T21:11:03.807400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767028+0000","last_change":"2023-12-07T21:08:56.887127+0000","last_active":"2023-12-07T21:11:09.767028+0000","last_peered":"2023-12-07T21:11:09.767028+0000","last_clean":"2023-12-07T21:11:09.767028+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:11:09.767028+0000","last_undegraded":"2023-12-07T21:11:09.767028+0000","last_fullsized":"2023-12-07T21:11:09.767028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801438+0000","last_change":"2023-12-07T21:08:54.890832+0000","last_active":"2023-12-07T21:11:03.801438+0000","last_peered":"2023-12-07T21:11:03.801438+0000","last_clean":"2023-12-07T21:11:03.801438+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:11:03.801438+0000","last_undegraded":"2023-12-07T21:11:03.801438+0000","last_fullsized":"2023-12-07T21:11:03.801438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:38.784125+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:09:38.784125+0000","last_peered":"2023-12-07T21:09:38.784125+0000","last_clean":"2023-12-07T21:09:38.784125+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:09:38.784125+0000","last_undegraded":"2023-12-07T21:09:38.784125+0000","last_fullsized":"2023-12-07T21:09:38.784125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808550+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:11:03.808550+0000","last_peered":"2023-12-07T21:11:03.808550+0000","last_clean":"2023-12-07T21:11:03.808550+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:11:03.808550+0000","last_undegraded":"2023-12-07T21:11:03.808550+0000","last_fullsized":"2023-12-07T21:11:03.808550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608236+0000","last_change":"2023-12-07T21:08:56.873919+0000","last_active":"2023-12-07T21:11:10.608236+0000","last_peered":"2023-12-07T21:11:10.608236+0000","last_clean":"2023-12-07T21:11:10.608236+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:11:10.608236+0000","last_undegraded":"2023-12-07T21:11:10.608236+0000","last_fullsized":"2023-12-07T21:11:10.608236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.805663+0000","last_change":"2023-12-07T21:08:54.880442+0000","last_active":"2023-12-07T21:10:58.805663+0000","last_peered":"2023-12-07T21:10:58.805663+0000","last_clean":"2023-12-07T21:10:58.805663+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:10:58.805663+0000","last_undegraded":"2023-12-07T21:10:58.805663+0000","last_fullsized":"2023-12-07T21:10:58.805663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608264+0000","last_change":"2023-12-07T21:08:56.874751+0000","last_active":"2023-12-07T21:11:10.608264+0000","last_peered":"2023-12-07T21:11:10.608264+0000","last_clean":"2023-12-07T21:11:10.608264+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:11:10.608264+0000","last_undegraded":"2023-12-07T21:11:10.608264+0000","last_fullsized":"2023-12-07T21:11:10.608264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607907+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:11:10.607907+0000","last_peered":"2023-12-07T21:11:10.607907+0000","last_clean":"2023-12-07T21:11:10.607907+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:11:10.607907+0000","last_undegraded":"2023-12-07T21:11:10.607907+0000","last_fullsized":"2023-12-07T21:11:10.607907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173605+0000","last_change":"2023-12-07T21:08:56.873414+0000","last_active":"2023-12-07T21:10:59.173605+0000","last_peered":"2023-12-07T21:10:59.173605+0000","last_clean":"2023-12-07T21:10:59.173605+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:10:59.173605+0000","last_undegraded":"2023-12-07T21:10:59.173605+0000","last_fullsized":"2023-12-07T21:10:59.173605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187656+0000","last_change":"2023-12-07T21:08:54.880274+0000","last_active":"2023-12-07T21:11:10.187656+0000","last_peered":"2023-12-07T21:11:10.187656+0000","last_clean":"2023-12-07T21:11:10.187656+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:11:10.187656+0000","last_undegraded":"2023-12-07T21:11:10.187656+0000","last_fullsized":"2023-12-07T21:11:10.187656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.427026+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:10:18.427026+0000","last_peered":"2023-12-07T21:10:18.427026+0000","last_clean":"2023-12-07T21:10:18.427026+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:10:18.427026+0000","last_undegraded":"2023-12-07T21:10:18.427026+0000","last_fullsized":"2023-12-07T21:10:18.427026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607886+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:11:10.607886+0000","last_peered":"2023-12-07T21:11:10.607886+0000","last_clean":"2023-12-07T21:11:10.607886+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:11:10.607886+0000","last_undegraded":"2023-12-07T21:11:10.607886+0000","last_fullsized":"2023-12-07T21:11:10.607886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807323+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:11:03.807323+0000","last_peered":"2023-12-07T21:11:03.807323+0000","last_clean":"2023-12-07T21:11:03.807323+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:11:03.807323+0000","last_undegraded":"2023-12-07T21:11:03.807323+0000","last_fullsized":"2023-12-07T21:11:03.807323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345133+0000","last_change":"2023-12-07T21:08:54.891021+0000","last_active":"2023-12-07T21:11:09.345133+0000","last_peered":"2023-12-07T21:11:09.345133+0000","last_clean":"2023-12-07T21:11:09.345133+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:11:09.345133+0000","last_undegraded":"2023-12-07T21:11:09.345133+0000","last_fullsized":"2023-12-07T21:11:09.345133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'13","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807362+0000","last_change":"2023-12-07T21:08:56.874321+0000","last_active":"2023-12-07T21:11:03.807362+0000","last_peered":"2023-12-07T21:11:03.807362+0000","last_clean":"2023-12-07T21:11:03.807362+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:11:03.807362+0000","last_undegraded":"2023-12-07T21:11:03.807362+0000","last_fullsized":"2023-12-07T21:11:03.807362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608172+0000","last_change":"2023-12-07T21:08:56.874409+0000","last_active":"2023-12-07T21:11:10.608172+0000","last_peered":"2023-12-07T21:11:10.608172+0000","last_clean":"2023-12-07T21:11:10.608172+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:11:10.608172+0000","last_undegraded":"2023-12-07T21:11:10.608172+0000","last_fullsized":"2023-12-07T21:11:10.608172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766655+0000","last_change":"2023-12-07T21:08:54.887766+0000","last_active":"2023-12-07T21:11:09.766655+0000","last_peered":"2023-12-07T21:11:09.766655+0000","last_clean":"2023-12-07T21:11:09.766655+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:11:09.766655+0000","last_undegraded":"2023-12-07T21:11:09.766655+0000","last_fullsized":"2023-12-07T21:11:09.766655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766942+0000","last_change":"2023-12-07T21:08:56.876692+0000","last_active":"2023-12-07T21:11:09.766942+0000","last_peered":"2023-12-07T21:11:09.766942+0000","last_clean":"2023-12-07T21:11:09.766942+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:11:09.766942+0000","last_undegraded":"2023-12-07T21:11:09.766942+0000","last_fullsized":"2023-12-07T21:11:09.766942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187817+0000","last_change":"2023-12-07T21:08:54.885605+0000","last_active":"2023-12-07T21:11:10.187817+0000","last_peered":"2023-12-07T21:11:10.187817+0000","last_clean":"2023-12-07T21:11:10.187817+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:11:10.187817+0000","last_undegraded":"2023-12-07T21:11:10.187817+0000","last_fullsized":"2023-12-07T21:11:10.187817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'13","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766969+0000","last_change":"2023-12-07T21:08:56.882602+0000","last_active":"2023-12-07T21:11:09.766969+0000","last_peered":"2023-12-07T21:11:09.766969+0000","last_clean":"2023-12-07T21:11:09.766969+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:11:09.766969+0000","last_undegraded":"2023-12-07T21:11:09.766969+0000","last_fullsized":"2023-12-07T21:11:09.766969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766621+0000","last_change":"2023-12-07T21:08:54.889812+0000","last_active":"2023-12-07T21:11:09.766621+0000","last_peered":"2023-12-07T21:11:09.766621+0000","last_clean":"2023-12-07T21:11:09.766621+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:11:09.766621+0000","last_undegraded":"2023-12-07T21:11:09.766621+0000","last_fullsized":"2023-12-07T21:11:09.766621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345375+0000","last_change":"2023-12-07T21:08:56.875989+0000","last_active":"2023-12-07T21:11:09.345375+0000","last_peered":"2023-12-07T21:11:09.345375+0000","last_clean":"2023-12-07T21:11:09.345375+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:11:09.345375+0000","last_undegraded":"2023-12-07T21:11:09.345375+0000","last_fullsized":"2023-12-07T21:11:09.345375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766605+0000","last_change":"2023-12-07T21:08:54.878784+0000","last_active":"2023-12-07T21:11:09.766605+0000","last_peered":"2023-12-07T21:11:09.766605+0000","last_clean":"2023-12-07T21:11:09.766605+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:11:09.766605+0000","last_undegraded":"2023-12-07T21:11:09.766605+0000","last_fullsized":"2023-12-07T21:11:09.766605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187888+0000","last_change":"2023-12-07T21:08:56.875039+0000","last_active":"2023-12-07T21:11:10.187888+0000","last_peered":"2023-12-07T21:11:10.187888+0000","last_clean":"2023-12-07T21:11:10.187888+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:11:10.187888+0000","last_undegraded":"2023-12-07T21:11:10.187888+0000","last_fullsized":"2023-12-07T21:11:10.187888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345261+0000","last_change":"2023-12-07T21:08:54.890574+0000","last_active":"2023-12-07T21:11:09.345261+0000","last_peered":"2023-12-07T21:11:09.345261+0000","last_clean":"2023-12-07T21:11:09.345261+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:11:09.345261+0000","last_undegraded":"2023-12-07T21:11:09.345261+0000","last_fullsized":"2023-12-07T21:11:09.345261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766967+0000","last_change":"2023-12-07T21:08:56.883504+0000","last_active":"2023-12-07T21:11:09.766967+0000","last_peered":"2023-12-07T21:11:09.766967+0000","last_clean":"2023-12-07T21:11:09.766967+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:11:09.766967+0000","last_undegraded":"2023-12-07T21:11:09.766967+0000","last_fullsized":"2023-12-07T21:11:09.766967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607871+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:11:10.607871+0000","last_peered":"2023-12-07T21:11:10.607871+0000","last_clean":"2023-12-07T21:11:10.607871+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:11:10.607871+0000","last_undegraded":"2023-12-07T21:11:10.607871+0000","last_fullsized":"2023-12-07T21:11:10.607871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.995357+0000","last_change":"2023-12-07T21:09:04.931981+0000","last_active":"2023-12-07T21:10:59.995357+0000","last_peered":"2023-12-07T21:10:59.995357+0000","last_clean":"2023-12-07T21:10:59.995357+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:10:59.995357+0000","last_undegraded":"2023-12-07T21:10:59.995357+0000","last_fullsized":"2023-12-07T21:10:59.995357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608196+0000","last_change":"2023-12-07T21:08:56.873551+0000","last_active":"2023-12-07T21:11:10.608196+0000","last_peered":"2023-12-07T21:11:10.608196+0000","last_clean":"2023-12-07T21:11:10.608196+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:11:10.608196+0000","last_undegraded":"2023-12-07T21:11:10.608196+0000","last_fullsized":"2023-12-07T21:11:10.608196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607680+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:11:10.607680+0000","last_peered":"2023-12-07T21:11:10.607680+0000","last_clean":"2023-12-07T21:11:10.607680+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:11:10.607680+0000","last_undegraded":"2023-12-07T21:11:10.607680+0000","last_fullsized":"2023-12-07T21:11:10.607680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.797174+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:12.797174+0000","last_peered":"2023-12-07T21:11:12.797174+0000","last_clean":"2023-12-07T21:11:12.797174+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:12.797174+0000","last_undegraded":"2023-12-07T21:11:12.797174+0000","last_fullsized":"2023-12-07T21:11:12.797174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'31","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608625+0000","last_change":"2023-12-07T21:09:00.895835+0000","last_active":"2023-12-07T21:11:10.608625+0000","last_peered":"2023-12-07T21:11:10.608625+0000","last_clean":"2023-12-07T21:11:10.608625+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:11:10.608625+0000","last_undegraded":"2023-12-07T21:11:10.608625+0000","last_fullsized":"2023-12-07T21:11:10.608625+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767372+0000","last_change":"2023-12-07T21:09:02.907297+0000","last_active":"2023-12-07T21:11:09.767372+0000","last_peered":"2023-12-07T21:11:09.767372+0000","last_clean":"2023-12-07T21:11:09.767372+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:11:09.767372+0000","last_undegraded":"2023-12-07T21:11:09.767372+0000","last_fullsized":"2023-12-07T21:11:09.767372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.554614+0000","last_change":"2023-12-07T21:09:04.931948+0000","last_active":"2023-12-07T21:10:18.554614+0000","last_peered":"2023-12-07T21:10:18.554614+0000","last_clean":"2023-12-07T21:10:18.554614+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:10:18.554614+0000","last_undegraded":"2023-12-07T21:10:18.554614+0000","last_fullsized":"2023-12-07T21:10:18.554614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608060+0000","last_change":"2023-12-07T21:08:56.874761+0000","last_active":"2023-12-07T21:11:10.608060+0000","last_peered":"2023-12-07T21:11:10.608060+0000","last_clean":"2023-12-07T21:11:10.608060+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:11:10.608060+0000","last_undegraded":"2023-12-07T21:11:10.608060+0000","last_fullsized":"2023-12-07T21:11:10.608060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880632+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345523+0000","last_change":"2023-12-07T21:08:58.877458+0000","last_active":"2023-12-07T21:11:09.345523+0000","last_peered":"2023-12-07T21:11:09.345523+0000","last_clean":"2023-12-07T21:11:09.345523+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:09.345523+0000","last_undegraded":"2023-12-07T21:11:09.345523+0000","last_fullsized":"2023-12-07T21:11:09.345523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.053083+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:11.053083+0000","last_peered":"2023-12-07T21:11:11.053083+0000","last_clean":"2023-12-07T21:11:11.053083+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:11.053083+0000","last_undegraded":"2023-12-07T21:11:11.053083+0000","last_fullsized":"2023-12-07T21:11:11.053083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767370+0000","last_change":"2023-12-07T21:09:02.901036+0000","last_active":"2023-12-07T21:11:09.767370+0000","last_peered":"2023-12-07T21:11:09.767370+0000","last_clean":"2023-12-07T21:11:09.767370+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:09.767370+0000","last_undegraded":"2023-12-07T21:11:09.767370+0000","last_fullsized":"2023-12-07T21:11:09.767370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941633+0000","last_change":"2023-12-07T21:09:04.925464+0000","last_active":"2023-12-07T21:09:35.941633+0000","last_peered":"2023-12-07T21:09:35.941633+0000","last_clean":"2023-12-07T21:09:35.941633+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:09:35.941633+0000","last_undegraded":"2023-12-07T21:09:35.941633+0000","last_fullsized":"2023-12-07T21:09:35.941633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'1","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608112+0000","last_change":"2023-12-07T21:08:56.875484+0000","last_active":"2023-12-07T21:11:10.608112+0000","last_peered":"2023-12-07T21:11:10.608112+0000","last_clean":"2023-12-07T21:11:10.608112+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:11:10.608112+0000","last_undegraded":"2023-12-07T21:11:10.608112+0000","last_fullsized":"2023-12-07T21:11:10.608112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607656+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:11:10.607656+0000","last_peered":"2023-12-07T21:11:10.607656+0000","last_clean":"2023-12-07T21:11:10.607656+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:11:10.607656+0000","last_undegraded":"2023-12-07T21:11:10.607656+0000","last_fullsized":"2023-12-07T21:11:10.607656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345528+0000","last_change":"2023-12-07T21:08:58.880158+0000","last_active":"2023-12-07T21:11:09.345528+0000","last_peered":"2023-12-07T21:11:09.345528+0000","last_clean":"2023-12-07T21:11:09.345528+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:09.345528+0000","last_undegraded":"2023-12-07T21:11:09.345528+0000","last_fullsized":"2023-12-07T21:11:09.345528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188196+0000","last_change":"2023-12-07T21:09:00.890726+0000","last_active":"2023-12-07T21:11:10.188196+0000","last_peered":"2023-12-07T21:11:10.188196+0000","last_clean":"2023-12-07T21:11:10.188196+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:10.188196+0000","last_undegraded":"2023-12-07T21:11:10.188196+0000","last_fullsized":"2023-12-07T21:11:10.188196+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'246","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608744+0000","last_change":"2023-12-07T21:09:02.906250+0000","last_active":"2023-12-07T21:11:10.608744+0000","last_peered":"2023-12-07T21:11:10.608744+0000","last_clean":"2023-12-07T21:11:10.608744+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:11:10.608744+0000","last_undegraded":"2023-12-07T21:11:10.608744+0000","last_fullsized":"2023-12-07T21:11:10.608744+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.941509+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:09:35.941509+0000","last_peered":"2023-12-07T21:09:35.941509+0000","last_clean":"2023-12-07T21:09:35.941509+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:09:35.941509+0000","last_undegraded":"2023-12-07T21:09:35.941509+0000","last_fullsized":"2023-12-07T21:09:35.941509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345217+0000","last_change":"2023-12-07T21:08:56.885545+0000","last_active":"2023-12-07T21:11:09.345217+0000","last_peered":"2023-12-07T21:11:09.345217+0000","last_clean":"2023-12-07T21:11:09.345217+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:11:09.345217+0000","last_undegraded":"2023-12-07T21:11:09.345217+0000","last_fullsized":"2023-12-07T21:11:09.345217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766427+0000","last_change":"2023-12-07T21:08:54.878527+0000","last_active":"2023-12-07T21:11:09.766427+0000","last_peered":"2023-12-07T21:11:09.766427+0000","last_clean":"2023-12-07T21:11:09.766427+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:11:09.766427+0000","last_undegraded":"2023-12-07T21:11:09.766427+0000","last_fullsized":"2023-12-07T21:11:09.766427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.775119+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:14.775119+0000","last_peered":"2023-12-07T21:11:14.775119+0000","last_clean":"2023-12-07T21:11:14.775119+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:14.775119+0000","last_undegraded":"2023-12-07T21:11:14.775119+0000","last_fullsized":"2023-12-07T21:11:14.775119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'31","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188203+0000","last_change":"2023-12-07T21:09:00.892788+0000","last_active":"2023-12-07T21:11:10.188203+0000","last_peered":"2023-12-07T21:11:10.188203+0000","last_clean":"2023-12-07T21:11:10.188203+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:10.188203+0000","last_undegraded":"2023-12-07T21:11:10.188203+0000","last_fullsized":"2023-12-07T21:11:10.188203+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'246","reported_seq":331,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345806+0000","last_change":"2023-12-07T21:09:02.901266+0000","last_active":"2023-12-07T21:11:09.345806+0000","last_peered":"2023-12-07T21:11:09.345806+0000","last_clean":"2023-12-07T21:11:09.345806+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:11:09.345806+0000","last_undegraded":"2023-12-07T21:11:09.345806+0000","last_fullsized":"2023-12-07T21:11:09.345806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809281+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:11:08.809281+0000","last_peered":"2023-12-07T21:11:08.809281+0000","last_clean":"2023-12-07T21:11:08.809281+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:11:08.809281+0000","last_undegraded":"2023-12-07T21:11:08.809281+0000","last_fullsized":"2023-12-07T21:11:08.809281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880253+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808422+0000","last_change":"2023-12-07T21:08:58.877986+0000","last_active":"2023-12-07T21:11:08.808422+0000","last_peered":"2023-12-07T21:11:08.808422+0000","last_clean":"2023-12-07T21:11:08.808422+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:08.808422+0000","last_undegraded":"2023-12-07T21:11:08.808422+0000","last_fullsized":"2023-12-07T21:11:08.808422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'42","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188158+0000","last_change":"2023-12-07T21:09:00.888749+0000","last_active":"2023-12-07T21:11:10.188158+0000","last_peered":"2023-12-07T21:11:10.188158+0000","last_clean":"2023-12-07T21:11:10.188158+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:10.188158+0000","last_undegraded":"2023-12-07T21:11:10.188158+0000","last_fullsized":"2023-12-07T21:11:10.188158+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345803+0000","last_change":"2023-12-07T21:09:02.897538+0000","last_active":"2023-12-07T21:11:09.345803+0000","last_peered":"2023-12-07T21:11:09.345803+0000","last_clean":"2023-12-07T21:11:09.345803+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:09.345803+0000","last_undegraded":"2023-12-07T21:11:09.345803+0000","last_fullsized":"2023-12-07T21:11:09.345803+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188362+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:11:10.188362+0000","last_peered":"2023-12-07T21:11:10.188362+0000","last_clean":"2023-12-07T21:11:10.188362+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:11:10.188362+0000","last_undegraded":"2023-12-07T21:11:10.188362+0000","last_fullsized":"2023-12-07T21:11:10.188362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'21","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808397+0000","last_change":"2023-12-07T21:08:56.871222+0000","last_active":"2023-12-07T21:11:08.808397+0000","last_peered":"2023-12-07T21:11:08.808397+0000","last_clean":"2023-12-07T21:11:08.808397+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:11:08.808397+0000","last_undegraded":"2023-12-07T21:11:08.808397+0000","last_fullsized":"2023-12-07T21:11:08.808397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187590+0000","last_change":"2023-12-07T21:08:54.885249+0000","last_active":"2023-12-07T21:11:10.187590+0000","last_peered":"2023-12-07T21:11:10.187590+0000","last_clean":"2023-12-07T21:11:10.187590+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:11:10.187590+0000","last_undegraded":"2023-12-07T21:11:10.187590+0000","last_fullsized":"2023-12-07T21:11:10.187590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802212+0000","last_change":"2023-12-07T21:08:58.880254+0000","last_active":"2023-12-07T21:11:08.802212+0000","last_peered":"2023-12-07T21:11:08.802212+0000","last_clean":"2023-12-07T21:11:08.802212+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:11:08.802212+0000","last_undegraded":"2023-12-07T21:11:08.802212+0000","last_fullsized":"2023-12-07T21:11:08.802212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'33","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608550+0000","last_change":"2023-12-07T21:09:00.895444+0000","last_active":"2023-12-07T21:11:10.608550+0000","last_peered":"2023-12-07T21:11:10.608550+0000","last_clean":"2023-12-07T21:11:10.608550+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:11:10.608550+0000","last_undegraded":"2023-12-07T21:11:10.608550+0000","last_fullsized":"2023-12-07T21:11:10.608550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345807+0000","last_change":"2023-12-07T21:09:02.906821+0000","last_active":"2023-12-07T21:11:09.345807+0000","last_peered":"2023-12-07T21:11:09.345807+0000","last_clean":"2023-12-07T21:11:09.345807+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:09.345807+0000","last_undegraded":"2023-12-07T21:11:09.345807+0000","last_fullsized":"2023-12-07T21:11:09.345807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767437+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:11:09.767437+0000","last_peered":"2023-12-07T21:11:09.767437+0000","last_clean":"2023-12-07T21:11:09.767437+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:11:09.767437+0000","last_undegraded":"2023-12-07T21:11:09.767437+0000","last_fullsized":"2023-12-07T21:11:09.767437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808402+0000","last_change":"2023-12-07T21:08:56.879742+0000","last_active":"2023-12-07T21:11:08.808402+0000","last_peered":"2023-12-07T21:11:08.808402+0000","last_clean":"2023-12-07T21:11:08.808402+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:11:08.808402+0000","last_undegraded":"2023-12-07T21:11:08.808402+0000","last_fullsized":"2023-12-07T21:11:08.808402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607665+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:11:10.607665+0000","last_peered":"2023-12-07T21:11:10.607665+0000","last_clean":"2023-12-07T21:11:10.607665+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:11:10.607665+0000","last_undegraded":"2023-12-07T21:11:10.607665+0000","last_fullsized":"2023-12-07T21:11:10.607665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345505+0000","last_change":"2023-12-07T21:08:58.874569+0000","last_active":"2023-12-07T21:11:09.345505+0000","last_peered":"2023-12-07T21:11:09.345505+0000","last_clean":"2023-12-07T21:11:09.345505+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:11:09.345505+0000","last_undegraded":"2023-12-07T21:11:09.345505+0000","last_fullsized":"2023-12-07T21:11:09.345505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'37","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608539+0000","last_change":"2023-12-07T21:09:00.889539+0000","last_active":"2023-12-07T21:11:10.608539+0000","last_peered":"2023-12-07T21:11:10.608539+0000","last_clean":"2023-12-07T21:11:10.608539+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:10.608539+0000","last_undegraded":"2023-12-07T21:11:10.608539+0000","last_fullsized":"2023-12-07T21:11:10.608539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":299,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345719+0000","last_change":"2023-12-07T21:09:02.905689+0000","last_active":"2023-12-07T21:11:09.345719+0000","last_peered":"2023-12-07T21:11:09.345719+0000","last_clean":"2023-12-07T21:11:09.345719+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:09.345719+0000","last_undegraded":"2023-12-07T21:11:09.345719+0000","last_fullsized":"2023-12-07T21:11:09.345719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345866+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:11:09.345866+0000","last_peered":"2023-12-07T21:11:09.345866+0000","last_clean":"2023-12-07T21:11:09.345866+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:11:09.345866+0000","last_undegraded":"2023-12-07T21:11:09.345866+0000","last_fullsized":"2023-12-07T21:11:09.345866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187733+0000","last_change":"2023-12-07T21:08:56.870949+0000","last_active":"2023-12-07T21:11:10.187733+0000","last_peered":"2023-12-07T21:11:10.187733+0000","last_clean":"2023-12-07T21:11:10.187733+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:11:10.187733+0000","last_undegraded":"2023-12-07T21:11:10.187733+0000","last_fullsized":"2023-12-07T21:11:10.187733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607649+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:11:10.607649+0000","last_peered":"2023-12-07T21:11:10.607649+0000","last_clean":"2023-12-07T21:11:10.607649+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:11:10.607649+0000","last_undegraded":"2023-12-07T21:11:10.607649+0000","last_fullsized":"2023-12-07T21:11:10.607649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802319+0000","last_change":"2023-12-07T21:08:58.880111+0000","last_active":"2023-12-07T21:11:08.802319+0000","last_peered":"2023-12-07T21:11:08.802319+0000","last_clean":"2023-12-07T21:11:08.802319+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:08.802319+0000","last_undegraded":"2023-12-07T21:11:08.802319+0000","last_fullsized":"2023-12-07T21:11:08.802319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'56","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608558+0000","last_change":"2023-12-07T21:09:00.894678+0000","last_active":"2023-12-07T21:11:10.608558+0000","last_peered":"2023-12-07T21:11:10.608558+0000","last_clean":"2023-12-07T21:11:10.608558+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:10.608558+0000","last_undegraded":"2023-12-07T21:11:10.608558+0000","last_fullsized":"2023-12-07T21:11:10.608558+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345702+0000","last_change":"2023-12-07T21:09:02.901382+0000","last_active":"2023-12-07T21:11:09.345702+0000","last_peered":"2023-12-07T21:11:09.345702+0000","last_clean":"2023-12-07T21:11:09.345702+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:09.345702+0000","last_undegraded":"2023-12-07T21:11:09.345702+0000","last_fullsized":"2023-12-07T21:11:09.345702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345867+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:11:09.345867+0000","last_peered":"2023-12-07T21:11:09.345867+0000","last_clean":"2023-12-07T21:11:09.345867+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:11:09.345867+0000","last_undegraded":"2023-12-07T21:11:09.345867+0000","last_fullsized":"2023-12-07T21:11:09.345867+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:38.788716+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:09:38.788716+0000","last_peered":"2023-12-07T21:09:38.788716+0000","last_clean":"2023-12-07T21:09:38.788716+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:09:38.788716+0000","last_undegraded":"2023-12-07T21:09:38.788716+0000","last_fullsized":"2023-12-07T21:09:38.788716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345205+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:11:09.345205+0000","last_peered":"2023-12-07T21:11:09.345205+0000","last_clean":"2023-12-07T21:11:09.345205+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:11:09.345205+0000","last_undegraded":"2023-12-07T21:11:09.345205+0000","last_fullsized":"2023-12-07T21:11:09.345205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187996+0000","last_change":"2023-12-07T21:08:58.878003+0000","last_active":"2023-12-07T21:11:10.187996+0000","last_peered":"2023-12-07T21:11:10.187996+0000","last_clean":"2023-12-07T21:11:10.187996+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:11:10.187996+0000","last_undegraded":"2023-12-07T21:11:10.187996+0000","last_fullsized":"2023-12-07T21:11:10.187996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'33","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767238+0000","last_change":"2023-12-07T21:09:00.892793+0000","last_active":"2023-12-07T21:11:09.767238+0000","last_peered":"2023-12-07T21:11:09.767238+0000","last_clean":"2023-12-07T21:11:09.767238+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:09.767238+0000","last_undegraded":"2023-12-07T21:11:09.767238+0000","last_fullsized":"2023-12-07T21:11:09.767238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608766+0000","last_change":"2023-12-07T21:09:02.906350+0000","last_active":"2023-12-07T21:11:10.608766+0000","last_peered":"2023-12-07T21:11:10.608766+0000","last_clean":"2023-12-07T21:11:10.608766+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:11:10.608766+0000","last_undegraded":"2023-12-07T21:11:10.608766+0000","last_fullsized":"2023-12-07T21:11:10.608766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809146+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:11:08.809146+0000","last_peered":"2023-12-07T21:11:08.809146+0000","last_clean":"2023-12-07T21:11:08.809146+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:11:08.809146+0000","last_undegraded":"2023-12-07T21:11:08.809146+0000","last_fullsized":"2023-12-07T21:11:08.809146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.745982+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:10:18.745982+0000","last_peered":"2023-12-07T21:10:18.745982+0000","last_clean":"2023-12-07T21:10:18.745982+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:10:18.745982+0000","last_undegraded":"2023-12-07T21:10:18.745982+0000","last_fullsized":"2023-12-07T21:10:18.745982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809479+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:11:08.809479+0000","last_peered":"2023-12-07T21:11:08.809479+0000","last_clean":"2023-12-07T21:11:08.809479+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:11:08.809479+0000","last_undegraded":"2023-12-07T21:11:08.809479+0000","last_fullsized":"2023-12-07T21:11:08.809479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345521+0000","last_change":"2023-12-07T21:08:58.880054+0000","last_active":"2023-12-07T21:11:09.345521+0000","last_peered":"2023-12-07T21:11:09.345521+0000","last_clean":"2023-12-07T21:11:09.345521+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:09.345521+0000","last_undegraded":"2023-12-07T21:11:09.345521+0000","last_fullsized":"2023-12-07T21:11:09.345521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188176+0000","last_change":"2023-12-07T21:09:00.884835+0000","last_active":"2023-12-07T21:11:10.188176+0000","last_peered":"2023-12-07T21:11:10.188176+0000","last_clean":"2023-12-07T21:11:10.188176+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:10.188176+0000","last_undegraded":"2023-12-07T21:11:10.188176+0000","last_fullsized":"2023-12-07T21:11:10.188176+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":336,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625017+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625017+0000","last_peered":"2023-12-07T21:11:28.625017+0000","last_clean":"2023-12-07T21:11:28.625017+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625017+0000","last_undegraded":"2023-12-07T21:11:28.625017+0000","last_fullsized":"2023-12-07T21:11:28.625017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345846+0000","last_change":"2023-12-07T21:09:04.919388+0000","last_active":"2023-12-07T21:11:09.345846+0000","last_peered":"2023-12-07T21:11:09.345846+0000","last_clean":"2023-12-07T21:11:09.345846+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:11:09.345846+0000","last_undegraded":"2023-12-07T21:11:09.345846+0000","last_fullsized":"2023-12-07T21:11:09.345846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187852+0000","last_change":"2023-12-07T21:08:56.880261+0000","last_active":"2023-12-07T21:11:10.187852+0000","last_peered":"2023-12-07T21:11:10.187852+0000","last_clean":"2023-12-07T21:11:10.187852+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:11:10.187852+0000","last_undegraded":"2023-12-07T21:11:10.187852+0000","last_fullsized":"2023-12-07T21:11:10.187852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809380+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:11:08.809380+0000","last_peered":"2023-12-07T21:11:08.809380+0000","last_clean":"2023-12-07T21:11:08.809380+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:11:08.809380+0000","last_undegraded":"2023-12-07T21:11:08.809380+0000","last_fullsized":"2023-12-07T21:11:08.809380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767078+0000","last_change":"2023-12-07T21:08:58.876612+0000","last_active":"2023-12-07T21:11:09.767078+0000","last_peered":"2023-12-07T21:11:09.767078+0000","last_clean":"2023-12-07T21:11:09.767078+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:09.767078+0000","last_undegraded":"2023-12-07T21:11:09.767078+0000","last_fullsized":"2023-12-07T21:11:09.767078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608582+0000","last_change":"2023-12-07T21:09:00.895566+0000","last_active":"2023-12-07T21:11:10.608582+0000","last_peered":"2023-12-07T21:11:10.608582+0000","last_clean":"2023-12-07T21:11:10.608582+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:11:10.608582+0000","last_undegraded":"2023-12-07T21:11:10.608582+0000","last_fullsized":"2023-12-07T21:11:10.608582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'246","reported_seq":363,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767360+0000","last_change":"2023-12-07T21:09:02.900092+0000","last_active":"2023-12-07T21:11:09.767360+0000","last_peered":"2023-12-07T21:11:09.767360+0000","last_clean":"2023-12-07T21:11:09.767360+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:09.767360+0000","last_undegraded":"2023-12-07T21:11:09.767360+0000","last_fullsized":"2023-12-07T21:11:09.767360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188292+0000","last_change":"2023-12-07T21:09:04.923396+0000","last_active":"2023-12-07T21:11:10.188292+0000","last_peered":"2023-12-07T21:11:10.188292+0000","last_clean":"2023-12-07T21:11:10.188292+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:11:10.188292+0000","last_undegraded":"2023-12-07T21:11:10.188292+0000","last_fullsized":"2023-12-07T21:11:10.188292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766719+0000","last_change":"2023-12-07T21:08:56.889238+0000","last_active":"2023-12-07T21:11:09.766719+0000","last_peered":"2023-12-07T21:11:09.766719+0000","last_clean":"2023-12-07T21:11:09.766719+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:11:09.766719+0000","last_undegraded":"2023-12-07T21:11:09.766719+0000","last_fullsized":"2023-12-07T21:11:09.766719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809240+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:11:08.809240+0000","last_peered":"2023-12-07T21:11:08.809240+0000","last_clean":"2023-12-07T21:11:08.809240+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:11:08.809240+0000","last_undegraded":"2023-12-07T21:11:08.809240+0000","last_fullsized":"2023-12-07T21:11:08.809240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608316+0000","last_change":"2023-12-07T21:08:58.879899+0000","last_active":"2023-12-07T21:11:10.608316+0000","last_peered":"2023-12-07T21:11:10.608316+0000","last_clean":"2023-12-07T21:11:10.608316+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:10.608316+0000","last_undegraded":"2023-12-07T21:11:10.608316+0000","last_fullsized":"2023-12-07T21:11:10.608316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262716+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262716+0000","last_peered":"2023-12-07T21:11:27.262716+0000","last_clean":"2023-12-07T21:11:27.262716+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262716+0000","last_undegraded":"2023-12-07T21:11:27.262716+0000","last_fullsized":"2023-12-07T21:11:27.262716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.426987+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:14.426987+0000","last_peered":"2023-12-07T21:11:14.426987+0000","last_clean":"2023-12-07T21:11:14.426987+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:14.426987+0000","last_undegraded":"2023-12-07T21:11:14.426987+0000","last_fullsized":"2023-12-07T21:11:14.426987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767450+0000","last_change":"2023-12-07T21:09:04.920277+0000","last_active":"2023-12-07T21:11:09.767450+0000","last_peered":"2023-12-07T21:11:09.767450+0000","last_clean":"2023-12-07T21:11:09.767450+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:11:09.767450+0000","last_undegraded":"2023-12-07T21:11:09.767450+0000","last_fullsized":"2023-12-07T21:11:09.767450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808538+0000","last_change":"2023-12-07T21:08:56.875185+0000","last_active":"2023-12-07T21:11:03.808538+0000","last_peered":"2023-12-07T21:11:03.808538+0000","last_clean":"2023-12-07T21:11:03.808538+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:11:03.808538+0000","last_undegraded":"2023-12-07T21:11:03.808538+0000","last_fullsized":"2023-12-07T21:11:03.808538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:43.801827+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:10:43.801827+0000","last_peered":"2023-12-07T21:10:43.801827+0000","last_clean":"2023-12-07T21:10:43.801827+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:10:43.801827+0000","last_undegraded":"2023-12-07T21:10:43.801827+0000","last_fullsized":"2023-12-07T21:10:43.801827+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806332+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:10:53.806332+0000","last_peered":"2023-12-07T21:10:53.806332+0000","last_clean":"2023-12-07T21:10:53.806332+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:10:53.806332+0000","last_undegraded":"2023-12-07T21:10:53.806332+0000","last_fullsized":"2023-12-07T21:10:53.806332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808304+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:11:03.808304+0000","last_peered":"2023-12-07T21:11:03.808304+0000","last_clean":"2023-12-07T21:11:03.808304+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:11:03.808304+0000","last_undegraded":"2023-12-07T21:11:03.808304+0000","last_fullsized":"2023-12-07T21:11:03.808304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807177+0000","last_change":"2023-12-07T21:08:58.875656+0000","last_active":"2023-12-07T21:11:03.807177+0000","last_peered":"2023-12-07T21:11:03.807177+0000","last_clean":"2023-12-07T21:11:03.807177+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:11:03.807177+0000","last_undegraded":"2023-12-07T21:11:03.807177+0000","last_fullsized":"2023-12-07T21:11:03.807177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'79","reported_seq":154,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608522+0000","last_change":"2023-12-07T21:09:00.891338+0000","last_active":"2023-12-07T21:11:10.608522+0000","last_peered":"2023-12-07T21:11:10.608522+0000","last_clean":"2023-12-07T21:11:10.608522+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:11:10.608522+0000","last_undegraded":"2023-12-07T21:11:10.608522+0000","last_fullsized":"2023-12-07T21:11:10.608522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345695+0000","last_change":"2023-12-07T21:09:02.905666+0000","last_active":"2023-12-07T21:11:09.345695+0000","last_peered":"2023-12-07T21:11:09.345695+0000","last_clean":"2023-12-07T21:11:09.345695+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:09.345695+0000","last_undegraded":"2023-12-07T21:11:09.345695+0000","last_fullsized":"2023-12-07T21:11:09.345695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188371+0000","last_change":"2023-12-07T21:09:04.924703+0000","last_active":"2023-12-07T21:11:10.188371+0000","last_peered":"2023-12-07T21:11:10.188371+0000","last_clean":"2023-12-07T21:11:10.188371+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:10.188371+0000","last_undegraded":"2023-12-07T21:11:10.188371+0000","last_fullsized":"2023-12-07T21:11:10.188371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809766+0000","last_change":"2023-12-07T21:08:56.872420+0000","last_active":"2023-12-07T21:11:08.809766+0000","last_peered":"2023-12-07T21:11:08.809766+0000","last_clean":"2023-12-07T21:11:08.809766+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:11:08.809766+0000","last_undegraded":"2023-12-07T21:11:08.809766+0000","last_fullsized":"2023-12-07T21:11:08.809766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:48.804993+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:10:48.804993+0000","last_peered":"2023-12-07T21:10:48.804993+0000","last_clean":"2023-12-07T21:10:48.804993+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:10:48.804993+0000","last_undegraded":"2023-12-07T21:10:48.804993+0000","last_fullsized":"2023-12-07T21:10:48.804993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800912+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:11:03.800912+0000","last_peered":"2023-12-07T21:11:03.800912+0000","last_clean":"2023-12-07T21:11:03.800912+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:11:03.800912+0000","last_undegraded":"2023-12-07T21:11:03.800912+0000","last_fullsized":"2023-12-07T21:11:03.800912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809854+0000","last_change":"2023-12-07T21:08:58.879144+0000","last_active":"2023-12-07T21:11:08.809854+0000","last_peered":"2023-12-07T21:11:08.809854+0000","last_clean":"2023-12-07T21:11:08.809854+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:08.809854+0000","last_undegraded":"2023-12-07T21:11:08.809854+0000","last_fullsized":"2023-12-07T21:11:08.809854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":450,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148355+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148355+0000","last_peered":"2023-12-07T21:11:18.148355+0000","last_clean":"2023-12-07T21:11:18.148355+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148355+0000","last_undegraded":"2023-12-07T21:11:18.148355+0000","last_fullsized":"2023-12-07T21:11:18.148355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809611+0000","last_change":"2023-12-07T21:09:02.905387+0000","last_active":"2023-12-07T21:11:08.809611+0000","last_peered":"2023-12-07T21:11:08.809611+0000","last_clean":"2023-12-07T21:11:08.809611+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:11:08.809611+0000","last_undegraded":"2023-12-07T21:11:08.809611+0000","last_fullsized":"2023-12-07T21:11:08.809611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767469+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:11:09.767469+0000","last_peered":"2023-12-07T21:11:09.767469+0000","last_clean":"2023-12-07T21:11:09.767469+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:11:09.767469+0000","last_undegraded":"2023-12-07T21:11:09.767469+0000","last_fullsized":"2023-12-07T21:11:09.767469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802682+0000","last_change":"2023-12-07T21:08:56.883281+0000","last_active":"2023-12-07T21:11:08.802682+0000","last_peered":"2023-12-07T21:11:08.802682+0000","last_clean":"2023-12-07T21:11:08.802682+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:11:08.802682+0000","last_undegraded":"2023-12-07T21:11:08.802682+0000","last_fullsized":"2023-12-07T21:11:08.802682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.804204+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:10:53.804204+0000","last_peered":"2023-12-07T21:10:53.804204+0000","last_clean":"2023-12-07T21:10:53.804204+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:10:53.804204+0000","last_undegraded":"2023-12-07T21:10:53.804204+0000","last_fullsized":"2023-12-07T21:10:53.804204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.799875+0000","last_change":"2023-12-07T21:08:54.881937+0000","last_active":"2023-12-07T21:10:58.799875+0000","last_peered":"2023-12-07T21:10:58.799875+0000","last_clean":"2023-12-07T21:10:58.799875+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:10:58.799875+0000","last_undegraded":"2023-12-07T21:10:58.799875+0000","last_fullsized":"2023-12-07T21:10:58.799875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808733+0000","last_change":"2023-12-07T21:08:58.875724+0000","last_active":"2023-12-07T21:11:08.808733+0000","last_peered":"2023-12-07T21:11:08.808733+0000","last_clean":"2023-12-07T21:11:08.808733+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:11:08.808733+0000","last_undegraded":"2023-12-07T21:11:08.808733+0000","last_fullsized":"2023-12-07T21:11:08.808733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808667+0000","last_change":"2023-12-07T21:09:00.888461+0000","last_active":"2023-12-07T21:11:08.808667+0000","last_peered":"2023-12-07T21:11:08.808667+0000","last_clean":"2023-12-07T21:11:08.808667+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:08.808667+0000","last_undegraded":"2023-12-07T21:11:08.808667+0000","last_fullsized":"2023-12-07T21:11:08.808667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642676+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642676+0000","last_peered":"2023-12-07T21:11:12.642676+0000","last_clean":"2023-12-07T21:11:12.642676+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642676+0000","last_undegraded":"2023-12-07T21:11:12.642676+0000","last_fullsized":"2023-12-07T21:11:12.642676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608815+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:11:10.608815+0000","last_peered":"2023-12-07T21:11:10.608815+0000","last_clean":"2023-12-07T21:11:10.608815+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:11:10.608815+0000","last_undegraded":"2023-12-07T21:11:10.608815+0000","last_fullsized":"2023-12-07T21:11:10.608815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801285+0000","last_change":"2023-12-07T21:08:56.872455+0000","last_active":"2023-12-07T21:11:03.801285+0000","last_peered":"2023-12-07T21:11:03.801285+0000","last_clean":"2023-12-07T21:11:03.801285+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:11:03.801285+0000","last_undegraded":"2023-12-07T21:11:03.801285+0000","last_fullsized":"2023-12-07T21:11:03.801285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806222+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:10:53.806222+0000","last_peered":"2023-12-07T21:10:53.806222+0000","last_clean":"2023-12-07T21:10:53.806222+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:10:53.806222+0000","last_undegraded":"2023-12-07T21:10:53.806222+0000","last_fullsized":"2023-12-07T21:10:53.806222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806975+0000","last_change":"2023-12-07T21:08:54.880674+0000","last_active":"2023-12-07T21:11:03.806975+0000","last_peered":"2023-12-07T21:11:03.806975+0000","last_clean":"2023-12-07T21:11:03.806975+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:11:03.806975+0000","last_undegraded":"2023-12-07T21:11:03.806975+0000","last_fullsized":"2023-12-07T21:11:03.806975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801326+0000","last_change":"2023-12-07T21:08:58.881871+0000","last_active":"2023-12-07T21:11:03.801326+0000","last_peered":"2023-12-07T21:11:03.801326+0000","last_clean":"2023-12-07T21:11:03.801326+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:11:03.801326+0000","last_undegraded":"2023-12-07T21:11:03.801326+0000","last_fullsized":"2023-12-07T21:11:03.801326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608529+0000","last_change":"2023-12-07T21:09:00.892022+0000","last_active":"2023-12-07T21:11:10.608529+0000","last_peered":"2023-12-07T21:11:10.608529+0000","last_clean":"2023-12-07T21:11:10.608529+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:11:10.608529+0000","last_undegraded":"2023-12-07T21:11:10.608529+0000","last_fullsized":"2023-12-07T21:11:10.608529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608704+0000","last_change":"2023-12-07T21:09:02.907037+0000","last_active":"2023-12-07T21:11:10.608704+0000","last_peered":"2023-12-07T21:11:10.608704+0000","last_clean":"2023-12-07T21:11:10.608704+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:11:10.608704+0000","last_undegraded":"2023-12-07T21:11:10.608704+0000","last_fullsized":"2023-12-07T21:11:10.608704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767468+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:11:09.767468+0000","last_peered":"2023-12-07T21:11:09.767468+0000","last_clean":"2023-12-07T21:11:09.767468+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:11:09.767468+0000","last_undegraded":"2023-12-07T21:11:09.767468+0000","last_fullsized":"2023-12-07T21:11:09.767468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806997+0000","last_change":"2023-12-07T21:08:56.882954+0000","last_active":"2023-12-07T21:11:03.806997+0000","last_peered":"2023-12-07T21:11:03.806997+0000","last_clean":"2023-12-07T21:11:03.806997+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:11:03.806997+0000","last_undegraded":"2023-12-07T21:11:03.806997+0000","last_fullsized":"2023-12-07T21:11:03.806997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807157+0000","last_change":"2023-12-07T21:08:54.881143+0000","last_active":"2023-12-07T21:11:03.807157+0000","last_peered":"2023-12-07T21:11:03.807157+0000","last_clean":"2023-12-07T21:11:03.807157+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:11:03.807157+0000","last_undegraded":"2023-12-07T21:11:03.807157+0000","last_fullsized":"2023-12-07T21:11:03.807157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.799061+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:10:53.799061+0000","last_peered":"2023-12-07T21:10:53.799061+0000","last_clean":"2023-12-07T21:10:53.799061+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:10:53.799061+0000","last_undegraded":"2023-12-07T21:10:53.799061+0000","last_fullsized":"2023-12-07T21:10:53.799061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801170+0000","last_change":"2023-12-07T21:08:58.881942+0000","last_active":"2023-12-07T21:11:03.801170+0000","last_peered":"2023-12-07T21:11:03.801170+0000","last_clean":"2023-12-07T21:11:03.801170+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:11:03.801170+0000","last_undegraded":"2023-12-07T21:11:03.801170+0000","last_fullsized":"2023-12-07T21:11:03.801170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'64","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.536116+0000","last_change":"2023-12-07T21:09:00.892917+0000","last_active":"2023-12-07T21:11:06.536116+0000","last_peered":"2023-12-07T21:11:06.536116+0000","last_clean":"2023-12-07T21:11:06.536116+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:06.536116+0000","last_undegraded":"2023-12-07T21:11:06.536116+0000","last_fullsized":"2023-12-07T21:11:06.536116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594393+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594393+0000","last_peered":"2023-12-07T21:11:25.594393+0000","last_clean":"2023-12-07T21:11:25.594393+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594393+0000","last_undegraded":"2023-12-07T21:11:25.594393+0000","last_fullsized":"2023-12-07T21:11:25.594393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345934+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:11:09.345934+0000","last_peered":"2023-12-07T21:11:09.345934+0000","last_clean":"2023-12-07T21:11:09.345934+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:11:09.345934+0000","last_undegraded":"2023-12-07T21:11:09.345934+0000","last_fullsized":"2023-12-07T21:11:09.345934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807102+0000","last_change":"2023-12-07T21:08:56.878924+0000","last_active":"2023-12-07T21:11:03.807102+0000","last_peered":"2023-12-07T21:11:03.807102+0000","last_clean":"2023-12-07T21:11:03.807102+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:11:03.807102+0000","last_undegraded":"2023-12-07T21:11:03.807102+0000","last_fullsized":"2023-12-07T21:11:03.807102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801254+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:11:03.801254+0000","last_peered":"2023-12-07T21:11:03.801254+0000","last_clean":"2023-12-07T21:11:03.801254+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:11:03.801254+0000","last_undegraded":"2023-12-07T21:11:03.801254+0000","last_fullsized":"2023-12-07T21:11:03.801254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806441+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:10:53.806441+0000","last_peered":"2023-12-07T21:10:53.806441+0000","last_clean":"2023-12-07T21:10:53.806441+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:10:53.806441+0000","last_undegraded":"2023-12-07T21:10:53.806441+0000","last_fullsized":"2023-12-07T21:10:53.806441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808267+0000","last_change":"2023-12-07T21:08:58.879797+0000","last_active":"2023-12-07T21:11:03.808267+0000","last_peered":"2023-12-07T21:11:03.808267+0000","last_clean":"2023-12-07T21:11:03.808267+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:11:03.808267+0000","last_undegraded":"2023-12-07T21:11:03.808267+0000","last_fullsized":"2023-12-07T21:11:03.808267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808441+0000","last_change":"2023-12-07T21:09:00.890696+0000","last_active":"2023-12-07T21:11:08.808441+0000","last_peered":"2023-12-07T21:11:08.808441+0000","last_clean":"2023-12-07T21:11:08.808441+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:08.808441+0000","last_undegraded":"2023-12-07T21:11:08.808441+0000","last_fullsized":"2023-12-07T21:11:08.808441+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":300,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.065927+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:11:20.065927+0000","last_peered":"2023-12-07T21:11:20.065927+0000","last_clean":"2023-12-07T21:11:20.065927+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:20.065927+0000","last_undegraded":"2023-12-07T21:11:20.065927+0000","last_fullsized":"2023-12-07T21:11:20.065927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608840+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:11:10.608840+0000","last_peered":"2023-12-07T21:11:10.608840+0000","last_clean":"2023-12-07T21:11:10.608840+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:11:10.608840+0000","last_undegraded":"2023-12-07T21:11:10.608840+0000","last_fullsized":"2023-12-07T21:11:10.608840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.807179+0000","last_change":"2023-12-07T21:08:56.887962+0000","last_active":"2023-12-07T21:10:58.807179+0000","last_peered":"2023-12-07T21:10:58.807179+0000","last_clean":"2023-12-07T21:10:58.807179+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:10:58.807179+0000","last_undegraded":"2023-12-07T21:10:58.807179+0000","last_fullsized":"2023-12-07T21:10:58.807179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809841+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:11:08.809841+0000","last_peered":"2023-12-07T21:11:08.809841+0000","last_clean":"2023-12-07T21:11:08.809841+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:11:08.809841+0000","last_undegraded":"2023-12-07T21:11:08.809841+0000","last_fullsized":"2023-12-07T21:11:08.809841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800250+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:10:58.800250+0000","last_peered":"2023-12-07T21:10:58.800250+0000","last_clean":"2023-12-07T21:10:58.800250+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:10:58.800250+0000","last_undegraded":"2023-12-07T21:10:58.800250+0000","last_fullsized":"2023-12-07T21:10:58.800250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.865875+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:11:18.865875+0000","last_peered":"2023-12-07T21:11:18.865875+0000","last_clean":"2023-12-07T21:11:18.865875+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:11:18.865875+0000","last_undegraded":"2023-12-07T21:11:18.865875+0000","last_fullsized":"2023-12-07T21:11:18.865875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809460+0000","last_change":"2023-12-07T21:09:00.896503+0000","last_active":"2023-12-07T21:11:08.809460+0000","last_peered":"2023-12-07T21:11:08.809460+0000","last_clean":"2023-12-07T21:11:08.809460+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:11:08.809460+0000","last_undegraded":"2023-12-07T21:11:08.809460+0000","last_fullsized":"2023-12-07T21:11:08.809460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":368,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712206+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712206+0000","last_peered":"2023-12-07T21:11:18.712206+0000","last_clean":"2023-12-07T21:11:18.712206+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712206+0000","last_undegraded":"2023-12-07T21:11:18.712206+0000","last_fullsized":"2023-12-07T21:11:18.712206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767478+0000","last_change":"2023-12-07T21:09:04.929420+0000","last_active":"2023-12-07T21:11:09.767478+0000","last_peered":"2023-12-07T21:11:09.767478+0000","last_clean":"2023-12-07T21:11:09.767478+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:11:09.767478+0000","last_undegraded":"2023-12-07T21:11:09.767478+0000","last_fullsized":"2023-12-07T21:11:09.767478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806772+0000","last_change":"2023-12-07T21:08:56.874336+0000","last_active":"2023-12-07T21:11:03.806772+0000","last_peered":"2023-12-07T21:11:03.806772+0000","last_clean":"2023-12-07T21:11:03.806772+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:11:03.806772+0000","last_undegraded":"2023-12-07T21:11:03.806772+0000","last_fullsized":"2023-12-07T21:11:03.806772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808876+0000","last_change":"2023-12-07T21:08:54.888557+0000","last_active":"2023-12-07T21:11:08.808876+0000","last_peered":"2023-12-07T21:11:08.808876+0000","last_clean":"2023-12-07T21:11:08.808876+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:11:08.808876+0000","last_undegraded":"2023-12-07T21:11:08.808876+0000","last_fullsized":"2023-12-07T21:11:08.808876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.807661+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:10:58.807661+0000","last_peered":"2023-12-07T21:10:58.807661+0000","last_clean":"2023-12-07T21:10:58.807661+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:10:58.807661+0000","last_undegraded":"2023-12-07T21:10:58.807661+0000","last_fullsized":"2023-12-07T21:10:58.807661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.807230+0000","last_change":"2023-12-07T21:09:35.953149+0000","last_active":"2023-12-07T21:10:58.807230+0000","last_peered":"2023-12-07T21:10:58.807230+0000","last_clean":"2023-12-07T21:10:58.807230+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:10:58.807230+0000","last_undegraded":"2023-12-07T21:10:58.807230+0000","last_fullsized":"2023-12-07T21:10:58.807230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'86","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808501+0000","last_change":"2023-12-07T21:09:00.891723+0000","last_active":"2023-12-07T21:11:08.808501+0000","last_peered":"2023-12-07T21:11:08.808501+0000","last_clean":"2023-12-07T21:11:08.808501+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:11:08.808501+0000","last_undegraded":"2023-12-07T21:11:08.808501+0000","last_fullsized":"2023-12-07T21:11:08.808501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802332+0000","last_change":"2023-12-07T21:09:02.898050+0000","last_active":"2023-12-07T21:11:08.802332+0000","last_peered":"2023-12-07T21:11:08.802332+0000","last_clean":"2023-12-07T21:11:08.802332+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:08.802332+0000","last_undegraded":"2023-12-07T21:11:08.802332+0000","last_fullsized":"2023-12-07T21:11:08.802332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188437+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:11:10.188437+0000","last_peered":"2023-12-07T21:11:10.188437+0000","last_clean":"2023-12-07T21:11:10.188437+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:11:10.188437+0000","last_undegraded":"2023-12-07T21:11:10.188437+0000","last_fullsized":"2023-12-07T21:11:10.188437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188463+0000","last_change":"2023-12-07T21:09:04.926451+0000","last_active":"2023-12-07T21:11:10.188463+0000","last_peered":"2023-12-07T21:11:10.188463+0000","last_clean":"2023-12-07T21:11:10.188463+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:11:10.188463+0000","last_undegraded":"2023-12-07T21:11:10.188463+0000","last_fullsized":"2023-12-07T21:11:10.188463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187815+0000","last_change":"2023-12-07T21:08:56.877160+0000","last_active":"2023-12-07T21:11:10.187815+0000","last_peered":"2023-12-07T21:11:10.187815+0000","last_clean":"2023-12-07T21:11:10.187815+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:11:10.187815+0000","last_undegraded":"2023-12-07T21:11:10.187815+0000","last_fullsized":"2023-12-07T21:11:10.187815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607705+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:11:10.607705+0000","last_peered":"2023-12-07T21:11:10.607705+0000","last_clean":"2023-12-07T21:11:10.607705+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:11:10.607705+0000","last_undegraded":"2023-12-07T21:11:10.607705+0000","last_fullsized":"2023-12-07T21:11:10.607705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767088+0000","last_change":"2023-12-07T21:08:58.876828+0000","last_active":"2023-12-07T21:11:09.767088+0000","last_peered":"2023-12-07T21:11:09.767088+0000","last_clean":"2023-12-07T21:11:09.767088+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:09.767088+0000","last_undegraded":"2023-12-07T21:11:09.767088+0000","last_fullsized":"2023-12-07T21:11:09.767088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.839849+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:20.839849+0000","last_peered":"2023-12-07T21:11:20.839849+0000","last_clean":"2023-12-07T21:11:20.839849+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:20.839849+0000","last_undegraded":"2023-12-07T21:11:20.839849+0000","last_fullsized":"2023-12-07T21:11:20.839849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608769+0000","last_change":"2023-12-07T21:09:02.907875+0000","last_active":"2023-12-07T21:11:10.608769+0000","last_peered":"2023-12-07T21:11:10.608769+0000","last_clean":"2023-12-07T21:11:10.608769+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:11:10.608769+0000","last_undegraded":"2023-12-07T21:11:10.608769+0000","last_fullsized":"2023-12-07T21:11:10.608769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802571+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:11:08.802571+0000","last_peered":"2023-12-07T21:11:08.802571+0000","last_clean":"2023-12-07T21:11:08.802571+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:11:08.802571+0000","last_undegraded":"2023-12-07T21:11:08.802571+0000","last_fullsized":"2023-12-07T21:11:08.802571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766751+0000","last_change":"2023-12-07T21:08:56.879187+0000","last_active":"2023-12-07T21:11:09.766751+0000","last_peered":"2023-12-07T21:11:09.766751+0000","last_clean":"2023-12-07T21:11:09.766751+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:11:09.766751+0000","last_undegraded":"2023-12-07T21:11:09.766751+0000","last_fullsized":"2023-12-07T21:11:09.766751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187534+0000","last_change":"2023-12-07T21:08:54.880755+0000","last_active":"2023-12-07T21:11:10.187534+0000","last_peered":"2023-12-07T21:11:10.187534+0000","last_clean":"2023-12-07T21:11:10.187534+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:11:10.187534+0000","last_undegraded":"2023-12-07T21:11:10.187534+0000","last_fullsized":"2023-12-07T21:11:10.187534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.790833+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:15.790833+0000","last_peered":"2023-12-07T21:11:15.790833+0000","last_clean":"2023-12-07T21:11:15.790833+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:15.790833+0000","last_undegraded":"2023-12-07T21:11:15.790833+0000","last_fullsized":"2023-12-07T21:11:15.790833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345587+0000","last_change":"2023-12-07T21:09:00.886499+0000","last_active":"2023-12-07T21:11:09.345587+0000","last_peered":"2023-12-07T21:11:09.345587+0000","last_clean":"2023-12-07T21:11:09.345587+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:09.345587+0000","last_undegraded":"2023-12-07T21:11:09.345587+0000","last_fullsized":"2023-12-07T21:11:09.345587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:19.515594+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:19.515594+0000","last_peered":"2023-12-07T21:11:19.515594+0000","last_clean":"2023-12-07T21:11:19.515594+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:19.515594+0000","last_undegraded":"2023-12-07T21:11:19.515594+0000","last_fullsized":"2023-12-07T21:11:19.515594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942947+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:09:35.942947+0000","last_peered":"2023-12-07T21:09:35.942947+0000","last_clean":"2023-12-07T21:09:35.942947+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:09:35.942947+0000","last_undegraded":"2023-12-07T21:09:35.942947+0000","last_fullsized":"2023-12-07T21:09:35.942947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345219+0000","last_change":"2023-12-07T21:08:56.874712+0000","last_active":"2023-12-07T21:11:09.345219+0000","last_peered":"2023-12-07T21:11:09.345219+0000","last_clean":"2023-12-07T21:11:09.345219+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:11:09.345219+0000","last_undegraded":"2023-12-07T21:11:09.345219+0000","last_fullsized":"2023-12-07T21:11:09.345219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187591+0000","last_change":"2023-12-07T21:08:54.885182+0000","last_active":"2023-12-07T21:11:10.187591+0000","last_peered":"2023-12-07T21:11:10.187591+0000","last_clean":"2023-12-07T21:11:10.187591+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:11:10.187591+0000","last_undegraded":"2023-12-07T21:11:10.187591+0000","last_fullsized":"2023-12-07T21:11:10.187591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188032+0000","last_change":"2023-12-07T21:08:58.873698+0000","last_active":"2023-12-07T21:11:10.188032+0000","last_peered":"2023-12-07T21:11:10.188032+0000","last_clean":"2023-12-07T21:11:10.188032+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:11:10.188032+0000","last_undegraded":"2023-12-07T21:11:10.188032+0000","last_fullsized":"2023-12-07T21:11:10.188032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.678798+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:11.678798+0000","last_peered":"2023-12-07T21:11:11.678798+0000","last_clean":"2023-12-07T21:11:11.678798+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:11.678798+0000","last_undegraded":"2023-12-07T21:11:11.678798+0000","last_fullsized":"2023-12-07T21:11:11.678798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767356+0000","last_change":"2023-12-07T21:09:02.900618+0000","last_active":"2023-12-07T21:11:09.767356+0000","last_peered":"2023-12-07T21:11:09.767356+0000","last_clean":"2023-12-07T21:11:09.767356+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:09.767356+0000","last_undegraded":"2023-12-07T21:11:09.767356+0000","last_fullsized":"2023-12-07T21:11:09.767356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.945627+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:09:35.945627+0000","last_peered":"2023-12-07T21:09:35.945627+0000","last_clean":"2023-12-07T21:09:35.945627+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:09:35.945627+0000","last_undegraded":"2023-12-07T21:09:35.945627+0000","last_fullsized":"2023-12-07T21:09:35.945627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608103+0000","last_change":"2023-12-07T21:08:56.887184+0000","last_active":"2023-12-07T21:11:10.608103+0000","last_peered":"2023-12-07T21:11:10.608103+0000","last_clean":"2023-12-07T21:11:10.608103+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:11:10.608103+0000","last_undegraded":"2023-12-07T21:11:10.608103+0000","last_fullsized":"2023-12-07T21:11:10.608103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766431+0000","last_change":"2023-12-07T21:08:54.878542+0000","last_active":"2023-12-07T21:11:09.766431+0000","last_peered":"2023-12-07T21:11:09.766431+0000","last_clean":"2023-12-07T21:11:09.766431+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:11:09.766431+0000","last_undegraded":"2023-12-07T21:11:09.766431+0000","last_fullsized":"2023-12-07T21:11:09.766431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608378+0000","last_change":"2023-12-07T21:08:58.878455+0000","last_active":"2023-12-07T21:11:10.608378+0000","last_peered":"2023-12-07T21:11:10.608378+0000","last_clean":"2023-12-07T21:11:10.608378+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:10.608378+0000","last_undegraded":"2023-12-07T21:11:10.608378+0000","last_fullsized":"2023-12-07T21:11:10.608378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'31","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188177+0000","last_change":"2023-12-07T21:09:00.885534+0000","last_active":"2023-12-07T21:11:10.188177+0000","last_peered":"2023-12-07T21:11:10.188177+0000","last_clean":"2023-12-07T21:11:10.188177+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:10.188177+0000","last_undegraded":"2023-12-07T21:11:10.188177+0000","last_fullsized":"2023-12-07T21:11:10.188177+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.544268+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:17.544268+0000","last_peered":"2023-12-07T21:11:17.544268+0000","last_clean":"2023-12-07T21:11:17.544268+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:17.544268+0000","last_undegraded":"2023-12-07T21:11:17.544268+0000","last_fullsized":"2023-12-07T21:11:17.544268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808681+0000","last_change":"2023-12-07T21:08:56.873185+0000","last_active":"2023-12-07T21:11:03.808681+0000","last_peered":"2023-12-07T21:11:03.808681+0000","last_clean":"2023-12-07T21:11:03.808681+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:11:03.808681+0000","last_undegraded":"2023-12-07T21:11:03.808681+0000","last_fullsized":"2023-12-07T21:11:03.808681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607720+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:11:10.607720+0000","last_peered":"2023-12-07T21:11:10.607720+0000","last_clean":"2023-12-07T21:11:10.607720+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:11:10.607720+0000","last_undegraded":"2023-12-07T21:11:10.607720+0000","last_fullsized":"2023-12-07T21:11:10.607720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800299+0000","last_change":"2023-12-07T21:08:58.879555+0000","last_active":"2023-12-07T21:10:58.800299+0000","last_peered":"2023-12-07T21:10:58.800299+0000","last_clean":"2023-12-07T21:10:58.800299+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:10:58.800299+0000","last_undegraded":"2023-12-07T21:10:58.800299+0000","last_fullsized":"2023-12-07T21:10:58.800299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'56","reported_seq":113,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.564552+0000","last_change":"2023-12-07T21:09:00.886089+0000","last_active":"2023-12-07T21:11:06.564552+0000","last_peered":"2023-12-07T21:11:06.564552+0000","last_clean":"2023-12-07T21:11:06.564552+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:06.564552+0000","last_undegraded":"2023-12-07T21:11:06.564552+0000","last_fullsized":"2023-12-07T21:11:06.564552+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942685+0000","last_change":"2023-12-07T21:09:02.900412+0000","last_active":"2023-12-07T21:09:35.942685+0000","last_peered":"2023-12-07T21:09:35.942685+0000","last_clean":"2023-12-07T21:09:35.942685+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:09:35.942685+0000","last_undegraded":"2023-12-07T21:09:35.942685+0000","last_fullsized":"2023-12-07T21:09:35.942685+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345942+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:11:09.345942+0000","last_peered":"2023-12-07T21:11:09.345942+0000","last_clean":"2023-12-07T21:11:09.345942+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:11:09.345942+0000","last_undegraded":"2023-12-07T21:11:09.345942+0000","last_fullsized":"2023-12-07T21:11:09.345942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173426+0000","last_change":"2023-12-07T21:08:56.877115+0000","last_active":"2023-12-07T21:10:59.173426+0000","last_peered":"2023-12-07T21:10:59.173426+0000","last_clean":"2023-12-07T21:10:59.173426+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:10:59.173426+0000","last_undegraded":"2023-12-07T21:10:59.173426+0000","last_fullsized":"2023-12-07T21:10:59.173426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766432+0000","last_change":"2023-12-07T21:08:54.882363+0000","last_active":"2023-12-07T21:11:09.766432+0000","last_peered":"2023-12-07T21:11:09.766432+0000","last_clean":"2023-12-07T21:11:09.766432+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:11:09.766432+0000","last_undegraded":"2023-12-07T21:11:09.766432+0000","last_fullsized":"2023-12-07T21:11:09.766432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807381+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:11:03.807381+0000","last_peered":"2023-12-07T21:11:03.807381+0000","last_clean":"2023-12-07T21:11:03.807381+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:11:03.807381+0000","last_undegraded":"2023-12-07T21:11:03.807381+0000","last_fullsized":"2023-12-07T21:11:03.807381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'37","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.570341+0000","last_change":"2023-12-07T21:09:00.887309+0000","last_active":"2023-12-07T21:11:06.570341+0000","last_peered":"2023-12-07T21:11:06.570341+0000","last_clean":"2023-12-07T21:11:06.570341+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:11:06.570341+0000","last_undegraded":"2023-12-07T21:11:06.570341+0000","last_fullsized":"2023-12-07T21:11:06.570341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.948280+0000","last_change":"2023-12-07T21:09:02.907306+0000","last_active":"2023-12-07T21:09:35.948280+0000","last_peered":"2023-12-07T21:09:35.948280+0000","last_clean":"2023-12-07T21:09:35.948280+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:09:35.948280+0000","last_undegraded":"2023-12-07T21:09:35.948280+0000","last_fullsized":"2023-12-07T21:09:35.948280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608912+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:11:10.608912+0000","last_peered":"2023-12-07T21:11:10.608912+0000","last_clean":"2023-12-07T21:11:10.608912+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:11:10.608912+0000","last_undegraded":"2023-12-07T21:11:10.608912+0000","last_fullsized":"2023-12-07T21:11:10.608912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608122+0000","last_change":"2023-12-07T21:08:56.885223+0000","last_active":"2023-12-07T21:11:10.608122+0000","last_peered":"2023-12-07T21:11:10.608122+0000","last_clean":"2023-12-07T21:11:10.608122+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:11:10.608122+0000","last_undegraded":"2023-12-07T21:11:10.608122+0000","last_fullsized":"2023-12-07T21:11:10.608122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766451+0000","last_change":"2023-12-07T21:08:54.887587+0000","last_active":"2023-12-07T21:11:09.766451+0000","last_peered":"2023-12-07T21:11:09.766451+0000","last_clean":"2023-12-07T21:11:09.766451+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:11:09.766451+0000","last_undegraded":"2023-12-07T21:11:09.766451+0000","last_fullsized":"2023-12-07T21:11:09.766451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188054+0000","last_change":"2023-12-07T21:08:58.876479+0000","last_active":"2023-12-07T21:11:10.188054+0000","last_peered":"2023-12-07T21:11:10.188054+0000","last_clean":"2023-12-07T21:11:10.188054+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:11:10.188054+0000","last_undegraded":"2023-12-07T21:11:10.188054+0000","last_fullsized":"2023-12-07T21:11:10.188054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'34","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802656+0000","last_change":"2023-12-07T21:09:00.890134+0000","last_active":"2023-12-07T21:11:08.802656+0000","last_peered":"2023-12-07T21:11:08.802656+0000","last_clean":"2023-12-07T21:11:08.802656+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:08.802656+0000","last_undegraded":"2023-12-07T21:11:08.802656+0000","last_fullsized":"2023-12-07T21:11:08.802656+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:16.616692+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:11:16.616692+0000","last_peered":"2023-12-07T21:11:16.616692+0000","last_clean":"2023-12-07T21:11:16.616692+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:11:16.616692+0000","last_undegraded":"2023-12-07T21:11:16.616692+0000","last_fullsized":"2023-12-07T21:11:16.616692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608884+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:11:10.608884+0000","last_peered":"2023-12-07T21:11:10.608884+0000","last_clean":"2023-12-07T21:11:10.608884+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:11:10.608884+0000","last_undegraded":"2023-12-07T21:11:10.608884+0000","last_fullsized":"2023-12-07T21:11:10.608884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'3","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345230+0000","last_change":"2023-12-07T21:08:56.872465+0000","last_active":"2023-12-07T21:11:09.345230+0000","last_peered":"2023-12-07T21:11:09.345230+0000","last_clean":"2023-12-07T21:11:09.345230+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:11:09.345230+0000","last_undegraded":"2023-12-07T21:11:09.345230+0000","last_fullsized":"2023-12-07T21:11:09.345230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607746+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:11:10.607746+0000","last_peered":"2023-12-07T21:11:10.607746+0000","last_clean":"2023-12-07T21:11:10.607746+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:11:10.607746+0000","last_undegraded":"2023-12-07T21:11:10.607746+0000","last_fullsized":"2023-12-07T21:11:10.607746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767201+0000","last_change":"2023-12-07T21:08:58.875630+0000","last_active":"2023-12-07T21:11:09.767201+0000","last_peered":"2023-12-07T21:11:09.767201+0000","last_clean":"2023-12-07T21:11:09.767201+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:09.767201+0000","last_undegraded":"2023-12-07T21:11:09.767201+0000","last_fullsized":"2023-12-07T21:11:09.767201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808601+0000","last_change":"2023-12-07T21:09:00.896323+0000","last_active":"2023-12-07T21:11:03.808601+0000","last_peered":"2023-12-07T21:11:03.808601+0000","last_clean":"2023-12-07T21:11:03.808601+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:11:03.808601+0000","last_undegraded":"2023-12-07T21:11:03.808601+0000","last_fullsized":"2023-12-07T21:11:03.808601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411900+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411900+0000","last_peered":"2023-12-07T21:11:10.411900+0000","last_clean":"2023-12-07T21:11:10.411900+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411900+0000","last_undegraded":"2023-12-07T21:11:10.411900+0000","last_fullsized":"2023-12-07T21:11:10.411900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608864+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:11:10.608864+0000","last_peered":"2023-12-07T21:11:10.608864+0000","last_clean":"2023-12-07T21:11:10.608864+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:11:10.608864+0000","last_undegraded":"2023-12-07T21:11:10.608864+0000","last_fullsized":"2023-12-07T21:11:10.608864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187884+0000","last_change":"2023-12-07T21:08:56.871124+0000","last_active":"2023-12-07T21:11:10.187884+0000","last_peered":"2023-12-07T21:11:10.187884+0000","last_clean":"2023-12-07T21:11:10.187884+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:11:10.187884+0000","last_undegraded":"2023-12-07T21:11:10.187884+0000","last_fullsized":"2023-12-07T21:11:10.187884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766523+0000","last_change":"2023-12-07T21:08:54.876774+0000","last_active":"2023-12-07T21:11:09.766523+0000","last_peered":"2023-12-07T21:11:09.766523+0000","last_clean":"2023-12-07T21:11:09.766523+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:11:09.766523+0000","last_undegraded":"2023-12-07T21:11:09.766523+0000","last_fullsized":"2023-12-07T21:11:09.766523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767196+0000","last_change":"2023-12-07T21:08:58.876085+0000","last_active":"2023-12-07T21:11:09.767196+0000","last_peered":"2023-12-07T21:11:09.767196+0000","last_clean":"2023-12-07T21:11:09.767196+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:09.767196+0000","last_undegraded":"2023-12-07T21:11:09.767196+0000","last_fullsized":"2023-12-07T21:11:09.767196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.102589+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:17.102589+0000","last_peered":"2023-12-07T21:11:17.102589+0000","last_clean":"2023-12-07T21:11:17.102589+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:17.102589+0000","last_undegraded":"2023-12-07T21:11:17.102589+0000","last_fullsized":"2023-12-07T21:11:17.102589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.804304+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:27.804304+0000","last_peered":"2023-12-07T21:11:27.804304+0000","last_clean":"2023-12-07T21:11:27.804304+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:27.804304+0000","last_undegraded":"2023-12-07T21:11:27.804304+0000","last_fullsized":"2023-12-07T21:11:27.804304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.951498+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:09:35.951498+0000","last_peered":"2023-12-07T21:09:35.951498+0000","last_clean":"2023-12-07T21:09:35.951498+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:09:35.951498+0000","last_undegraded":"2023-12-07T21:09:35.951498+0000","last_fullsized":"2023-12-07T21:09:35.951498+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187796+0000","last_change":"2023-12-07T21:08:56.870984+0000","last_active":"2023-12-07T21:11:10.187796+0000","last_peered":"2023-12-07T21:11:10.187796+0000","last_clean":"2023-12-07T21:11:10.187796+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:11:10.187796+0000","last_undegraded":"2023-12-07T21:11:10.187796+0000","last_fullsized":"2023-12-07T21:11:10.187796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607752+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:11:10.607752+0000","last_peered":"2023-12-07T21:11:10.607752+0000","last_clean":"2023-12-07T21:11:10.607752+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:11:10.607752+0000","last_undegraded":"2023-12-07T21:11:10.607752+0000","last_fullsized":"2023-12-07T21:11:10.607752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188024+0000","last_change":"2023-12-07T21:08:58.881984+0000","last_active":"2023-12-07T21:11:10.188024+0000","last_peered":"2023-12-07T21:11:10.188024+0000","last_clean":"2023-12-07T21:11:10.188024+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:11:10.188024+0000","last_undegraded":"2023-12-07T21:11:10.188024+0000","last_fullsized":"2023-12-07T21:11:10.188024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'31","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345644+0000","last_change":"2023-12-07T21:09:00.894601+0000","last_active":"2023-12-07T21:11:09.345644+0000","last_peered":"2023-12-07T21:11:09.345644+0000","last_clean":"2023-12-07T21:11:09.345644+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:09.345644+0000","last_undegraded":"2023-12-07T21:11:09.345644+0000","last_fullsized":"2023-12-07T21:11:09.345644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608739+0000","last_change":"2023-12-07T21:09:02.907688+0000","last_active":"2023-12-07T21:11:10.608739+0000","last_peered":"2023-12-07T21:11:10.608739+0000","last_clean":"2023-12-07T21:11:10.608739+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:11:10.608739+0000","last_undegraded":"2023-12-07T21:11:10.608739+0000","last_fullsized":"2023-12-07T21:11:10.608739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:13.097530+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:10:13.097530+0000","last_peered":"2023-12-07T21:10:13.097530+0000","last_clean":"2023-12-07T21:10:13.097530+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:10:13.097530+0000","last_undegraded":"2023-12-07T21:10:13.097530+0000","last_fullsized":"2023-12-07T21:10:13.097530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608124+0000","last_change":"2023-12-07T21:08:56.873059+0000","last_active":"2023-12-07T21:11:10.608124+0000","last_peered":"2023-12-07T21:11:10.608124+0000","last_clean":"2023-12-07T21:11:10.608124+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:11:10.608124+0000","last_undegraded":"2023-12-07T21:11:10.608124+0000","last_fullsized":"2023-12-07T21:11:10.608124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800263+0000","last_change":"2023-12-07T21:08:54.890887+0000","last_active":"2023-12-07T21:10:58.800263+0000","last_peered":"2023-12-07T21:10:58.800263+0000","last_clean":"2023-12-07T21:10:58.800263+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:10:58.800263+0000","last_undegraded":"2023-12-07T21:10:58.800263+0000","last_fullsized":"2023-12-07T21:10:58.800263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767118+0000","last_change":"2023-12-07T21:08:58.878440+0000","last_active":"2023-12-07T21:11:09.767118+0000","last_peered":"2023-12-07T21:11:09.767118+0000","last_clean":"2023-12-07T21:11:09.767118+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:09.767118+0000","last_undegraded":"2023-12-07T21:11:09.767118+0000","last_fullsized":"2023-12-07T21:11:09.767118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'27","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.517317+0000","last_change":"2023-12-07T21:09:00.889913+0000","last_active":"2023-12-07T21:11:06.517317+0000","last_peered":"2023-12-07T21:11:06.517317+0000","last_clean":"2023-12-07T21:11:06.517317+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:11:06.517317+0000","last_undegraded":"2023-12-07T21:11:06.517317+0000","last_fullsized":"2023-12-07T21:11:06.517317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:35.942544+0000","last_change":"2023-12-07T21:09:02.906202+0000","last_active":"2023-12-07T21:09:35.942544+0000","last_peered":"2023-12-07T21:09:35.942544+0000","last_clean":"2023-12-07T21:09:35.942544+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:09:35.942544+0000","last_undegraded":"2023-12-07T21:09:35.942544+0000","last_fullsized":"2023-12-07T21:09:35.942544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.171590+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:10:59.171590+0000","last_peered":"2023-12-07T21:10:59.171590+0000","last_clean":"2023-12-07T21:10:59.171590+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:10:59.171590+0000","last_undegraded":"2023-12-07T21:10:59.171590+0000","last_fullsized":"2023-12-07T21:10:59.171590+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'13","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187822+0000","last_change":"2023-12-07T21:08:56.869733+0000","last_active":"2023-12-07T21:11:10.187822+0000","last_peered":"2023-12-07T21:11:10.187822+0000","last_clean":"2023-12-07T21:11:10.187822+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:11:10.187822+0000","last_undegraded":"2023-12-07T21:11:10.187822+0000","last_fullsized":"2023-12-07T21:11:10.187822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807399+0000","last_change":"2023-12-07T21:08:54.878825+0000","last_active":"2023-12-07T21:11:03.807399+0000","last_peered":"2023-12-07T21:11:03.807399+0000","last_clean":"2023-12-07T21:11:03.807399+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:11:03.807399+0000","last_undegraded":"2023-12-07T21:11:03.807399+0000","last_fullsized":"2023-12-07T21:11:03.807399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'6","reported_seq":115,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767169+0000","last_change":"2023-12-07T21:08:58.877654+0000","last_active":"2023-12-07T21:11:09.767169+0000","last_peered":"2023-12-07T21:11:09.767169+0000","last_clean":"2023-12-07T21:11:09.767169+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:09.767169+0000","last_undegraded":"2023-12-07T21:11:09.767169+0000","last_fullsized":"2023-12-07T21:11:09.767169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:06.526292+0000","last_change":"2023-12-07T21:09:00.887872+0000","last_active":"2023-12-07T21:11:06.526292+0000","last_peered":"2023-12-07T21:11:06.526292+0000","last_clean":"2023-12-07T21:11:06.526292+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:11:06.526292+0000","last_undegraded":"2023-12-07T21:11:06.526292+0000","last_fullsized":"2023-12-07T21:11:06.526292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.597770+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:15.597770+0000","last_peered":"2023-12-07T21:11:15.597770+0000","last_clean":"2023-12-07T21:11:15.597770+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:15.597770+0000","last_undegraded":"2023-12-07T21:11:15.597770+0000","last_fullsized":"2023-12-07T21:11:15.597770+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608930+0000","last_change":"2023-12-07T21:09:04.928655+0000","last_active":"2023-12-07T21:11:10.608930+0000","last_peered":"2023-12-07T21:11:10.608930+0000","last_clean":"2023-12-07T21:11:10.608930+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:11:10.608930+0000","last_undegraded":"2023-12-07T21:11:10.608930+0000","last_fullsized":"2023-12-07T21:11:10.608930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808984+0000","last_change":"2023-12-07T21:08:56.884246+0000","last_active":"2023-12-07T21:11:08.808984+0000","last_peered":"2023-12-07T21:11:08.808984+0000","last_clean":"2023-12-07T21:11:08.808984+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:11:08.808984+0000","last_undegraded":"2023-12-07T21:11:08.808984+0000","last_fullsized":"2023-12-07T21:11:08.808984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806724+0000","last_change":"2023-12-07T21:08:54.888408+0000","last_active":"2023-12-07T21:11:03.806724+0000","last_peered":"2023-12-07T21:11:03.806724+0000","last_clean":"2023-12-07T21:11:03.806724+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:11:03.806724+0000","last_undegraded":"2023-12-07T21:11:03.806724+0000","last_fullsized":"2023-12-07T21:11:03.806724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802632+0000","last_change":"2023-12-07T21:08:56.873286+0000","last_active":"2023-12-07T21:11:08.802632+0000","last_peered":"2023-12-07T21:11:08.802632+0000","last_clean":"2023-12-07T21:11:08.802632+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:11:08.802632+0000","last_undegraded":"2023-12-07T21:11:08.802632+0000","last_fullsized":"2023-12-07T21:11:08.802632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800891+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:11:03.800891+0000","last_peered":"2023-12-07T21:11:03.800891+0000","last_clean":"2023-12-07T21:11:03.800891+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:11:03.800891+0000","last_undegraded":"2023-12-07T21:11:03.800891+0000","last_fullsized":"2023-12-07T21:11:03.800891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809648+0000","last_change":"2023-12-07T21:08:56.874905+0000","last_active":"2023-12-07T21:11:08.809648+0000","last_peered":"2023-12-07T21:11:08.809648+0000","last_clean":"2023-12-07T21:11:08.809648+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:11:08.809648+0000","last_undegraded":"2023-12-07T21:11:08.809648+0000","last_fullsized":"2023-12-07T21:11:08.809648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808292+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:11:03.808292+0000","last_peered":"2023-12-07T21:11:03.808292+0000","last_clean":"2023-12-07T21:11:03.808292+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:11:03.808292+0000","last_undegraded":"2023-12-07T21:11:03.808292+0000","last_fullsized":"2023-12-07T21:11:03.808292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802478+0000","last_change":"2023-12-07T21:08:56.872273+0000","last_active":"2023-12-07T21:11:08.802478+0000","last_peered":"2023-12-07T21:11:08.802478+0000","last_clean":"2023-12-07T21:11:08.802478+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:11:08.802478+0000","last_undegraded":"2023-12-07T21:11:08.802478+0000","last_fullsized":"2023-12-07T21:11:08.802478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801133+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:11:03.801133+0000","last_peered":"2023-12-07T21:11:03.801133+0000","last_clean":"2023-12-07T21:11:03.801133+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:11:03.801133+0000","last_undegraded":"2023-12-07T21:11:03.801133+0000","last_fullsized":"2023-12-07T21:11:03.801133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801089+0000","last_change":"2023-12-07T21:08:56.876070+0000","last_active":"2023-12-07T21:11:03.801089+0000","last_peered":"2023-12-07T21:11:03.801089+0000","last_clean":"2023-12-07T21:11:03.801089+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:11:03.801089+0000","last_undegraded":"2023-12-07T21:11:03.801089+0000","last_fullsized":"2023-12-07T21:11:03.801089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802500+0000","last_change":"2023-12-07T21:08:54.874578+0000","last_active":"2023-12-07T21:11:08.802500+0000","last_peered":"2023-12-07T21:11:08.802500+0000","last_clean":"2023-12-07T21:11:08.802500+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:11:08.802500+0000","last_undegraded":"2023-12-07T21:11:08.802500+0000","last_fullsized":"2023-12-07T21:11:08.802500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807052+0000","last_change":"2023-12-07T21:08:56.883348+0000","last_active":"2023-12-07T21:11:03.807052+0000","last_peered":"2023-12-07T21:11:03.807052+0000","last_clean":"2023-12-07T21:11:03.807052+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:11:03.807052+0000","last_undegraded":"2023-12-07T21:11:03.807052+0000","last_fullsized":"2023-12-07T21:11:03.807052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808756+0000","last_change":"2023-12-07T21:08:54.887259+0000","last_active":"2023-12-07T21:11:08.808756+0000","last_peered":"2023-12-07T21:11:08.808756+0000","last_clean":"2023-12-07T21:11:08.808756+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:11:08.808756+0000","last_undegraded":"2023-12-07T21:11:08.808756+0000","last_fullsized":"2023-12-07T21:11:08.808756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800970+0000","last_change":"2023-12-07T21:08:56.876299+0000","last_active":"2023-12-07T21:11:03.800970+0000","last_peered":"2023-12-07T21:11:03.800970+0000","last_clean":"2023-12-07T21:11:03.800970+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:11:03.800970+0000","last_undegraded":"2023-12-07T21:11:03.800970+0000","last_fullsized":"2023-12-07T21:11:03.800970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808785+0000","last_change":"2023-12-07T21:08:54.885457+0000","last_active":"2023-12-07T21:11:08.808785+0000","last_peered":"2023-12-07T21:11:08.808785+0000","last_clean":"2023-12-07T21:11:08.808785+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:11:08.808785+0000","last_undegraded":"2023-12-07T21:11:08.808785+0000","last_fullsized":"2023-12-07T21:11:08.808785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806817+0000","last_change":"2023-12-07T21:08:56.887101+0000","last_active":"2023-12-07T21:11:03.806817+0000","last_peered":"2023-12-07T21:11:03.806817+0000","last_clean":"2023-12-07T21:11:03.806817+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:11:03.806817+0000","last_undegraded":"2023-12-07T21:11:03.806817+0000","last_fullsized":"2023-12-07T21:11:03.806817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802670+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:11:08.802670+0000","last_peered":"2023-12-07T21:11:08.802670+0000","last_clean":"2023-12-07T21:11:08.802670+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:11:08.802670+0000","last_undegraded":"2023-12-07T21:11:08.802670+0000","last_fullsized":"2023-12-07T21:11:08.802670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766944+0000","last_change":"2023-12-07T21:08:56.882240+0000","last_active":"2023-12-07T21:11:09.766944+0000","last_peered":"2023-12-07T21:11:09.766944+0000","last_clean":"2023-12-07T21:11:09.766944+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:11:09.766944+0000","last_undegraded":"2023-12-07T21:11:09.766944+0000","last_fullsized":"2023-12-07T21:11:09.766944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809216+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:11:08.809216+0000","last_peered":"2023-12-07T21:11:08.809216+0000","last_clean":"2023-12-07T21:11:08.809216+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:11:08.809216+0000","last_undegraded":"2023-12-07T21:11:08.809216+0000","last_fullsized":"2023-12-07T21:11:08.809216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608162+0000","last_change":"2023-12-07T21:08:56.875906+0000","last_active":"2023-12-07T21:11:10.608162+0000","last_peered":"2023-12-07T21:11:10.608162+0000","last_clean":"2023-12-07T21:11:10.608162+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:11:10.608162+0000","last_undegraded":"2023-12-07T21:11:10.608162+0000","last_fullsized":"2023-12-07T21:11:10.608162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345160+0000","last_change":"2023-12-07T21:08:54.883629+0000","last_active":"2023-12-07T21:11:09.345160+0000","last_peered":"2023-12-07T21:11:09.345160+0000","last_clean":"2023-12-07T21:11:09.345160+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:11:09.345160+0000","last_undegraded":"2023-12-07T21:11:09.345160+0000","last_fullsized":"2023-12-07T21:11:09.345160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345344+0000","last_change":"2023-12-07T21:08:56.876309+0000","last_active":"2023-12-07T21:11:09.345344+0000","last_peered":"2023-12-07T21:11:09.345344+0000","last_clean":"2023-12-07T21:11:09.345344+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:11:09.345344+0000","last_undegraded":"2023-12-07T21:11:09.345344+0000","last_fullsized":"2023-12-07T21:11:09.345344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766567+0000","last_change":"2023-12-07T21:08:54.887130+0000","last_active":"2023-12-07T21:11:09.766567+0000","last_peered":"2023-12-07T21:11:09.766567+0000","last_clean":"2023-12-07T21:11:09.766567+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:11:09.766567+0000","last_undegraded":"2023-12-07T21:11:09.766567+0000","last_fullsized":"2023-12-07T21:11:09.766567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766855+0000","last_change":"2023-12-07T21:08:56.871205+0000","last_active":"2023-12-07T21:11:09.766855+0000","last_peered":"2023-12-07T21:11:09.766855+0000","last_clean":"2023-12-07T21:11:09.766855+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:11:09.766855+0000","last_undegraded":"2023-12-07T21:11:09.766855+0000","last_fullsized":"2023-12-07T21:11:09.766855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766587+0000","last_change":"2023-12-07T21:08:54.884013+0000","last_active":"2023-12-07T21:11:09.766587+0000","last_peered":"2023-12-07T21:11:09.766587+0000","last_clean":"2023-12-07T21:11:09.766587+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:11:09.766587+0000","last_undegraded":"2023-12-07T21:11:09.766587+0000","last_fullsized":"2023-12-07T21:11:09.766587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766814+0000","last_change":"2023-12-07T21:08:56.879513+0000","last_active":"2023-12-07T21:11:09.766814+0000","last_peered":"2023-12-07T21:11:09.766814+0000","last_clean":"2023-12-07T21:11:09.766814+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:11:09.766814+0000","last_undegraded":"2023-12-07T21:11:09.766814+0000","last_fullsized":"2023-12-07T21:11:09.766814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607834+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:11:10.607834+0000","last_peered":"2023-12-07T21:11:10.607834+0000","last_clean":"2023-12-07T21:11:10.607834+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:11:10.607834+0000","last_undegraded":"2023-12-07T21:11:10.607834+0000","last_fullsized":"2023-12-07T21:11:10.607834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'15","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766836+0000","last_change":"2023-12-07T21:08:56.882760+0000","last_active":"2023-12-07T21:11:09.766836+0000","last_peered":"2023-12-07T21:11:09.766836+0000","last_clean":"2023-12-07T21:11:09.766836+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:11:09.766836+0000","last_undegraded":"2023-12-07T21:11:09.766836+0000","last_fullsized":"2023-12-07T21:11:09.766836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607826+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:11:10.607826+0000","last_peered":"2023-12-07T21:11:10.607826+0000","last_clean":"2023-12-07T21:11:10.607826+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:11:10.607826+0000","last_undegraded":"2023-12-07T21:11:10.607826+0000","last_fullsized":"2023-12-07T21:11:10.607826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608179+0000","last_change":"2023-12-07T21:08:56.876875+0000","last_active":"2023-12-07T21:11:10.608179+0000","last_peered":"2023-12-07T21:11:10.608179+0000","last_clean":"2023-12-07T21:11:10.608179+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:11:10.608179+0000","last_undegraded":"2023-12-07T21:11:10.608179+0000","last_fullsized":"2023-12-07T21:11:10.608179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187739+0000","last_change":"2023-12-07T21:08:54.885432+0000","last_active":"2023-12-07T21:11:10.187739+0000","last_peered":"2023-12-07T21:11:10.187739+0000","last_clean":"2023-12-07T21:11:10.187739+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:11:10.187739+0000","last_undegraded":"2023-12-07T21:11:10.187739+0000","last_fullsized":"2023-12-07T21:11:10.187739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808321+0000","last_change":"2023-12-07T21:08:56.889380+0000","last_active":"2023-12-07T21:11:08.808321+0000","last_peered":"2023-12-07T21:11:08.808321+0000","last_clean":"2023-12-07T21:11:08.808321+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:11:08.808321+0000","last_undegraded":"2023-12-07T21:11:08.808321+0000","last_fullsized":"2023-12-07T21:11:08.808321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607856+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:11:10.607856+0000","last_peered":"2023-12-07T21:11:10.607856+0000","last_clean":"2023-12-07T21:11:10.607856+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:11:10.607856+0000","last_undegraded":"2023-12-07T21:11:10.607856+0000","last_fullsized":"2023-12-07T21:11:10.607856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607882+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:11:10.607882+0000","last_peered":"2023-12-07T21:11:10.607882+0000","last_clean":"2023-12-07T21:11:10.607882+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:11:10.607882+0000","last_undegraded":"2023-12-07T21:11:10.607882+0000","last_fullsized":"2023-12-07T21:11:10.607882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345392+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:11:09.345392+0000","last_peered":"2023-12-07T21:11:09.345392+0000","last_clean":"2023-12-07T21:11:09.345392+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:11:09.345392+0000","last_undegraded":"2023-12-07T21:11:09.345392+0000","last_fullsized":"2023-12-07T21:11:09.345392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345178+0000","last_change":"2023-12-07T21:08:54.883760+0000","last_active":"2023-12-07T21:11:09.345178+0000","last_peered":"2023-12-07T21:11:09.345178+0000","last_clean":"2023-12-07T21:11:09.345178+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:11:09.345178+0000","last_undegraded":"2023-12-07T21:11:09.345178+0000","last_fullsized":"2023-12-07T21:11:09.345178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766992+0000","last_change":"2023-12-07T21:08:56.881838+0000","last_active":"2023-12-07T21:11:09.766992+0000","last_peered":"2023-12-07T21:11:09.766992+0000","last_clean":"2023-12-07T21:11:09.766992+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:11:09.766992+0000","last_undegraded":"2023-12-07T21:11:09.766992+0000","last_fullsized":"2023-12-07T21:11:09.766992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1968,"ondisk_log_size":1968,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1301,"ondisk_log_size":1301,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705702,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42199999999999999,"15min":0.42299999999999999},"min":{"1min":0.35099999999999998,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.54300000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.34499999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56899999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.34300000000000003,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.44400000000000001,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.34599999999999997,"15min":0.34799999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.48199999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.28699999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.52500000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.34599999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705701,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.33300000000000002,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.50800000000000001,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.5},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.309,"5min":0.219,"15min":0.219},"max":{"1min":0.58699999999999997,"5min":0.621,"15min":0.621},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.318,"15min":0.318},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.39100000000000001,"5min":0.436,"15min":0.436},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Dec 7 21:10:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.247,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36499999999999999,"15min":0.36799999999999999},"min":{"1min":0.27200000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.46000000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.41099999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705701,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.28000000000000003,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.23799999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.23799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.54200000000000004,"5min":0.629,"15min":0.629},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.23499999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Dec 7 21:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.376,"15min":0.38},"min":{"1min":0.25900000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.48399999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.45100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.28899999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68300000000000005,"5min":0.747,"15min":0.747},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47799999999999998,"15min":0.47699999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.47299999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.499}]},{"osd":3,"last update":"Thu Dec 7 21:10:40 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.439}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:11:31.340 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.340 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.340 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.340 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.340 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.340 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.341 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.341 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.341 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.341 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.341 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.341 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.342 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.342 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.342 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.342 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.342 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.342 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.342 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.343 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.343 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.343 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.343 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.343 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.343 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.343 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.344 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.344 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.344 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.344 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.344 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.344 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.345 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.345 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.345 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.345 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.345 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.345 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.346 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.346 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.346 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.346 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.346 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.346 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.347 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.347 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.347 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.347 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.347 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.347 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.347 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.348 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.348 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.348 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.348 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.348 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.348 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.349 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.349 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.349 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.349 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.349 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.349 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.350 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.350 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.350 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.350 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.350 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.350 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.350 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.351 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.351 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.351 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.351 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.351 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.351 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.352 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.352 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.352 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.352 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.352 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.352 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.352 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.353 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.353 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.353 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.353 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.353 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.353 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.354 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.354 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.354 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.354 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.354 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.354 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.355 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-07T21:08:40.790884+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=40, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.355 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.355 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.355 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.355 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.355 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.355 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.356 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.356 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.356 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.356 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.356 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.356 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.356 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.357 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.357 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.357 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.357 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.357 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.357 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.357 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.358 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.358 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.358 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.358 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.358 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.358 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.358 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.359 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.359 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.359 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.359 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.359 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.359 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.360 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.360 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.360 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.360 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.360 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.360 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.360 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.361 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.361 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.361 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.361 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.361 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.361 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.361 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.362 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.362 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.362 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.362 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.362 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.362 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.363 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.363 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.363 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.363 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.363 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.363 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.364 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.364 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.364 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.364 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.364 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.364 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.364 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.365 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.365 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.365 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.365 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.365 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.365 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.366 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.366 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.366 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.366 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.366 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.366 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.367 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.367 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.367 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.367 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.367 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.367 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.367 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.368 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.368 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.368 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.368 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.368 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.368 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.369 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.369 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.369 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.369 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.369 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.369 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.370 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.370 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.370 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.370 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.370 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.370 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.371 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.371 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.371 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.371 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.371 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.371 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.371 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.372 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.372 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.372 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.372 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.372 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.372 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.373 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.373 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.373 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.373 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.373 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.373 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.373 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.374 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.374 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.374 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.374 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.374 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.374 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.374 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.375 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.375 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.375 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.375 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.375 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.375 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.376 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.376 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.376 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.376 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.376 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.376 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.376 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.377 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.377 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.377 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.377 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:31.377 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:11:51.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:11:51.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.497+0000 7fdb95eaf640 1 Processor -- start 2023-12-07T21:11:51.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.497+0000 7fdb95eaf640 1 -- start start 2023-12-07T21:11:51.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.497+0000 7fdb95eaf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdb90070610 0x7fdb900709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:51.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.497+0000 7fdb95eaf640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9006e240 con 0x7fdb9006cc90 2023-12-07T21:11:51.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.497+0000 7fdb95eaf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb90070140 con 0x7fdb90070610 2023-12-07T21:11:51.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.498+0000 7fdb8f7fe640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdb90070610 0x7fdb900709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:51.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.498+0000 7fdb8effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdb9006cc90 0x7fdb9006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:53620/0 (socket says 172.21.15.89:53620) 2023-12-07T21:11:51.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.498+0000 7fdb8effd640 1 -- 172.21.15.89:0/806957443 learned_addr learned my addr 172.21.15.89:0/806957443 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:11:51.490 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.498+0000 7fdb8f7fe640 1 -- 172.21.15.89:0/806957443 >> v1:172.21.15.89:6789/0 conn(0x7fdb9006cc90 legacy=0x7fdb9006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:51.491 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.498+0000 7fdb8f7fe640 1 -- 172.21.15.89:0/806957443 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9006e9a0 con 0x7fdb90070610 2023-12-07T21:11:51.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.499+0000 7fdb8f7fe640 1 --2- 172.21.15.89:0/806957443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb90070610 0x7fdb900709f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009720 tx=0x7fdb8002c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8f2359167816d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:51.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.499+0000 7fdb8e7fc640 1 -- 172.21.15.89:0/806957443 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb80031740 con 0x7fdb90070610 2023-12-07T21:11:51.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.499+0000 7fdb8e7fc640 1 -- 172.21.15.89:0/806957443 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb800318a0 con 0x7fdb90070610 2023-12-07T21:11:51.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.499+0000 7fdb8e7fc640 1 -- 172.21.15.89:0/806957443 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb80031b60 con 0x7fdb90070610 2023-12-07T21:11:51.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.499+0000 7fdb95eaf640 1 -- 172.21.15.89:0/806957443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb90070610 msgr2=0x7fdb900709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:51.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.499+0000 7fdb95eaf640 1 --2- 172.21.15.89:0/806957443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb90070610 0x7fdb900709f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009720 tx=0x7fdb8002c950 comp rx=0 tx=0).stop 2023-12-07T21:11:51.494 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.499+0000 7fdb95eaf640 1 -- 172.21.15.89:0/806957443 shutdown_connections 2023-12-07T21:11:51.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.499+0000 7fdb95eaf640 1 --2- 172.21.15.89:0/806957443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb90070610 0x7fdb900709f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:51.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.499+0000 7fdb95eaf640 1 -- 172.21.15.89:0/806957443 >> 172.21.15.89:0/806957443 conn(0x7fdb900987f0 msgr2=0x7fdb90098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:51.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.499+0000 7fdb95eaf640 1 -- 172.21.15.89:0/806957443 shutdown_connections 2023-12-07T21:11:51.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.499+0000 7fdb95eaf640 1 -- 172.21.15.89:0/806957443 wait complete. 2023-12-07T21:11:51.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.500+0000 7fdb95eaf640 1 Processor -- start 2023-12-07T21:11:51.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.500+0000 7fdb95eaf640 1 -- start start 2023-12-07T21:11:51.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb95eaf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb9006cc90 0x7fdb900959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:51.495 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb95eaf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb90095ef0 con 0x7fdb9006cc90 2023-12-07T21:11:51.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb8f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb9006cc90 0x7fdb900959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:51.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb8f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb9006cc90 0x7fdb900959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46234/0 (socket says 172.21.15.89:46234) 2023-12-07T21:11:51.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb8f7fe640 1 -- 172.21.15.89:0/4161111534 learned_addr learned my addr 172.21.15.89:0/4161111534 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:11:51.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb8f7fe640 1 -- 172.21.15.89:0/4161111534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb80009400 con 0x7fdb9006cc90 2023-12-07T21:11:51.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb8f7fe640 1 --2- 172.21.15.89:0/4161111534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb9006cc90 0x7fdb900959b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdb80000c00 tx=0x7fdb800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:51.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb77fff640 1 -- 172.21.15.89:0/4161111534 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb8003f070 con 0x7fdb9006cc90 2023-12-07T21:11:51.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb77fff640 1 -- 172.21.15.89:0/4161111534 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8003ab80 con 0x7fdb9006cc90 2023-12-07T21:11:51.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb95eaf640 1 -- 172.21.15.89:0/4161111534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb90129ea0 con 0x7fdb9006cc90 2023-12-07T21:11:51.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb77fff640 1 -- 172.21.15.89:0/4161111534 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb8003ae60 con 0x7fdb9006cc90 2023-12-07T21:11:51.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.501+0000 7fdb95eaf640 1 -- 172.21.15.89:0/4161111534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb90122090 con 0x7fdb9006cc90 2023-12-07T21:11:51.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.502+0000 7fdb77fff640 1 -- 172.21.15.89:0/4161111534 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fdb8004c400 con 0x7fdb9006cc90 2023-12-07T21:11:51.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.502+0000 7fdb77fff640 1 --2- 172.21.15.89:0/4161111534 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdb7c037820 0x7fdb7c039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:11:51.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.502+0000 7fdb77fff640 1 -- 172.21.15.89:0/4161111534 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fdb8006d4f0 con 0x7fdb9006cc90 2023-12-07T21:11:51.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.502+0000 7fdb95eaf640 1 -- 172.21.15.89:0/4161111534 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb90121670 con 0x7fdb9006cc90 2023-12-07T21:11:51.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.503+0000 7fdb8effd640 1 --2- 172.21.15.89:0/4161111534 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdb7c037820 0x7fdb7c039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:11:51.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.503+0000 7fdb8effd640 1 --2- 172.21.15.89:0/4161111534 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdb7c037820 0x7fdb7c039ce0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdb84007fd0 tx=0x7fdb84007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:11:51.498 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.507+0000 7fdb77fff640 1 -- 172.21.15.89:0/4161111534 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb80035030 con 0x7fdb9006cc90 2023-12-07T21:11:51.664 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.673+0000 7fdb95eaf640 1 -- 172.21.15.89:0/4161111534 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb90070f30 con 0x7fdb7c037820 2023-12-07T21:11:51.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.689+0000 7fdb77fff640 1 -- 172.21.15.89:0/4161111534 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+666385 (secure 0 0 0) 0x7fdb840012f0 con 0x7fdb7c037820 2023-12-07T21:11:51.688 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:11:51.693 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:11:51.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.694+0000 7fdb95eaf640 1 -- 172.21.15.89:0/4161111534 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdb7c037820 msgr2=0x7fdb7c039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:51.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.694+0000 7fdb95eaf640 1 --2- 172.21.15.89:0/4161111534 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdb7c037820 0x7fdb7c039ce0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdb84007fd0 tx=0x7fdb84007ac0 comp rx=0 tx=0).stop 2023-12-07T21:11:51.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.694+0000 7fdb95eaf640 1 -- 172.21.15.89:0/4161111534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb9006cc90 msgr2=0x7fdb900959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:11:51.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.694+0000 7fdb95eaf640 1 --2- 172.21.15.89:0/4161111534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb9006cc90 0x7fdb900959b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdb80000c00 tx=0x7fdb800046c0 comp rx=0 tx=0).stop 2023-12-07T21:11:51.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.694+0000 7fdb95eaf640 1 -- 172.21.15.89:0/4161111534 shutdown_connections 2023-12-07T21:11:51.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.694+0000 7fdb95eaf640 1 --2- 172.21.15.89:0/4161111534 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fdb7c037820 0x7fdb7c039ce0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:51.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.694+0000 7fdb95eaf640 1 --2- 172.21.15.89:0/4161111534 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb9006cc90 0x7fdb900959b0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:11:51.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.694+0000 7fdb95eaf640 1 -- 172.21.15.89:0/4161111534 >> 172.21.15.89:0/4161111534 conn(0x7fdb900987f0 msgr2=0x7fdb901b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:11:51.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.694+0000 7fdb95eaf640 1 -- 172.21.15.89:0/4161111534 shutdown_connections 2023-12-07T21:11:51.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:11:51.694+0000 7fdb95eaf640 1 -- 172.21.15.89:0/4161111534 wait complete. 2023-12-07T21:11:51.697 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2023-12-07T21:11:50.102814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3933,"ondisk_log_size":3933,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003786"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807400+0000","last_change":"2023-12-07T21:08:54.882968+0000","last_active":"2023-12-07T21:11:03.807400+0000","last_peered":"2023-12-07T21:11:03.807400+0000","last_clean":"2023-12-07T21:11:03.807400+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:11:03.807400+0000","last_undegraded":"2023-12-07T21:11:03.807400+0000","last_fullsized":"2023-12-07T21:11:03.807400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767028+0000","last_change":"2023-12-07T21:08:56.887127+0000","last_active":"2023-12-07T21:11:09.767028+0000","last_peered":"2023-12-07T21:11:09.767028+0000","last_clean":"2023-12-07T21:11:09.767028+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:11:09.767028+0000","last_undegraded":"2023-12-07T21:11:09.767028+0000","last_fullsized":"2023-12-07T21:11:09.767028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801438+0000","last_change":"2023-12-07T21:08:54.890832+0000","last_active":"2023-12-07T21:11:03.801438+0000","last_peered":"2023-12-07T21:11:03.801438+0000","last_clean":"2023-12-07T21:11:03.801438+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:11:03.801438+0000","last_undegraded":"2023-12-07T21:11:03.801438+0000","last_fullsized":"2023-12-07T21:11:03.801438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:38.784125+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:09:38.784125+0000","last_peered":"2023-12-07T21:09:38.784125+0000","last_clean":"2023-12-07T21:09:38.784125+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:09:38.784125+0000","last_undegraded":"2023-12-07T21:09:38.784125+0000","last_fullsized":"2023-12-07T21:09:38.784125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808550+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:11:03.808550+0000","last_peered":"2023-12-07T21:11:03.808550+0000","last_clean":"2023-12-07T21:11:03.808550+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:11:03.808550+0000","last_undegraded":"2023-12-07T21:11:03.808550+0000","last_fullsized":"2023-12-07T21:11:03.808550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608236+0000","last_change":"2023-12-07T21:08:56.873919+0000","last_active":"2023-12-07T21:11:10.608236+0000","last_peered":"2023-12-07T21:11:10.608236+0000","last_clean":"2023-12-07T21:11:10.608236+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:11:10.608236+0000","last_undegraded":"2023-12-07T21:11:10.608236+0000","last_fullsized":"2023-12-07T21:11:10.608236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.805663+0000","last_change":"2023-12-07T21:08:54.880442+0000","last_active":"2023-12-07T21:10:58.805663+0000","last_peered":"2023-12-07T21:10:58.805663+0000","last_clean":"2023-12-07T21:10:58.805663+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:10:58.805663+0000","last_undegraded":"2023-12-07T21:10:58.805663+0000","last_fullsized":"2023-12-07T21:10:58.805663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608264+0000","last_change":"2023-12-07T21:08:56.874751+0000","last_active":"2023-12-07T21:11:10.608264+0000","last_peered":"2023-12-07T21:11:10.608264+0000","last_clean":"2023-12-07T21:11:10.608264+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:11:10.608264+0000","last_undegraded":"2023-12-07T21:11:10.608264+0000","last_fullsized":"2023-12-07T21:11:10.608264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607907+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:11:10.607907+0000","last_peered":"2023-12-07T21:11:10.607907+0000","last_clean":"2023-12-07T21:11:10.607907+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:11:10.607907+0000","last_undegraded":"2023-12-07T21:11:10.607907+0000","last_fullsized":"2023-12-07T21:11:10.607907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173605+0000","last_change":"2023-12-07T21:08:56.873414+0000","last_active":"2023-12-07T21:10:59.173605+0000","last_peered":"2023-12-07T21:10:59.173605+0000","last_clean":"2023-12-07T21:10:59.173605+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:10:59.173605+0000","last_undegraded":"2023-12-07T21:10:59.173605+0000","last_fullsized":"2023-12-07T21:10:59.173605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187656+0000","last_change":"2023-12-07T21:08:54.880274+0000","last_active":"2023-12-07T21:11:10.187656+0000","last_peered":"2023-12-07T21:11:10.187656+0000","last_clean":"2023-12-07T21:11:10.187656+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:11:10.187656+0000","last_undegraded":"2023-12-07T21:11:10.187656+0000","last_fullsized":"2023-12-07T21:11:10.187656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187892+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:11:10.187892+0000","last_peered":"2023-12-07T21:11:10.187892+0000","last_clean":"2023-12-07T21:11:10.187892+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:11:10.187892+0000","last_undegraded":"2023-12-07T21:11:10.187892+0000","last_fullsized":"2023-12-07T21:11:10.187892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607886+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:11:10.607886+0000","last_peered":"2023-12-07T21:11:10.607886+0000","last_clean":"2023-12-07T21:11:10.607886+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:11:10.607886+0000","last_undegraded":"2023-12-07T21:11:10.607886+0000","last_fullsized":"2023-12-07T21:11:10.607886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807323+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:11:03.807323+0000","last_peered":"2023-12-07T21:11:03.807323+0000","last_clean":"2023-12-07T21:11:03.807323+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:11:03.807323+0000","last_undegraded":"2023-12-07T21:11:03.807323+0000","last_fullsized":"2023-12-07T21:11:03.807323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345133+0000","last_change":"2023-12-07T21:08:54.891021+0000","last_active":"2023-12-07T21:11:09.345133+0000","last_peered":"2023-12-07T21:11:09.345133+0000","last_clean":"2023-12-07T21:11:09.345133+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:11:09.345133+0000","last_undegraded":"2023-12-07T21:11:09.345133+0000","last_fullsized":"2023-12-07T21:11:09.345133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'13","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807362+0000","last_change":"2023-12-07T21:08:56.874321+0000","last_active":"2023-12-07T21:11:03.807362+0000","last_peered":"2023-12-07T21:11:03.807362+0000","last_clean":"2023-12-07T21:11:03.807362+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:11:03.807362+0000","last_undegraded":"2023-12-07T21:11:03.807362+0000","last_fullsized":"2023-12-07T21:11:03.807362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608172+0000","last_change":"2023-12-07T21:08:56.874409+0000","last_active":"2023-12-07T21:11:10.608172+0000","last_peered":"2023-12-07T21:11:10.608172+0000","last_clean":"2023-12-07T21:11:10.608172+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:11:10.608172+0000","last_undegraded":"2023-12-07T21:11:10.608172+0000","last_fullsized":"2023-12-07T21:11:10.608172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766655+0000","last_change":"2023-12-07T21:08:54.887766+0000","last_active":"2023-12-07T21:11:09.766655+0000","last_peered":"2023-12-07T21:11:09.766655+0000","last_clean":"2023-12-07T21:11:09.766655+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:11:09.766655+0000","last_undegraded":"2023-12-07T21:11:09.766655+0000","last_fullsized":"2023-12-07T21:11:09.766655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766942+0000","last_change":"2023-12-07T21:08:56.876692+0000","last_active":"2023-12-07T21:11:09.766942+0000","last_peered":"2023-12-07T21:11:09.766942+0000","last_clean":"2023-12-07T21:11:09.766942+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:11:09.766942+0000","last_undegraded":"2023-12-07T21:11:09.766942+0000","last_fullsized":"2023-12-07T21:11:09.766942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187817+0000","last_change":"2023-12-07T21:08:54.885605+0000","last_active":"2023-12-07T21:11:10.187817+0000","last_peered":"2023-12-07T21:11:10.187817+0000","last_clean":"2023-12-07T21:11:10.187817+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:11:10.187817+0000","last_undegraded":"2023-12-07T21:11:10.187817+0000","last_fullsized":"2023-12-07T21:11:10.187817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'13","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766969+0000","last_change":"2023-12-07T21:08:56.882602+0000","last_active":"2023-12-07T21:11:09.766969+0000","last_peered":"2023-12-07T21:11:09.766969+0000","last_clean":"2023-12-07T21:11:09.766969+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:11:09.766969+0000","last_undegraded":"2023-12-07T21:11:09.766969+0000","last_fullsized":"2023-12-07T21:11:09.766969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766621+0000","last_change":"2023-12-07T21:08:54.889812+0000","last_active":"2023-12-07T21:11:09.766621+0000","last_peered":"2023-12-07T21:11:09.766621+0000","last_clean":"2023-12-07T21:11:09.766621+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:11:09.766621+0000","last_undegraded":"2023-12-07T21:11:09.766621+0000","last_fullsized":"2023-12-07T21:11:09.766621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345375+0000","last_change":"2023-12-07T21:08:56.875989+0000","last_active":"2023-12-07T21:11:09.345375+0000","last_peered":"2023-12-07T21:11:09.345375+0000","last_clean":"2023-12-07T21:11:09.345375+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:11:09.345375+0000","last_undegraded":"2023-12-07T21:11:09.345375+0000","last_fullsized":"2023-12-07T21:11:09.345375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766605+0000","last_change":"2023-12-07T21:08:54.878784+0000","last_active":"2023-12-07T21:11:09.766605+0000","last_peered":"2023-12-07T21:11:09.766605+0000","last_clean":"2023-12-07T21:11:09.766605+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:11:09.766605+0000","last_undegraded":"2023-12-07T21:11:09.766605+0000","last_fullsized":"2023-12-07T21:11:09.766605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187888+0000","last_change":"2023-12-07T21:08:56.875039+0000","last_active":"2023-12-07T21:11:10.187888+0000","last_peered":"2023-12-07T21:11:10.187888+0000","last_clean":"2023-12-07T21:11:10.187888+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:11:10.187888+0000","last_undegraded":"2023-12-07T21:11:10.187888+0000","last_fullsized":"2023-12-07T21:11:10.187888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345261+0000","last_change":"2023-12-07T21:08:54.890574+0000","last_active":"2023-12-07T21:11:09.345261+0000","last_peered":"2023-12-07T21:11:09.345261+0000","last_clean":"2023-12-07T21:11:09.345261+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:11:09.345261+0000","last_undegraded":"2023-12-07T21:11:09.345261+0000","last_fullsized":"2023-12-07T21:11:09.345261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766967+0000","last_change":"2023-12-07T21:08:56.883504+0000","last_active":"2023-12-07T21:11:09.766967+0000","last_peered":"2023-12-07T21:11:09.766967+0000","last_clean":"2023-12-07T21:11:09.766967+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:11:09.766967+0000","last_undegraded":"2023-12-07T21:11:09.766967+0000","last_fullsized":"2023-12-07T21:11:09.766967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607871+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:11:10.607871+0000","last_peered":"2023-12-07T21:11:10.607871+0000","last_clean":"2023-12-07T21:11:10.607871+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:11:10.607871+0000","last_undegraded":"2023-12-07T21:11:10.607871+0000","last_fullsized":"2023-12-07T21:11:10.607871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767525+0000","last_change":"2023-12-07T21:09:04.931981+0000","last_active":"2023-12-07T21:11:09.767525+0000","last_peered":"2023-12-07T21:11:09.767525+0000","last_clean":"2023-12-07T21:11:09.767525+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:11:09.767525+0000","last_undegraded":"2023-12-07T21:11:09.767525+0000","last_fullsized":"2023-12-07T21:11:09.767525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608196+0000","last_change":"2023-12-07T21:08:56.873551+0000","last_active":"2023-12-07T21:11:10.608196+0000","last_peered":"2023-12-07T21:11:10.608196+0000","last_clean":"2023-12-07T21:11:10.608196+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:11:10.608196+0000","last_undegraded":"2023-12-07T21:11:10.608196+0000","last_fullsized":"2023-12-07T21:11:10.608196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607680+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:11:10.607680+0000","last_peered":"2023-12-07T21:11:10.607680+0000","last_clean":"2023-12-07T21:11:10.607680+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:11:10.607680+0000","last_undegraded":"2023-12-07T21:11:10.607680+0000","last_fullsized":"2023-12-07T21:11:10.607680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.797174+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:12.797174+0000","last_peered":"2023-12-07T21:11:12.797174+0000","last_clean":"2023-12-07T21:11:12.797174+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:12.797174+0000","last_undegraded":"2023-12-07T21:11:12.797174+0000","last_fullsized":"2023-12-07T21:11:12.797174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'31","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608625+0000","last_change":"2023-12-07T21:09:00.895835+0000","last_active":"2023-12-07T21:11:10.608625+0000","last_peered":"2023-12-07T21:11:10.608625+0000","last_clean":"2023-12-07T21:11:10.608625+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:11:10.608625+0000","last_undegraded":"2023-12-07T21:11:10.608625+0000","last_fullsized":"2023-12-07T21:11:10.608625+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767372+0000","last_change":"2023-12-07T21:09:02.907297+0000","last_active":"2023-12-07T21:11:09.767372+0000","last_peered":"2023-12-07T21:11:09.767372+0000","last_clean":"2023-12-07T21:11:09.767372+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:11:09.767372+0000","last_undegraded":"2023-12-07T21:11:09.767372+0000","last_fullsized":"2023-12-07T21:11:09.767372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767538+0000","last_change":"2023-12-07T21:09:04.931948+0000","last_active":"2023-12-07T21:11:09.767538+0000","last_peered":"2023-12-07T21:11:09.767538+0000","last_clean":"2023-12-07T21:11:09.767538+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:11:09.767538+0000","last_undegraded":"2023-12-07T21:11:09.767538+0000","last_fullsized":"2023-12-07T21:11:09.767538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608060+0000","last_change":"2023-12-07T21:08:56.874761+0000","last_active":"2023-12-07T21:11:10.608060+0000","last_peered":"2023-12-07T21:11:10.608060+0000","last_clean":"2023-12-07T21:11:10.608060+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:11:10.608060+0000","last_undegraded":"2023-12-07T21:11:10.608060+0000","last_fullsized":"2023-12-07T21:11:10.608060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880632+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345523+0000","last_change":"2023-12-07T21:08:58.877458+0000","last_active":"2023-12-07T21:11:09.345523+0000","last_peered":"2023-12-07T21:11:09.345523+0000","last_clean":"2023-12-07T21:11:09.345523+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:09.345523+0000","last_undegraded":"2023-12-07T21:11:09.345523+0000","last_fullsized":"2023-12-07T21:11:09.345523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.053083+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:11.053083+0000","last_peered":"2023-12-07T21:11:11.053083+0000","last_clean":"2023-12-07T21:11:11.053083+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:11.053083+0000","last_undegraded":"2023-12-07T21:11:11.053083+0000","last_fullsized":"2023-12-07T21:11:11.053083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.304118+0000","last_change":"2023-12-07T21:11:42.304137+0000","last_active":"2023-12-07T21:11:42.304118+0000","last_peered":"2023-12-07T21:11:42.304118+0000","last_clean":"2023-12-07T21:11:42.304118+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:42.304118+0000","last_undegraded":"2023-12-07T21:11:42.304118+0000","last_fullsized":"2023-12-07T21:11:42.304118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.304031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:14.639583+0000","scrub_duration":0.0010594929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345945+0000","last_change":"2023-12-07T21:09:04.925464+0000","last_active":"2023-12-07T21:11:09.345945+0000","last_peered":"2023-12-07T21:11:09.345945+0000","last_clean":"2023-12-07T21:11:09.345945+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:11:09.345945+0000","last_undegraded":"2023-12-07T21:11:09.345945+0000","last_fullsized":"2023-12-07T21:11:09.345945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'1","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608112+0000","last_change":"2023-12-07T21:08:56.875484+0000","last_active":"2023-12-07T21:11:10.608112+0000","last_peered":"2023-12-07T21:11:10.608112+0000","last_clean":"2023-12-07T21:11:10.608112+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:11:10.608112+0000","last_undegraded":"2023-12-07T21:11:10.608112+0000","last_fullsized":"2023-12-07T21:11:10.608112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607656+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:11:10.607656+0000","last_peered":"2023-12-07T21:11:10.607656+0000","last_clean":"2023-12-07T21:11:10.607656+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:11:10.607656+0000","last_undegraded":"2023-12-07T21:11:10.607656+0000","last_fullsized":"2023-12-07T21:11:10.607656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345528+0000","last_change":"2023-12-07T21:08:58.880158+0000","last_active":"2023-12-07T21:11:09.345528+0000","last_peered":"2023-12-07T21:11:09.345528+0000","last_clean":"2023-12-07T21:11:09.345528+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:09.345528+0000","last_undegraded":"2023-12-07T21:11:09.345528+0000","last_fullsized":"2023-12-07T21:11:09.345528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.554028+0000","last_change":"2023-12-07T21:11:35.554062+0000","last_active":"2023-12-07T21:11:35.554028+0000","last_peered":"2023-12-07T21:11:35.554028+0000","last_clean":"2023-12-07T21:11:35.554028+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:35.554028+0000","last_undegraded":"2023-12-07T21:11:35.554028+0000","last_fullsized":"2023-12-07T21:11:35.554028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.553946+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:56.699897+0000","scrub_duration":0.0042775269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'246","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608744+0000","last_change":"2023-12-07T21:09:02.906250+0000","last_active":"2023-12-07T21:11:10.608744+0000","last_peered":"2023-12-07T21:11:10.608744+0000","last_clean":"2023-12-07T21:11:10.608744+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:11:10.608744+0000","last_undegraded":"2023-12-07T21:11:10.608744+0000","last_fullsized":"2023-12-07T21:11:10.608744+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188448+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:11:10.188448+0000","last_peered":"2023-12-07T21:11:10.188448+0000","last_clean":"2023-12-07T21:11:10.188448+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:11:10.188448+0000","last_undegraded":"2023-12-07T21:11:10.188448+0000","last_fullsized":"2023-12-07T21:11:10.188448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345217+0000","last_change":"2023-12-07T21:08:56.885545+0000","last_active":"2023-12-07T21:11:09.345217+0000","last_peered":"2023-12-07T21:11:09.345217+0000","last_clean":"2023-12-07T21:11:09.345217+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:11:09.345217+0000","last_undegraded":"2023-12-07T21:11:09.345217+0000","last_fullsized":"2023-12-07T21:11:09.345217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766427+0000","last_change":"2023-12-07T21:08:54.878527+0000","last_active":"2023-12-07T21:11:09.766427+0000","last_peered":"2023-12-07T21:11:09.766427+0000","last_clean":"2023-12-07T21:11:09.766427+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:11:09.766427+0000","last_undegraded":"2023-12-07T21:11:09.766427+0000","last_fullsized":"2023-12-07T21:11:09.766427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.775119+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:14.775119+0000","last_peered":"2023-12-07T21:11:14.775119+0000","last_clean":"2023-12-07T21:11:14.775119+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:14.775119+0000","last_undegraded":"2023-12-07T21:11:14.775119+0000","last_fullsized":"2023-12-07T21:11:14.775119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:29.600052+0000","last_change":"2023-12-07T21:11:29.600086+0000","last_active":"2023-12-07T21:11:29.600052+0000","last_peered":"2023-12-07T21:11:29.600052+0000","last_clean":"2023-12-07T21:11:29.600052+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:29.600052+0000","last_undegraded":"2023-12-07T21:11:29.600052+0000","last_fullsized":"2023-12-07T21:11:29.600052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_clean_scrub_stamp":"2023-12-07T21:11:29.599963+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:30:03.772118+0000","scrub_duration":0.003554771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'246","reported_seq":331,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345806+0000","last_change":"2023-12-07T21:09:02.901266+0000","last_active":"2023-12-07T21:11:09.345806+0000","last_peered":"2023-12-07T21:11:09.345806+0000","last_clean":"2023-12-07T21:11:09.345806+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:11:09.345806+0000","last_undegraded":"2023-12-07T21:11:09.345806+0000","last_fullsized":"2023-12-07T21:11:09.345806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809281+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:11:08.809281+0000","last_peered":"2023-12-07T21:11:08.809281+0000","last_clean":"2023-12-07T21:11:08.809281+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:11:08.809281+0000","last_undegraded":"2023-12-07T21:11:08.809281+0000","last_fullsized":"2023-12-07T21:11:08.809281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880253+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808422+0000","last_change":"2023-12-07T21:08:58.877986+0000","last_active":"2023-12-07T21:11:08.808422+0000","last_peered":"2023-12-07T21:11:08.808422+0000","last_clean":"2023-12-07T21:11:08.808422+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:08.808422+0000","last_undegraded":"2023-12-07T21:11:08.808422+0000","last_fullsized":"2023-12-07T21:11:08.808422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.606772+0000","last_change":"2023-12-07T21:11:39.606842+0000","last_active":"2023-12-07T21:11:39.606772+0000","last_peered":"2023-12-07T21:11:39.606772+0000","last_clean":"2023-12-07T21:11:39.606772+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:39.606772+0000","last_undegraded":"2023-12-07T21:11:39.606772+0000","last_fullsized":"2023-12-07T21:11:39.606772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.606684+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:36.950556+0000","scrub_duration":0.0069737849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:34.781691+0000","last_change":"2023-12-07T21:11:34.781711+0000","last_active":"2023-12-07T21:11:34.781691+0000","last_peered":"2023-12-07T21:11:34.781691+0000","last_clean":"2023-12-07T21:11:34.781691+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:34.781691+0000","last_undegraded":"2023-12-07T21:11:34.781691+0000","last_fullsized":"2023-12-07T21:11:34.781691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:34.781604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:44.478780+0000","scrub_duration":0.001255822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188362+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:11:10.188362+0000","last_peered":"2023-12-07T21:11:10.188362+0000","last_clean":"2023-12-07T21:11:10.188362+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:11:10.188362+0000","last_undegraded":"2023-12-07T21:11:10.188362+0000","last_fullsized":"2023-12-07T21:11:10.188362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'21","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808397+0000","last_change":"2023-12-07T21:08:56.871222+0000","last_active":"2023-12-07T21:11:08.808397+0000","last_peered":"2023-12-07T21:11:08.808397+0000","last_clean":"2023-12-07T21:11:08.808397+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:11:08.808397+0000","last_undegraded":"2023-12-07T21:11:08.808397+0000","last_fullsized":"2023-12-07T21:11:08.808397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187590+0000","last_change":"2023-12-07T21:08:54.885249+0000","last_active":"2023-12-07T21:11:10.187590+0000","last_peered":"2023-12-07T21:11:10.187590+0000","last_clean":"2023-12-07T21:11:10.187590+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:11:10.187590+0000","last_undegraded":"2023-12-07T21:11:10.187590+0000","last_fullsized":"2023-12-07T21:11:10.187590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802212+0000","last_change":"2023-12-07T21:08:58.880254+0000","last_active":"2023-12-07T21:11:08.802212+0000","last_peered":"2023-12-07T21:11:08.802212+0000","last_clean":"2023-12-07T21:11:08.802212+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:11:08.802212+0000","last_undegraded":"2023-12-07T21:11:08.802212+0000","last_fullsized":"2023-12-07T21:11:08.802212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'33","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608550+0000","last_change":"2023-12-07T21:09:00.895444+0000","last_active":"2023-12-07T21:11:10.608550+0000","last_peered":"2023-12-07T21:11:10.608550+0000","last_clean":"2023-12-07T21:11:10.608550+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:11:10.608550+0000","last_undegraded":"2023-12-07T21:11:10.608550+0000","last_fullsized":"2023-12-07T21:11:10.608550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.735445+0000","last_change":"2023-12-07T21:11:33.735466+0000","last_active":"2023-12-07T21:11:33.735445+0000","last_peered":"2023-12-07T21:11:33.735445+0000","last_clean":"2023-12-07T21:11:33.735445+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:33.735445+0000","last_undegraded":"2023-12-07T21:11:33.735445+0000","last_fullsized":"2023-12-07T21:11:33.735445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.735352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:03.972116+0000","scrub_duration":0.0011441929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767437+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:11:09.767437+0000","last_peered":"2023-12-07T21:11:09.767437+0000","last_clean":"2023-12-07T21:11:09.767437+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:11:09.767437+0000","last_undegraded":"2023-12-07T21:11:09.767437+0000","last_fullsized":"2023-12-07T21:11:09.767437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808402+0000","last_change":"2023-12-07T21:08:56.879742+0000","last_active":"2023-12-07T21:11:08.808402+0000","last_peered":"2023-12-07T21:11:08.808402+0000","last_clean":"2023-12-07T21:11:08.808402+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:11:08.808402+0000","last_undegraded":"2023-12-07T21:11:08.808402+0000","last_fullsized":"2023-12-07T21:11:08.808402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607665+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:11:10.607665+0000","last_peered":"2023-12-07T21:11:10.607665+0000","last_clean":"2023-12-07T21:11:10.607665+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:11:10.607665+0000","last_undegraded":"2023-12-07T21:11:10.607665+0000","last_fullsized":"2023-12-07T21:11:10.607665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345505+0000","last_change":"2023-12-07T21:08:58.874569+0000","last_active":"2023-12-07T21:11:09.345505+0000","last_peered":"2023-12-07T21:11:09.345505+0000","last_clean":"2023-12-07T21:11:09.345505+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:11:09.345505+0000","last_undegraded":"2023-12-07T21:11:09.345505+0000","last_fullsized":"2023-12-07T21:11:09.345505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'37","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608539+0000","last_change":"2023-12-07T21:09:00.889539+0000","last_active":"2023-12-07T21:11:10.608539+0000","last_peered":"2023-12-07T21:11:10.608539+0000","last_clean":"2023-12-07T21:11:10.608539+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:10.608539+0000","last_undegraded":"2023-12-07T21:11:10.608539+0000","last_fullsized":"2023-12-07T21:11:10.608539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":307,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.761860+0000","last_change":"2023-12-07T21:11:35.761887+0000","last_active":"2023-12-07T21:11:35.761860+0000","last_peered":"2023-12-07T21:11:35.761860+0000","last_clean":"2023-12-07T21:11:35.761860+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:35.761860+0000","last_undegraded":"2023-12-07T21:11:35.761860+0000","last_fullsized":"2023-12-07T21:11:35.761860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.761766+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:14.383149+0000","scrub_duration":0.0016151640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345866+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:11:09.345866+0000","last_peered":"2023-12-07T21:11:09.345866+0000","last_clean":"2023-12-07T21:11:09.345866+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:11:09.345866+0000","last_undegraded":"2023-12-07T21:11:09.345866+0000","last_fullsized":"2023-12-07T21:11:09.345866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187733+0000","last_change":"2023-12-07T21:08:56.870949+0000","last_active":"2023-12-07T21:11:10.187733+0000","last_peered":"2023-12-07T21:11:10.187733+0000","last_clean":"2023-12-07T21:11:10.187733+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:11:10.187733+0000","last_undegraded":"2023-12-07T21:11:10.187733+0000","last_fullsized":"2023-12-07T21:11:10.187733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607649+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:11:10.607649+0000","last_peered":"2023-12-07T21:11:10.607649+0000","last_clean":"2023-12-07T21:11:10.607649+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:11:10.607649+0000","last_undegraded":"2023-12-07T21:11:10.607649+0000","last_fullsized":"2023-12-07T21:11:10.607649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802319+0000","last_change":"2023-12-07T21:08:58.880111+0000","last_active":"2023-12-07T21:11:08.802319+0000","last_peered":"2023-12-07T21:11:08.802319+0000","last_clean":"2023-12-07T21:11:08.802319+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:08.802319+0000","last_undegraded":"2023-12-07T21:11:08.802319+0000","last_fullsized":"2023-12-07T21:11:08.802319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:31.726530+0000","last_change":"2023-12-07T21:11:31.726564+0000","last_active":"2023-12-07T21:11:31.726530+0000","last_peered":"2023-12-07T21:11:31.726530+0000","last_clean":"2023-12-07T21:11:31.726530+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:31.726530+0000","last_undegraded":"2023-12-07T21:11:31.726530+0000","last_fullsized":"2023-12-07T21:11:31.726530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:31.726451+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:36.775283+0000","scrub_duration":0.0038601009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345702+0000","last_change":"2023-12-07T21:09:02.901382+0000","last_active":"2023-12-07T21:11:09.345702+0000","last_peered":"2023-12-07T21:11:09.345702+0000","last_clean":"2023-12-07T21:11:09.345702+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:09.345702+0000","last_undegraded":"2023-12-07T21:11:09.345702+0000","last_fullsized":"2023-12-07T21:11:09.345702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345867+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:11:09.345867+0000","last_peered":"2023-12-07T21:11:09.345867+0000","last_clean":"2023-12-07T21:11:09.345867+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:11:09.345867+0000","last_undegraded":"2023-12-07T21:11:09.345867+0000","last_fullsized":"2023-12-07T21:11:09.345867+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:09:38.788716+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:09:38.788716+0000","last_peered":"2023-12-07T21:09:38.788716+0000","last_clean":"2023-12-07T21:09:38.788716+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:09:38.788716+0000","last_undegraded":"2023-12-07T21:09:38.788716+0000","last_fullsized":"2023-12-07T21:09:38.788716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345205+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:11:09.345205+0000","last_peered":"2023-12-07T21:11:09.345205+0000","last_clean":"2023-12-07T21:11:09.345205+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:11:09.345205+0000","last_undegraded":"2023-12-07T21:11:09.345205+0000","last_fullsized":"2023-12-07T21:11:09.345205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187996+0000","last_change":"2023-12-07T21:08:58.878003+0000","last_active":"2023-12-07T21:11:10.187996+0000","last_peered":"2023-12-07T21:11:10.187996+0000","last_clean":"2023-12-07T21:11:10.187996+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:11:10.187996+0000","last_undegraded":"2023-12-07T21:11:10.187996+0000","last_fullsized":"2023-12-07T21:11:10.187996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.222534+0000","last_change":"2023-12-07T21:11:32.222572+0000","last_active":"2023-12-07T21:11:32.222534+0000","last_peered":"2023-12-07T21:11:32.222534+0000","last_clean":"2023-12-07T21:11:32.222534+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:32.222534+0000","last_undegraded":"2023-12-07T21:11:32.222534+0000","last_fullsized":"2023-12-07T21:11:32.222534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.222451+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:29.566323+0000","scrub_duration":0.0042948600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608766+0000","last_change":"2023-12-07T21:09:02.906350+0000","last_active":"2023-12-07T21:11:10.608766+0000","last_peered":"2023-12-07T21:11:10.608766+0000","last_clean":"2023-12-07T21:11:10.608766+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:11:10.608766+0000","last_undegraded":"2023-12-07T21:11:10.608766+0000","last_fullsized":"2023-12-07T21:11:10.608766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809146+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:11:08.809146+0000","last_peered":"2023-12-07T21:11:08.809146+0000","last_clean":"2023-12-07T21:11:08.809146+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:11:08.809146+0000","last_undegraded":"2023-12-07T21:11:08.809146+0000","last_fullsized":"2023-12-07T21:11:08.809146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:18.745982+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:10:18.745982+0000","last_peered":"2023-12-07T21:10:18.745982+0000","last_clean":"2023-12-07T21:10:18.745982+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:10:18.745982+0000","last_undegraded":"2023-12-07T21:10:18.745982+0000","last_fullsized":"2023-12-07T21:10:18.745982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809479+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:11:08.809479+0000","last_peered":"2023-12-07T21:11:08.809479+0000","last_clean":"2023-12-07T21:11:08.809479+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:11:08.809479+0000","last_undegraded":"2023-12-07T21:11:08.809479+0000","last_fullsized":"2023-12-07T21:11:08.809479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345521+0000","last_change":"2023-12-07T21:08:58.880054+0000","last_active":"2023-12-07T21:11:09.345521+0000","last_peered":"2023-12-07T21:11:09.345521+0000","last_clean":"2023-12-07T21:11:09.345521+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:09.345521+0000","last_undegraded":"2023-12-07T21:11:09.345521+0000","last_fullsized":"2023-12-07T21:11:09.345521+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.576728+0000","last_change":"2023-12-07T21:11:38.576788+0000","last_active":"2023-12-07T21:11:38.576728+0000","last_peered":"2023-12-07T21:11:38.576728+0000","last_clean":"2023-12-07T21:11:38.576728+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:38.576728+0000","last_undegraded":"2023-12-07T21:11:38.576728+0000","last_fullsized":"2023-12-07T21:11:38.576728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.576637+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:37:48.632379+0000","scrub_duration":0.0068514220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":336,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625017+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625017+0000","last_peered":"2023-12-07T21:11:28.625017+0000","last_clean":"2023-12-07T21:11:28.625017+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625017+0000","last_undegraded":"2023-12-07T21:11:28.625017+0000","last_fullsized":"2023-12-07T21:11:28.625017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345846+0000","last_change":"2023-12-07T21:09:04.919388+0000","last_active":"2023-12-07T21:11:09.345846+0000","last_peered":"2023-12-07T21:11:09.345846+0000","last_clean":"2023-12-07T21:11:09.345846+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:11:09.345846+0000","last_undegraded":"2023-12-07T21:11:09.345846+0000","last_fullsized":"2023-12-07T21:11:09.345846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187852+0000","last_change":"2023-12-07T21:08:56.880261+0000","last_active":"2023-12-07T21:11:10.187852+0000","last_peered":"2023-12-07T21:11:10.187852+0000","last_clean":"2023-12-07T21:11:10.187852+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:11:10.187852+0000","last_undegraded":"2023-12-07T21:11:10.187852+0000","last_fullsized":"2023-12-07T21:11:10.187852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809380+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:11:08.809380+0000","last_peered":"2023-12-07T21:11:08.809380+0000","last_clean":"2023-12-07T21:11:08.809380+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:11:08.809380+0000","last_undegraded":"2023-12-07T21:11:08.809380+0000","last_fullsized":"2023-12-07T21:11:08.809380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.296670+0000","last_change":"2023-12-07T21:11:38.296697+0000","last_active":"2023-12-07T21:11:38.296670+0000","last_peered":"2023-12-07T21:11:38.296670+0000","last_clean":"2023-12-07T21:11:38.296670+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:38.296670+0000","last_undegraded":"2023-12-07T21:11:38.296670+0000","last_fullsized":"2023-12-07T21:11:38.296670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.296568+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:08.533333+0000","scrub_duration":0.0033144630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608582+0000","last_change":"2023-12-07T21:09:00.895566+0000","last_active":"2023-12-07T21:11:10.608582+0000","last_peered":"2023-12-07T21:11:10.608582+0000","last_clean":"2023-12-07T21:11:10.608582+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:11:10.608582+0000","last_undegraded":"2023-12-07T21:11:10.608582+0000","last_fullsized":"2023-12-07T21:11:10.608582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'247","reported_seq":372,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:47.359710+0000","last_change":"2023-12-07T21:11:47.359735+0000","last_active":"2023-12-07T21:11:47.359710+0000","last_peered":"2023-12-07T21:11:47.359710+0000","last_clean":"2023-12-07T21:11:47.359710+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:47.359710+0000","last_undegraded":"2023-12-07T21:11:47.359710+0000","last_fullsized":"2023-12-07T21:11:47.359710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_clean_scrub_stamp":"2023-12-07T21:11:47.359610+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:10.050726+0000","scrub_duration":0.0028663759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188292+0000","last_change":"2023-12-07T21:09:04.923396+0000","last_active":"2023-12-07T21:11:10.188292+0000","last_peered":"2023-12-07T21:11:10.188292+0000","last_clean":"2023-12-07T21:11:10.188292+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:11:10.188292+0000","last_undegraded":"2023-12-07T21:11:10.188292+0000","last_fullsized":"2023-12-07T21:11:10.188292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766719+0000","last_change":"2023-12-07T21:08:56.889238+0000","last_active":"2023-12-07T21:11:09.766719+0000","last_peered":"2023-12-07T21:11:09.766719+0000","last_clean":"2023-12-07T21:11:09.766719+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:11:09.766719+0000","last_undegraded":"2023-12-07T21:11:09.766719+0000","last_fullsized":"2023-12-07T21:11:09.766719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809240+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:11:08.809240+0000","last_peered":"2023-12-07T21:11:08.809240+0000","last_clean":"2023-12-07T21:11:08.809240+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:11:08.809240+0000","last_undegraded":"2023-12-07T21:11:08.809240+0000","last_fullsized":"2023-12-07T21:11:08.809240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.847894+0000","last_change":"2023-12-07T21:11:28.847914+0000","last_active":"2023-12-07T21:11:28.847894+0000","last_peered":"2023-12-07T21:11:28.847894+0000","last_clean":"2023-12-07T21:11:28.847894+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:28.847894+0000","last_undegraded":"2023-12-07T21:11:28.847894+0000","last_fullsized":"2023-12-07T21:11:28.847894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.847797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:20:42.481026+0000","scrub_duration":0.001132973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262716+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262716+0000","last_peered":"2023-12-07T21:11:27.262716+0000","last_clean":"2023-12-07T21:11:27.262716+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262716+0000","last_undegraded":"2023-12-07T21:11:27.262716+0000","last_fullsized":"2023-12-07T21:11:27.262716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.426987+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:14.426987+0000","last_peered":"2023-12-07T21:11:14.426987+0000","last_clean":"2023-12-07T21:11:14.426987+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:14.426987+0000","last_undegraded":"2023-12-07T21:11:14.426987+0000","last_fullsized":"2023-12-07T21:11:14.426987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767450+0000","last_change":"2023-12-07T21:09:04.920277+0000","last_active":"2023-12-07T21:11:09.767450+0000","last_peered":"2023-12-07T21:11:09.767450+0000","last_clean":"2023-12-07T21:11:09.767450+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:11:09.767450+0000","last_undegraded":"2023-12-07T21:11:09.767450+0000","last_fullsized":"2023-12-07T21:11:09.767450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808538+0000","last_change":"2023-12-07T21:08:56.875185+0000","last_active":"2023-12-07T21:11:03.808538+0000","last_peered":"2023-12-07T21:11:03.808538+0000","last_clean":"2023-12-07T21:11:03.808538+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:11:03.808538+0000","last_undegraded":"2023-12-07T21:11:03.808538+0000","last_fullsized":"2023-12-07T21:11:03.808538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:43.801827+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:10:43.801827+0000","last_peered":"2023-12-07T21:10:43.801827+0000","last_clean":"2023-12-07T21:10:43.801827+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:10:43.801827+0000","last_undegraded":"2023-12-07T21:10:43.801827+0000","last_fullsized":"2023-12-07T21:10:43.801827+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806332+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:10:53.806332+0000","last_peered":"2023-12-07T21:10:53.806332+0000","last_clean":"2023-12-07T21:10:53.806332+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:10:53.806332+0000","last_undegraded":"2023-12-07T21:10:53.806332+0000","last_fullsized":"2023-12-07T21:10:53.806332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808304+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:11:03.808304+0000","last_peered":"2023-12-07T21:11:03.808304+0000","last_clean":"2023-12-07T21:11:03.808304+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:11:03.808304+0000","last_undegraded":"2023-12-07T21:11:03.808304+0000","last_fullsized":"2023-12-07T21:11:03.808304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.324719+0000","last_change":"2023-12-07T21:11:45.324752+0000","last_active":"2023-12-07T21:11:45.324719+0000","last_peered":"2023-12-07T21:11:45.324719+0000","last_clean":"2023-12-07T21:11:45.324719+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:11:45.324719+0000","last_undegraded":"2023-12-07T21:11:45.324719+0000","last_fullsized":"2023-12-07T21:11:45.324719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.324596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:15.702930+0000","scrub_duration":0.001375037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'79","reported_seq":154,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608522+0000","last_change":"2023-12-07T21:09:00.891338+0000","last_active":"2023-12-07T21:11:10.608522+0000","last_peered":"2023-12-07T21:11:10.608522+0000","last_clean":"2023-12-07T21:11:10.608522+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:11:10.608522+0000","last_undegraded":"2023-12-07T21:11:10.608522+0000","last_fullsized":"2023-12-07T21:11:10.608522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.743690+0000","last_change":"2023-12-07T21:11:42.743712+0000","last_active":"2023-12-07T21:11:42.743690+0000","last_peered":"2023-12-07T21:11:42.743690+0000","last_clean":"2023-12-07T21:11:42.743690+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:42.743690+0000","last_undegraded":"2023-12-07T21:11:42.743690+0000","last_fullsized":"2023-12-07T21:11:42.743690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.743604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:58.016229+0000","scrub_duration":0.001386167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188371+0000","last_change":"2023-12-07T21:09:04.924703+0000","last_active":"2023-12-07T21:11:10.188371+0000","last_peered":"2023-12-07T21:11:10.188371+0000","last_clean":"2023-12-07T21:11:10.188371+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:10.188371+0000","last_undegraded":"2023-12-07T21:11:10.188371+0000","last_fullsized":"2023-12-07T21:11:10.188371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809766+0000","last_change":"2023-12-07T21:08:56.872420+0000","last_active":"2023-12-07T21:11:08.809766+0000","last_peered":"2023-12-07T21:11:08.809766+0000","last_clean":"2023-12-07T21:11:08.809766+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:11:08.809766+0000","last_undegraded":"2023-12-07T21:11:08.809766+0000","last_fullsized":"2023-12-07T21:11:08.809766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:48.804993+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:10:48.804993+0000","last_peered":"2023-12-07T21:10:48.804993+0000","last_clean":"2023-12-07T21:10:48.804993+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:10:48.804993+0000","last_undegraded":"2023-12-07T21:10:48.804993+0000","last_fullsized":"2023-12-07T21:10:48.804993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800912+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:11:03.800912+0000","last_peered":"2023-12-07T21:11:03.800912+0000","last_clean":"2023-12-07T21:11:03.800912+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:11:03.800912+0000","last_undegraded":"2023-12-07T21:11:03.800912+0000","last_fullsized":"2023-12-07T21:11:03.800912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.687459+0000","last_change":"2023-12-07T21:11:32.687480+0000","last_active":"2023-12-07T21:11:32.687459+0000","last_peered":"2023-12-07T21:11:32.687459+0000","last_clean":"2023-12-07T21:11:32.687459+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:32.687459+0000","last_undegraded":"2023-12-07T21:11:32.687459+0000","last_fullsized":"2023-12-07T21:11:32.687459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.687375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:18:45.906213+0000","scrub_duration":0.001283024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":450,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148355+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148355+0000","last_peered":"2023-12-07T21:11:18.148355+0000","last_clean":"2023-12-07T21:11:18.148355+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148355+0000","last_undegraded":"2023-12-07T21:11:18.148355+0000","last_fullsized":"2023-12-07T21:11:18.148355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809611+0000","last_change":"2023-12-07T21:09:02.905387+0000","last_active":"2023-12-07T21:11:08.809611+0000","last_peered":"2023-12-07T21:11:08.809611+0000","last_clean":"2023-12-07T21:11:08.809611+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:11:08.809611+0000","last_undegraded":"2023-12-07T21:11:08.809611+0000","last_fullsized":"2023-12-07T21:11:08.809611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767469+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:11:09.767469+0000","last_peered":"2023-12-07T21:11:09.767469+0000","last_clean":"2023-12-07T21:11:09.767469+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:11:09.767469+0000","last_undegraded":"2023-12-07T21:11:09.767469+0000","last_fullsized":"2023-12-07T21:11:09.767469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802682+0000","last_change":"2023-12-07T21:08:56.883281+0000","last_active":"2023-12-07T21:11:08.802682+0000","last_peered":"2023-12-07T21:11:08.802682+0000","last_clean":"2023-12-07T21:11:08.802682+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:11:08.802682+0000","last_undegraded":"2023-12-07T21:11:08.802682+0000","last_fullsized":"2023-12-07T21:11:08.802682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.804204+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:10:53.804204+0000","last_peered":"2023-12-07T21:10:53.804204+0000","last_clean":"2023-12-07T21:10:53.804204+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:10:53.804204+0000","last_undegraded":"2023-12-07T21:10:53.804204+0000","last_fullsized":"2023-12-07T21:10:53.804204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.799875+0000","last_change":"2023-12-07T21:08:54.881937+0000","last_active":"2023-12-07T21:10:58.799875+0000","last_peered":"2023-12-07T21:10:58.799875+0000","last_clean":"2023-12-07T21:10:58.799875+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:10:58.799875+0000","last_undegraded":"2023-12-07T21:10:58.799875+0000","last_fullsized":"2023-12-07T21:10:58.799875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808733+0000","last_change":"2023-12-07T21:08:58.875724+0000","last_active":"2023-12-07T21:11:08.808733+0000","last_peered":"2023-12-07T21:11:08.808733+0000","last_clean":"2023-12-07T21:11:08.808733+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:11:08.808733+0000","last_undegraded":"2023-12-07T21:11:08.808733+0000","last_fullsized":"2023-12-07T21:11:08.808733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'25","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:46.537878+0000","last_change":"2023-12-07T21:11:46.537922+0000","last_active":"2023-12-07T21:11:46.537878+0000","last_peered":"2023-12-07T21:11:46.537878+0000","last_clean":"2023-12-07T21:11:46.537878+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:46.537878+0000","last_undegraded":"2023-12-07T21:11:46.537878+0000","last_fullsized":"2023-12-07T21:11:46.537878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_clean_scrub_stamp":"2023-12-07T21:11:46.537795+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:57.338431+0000","scrub_duration":0.0057357379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642676+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642676+0000","last_peered":"2023-12-07T21:11:12.642676+0000","last_clean":"2023-12-07T21:11:12.642676+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642676+0000","last_undegraded":"2023-12-07T21:11:12.642676+0000","last_fullsized":"2023-12-07T21:11:12.642676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608815+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:11:10.608815+0000","last_peered":"2023-12-07T21:11:10.608815+0000","last_clean":"2023-12-07T21:11:10.608815+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:11:10.608815+0000","last_undegraded":"2023-12-07T21:11:10.608815+0000","last_fullsized":"2023-12-07T21:11:10.608815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801285+0000","last_change":"2023-12-07T21:08:56.872455+0000","last_active":"2023-12-07T21:11:03.801285+0000","last_peered":"2023-12-07T21:11:03.801285+0000","last_clean":"2023-12-07T21:11:03.801285+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:11:03.801285+0000","last_undegraded":"2023-12-07T21:11:03.801285+0000","last_fullsized":"2023-12-07T21:11:03.801285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806222+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:10:53.806222+0000","last_peered":"2023-12-07T21:10:53.806222+0000","last_clean":"2023-12-07T21:10:53.806222+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:10:53.806222+0000","last_undegraded":"2023-12-07T21:10:53.806222+0000","last_fullsized":"2023-12-07T21:10:53.806222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806975+0000","last_change":"2023-12-07T21:08:54.880674+0000","last_active":"2023-12-07T21:11:03.806975+0000","last_peered":"2023-12-07T21:11:03.806975+0000","last_clean":"2023-12-07T21:11:03.806975+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:11:03.806975+0000","last_undegraded":"2023-12-07T21:11:03.806975+0000","last_fullsized":"2023-12-07T21:11:03.806975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801326+0000","last_change":"2023-12-07T21:08:58.881871+0000","last_active":"2023-12-07T21:11:03.801326+0000","last_peered":"2023-12-07T21:11:03.801326+0000","last_clean":"2023-12-07T21:11:03.801326+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:11:03.801326+0000","last_undegraded":"2023-12-07T21:11:03.801326+0000","last_fullsized":"2023-12-07T21:11:03.801326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608529+0000","last_change":"2023-12-07T21:09:00.892022+0000","last_active":"2023-12-07T21:11:10.608529+0000","last_peered":"2023-12-07T21:11:10.608529+0000","last_clean":"2023-12-07T21:11:10.608529+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:11:10.608529+0000","last_undegraded":"2023-12-07T21:11:10.608529+0000","last_fullsized":"2023-12-07T21:11:10.608529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608704+0000","last_change":"2023-12-07T21:09:02.907037+0000","last_active":"2023-12-07T21:11:10.608704+0000","last_peered":"2023-12-07T21:11:10.608704+0000","last_clean":"2023-12-07T21:11:10.608704+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:11:10.608704+0000","last_undegraded":"2023-12-07T21:11:10.608704+0000","last_fullsized":"2023-12-07T21:11:10.608704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767468+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:11:09.767468+0000","last_peered":"2023-12-07T21:11:09.767468+0000","last_clean":"2023-12-07T21:11:09.767468+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:11:09.767468+0000","last_undegraded":"2023-12-07T21:11:09.767468+0000","last_fullsized":"2023-12-07T21:11:09.767468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806997+0000","last_change":"2023-12-07T21:08:56.882954+0000","last_active":"2023-12-07T21:11:03.806997+0000","last_peered":"2023-12-07T21:11:03.806997+0000","last_clean":"2023-12-07T21:11:03.806997+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:11:03.806997+0000","last_undegraded":"2023-12-07T21:11:03.806997+0000","last_fullsized":"2023-12-07T21:11:03.806997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807157+0000","last_change":"2023-12-07T21:08:54.881143+0000","last_active":"2023-12-07T21:11:03.807157+0000","last_peered":"2023-12-07T21:11:03.807157+0000","last_clean":"2023-12-07T21:11:03.807157+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:11:03.807157+0000","last_undegraded":"2023-12-07T21:11:03.807157+0000","last_fullsized":"2023-12-07T21:11:03.807157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.799061+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:10:53.799061+0000","last_peered":"2023-12-07T21:10:53.799061+0000","last_clean":"2023-12-07T21:10:53.799061+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:10:53.799061+0000","last_undegraded":"2023-12-07T21:10:53.799061+0000","last_fullsized":"2023-12-07T21:10:53.799061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801170+0000","last_change":"2023-12-07T21:08:58.881942+0000","last_active":"2023-12-07T21:11:03.801170+0000","last_peered":"2023-12-07T21:11:03.801170+0000","last_clean":"2023-12-07T21:11:03.801170+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:11:03.801170+0000","last_undegraded":"2023-12-07T21:11:03.801170+0000","last_fullsized":"2023-12-07T21:11:03.801170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'72","reported_seq":141,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.762966+0000","last_change":"2023-12-07T21:11:45.763012+0000","last_active":"2023-12-07T21:11:45.762966+0000","last_peered":"2023-12-07T21:11:45.762966+0000","last_clean":"2023-12-07T21:11:45.762966+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:45.762966+0000","last_undegraded":"2023-12-07T21:11:45.762966+0000","last_fullsized":"2023-12-07T21:11:45.762966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.762875+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:27:47.809323+0000","scrub_duration":0.006706058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594393+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594393+0000","last_peered":"2023-12-07T21:11:25.594393+0000","last_clean":"2023-12-07T21:11:25.594393+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594393+0000","last_undegraded":"2023-12-07T21:11:25.594393+0000","last_fullsized":"2023-12-07T21:11:25.594393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345934+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:11:09.345934+0000","last_peered":"2023-12-07T21:11:09.345934+0000","last_clean":"2023-12-07T21:11:09.345934+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:11:09.345934+0000","last_undegraded":"2023-12-07T21:11:09.345934+0000","last_fullsized":"2023-12-07T21:11:09.345934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807102+0000","last_change":"2023-12-07T21:08:56.878924+0000","last_active":"2023-12-07T21:11:03.807102+0000","last_peered":"2023-12-07T21:11:03.807102+0000","last_clean":"2023-12-07T21:11:03.807102+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:11:03.807102+0000","last_undegraded":"2023-12-07T21:11:03.807102+0000","last_fullsized":"2023-12-07T21:11:03.807102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801254+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:11:03.801254+0000","last_peered":"2023-12-07T21:11:03.801254+0000","last_clean":"2023-12-07T21:11:03.801254+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:11:03.801254+0000","last_undegraded":"2023-12-07T21:11:03.801254+0000","last_fullsized":"2023-12-07T21:11:03.801254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806441+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:10:53.806441+0000","last_peered":"2023-12-07T21:10:53.806441+0000","last_clean":"2023-12-07T21:10:53.806441+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:10:53.806441+0000","last_undegraded":"2023-12-07T21:10:53.806441+0000","last_fullsized":"2023-12-07T21:10:53.806441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.626455+0000","last_change":"2023-12-07T21:11:42.626478+0000","last_active":"2023-12-07T21:11:42.626455+0000","last_peered":"2023-12-07T21:11:42.626455+0000","last_clean":"2023-12-07T21:11:42.626455+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:11:42.626455+0000","last_undegraded":"2023-12-07T21:11:42.626455+0000","last_fullsized":"2023-12-07T21:11:42.626455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.626356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:23.689571+0000","scrub_duration":0.001348258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.225002+0000","last_change":"2023-12-07T21:11:33.225043+0000","last_active":"2023-12-07T21:11:33.225002+0000","last_peered":"2023-12-07T21:11:33.225002+0000","last_clean":"2023-12-07T21:11:33.225002+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:33.225002+0000","last_undegraded":"2023-12-07T21:11:33.225002+0000","last_fullsized":"2023-12-07T21:11:33.225002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.224920+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:12.396025+0000","scrub_duration":0.0049945800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":300,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.065927+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:11:20.065927+0000","last_peered":"2023-12-07T21:11:20.065927+0000","last_clean":"2023-12-07T21:11:20.065927+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:20.065927+0000","last_undegraded":"2023-12-07T21:11:20.065927+0000","last_fullsized":"2023-12-07T21:11:20.065927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608840+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:11:10.608840+0000","last_peered":"2023-12-07T21:11:10.608840+0000","last_clean":"2023-12-07T21:11:10.608840+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:11:10.608840+0000","last_undegraded":"2023-12-07T21:11:10.608840+0000","last_fullsized":"2023-12-07T21:11:10.608840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.807179+0000","last_change":"2023-12-07T21:08:56.887962+0000","last_active":"2023-12-07T21:10:58.807179+0000","last_peered":"2023-12-07T21:10:58.807179+0000","last_clean":"2023-12-07T21:10:58.807179+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:10:58.807179+0000","last_undegraded":"2023-12-07T21:10:58.807179+0000","last_fullsized":"2023-12-07T21:10:58.807179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809841+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:11:08.809841+0000","last_peered":"2023-12-07T21:11:08.809841+0000","last_clean":"2023-12-07T21:11:08.809841+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:11:08.809841+0000","last_undegraded":"2023-12-07T21:11:08.809841+0000","last_fullsized":"2023-12-07T21:11:08.809841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800250+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:10:58.800250+0000","last_peered":"2023-12-07T21:10:58.800250+0000","last_clean":"2023-12-07T21:10:58.800250+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:10:58.800250+0000","last_undegraded":"2023-12-07T21:10:58.800250+0000","last_fullsized":"2023-12-07T21:10:58.800250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.865875+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:11:18.865875+0000","last_peered":"2023-12-07T21:11:18.865875+0000","last_clean":"2023-12-07T21:11:18.865875+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:11:18.865875+0000","last_undegraded":"2023-12-07T21:11:18.865875+0000","last_fullsized":"2023-12-07T21:11:18.865875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809460+0000","last_change":"2023-12-07T21:09:00.896503+0000","last_active":"2023-12-07T21:11:08.809460+0000","last_peered":"2023-12-07T21:11:08.809460+0000","last_clean":"2023-12-07T21:11:08.809460+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:11:08.809460+0000","last_undegraded":"2023-12-07T21:11:08.809460+0000","last_fullsized":"2023-12-07T21:11:08.809460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":368,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712206+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712206+0000","last_peered":"2023-12-07T21:11:18.712206+0000","last_clean":"2023-12-07T21:11:18.712206+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712206+0000","last_undegraded":"2023-12-07T21:11:18.712206+0000","last_fullsized":"2023-12-07T21:11:18.712206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767478+0000","last_change":"2023-12-07T21:09:04.929420+0000","last_active":"2023-12-07T21:11:09.767478+0000","last_peered":"2023-12-07T21:11:09.767478+0000","last_clean":"2023-12-07T21:11:09.767478+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:11:09.767478+0000","last_undegraded":"2023-12-07T21:11:09.767478+0000","last_fullsized":"2023-12-07T21:11:09.767478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806772+0000","last_change":"2023-12-07T21:08:56.874336+0000","last_active":"2023-12-07T21:11:03.806772+0000","last_peered":"2023-12-07T21:11:03.806772+0000","last_clean":"2023-12-07T21:11:03.806772+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:11:03.806772+0000","last_undegraded":"2023-12-07T21:11:03.806772+0000","last_fullsized":"2023-12-07T21:11:03.806772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808876+0000","last_change":"2023-12-07T21:08:54.888557+0000","last_active":"2023-12-07T21:11:08.808876+0000","last_peered":"2023-12-07T21:11:08.808876+0000","last_clean":"2023-12-07T21:11:08.808876+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:11:08.808876+0000","last_undegraded":"2023-12-07T21:11:08.808876+0000","last_fullsized":"2023-12-07T21:11:08.808876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.807661+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:10:58.807661+0000","last_peered":"2023-12-07T21:10:58.807661+0000","last_clean":"2023-12-07T21:10:58.807661+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:10:58.807661+0000","last_undegraded":"2023-12-07T21:10:58.807661+0000","last_fullsized":"2023-12-07T21:10:58.807661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:37.651284+0000","last_change":"2023-12-07T21:11:37.651334+0000","last_active":"2023-12-07T21:11:37.651284+0000","last_peered":"2023-12-07T21:11:37.651284+0000","last_clean":"2023-12-07T21:11:37.651284+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:11:37.651284+0000","last_undegraded":"2023-12-07T21:11:37.651284+0000","last_fullsized":"2023-12-07T21:11:37.651284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_clean_scrub_stamp":"2023-12-07T21:11:37.651191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:09.090050+0000","scrub_duration":0.0012443790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'86","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808501+0000","last_change":"2023-12-07T21:09:00.891723+0000","last_active":"2023-12-07T21:11:08.808501+0000","last_peered":"2023-12-07T21:11:08.808501+0000","last_clean":"2023-12-07T21:11:08.808501+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:11:08.808501+0000","last_undegraded":"2023-12-07T21:11:08.808501+0000","last_fullsized":"2023-12-07T21:11:08.808501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802332+0000","last_change":"2023-12-07T21:09:02.898050+0000","last_active":"2023-12-07T21:11:08.802332+0000","last_peered":"2023-12-07T21:11:08.802332+0000","last_clean":"2023-12-07T21:11:08.802332+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:08.802332+0000","last_undegraded":"2023-12-07T21:11:08.802332+0000","last_fullsized":"2023-12-07T21:11:08.802332+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188437+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:11:10.188437+0000","last_peered":"2023-12-07T21:11:10.188437+0000","last_clean":"2023-12-07T21:11:10.188437+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:11:10.188437+0000","last_undegraded":"2023-12-07T21:11:10.188437+0000","last_fullsized":"2023-12-07T21:11:10.188437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188463+0000","last_change":"2023-12-07T21:09:04.926451+0000","last_active":"2023-12-07T21:11:10.188463+0000","last_peered":"2023-12-07T21:11:10.188463+0000","last_clean":"2023-12-07T21:11:10.188463+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:11:10.188463+0000","last_undegraded":"2023-12-07T21:11:10.188463+0000","last_fullsized":"2023-12-07T21:11:10.188463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187815+0000","last_change":"2023-12-07T21:08:56.877160+0000","last_active":"2023-12-07T21:11:10.187815+0000","last_peered":"2023-12-07T21:11:10.187815+0000","last_clean":"2023-12-07T21:11:10.187815+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:11:10.187815+0000","last_undegraded":"2023-12-07T21:11:10.187815+0000","last_fullsized":"2023-12-07T21:11:10.187815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607705+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:11:10.607705+0000","last_peered":"2023-12-07T21:11:10.607705+0000","last_clean":"2023-12-07T21:11:10.607705+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:11:10.607705+0000","last_undegraded":"2023-12-07T21:11:10.607705+0000","last_fullsized":"2023-12-07T21:11:10.607705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.299949+0000","last_change":"2023-12-07T21:11:39.299988+0000","last_active":"2023-12-07T21:11:39.299949+0000","last_peered":"2023-12-07T21:11:39.299949+0000","last_clean":"2023-12-07T21:11:39.299949+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:39.299949+0000","last_undegraded":"2023-12-07T21:11:39.299949+0000","last_fullsized":"2023-12-07T21:11:39.299949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.299849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:48.997025+0000","scrub_duration":0.001356866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.839849+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:20.839849+0000","last_peered":"2023-12-07T21:11:20.839849+0000","last_clean":"2023-12-07T21:11:20.839849+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:20.839849+0000","last_undegraded":"2023-12-07T21:11:20.839849+0000","last_fullsized":"2023-12-07T21:11:20.839849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608769+0000","last_change":"2023-12-07T21:09:02.907875+0000","last_active":"2023-12-07T21:11:10.608769+0000","last_peered":"2023-12-07T21:11:10.608769+0000","last_clean":"2023-12-07T21:11:10.608769+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:11:10.608769+0000","last_undegraded":"2023-12-07T21:11:10.608769+0000","last_fullsized":"2023-12-07T21:11:10.608769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802571+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:11:08.802571+0000","last_peered":"2023-12-07T21:11:08.802571+0000","last_clean":"2023-12-07T21:11:08.802571+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:11:08.802571+0000","last_undegraded":"2023-12-07T21:11:08.802571+0000","last_fullsized":"2023-12-07T21:11:08.802571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766751+0000","last_change":"2023-12-07T21:08:56.879187+0000","last_active":"2023-12-07T21:11:09.766751+0000","last_peered":"2023-12-07T21:11:09.766751+0000","last_clean":"2023-12-07T21:11:09.766751+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:11:09.766751+0000","last_undegraded":"2023-12-07T21:11:09.766751+0000","last_fullsized":"2023-12-07T21:11:09.766751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187534+0000","last_change":"2023-12-07T21:08:54.880755+0000","last_active":"2023-12-07T21:11:10.187534+0000","last_peered":"2023-12-07T21:11:10.187534+0000","last_clean":"2023-12-07T21:11:10.187534+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:11:10.187534+0000","last_undegraded":"2023-12-07T21:11:10.187534+0000","last_fullsized":"2023-12-07T21:11:10.187534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.790833+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:15.790833+0000","last_peered":"2023-12-07T21:11:15.790833+0000","last_clean":"2023-12-07T21:11:15.790833+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:15.790833+0000","last_undegraded":"2023-12-07T21:11:15.790833+0000","last_fullsized":"2023-12-07T21:11:15.790833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345587+0000","last_change":"2023-12-07T21:09:00.886499+0000","last_active":"2023-12-07T21:11:09.345587+0000","last_peered":"2023-12-07T21:11:09.345587+0000","last_clean":"2023-12-07T21:11:09.345587+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:09.345587+0000","last_undegraded":"2023-12-07T21:11:09.345587+0000","last_fullsized":"2023-12-07T21:11:09.345587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:19.515594+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:19.515594+0000","last_peered":"2023-12-07T21:11:19.515594+0000","last_clean":"2023-12-07T21:11:19.515594+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:19.515594+0000","last_undegraded":"2023-12-07T21:11:19.515594+0000","last_fullsized":"2023-12-07T21:11:19.515594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345954+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:11:09.345954+0000","last_peered":"2023-12-07T21:11:09.345954+0000","last_clean":"2023-12-07T21:11:09.345954+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:11:09.345954+0000","last_undegraded":"2023-12-07T21:11:09.345954+0000","last_fullsized":"2023-12-07T21:11:09.345954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345219+0000","last_change":"2023-12-07T21:08:56.874712+0000","last_active":"2023-12-07T21:11:09.345219+0000","last_peered":"2023-12-07T21:11:09.345219+0000","last_clean":"2023-12-07T21:11:09.345219+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:11:09.345219+0000","last_undegraded":"2023-12-07T21:11:09.345219+0000","last_fullsized":"2023-12-07T21:11:09.345219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187591+0000","last_change":"2023-12-07T21:08:54.885182+0000","last_active":"2023-12-07T21:11:10.187591+0000","last_peered":"2023-12-07T21:11:10.187591+0000","last_clean":"2023-12-07T21:11:10.187591+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:11:10.187591+0000","last_undegraded":"2023-12-07T21:11:10.187591+0000","last_fullsized":"2023-12-07T21:11:10.187591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188032+0000","last_change":"2023-12-07T21:08:58.873698+0000","last_active":"2023-12-07T21:11:10.188032+0000","last_peered":"2023-12-07T21:11:10.188032+0000","last_clean":"2023-12-07T21:11:10.188032+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:11:10.188032+0000","last_undegraded":"2023-12-07T21:11:10.188032+0000","last_fullsized":"2023-12-07T21:11:10.188032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.678798+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:11.678798+0000","last_peered":"2023-12-07T21:11:11.678798+0000","last_clean":"2023-12-07T21:11:11.678798+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:11.678798+0000","last_undegraded":"2023-12-07T21:11:11.678798+0000","last_fullsized":"2023-12-07T21:11:11.678798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.302787+0000","last_change":"2023-12-07T21:11:36.302809+0000","last_active":"2023-12-07T21:11:36.302787+0000","last_peered":"2023-12-07T21:11:36.302787+0000","last_clean":"2023-12-07T21:11:36.302787+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:36.302787+0000","last_undegraded":"2023-12-07T21:11:36.302787+0000","last_fullsized":"2023-12-07T21:11:36.302787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.302687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:01.567462+0000","scrub_duration":0.0014296669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608968+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:11:10.608968+0000","last_peered":"2023-12-07T21:11:10.608968+0000","last_clean":"2023-12-07T21:11:10.608968+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:11:10.608968+0000","last_undegraded":"2023-12-07T21:11:10.608968+0000","last_fullsized":"2023-12-07T21:11:10.608968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608103+0000","last_change":"2023-12-07T21:08:56.887184+0000","last_active":"2023-12-07T21:11:10.608103+0000","last_peered":"2023-12-07T21:11:10.608103+0000","last_clean":"2023-12-07T21:11:10.608103+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:11:10.608103+0000","last_undegraded":"2023-12-07T21:11:10.608103+0000","last_fullsized":"2023-12-07T21:11:10.608103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766431+0000","last_change":"2023-12-07T21:08:54.878542+0000","last_active":"2023-12-07T21:11:09.766431+0000","last_peered":"2023-12-07T21:11:09.766431+0000","last_clean":"2023-12-07T21:11:09.766431+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:11:09.766431+0000","last_undegraded":"2023-12-07T21:11:09.766431+0000","last_fullsized":"2023-12-07T21:11:09.766431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608378+0000","last_change":"2023-12-07T21:08:58.878455+0000","last_active":"2023-12-07T21:11:10.608378+0000","last_peered":"2023-12-07T21:11:10.608378+0000","last_clean":"2023-12-07T21:11:10.608378+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:10.608378+0000","last_undegraded":"2023-12-07T21:11:10.608378+0000","last_fullsized":"2023-12-07T21:11:10.608378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.532757+0000","last_change":"2023-12-07T21:11:32.532802+0000","last_active":"2023-12-07T21:11:32.532757+0000","last_peered":"2023-12-07T21:11:32.532757+0000","last_clean":"2023-12-07T21:11:32.532757+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:32.532757+0000","last_undegraded":"2023-12-07T21:11:32.532757+0000","last_fullsized":"2023-12-07T21:11:32.532757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.532666+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:34.382885+0000","scrub_duration":0.0035860219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.544268+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:17.544268+0000","last_peered":"2023-12-07T21:11:17.544268+0000","last_clean":"2023-12-07T21:11:17.544268+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:17.544268+0000","last_undegraded":"2023-12-07T21:11:17.544268+0000","last_fullsized":"2023-12-07T21:11:17.544268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808681+0000","last_change":"2023-12-07T21:08:56.873185+0000","last_active":"2023-12-07T21:11:03.808681+0000","last_peered":"2023-12-07T21:11:03.808681+0000","last_clean":"2023-12-07T21:11:03.808681+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:11:03.808681+0000","last_undegraded":"2023-12-07T21:11:03.808681+0000","last_fullsized":"2023-12-07T21:11:03.808681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607720+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:11:10.607720+0000","last_peered":"2023-12-07T21:11:10.607720+0000","last_clean":"2023-12-07T21:11:10.607720+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:11:10.607720+0000","last_undegraded":"2023-12-07T21:11:10.607720+0000","last_fullsized":"2023-12-07T21:11:10.607720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800299+0000","last_change":"2023-12-07T21:08:58.879555+0000","last_active":"2023-12-07T21:10:58.800299+0000","last_peered":"2023-12-07T21:10:58.800299+0000","last_clean":"2023-12-07T21:10:58.800299+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:10:58.800299+0000","last_undegraded":"2023-12-07T21:10:58.800299+0000","last_fullsized":"2023-12-07T21:10:58.800299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'61","reported_seq":127,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.783931+0000","last_change":"2023-12-07T21:11:44.783993+0000","last_active":"2023-12-07T21:11:44.783931+0000","last_peered":"2023-12-07T21:11:44.783931+0000","last_clean":"2023-12-07T21:11:44.783931+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:44.783931+0000","last_undegraded":"2023-12-07T21:11:44.783931+0000","last_fullsized":"2023-12-07T21:11:44.783931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.783824+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:07.474940+0000","scrub_duration":0.004588193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.558888+0000","last_change":"2023-12-07T21:11:36.558908+0000","last_active":"2023-12-07T21:11:36.558888+0000","last_peered":"2023-12-07T21:11:36.558888+0000","last_clean":"2023-12-07T21:11:36.558888+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:11:36.558888+0000","last_undegraded":"2023-12-07T21:11:36.558888+0000","last_fullsized":"2023-12-07T21:11:36.558888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.558807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:33:06.320086+0000","scrub_duration":0.001387288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345942+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:11:09.345942+0000","last_peered":"2023-12-07T21:11:09.345942+0000","last_clean":"2023-12-07T21:11:09.345942+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:11:09.345942+0000","last_undegraded":"2023-12-07T21:11:09.345942+0000","last_fullsized":"2023-12-07T21:11:09.345942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173426+0000","last_change":"2023-12-07T21:08:56.877115+0000","last_active":"2023-12-07T21:10:59.173426+0000","last_peered":"2023-12-07T21:10:59.173426+0000","last_clean":"2023-12-07T21:10:59.173426+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:10:59.173426+0000","last_undegraded":"2023-12-07T21:10:59.173426+0000","last_fullsized":"2023-12-07T21:10:59.173426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766432+0000","last_change":"2023-12-07T21:08:54.882363+0000","last_active":"2023-12-07T21:11:09.766432+0000","last_peered":"2023-12-07T21:11:09.766432+0000","last_clean":"2023-12-07T21:11:09.766432+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:11:09.766432+0000","last_undegraded":"2023-12-07T21:11:09.766432+0000","last_fullsized":"2023-12-07T21:11:09.766432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807381+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:11:03.807381+0000","last_peered":"2023-12-07T21:11:03.807381+0000","last_clean":"2023-12-07T21:11:03.807381+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:11:03.807381+0000","last_undegraded":"2023-12-07T21:11:03.807381+0000","last_fullsized":"2023-12-07T21:11:03.807381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'37","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608669+0000","last_change":"2023-12-07T21:09:00.887309+0000","last_active":"2023-12-07T21:11:10.608669+0000","last_peered":"2023-12-07T21:11:10.608669+0000","last_clean":"2023-12-07T21:11:10.608669+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:11:10.608669+0000","last_undegraded":"2023-12-07T21:11:10.608669+0000","last_fullsized":"2023-12-07T21:11:10.608669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767423+0000","last_change":"2023-12-07T21:09:02.907306+0000","last_active":"2023-12-07T21:11:09.767423+0000","last_peered":"2023-12-07T21:11:09.767423+0000","last_clean":"2023-12-07T21:11:09.767423+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:11:09.767423+0000","last_undegraded":"2023-12-07T21:11:09.767423+0000","last_fullsized":"2023-12-07T21:11:09.767423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608912+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:11:10.608912+0000","last_peered":"2023-12-07T21:11:10.608912+0000","last_clean":"2023-12-07T21:11:10.608912+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:11:10.608912+0000","last_undegraded":"2023-12-07T21:11:10.608912+0000","last_fullsized":"2023-12-07T21:11:10.608912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608122+0000","last_change":"2023-12-07T21:08:56.885223+0000","last_active":"2023-12-07T21:11:10.608122+0000","last_peered":"2023-12-07T21:11:10.608122+0000","last_clean":"2023-12-07T21:11:10.608122+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:11:10.608122+0000","last_undegraded":"2023-12-07T21:11:10.608122+0000","last_fullsized":"2023-12-07T21:11:10.608122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766451+0000","last_change":"2023-12-07T21:08:54.887587+0000","last_active":"2023-12-07T21:11:09.766451+0000","last_peered":"2023-12-07T21:11:09.766451+0000","last_clean":"2023-12-07T21:11:09.766451+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:11:09.766451+0000","last_undegraded":"2023-12-07T21:11:09.766451+0000","last_fullsized":"2023-12-07T21:11:09.766451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188054+0000","last_change":"2023-12-07T21:08:58.876479+0000","last_active":"2023-12-07T21:11:10.188054+0000","last_peered":"2023-12-07T21:11:10.188054+0000","last_clean":"2023-12-07T21:11:10.188054+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:11:10.188054+0000","last_undegraded":"2023-12-07T21:11:10.188054+0000","last_fullsized":"2023-12-07T21:11:10.188054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.745145+0000","last_change":"2023-12-07T21:11:36.745178+0000","last_active":"2023-12-07T21:11:36.745145+0000","last_peered":"2023-12-07T21:11:36.745145+0000","last_clean":"2023-12-07T21:11:36.745145+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:36.745145+0000","last_undegraded":"2023-12-07T21:11:36.745145+0000","last_fullsized":"2023-12-07T21:11:36.745145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.745068+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:09.080620+0000","scrub_duration":0.0072373669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:16.616692+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:11:16.616692+0000","last_peered":"2023-12-07T21:11:16.616692+0000","last_clean":"2023-12-07T21:11:16.616692+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:11:16.616692+0000","last_undegraded":"2023-12-07T21:11:16.616692+0000","last_fullsized":"2023-12-07T21:11:16.616692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608884+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:11:10.608884+0000","last_peered":"2023-12-07T21:11:10.608884+0000","last_clean":"2023-12-07T21:11:10.608884+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:11:10.608884+0000","last_undegraded":"2023-12-07T21:11:10.608884+0000","last_fullsized":"2023-12-07T21:11:10.608884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'3","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345230+0000","last_change":"2023-12-07T21:08:56.872465+0000","last_active":"2023-12-07T21:11:09.345230+0000","last_peered":"2023-12-07T21:11:09.345230+0000","last_clean":"2023-12-07T21:11:09.345230+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:11:09.345230+0000","last_undegraded":"2023-12-07T21:11:09.345230+0000","last_fullsized":"2023-12-07T21:11:09.345230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607746+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:11:10.607746+0000","last_peered":"2023-12-07T21:11:10.607746+0000","last_clean":"2023-12-07T21:11:10.607746+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:11:10.607746+0000","last_undegraded":"2023-12-07T21:11:10.607746+0000","last_fullsized":"2023-12-07T21:11:10.607746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.324406+0000","last_change":"2023-12-07T21:11:41.324449+0000","last_active":"2023-12-07T21:11:41.324406+0000","last_peered":"2023-12-07T21:11:41.324406+0000","last_clean":"2023-12-07T21:11:41.324406+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:41.324406+0000","last_undegraded":"2023-12-07T21:11:41.324406+0000","last_fullsized":"2023-12-07T21:11:41.324406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.324294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:18:22.956309+0000","scrub_duration":0.001431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808601+0000","last_change":"2023-12-07T21:09:00.896323+0000","last_active":"2023-12-07T21:11:03.808601+0000","last_peered":"2023-12-07T21:11:03.808601+0000","last_clean":"2023-12-07T21:11:03.808601+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:11:03.808601+0000","last_undegraded":"2023-12-07T21:11:03.808601+0000","last_fullsized":"2023-12-07T21:11:03.808601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411900+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411900+0000","last_peered":"2023-12-07T21:11:10.411900+0000","last_clean":"2023-12-07T21:11:10.411900+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411900+0000","last_undegraded":"2023-12-07T21:11:10.411900+0000","last_fullsized":"2023-12-07T21:11:10.411900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608864+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:11:10.608864+0000","last_peered":"2023-12-07T21:11:10.608864+0000","last_clean":"2023-12-07T21:11:10.608864+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:11:10.608864+0000","last_undegraded":"2023-12-07T21:11:10.608864+0000","last_fullsized":"2023-12-07T21:11:10.608864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187884+0000","last_change":"2023-12-07T21:08:56.871124+0000","last_active":"2023-12-07T21:11:10.187884+0000","last_peered":"2023-12-07T21:11:10.187884+0000","last_clean":"2023-12-07T21:11:10.187884+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:11:10.187884+0000","last_undegraded":"2023-12-07T21:11:10.187884+0000","last_fullsized":"2023-12-07T21:11:10.187884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766523+0000","last_change":"2023-12-07T21:08:54.876774+0000","last_active":"2023-12-07T21:11:09.766523+0000","last_peered":"2023-12-07T21:11:09.766523+0000","last_clean":"2023-12-07T21:11:09.766523+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:11:09.766523+0000","last_undegraded":"2023-12-07T21:11:09.766523+0000","last_fullsized":"2023-12-07T21:11:09.766523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.351535+0000","last_change":"2023-12-07T21:11:43.351557+0000","last_active":"2023-12-07T21:11:43.351535+0000","last_peered":"2023-12-07T21:11:43.351535+0000","last_clean":"2023-12-07T21:11:43.351535+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:43.351535+0000","last_undegraded":"2023-12-07T21:11:43.351535+0000","last_fullsized":"2023-12-07T21:11:43.351535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_clean_scrub_stamp":"2023-12-07T21:11:43.351414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:25.302758+0000","scrub_duration":0.001534795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.102589+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:17.102589+0000","last_peered":"2023-12-07T21:11:17.102589+0000","last_clean":"2023-12-07T21:11:17.102589+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:17.102589+0000","last_undegraded":"2023-12-07T21:11:17.102589+0000","last_fullsized":"2023-12-07T21:11:17.102589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.804304+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:27.804304+0000","last_peered":"2023-12-07T21:11:27.804304+0000","last_clean":"2023-12-07T21:11:27.804304+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:27.804304+0000","last_undegraded":"2023-12-07T21:11:27.804304+0000","last_fullsized":"2023-12-07T21:11:27.804304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767539+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:11:09.767539+0000","last_peered":"2023-12-07T21:11:09.767539+0000","last_clean":"2023-12-07T21:11:09.767539+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:11:09.767539+0000","last_undegraded":"2023-12-07T21:11:09.767539+0000","last_fullsized":"2023-12-07T21:11:09.767539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187796+0000","last_change":"2023-12-07T21:08:56.870984+0000","last_active":"2023-12-07T21:11:10.187796+0000","last_peered":"2023-12-07T21:11:10.187796+0000","last_clean":"2023-12-07T21:11:10.187796+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:11:10.187796+0000","last_undegraded":"2023-12-07T21:11:10.187796+0000","last_fullsized":"2023-12-07T21:11:10.187796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607752+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:11:10.607752+0000","last_peered":"2023-12-07T21:11:10.607752+0000","last_clean":"2023-12-07T21:11:10.607752+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:11:10.607752+0000","last_undegraded":"2023-12-07T21:11:10.607752+0000","last_fullsized":"2023-12-07T21:11:10.607752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188024+0000","last_change":"2023-12-07T21:08:58.881984+0000","last_active":"2023-12-07T21:11:10.188024+0000","last_peered":"2023-12-07T21:11:10.188024+0000","last_clean":"2023-12-07T21:11:10.188024+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:11:10.188024+0000","last_undegraded":"2023-12-07T21:11:10.188024+0000","last_fullsized":"2023-12-07T21:11:10.188024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.713857+0000","last_change":"2023-12-07T21:11:41.713922+0000","last_active":"2023-12-07T21:11:41.713857+0000","last_peered":"2023-12-07T21:11:41.713857+0000","last_clean":"2023-12-07T21:11:41.713857+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:41.713857+0000","last_undegraded":"2023-12-07T21:11:41.713857+0000","last_fullsized":"2023-12-07T21:11:41.713857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.713762+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:20:34.087308+0000","scrub_duration":0.004054785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608739+0000","last_change":"2023-12-07T21:09:02.907688+0000","last_active":"2023-12-07T21:11:10.608739+0000","last_peered":"2023-12-07T21:11:10.608739+0000","last_clean":"2023-12-07T21:11:10.608739+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:11:10.608739+0000","last_undegraded":"2023-12-07T21:11:10.608739+0000","last_fullsized":"2023-12-07T21:11:10.608739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608952+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:11:10.608952+0000","last_peered":"2023-12-07T21:11:10.608952+0000","last_clean":"2023-12-07T21:11:10.608952+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:11:10.608952+0000","last_undegraded":"2023-12-07T21:11:10.608952+0000","last_fullsized":"2023-12-07T21:11:10.608952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608124+0000","last_change":"2023-12-07T21:08:56.873059+0000","last_active":"2023-12-07T21:11:10.608124+0000","last_peered":"2023-12-07T21:11:10.608124+0000","last_clean":"2023-12-07T21:11:10.608124+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:11:10.608124+0000","last_undegraded":"2023-12-07T21:11:10.608124+0000","last_fullsized":"2023-12-07T21:11:10.608124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800263+0000","last_change":"2023-12-07T21:08:54.890887+0000","last_active":"2023-12-07T21:10:58.800263+0000","last_peered":"2023-12-07T21:10:58.800263+0000","last_clean":"2023-12-07T21:10:58.800263+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:10:58.800263+0000","last_undegraded":"2023-12-07T21:10:58.800263+0000","last_fullsized":"2023-12-07T21:10:58.800263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767118+0000","last_change":"2023-12-07T21:08:58.878440+0000","last_active":"2023-12-07T21:11:09.767118+0000","last_peered":"2023-12-07T21:11:09.767118+0000","last_clean":"2023-12-07T21:11:09.767118+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:09.767118+0000","last_undegraded":"2023-12-07T21:11:09.767118+0000","last_fullsized":"2023-12-07T21:11:09.767118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'27","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608669+0000","last_change":"2023-12-07T21:09:00.889913+0000","last_active":"2023-12-07T21:11:10.608669+0000","last_peered":"2023-12-07T21:11:10.608669+0000","last_clean":"2023-12-07T21:11:10.608669+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:11:10.608669+0000","last_undegraded":"2023-12-07T21:11:10.608669+0000","last_fullsized":"2023-12-07T21:11:10.608669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608741+0000","last_change":"2023-12-07T21:09:02.906202+0000","last_active":"2023-12-07T21:11:10.608741+0000","last_peered":"2023-12-07T21:11:10.608741+0000","last_clean":"2023-12-07T21:11:10.608741+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:11:10.608741+0000","last_undegraded":"2023-12-07T21:11:10.608741+0000","last_fullsized":"2023-12-07T21:11:10.608741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608961+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:11:10.608961+0000","last_peered":"2023-12-07T21:11:10.608961+0000","last_clean":"2023-12-07T21:11:10.608961+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:11:10.608961+0000","last_undegraded":"2023-12-07T21:11:10.608961+0000","last_fullsized":"2023-12-07T21:11:10.608961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'13","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187822+0000","last_change":"2023-12-07T21:08:56.869733+0000","last_active":"2023-12-07T21:11:10.187822+0000","last_peered":"2023-12-07T21:11:10.187822+0000","last_clean":"2023-12-07T21:11:10.187822+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:11:10.187822+0000","last_undegraded":"2023-12-07T21:11:10.187822+0000","last_fullsized":"2023-12-07T21:11:10.187822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807399+0000","last_change":"2023-12-07T21:08:54.878825+0000","last_active":"2023-12-07T21:11:03.807399+0000","last_peered":"2023-12-07T21:11:03.807399+0000","last_clean":"2023-12-07T21:11:03.807399+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:11:03.807399+0000","last_undegraded":"2023-12-07T21:11:03.807399+0000","last_fullsized":"2023-12-07T21:11:03.807399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.347674+0000","last_change":"2023-12-07T21:11:44.347728+0000","last_active":"2023-12-07T21:11:44.347674+0000","last_peered":"2023-12-07T21:11:44.347674+0000","last_clean":"2023-12-07T21:11:44.347674+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:44.347674+0000","last_undegraded":"2023-12-07T21:11:44.347674+0000","last_fullsized":"2023-12-07T21:11:44.347674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.347582+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:19:20.740832+0000","scrub_duration":0.0032839919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608679+0000","last_change":"2023-12-07T21:09:00.887872+0000","last_active":"2023-12-07T21:11:10.608679+0000","last_peered":"2023-12-07T21:11:10.608679+0000","last_clean":"2023-12-07T21:11:10.608679+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:11:10.608679+0000","last_undegraded":"2023-12-07T21:11:10.608679+0000","last_fullsized":"2023-12-07T21:11:10.608679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.597790+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:15.597790+0000","last_peered":"2023-12-07T21:11:15.597790+0000","last_clean":"2023-12-07T21:11:15.597790+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:15.597790+0000","last_undegraded":"2023-12-07T21:11:15.597790+0000","last_fullsized":"2023-12-07T21:11:15.597790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608930+0000","last_change":"2023-12-07T21:09:04.928655+0000","last_active":"2023-12-07T21:11:10.608930+0000","last_peered":"2023-12-07T21:11:10.608930+0000","last_clean":"2023-12-07T21:11:10.608930+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:11:10.608930+0000","last_undegraded":"2023-12-07T21:11:10.608930+0000","last_fullsized":"2023-12-07T21:11:10.608930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808984+0000","last_change":"2023-12-07T21:08:56.884246+0000","last_active":"2023-12-07T21:11:08.808984+0000","last_peered":"2023-12-07T21:11:08.808984+0000","last_clean":"2023-12-07T21:11:08.808984+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:11:08.808984+0000","last_undegraded":"2023-12-07T21:11:08.808984+0000","last_fullsized":"2023-12-07T21:11:08.808984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806724+0000","last_change":"2023-12-07T21:08:54.888408+0000","last_active":"2023-12-07T21:11:03.806724+0000","last_peered":"2023-12-07T21:11:03.806724+0000","last_clean":"2023-12-07T21:11:03.806724+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:11:03.806724+0000","last_undegraded":"2023-12-07T21:11:03.806724+0000","last_fullsized":"2023-12-07T21:11:03.806724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802632+0000","last_change":"2023-12-07T21:08:56.873286+0000","last_active":"2023-12-07T21:11:08.802632+0000","last_peered":"2023-12-07T21:11:08.802632+0000","last_clean":"2023-12-07T21:11:08.802632+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:11:08.802632+0000","last_undegraded":"2023-12-07T21:11:08.802632+0000","last_fullsized":"2023-12-07T21:11:08.802632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800891+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:11:03.800891+0000","last_peered":"2023-12-07T21:11:03.800891+0000","last_clean":"2023-12-07T21:11:03.800891+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:11:03.800891+0000","last_undegraded":"2023-12-07T21:11:03.800891+0000","last_fullsized":"2023-12-07T21:11:03.800891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809648+0000","last_change":"2023-12-07T21:08:56.874905+0000","last_active":"2023-12-07T21:11:08.809648+0000","last_peered":"2023-12-07T21:11:08.809648+0000","last_clean":"2023-12-07T21:11:08.809648+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:11:08.809648+0000","last_undegraded":"2023-12-07T21:11:08.809648+0000","last_fullsized":"2023-12-07T21:11:08.809648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808292+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:11:03.808292+0000","last_peered":"2023-12-07T21:11:03.808292+0000","last_clean":"2023-12-07T21:11:03.808292+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:11:03.808292+0000","last_undegraded":"2023-12-07T21:11:03.808292+0000","last_fullsized":"2023-12-07T21:11:03.808292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802478+0000","last_change":"2023-12-07T21:08:56.872273+0000","last_active":"2023-12-07T21:11:08.802478+0000","last_peered":"2023-12-07T21:11:08.802478+0000","last_clean":"2023-12-07T21:11:08.802478+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:11:08.802478+0000","last_undegraded":"2023-12-07T21:11:08.802478+0000","last_fullsized":"2023-12-07T21:11:08.802478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801133+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:11:03.801133+0000","last_peered":"2023-12-07T21:11:03.801133+0000","last_clean":"2023-12-07T21:11:03.801133+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:11:03.801133+0000","last_undegraded":"2023-12-07T21:11:03.801133+0000","last_fullsized":"2023-12-07T21:11:03.801133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801089+0000","last_change":"2023-12-07T21:08:56.876070+0000","last_active":"2023-12-07T21:11:03.801089+0000","last_peered":"2023-12-07T21:11:03.801089+0000","last_clean":"2023-12-07T21:11:03.801089+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:11:03.801089+0000","last_undegraded":"2023-12-07T21:11:03.801089+0000","last_fullsized":"2023-12-07T21:11:03.801089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802500+0000","last_change":"2023-12-07T21:08:54.874578+0000","last_active":"2023-12-07T21:11:08.802500+0000","last_peered":"2023-12-07T21:11:08.802500+0000","last_clean":"2023-12-07T21:11:08.802500+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:11:08.802500+0000","last_undegraded":"2023-12-07T21:11:08.802500+0000","last_fullsized":"2023-12-07T21:11:08.802500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807052+0000","last_change":"2023-12-07T21:08:56.883348+0000","last_active":"2023-12-07T21:11:03.807052+0000","last_peered":"2023-12-07T21:11:03.807052+0000","last_clean":"2023-12-07T21:11:03.807052+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:11:03.807052+0000","last_undegraded":"2023-12-07T21:11:03.807052+0000","last_fullsized":"2023-12-07T21:11:03.807052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808756+0000","last_change":"2023-12-07T21:08:54.887259+0000","last_active":"2023-12-07T21:11:08.808756+0000","last_peered":"2023-12-07T21:11:08.808756+0000","last_clean":"2023-12-07T21:11:08.808756+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:11:08.808756+0000","last_undegraded":"2023-12-07T21:11:08.808756+0000","last_fullsized":"2023-12-07T21:11:08.808756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800970+0000","last_change":"2023-12-07T21:08:56.876299+0000","last_active":"2023-12-07T21:11:03.800970+0000","last_peered":"2023-12-07T21:11:03.800970+0000","last_clean":"2023-12-07T21:11:03.800970+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:11:03.800970+0000","last_undegraded":"2023-12-07T21:11:03.800970+0000","last_fullsized":"2023-12-07T21:11:03.800970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808785+0000","last_change":"2023-12-07T21:08:54.885457+0000","last_active":"2023-12-07T21:11:08.808785+0000","last_peered":"2023-12-07T21:11:08.808785+0000","last_clean":"2023-12-07T21:11:08.808785+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:11:08.808785+0000","last_undegraded":"2023-12-07T21:11:08.808785+0000","last_fullsized":"2023-12-07T21:11:08.808785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806817+0000","last_change":"2023-12-07T21:08:56.887101+0000","last_active":"2023-12-07T21:11:03.806817+0000","last_peered":"2023-12-07T21:11:03.806817+0000","last_clean":"2023-12-07T21:11:03.806817+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:11:03.806817+0000","last_undegraded":"2023-12-07T21:11:03.806817+0000","last_fullsized":"2023-12-07T21:11:03.806817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802670+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:11:08.802670+0000","last_peered":"2023-12-07T21:11:08.802670+0000","last_clean":"2023-12-07T21:11:08.802670+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:11:08.802670+0000","last_undegraded":"2023-12-07T21:11:08.802670+0000","last_fullsized":"2023-12-07T21:11:08.802670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766944+0000","last_change":"2023-12-07T21:08:56.882240+0000","last_active":"2023-12-07T21:11:09.766944+0000","last_peered":"2023-12-07T21:11:09.766944+0000","last_clean":"2023-12-07T21:11:09.766944+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:11:09.766944+0000","last_undegraded":"2023-12-07T21:11:09.766944+0000","last_fullsized":"2023-12-07T21:11:09.766944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809216+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:11:08.809216+0000","last_peered":"2023-12-07T21:11:08.809216+0000","last_clean":"2023-12-07T21:11:08.809216+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:11:08.809216+0000","last_undegraded":"2023-12-07T21:11:08.809216+0000","last_fullsized":"2023-12-07T21:11:08.809216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608162+0000","last_change":"2023-12-07T21:08:56.875906+0000","last_active":"2023-12-07T21:11:10.608162+0000","last_peered":"2023-12-07T21:11:10.608162+0000","last_clean":"2023-12-07T21:11:10.608162+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:11:10.608162+0000","last_undegraded":"2023-12-07T21:11:10.608162+0000","last_fullsized":"2023-12-07T21:11:10.608162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345160+0000","last_change":"2023-12-07T21:08:54.883629+0000","last_active":"2023-12-07T21:11:09.345160+0000","last_peered":"2023-12-07T21:11:09.345160+0000","last_clean":"2023-12-07T21:11:09.345160+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:11:09.345160+0000","last_undegraded":"2023-12-07T21:11:09.345160+0000","last_fullsized":"2023-12-07T21:11:09.345160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345344+0000","last_change":"2023-12-07T21:08:56.876309+0000","last_active":"2023-12-07T21:11:09.345344+0000","last_peered":"2023-12-07T21:11:09.345344+0000","last_clean":"2023-12-07T21:11:09.345344+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:11:09.345344+0000","last_undegraded":"2023-12-07T21:11:09.345344+0000","last_fullsized":"2023-12-07T21:11:09.345344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766567+0000","last_change":"2023-12-07T21:08:54.887130+0000","last_active":"2023-12-07T21:11:09.766567+0000","last_peered":"2023-12-07T21:11:09.766567+0000","last_clean":"2023-12-07T21:11:09.766567+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:11:09.766567+0000","last_undegraded":"2023-12-07T21:11:09.766567+0000","last_fullsized":"2023-12-07T21:11:09.766567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766855+0000","last_change":"2023-12-07T21:08:56.871205+0000","last_active":"2023-12-07T21:11:09.766855+0000","last_peered":"2023-12-07T21:11:09.766855+0000","last_clean":"2023-12-07T21:11:09.766855+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:11:09.766855+0000","last_undegraded":"2023-12-07T21:11:09.766855+0000","last_fullsized":"2023-12-07T21:11:09.766855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766587+0000","last_change":"2023-12-07T21:08:54.884013+0000","last_active":"2023-12-07T21:11:09.766587+0000","last_peered":"2023-12-07T21:11:09.766587+0000","last_clean":"2023-12-07T21:11:09.766587+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:11:09.766587+0000","last_undegraded":"2023-12-07T21:11:09.766587+0000","last_fullsized":"2023-12-07T21:11:09.766587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766814+0000","last_change":"2023-12-07T21:08:56.879513+0000","last_active":"2023-12-07T21:11:09.766814+0000","last_peered":"2023-12-07T21:11:09.766814+0000","last_clean":"2023-12-07T21:11:09.766814+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:11:09.766814+0000","last_undegraded":"2023-12-07T21:11:09.766814+0000","last_fullsized":"2023-12-07T21:11:09.766814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607834+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:11:10.607834+0000","last_peered":"2023-12-07T21:11:10.607834+0000","last_clean":"2023-12-07T21:11:10.607834+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:11:10.607834+0000","last_undegraded":"2023-12-07T21:11:10.607834+0000","last_fullsized":"2023-12-07T21:11:10.607834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'15","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766836+0000","last_change":"2023-12-07T21:08:56.882760+0000","last_active":"2023-12-07T21:11:09.766836+0000","last_peered":"2023-12-07T21:11:09.766836+0000","last_clean":"2023-12-07T21:11:09.766836+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:11:09.766836+0000","last_undegraded":"2023-12-07T21:11:09.766836+0000","last_fullsized":"2023-12-07T21:11:09.766836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607826+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:11:10.607826+0000","last_peered":"2023-12-07T21:11:10.607826+0000","last_clean":"2023-12-07T21:11:10.607826+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:11:10.607826+0000","last_undegraded":"2023-12-07T21:11:10.607826+0000","last_fullsized":"2023-12-07T21:11:10.607826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608179+0000","last_change":"2023-12-07T21:08:56.876875+0000","last_active":"2023-12-07T21:11:10.608179+0000","last_peered":"2023-12-07T21:11:10.608179+0000","last_clean":"2023-12-07T21:11:10.608179+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:11:10.608179+0000","last_undegraded":"2023-12-07T21:11:10.608179+0000","last_fullsized":"2023-12-07T21:11:10.608179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187739+0000","last_change":"2023-12-07T21:08:54.885432+0000","last_active":"2023-12-07T21:11:10.187739+0000","last_peered":"2023-12-07T21:11:10.187739+0000","last_clean":"2023-12-07T21:11:10.187739+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:11:10.187739+0000","last_undegraded":"2023-12-07T21:11:10.187739+0000","last_fullsized":"2023-12-07T21:11:10.187739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808321+0000","last_change":"2023-12-07T21:08:56.889380+0000","last_active":"2023-12-07T21:11:08.808321+0000","last_peered":"2023-12-07T21:11:08.808321+0000","last_clean":"2023-12-07T21:11:08.808321+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:11:08.808321+0000","last_undegraded":"2023-12-07T21:11:08.808321+0000","last_fullsized":"2023-12-07T21:11:08.808321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607856+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:11:10.607856+0000","last_peered":"2023-12-07T21:11:10.607856+0000","last_clean":"2023-12-07T21:11:10.607856+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:11:10.607856+0000","last_undegraded":"2023-12-07T21:11:10.607856+0000","last_fullsized":"2023-12-07T21:11:10.607856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607882+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:11:10.607882+0000","last_peered":"2023-12-07T21:11:10.607882+0000","last_clean":"2023-12-07T21:11:10.607882+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:11:10.607882+0000","last_undegraded":"2023-12-07T21:11:10.607882+0000","last_fullsized":"2023-12-07T21:11:10.607882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345392+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:11:09.345392+0000","last_peered":"2023-12-07T21:11:09.345392+0000","last_clean":"2023-12-07T21:11:09.345392+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:11:09.345392+0000","last_undegraded":"2023-12-07T21:11:09.345392+0000","last_fullsized":"2023-12-07T21:11:09.345392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345178+0000","last_change":"2023-12-07T21:08:54.883760+0000","last_active":"2023-12-07T21:11:09.345178+0000","last_peered":"2023-12-07T21:11:09.345178+0000","last_clean":"2023-12-07T21:11:09.345178+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:11:09.345178+0000","last_undegraded":"2023-12-07T21:11:09.345178+0000","last_fullsized":"2023-12-07T21:11:09.345178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766992+0000","last_change":"2023-12-07T21:08:56.881838+0000","last_active":"2023-12-07T21:11:09.766992+0000","last_peered":"2023-12-07T21:11:09.766992+0000","last_clean":"2023-12-07T21:11:09.766992+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:11:09.766992+0000","last_undegraded":"2023-12-07T21:11:09.766992+0000","last_fullsized":"2023-12-07T21:11:09.766992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1969,"ondisk_log_size":1969,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1372,"ondisk_log_size":1372,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705706,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.56899999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54500000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.443}]},{"osd":1,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.33700000000000002,"15min":0.34399999999999997},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.40200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34100000000000003,"15min":0.34599999999999997},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45300000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.24199999999999999}]},{"osd":2,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.52300000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.44700000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.315}]}]},{"osd":2,"up_from":9,"seq":38654705705,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.22900000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.24399999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.59499999999999997,"5min":0.621,"15min":0.621},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Dec 7 21:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.371}]},{"osd":3,"last update":"Thu Dec 7 21:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.313},{"interface":"front","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33400000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705705,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45200000000000001,"15min":0.45500000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.59199999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.222,"15min":0.222},"max":{"1min":0.57699999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Dec 7 21:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35299999999999998,"15min":0.36299999999999999},"min":{"1min":0.22700000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.50600000000000001,"5min":0.629,"15min":0.629},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.22900000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.48999999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Dec 7 21:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46400000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.373,"15min":0.379},"min":{"1min":0.29099999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.48599999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.47499999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.67600000000000005,"5min":0.747,"15min":0.747},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.47499999999999998},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67600000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.29599999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.505},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49099999999999999,"15min":0.48899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:11:51.706 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.706 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.707 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.707 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.707 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.707 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.707 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.707 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.708 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.708 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.708 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.708 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.708 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.708 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.708 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.709 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.709 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.709 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.709 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.709 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.709 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.709 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.710 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.710 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.710 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.710 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.710 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.710 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.711 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.711 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.711 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.711 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.712 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.712 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.712 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.712 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.712 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.712 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.712 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.713 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.713 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.713 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.713 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.713 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.713 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.714 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.714 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.714 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.714 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.714 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.714 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.714 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.715 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.715 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.715 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.715 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.715 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.716 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.716 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.716 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.716 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.716 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.716 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.716 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.717 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.717 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.717 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.717 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.717 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.717 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.718 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.718 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.718 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.718 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.718 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.718 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.719 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.719 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.719 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.719 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.719 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.719 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.719 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-07T21:08:40.790884+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=40, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.720 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.720 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.720 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.720 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.720 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.720 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.720 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.721 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.721 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.721 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.721 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.721 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.721 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.722 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.722 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.722 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.722 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.722 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.722 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.722 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.723 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.723 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.723 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.723 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.723 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.724 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.724 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.724 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.724 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.724 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.724 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.724 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.725 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.725 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.725 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.725 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.725 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.725 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.726 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.726 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.726 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.726 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.726 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.727 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.727 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.727 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.727 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.727 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.727 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.728 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.728 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.728 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.728 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.728 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.728 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.729 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.729 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.729 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.729 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.729 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.729 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.729 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.730 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.730 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.730 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.730 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.730 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.730 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.730 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.731 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.731 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.731 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.731 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.731 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.731 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.731 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.732 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.732 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.732 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.732 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.732 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.732 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.732 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.733 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.733 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.733 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.733 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.733 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.733 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.733 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.734 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.734 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.734 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.734 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.734 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.734 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.735 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.735 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.735 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.735 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.735 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.735 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.735 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.736 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.736 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.736 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.736 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.736 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.736 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.737 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.737 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.737 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.737 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.737 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.737 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.737 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.738 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.738 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.738 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.738 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.738 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.738 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.738 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.739 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.739 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.739 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.739 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.739 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.739 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:11:51.739 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:12:11.740 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:12:11.852 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.860+0000 7f1e1f6c2640 1 Processor -- start 2023-12-07T21:12:11.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.860+0000 7f1e1f6c2640 1 -- start start 2023-12-07T21:12:11.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.861+0000 7f1e1f6c2640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1e1809b570 0x7f1e1809b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:12:11.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.861+0000 7f1e1f6c2640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e18099490 con 0x7f1e1809be90 2023-12-07T21:12:11.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.861+0000 7f1e1f6c2640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e18098740 con 0x7f1e1809b570 2023-12-07T21:12:11.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.861+0000 7f1e1d45e640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1e1809b570 0x7f1e1809b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:12:11.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.861+0000 7f1e1cc5d640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1e1809be90 0x7f1e1812a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:38338/0 (socket says 172.21.15.89:38338) 2023-12-07T21:12:11.853 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.861+0000 7f1e1cc5d640 1 -- 172.21.15.89:0/446608486 learned_addr learned my addr 172.21.15.89:0/446608486 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:12:11.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.861+0000 7f1e1d45e640 1 -- 172.21.15.89:0/446608486 >> v1:172.21.15.89:6789/0 conn(0x7f1e1809be90 legacy=0x7f1e1812a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:11.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.861+0000 7f1e1d45e640 1 -- 172.21.15.89:0/446608486 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1809a040 con 0x7f1e1809b570 2023-12-07T21:12:11.854 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.861+0000 7f1e0ffff640 1 -- 172.21.15.89:0/446608486 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032100911 0 0) 0x7f1e18099490 con 0x7f1e1809be90 2023-12-07T21:12:11.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.862+0000 7f1e1d45e640 1 --2- 172.21.15.89:0/446608486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e1809b570 0x7f1e1809b950 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009720 tx=0x7f1e1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8888b15d6e2cfb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:12:11.856 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.862+0000 7f1e0ffff640 1 -- 172.21.15.89:0/446608486 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e1402e070 con 0x7f1e1809b570 2023-12-07T21:12:11.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.862+0000 7f1e0ffff640 1 -- 172.21.15.89:0/446608486 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e140316d0 con 0x7f1e1809b570 2023-12-07T21:12:11.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.862+0000 7f1e0ffff640 1 -- 172.21.15.89:0/446608486 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e14031990 con 0x7f1e1809b570 2023-12-07T21:12:11.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.863+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/446608486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e1809b570 msgr2=0x7f1e1809b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:11.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.863+0000 7f1e1f6c2640 1 --2- 172.21.15.89:0/446608486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e1809b570 0x7f1e1809b950 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1e14009720 tx=0x7f1e1402b840 comp rx=0 tx=0).stop 2023-12-07T21:12:11.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.863+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/446608486 shutdown_connections 2023-12-07T21:12:11.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.863+0000 7f1e1f6c2640 1 --2- 172.21.15.89:0/446608486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e1809b570 0x7f1e1809b950 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:12:11.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.863+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/446608486 >> 172.21.15.89:0/446608486 conn(0x7f1e1806c730 msgr2=0x7f1e1806cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:12:11.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.863+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/446608486 shutdown_connections 2023-12-07T21:12:11.857 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.863+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/446608486 wait complete. 2023-12-07T21:12:11.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.864+0000 7f1e1f6c2640 1 Processor -- start 2023-12-07T21:12:11.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.864+0000 7f1e1f6c2640 1 -- start start 2023-12-07T21:12:11.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.864+0000 7f1e1f6c2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e1809b570 0x7f1e1806e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:12:11.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.864+0000 7f1e1f6c2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18071d00 con 0x7f1e1809b570 2023-12-07T21:12:11.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.864+0000 7f1e1d45e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e1809b570 0x7f1e1806e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:12:11.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.864+0000 7f1e1d45e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e1809b570 0x7f1e1806e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41936/0 (socket says 172.21.15.89:41936) 2023-12-07T21:12:11.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.864+0000 7f1e1d45e640 1 -- 172.21.15.89:0/2488113402 learned_addr learned my addr 172.21.15.89:0/2488113402 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:12:11.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.864+0000 7f1e1d45e640 1 -- 172.21.15.89:0/2488113402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e14009400 con 0x7f1e1809b570 2023-12-07T21:12:11.858 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.865+0000 7f1e1d45e640 1 --2- 172.21.15.89:0/2488113402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e1809b570 0x7f1e1806e430 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1e1402b880 tx=0x7f1e140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:12:11.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.865+0000 7f1e0dffb640 1 -- 172.21.15.89:0/2488113402 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e14004160 con 0x7f1e1809b570 2023-12-07T21:12:11.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.865+0000 7f1e0dffb640 1 -- 172.21.15.89:0/2488113402 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e140042c0 con 0x7f1e1809b570 2023-12-07T21:12:11.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.865+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/2488113402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e18070490 con 0x7f1e1809b570 2023-12-07T21:12:11.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.865+0000 7f1e0dffb640 1 -- 172.21.15.89:0/2488113402 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e14032700 con 0x7f1e1809b570 2023-12-07T21:12:11.859 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.865+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/2488113402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e18071390 con 0x7f1e1809b570 2023-12-07T21:12:11.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.866+0000 7f1e0dffb640 1 -- 172.21.15.89:0/2488113402 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f1e14032860 con 0x7f1e1809b570 2023-12-07T21:12:11.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.866+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/2488113402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e18071fd0 con 0x7f1e1809b570 2023-12-07T21:12:11.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.866+0000 7f1e0dffb640 1 --2- 172.21.15.89:0/2488113402 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1dfc037820 0x7f1dfc039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:12:11.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.866+0000 7f1e0dffb640 1 -- 172.21.15.89:0/2488113402 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f1e1406d110 con 0x7f1e1809b570 2023-12-07T21:12:11.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.866+0000 7f1e1cc5d640 1 --2- 172.21.15.89:0/2488113402 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1dfc037820 0x7f1dfc039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:12:11.860 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.867+0000 7f1e1cc5d640 1 --2- 172.21.15.89:0/2488113402 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1dfc037820 0x7f1dfc039ce0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1e08000c00 tx=0x7f1e08007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:12:11.862 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:11.871+0000 7f1e0dffb640 1 -- 172.21.15.89:0/2488113402 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e18071fd0 con 0x7f1e1809b570 2023-12-07T21:12:12.025 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.034+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/2488113402 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e18098db0 con 0x7f1dfc037820 2023-12-07T21:12:12.041 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.050+0000 7f1e0dffb640 1 -- 172.21.15.89:0/2488113402 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+667457 (secure 0 0 0) 0x7f1e080012b0 con 0x7f1dfc037820 2023-12-07T21:12:12.049 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:12:12.053 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:12:12.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.054+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/2488113402 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1dfc037820 msgr2=0x7f1dfc039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:12.056 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.054+0000 7f1e1f6c2640 1 --2- 172.21.15.89:0/2488113402 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1dfc037820 0x7f1dfc039ce0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1e08000c00 tx=0x7f1e08007910 comp rx=0 tx=0).stop 2023-12-07T21:12:12.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.054+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/2488113402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e1809b570 msgr2=0x7f1e1806e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:12.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.054+0000 7f1e1f6c2640 1 --2- 172.21.15.89:0/2488113402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e1809b570 0x7f1e1806e430 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1e1402b880 tx=0x7f1e140046c0 comp rx=0 tx=0).stop 2023-12-07T21:12:12.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.054+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/2488113402 shutdown_connections 2023-12-07T21:12:12.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.054+0000 7f1e1f6c2640 1 --2- 172.21.15.89:0/2488113402 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f1dfc037820 0x7f1dfc039ce0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:12:12.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.054+0000 7f1e1f6c2640 1 --2- 172.21.15.89:0/2488113402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e1809b570 0x7f1e1806e430 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:12:12.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.054+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/2488113402 >> 172.21.15.89:0/2488113402 conn(0x7f1e1806c730 msgr2=0x7f1e1812cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:12:12.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.055+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/2488113402 shutdown_connections 2023-12-07T21:12:12.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:12.055+0000 7f1e1f6c2640 1 -- 172.21.15.89:0/2488113402 wait complete. 2023-12-07T21:12:12.058 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-12-07T21:12:10.108939+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3954,"ondisk_log_size":3954,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003508"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807400+0000","last_change":"2023-12-07T21:08:54.882968+0000","last_active":"2023-12-07T21:11:03.807400+0000","last_peered":"2023-12-07T21:11:03.807400+0000","last_clean":"2023-12-07T21:11:03.807400+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:11:03.807400+0000","last_undegraded":"2023-12-07T21:11:03.807400+0000","last_fullsized":"2023-12-07T21:11:03.807400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767028+0000","last_change":"2023-12-07T21:08:56.887127+0000","last_active":"2023-12-07T21:11:09.767028+0000","last_peered":"2023-12-07T21:11:09.767028+0000","last_clean":"2023-12-07T21:11:09.767028+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:11:09.767028+0000","last_undegraded":"2023-12-07T21:11:09.767028+0000","last_fullsized":"2023-12-07T21:11:09.767028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801438+0000","last_change":"2023-12-07T21:08:54.890832+0000","last_active":"2023-12-07T21:11:03.801438+0000","last_peered":"2023-12-07T21:11:03.801438+0000","last_clean":"2023-12-07T21:11:03.801438+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:11:03.801438+0000","last_undegraded":"2023-12-07T21:11:03.801438+0000","last_fullsized":"2023-12-07T21:11:03.801438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345425+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:11:09.345425+0000","last_peered":"2023-12-07T21:11:09.345425+0000","last_clean":"2023-12-07T21:11:09.345425+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:11:09.345425+0000","last_undegraded":"2023-12-07T21:11:09.345425+0000","last_fullsized":"2023-12-07T21:11:09.345425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808550+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:11:03.808550+0000","last_peered":"2023-12-07T21:11:03.808550+0000","last_clean":"2023-12-07T21:11:03.808550+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:11:03.808550+0000","last_undegraded":"2023-12-07T21:11:03.808550+0000","last_fullsized":"2023-12-07T21:11:03.808550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608236+0000","last_change":"2023-12-07T21:08:56.873919+0000","last_active":"2023-12-07T21:11:10.608236+0000","last_peered":"2023-12-07T21:11:10.608236+0000","last_clean":"2023-12-07T21:11:10.608236+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:11:10.608236+0000","last_undegraded":"2023-12-07T21:11:10.608236+0000","last_fullsized":"2023-12-07T21:11:10.608236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.805663+0000","last_change":"2023-12-07T21:08:54.880442+0000","last_active":"2023-12-07T21:10:58.805663+0000","last_peered":"2023-12-07T21:10:58.805663+0000","last_clean":"2023-12-07T21:10:58.805663+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:10:58.805663+0000","last_undegraded":"2023-12-07T21:10:58.805663+0000","last_fullsized":"2023-12-07T21:10:58.805663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608264+0000","last_change":"2023-12-07T21:08:56.874751+0000","last_active":"2023-12-07T21:11:10.608264+0000","last_peered":"2023-12-07T21:11:10.608264+0000","last_clean":"2023-12-07T21:11:10.608264+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:11:10.608264+0000","last_undegraded":"2023-12-07T21:11:10.608264+0000","last_fullsized":"2023-12-07T21:11:10.608264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607907+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:11:10.607907+0000","last_peered":"2023-12-07T21:11:10.607907+0000","last_clean":"2023-12-07T21:11:10.607907+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:11:10.607907+0000","last_undegraded":"2023-12-07T21:11:10.607907+0000","last_fullsized":"2023-12-07T21:11:10.607907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173605+0000","last_change":"2023-12-07T21:08:56.873414+0000","last_active":"2023-12-07T21:10:59.173605+0000","last_peered":"2023-12-07T21:10:59.173605+0000","last_clean":"2023-12-07T21:10:59.173605+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:10:59.173605+0000","last_undegraded":"2023-12-07T21:10:59.173605+0000","last_fullsized":"2023-12-07T21:10:59.173605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187656+0000","last_change":"2023-12-07T21:08:54.880274+0000","last_active":"2023-12-07T21:11:10.187656+0000","last_peered":"2023-12-07T21:11:10.187656+0000","last_clean":"2023-12-07T21:11:10.187656+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:11:10.187656+0000","last_undegraded":"2023-12-07T21:11:10.187656+0000","last_fullsized":"2023-12-07T21:11:10.187656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187892+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:11:10.187892+0000","last_peered":"2023-12-07T21:11:10.187892+0000","last_clean":"2023-12-07T21:11:10.187892+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:11:10.187892+0000","last_undegraded":"2023-12-07T21:11:10.187892+0000","last_fullsized":"2023-12-07T21:11:10.187892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607886+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:11:10.607886+0000","last_peered":"2023-12-07T21:11:10.607886+0000","last_clean":"2023-12-07T21:11:10.607886+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:11:10.607886+0000","last_undegraded":"2023-12-07T21:11:10.607886+0000","last_fullsized":"2023-12-07T21:11:10.607886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807323+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:11:03.807323+0000","last_peered":"2023-12-07T21:11:03.807323+0000","last_clean":"2023-12-07T21:11:03.807323+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:11:03.807323+0000","last_undegraded":"2023-12-07T21:11:03.807323+0000","last_fullsized":"2023-12-07T21:11:03.807323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345133+0000","last_change":"2023-12-07T21:08:54.891021+0000","last_active":"2023-12-07T21:11:09.345133+0000","last_peered":"2023-12-07T21:11:09.345133+0000","last_clean":"2023-12-07T21:11:09.345133+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:11:09.345133+0000","last_undegraded":"2023-12-07T21:11:09.345133+0000","last_fullsized":"2023-12-07T21:11:09.345133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'13","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807362+0000","last_change":"2023-12-07T21:08:56.874321+0000","last_active":"2023-12-07T21:11:03.807362+0000","last_peered":"2023-12-07T21:11:03.807362+0000","last_clean":"2023-12-07T21:11:03.807362+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:11:03.807362+0000","last_undegraded":"2023-12-07T21:11:03.807362+0000","last_fullsized":"2023-12-07T21:11:03.807362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608172+0000","last_change":"2023-12-07T21:08:56.874409+0000","last_active":"2023-12-07T21:11:10.608172+0000","last_peered":"2023-12-07T21:11:10.608172+0000","last_clean":"2023-12-07T21:11:10.608172+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:11:10.608172+0000","last_undegraded":"2023-12-07T21:11:10.608172+0000","last_fullsized":"2023-12-07T21:11:10.608172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766655+0000","last_change":"2023-12-07T21:08:54.887766+0000","last_active":"2023-12-07T21:11:09.766655+0000","last_peered":"2023-12-07T21:11:09.766655+0000","last_clean":"2023-12-07T21:11:09.766655+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:11:09.766655+0000","last_undegraded":"2023-12-07T21:11:09.766655+0000","last_fullsized":"2023-12-07T21:11:09.766655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766942+0000","last_change":"2023-12-07T21:08:56.876692+0000","last_active":"2023-12-07T21:11:09.766942+0000","last_peered":"2023-12-07T21:11:09.766942+0000","last_clean":"2023-12-07T21:11:09.766942+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:11:09.766942+0000","last_undegraded":"2023-12-07T21:11:09.766942+0000","last_fullsized":"2023-12-07T21:11:09.766942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187817+0000","last_change":"2023-12-07T21:08:54.885605+0000","last_active":"2023-12-07T21:11:10.187817+0000","last_peered":"2023-12-07T21:11:10.187817+0000","last_clean":"2023-12-07T21:11:10.187817+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:11:10.187817+0000","last_undegraded":"2023-12-07T21:11:10.187817+0000","last_fullsized":"2023-12-07T21:11:10.187817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'13","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766969+0000","last_change":"2023-12-07T21:08:56.882602+0000","last_active":"2023-12-07T21:11:09.766969+0000","last_peered":"2023-12-07T21:11:09.766969+0000","last_clean":"2023-12-07T21:11:09.766969+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:11:09.766969+0000","last_undegraded":"2023-12-07T21:11:09.766969+0000","last_fullsized":"2023-12-07T21:11:09.766969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766621+0000","last_change":"2023-12-07T21:08:54.889812+0000","last_active":"2023-12-07T21:11:09.766621+0000","last_peered":"2023-12-07T21:11:09.766621+0000","last_clean":"2023-12-07T21:11:09.766621+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:11:09.766621+0000","last_undegraded":"2023-12-07T21:11:09.766621+0000","last_fullsized":"2023-12-07T21:11:09.766621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345375+0000","last_change":"2023-12-07T21:08:56.875989+0000","last_active":"2023-12-07T21:11:09.345375+0000","last_peered":"2023-12-07T21:11:09.345375+0000","last_clean":"2023-12-07T21:11:09.345375+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:11:09.345375+0000","last_undegraded":"2023-12-07T21:11:09.345375+0000","last_fullsized":"2023-12-07T21:11:09.345375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766605+0000","last_change":"2023-12-07T21:08:54.878784+0000","last_active":"2023-12-07T21:11:09.766605+0000","last_peered":"2023-12-07T21:11:09.766605+0000","last_clean":"2023-12-07T21:11:09.766605+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:11:09.766605+0000","last_undegraded":"2023-12-07T21:11:09.766605+0000","last_fullsized":"2023-12-07T21:11:09.766605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187888+0000","last_change":"2023-12-07T21:08:56.875039+0000","last_active":"2023-12-07T21:11:10.187888+0000","last_peered":"2023-12-07T21:11:10.187888+0000","last_clean":"2023-12-07T21:11:10.187888+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:11:10.187888+0000","last_undegraded":"2023-12-07T21:11:10.187888+0000","last_fullsized":"2023-12-07T21:11:10.187888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345261+0000","last_change":"2023-12-07T21:08:54.890574+0000","last_active":"2023-12-07T21:11:09.345261+0000","last_peered":"2023-12-07T21:11:09.345261+0000","last_clean":"2023-12-07T21:11:09.345261+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:11:09.345261+0000","last_undegraded":"2023-12-07T21:11:09.345261+0000","last_fullsized":"2023-12-07T21:11:09.345261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766967+0000","last_change":"2023-12-07T21:08:56.883504+0000","last_active":"2023-12-07T21:11:09.766967+0000","last_peered":"2023-12-07T21:11:09.766967+0000","last_clean":"2023-12-07T21:11:09.766967+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:11:09.766967+0000","last_undegraded":"2023-12-07T21:11:09.766967+0000","last_fullsized":"2023-12-07T21:11:09.766967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607871+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:11:10.607871+0000","last_peered":"2023-12-07T21:11:10.607871+0000","last_clean":"2023-12-07T21:11:10.607871+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:11:10.607871+0000","last_undegraded":"2023-12-07T21:11:10.607871+0000","last_fullsized":"2023-12-07T21:11:10.607871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767525+0000","last_change":"2023-12-07T21:09:04.931981+0000","last_active":"2023-12-07T21:11:09.767525+0000","last_peered":"2023-12-07T21:11:09.767525+0000","last_clean":"2023-12-07T21:11:09.767525+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:11:09.767525+0000","last_undegraded":"2023-12-07T21:11:09.767525+0000","last_fullsized":"2023-12-07T21:11:09.767525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608196+0000","last_change":"2023-12-07T21:08:56.873551+0000","last_active":"2023-12-07T21:11:10.608196+0000","last_peered":"2023-12-07T21:11:10.608196+0000","last_clean":"2023-12-07T21:11:10.608196+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:11:10.608196+0000","last_undegraded":"2023-12-07T21:11:10.608196+0000","last_fullsized":"2023-12-07T21:11:10.608196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607680+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:11:10.607680+0000","last_peered":"2023-12-07T21:11:10.607680+0000","last_clean":"2023-12-07T21:11:10.607680+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:11:10.607680+0000","last_undegraded":"2023-12-07T21:11:10.607680+0000","last_fullsized":"2023-12-07T21:11:10.607680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.797174+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:12.797174+0000","last_peered":"2023-12-07T21:11:12.797174+0000","last_clean":"2023-12-07T21:11:12.797174+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:12.797174+0000","last_undegraded":"2023-12-07T21:11:12.797174+0000","last_fullsized":"2023-12-07T21:11:12.797174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'31","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608625+0000","last_change":"2023-12-07T21:09:00.895835+0000","last_active":"2023-12-07T21:11:10.608625+0000","last_peered":"2023-12-07T21:11:10.608625+0000","last_clean":"2023-12-07T21:11:10.608625+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:11:10.608625+0000","last_undegraded":"2023-12-07T21:11:10.608625+0000","last_fullsized":"2023-12-07T21:11:10.608625+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767372+0000","last_change":"2023-12-07T21:09:02.907297+0000","last_active":"2023-12-07T21:11:09.767372+0000","last_peered":"2023-12-07T21:11:09.767372+0000","last_clean":"2023-12-07T21:11:09.767372+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:11:09.767372+0000","last_undegraded":"2023-12-07T21:11:09.767372+0000","last_fullsized":"2023-12-07T21:11:09.767372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767538+0000","last_change":"2023-12-07T21:09:04.931948+0000","last_active":"2023-12-07T21:11:09.767538+0000","last_peered":"2023-12-07T21:11:09.767538+0000","last_clean":"2023-12-07T21:11:09.767538+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:11:09.767538+0000","last_undegraded":"2023-12-07T21:11:09.767538+0000","last_fullsized":"2023-12-07T21:11:09.767538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608060+0000","last_change":"2023-12-07T21:08:56.874761+0000","last_active":"2023-12-07T21:11:10.608060+0000","last_peered":"2023-12-07T21:11:10.608060+0000","last_clean":"2023-12-07T21:11:10.608060+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:11:10.608060+0000","last_undegraded":"2023-12-07T21:11:10.608060+0000","last_fullsized":"2023-12-07T21:11:10.608060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880632+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.830062+0000","last_change":"2023-12-07T21:11:53.830085+0000","last_active":"2023-12-07T21:11:53.830062+0000","last_peered":"2023-12-07T21:11:53.830062+0000","last_clean":"2023-12-07T21:11:53.830062+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:53.830062+0000","last_undegraded":"2023-12-07T21:11:53.830062+0000","last_fullsized":"2023-12-07T21:11:53.830062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_clean_scrub_stamp":"2023-12-07T21:11:53.829969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:45.205269+0000","scrub_duration":0.001216066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.053083+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:11.053083+0000","last_peered":"2023-12-07T21:11:11.053083+0000","last_clean":"2023-12-07T21:11:11.053083+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:11.053083+0000","last_undegraded":"2023-12-07T21:11:11.053083+0000","last_fullsized":"2023-12-07T21:11:11.053083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.304118+0000","last_change":"2023-12-07T21:11:42.304137+0000","last_active":"2023-12-07T21:11:42.304118+0000","last_peered":"2023-12-07T21:11:42.304118+0000","last_clean":"2023-12-07T21:11:42.304118+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:42.304118+0000","last_undegraded":"2023-12-07T21:11:42.304118+0000","last_fullsized":"2023-12-07T21:11:42.304118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.304031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:14.639583+0000","scrub_duration":0.0010594929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345945+0000","last_change":"2023-12-07T21:09:04.925464+0000","last_active":"2023-12-07T21:11:09.345945+0000","last_peered":"2023-12-07T21:11:09.345945+0000","last_clean":"2023-12-07T21:11:09.345945+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:11:09.345945+0000","last_undegraded":"2023-12-07T21:11:09.345945+0000","last_fullsized":"2023-12-07T21:11:09.345945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'1","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608112+0000","last_change":"2023-12-07T21:08:56.875484+0000","last_active":"2023-12-07T21:11:10.608112+0000","last_peered":"2023-12-07T21:11:10.608112+0000","last_clean":"2023-12-07T21:11:10.608112+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:11:10.608112+0000","last_undegraded":"2023-12-07T21:11:10.608112+0000","last_fullsized":"2023-12-07T21:11:10.608112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607656+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:11:10.607656+0000","last_peered":"2023-12-07T21:11:10.607656+0000","last_clean":"2023-12-07T21:11:10.607656+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:11:10.607656+0000","last_undegraded":"2023-12-07T21:11:10.607656+0000","last_fullsized":"2023-12-07T21:11:10.607656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.707066+0000","last_change":"2023-12-07T21:11:58.707102+0000","last_active":"2023-12-07T21:11:58.707066+0000","last_peered":"2023-12-07T21:11:58.707066+0000","last_clean":"2023-12-07T21:11:58.707066+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:58.707066+0000","last_undegraded":"2023-12-07T21:11:58.707066+0000","last_fullsized":"2023-12-07T21:11:58.707066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.706965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:56:05.594599+0000","scrub_duration":0.0011023249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.554028+0000","last_change":"2023-12-07T21:11:35.554062+0000","last_active":"2023-12-07T21:11:35.554028+0000","last_peered":"2023-12-07T21:11:35.554028+0000","last_clean":"2023-12-07T21:11:35.554028+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:35.554028+0000","last_undegraded":"2023-12-07T21:11:35.554028+0000","last_fullsized":"2023-12-07T21:11:35.554028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.553946+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:56.699897+0000","scrub_duration":0.0042775269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'246","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608744+0000","last_change":"2023-12-07T21:09:02.906250+0000","last_active":"2023-12-07T21:11:10.608744+0000","last_peered":"2023-12-07T21:11:10.608744+0000","last_clean":"2023-12-07T21:11:10.608744+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:11:10.608744+0000","last_undegraded":"2023-12-07T21:11:10.608744+0000","last_fullsized":"2023-12-07T21:11:10.608744+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188448+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:11:10.188448+0000","last_peered":"2023-12-07T21:11:10.188448+0000","last_clean":"2023-12-07T21:11:10.188448+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:11:10.188448+0000","last_undegraded":"2023-12-07T21:11:10.188448+0000","last_fullsized":"2023-12-07T21:11:10.188448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345217+0000","last_change":"2023-12-07T21:08:56.885545+0000","last_active":"2023-12-07T21:11:09.345217+0000","last_peered":"2023-12-07T21:11:09.345217+0000","last_clean":"2023-12-07T21:11:09.345217+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:11:09.345217+0000","last_undegraded":"2023-12-07T21:11:09.345217+0000","last_fullsized":"2023-12-07T21:11:09.345217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766427+0000","last_change":"2023-12-07T21:08:54.878527+0000","last_active":"2023-12-07T21:11:09.766427+0000","last_peered":"2023-12-07T21:11:09.766427+0000","last_clean":"2023-12-07T21:11:09.766427+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:11:09.766427+0000","last_undegraded":"2023-12-07T21:11:09.766427+0000","last_fullsized":"2023-12-07T21:11:09.766427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.775119+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:14.775119+0000","last_peered":"2023-12-07T21:11:14.775119+0000","last_clean":"2023-12-07T21:11:14.775119+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:14.775119+0000","last_undegraded":"2023-12-07T21:11:14.775119+0000","last_fullsized":"2023-12-07T21:11:14.775119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:29.600052+0000","last_change":"2023-12-07T21:11:29.600086+0000","last_active":"2023-12-07T21:11:29.600052+0000","last_peered":"2023-12-07T21:11:29.600052+0000","last_clean":"2023-12-07T21:11:29.600052+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:29.600052+0000","last_undegraded":"2023-12-07T21:11:29.600052+0000","last_fullsized":"2023-12-07T21:11:29.600052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_clean_scrub_stamp":"2023-12-07T21:11:29.599963+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:30:03.772118+0000","scrub_duration":0.003554771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'247","reported_seq":340,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:02.790438+0000","last_change":"2023-12-07T21:12:02.790465+0000","last_active":"2023-12-07T21:12:02.790438+0000","last_peered":"2023-12-07T21:12:02.790438+0000","last_clean":"2023-12-07T21:12:02.790438+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:12:02.790438+0000","last_undegraded":"2023-12-07T21:12:02.790438+0000","last_fullsized":"2023-12-07T21:12:02.790438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_clean_scrub_stamp":"2023-12-07T21:12:02.790346+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:07.839178+0000","scrub_duration":0.0026089529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809281+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:11:08.809281+0000","last_peered":"2023-12-07T21:11:08.809281+0000","last_clean":"2023-12-07T21:11:08.809281+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:11:08.809281+0000","last_undegraded":"2023-12-07T21:11:08.809281+0000","last_fullsized":"2023-12-07T21:11:08.809281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880253+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.443130+0000","last_change":"2023-12-07T21:11:56.443153+0000","last_active":"2023-12-07T21:11:56.443130+0000","last_peered":"2023-12-07T21:11:56.443130+0000","last_clean":"2023-12-07T21:11:56.443130+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:56.443130+0000","last_undegraded":"2023-12-07T21:11:56.443130+0000","last_fullsized":"2023-12-07T21:11:56.443130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.443045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:05.069384+0000","scrub_duration":0.0010685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.606772+0000","last_change":"2023-12-07T21:11:39.606842+0000","last_active":"2023-12-07T21:11:39.606772+0000","last_peered":"2023-12-07T21:11:39.606772+0000","last_clean":"2023-12-07T21:11:39.606772+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:39.606772+0000","last_undegraded":"2023-12-07T21:11:39.606772+0000","last_fullsized":"2023-12-07T21:11:39.606772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.606684+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:36.950556+0000","scrub_duration":0.0069737849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:34.781691+0000","last_change":"2023-12-07T21:11:34.781711+0000","last_active":"2023-12-07T21:11:34.781691+0000","last_peered":"2023-12-07T21:11:34.781691+0000","last_clean":"2023-12-07T21:11:34.781691+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:34.781691+0000","last_undegraded":"2023-12-07T21:11:34.781691+0000","last_fullsized":"2023-12-07T21:11:34.781691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:34.781604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:44.478780+0000","scrub_duration":0.001255822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188362+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:11:10.188362+0000","last_peered":"2023-12-07T21:11:10.188362+0000","last_clean":"2023-12-07T21:11:10.188362+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:11:10.188362+0000","last_undegraded":"2023-12-07T21:11:10.188362+0000","last_fullsized":"2023-12-07T21:11:10.188362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'21","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808397+0000","last_change":"2023-12-07T21:08:56.871222+0000","last_active":"2023-12-07T21:11:08.808397+0000","last_peered":"2023-12-07T21:11:08.808397+0000","last_clean":"2023-12-07T21:11:08.808397+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:11:08.808397+0000","last_undegraded":"2023-12-07T21:11:08.808397+0000","last_fullsized":"2023-12-07T21:11:08.808397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187590+0000","last_change":"2023-12-07T21:08:54.885249+0000","last_active":"2023-12-07T21:11:10.187590+0000","last_peered":"2023-12-07T21:11:10.187590+0000","last_clean":"2023-12-07T21:11:10.187590+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:11:10.187590+0000","last_undegraded":"2023-12-07T21:11:10.187590+0000","last_fullsized":"2023-12-07T21:11:10.187590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:07.717434+0000","last_change":"2023-12-07T21:12:07.717459+0000","last_active":"2023-12-07T21:12:07.717434+0000","last_peered":"2023-12-07T21:12:07.717434+0000","last_clean":"2023-12-07T21:12:07.717434+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:12:07.717434+0000","last_undegraded":"2023-12-07T21:12:07.717434+0000","last_fullsized":"2023-12-07T21:12:07.717434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_clean_scrub_stamp":"2023-12-07T21:12:07.717342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:32.009926+0000","scrub_duration":0.0014039289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'33","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608550+0000","last_change":"2023-12-07T21:09:00.895444+0000","last_active":"2023-12-07T21:11:10.608550+0000","last_peered":"2023-12-07T21:11:10.608550+0000","last_clean":"2023-12-07T21:11:10.608550+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:11:10.608550+0000","last_undegraded":"2023-12-07T21:11:10.608550+0000","last_fullsized":"2023-12-07T21:11:10.608550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.735445+0000","last_change":"2023-12-07T21:11:33.735466+0000","last_active":"2023-12-07T21:11:33.735445+0000","last_peered":"2023-12-07T21:11:33.735445+0000","last_clean":"2023-12-07T21:11:33.735445+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:33.735445+0000","last_undegraded":"2023-12-07T21:11:33.735445+0000","last_fullsized":"2023-12-07T21:11:33.735445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.735352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:03.972116+0000","scrub_duration":0.0011441929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767437+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:11:09.767437+0000","last_peered":"2023-12-07T21:11:09.767437+0000","last_clean":"2023-12-07T21:11:09.767437+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:11:09.767437+0000","last_undegraded":"2023-12-07T21:11:09.767437+0000","last_fullsized":"2023-12-07T21:11:09.767437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808402+0000","last_change":"2023-12-07T21:08:56.879742+0000","last_active":"2023-12-07T21:11:08.808402+0000","last_peered":"2023-12-07T21:11:08.808402+0000","last_clean":"2023-12-07T21:11:08.808402+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:11:08.808402+0000","last_undegraded":"2023-12-07T21:11:08.808402+0000","last_fullsized":"2023-12-07T21:11:08.808402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607665+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:11:10.607665+0000","last_peered":"2023-12-07T21:11:10.607665+0000","last_clean":"2023-12-07T21:11:10.607665+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:11:10.607665+0000","last_undegraded":"2023-12-07T21:11:10.607665+0000","last_fullsized":"2023-12-07T21:11:10.607665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345505+0000","last_change":"2023-12-07T21:08:58.874569+0000","last_active":"2023-12-07T21:11:09.345505+0000","last_peered":"2023-12-07T21:11:09.345505+0000","last_clean":"2023-12-07T21:11:09.345505+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:11:09.345505+0000","last_undegraded":"2023-12-07T21:11:09.345505+0000","last_fullsized":"2023-12-07T21:11:09.345505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.522055+0000","last_change":"2023-12-07T21:11:50.522112+0000","last_active":"2023-12-07T21:11:50.522055+0000","last_peered":"2023-12-07T21:11:50.522055+0000","last_clean":"2023-12-07T21:11:50.522055+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:50.522055+0000","last_undegraded":"2023-12-07T21:11:50.522055+0000","last_fullsized":"2023-12-07T21:11:50.522055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.521955+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:04.827943+0000","scrub_duration":0.0073561030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":307,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.761860+0000","last_change":"2023-12-07T21:11:35.761887+0000","last_active":"2023-12-07T21:11:35.761860+0000","last_peered":"2023-12-07T21:11:35.761860+0000","last_clean":"2023-12-07T21:11:35.761860+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:35.761860+0000","last_undegraded":"2023-12-07T21:11:35.761860+0000","last_fullsized":"2023-12-07T21:11:35.761860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.761766+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:14.383149+0000","scrub_duration":0.0016151640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345866+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:11:09.345866+0000","last_peered":"2023-12-07T21:11:09.345866+0000","last_clean":"2023-12-07T21:11:09.345866+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:11:09.345866+0000","last_undegraded":"2023-12-07T21:11:09.345866+0000","last_fullsized":"2023-12-07T21:11:09.345866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187733+0000","last_change":"2023-12-07T21:08:56.870949+0000","last_active":"2023-12-07T21:11:10.187733+0000","last_peered":"2023-12-07T21:11:10.187733+0000","last_clean":"2023-12-07T21:11:10.187733+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:11:10.187733+0000","last_undegraded":"2023-12-07T21:11:10.187733+0000","last_fullsized":"2023-12-07T21:11:10.187733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607649+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:11:10.607649+0000","last_peered":"2023-12-07T21:11:10.607649+0000","last_clean":"2023-12-07T21:11:10.607649+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:11:10.607649+0000","last_undegraded":"2023-12-07T21:11:10.607649+0000","last_fullsized":"2023-12-07T21:11:10.607649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.753680+0000","last_change":"2023-12-07T21:11:55.753724+0000","last_active":"2023-12-07T21:11:55.753680+0000","last_peered":"2023-12-07T21:11:55.753680+0000","last_clean":"2023-12-07T21:11:55.753680+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:55.753680+0000","last_undegraded":"2023-12-07T21:11:55.753680+0000","last_fullsized":"2023-12-07T21:11:55.753680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.753576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:53:37.572475+0000","scrub_duration":0.0013913199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:31.726530+0000","last_change":"2023-12-07T21:11:31.726564+0000","last_active":"2023-12-07T21:11:31.726530+0000","last_peered":"2023-12-07T21:11:31.726530+0000","last_clean":"2023-12-07T21:11:31.726530+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:31.726530+0000","last_undegraded":"2023-12-07T21:11:31.726530+0000","last_fullsized":"2023-12-07T21:11:31.726530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:31.726451+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:36.775283+0000","scrub_duration":0.0038601009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.752542+0000","last_change":"2023-12-07T21:11:56.752564+0000","last_active":"2023-12-07T21:11:56.752542+0000","last_peered":"2023-12-07T21:11:56.752542+0000","last_clean":"2023-12-07T21:11:56.752542+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:56.752542+0000","last_undegraded":"2023-12-07T21:11:56.752542+0000","last_fullsized":"2023-12-07T21:11:56.752542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.752450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:44.261937+0000","scrub_duration":0.0012919610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345867+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:11:09.345867+0000","last_peered":"2023-12-07T21:11:09.345867+0000","last_clean":"2023-12-07T21:11:09.345867+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:11:09.345867+0000","last_undegraded":"2023-12-07T21:11:09.345867+0000","last_fullsized":"2023-12-07T21:11:09.345867+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187760+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:11:10.187760+0000","last_peered":"2023-12-07T21:11:10.187760+0000","last_clean":"2023-12-07T21:11:10.187760+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:11:10.187760+0000","last_undegraded":"2023-12-07T21:11:10.187760+0000","last_fullsized":"2023-12-07T21:11:10.187760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345205+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:11:09.345205+0000","last_peered":"2023-12-07T21:11:09.345205+0000","last_clean":"2023-12-07T21:11:09.345205+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:11:09.345205+0000","last_undegraded":"2023-12-07T21:11:09.345205+0000","last_fullsized":"2023-12-07T21:11:09.345205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187996+0000","last_change":"2023-12-07T21:08:58.878003+0000","last_active":"2023-12-07T21:11:10.187996+0000","last_peered":"2023-12-07T21:11:10.187996+0000","last_clean":"2023-12-07T21:11:10.187996+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:11:10.187996+0000","last_undegraded":"2023-12-07T21:11:10.187996+0000","last_fullsized":"2023-12-07T21:11:10.187996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.222534+0000","last_change":"2023-12-07T21:11:32.222572+0000","last_active":"2023-12-07T21:11:32.222534+0000","last_peered":"2023-12-07T21:11:32.222534+0000","last_clean":"2023-12-07T21:11:32.222534+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:32.222534+0000","last_undegraded":"2023-12-07T21:11:32.222534+0000","last_fullsized":"2023-12-07T21:11:32.222534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.222451+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:29.566323+0000","scrub_duration":0.0042948600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608766+0000","last_change":"2023-12-07T21:09:02.906350+0000","last_active":"2023-12-07T21:11:10.608766+0000","last_peered":"2023-12-07T21:11:10.608766+0000","last_clean":"2023-12-07T21:11:10.608766+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:11:10.608766+0000","last_undegraded":"2023-12-07T21:11:10.608766+0000","last_fullsized":"2023-12-07T21:11:10.608766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809146+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:11:08.809146+0000","last_peered":"2023-12-07T21:11:08.809146+0000","last_clean":"2023-12-07T21:11:08.809146+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:11:08.809146+0000","last_undegraded":"2023-12-07T21:11:08.809146+0000","last_fullsized":"2023-12-07T21:11:08.809146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187764+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:11:10.187764+0000","last_peered":"2023-12-07T21:11:10.187764+0000","last_clean":"2023-12-07T21:11:10.187764+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:11:10.187764+0000","last_undegraded":"2023-12-07T21:11:10.187764+0000","last_fullsized":"2023-12-07T21:11:10.187764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809479+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:11:08.809479+0000","last_peered":"2023-12-07T21:11:08.809479+0000","last_clean":"2023-12-07T21:11:08.809479+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:11:08.809479+0000","last_undegraded":"2023-12-07T21:11:08.809479+0000","last_fullsized":"2023-12-07T21:11:08.809479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:54.784543+0000","last_change":"2023-12-07T21:11:54.784564+0000","last_active":"2023-12-07T21:11:54.784543+0000","last_peered":"2023-12-07T21:11:54.784543+0000","last_clean":"2023-12-07T21:11:54.784543+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:54.784543+0000","last_undegraded":"2023-12-07T21:11:54.784543+0000","last_fullsized":"2023-12-07T21:11:54.784543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_clean_scrub_stamp":"2023-12-07T21:11:54.784441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:06.366596+0000","scrub_duration":0.001044002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.576728+0000","last_change":"2023-12-07T21:11:38.576788+0000","last_active":"2023-12-07T21:11:38.576728+0000","last_peered":"2023-12-07T21:11:38.576728+0000","last_clean":"2023-12-07T21:11:38.576728+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:38.576728+0000","last_undegraded":"2023-12-07T21:11:38.576728+0000","last_fullsized":"2023-12-07T21:11:38.576728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.576637+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:37:48.632379+0000","scrub_duration":0.0068514220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":336,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625017+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625017+0000","last_peered":"2023-12-07T21:11:28.625017+0000","last_clean":"2023-12-07T21:11:28.625017+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625017+0000","last_undegraded":"2023-12-07T21:11:28.625017+0000","last_fullsized":"2023-12-07T21:11:28.625017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345846+0000","last_change":"2023-12-07T21:09:04.919388+0000","last_active":"2023-12-07T21:11:09.345846+0000","last_peered":"2023-12-07T21:11:09.345846+0000","last_clean":"2023-12-07T21:11:09.345846+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:11:09.345846+0000","last_undegraded":"2023-12-07T21:11:09.345846+0000","last_fullsized":"2023-12-07T21:11:09.345846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187852+0000","last_change":"2023-12-07T21:08:56.880261+0000","last_active":"2023-12-07T21:11:10.187852+0000","last_peered":"2023-12-07T21:11:10.187852+0000","last_clean":"2023-12-07T21:11:10.187852+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:11:10.187852+0000","last_undegraded":"2023-12-07T21:11:10.187852+0000","last_fullsized":"2023-12-07T21:11:10.187852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809380+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:11:08.809380+0000","last_peered":"2023-12-07T21:11:08.809380+0000","last_clean":"2023-12-07T21:11:08.809380+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:11:08.809380+0000","last_undegraded":"2023-12-07T21:11:08.809380+0000","last_fullsized":"2023-12-07T21:11:08.809380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.296670+0000","last_change":"2023-12-07T21:11:38.296697+0000","last_active":"2023-12-07T21:11:38.296670+0000","last_peered":"2023-12-07T21:11:38.296670+0000","last_clean":"2023-12-07T21:11:38.296670+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:38.296670+0000","last_undegraded":"2023-12-07T21:11:38.296670+0000","last_fullsized":"2023-12-07T21:11:38.296670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.296568+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:08.533333+0000","scrub_duration":0.0033144630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608582+0000","last_change":"2023-12-07T21:09:00.895566+0000","last_active":"2023-12-07T21:11:10.608582+0000","last_peered":"2023-12-07T21:11:10.608582+0000","last_clean":"2023-12-07T21:11:10.608582+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:11:10.608582+0000","last_undegraded":"2023-12-07T21:11:10.608582+0000","last_fullsized":"2023-12-07T21:11:10.608582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'247","reported_seq":372,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:47.359710+0000","last_change":"2023-12-07T21:11:47.359735+0000","last_active":"2023-12-07T21:11:47.359710+0000","last_peered":"2023-12-07T21:11:47.359710+0000","last_clean":"2023-12-07T21:11:47.359710+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:47.359710+0000","last_undegraded":"2023-12-07T21:11:47.359710+0000","last_fullsized":"2023-12-07T21:11:47.359710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_clean_scrub_stamp":"2023-12-07T21:11:47.359610+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:10.050726+0000","scrub_duration":0.0028663759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188292+0000","last_change":"2023-12-07T21:09:04.923396+0000","last_active":"2023-12-07T21:11:10.188292+0000","last_peered":"2023-12-07T21:11:10.188292+0000","last_clean":"2023-12-07T21:11:10.188292+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:11:10.188292+0000","last_undegraded":"2023-12-07T21:11:10.188292+0000","last_fullsized":"2023-12-07T21:11:10.188292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766719+0000","last_change":"2023-12-07T21:08:56.889238+0000","last_active":"2023-12-07T21:11:09.766719+0000","last_peered":"2023-12-07T21:11:09.766719+0000","last_clean":"2023-12-07T21:11:09.766719+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:11:09.766719+0000","last_undegraded":"2023-12-07T21:11:09.766719+0000","last_fullsized":"2023-12-07T21:11:09.766719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809240+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:11:08.809240+0000","last_peered":"2023-12-07T21:11:08.809240+0000","last_clean":"2023-12-07T21:11:08.809240+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:11:08.809240+0000","last_undegraded":"2023-12-07T21:11:08.809240+0000","last_fullsized":"2023-12-07T21:11:08.809240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.847894+0000","last_change":"2023-12-07T21:11:28.847914+0000","last_active":"2023-12-07T21:11:28.847894+0000","last_peered":"2023-12-07T21:11:28.847894+0000","last_clean":"2023-12-07T21:11:28.847894+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:28.847894+0000","last_undegraded":"2023-12-07T21:11:28.847894+0000","last_fullsized":"2023-12-07T21:11:28.847894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.847797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:20:42.481026+0000","scrub_duration":0.001132973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262716+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262716+0000","last_peered":"2023-12-07T21:11:27.262716+0000","last_clean":"2023-12-07T21:11:27.262716+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262716+0000","last_undegraded":"2023-12-07T21:11:27.262716+0000","last_fullsized":"2023-12-07T21:11:27.262716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.426987+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:14.426987+0000","last_peered":"2023-12-07T21:11:14.426987+0000","last_clean":"2023-12-07T21:11:14.426987+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:14.426987+0000","last_undegraded":"2023-12-07T21:11:14.426987+0000","last_fullsized":"2023-12-07T21:11:14.426987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767450+0000","last_change":"2023-12-07T21:09:04.920277+0000","last_active":"2023-12-07T21:11:09.767450+0000","last_peered":"2023-12-07T21:11:09.767450+0000","last_clean":"2023-12-07T21:11:09.767450+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:11:09.767450+0000","last_undegraded":"2023-12-07T21:11:09.767450+0000","last_fullsized":"2023-12-07T21:11:09.767450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:08.448202+0000","last_change":"2023-12-07T21:12:08.448223+0000","last_active":"2023-12-07T21:12:08.448202+0000","last_peered":"2023-12-07T21:12:08.448202+0000","last_clean":"2023-12-07T21:12:08.448202+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:12:08.448202+0000","last_undegraded":"2023-12-07T21:12:08.448202+0000","last_fullsized":"2023-12-07T21:12:08.448202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_clean_scrub_stamp":"2023-12-07T21:12:08.448115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:53:48.563995+0000","scrub_duration":0.001037821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:43.801827+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:10:43.801827+0000","last_peered":"2023-12-07T21:10:43.801827+0000","last_clean":"2023-12-07T21:10:43.801827+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:10:43.801827+0000","last_undegraded":"2023-12-07T21:10:43.801827+0000","last_fullsized":"2023-12-07T21:10:43.801827+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806332+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:10:53.806332+0000","last_peered":"2023-12-07T21:10:53.806332+0000","last_clean":"2023-12-07T21:10:53.806332+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:10:53.806332+0000","last_undegraded":"2023-12-07T21:10:53.806332+0000","last_fullsized":"2023-12-07T21:10:53.806332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808304+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:11:03.808304+0000","last_peered":"2023-12-07T21:11:03.808304+0000","last_clean":"2023-12-07T21:11:03.808304+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:11:03.808304+0000","last_undegraded":"2023-12-07T21:11:03.808304+0000","last_fullsized":"2023-12-07T21:11:03.808304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.324719+0000","last_change":"2023-12-07T21:11:45.324752+0000","last_active":"2023-12-07T21:11:45.324719+0000","last_peered":"2023-12-07T21:11:45.324719+0000","last_clean":"2023-12-07T21:11:45.324719+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:11:45.324719+0000","last_undegraded":"2023-12-07T21:11:45.324719+0000","last_fullsized":"2023-12-07T21:11:45.324719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.324596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:15.702930+0000","scrub_duration":0.001375037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'79","reported_seq":154,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608522+0000","last_change":"2023-12-07T21:09:00.891338+0000","last_active":"2023-12-07T21:11:10.608522+0000","last_peered":"2023-12-07T21:11:10.608522+0000","last_clean":"2023-12-07T21:11:10.608522+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:11:10.608522+0000","last_undegraded":"2023-12-07T21:11:10.608522+0000","last_fullsized":"2023-12-07T21:11:10.608522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.743690+0000","last_change":"2023-12-07T21:11:42.743712+0000","last_active":"2023-12-07T21:11:42.743690+0000","last_peered":"2023-12-07T21:11:42.743690+0000","last_clean":"2023-12-07T21:11:42.743690+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:42.743690+0000","last_undegraded":"2023-12-07T21:11:42.743690+0000","last_fullsized":"2023-12-07T21:11:42.743690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.743604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:58.016229+0000","scrub_duration":0.001386167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":148,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.433658+0000","last_change":"2023-12-07T21:11:58.433682+0000","last_active":"2023-12-07T21:11:58.433658+0000","last_peered":"2023-12-07T21:11:58.433658+0000","last_clean":"2023-12-07T21:11:58.433658+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:58.433658+0000","last_undegraded":"2023-12-07T21:11:58.433658+0000","last_fullsized":"2023-12-07T21:11:58.433658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.433567+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:08.130743+0000","scrub_duration":0.0014101739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809766+0000","last_change":"2023-12-07T21:08:56.872420+0000","last_active":"2023-12-07T21:11:08.809766+0000","last_peered":"2023-12-07T21:11:08.809766+0000","last_clean":"2023-12-07T21:11:08.809766+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:11:08.809766+0000","last_undegraded":"2023-12-07T21:11:08.809766+0000","last_fullsized":"2023-12-07T21:11:08.809766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:48.804993+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:10:48.804993+0000","last_peered":"2023-12-07T21:10:48.804993+0000","last_clean":"2023-12-07T21:10:48.804993+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:10:48.804993+0000","last_undegraded":"2023-12-07T21:10:48.804993+0000","last_fullsized":"2023-12-07T21:10:48.804993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800912+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:11:03.800912+0000","last_peered":"2023-12-07T21:11:03.800912+0000","last_clean":"2023-12-07T21:11:03.800912+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:11:03.800912+0000","last_undegraded":"2023-12-07T21:11:03.800912+0000","last_fullsized":"2023-12-07T21:11:03.800912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.687459+0000","last_change":"2023-12-07T21:11:32.687480+0000","last_active":"2023-12-07T21:11:32.687459+0000","last_peered":"2023-12-07T21:11:32.687459+0000","last_clean":"2023-12-07T21:11:32.687459+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:32.687459+0000","last_undegraded":"2023-12-07T21:11:32.687459+0000","last_fullsized":"2023-12-07T21:11:32.687459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.687375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:18:45.906213+0000","scrub_duration":0.001283024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":450,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148355+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148355+0000","last_peered":"2023-12-07T21:11:18.148355+0000","last_clean":"2023-12-07T21:11:18.148355+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148355+0000","last_undegraded":"2023-12-07T21:11:18.148355+0000","last_fullsized":"2023-12-07T21:11:18.148355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809611+0000","last_change":"2023-12-07T21:09:02.905387+0000","last_active":"2023-12-07T21:11:08.809611+0000","last_peered":"2023-12-07T21:11:08.809611+0000","last_clean":"2023-12-07T21:11:08.809611+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:11:08.809611+0000","last_undegraded":"2023-12-07T21:11:08.809611+0000","last_fullsized":"2023-12-07T21:11:08.809611+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767469+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:11:09.767469+0000","last_peered":"2023-12-07T21:11:09.767469+0000","last_clean":"2023-12-07T21:11:09.767469+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:11:09.767469+0000","last_undegraded":"2023-12-07T21:11:09.767469+0000","last_fullsized":"2023-12-07T21:11:09.767469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802682+0000","last_change":"2023-12-07T21:08:56.883281+0000","last_active":"2023-12-07T21:11:08.802682+0000","last_peered":"2023-12-07T21:11:08.802682+0000","last_clean":"2023-12-07T21:11:08.802682+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:11:08.802682+0000","last_undegraded":"2023-12-07T21:11:08.802682+0000","last_fullsized":"2023-12-07T21:11:08.802682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.804204+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:10:53.804204+0000","last_peered":"2023-12-07T21:10:53.804204+0000","last_clean":"2023-12-07T21:10:53.804204+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:10:53.804204+0000","last_undegraded":"2023-12-07T21:10:53.804204+0000","last_fullsized":"2023-12-07T21:10:53.804204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.799875+0000","last_change":"2023-12-07T21:08:54.881937+0000","last_active":"2023-12-07T21:10:58.799875+0000","last_peered":"2023-12-07T21:10:58.799875+0000","last_clean":"2023-12-07T21:10:58.799875+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:10:58.799875+0000","last_undegraded":"2023-12-07T21:10:58.799875+0000","last_fullsized":"2023-12-07T21:10:58.799875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'1","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808733+0000","last_change":"2023-12-07T21:08:58.875724+0000","last_active":"2023-12-07T21:11:08.808733+0000","last_peered":"2023-12-07T21:11:08.808733+0000","last_clean":"2023-12-07T21:11:08.808733+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:11:08.808733+0000","last_undegraded":"2023-12-07T21:11:08.808733+0000","last_fullsized":"2023-12-07T21:11:08.808733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'25","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:46.537878+0000","last_change":"2023-12-07T21:11:46.537922+0000","last_active":"2023-12-07T21:11:46.537878+0000","last_peered":"2023-12-07T21:11:46.537878+0000","last_clean":"2023-12-07T21:11:46.537878+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:46.537878+0000","last_undegraded":"2023-12-07T21:11:46.537878+0000","last_fullsized":"2023-12-07T21:11:46.537878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_clean_scrub_stamp":"2023-12-07T21:11:46.537795+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:57.338431+0000","scrub_duration":0.0057357379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642676+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642676+0000","last_peered":"2023-12-07T21:11:12.642676+0000","last_clean":"2023-12-07T21:11:12.642676+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642676+0000","last_undegraded":"2023-12-07T21:11:12.642676+0000","last_fullsized":"2023-12-07T21:11:12.642676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608815+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:11:10.608815+0000","last_peered":"2023-12-07T21:11:10.608815+0000","last_clean":"2023-12-07T21:11:10.608815+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:11:10.608815+0000","last_undegraded":"2023-12-07T21:11:10.608815+0000","last_fullsized":"2023-12-07T21:11:10.608815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801285+0000","last_change":"2023-12-07T21:08:56.872455+0000","last_active":"2023-12-07T21:11:03.801285+0000","last_peered":"2023-12-07T21:11:03.801285+0000","last_clean":"2023-12-07T21:11:03.801285+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:11:03.801285+0000","last_undegraded":"2023-12-07T21:11:03.801285+0000","last_fullsized":"2023-12-07T21:11:03.801285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806222+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:10:53.806222+0000","last_peered":"2023-12-07T21:10:53.806222+0000","last_clean":"2023-12-07T21:10:53.806222+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:10:53.806222+0000","last_undegraded":"2023-12-07T21:10:53.806222+0000","last_fullsized":"2023-12-07T21:10:53.806222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806975+0000","last_change":"2023-12-07T21:08:54.880674+0000","last_active":"2023-12-07T21:11:03.806975+0000","last_peered":"2023-12-07T21:11:03.806975+0000","last_clean":"2023-12-07T21:11:03.806975+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:11:03.806975+0000","last_undegraded":"2023-12-07T21:11:03.806975+0000","last_fullsized":"2023-12-07T21:11:03.806975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:57.727189+0000","last_change":"2023-12-07T21:11:57.727223+0000","last_active":"2023-12-07T21:11:57.727189+0000","last_peered":"2023-12-07T21:11:57.727189+0000","last_clean":"2023-12-07T21:11:57.727189+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:11:57.727189+0000","last_undegraded":"2023-12-07T21:11:57.727189+0000","last_fullsized":"2023-12-07T21:11:57.727189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_clean_scrub_stamp":"2023-12-07T21:11:57.727085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:53.015740+0000","scrub_duration":0.0013430639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608529+0000","last_change":"2023-12-07T21:09:00.892022+0000","last_active":"2023-12-07T21:11:10.608529+0000","last_peered":"2023-12-07T21:11:10.608529+0000","last_clean":"2023-12-07T21:11:10.608529+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:11:10.608529+0000","last_undegraded":"2023-12-07T21:11:10.608529+0000","last_fullsized":"2023-12-07T21:11:10.608529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608704+0000","last_change":"2023-12-07T21:09:02.907037+0000","last_active":"2023-12-07T21:11:10.608704+0000","last_peered":"2023-12-07T21:11:10.608704+0000","last_clean":"2023-12-07T21:11:10.608704+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:11:10.608704+0000","last_undegraded":"2023-12-07T21:11:10.608704+0000","last_fullsized":"2023-12-07T21:11:10.608704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767468+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:11:09.767468+0000","last_peered":"2023-12-07T21:11:09.767468+0000","last_clean":"2023-12-07T21:11:09.767468+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:11:09.767468+0000","last_undegraded":"2023-12-07T21:11:09.767468+0000","last_fullsized":"2023-12-07T21:11:09.767468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806997+0000","last_change":"2023-12-07T21:08:56.882954+0000","last_active":"2023-12-07T21:11:03.806997+0000","last_peered":"2023-12-07T21:11:03.806997+0000","last_clean":"2023-12-07T21:11:03.806997+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:11:03.806997+0000","last_undegraded":"2023-12-07T21:11:03.806997+0000","last_fullsized":"2023-12-07T21:11:03.806997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807157+0000","last_change":"2023-12-07T21:08:54.881143+0000","last_active":"2023-12-07T21:11:03.807157+0000","last_peered":"2023-12-07T21:11:03.807157+0000","last_clean":"2023-12-07T21:11:03.807157+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:11:03.807157+0000","last_undegraded":"2023-12-07T21:11:03.807157+0000","last_fullsized":"2023-12-07T21:11:03.807157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.799061+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:10:53.799061+0000","last_peered":"2023-12-07T21:10:53.799061+0000","last_clean":"2023-12-07T21:10:53.799061+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:10:53.799061+0000","last_undegraded":"2023-12-07T21:10:53.799061+0000","last_fullsized":"2023-12-07T21:10:53.799061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801170+0000","last_change":"2023-12-07T21:08:58.881942+0000","last_active":"2023-12-07T21:11:03.801170+0000","last_peered":"2023-12-07T21:11:03.801170+0000","last_clean":"2023-12-07T21:11:03.801170+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:11:03.801170+0000","last_undegraded":"2023-12-07T21:11:03.801170+0000","last_fullsized":"2023-12-07T21:11:03.801170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'72","reported_seq":141,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.762966+0000","last_change":"2023-12-07T21:11:45.763012+0000","last_active":"2023-12-07T21:11:45.762966+0000","last_peered":"2023-12-07T21:11:45.762966+0000","last_clean":"2023-12-07T21:11:45.762966+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:45.762966+0000","last_undegraded":"2023-12-07T21:11:45.762966+0000","last_fullsized":"2023-12-07T21:11:45.762966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.762875+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:27:47.809323+0000","scrub_duration":0.006706058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594393+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594393+0000","last_peered":"2023-12-07T21:11:25.594393+0000","last_clean":"2023-12-07T21:11:25.594393+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594393+0000","last_undegraded":"2023-12-07T21:11:25.594393+0000","last_fullsized":"2023-12-07T21:11:25.594393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345934+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:11:09.345934+0000","last_peered":"2023-12-07T21:11:09.345934+0000","last_clean":"2023-12-07T21:11:09.345934+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:11:09.345934+0000","last_undegraded":"2023-12-07T21:11:09.345934+0000","last_fullsized":"2023-12-07T21:11:09.345934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807102+0000","last_change":"2023-12-07T21:08:56.878924+0000","last_active":"2023-12-07T21:11:03.807102+0000","last_peered":"2023-12-07T21:11:03.807102+0000","last_clean":"2023-12-07T21:11:03.807102+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:11:03.807102+0000","last_undegraded":"2023-12-07T21:11:03.807102+0000","last_fullsized":"2023-12-07T21:11:03.807102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801254+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:11:03.801254+0000","last_peered":"2023-12-07T21:11:03.801254+0000","last_clean":"2023-12-07T21:11:03.801254+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:11:03.801254+0000","last_undegraded":"2023-12-07T21:11:03.801254+0000","last_fullsized":"2023-12-07T21:11:03.801254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806441+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:10:53.806441+0000","last_peered":"2023-12-07T21:10:53.806441+0000","last_clean":"2023-12-07T21:10:53.806441+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:10:53.806441+0000","last_undegraded":"2023-12-07T21:10:53.806441+0000","last_fullsized":"2023-12-07T21:10:53.806441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.626455+0000","last_change":"2023-12-07T21:11:42.626478+0000","last_active":"2023-12-07T21:11:42.626455+0000","last_peered":"2023-12-07T21:11:42.626455+0000","last_clean":"2023-12-07T21:11:42.626455+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:11:42.626455+0000","last_undegraded":"2023-12-07T21:11:42.626455+0000","last_fullsized":"2023-12-07T21:11:42.626455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.626356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:23.689571+0000","scrub_duration":0.001348258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.225002+0000","last_change":"2023-12-07T21:11:33.225043+0000","last_active":"2023-12-07T21:11:33.225002+0000","last_peered":"2023-12-07T21:11:33.225002+0000","last_clean":"2023-12-07T21:11:33.225002+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:33.225002+0000","last_undegraded":"2023-12-07T21:11:33.225002+0000","last_fullsized":"2023-12-07T21:11:33.225002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.224920+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:12.396025+0000","scrub_duration":0.0049945800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":300,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.065927+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:11:20.065927+0000","last_peered":"2023-12-07T21:11:20.065927+0000","last_clean":"2023-12-07T21:11:20.065927+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:20.065927+0000","last_undegraded":"2023-12-07T21:11:20.065927+0000","last_fullsized":"2023-12-07T21:11:20.065927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608840+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:11:10.608840+0000","last_peered":"2023-12-07T21:11:10.608840+0000","last_clean":"2023-12-07T21:11:10.608840+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:11:10.608840+0000","last_undegraded":"2023-12-07T21:11:10.608840+0000","last_fullsized":"2023-12-07T21:11:10.608840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.807179+0000","last_change":"2023-12-07T21:08:56.887962+0000","last_active":"2023-12-07T21:10:58.807179+0000","last_peered":"2023-12-07T21:10:58.807179+0000","last_clean":"2023-12-07T21:10:58.807179+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:10:58.807179+0000","last_undegraded":"2023-12-07T21:10:58.807179+0000","last_fullsized":"2023-12-07T21:10:58.807179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809841+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:11:08.809841+0000","last_peered":"2023-12-07T21:11:08.809841+0000","last_clean":"2023-12-07T21:11:08.809841+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:11:08.809841+0000","last_undegraded":"2023-12-07T21:11:08.809841+0000","last_fullsized":"2023-12-07T21:11:08.809841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800250+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:10:58.800250+0000","last_peered":"2023-12-07T21:10:58.800250+0000","last_clean":"2023-12-07T21:10:58.800250+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:10:58.800250+0000","last_undegraded":"2023-12-07T21:10:58.800250+0000","last_fullsized":"2023-12-07T21:10:58.800250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.865875+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:11:18.865875+0000","last_peered":"2023-12-07T21:11:18.865875+0000","last_clean":"2023-12-07T21:11:18.865875+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:11:18.865875+0000","last_undegraded":"2023-12-07T21:11:18.865875+0000","last_fullsized":"2023-12-07T21:11:18.865875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809460+0000","last_change":"2023-12-07T21:09:00.896503+0000","last_active":"2023-12-07T21:11:08.809460+0000","last_peered":"2023-12-07T21:11:08.809460+0000","last_clean":"2023-12-07T21:11:08.809460+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:11:08.809460+0000","last_undegraded":"2023-12-07T21:11:08.809460+0000","last_fullsized":"2023-12-07T21:11:08.809460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":368,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712206+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712206+0000","last_peered":"2023-12-07T21:11:18.712206+0000","last_clean":"2023-12-07T21:11:18.712206+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712206+0000","last_undegraded":"2023-12-07T21:11:18.712206+0000","last_fullsized":"2023-12-07T21:11:18.712206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767478+0000","last_change":"2023-12-07T21:09:04.929420+0000","last_active":"2023-12-07T21:11:09.767478+0000","last_peered":"2023-12-07T21:11:09.767478+0000","last_clean":"2023-12-07T21:11:09.767478+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:11:09.767478+0000","last_undegraded":"2023-12-07T21:11:09.767478+0000","last_fullsized":"2023-12-07T21:11:09.767478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806772+0000","last_change":"2023-12-07T21:08:56.874336+0000","last_active":"2023-12-07T21:11:03.806772+0000","last_peered":"2023-12-07T21:11:03.806772+0000","last_clean":"2023-12-07T21:11:03.806772+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:11:03.806772+0000","last_undegraded":"2023-12-07T21:11:03.806772+0000","last_fullsized":"2023-12-07T21:11:03.806772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808876+0000","last_change":"2023-12-07T21:08:54.888557+0000","last_active":"2023-12-07T21:11:08.808876+0000","last_peered":"2023-12-07T21:11:08.808876+0000","last_clean":"2023-12-07T21:11:08.808876+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:11:08.808876+0000","last_undegraded":"2023-12-07T21:11:08.808876+0000","last_fullsized":"2023-12-07T21:11:08.808876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.807661+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:10:58.807661+0000","last_peered":"2023-12-07T21:10:58.807661+0000","last_clean":"2023-12-07T21:10:58.807661+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:10:58.807661+0000","last_undegraded":"2023-12-07T21:10:58.807661+0000","last_fullsized":"2023-12-07T21:10:58.807661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:37.651284+0000","last_change":"2023-12-07T21:11:37.651334+0000","last_active":"2023-12-07T21:11:37.651284+0000","last_peered":"2023-12-07T21:11:37.651284+0000","last_clean":"2023-12-07T21:11:37.651284+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:11:37.651284+0000","last_undegraded":"2023-12-07T21:11:37.651284+0000","last_fullsized":"2023-12-07T21:11:37.651284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_clean_scrub_stamp":"2023-12-07T21:11:37.651191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:09.090050+0000","scrub_duration":0.0012443790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'94","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:05.544462+0000","last_change":"2023-12-07T21:12:05.544503+0000","last_active":"2023-12-07T21:12:05.544462+0000","last_peered":"2023-12-07T21:12:05.544462+0000","last_clean":"2023-12-07T21:12:05.544462+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:12:05.544462+0000","last_undegraded":"2023-12-07T21:12:05.544462+0000","last_fullsized":"2023-12-07T21:12:05.544462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'94","last_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_deep_scrub":"33'94","last_deep_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_clean_scrub_stamp":"2023-12-07T21:12:05.544369+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:32:13.323537+0000","scrub_duration":0.006343095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.831630+0000","last_change":"2023-12-07T21:11:52.831678+0000","last_active":"2023-12-07T21:11:52.831630+0000","last_peered":"2023-12-07T21:11:52.831630+0000","last_clean":"2023-12-07T21:11:52.831630+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:52.831630+0000","last_undegraded":"2023-12-07T21:11:52.831630+0000","last_fullsized":"2023-12-07T21:11:52.831630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.831531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:22.265020+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188437+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:11:10.188437+0000","last_peered":"2023-12-07T21:11:10.188437+0000","last_clean":"2023-12-07T21:11:10.188437+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:11:10.188437+0000","last_undegraded":"2023-12-07T21:11:10.188437+0000","last_fullsized":"2023-12-07T21:11:10.188437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188463+0000","last_change":"2023-12-07T21:09:04.926451+0000","last_active":"2023-12-07T21:11:10.188463+0000","last_peered":"2023-12-07T21:11:10.188463+0000","last_clean":"2023-12-07T21:11:10.188463+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:11:10.188463+0000","last_undegraded":"2023-12-07T21:11:10.188463+0000","last_fullsized":"2023-12-07T21:11:10.188463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187815+0000","last_change":"2023-12-07T21:08:56.877160+0000","last_active":"2023-12-07T21:11:10.187815+0000","last_peered":"2023-12-07T21:11:10.187815+0000","last_clean":"2023-12-07T21:11:10.187815+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:11:10.187815+0000","last_undegraded":"2023-12-07T21:11:10.187815+0000","last_fullsized":"2023-12-07T21:11:10.187815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607705+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:11:10.607705+0000","last_peered":"2023-12-07T21:11:10.607705+0000","last_clean":"2023-12-07T21:11:10.607705+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:11:10.607705+0000","last_undegraded":"2023-12-07T21:11:10.607705+0000","last_fullsized":"2023-12-07T21:11:10.607705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.299949+0000","last_change":"2023-12-07T21:11:39.299988+0000","last_active":"2023-12-07T21:11:39.299949+0000","last_peered":"2023-12-07T21:11:39.299949+0000","last_clean":"2023-12-07T21:11:39.299949+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:39.299949+0000","last_undegraded":"2023-12-07T21:11:39.299949+0000","last_fullsized":"2023-12-07T21:11:39.299949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.299849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:48.997025+0000","scrub_duration":0.001356866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.839849+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:20.839849+0000","last_peered":"2023-12-07T21:11:20.839849+0000","last_clean":"2023-12-07T21:11:20.839849+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:20.839849+0000","last_undegraded":"2023-12-07T21:11:20.839849+0000","last_fullsized":"2023-12-07T21:11:20.839849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608769+0000","last_change":"2023-12-07T21:09:02.907875+0000","last_active":"2023-12-07T21:11:10.608769+0000","last_peered":"2023-12-07T21:11:10.608769+0000","last_clean":"2023-12-07T21:11:10.608769+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:11:10.608769+0000","last_undegraded":"2023-12-07T21:11:10.608769+0000","last_fullsized":"2023-12-07T21:11:10.608769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802571+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:11:08.802571+0000","last_peered":"2023-12-07T21:11:08.802571+0000","last_clean":"2023-12-07T21:11:08.802571+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:11:08.802571+0000","last_undegraded":"2023-12-07T21:11:08.802571+0000","last_fullsized":"2023-12-07T21:11:08.802571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766751+0000","last_change":"2023-12-07T21:08:56.879187+0000","last_active":"2023-12-07T21:11:09.766751+0000","last_peered":"2023-12-07T21:11:09.766751+0000","last_clean":"2023-12-07T21:11:09.766751+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:11:09.766751+0000","last_undegraded":"2023-12-07T21:11:09.766751+0000","last_fullsized":"2023-12-07T21:11:09.766751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187534+0000","last_change":"2023-12-07T21:08:54.880755+0000","last_active":"2023-12-07T21:11:10.187534+0000","last_peered":"2023-12-07T21:11:10.187534+0000","last_clean":"2023-12-07T21:11:10.187534+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:11:10.187534+0000","last_undegraded":"2023-12-07T21:11:10.187534+0000","last_fullsized":"2023-12-07T21:11:10.187534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.790833+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:15.790833+0000","last_peered":"2023-12-07T21:11:15.790833+0000","last_clean":"2023-12-07T21:11:15.790833+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:15.790833+0000","last_undegraded":"2023-12-07T21:11:15.790833+0000","last_fullsized":"2023-12-07T21:11:15.790833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'9","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.887014+0000","last_change":"2023-12-07T21:11:50.887056+0000","last_active":"2023-12-07T21:11:50.887014+0000","last_peered":"2023-12-07T21:11:50.887014+0000","last_clean":"2023-12-07T21:11:50.887014+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:50.887014+0000","last_undegraded":"2023-12-07T21:11:50.887014+0000","last_fullsized":"2023-12-07T21:11:50.887014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.886922+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:02.989113+0000","scrub_duration":0.0042007399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:19.515594+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:19.515594+0000","last_peered":"2023-12-07T21:11:19.515594+0000","last_clean":"2023-12-07T21:11:19.515594+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:19.515594+0000","last_undegraded":"2023-12-07T21:11:19.515594+0000","last_fullsized":"2023-12-07T21:11:19.515594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345954+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:11:09.345954+0000","last_peered":"2023-12-07T21:11:09.345954+0000","last_clean":"2023-12-07T21:11:09.345954+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:11:09.345954+0000","last_undegraded":"2023-12-07T21:11:09.345954+0000","last_fullsized":"2023-12-07T21:11:09.345954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345219+0000","last_change":"2023-12-07T21:08:56.874712+0000","last_active":"2023-12-07T21:11:09.345219+0000","last_peered":"2023-12-07T21:11:09.345219+0000","last_clean":"2023-12-07T21:11:09.345219+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:11:09.345219+0000","last_undegraded":"2023-12-07T21:11:09.345219+0000","last_fullsized":"2023-12-07T21:11:09.345219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187591+0000","last_change":"2023-12-07T21:08:54.885182+0000","last_active":"2023-12-07T21:11:10.187591+0000","last_peered":"2023-12-07T21:11:10.187591+0000","last_clean":"2023-12-07T21:11:10.187591+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:11:10.187591+0000","last_undegraded":"2023-12-07T21:11:10.187591+0000","last_fullsized":"2023-12-07T21:11:10.187591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188032+0000","last_change":"2023-12-07T21:08:58.873698+0000","last_active":"2023-12-07T21:11:10.188032+0000","last_peered":"2023-12-07T21:11:10.188032+0000","last_clean":"2023-12-07T21:11:10.188032+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:11:10.188032+0000","last_undegraded":"2023-12-07T21:11:10.188032+0000","last_fullsized":"2023-12-07T21:11:10.188032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.678798+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:11.678798+0000","last_peered":"2023-12-07T21:11:11.678798+0000","last_clean":"2023-12-07T21:11:11.678798+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:11.678798+0000","last_undegraded":"2023-12-07T21:11:11.678798+0000","last_fullsized":"2023-12-07T21:11:11.678798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.302787+0000","last_change":"2023-12-07T21:11:36.302809+0000","last_active":"2023-12-07T21:11:36.302787+0000","last_peered":"2023-12-07T21:11:36.302787+0000","last_clean":"2023-12-07T21:11:36.302787+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:36.302787+0000","last_undegraded":"2023-12-07T21:11:36.302787+0000","last_fullsized":"2023-12-07T21:11:36.302787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.302687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:01.567462+0000","scrub_duration":0.0014296669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608968+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:11:10.608968+0000","last_peered":"2023-12-07T21:11:10.608968+0000","last_clean":"2023-12-07T21:11:10.608968+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:11:10.608968+0000","last_undegraded":"2023-12-07T21:11:10.608968+0000","last_fullsized":"2023-12-07T21:11:10.608968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608103+0000","last_change":"2023-12-07T21:08:56.887184+0000","last_active":"2023-12-07T21:11:10.608103+0000","last_peered":"2023-12-07T21:11:10.608103+0000","last_clean":"2023-12-07T21:11:10.608103+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:11:10.608103+0000","last_undegraded":"2023-12-07T21:11:10.608103+0000","last_fullsized":"2023-12-07T21:11:10.608103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766431+0000","last_change":"2023-12-07T21:08:54.878542+0000","last_active":"2023-12-07T21:11:09.766431+0000","last_peered":"2023-12-07T21:11:09.766431+0000","last_clean":"2023-12-07T21:11:09.766431+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:11:09.766431+0000","last_undegraded":"2023-12-07T21:11:09.766431+0000","last_fullsized":"2023-12-07T21:11:09.766431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.514123+0000","last_change":"2023-12-07T21:11:52.514142+0000","last_active":"2023-12-07T21:11:52.514123+0000","last_peered":"2023-12-07T21:11:52.514123+0000","last_clean":"2023-12-07T21:11:52.514123+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:52.514123+0000","last_undegraded":"2023-12-07T21:11:52.514123+0000","last_fullsized":"2023-12-07T21:11:52.514123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.514035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:00:51.180837+0000","scrub_duration":0.00101976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.532757+0000","last_change":"2023-12-07T21:11:32.532802+0000","last_active":"2023-12-07T21:11:32.532757+0000","last_peered":"2023-12-07T21:11:32.532757+0000","last_clean":"2023-12-07T21:11:32.532757+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:32.532757+0000","last_undegraded":"2023-12-07T21:11:32.532757+0000","last_fullsized":"2023-12-07T21:11:32.532757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.532666+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:34.382885+0000","scrub_duration":0.0035860219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.544268+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:17.544268+0000","last_peered":"2023-12-07T21:11:17.544268+0000","last_clean":"2023-12-07T21:11:17.544268+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:17.544268+0000","last_undegraded":"2023-12-07T21:11:17.544268+0000","last_fullsized":"2023-12-07T21:11:17.544268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808681+0000","last_change":"2023-12-07T21:08:56.873185+0000","last_active":"2023-12-07T21:11:03.808681+0000","last_peered":"2023-12-07T21:11:03.808681+0000","last_clean":"2023-12-07T21:11:03.808681+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:11:03.808681+0000","last_undegraded":"2023-12-07T21:11:03.808681+0000","last_fullsized":"2023-12-07T21:11:03.808681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607720+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:11:10.607720+0000","last_peered":"2023-12-07T21:11:10.607720+0000","last_clean":"2023-12-07T21:11:10.607720+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:11:10.607720+0000","last_undegraded":"2023-12-07T21:11:10.607720+0000","last_fullsized":"2023-12-07T21:11:10.607720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:59.757098+0000","last_change":"2023-12-07T21:11:59.757120+0000","last_active":"2023-12-07T21:11:59.757098+0000","last_peered":"2023-12-07T21:11:59.757098+0000","last_clean":"2023-12-07T21:11:59.757098+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:11:59.757098+0000","last_undegraded":"2023-12-07T21:11:59.757098+0000","last_fullsized":"2023-12-07T21:11:59.757098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_clean_scrub_stamp":"2023-12-07T21:11:59.757017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:04:59.018197+0000","scrub_duration":0.001196353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'61","reported_seq":127,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.783931+0000","last_change":"2023-12-07T21:11:44.783993+0000","last_active":"2023-12-07T21:11:44.783931+0000","last_peered":"2023-12-07T21:11:44.783931+0000","last_clean":"2023-12-07T21:11:44.783931+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:44.783931+0000","last_undegraded":"2023-12-07T21:11:44.783931+0000","last_fullsized":"2023-12-07T21:11:44.783931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.783824+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:07.474940+0000","scrub_duration":0.004588193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.558888+0000","last_change":"2023-12-07T21:11:36.558908+0000","last_active":"2023-12-07T21:11:36.558888+0000","last_peered":"2023-12-07T21:11:36.558888+0000","last_clean":"2023-12-07T21:11:36.558888+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:11:36.558888+0000","last_undegraded":"2023-12-07T21:11:36.558888+0000","last_fullsized":"2023-12-07T21:11:36.558888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.558807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:33:06.320086+0000","scrub_duration":0.001387288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345942+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:11:09.345942+0000","last_peered":"2023-12-07T21:11:09.345942+0000","last_clean":"2023-12-07T21:11:09.345942+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:11:09.345942+0000","last_undegraded":"2023-12-07T21:11:09.345942+0000","last_fullsized":"2023-12-07T21:11:09.345942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173426+0000","last_change":"2023-12-07T21:08:56.877115+0000","last_active":"2023-12-07T21:10:59.173426+0000","last_peered":"2023-12-07T21:10:59.173426+0000","last_clean":"2023-12-07T21:10:59.173426+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:10:59.173426+0000","last_undegraded":"2023-12-07T21:10:59.173426+0000","last_fullsized":"2023-12-07T21:10:59.173426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766432+0000","last_change":"2023-12-07T21:08:54.882363+0000","last_active":"2023-12-07T21:11:09.766432+0000","last_peered":"2023-12-07T21:11:09.766432+0000","last_clean":"2023-12-07T21:11:09.766432+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:11:09.766432+0000","last_undegraded":"2023-12-07T21:11:09.766432+0000","last_fullsized":"2023-12-07T21:11:09.766432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807381+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:11:03.807381+0000","last_peered":"2023-12-07T21:11:03.807381+0000","last_clean":"2023-12-07T21:11:03.807381+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:11:03.807381+0000","last_undegraded":"2023-12-07T21:11:03.807381+0000","last_fullsized":"2023-12-07T21:11:03.807381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'37","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608669+0000","last_change":"2023-12-07T21:09:00.887309+0000","last_active":"2023-12-07T21:11:10.608669+0000","last_peered":"2023-12-07T21:11:10.608669+0000","last_clean":"2023-12-07T21:11:10.608669+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:11:10.608669+0000","last_undegraded":"2023-12-07T21:11:10.608669+0000","last_fullsized":"2023-12-07T21:11:10.608669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767423+0000","last_change":"2023-12-07T21:09:02.907306+0000","last_active":"2023-12-07T21:11:09.767423+0000","last_peered":"2023-12-07T21:11:09.767423+0000","last_clean":"2023-12-07T21:11:09.767423+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:11:09.767423+0000","last_undegraded":"2023-12-07T21:11:09.767423+0000","last_fullsized":"2023-12-07T21:11:09.767423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608912+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:11:10.608912+0000","last_peered":"2023-12-07T21:11:10.608912+0000","last_clean":"2023-12-07T21:11:10.608912+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:11:10.608912+0000","last_undegraded":"2023-12-07T21:11:10.608912+0000","last_fullsized":"2023-12-07T21:11:10.608912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608122+0000","last_change":"2023-12-07T21:08:56.885223+0000","last_active":"2023-12-07T21:11:10.608122+0000","last_peered":"2023-12-07T21:11:10.608122+0000","last_clean":"2023-12-07T21:11:10.608122+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:11:10.608122+0000","last_undegraded":"2023-12-07T21:11:10.608122+0000","last_fullsized":"2023-12-07T21:11:10.608122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766451+0000","last_change":"2023-12-07T21:08:54.887587+0000","last_active":"2023-12-07T21:11:09.766451+0000","last_peered":"2023-12-07T21:11:09.766451+0000","last_clean":"2023-12-07T21:11:09.766451+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:11:09.766451+0000","last_undegraded":"2023-12-07T21:11:09.766451+0000","last_fullsized":"2023-12-07T21:11:09.766451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188054+0000","last_change":"2023-12-07T21:08:58.876479+0000","last_active":"2023-12-07T21:11:10.188054+0000","last_peered":"2023-12-07T21:11:10.188054+0000","last_clean":"2023-12-07T21:11:10.188054+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:11:10.188054+0000","last_undegraded":"2023-12-07T21:11:10.188054+0000","last_fullsized":"2023-12-07T21:11:10.188054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.745145+0000","last_change":"2023-12-07T21:11:36.745178+0000","last_active":"2023-12-07T21:11:36.745145+0000","last_peered":"2023-12-07T21:11:36.745145+0000","last_clean":"2023-12-07T21:11:36.745145+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:36.745145+0000","last_undegraded":"2023-12-07T21:11:36.745145+0000","last_fullsized":"2023-12-07T21:11:36.745145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.745068+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:09.080620+0000","scrub_duration":0.0072373669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:16.616692+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:11:16.616692+0000","last_peered":"2023-12-07T21:11:16.616692+0000","last_clean":"2023-12-07T21:11:16.616692+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:11:16.616692+0000","last_undegraded":"2023-12-07T21:11:16.616692+0000","last_fullsized":"2023-12-07T21:11:16.616692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608884+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:11:10.608884+0000","last_peered":"2023-12-07T21:11:10.608884+0000","last_clean":"2023-12-07T21:11:10.608884+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:11:10.608884+0000","last_undegraded":"2023-12-07T21:11:10.608884+0000","last_fullsized":"2023-12-07T21:11:10.608884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'3","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345230+0000","last_change":"2023-12-07T21:08:56.872465+0000","last_active":"2023-12-07T21:11:09.345230+0000","last_peered":"2023-12-07T21:11:09.345230+0000","last_clean":"2023-12-07T21:11:09.345230+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:11:09.345230+0000","last_undegraded":"2023-12-07T21:11:09.345230+0000","last_fullsized":"2023-12-07T21:11:09.345230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607746+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:11:10.607746+0000","last_peered":"2023-12-07T21:11:10.607746+0000","last_clean":"2023-12-07T21:11:10.607746+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:11:10.607746+0000","last_undegraded":"2023-12-07T21:11:10.607746+0000","last_fullsized":"2023-12-07T21:11:10.607746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.324406+0000","last_change":"2023-12-07T21:11:41.324449+0000","last_active":"2023-12-07T21:11:41.324406+0000","last_peered":"2023-12-07T21:11:41.324406+0000","last_clean":"2023-12-07T21:11:41.324406+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:41.324406+0000","last_undegraded":"2023-12-07T21:11:41.324406+0000","last_fullsized":"2023-12-07T21:11:41.324406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.324294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:18:22.956309+0000","scrub_duration":0.001431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808601+0000","last_change":"2023-12-07T21:09:00.896323+0000","last_active":"2023-12-07T21:11:03.808601+0000","last_peered":"2023-12-07T21:11:03.808601+0000","last_clean":"2023-12-07T21:11:03.808601+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:11:03.808601+0000","last_undegraded":"2023-12-07T21:11:03.808601+0000","last_fullsized":"2023-12-07T21:11:03.808601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411900+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411900+0000","last_peered":"2023-12-07T21:11:10.411900+0000","last_clean":"2023-12-07T21:11:10.411900+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411900+0000","last_undegraded":"2023-12-07T21:11:10.411900+0000","last_fullsized":"2023-12-07T21:11:10.411900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608864+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:11:10.608864+0000","last_peered":"2023-12-07T21:11:10.608864+0000","last_clean":"2023-12-07T21:11:10.608864+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:11:10.608864+0000","last_undegraded":"2023-12-07T21:11:10.608864+0000","last_fullsized":"2023-12-07T21:11:10.608864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187884+0000","last_change":"2023-12-07T21:08:56.871124+0000","last_active":"2023-12-07T21:11:10.187884+0000","last_peered":"2023-12-07T21:11:10.187884+0000","last_clean":"2023-12-07T21:11:10.187884+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:11:10.187884+0000","last_undegraded":"2023-12-07T21:11:10.187884+0000","last_fullsized":"2023-12-07T21:11:10.187884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766523+0000","last_change":"2023-12-07T21:08:54.876774+0000","last_active":"2023-12-07T21:11:09.766523+0000","last_peered":"2023-12-07T21:11:09.766523+0000","last_clean":"2023-12-07T21:11:09.766523+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:11:09.766523+0000","last_undegraded":"2023-12-07T21:11:09.766523+0000","last_fullsized":"2023-12-07T21:11:09.766523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.351535+0000","last_change":"2023-12-07T21:11:43.351557+0000","last_active":"2023-12-07T21:11:43.351535+0000","last_peered":"2023-12-07T21:11:43.351535+0000","last_clean":"2023-12-07T21:11:43.351535+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:43.351535+0000","last_undegraded":"2023-12-07T21:11:43.351535+0000","last_fullsized":"2023-12-07T21:11:43.351535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_clean_scrub_stamp":"2023-12-07T21:11:43.351414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:25.302758+0000","scrub_duration":0.001534795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.102589+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:17.102589+0000","last_peered":"2023-12-07T21:11:17.102589+0000","last_clean":"2023-12-07T21:11:17.102589+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:17.102589+0000","last_undegraded":"2023-12-07T21:11:17.102589+0000","last_fullsized":"2023-12-07T21:11:17.102589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.804304+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:27.804304+0000","last_peered":"2023-12-07T21:11:27.804304+0000","last_clean":"2023-12-07T21:11:27.804304+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:27.804304+0000","last_undegraded":"2023-12-07T21:11:27.804304+0000","last_fullsized":"2023-12-07T21:11:27.804304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767539+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:11:09.767539+0000","last_peered":"2023-12-07T21:11:09.767539+0000","last_clean":"2023-12-07T21:11:09.767539+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:11:09.767539+0000","last_undegraded":"2023-12-07T21:11:09.767539+0000","last_fullsized":"2023-12-07T21:11:09.767539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187796+0000","last_change":"2023-12-07T21:08:56.870984+0000","last_active":"2023-12-07T21:11:10.187796+0000","last_peered":"2023-12-07T21:11:10.187796+0000","last_clean":"2023-12-07T21:11:10.187796+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:11:10.187796+0000","last_undegraded":"2023-12-07T21:11:10.187796+0000","last_fullsized":"2023-12-07T21:11:10.187796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607752+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:11:10.607752+0000","last_peered":"2023-12-07T21:11:10.607752+0000","last_clean":"2023-12-07T21:11:10.607752+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:11:10.607752+0000","last_undegraded":"2023-12-07T21:11:10.607752+0000","last_fullsized":"2023-12-07T21:11:10.607752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188024+0000","last_change":"2023-12-07T21:08:58.881984+0000","last_active":"2023-12-07T21:11:10.188024+0000","last_peered":"2023-12-07T21:11:10.188024+0000","last_clean":"2023-12-07T21:11:10.188024+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:11:10.188024+0000","last_undegraded":"2023-12-07T21:11:10.188024+0000","last_fullsized":"2023-12-07T21:11:10.188024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.713857+0000","last_change":"2023-12-07T21:11:41.713922+0000","last_active":"2023-12-07T21:11:41.713857+0000","last_peered":"2023-12-07T21:11:41.713857+0000","last_clean":"2023-12-07T21:11:41.713857+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:41.713857+0000","last_undegraded":"2023-12-07T21:11:41.713857+0000","last_fullsized":"2023-12-07T21:11:41.713857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.713762+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:20:34.087308+0000","scrub_duration":0.004054785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608739+0000","last_change":"2023-12-07T21:09:02.907688+0000","last_active":"2023-12-07T21:11:10.608739+0000","last_peered":"2023-12-07T21:11:10.608739+0000","last_clean":"2023-12-07T21:11:10.608739+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:11:10.608739+0000","last_undegraded":"2023-12-07T21:11:10.608739+0000","last_fullsized":"2023-12-07T21:11:10.608739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608952+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:11:10.608952+0000","last_peered":"2023-12-07T21:11:10.608952+0000","last_clean":"2023-12-07T21:11:10.608952+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:11:10.608952+0000","last_undegraded":"2023-12-07T21:11:10.608952+0000","last_fullsized":"2023-12-07T21:11:10.608952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608124+0000","last_change":"2023-12-07T21:08:56.873059+0000","last_active":"2023-12-07T21:11:10.608124+0000","last_peered":"2023-12-07T21:11:10.608124+0000","last_clean":"2023-12-07T21:11:10.608124+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:11:10.608124+0000","last_undegraded":"2023-12-07T21:11:10.608124+0000","last_fullsized":"2023-12-07T21:11:10.608124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800263+0000","last_change":"2023-12-07T21:08:54.890887+0000","last_active":"2023-12-07T21:10:58.800263+0000","last_peered":"2023-12-07T21:10:58.800263+0000","last_clean":"2023-12-07T21:10:58.800263+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:10:58.800263+0000","last_undegraded":"2023-12-07T21:10:58.800263+0000","last_fullsized":"2023-12-07T21:10:58.800263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.412338+0000","last_change":"2023-12-07T21:11:55.412366+0000","last_active":"2023-12-07T21:11:55.412338+0000","last_peered":"2023-12-07T21:11:55.412338+0000","last_clean":"2023-12-07T21:11:55.412338+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:55.412338+0000","last_undegraded":"2023-12-07T21:11:55.412338+0000","last_fullsized":"2023-12-07T21:11:55.412338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.412243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.514434+0000","scrub_duration":0.0010230090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:00.405899+0000","last_change":"2023-12-07T21:12:00.405945+0000","last_active":"2023-12-07T21:12:00.405899+0000","last_peered":"2023-12-07T21:12:00.405899+0000","last_clean":"2023-12-07T21:12:00.405899+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:12:00.405899+0000","last_undegraded":"2023-12-07T21:12:00.405899+0000","last_fullsized":"2023-12-07T21:12:00.405899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_clean_scrub_stamp":"2023-12-07T21:12:00.405797+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:22.672028+0000","scrub_duration":0.0030248670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608741+0000","last_change":"2023-12-07T21:09:02.906202+0000","last_active":"2023-12-07T21:11:10.608741+0000","last_peered":"2023-12-07T21:11:10.608741+0000","last_clean":"2023-12-07T21:11:10.608741+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:11:10.608741+0000","last_undegraded":"2023-12-07T21:11:10.608741+0000","last_fullsized":"2023-12-07T21:11:10.608741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608961+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:11:10.608961+0000","last_peered":"2023-12-07T21:11:10.608961+0000","last_clean":"2023-12-07T21:11:10.608961+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:11:10.608961+0000","last_undegraded":"2023-12-07T21:11:10.608961+0000","last_fullsized":"2023-12-07T21:11:10.608961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'13","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187822+0000","last_change":"2023-12-07T21:08:56.869733+0000","last_active":"2023-12-07T21:11:10.187822+0000","last_peered":"2023-12-07T21:11:10.187822+0000","last_clean":"2023-12-07T21:11:10.187822+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:11:10.187822+0000","last_undegraded":"2023-12-07T21:11:10.187822+0000","last_fullsized":"2023-12-07T21:11:10.187822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807399+0000","last_change":"2023-12-07T21:08:54.878825+0000","last_active":"2023-12-07T21:11:03.807399+0000","last_peered":"2023-12-07T21:11:03.807399+0000","last_clean":"2023-12-07T21:11:03.807399+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:11:03.807399+0000","last_undegraded":"2023-12-07T21:11:03.807399+0000","last_fullsized":"2023-12-07T21:11:03.807399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.347674+0000","last_change":"2023-12-07T21:11:44.347728+0000","last_active":"2023-12-07T21:11:44.347674+0000","last_peered":"2023-12-07T21:11:44.347674+0000","last_clean":"2023-12-07T21:11:44.347674+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:44.347674+0000","last_undegraded":"2023-12-07T21:11:44.347674+0000","last_fullsized":"2023-12-07T21:11:44.347674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.347582+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:19:20.740832+0000","scrub_duration":0.0032839919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608679+0000","last_change":"2023-12-07T21:09:00.887872+0000","last_active":"2023-12-07T21:11:10.608679+0000","last_peered":"2023-12-07T21:11:10.608679+0000","last_clean":"2023-12-07T21:11:10.608679+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:11:10.608679+0000","last_undegraded":"2023-12-07T21:11:10.608679+0000","last_fullsized":"2023-12-07T21:11:10.608679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.597790+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:15.597790+0000","last_peered":"2023-12-07T21:11:15.597790+0000","last_clean":"2023-12-07T21:11:15.597790+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:15.597790+0000","last_undegraded":"2023-12-07T21:11:15.597790+0000","last_fullsized":"2023-12-07T21:11:15.597790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608930+0000","last_change":"2023-12-07T21:09:04.928655+0000","last_active":"2023-12-07T21:11:10.608930+0000","last_peered":"2023-12-07T21:11:10.608930+0000","last_clean":"2023-12-07T21:11:10.608930+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:11:10.608930+0000","last_undegraded":"2023-12-07T21:11:10.608930+0000","last_fullsized":"2023-12-07T21:11:10.608930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808984+0000","last_change":"2023-12-07T21:08:56.884246+0000","last_active":"2023-12-07T21:11:08.808984+0000","last_peered":"2023-12-07T21:11:08.808984+0000","last_clean":"2023-12-07T21:11:08.808984+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:11:08.808984+0000","last_undegraded":"2023-12-07T21:11:08.808984+0000","last_fullsized":"2023-12-07T21:11:08.808984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806724+0000","last_change":"2023-12-07T21:08:54.888408+0000","last_active":"2023-12-07T21:11:03.806724+0000","last_peered":"2023-12-07T21:11:03.806724+0000","last_clean":"2023-12-07T21:11:03.806724+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:11:03.806724+0000","last_undegraded":"2023-12-07T21:11:03.806724+0000","last_fullsized":"2023-12-07T21:11:03.806724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802632+0000","last_change":"2023-12-07T21:08:56.873286+0000","last_active":"2023-12-07T21:11:08.802632+0000","last_peered":"2023-12-07T21:11:08.802632+0000","last_clean":"2023-12-07T21:11:08.802632+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:11:08.802632+0000","last_undegraded":"2023-12-07T21:11:08.802632+0000","last_fullsized":"2023-12-07T21:11:08.802632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800891+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:11:03.800891+0000","last_peered":"2023-12-07T21:11:03.800891+0000","last_clean":"2023-12-07T21:11:03.800891+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:11:03.800891+0000","last_undegraded":"2023-12-07T21:11:03.800891+0000","last_fullsized":"2023-12-07T21:11:03.800891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809648+0000","last_change":"2023-12-07T21:08:56.874905+0000","last_active":"2023-12-07T21:11:08.809648+0000","last_peered":"2023-12-07T21:11:08.809648+0000","last_clean":"2023-12-07T21:11:08.809648+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:11:08.809648+0000","last_undegraded":"2023-12-07T21:11:08.809648+0000","last_fullsized":"2023-12-07T21:11:08.809648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808292+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:11:03.808292+0000","last_peered":"2023-12-07T21:11:03.808292+0000","last_clean":"2023-12-07T21:11:03.808292+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:11:03.808292+0000","last_undegraded":"2023-12-07T21:11:03.808292+0000","last_fullsized":"2023-12-07T21:11:03.808292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802478+0000","last_change":"2023-12-07T21:08:56.872273+0000","last_active":"2023-12-07T21:11:08.802478+0000","last_peered":"2023-12-07T21:11:08.802478+0000","last_clean":"2023-12-07T21:11:08.802478+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:11:08.802478+0000","last_undegraded":"2023-12-07T21:11:08.802478+0000","last_fullsized":"2023-12-07T21:11:08.802478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801133+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:11:03.801133+0000","last_peered":"2023-12-07T21:11:03.801133+0000","last_clean":"2023-12-07T21:11:03.801133+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:11:03.801133+0000","last_undegraded":"2023-12-07T21:11:03.801133+0000","last_fullsized":"2023-12-07T21:11:03.801133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801089+0000","last_change":"2023-12-07T21:08:56.876070+0000","last_active":"2023-12-07T21:11:03.801089+0000","last_peered":"2023-12-07T21:11:03.801089+0000","last_clean":"2023-12-07T21:11:03.801089+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:11:03.801089+0000","last_undegraded":"2023-12-07T21:11:03.801089+0000","last_fullsized":"2023-12-07T21:11:03.801089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802500+0000","last_change":"2023-12-07T21:08:54.874578+0000","last_active":"2023-12-07T21:11:08.802500+0000","last_peered":"2023-12-07T21:11:08.802500+0000","last_clean":"2023-12-07T21:11:08.802500+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:11:08.802500+0000","last_undegraded":"2023-12-07T21:11:08.802500+0000","last_fullsized":"2023-12-07T21:11:08.802500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807052+0000","last_change":"2023-12-07T21:08:56.883348+0000","last_active":"2023-12-07T21:11:03.807052+0000","last_peered":"2023-12-07T21:11:03.807052+0000","last_clean":"2023-12-07T21:11:03.807052+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:11:03.807052+0000","last_undegraded":"2023-12-07T21:11:03.807052+0000","last_fullsized":"2023-12-07T21:11:03.807052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808756+0000","last_change":"2023-12-07T21:08:54.887259+0000","last_active":"2023-12-07T21:11:08.808756+0000","last_peered":"2023-12-07T21:11:08.808756+0000","last_clean":"2023-12-07T21:11:08.808756+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:11:08.808756+0000","last_undegraded":"2023-12-07T21:11:08.808756+0000","last_fullsized":"2023-12-07T21:11:08.808756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800970+0000","last_change":"2023-12-07T21:08:56.876299+0000","last_active":"2023-12-07T21:11:03.800970+0000","last_peered":"2023-12-07T21:11:03.800970+0000","last_clean":"2023-12-07T21:11:03.800970+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:11:03.800970+0000","last_undegraded":"2023-12-07T21:11:03.800970+0000","last_fullsized":"2023-12-07T21:11:03.800970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808785+0000","last_change":"2023-12-07T21:08:54.885457+0000","last_active":"2023-12-07T21:11:08.808785+0000","last_peered":"2023-12-07T21:11:08.808785+0000","last_clean":"2023-12-07T21:11:08.808785+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:11:08.808785+0000","last_undegraded":"2023-12-07T21:11:08.808785+0000","last_fullsized":"2023-12-07T21:11:08.808785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806817+0000","last_change":"2023-12-07T21:08:56.887101+0000","last_active":"2023-12-07T21:11:03.806817+0000","last_peered":"2023-12-07T21:11:03.806817+0000","last_clean":"2023-12-07T21:11:03.806817+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:11:03.806817+0000","last_undegraded":"2023-12-07T21:11:03.806817+0000","last_fullsized":"2023-12-07T21:11:03.806817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802670+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:11:08.802670+0000","last_peered":"2023-12-07T21:11:08.802670+0000","last_clean":"2023-12-07T21:11:08.802670+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:11:08.802670+0000","last_undegraded":"2023-12-07T21:11:08.802670+0000","last_fullsized":"2023-12-07T21:11:08.802670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766944+0000","last_change":"2023-12-07T21:08:56.882240+0000","last_active":"2023-12-07T21:11:09.766944+0000","last_peered":"2023-12-07T21:11:09.766944+0000","last_clean":"2023-12-07T21:11:09.766944+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:11:09.766944+0000","last_undegraded":"2023-12-07T21:11:09.766944+0000","last_fullsized":"2023-12-07T21:11:09.766944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809216+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:11:08.809216+0000","last_peered":"2023-12-07T21:11:08.809216+0000","last_clean":"2023-12-07T21:11:08.809216+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:11:08.809216+0000","last_undegraded":"2023-12-07T21:11:08.809216+0000","last_fullsized":"2023-12-07T21:11:08.809216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608162+0000","last_change":"2023-12-07T21:08:56.875906+0000","last_active":"2023-12-07T21:11:10.608162+0000","last_peered":"2023-12-07T21:11:10.608162+0000","last_clean":"2023-12-07T21:11:10.608162+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:11:10.608162+0000","last_undegraded":"2023-12-07T21:11:10.608162+0000","last_fullsized":"2023-12-07T21:11:10.608162+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345160+0000","last_change":"2023-12-07T21:08:54.883629+0000","last_active":"2023-12-07T21:11:09.345160+0000","last_peered":"2023-12-07T21:11:09.345160+0000","last_clean":"2023-12-07T21:11:09.345160+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:11:09.345160+0000","last_undegraded":"2023-12-07T21:11:09.345160+0000","last_fullsized":"2023-12-07T21:11:09.345160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345344+0000","last_change":"2023-12-07T21:08:56.876309+0000","last_active":"2023-12-07T21:11:09.345344+0000","last_peered":"2023-12-07T21:11:09.345344+0000","last_clean":"2023-12-07T21:11:09.345344+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:11:09.345344+0000","last_undegraded":"2023-12-07T21:11:09.345344+0000","last_fullsized":"2023-12-07T21:11:09.345344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766567+0000","last_change":"2023-12-07T21:08:54.887130+0000","last_active":"2023-12-07T21:11:09.766567+0000","last_peered":"2023-12-07T21:11:09.766567+0000","last_clean":"2023-12-07T21:11:09.766567+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:11:09.766567+0000","last_undegraded":"2023-12-07T21:11:09.766567+0000","last_fullsized":"2023-12-07T21:11:09.766567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766855+0000","last_change":"2023-12-07T21:08:56.871205+0000","last_active":"2023-12-07T21:11:09.766855+0000","last_peered":"2023-12-07T21:11:09.766855+0000","last_clean":"2023-12-07T21:11:09.766855+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:11:09.766855+0000","last_undegraded":"2023-12-07T21:11:09.766855+0000","last_fullsized":"2023-12-07T21:11:09.766855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766587+0000","last_change":"2023-12-07T21:08:54.884013+0000","last_active":"2023-12-07T21:11:09.766587+0000","last_peered":"2023-12-07T21:11:09.766587+0000","last_clean":"2023-12-07T21:11:09.766587+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:11:09.766587+0000","last_undegraded":"2023-12-07T21:11:09.766587+0000","last_fullsized":"2023-12-07T21:11:09.766587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766814+0000","last_change":"2023-12-07T21:08:56.879513+0000","last_active":"2023-12-07T21:11:09.766814+0000","last_peered":"2023-12-07T21:11:09.766814+0000","last_clean":"2023-12-07T21:11:09.766814+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:11:09.766814+0000","last_undegraded":"2023-12-07T21:11:09.766814+0000","last_fullsized":"2023-12-07T21:11:09.766814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607834+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:11:10.607834+0000","last_peered":"2023-12-07T21:11:10.607834+0000","last_clean":"2023-12-07T21:11:10.607834+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:11:10.607834+0000","last_undegraded":"2023-12-07T21:11:10.607834+0000","last_fullsized":"2023-12-07T21:11:10.607834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'15","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766836+0000","last_change":"2023-12-07T21:08:56.882760+0000","last_active":"2023-12-07T21:11:09.766836+0000","last_peered":"2023-12-07T21:11:09.766836+0000","last_clean":"2023-12-07T21:11:09.766836+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:11:09.766836+0000","last_undegraded":"2023-12-07T21:11:09.766836+0000","last_fullsized":"2023-12-07T21:11:09.766836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607826+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:11:10.607826+0000","last_peered":"2023-12-07T21:11:10.607826+0000","last_clean":"2023-12-07T21:11:10.607826+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:11:10.607826+0000","last_undegraded":"2023-12-07T21:11:10.607826+0000","last_fullsized":"2023-12-07T21:11:10.607826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608179+0000","last_change":"2023-12-07T21:08:56.876875+0000","last_active":"2023-12-07T21:11:10.608179+0000","last_peered":"2023-12-07T21:11:10.608179+0000","last_clean":"2023-12-07T21:11:10.608179+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:11:10.608179+0000","last_undegraded":"2023-12-07T21:11:10.608179+0000","last_fullsized":"2023-12-07T21:11:10.608179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187739+0000","last_change":"2023-12-07T21:08:54.885432+0000","last_active":"2023-12-07T21:11:10.187739+0000","last_peered":"2023-12-07T21:11:10.187739+0000","last_clean":"2023-12-07T21:11:10.187739+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:11:10.187739+0000","last_undegraded":"2023-12-07T21:11:10.187739+0000","last_fullsized":"2023-12-07T21:11:10.187739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:01.404024+0000","last_change":"2023-12-07T21:12:01.404048+0000","last_active":"2023-12-07T21:12:01.404024+0000","last_peered":"2023-12-07T21:12:01.404024+0000","last_clean":"2023-12-07T21:12:01.404024+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:12:01.404024+0000","last_undegraded":"2023-12-07T21:12:01.404024+0000","last_fullsized":"2023-12-07T21:12:01.404024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_clean_scrub_stamp":"2023-12-07T21:12:01.403925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:06:41.638050+0000","scrub_duration":0.0014963070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607856+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:11:10.607856+0000","last_peered":"2023-12-07T21:11:10.607856+0000","last_clean":"2023-12-07T21:11:10.607856+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:11:10.607856+0000","last_undegraded":"2023-12-07T21:11:10.607856+0000","last_fullsized":"2023-12-07T21:11:10.607856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607882+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:11:10.607882+0000","last_peered":"2023-12-07T21:11:10.607882+0000","last_clean":"2023-12-07T21:11:10.607882+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:11:10.607882+0000","last_undegraded":"2023-12-07T21:11:10.607882+0000","last_fullsized":"2023-12-07T21:11:10.607882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345392+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:11:09.345392+0000","last_peered":"2023-12-07T21:11:09.345392+0000","last_clean":"2023-12-07T21:11:09.345392+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:11:09.345392+0000","last_undegraded":"2023-12-07T21:11:09.345392+0000","last_fullsized":"2023-12-07T21:11:09.345392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345178+0000","last_change":"2023-12-07T21:08:54.883760+0000","last_active":"2023-12-07T21:11:09.345178+0000","last_peered":"2023-12-07T21:11:09.345178+0000","last_clean":"2023-12-07T21:11:09.345178+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:11:09.345178+0000","last_undegraded":"2023-12-07T21:11:09.345178+0000","last_fullsized":"2023-12-07T21:11:09.345178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766992+0000","last_change":"2023-12-07T21:08:56.881838+0000","last_active":"2023-12-07T21:11:09.766992+0000","last_peered":"2023-12-07T21:11:09.766992+0000","last_clean":"2023-12-07T21:11:09.766992+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:11:09.766992+0000","last_undegraded":"2023-12-07T21:11:09.766992+0000","last_fullsized":"2023-12-07T21:11:09.766992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1970,"ondisk_log_size":1970,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1392,"ondisk_log_size":1392,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705710,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.56899999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54500000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.33700000000000002,"15min":0.34399999999999997},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.40200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34100000000000003,"15min":0.34599999999999997},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45300000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.52300000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.44700000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.25}]}]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.22900000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.24399999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.59499999999999997,"5min":0.621,"15min":0.621},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Dec 7 21:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Dec 7 21:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.432}]}]},{"osd":1,"up_from":9,"seq":38654705709,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45200000000000001,"15min":0.45500000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.59199999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.222,"15min":0.222},"max":{"1min":0.57699999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.504}]},{"osd":2,"last update":"Thu Dec 7 21:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35299999999999998,"15min":0.36299999999999999},"min":{"1min":0.22700000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.50600000000000001,"5min":0.629,"15min":0.629},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.22900000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.48999999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.252}]},{"osd":3,"last update":"Thu Dec 7 21:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46400000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.316},{"interface":"front","average":{"1min":0.371,"5min":0.373,"15min":0.379},"min":{"1min":0.29099999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.48599999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.34499999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.434},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.67600000000000005,"5min":0.747,"15min":0.747},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.502},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.47499999999999998},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67600000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.29599999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49099999999999999,"15min":0.48899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.44900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:12:12.068 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.068 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.068 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.068 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.068 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.069 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.069 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.069 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.069 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.069 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.069 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.069 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.070 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.070 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.070 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.070 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.070 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.070 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.071 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.071 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.071 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.071 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.071 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.071 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.071 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.072 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.072 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.072 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.072 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.072 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.072 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.072 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.073 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.073 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.073 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.073 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.073 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.073 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.074 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.074 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.074 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.074 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.074 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.074 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.075 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.075 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.075 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.075 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.075 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.075 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.076 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.076 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.076 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.076 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.076 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.076 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.076 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.077 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.077 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.077 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.077 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.077 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.077 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.077 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.078 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.078 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.078 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.078 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.078 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.079 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.079 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.079 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.079 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-07T21:08:40.790884+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=40, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.079 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.079 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.079 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.080 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.080 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.080 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.080 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.080 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.080 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.081 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.081 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.081 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.081 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.081 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.081 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.081 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.082 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.082 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.082 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.082 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.082 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.082 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.083 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.083 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.083 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.083 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.083 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.083 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.083 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.084 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.084 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.084 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.084 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.084 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.084 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.085 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.085 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.085 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.085 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.085 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.085 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.085 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.086 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.086 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.086 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.086 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.086 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.086 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.087 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.087 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.087 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.087 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.087 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.087 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.088 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.088 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.088 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.088 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.088 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.088 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.088 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.089 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.089 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.089 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.089 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.089 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.089 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.090 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.090 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.090 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.090 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.090 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.091 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.091 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.091 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.091 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.091 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.091 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.091 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.092 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.092 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.092 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.092 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.092 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.092 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.092 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.093 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.093 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.093 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.093 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.093 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.093 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.094 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.094 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.094 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.094 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.094 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.094 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.094 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.095 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.095 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.095 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.095 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.095 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.095 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.095 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.096 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.096 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.096 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.096 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.096 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.096 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.097 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.097 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.097 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.097 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.097 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.097 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.097 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:12.098 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:12:32.099 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:12:32.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.218+0000 7ff843c51640 1 Processor -- start 2023-12-07T21:12:32.209 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.218+0000 7ff843c51640 1 -- start start 2023-12-07T21:12:32.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.218+0000 7ff843c51640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff83c097ab0 0x7ff83c12fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:12:32.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.218+0000 7ff843c51640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c06e240 con 0x7ff83c0976d0 2023-12-07T21:12:32.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.218+0000 7ff843c51640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83c070140 con 0x7ff83c097ab0 2023-12-07T21:12:32.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.219+0000 7ff8411ec640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff83c097ab0 0x7ff83c12fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:12:32.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.219+0000 7ff8419ed640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff83c0976d0 0x7ff83c070610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:46544/0 (socket says 172.21.15.89:46544) 2023-12-07T21:12:32.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.219+0000 7ff8419ed640 1 -- 172.21.15.89:0/1221098194 learned_addr learned my addr 172.21.15.89:0/1221098194 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:12:32.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.219+0000 7ff8411ec640 1 -- 172.21.15.89:0/1221098194 >> v1:172.21.15.89:6789/0 conn(0x7ff83c0976d0 legacy=0x7ff83c070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:32.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.219+0000 7ff8411ec640 1 -- 172.21.15.89:0/1221098194 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c06e9a0 con 0x7ff83c097ab0 2023-12-07T21:12:32.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.219+0000 7ff8409eb640 1 -- 172.21.15.89:0/1221098194 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804415138 0 0) 0x7ff83c06e240 con 0x7ff83c0976d0 2023-12-07T21:12:32.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.220+0000 7ff8411ec640 1 --2- 172.21.15.89:0/1221098194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c097ab0 0x7ff83c12fe50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009720 tx=0x7ff82c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c101d595bafb3ff server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:12:32.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.220+0000 7ff8409eb640 1 -- 172.21.15.89:0/1221098194 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff82c02e070 con 0x7ff83c097ab0 2023-12-07T21:12:32.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.220+0000 7ff8409eb640 1 -- 172.21.15.89:0/1221098194 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c0316d0 con 0x7ff83c097ab0 2023-12-07T21:12:32.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.220+0000 7ff8409eb640 1 -- 172.21.15.89:0/1221098194 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff82c031990 con 0x7ff83c097ab0 2023-12-07T21:12:32.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.220+0000 7ff843c51640 1 -- 172.21.15.89:0/1221098194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c097ab0 msgr2=0x7ff83c12fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:32.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.220+0000 7ff843c51640 1 --2- 172.21.15.89:0/1221098194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c097ab0 0x7ff83c12fe50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009720 tx=0x7ff82c02b840 comp rx=0 tx=0).stop 2023-12-07T21:12:32.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.220+0000 7ff843c51640 1 -- 172.21.15.89:0/1221098194 shutdown_connections 2023-12-07T21:12:32.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.220+0000 7ff843c51640 1 --2- 172.21.15.89:0/1221098194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c097ab0 0x7ff83c12fe50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:12:32.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.220+0000 7ff843c51640 1 -- 172.21.15.89:0/1221098194 >> 172.21.15.89:0/1221098194 conn(0x7ff83c0987f0 msgr2=0x7ff83c098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:12:32.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.220+0000 7ff843c51640 1 -- 172.21.15.89:0/1221098194 shutdown_connections 2023-12-07T21:12:32.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.221+0000 7ff843c51640 1 -- 172.21.15.89:0/1221098194 wait complete. 2023-12-07T21:12:32.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.221+0000 7ff843c51640 1 Processor -- start 2023-12-07T21:12:32.216 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.221+0000 7ff843c51640 1 -- start start 2023-12-07T21:12:32.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.222+0000 7ff843c51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0976d0 0x7ff83c1bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:12:32.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.222+0000 7ff843c51640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c08bdd0 con 0x7ff83c0976d0 2023-12-07T21:12:32.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.222+0000 7ff8419ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0976d0 0x7ff83c1bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:12:32.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.222+0000 7ff8419ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0976d0 0x7ff83c1bfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50660/0 (socket says 172.21.15.89:50660) 2023-12-07T21:12:32.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.222+0000 7ff8419ed640 1 -- 172.21.15.89:0/2640901621 learned_addr learned my addr 172.21.15.89:0/2640901621 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:12:32.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.222+0000 7ff8419ed640 1 -- 172.21.15.89:0/2640901621 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c009400 con 0x7ff83c0976d0 2023-12-07T21:12:32.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.222+0000 7ff8419ed640 1 --2- 172.21.15.89:0/2640901621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0976d0 0x7ff83c1bfea0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff83800c420 tx=0x7ff83800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:12:32.217 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.222+0000 7ff8327fc640 1 -- 172.21.15.89:0/2640901621 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8380074d0 con 0x7ff83c0976d0 2023-12-07T21:12:32.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.222+0000 7ff8327fc640 1 -- 172.21.15.89:0/2640901621 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff838007630 con 0x7ff83c0976d0 2023-12-07T21:12:32.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.222+0000 7ff843c51640 1 -- 172.21.15.89:0/2640901621 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c08b620 con 0x7ff83c0976d0 2023-12-07T21:12:32.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.222+0000 7ff8327fc640 1 -- 172.21.15.89:0/2640901621 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff838004950 con 0x7ff83c0976d0 2023-12-07T21:12:32.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.223+0000 7ff843c51640 1 -- 172.21.15.89:0/2640901621 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c08d2d0 con 0x7ff83c0976d0 2023-12-07T21:12:32.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.223+0000 7ff8327fc640 1 -- 172.21.15.89:0/2640901621 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7ff838004b70 con 0x7ff83c0976d0 2023-12-07T21:12:32.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.223+0000 7ff843c51640 1 -- 172.21.15.89:0/2640901621 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83c062110 con 0x7ff83c0976d0 2023-12-07T21:12:32.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.224+0000 7ff8327fc640 1 --2- 172.21.15.89:0/2640901621 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8200377d0 0x7ff820039c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:12:32.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.224+0000 7ff8327fc640 1 -- 172.21.15.89:0/2640901621 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7ff83804a1c0 con 0x7ff83c0976d0 2023-12-07T21:12:32.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.224+0000 7ff8411ec640 1 --2- 172.21.15.89:0/2640901621 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8200377d0 0x7ff820039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:12:32.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.224+0000 7ff8411ec640 1 --2- 172.21.15.89:0/2640901621 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8200377d0 0x7ff820039c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff82c036000 tx=0x7ff82c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:12:32.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.228+0000 7ff8327fc640 1 -- 172.21.15.89:0/2640901621 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff83801ab40 con 0x7ff83c0976d0 2023-12-07T21:12:32.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.395+0000 7ff843c51640 1 -- 172.21.15.89:0/2640901621 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff83c06f010 con 0x7ff8200377d0 2023-12-07T21:12:32.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.411+0000 7ff8327fc640 1 -- 172.21.15.89:0/2640901621 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+669251 (secure 0 0 0) 0x7ff82c031b40 con 0x7ff8200377d0 2023-12-07T21:12:32.409 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:12:32.414 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:12:32.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.415+0000 7ff843c51640 1 -- 172.21.15.89:0/2640901621 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8200377d0 msgr2=0x7ff820039c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:32.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.415+0000 7ff843c51640 1 --2- 172.21.15.89:0/2640901621 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8200377d0 0x7ff820039c90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff82c036000 tx=0x7ff82c008030 comp rx=0 tx=0).stop 2023-12-07T21:12:32.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.415+0000 7ff843c51640 1 -- 172.21.15.89:0/2640901621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0976d0 msgr2=0x7ff83c1bfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:32.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.415+0000 7ff843c51640 1 --2- 172.21.15.89:0/2640901621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0976d0 0x7ff83c1bfea0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ff83800c420 tx=0x7ff83800c8e0 comp rx=0 tx=0).stop 2023-12-07T21:12:32.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.415+0000 7ff843c51640 1 -- 172.21.15.89:0/2640901621 shutdown_connections 2023-12-07T21:12:32.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.415+0000 7ff843c51640 1 --2- 172.21.15.89:0/2640901621 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7ff8200377d0 0x7ff820039c90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:12:32.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.415+0000 7ff843c51640 1 --2- 172.21.15.89:0/2640901621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0976d0 0x7ff83c1bfea0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:12:32.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.415+0000 7ff843c51640 1 -- 172.21.15.89:0/2640901621 >> 172.21.15.89:0/2640901621 conn(0x7ff83c0987f0 msgr2=0x7ff83c1250f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:12:32.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.416+0000 7ff843c51640 1 -- 172.21.15.89:0/2640901621 shutdown_connections 2023-12-07T21:12:32.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:32.416+0000 7ff843c51640 1 -- 172.21.15.89:0/2640901621 wait complete. 2023-12-07T21:12:32.419 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-12-07T21:12:32.116458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3969,"ondisk_log_size":3969,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004204"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807400+0000","last_change":"2023-12-07T21:08:54.882968+0000","last_active":"2023-12-07T21:11:03.807400+0000","last_peered":"2023-12-07T21:11:03.807400+0000","last_clean":"2023-12-07T21:11:03.807400+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:11:03.807400+0000","last_undegraded":"2023-12-07T21:11:03.807400+0000","last_fullsized":"2023-12-07T21:11:03.807400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.407237+0000","last_change":"2023-12-07T21:12:16.407256+0000","last_active":"2023-12-07T21:12:16.407237+0000","last_peered":"2023-12-07T21:12:16.407237+0000","last_clean":"2023-12-07T21:12:16.407237+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:12:16.407237+0000","last_undegraded":"2023-12-07T21:12:16.407237+0000","last_fullsized":"2023-12-07T21:12:16.407237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.407151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:53.647151+0000","scrub_duration":0.00097124400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801438+0000","last_change":"2023-12-07T21:08:54.890832+0000","last_active":"2023-12-07T21:11:03.801438+0000","last_peered":"2023-12-07T21:11:03.801438+0000","last_clean":"2023-12-07T21:11:03.801438+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:11:03.801438+0000","last_undegraded":"2023-12-07T21:11:03.801438+0000","last_fullsized":"2023-12-07T21:11:03.801438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345425+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:11:09.345425+0000","last_peered":"2023-12-07T21:11:09.345425+0000","last_clean":"2023-12-07T21:11:09.345425+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:11:09.345425+0000","last_undegraded":"2023-12-07T21:11:09.345425+0000","last_fullsized":"2023-12-07T21:11:09.345425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808550+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:11:03.808550+0000","last_peered":"2023-12-07T21:11:03.808550+0000","last_clean":"2023-12-07T21:11:03.808550+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:11:03.808550+0000","last_undegraded":"2023-12-07T21:11:03.808550+0000","last_fullsized":"2023-12-07T21:11:03.808550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608236+0000","last_change":"2023-12-07T21:08:56.873919+0000","last_active":"2023-12-07T21:11:10.608236+0000","last_peered":"2023-12-07T21:11:10.608236+0000","last_clean":"2023-12-07T21:11:10.608236+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:11:10.608236+0000","last_undegraded":"2023-12-07T21:11:10.608236+0000","last_fullsized":"2023-12-07T21:11:10.608236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.805663+0000","last_change":"2023-12-07T21:08:54.880442+0000","last_active":"2023-12-07T21:10:58.805663+0000","last_peered":"2023-12-07T21:10:58.805663+0000","last_clean":"2023-12-07T21:10:58.805663+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:10:58.805663+0000","last_undegraded":"2023-12-07T21:10:58.805663+0000","last_fullsized":"2023-12-07T21:10:58.805663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608264+0000","last_change":"2023-12-07T21:08:56.874751+0000","last_active":"2023-12-07T21:11:10.608264+0000","last_peered":"2023-12-07T21:11:10.608264+0000","last_clean":"2023-12-07T21:11:10.608264+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:11:10.608264+0000","last_undegraded":"2023-12-07T21:11:10.608264+0000","last_fullsized":"2023-12-07T21:11:10.608264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607907+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:11:10.607907+0000","last_peered":"2023-12-07T21:11:10.607907+0000","last_clean":"2023-12-07T21:11:10.607907+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:11:10.607907+0000","last_undegraded":"2023-12-07T21:11:10.607907+0000","last_fullsized":"2023-12-07T21:11:10.607907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:59.173605+0000","last_change":"2023-12-07T21:08:56.873414+0000","last_active":"2023-12-07T21:10:59.173605+0000","last_peered":"2023-12-07T21:10:59.173605+0000","last_clean":"2023-12-07T21:10:59.173605+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:10:59.173605+0000","last_undegraded":"2023-12-07T21:10:59.173605+0000","last_fullsized":"2023-12-07T21:10:59.173605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187656+0000","last_change":"2023-12-07T21:08:54.880274+0000","last_active":"2023-12-07T21:11:10.187656+0000","last_peered":"2023-12-07T21:11:10.187656+0000","last_clean":"2023-12-07T21:11:10.187656+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:11:10.187656+0000","last_undegraded":"2023-12-07T21:11:10.187656+0000","last_fullsized":"2023-12-07T21:11:10.187656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187892+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:11:10.187892+0000","last_peered":"2023-12-07T21:11:10.187892+0000","last_clean":"2023-12-07T21:11:10.187892+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:11:10.187892+0000","last_undegraded":"2023-12-07T21:11:10.187892+0000","last_fullsized":"2023-12-07T21:11:10.187892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607886+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:11:10.607886+0000","last_peered":"2023-12-07T21:11:10.607886+0000","last_clean":"2023-12-07T21:11:10.607886+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:11:10.607886+0000","last_undegraded":"2023-12-07T21:11:10.607886+0000","last_fullsized":"2023-12-07T21:11:10.607886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807323+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:11:03.807323+0000","last_peered":"2023-12-07T21:11:03.807323+0000","last_clean":"2023-12-07T21:11:03.807323+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:11:03.807323+0000","last_undegraded":"2023-12-07T21:11:03.807323+0000","last_fullsized":"2023-12-07T21:11:03.807323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345133+0000","last_change":"2023-12-07T21:08:54.891021+0000","last_active":"2023-12-07T21:11:09.345133+0000","last_peered":"2023-12-07T21:11:09.345133+0000","last_clean":"2023-12-07T21:11:09.345133+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:11:09.345133+0000","last_undegraded":"2023-12-07T21:11:09.345133+0000","last_fullsized":"2023-12-07T21:11:09.345133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'13","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807362+0000","last_change":"2023-12-07T21:08:56.874321+0000","last_active":"2023-12-07T21:11:03.807362+0000","last_peered":"2023-12-07T21:11:03.807362+0000","last_clean":"2023-12-07T21:11:03.807362+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:11:03.807362+0000","last_undegraded":"2023-12-07T21:11:03.807362+0000","last_fullsized":"2023-12-07T21:11:03.807362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608172+0000","last_change":"2023-12-07T21:08:56.874409+0000","last_active":"2023-12-07T21:11:10.608172+0000","last_peered":"2023-12-07T21:11:10.608172+0000","last_clean":"2023-12-07T21:11:10.608172+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:11:10.608172+0000","last_undegraded":"2023-12-07T21:11:10.608172+0000","last_fullsized":"2023-12-07T21:11:10.608172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766655+0000","last_change":"2023-12-07T21:08:54.887766+0000","last_active":"2023-12-07T21:11:09.766655+0000","last_peered":"2023-12-07T21:11:09.766655+0000","last_clean":"2023-12-07T21:11:09.766655+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:11:09.766655+0000","last_undegraded":"2023-12-07T21:11:09.766655+0000","last_fullsized":"2023-12-07T21:11:09.766655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766942+0000","last_change":"2023-12-07T21:08:56.876692+0000","last_active":"2023-12-07T21:11:09.766942+0000","last_peered":"2023-12-07T21:11:09.766942+0000","last_clean":"2023-12-07T21:11:09.766942+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:11:09.766942+0000","last_undegraded":"2023-12-07T21:11:09.766942+0000","last_fullsized":"2023-12-07T21:11:09.766942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187817+0000","last_change":"2023-12-07T21:08:54.885605+0000","last_active":"2023-12-07T21:11:10.187817+0000","last_peered":"2023-12-07T21:11:10.187817+0000","last_clean":"2023-12-07T21:11:10.187817+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:11:10.187817+0000","last_undegraded":"2023-12-07T21:11:10.187817+0000","last_fullsized":"2023-12-07T21:11:10.187817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'13","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766969+0000","last_change":"2023-12-07T21:08:56.882602+0000","last_active":"2023-12-07T21:11:09.766969+0000","last_peered":"2023-12-07T21:11:09.766969+0000","last_clean":"2023-12-07T21:11:09.766969+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:11:09.766969+0000","last_undegraded":"2023-12-07T21:11:09.766969+0000","last_fullsized":"2023-12-07T21:11:09.766969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766621+0000","last_change":"2023-12-07T21:08:54.889812+0000","last_active":"2023-12-07T21:11:09.766621+0000","last_peered":"2023-12-07T21:11:09.766621+0000","last_clean":"2023-12-07T21:11:09.766621+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:11:09.766621+0000","last_undegraded":"2023-12-07T21:11:09.766621+0000","last_fullsized":"2023-12-07T21:11:09.766621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345375+0000","last_change":"2023-12-07T21:08:56.875989+0000","last_active":"2023-12-07T21:11:09.345375+0000","last_peered":"2023-12-07T21:11:09.345375+0000","last_clean":"2023-12-07T21:11:09.345375+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:11:09.345375+0000","last_undegraded":"2023-12-07T21:11:09.345375+0000","last_fullsized":"2023-12-07T21:11:09.345375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766605+0000","last_change":"2023-12-07T21:08:54.878784+0000","last_active":"2023-12-07T21:11:09.766605+0000","last_peered":"2023-12-07T21:11:09.766605+0000","last_clean":"2023-12-07T21:11:09.766605+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:11:09.766605+0000","last_undegraded":"2023-12-07T21:11:09.766605+0000","last_fullsized":"2023-12-07T21:11:09.766605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187888+0000","last_change":"2023-12-07T21:08:56.875039+0000","last_active":"2023-12-07T21:11:10.187888+0000","last_peered":"2023-12-07T21:11:10.187888+0000","last_clean":"2023-12-07T21:11:10.187888+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:11:10.187888+0000","last_undegraded":"2023-12-07T21:11:10.187888+0000","last_fullsized":"2023-12-07T21:11:10.187888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345261+0000","last_change":"2023-12-07T21:08:54.890574+0000","last_active":"2023-12-07T21:11:09.345261+0000","last_peered":"2023-12-07T21:11:09.345261+0000","last_clean":"2023-12-07T21:11:09.345261+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:11:09.345261+0000","last_undegraded":"2023-12-07T21:11:09.345261+0000","last_fullsized":"2023-12-07T21:11:09.345261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.336912+0000","last_change":"2023-12-07T21:12:23.336936+0000","last_active":"2023-12-07T21:12:23.336912+0000","last_peered":"2023-12-07T21:12:23.336912+0000","last_clean":"2023-12-07T21:12:23.336912+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:12:23.336912+0000","last_undegraded":"2023-12-07T21:12:23.336912+0000","last_fullsized":"2023-12-07T21:12:23.336912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.336820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:54.775680+0000","scrub_duration":0.0015463409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607871+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:11:10.607871+0000","last_peered":"2023-12-07T21:11:10.607871+0000","last_clean":"2023-12-07T21:11:10.607871+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:11:10.607871+0000","last_undegraded":"2023-12-07T21:11:10.607871+0000","last_fullsized":"2023-12-07T21:11:10.607871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767525+0000","last_change":"2023-12-07T21:09:04.931981+0000","last_active":"2023-12-07T21:11:09.767525+0000","last_peered":"2023-12-07T21:11:09.767525+0000","last_clean":"2023-12-07T21:11:09.767525+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:11:09.767525+0000","last_undegraded":"2023-12-07T21:11:09.767525+0000","last_fullsized":"2023-12-07T21:11:09.767525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.461393+0000","last_change":"2023-12-07T21:12:20.461414+0000","last_active":"2023-12-07T21:12:20.461393+0000","last_peered":"2023-12-07T21:12:20.461393+0000","last_clean":"2023-12-07T21:12:20.461393+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:12:20.461393+0000","last_undegraded":"2023-12-07T21:12:20.461393+0000","last_fullsized":"2023-12-07T21:12:20.461393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.461275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:11:30.745289+0000","scrub_duration":0.0012528039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607680+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:11:10.607680+0000","last_peered":"2023-12-07T21:11:10.607680+0000","last_clean":"2023-12-07T21:11:10.607680+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:11:10.607680+0000","last_undegraded":"2023-12-07T21:11:10.607680+0000","last_fullsized":"2023-12-07T21:11:10.607680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.797174+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:12.797174+0000","last_peered":"2023-12-07T21:11:12.797174+0000","last_clean":"2023-12-07T21:11:12.797174+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:12.797174+0000","last_undegraded":"2023-12-07T21:11:12.797174+0000","last_fullsized":"2023-12-07T21:11:12.797174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'31","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608625+0000","last_change":"2023-12-07T21:09:00.895835+0000","last_active":"2023-12-07T21:11:10.608625+0000","last_peered":"2023-12-07T21:11:10.608625+0000","last_clean":"2023-12-07T21:11:10.608625+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:11:10.608625+0000","last_undegraded":"2023-12-07T21:11:10.608625+0000","last_fullsized":"2023-12-07T21:11:10.608625+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.345063+0000","last_change":"2023-12-07T21:12:18.345086+0000","last_active":"2023-12-07T21:12:18.345063+0000","last_peered":"2023-12-07T21:12:18.345063+0000","last_clean":"2023-12-07T21:12:18.345063+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:12:18.345063+0000","last_undegraded":"2023-12-07T21:12:18.345063+0000","last_fullsized":"2023-12-07T21:12:18.345063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.344968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:53:47.984483+0000","scrub_duration":0.00095218699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:26.318801+0000","last_change":"2023-12-07T21:12:26.318843+0000","last_active":"2023-12-07T21:12:26.318801+0000","last_peered":"2023-12-07T21:12:26.318801+0000","last_clean":"2023-12-07T21:12:26.318801+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:12:26.318801+0000","last_undegraded":"2023-12-07T21:12:26.318801+0000","last_fullsized":"2023-12-07T21:12:26.318801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:26.318685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:21.073203+0000","scrub_duration":0.0010887360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608060+0000","last_change":"2023-12-07T21:08:56.874761+0000","last_active":"2023-12-07T21:11:10.608060+0000","last_peered":"2023-12-07T21:11:10.608060+0000","last_clean":"2023-12-07T21:11:10.608060+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:11:10.608060+0000","last_undegraded":"2023-12-07T21:11:10.608060+0000","last_fullsized":"2023-12-07T21:11:10.608060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880632+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.830062+0000","last_change":"2023-12-07T21:11:53.830085+0000","last_active":"2023-12-07T21:11:53.830062+0000","last_peered":"2023-12-07T21:11:53.830062+0000","last_clean":"2023-12-07T21:11:53.830062+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:53.830062+0000","last_undegraded":"2023-12-07T21:11:53.830062+0000","last_fullsized":"2023-12-07T21:11:53.830062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_clean_scrub_stamp":"2023-12-07T21:11:53.829969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:45.205269+0000","scrub_duration":0.001216066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.053083+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:11.053083+0000","last_peered":"2023-12-07T21:11:11.053083+0000","last_clean":"2023-12-07T21:11:11.053083+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:11.053083+0000","last_undegraded":"2023-12-07T21:11:11.053083+0000","last_fullsized":"2023-12-07T21:11:11.053083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.304118+0000","last_change":"2023-12-07T21:11:42.304137+0000","last_active":"2023-12-07T21:11:42.304118+0000","last_peered":"2023-12-07T21:11:42.304118+0000","last_clean":"2023-12-07T21:11:42.304118+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:42.304118+0000","last_undegraded":"2023-12-07T21:11:42.304118+0000","last_fullsized":"2023-12-07T21:11:42.304118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.304031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:14.639583+0000","scrub_duration":0.0010594929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345945+0000","last_change":"2023-12-07T21:09:04.925464+0000","last_active":"2023-12-07T21:11:09.345945+0000","last_peered":"2023-12-07T21:11:09.345945+0000","last_clean":"2023-12-07T21:11:09.345945+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:11:09.345945+0000","last_undegraded":"2023-12-07T21:11:09.345945+0000","last_fullsized":"2023-12-07T21:11:09.345945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'1","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608112+0000","last_change":"2023-12-07T21:08:56.875484+0000","last_active":"2023-12-07T21:11:10.608112+0000","last_peered":"2023-12-07T21:11:10.608112+0000","last_clean":"2023-12-07T21:11:10.608112+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:11:10.608112+0000","last_undegraded":"2023-12-07T21:11:10.608112+0000","last_fullsized":"2023-12-07T21:11:10.608112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607656+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:11:10.607656+0000","last_peered":"2023-12-07T21:11:10.607656+0000","last_clean":"2023-12-07T21:11:10.607656+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:11:10.607656+0000","last_undegraded":"2023-12-07T21:11:10.607656+0000","last_fullsized":"2023-12-07T21:11:10.607656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.707066+0000","last_change":"2023-12-07T21:11:58.707102+0000","last_active":"2023-12-07T21:11:58.707066+0000","last_peered":"2023-12-07T21:11:58.707066+0000","last_clean":"2023-12-07T21:11:58.707066+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:58.707066+0000","last_undegraded":"2023-12-07T21:11:58.707066+0000","last_fullsized":"2023-12-07T21:11:58.707066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.706965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:56:05.594599+0000","scrub_duration":0.0011023249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.554028+0000","last_change":"2023-12-07T21:11:35.554062+0000","last_active":"2023-12-07T21:11:35.554028+0000","last_peered":"2023-12-07T21:11:35.554028+0000","last_clean":"2023-12-07T21:11:35.554028+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:35.554028+0000","last_undegraded":"2023-12-07T21:11:35.554028+0000","last_fullsized":"2023-12-07T21:11:35.554028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.553946+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:56.699897+0000","scrub_duration":0.0042775269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'246","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608744+0000","last_change":"2023-12-07T21:09:02.906250+0000","last_active":"2023-12-07T21:11:10.608744+0000","last_peered":"2023-12-07T21:11:10.608744+0000","last_clean":"2023-12-07T21:11:10.608744+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:11:10.608744+0000","last_undegraded":"2023-12-07T21:11:10.608744+0000","last_fullsized":"2023-12-07T21:11:10.608744+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188448+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:11:10.188448+0000","last_peered":"2023-12-07T21:11:10.188448+0000","last_clean":"2023-12-07T21:11:10.188448+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:11:10.188448+0000","last_undegraded":"2023-12-07T21:11:10.188448+0000","last_fullsized":"2023-12-07T21:11:10.188448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.764627+0000","last_change":"2023-12-07T21:12:27.764650+0000","last_active":"2023-12-07T21:12:27.764627+0000","last_peered":"2023-12-07T21:12:27.764627+0000","last_clean":"2023-12-07T21:12:27.764627+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:12:27.764627+0000","last_undegraded":"2023-12-07T21:12:27.764627+0000","last_fullsized":"2023-12-07T21:12:27.764627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.764507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:17:01.731572+0000","scrub_duration":0.0015146649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766427+0000","last_change":"2023-12-07T21:08:54.878527+0000","last_active":"2023-12-07T21:11:09.766427+0000","last_peered":"2023-12-07T21:11:09.766427+0000","last_clean":"2023-12-07T21:11:09.766427+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:11:09.766427+0000","last_undegraded":"2023-12-07T21:11:09.766427+0000","last_fullsized":"2023-12-07T21:11:09.766427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.775119+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:14.775119+0000","last_peered":"2023-12-07T21:11:14.775119+0000","last_clean":"2023-12-07T21:11:14.775119+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:14.775119+0000","last_undegraded":"2023-12-07T21:11:14.775119+0000","last_fullsized":"2023-12-07T21:11:14.775119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:29.600052+0000","last_change":"2023-12-07T21:11:29.600086+0000","last_active":"2023-12-07T21:11:29.600052+0000","last_peered":"2023-12-07T21:11:29.600052+0000","last_clean":"2023-12-07T21:11:29.600052+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:29.600052+0000","last_undegraded":"2023-12-07T21:11:29.600052+0000","last_fullsized":"2023-12-07T21:11:29.600052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_clean_scrub_stamp":"2023-12-07T21:11:29.599963+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:30:03.772118+0000","scrub_duration":0.003554771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'247","reported_seq":340,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:02.790438+0000","last_change":"2023-12-07T21:12:02.790465+0000","last_active":"2023-12-07T21:12:02.790438+0000","last_peered":"2023-12-07T21:12:02.790438+0000","last_clean":"2023-12-07T21:12:02.790438+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:12:02.790438+0000","last_undegraded":"2023-12-07T21:12:02.790438+0000","last_fullsized":"2023-12-07T21:12:02.790438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_clean_scrub_stamp":"2023-12-07T21:12:02.790346+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:07.839178+0000","scrub_duration":0.0026089529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809281+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:11:08.809281+0000","last_peered":"2023-12-07T21:11:08.809281+0000","last_clean":"2023-12-07T21:11:08.809281+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:11:08.809281+0000","last_undegraded":"2023-12-07T21:11:08.809281+0000","last_fullsized":"2023-12-07T21:11:08.809281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880253+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.443130+0000","last_change":"2023-12-07T21:11:56.443153+0000","last_active":"2023-12-07T21:11:56.443130+0000","last_peered":"2023-12-07T21:11:56.443130+0000","last_clean":"2023-12-07T21:11:56.443130+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:56.443130+0000","last_undegraded":"2023-12-07T21:11:56.443130+0000","last_fullsized":"2023-12-07T21:11:56.443130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.443045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:05.069384+0000","scrub_duration":0.0010685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.606772+0000","last_change":"2023-12-07T21:11:39.606842+0000","last_active":"2023-12-07T21:11:39.606772+0000","last_peered":"2023-12-07T21:11:39.606772+0000","last_clean":"2023-12-07T21:11:39.606772+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:39.606772+0000","last_undegraded":"2023-12-07T21:11:39.606772+0000","last_fullsized":"2023-12-07T21:11:39.606772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.606684+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:36.950556+0000","scrub_duration":0.0069737849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:34.781691+0000","last_change":"2023-12-07T21:11:34.781711+0000","last_active":"2023-12-07T21:11:34.781691+0000","last_peered":"2023-12-07T21:11:34.781691+0000","last_clean":"2023-12-07T21:11:34.781691+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:34.781691+0000","last_undegraded":"2023-12-07T21:11:34.781691+0000","last_fullsized":"2023-12-07T21:11:34.781691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:34.781604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:44.478780+0000","scrub_duration":0.001255822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188362+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:11:10.188362+0000","last_peered":"2023-12-07T21:11:10.188362+0000","last_clean":"2023-12-07T21:11:10.188362+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:11:10.188362+0000","last_undegraded":"2023-12-07T21:11:10.188362+0000","last_fullsized":"2023-12-07T21:11:10.188362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'21","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808397+0000","last_change":"2023-12-07T21:08:56.871222+0000","last_active":"2023-12-07T21:11:08.808397+0000","last_peered":"2023-12-07T21:11:08.808397+0000","last_clean":"2023-12-07T21:11:08.808397+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:11:08.808397+0000","last_undegraded":"2023-12-07T21:11:08.808397+0000","last_fullsized":"2023-12-07T21:11:08.808397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187590+0000","last_change":"2023-12-07T21:08:54.885249+0000","last_active":"2023-12-07T21:11:10.187590+0000","last_peered":"2023-12-07T21:11:10.187590+0000","last_clean":"2023-12-07T21:11:10.187590+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:11:10.187590+0000","last_undegraded":"2023-12-07T21:11:10.187590+0000","last_fullsized":"2023-12-07T21:11:10.187590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:07.717434+0000","last_change":"2023-12-07T21:12:07.717459+0000","last_active":"2023-12-07T21:12:07.717434+0000","last_peered":"2023-12-07T21:12:07.717434+0000","last_clean":"2023-12-07T21:12:07.717434+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:12:07.717434+0000","last_undegraded":"2023-12-07T21:12:07.717434+0000","last_fullsized":"2023-12-07T21:12:07.717434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_clean_scrub_stamp":"2023-12-07T21:12:07.717342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:32.009926+0000","scrub_duration":0.0014039289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:09.439719+0000","last_change":"2023-12-07T21:12:09.439747+0000","last_active":"2023-12-07T21:12:09.439719+0000","last_peered":"2023-12-07T21:12:09.439719+0000","last_clean":"2023-12-07T21:12:09.439719+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:12:09.439719+0000","last_undegraded":"2023-12-07T21:12:09.439719+0000","last_fullsized":"2023-12-07T21:12:09.439719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_clean_scrub_stamp":"2023-12-07T21:12:09.439641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:19.195035+0000","scrub_duration":0.0043223589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.735445+0000","last_change":"2023-12-07T21:11:33.735466+0000","last_active":"2023-12-07T21:11:33.735445+0000","last_peered":"2023-12-07T21:11:33.735445+0000","last_clean":"2023-12-07T21:11:33.735445+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:33.735445+0000","last_undegraded":"2023-12-07T21:11:33.735445+0000","last_fullsized":"2023-12-07T21:11:33.735445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.735352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:03.972116+0000","scrub_duration":0.0011441929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767437+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:11:09.767437+0000","last_peered":"2023-12-07T21:11:09.767437+0000","last_clean":"2023-12-07T21:11:09.767437+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:11:09.767437+0000","last_undegraded":"2023-12-07T21:11:09.767437+0000","last_fullsized":"2023-12-07T21:11:09.767437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808402+0000","last_change":"2023-12-07T21:08:56.879742+0000","last_active":"2023-12-07T21:11:08.808402+0000","last_peered":"2023-12-07T21:11:08.808402+0000","last_clean":"2023-12-07T21:11:08.808402+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:11:08.808402+0000","last_undegraded":"2023-12-07T21:11:08.808402+0000","last_fullsized":"2023-12-07T21:11:08.808402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607665+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:11:10.607665+0000","last_peered":"2023-12-07T21:11:10.607665+0000","last_clean":"2023-12-07T21:11:10.607665+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:11:10.607665+0000","last_undegraded":"2023-12-07T21:11:10.607665+0000","last_fullsized":"2023-12-07T21:11:10.607665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.810355+0000","last_change":"2023-12-07T21:12:15.810375+0000","last_active":"2023-12-07T21:12:15.810355+0000","last_peered":"2023-12-07T21:12:15.810355+0000","last_clean":"2023-12-07T21:12:15.810355+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:12:15.810355+0000","last_undegraded":"2023-12-07T21:12:15.810355+0000","last_fullsized":"2023-12-07T21:12:15.810355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.810269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:33.566530+0000","scrub_duration":0.0014408579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.522055+0000","last_change":"2023-12-07T21:11:50.522112+0000","last_active":"2023-12-07T21:11:50.522055+0000","last_peered":"2023-12-07T21:11:50.522055+0000","last_clean":"2023-12-07T21:11:50.522055+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:50.522055+0000","last_undegraded":"2023-12-07T21:11:50.522055+0000","last_fullsized":"2023-12-07T21:11:50.522055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.521955+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:04.827943+0000","scrub_duration":0.0073561030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":307,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.761860+0000","last_change":"2023-12-07T21:11:35.761887+0000","last_active":"2023-12-07T21:11:35.761860+0000","last_peered":"2023-12-07T21:11:35.761860+0000","last_clean":"2023-12-07T21:11:35.761860+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:35.761860+0000","last_undegraded":"2023-12-07T21:11:35.761860+0000","last_fullsized":"2023-12-07T21:11:35.761860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.761766+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:14.383149+0000","scrub_duration":0.0016151640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345866+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:11:09.345866+0000","last_peered":"2023-12-07T21:11:09.345866+0000","last_clean":"2023-12-07T21:11:09.345866+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:11:09.345866+0000","last_undegraded":"2023-12-07T21:11:09.345866+0000","last_fullsized":"2023-12-07T21:11:09.345866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187733+0000","last_change":"2023-12-07T21:08:56.870949+0000","last_active":"2023-12-07T21:11:10.187733+0000","last_peered":"2023-12-07T21:11:10.187733+0000","last_clean":"2023-12-07T21:11:10.187733+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:11:10.187733+0000","last_undegraded":"2023-12-07T21:11:10.187733+0000","last_fullsized":"2023-12-07T21:11:10.187733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607649+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:11:10.607649+0000","last_peered":"2023-12-07T21:11:10.607649+0000","last_clean":"2023-12-07T21:11:10.607649+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:11:10.607649+0000","last_undegraded":"2023-12-07T21:11:10.607649+0000","last_fullsized":"2023-12-07T21:11:10.607649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.753680+0000","last_change":"2023-12-07T21:11:55.753724+0000","last_active":"2023-12-07T21:11:55.753680+0000","last_peered":"2023-12-07T21:11:55.753680+0000","last_clean":"2023-12-07T21:11:55.753680+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:55.753680+0000","last_undegraded":"2023-12-07T21:11:55.753680+0000","last_fullsized":"2023-12-07T21:11:55.753680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.753576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:53:37.572475+0000","scrub_duration":0.0013913199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:31.726530+0000","last_change":"2023-12-07T21:11:31.726564+0000","last_active":"2023-12-07T21:11:31.726530+0000","last_peered":"2023-12-07T21:11:31.726530+0000","last_clean":"2023-12-07T21:11:31.726530+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:31.726530+0000","last_undegraded":"2023-12-07T21:11:31.726530+0000","last_fullsized":"2023-12-07T21:11:31.726530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:31.726451+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:36.775283+0000","scrub_duration":0.0038601009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.752542+0000","last_change":"2023-12-07T21:11:56.752564+0000","last_active":"2023-12-07T21:11:56.752542+0000","last_peered":"2023-12-07T21:11:56.752542+0000","last_clean":"2023-12-07T21:11:56.752542+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:56.752542+0000","last_undegraded":"2023-12-07T21:11:56.752542+0000","last_fullsized":"2023-12-07T21:11:56.752542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.752450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:44.261937+0000","scrub_duration":0.0012919610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345867+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:11:09.345867+0000","last_peered":"2023-12-07T21:11:09.345867+0000","last_clean":"2023-12-07T21:11:09.345867+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:11:09.345867+0000","last_undegraded":"2023-12-07T21:11:09.345867+0000","last_fullsized":"2023-12-07T21:11:09.345867+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187760+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:11:10.187760+0000","last_peered":"2023-12-07T21:11:10.187760+0000","last_clean":"2023-12-07T21:11:10.187760+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:11:10.187760+0000","last_undegraded":"2023-12-07T21:11:10.187760+0000","last_fullsized":"2023-12-07T21:11:10.187760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345205+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:11:09.345205+0000","last_peered":"2023-12-07T21:11:09.345205+0000","last_clean":"2023-12-07T21:11:09.345205+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:11:09.345205+0000","last_undegraded":"2023-12-07T21:11:09.345205+0000","last_fullsized":"2023-12-07T21:11:09.345205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.578099+0000","last_change":"2023-12-07T21:12:12.578121+0000","last_active":"2023-12-07T21:12:12.578099+0000","last_peered":"2023-12-07T21:12:12.578099+0000","last_clean":"2023-12-07T21:12:12.578099+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:12:12.578099+0000","last_undegraded":"2023-12-07T21:12:12.578099+0000","last_fullsized":"2023-12-07T21:12:12.578099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.578001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:21:04.951547+0000","scrub_duration":0.0009980639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.222534+0000","last_change":"2023-12-07T21:11:32.222572+0000","last_active":"2023-12-07T21:11:32.222534+0000","last_peered":"2023-12-07T21:11:32.222534+0000","last_clean":"2023-12-07T21:11:32.222534+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:32.222534+0000","last_undegraded":"2023-12-07T21:11:32.222534+0000","last_fullsized":"2023-12-07T21:11:32.222534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.222451+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:29.566323+0000","scrub_duration":0.0042948600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608766+0000","last_change":"2023-12-07T21:09:02.906350+0000","last_active":"2023-12-07T21:11:10.608766+0000","last_peered":"2023-12-07T21:11:10.608766+0000","last_clean":"2023-12-07T21:11:10.608766+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:11:10.608766+0000","last_undegraded":"2023-12-07T21:11:10.608766+0000","last_fullsized":"2023-12-07T21:11:10.608766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809146+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:11:08.809146+0000","last_peered":"2023-12-07T21:11:08.809146+0000","last_clean":"2023-12-07T21:11:08.809146+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:11:08.809146+0000","last_undegraded":"2023-12-07T21:11:08.809146+0000","last_fullsized":"2023-12-07T21:11:08.809146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187764+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:11:10.187764+0000","last_peered":"2023-12-07T21:11:10.187764+0000","last_clean":"2023-12-07T21:11:10.187764+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:11:10.187764+0000","last_undegraded":"2023-12-07T21:11:10.187764+0000","last_fullsized":"2023-12-07T21:11:10.187764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809479+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:11:08.809479+0000","last_peered":"2023-12-07T21:11:08.809479+0000","last_clean":"2023-12-07T21:11:08.809479+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:11:08.809479+0000","last_undegraded":"2023-12-07T21:11:08.809479+0000","last_fullsized":"2023-12-07T21:11:08.809479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:54.784543+0000","last_change":"2023-12-07T21:11:54.784564+0000","last_active":"2023-12-07T21:11:54.784543+0000","last_peered":"2023-12-07T21:11:54.784543+0000","last_clean":"2023-12-07T21:11:54.784543+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:54.784543+0000","last_undegraded":"2023-12-07T21:11:54.784543+0000","last_fullsized":"2023-12-07T21:11:54.784543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_clean_scrub_stamp":"2023-12-07T21:11:54.784441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:06.366596+0000","scrub_duration":0.001044002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.576728+0000","last_change":"2023-12-07T21:11:38.576788+0000","last_active":"2023-12-07T21:11:38.576728+0000","last_peered":"2023-12-07T21:11:38.576728+0000","last_clean":"2023-12-07T21:11:38.576728+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:38.576728+0000","last_undegraded":"2023-12-07T21:11:38.576728+0000","last_fullsized":"2023-12-07T21:11:38.576728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.576637+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:37:48.632379+0000","scrub_duration":0.0068514220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":336,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625017+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625017+0000","last_peered":"2023-12-07T21:11:28.625017+0000","last_clean":"2023-12-07T21:11:28.625017+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625017+0000","last_undegraded":"2023-12-07T21:11:28.625017+0000","last_fullsized":"2023-12-07T21:11:28.625017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.858687+0000","last_change":"2023-12-07T21:12:16.858711+0000","last_active":"2023-12-07T21:12:16.858687+0000","last_peered":"2023-12-07T21:12:16.858687+0000","last_clean":"2023-12-07T21:12:16.858687+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:12:16.858687+0000","last_undegraded":"2023-12-07T21:12:16.858687+0000","last_fullsized":"2023-12-07T21:12:16.858687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.858602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:29:51.847246+0000","scrub_duration":0.0011473449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187852+0000","last_change":"2023-12-07T21:08:56.880261+0000","last_active":"2023-12-07T21:11:10.187852+0000","last_peered":"2023-12-07T21:11:10.187852+0000","last_clean":"2023-12-07T21:11:10.187852+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:11:10.187852+0000","last_undegraded":"2023-12-07T21:11:10.187852+0000","last_fullsized":"2023-12-07T21:11:10.187852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809380+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:11:08.809380+0000","last_peered":"2023-12-07T21:11:08.809380+0000","last_clean":"2023-12-07T21:11:08.809380+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:11:08.809380+0000","last_undegraded":"2023-12-07T21:11:08.809380+0000","last_fullsized":"2023-12-07T21:11:08.809380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.296670+0000","last_change":"2023-12-07T21:11:38.296697+0000","last_active":"2023-12-07T21:11:38.296670+0000","last_peered":"2023-12-07T21:11:38.296670+0000","last_clean":"2023-12-07T21:11:38.296670+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:38.296670+0000","last_undegraded":"2023-12-07T21:11:38.296670+0000","last_fullsized":"2023-12-07T21:11:38.296670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.296568+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:08.533333+0000","scrub_duration":0.0033144630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608582+0000","last_change":"2023-12-07T21:09:00.895566+0000","last_active":"2023-12-07T21:11:10.608582+0000","last_peered":"2023-12-07T21:11:10.608582+0000","last_clean":"2023-12-07T21:11:10.608582+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:11:10.608582+0000","last_undegraded":"2023-12-07T21:11:10.608582+0000","last_fullsized":"2023-12-07T21:11:10.608582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'247","reported_seq":372,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:47.359710+0000","last_change":"2023-12-07T21:11:47.359735+0000","last_active":"2023-12-07T21:11:47.359710+0000","last_peered":"2023-12-07T21:11:47.359710+0000","last_clean":"2023-12-07T21:11:47.359710+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:47.359710+0000","last_undegraded":"2023-12-07T21:11:47.359710+0000","last_fullsized":"2023-12-07T21:11:47.359710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_clean_scrub_stamp":"2023-12-07T21:11:47.359610+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:10.050726+0000","scrub_duration":0.0028663759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.579743+0000","last_change":"2023-12-07T21:12:14.579785+0000","last_active":"2023-12-07T21:12:14.579743+0000","last_peered":"2023-12-07T21:12:14.579743+0000","last_clean":"2023-12-07T21:12:14.579743+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:12:14.579743+0000","last_undegraded":"2023-12-07T21:12:14.579743+0000","last_fullsized":"2023-12-07T21:12:14.579743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.579627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:44.957962+0000","scrub_duration":0.0013656510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.375160+0000","last_change":"2023-12-07T21:12:17.375184+0000","last_active":"2023-12-07T21:12:17.375160+0000","last_peered":"2023-12-07T21:12:17.375160+0000","last_clean":"2023-12-07T21:12:17.375160+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:12:17.375160+0000","last_undegraded":"2023-12-07T21:12:17.375160+0000","last_fullsized":"2023-12-07T21:12:17.375160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.375067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:21:31.008297+0000","scrub_duration":0.001068486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809240+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:11:08.809240+0000","last_peered":"2023-12-07T21:11:08.809240+0000","last_clean":"2023-12-07T21:11:08.809240+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:11:08.809240+0000","last_undegraded":"2023-12-07T21:11:08.809240+0000","last_fullsized":"2023-12-07T21:11:08.809240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.847894+0000","last_change":"2023-12-07T21:11:28.847914+0000","last_active":"2023-12-07T21:11:28.847894+0000","last_peered":"2023-12-07T21:11:28.847894+0000","last_clean":"2023-12-07T21:11:28.847894+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:28.847894+0000","last_undegraded":"2023-12-07T21:11:28.847894+0000","last_fullsized":"2023-12-07T21:11:28.847894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.847797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:20:42.481026+0000","scrub_duration":0.001132973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262716+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262716+0000","last_peered":"2023-12-07T21:11:27.262716+0000","last_clean":"2023-12-07T21:11:27.262716+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262716+0000","last_undegraded":"2023-12-07T21:11:27.262716+0000","last_fullsized":"2023-12-07T21:11:27.262716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.426987+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:14.426987+0000","last_peered":"2023-12-07T21:11:14.426987+0000","last_clean":"2023-12-07T21:11:14.426987+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:14.426987+0000","last_undegraded":"2023-12-07T21:11:14.426987+0000","last_fullsized":"2023-12-07T21:11:14.426987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767450+0000","last_change":"2023-12-07T21:09:04.920277+0000","last_active":"2023-12-07T21:11:09.767450+0000","last_peered":"2023-12-07T21:11:09.767450+0000","last_clean":"2023-12-07T21:11:09.767450+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:11:09.767450+0000","last_undegraded":"2023-12-07T21:11:09.767450+0000","last_fullsized":"2023-12-07T21:11:09.767450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:08.448202+0000","last_change":"2023-12-07T21:12:08.448223+0000","last_active":"2023-12-07T21:12:08.448202+0000","last_peered":"2023-12-07T21:12:08.448202+0000","last_clean":"2023-12-07T21:12:08.448202+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:12:08.448202+0000","last_undegraded":"2023-12-07T21:12:08.448202+0000","last_fullsized":"2023-12-07T21:12:08.448202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_clean_scrub_stamp":"2023-12-07T21:12:08.448115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:53:48.563995+0000","scrub_duration":0.001037821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:43.801827+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:10:43.801827+0000","last_peered":"2023-12-07T21:10:43.801827+0000","last_clean":"2023-12-07T21:10:43.801827+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:10:43.801827+0000","last_undegraded":"2023-12-07T21:10:43.801827+0000","last_fullsized":"2023-12-07T21:10:43.801827+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806332+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:10:53.806332+0000","last_peered":"2023-12-07T21:10:53.806332+0000","last_clean":"2023-12-07T21:10:53.806332+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:10:53.806332+0000","last_undegraded":"2023-12-07T21:10:53.806332+0000","last_fullsized":"2023-12-07T21:10:53.806332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808304+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:11:03.808304+0000","last_peered":"2023-12-07T21:11:03.808304+0000","last_clean":"2023-12-07T21:11:03.808304+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:11:03.808304+0000","last_undegraded":"2023-12-07T21:11:03.808304+0000","last_fullsized":"2023-12-07T21:11:03.808304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.324719+0000","last_change":"2023-12-07T21:11:45.324752+0000","last_active":"2023-12-07T21:11:45.324719+0000","last_peered":"2023-12-07T21:11:45.324719+0000","last_clean":"2023-12-07T21:11:45.324719+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:11:45.324719+0000","last_undegraded":"2023-12-07T21:11:45.324719+0000","last_fullsized":"2023-12-07T21:11:45.324719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.324596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:15.702930+0000","scrub_duration":0.001375037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'79","reported_seq":154,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608522+0000","last_change":"2023-12-07T21:09:00.891338+0000","last_active":"2023-12-07T21:11:10.608522+0000","last_peered":"2023-12-07T21:11:10.608522+0000","last_clean":"2023-12-07T21:11:10.608522+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:11:10.608522+0000","last_undegraded":"2023-12-07T21:11:10.608522+0000","last_fullsized":"2023-12-07T21:11:10.608522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.743690+0000","last_change":"2023-12-07T21:11:42.743712+0000","last_active":"2023-12-07T21:11:42.743690+0000","last_peered":"2023-12-07T21:11:42.743690+0000","last_clean":"2023-12-07T21:11:42.743690+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:42.743690+0000","last_undegraded":"2023-12-07T21:11:42.743690+0000","last_fullsized":"2023-12-07T21:11:42.743690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.743604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:58.016229+0000","scrub_duration":0.001386167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":148,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.433658+0000","last_change":"2023-12-07T21:11:58.433682+0000","last_active":"2023-12-07T21:11:58.433658+0000","last_peered":"2023-12-07T21:11:58.433658+0000","last_clean":"2023-12-07T21:11:58.433658+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:58.433658+0000","last_undegraded":"2023-12-07T21:11:58.433658+0000","last_fullsized":"2023-12-07T21:11:58.433658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.433567+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:08.130743+0000","scrub_duration":0.0014101739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809766+0000","last_change":"2023-12-07T21:08:56.872420+0000","last_active":"2023-12-07T21:11:08.809766+0000","last_peered":"2023-12-07T21:11:08.809766+0000","last_clean":"2023-12-07T21:11:08.809766+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:11:08.809766+0000","last_undegraded":"2023-12-07T21:11:08.809766+0000","last_fullsized":"2023-12-07T21:11:08.809766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:48.804993+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:10:48.804993+0000","last_peered":"2023-12-07T21:10:48.804993+0000","last_clean":"2023-12-07T21:10:48.804993+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:10:48.804993+0000","last_undegraded":"2023-12-07T21:10:48.804993+0000","last_fullsized":"2023-12-07T21:10:48.804993+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800912+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:11:03.800912+0000","last_peered":"2023-12-07T21:11:03.800912+0000","last_clean":"2023-12-07T21:11:03.800912+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:11:03.800912+0000","last_undegraded":"2023-12-07T21:11:03.800912+0000","last_fullsized":"2023-12-07T21:11:03.800912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.687459+0000","last_change":"2023-12-07T21:11:32.687480+0000","last_active":"2023-12-07T21:11:32.687459+0000","last_peered":"2023-12-07T21:11:32.687459+0000","last_clean":"2023-12-07T21:11:32.687459+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:32.687459+0000","last_undegraded":"2023-12-07T21:11:32.687459+0000","last_fullsized":"2023-12-07T21:11:32.687459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.687375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:18:45.906213+0000","scrub_duration":0.001283024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":450,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148355+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148355+0000","last_peered":"2023-12-07T21:11:18.148355+0000","last_clean":"2023-12-07T21:11:18.148355+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148355+0000","last_undegraded":"2023-12-07T21:11:18.148355+0000","last_fullsized":"2023-12-07T21:11:18.148355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:25.481129+0000","last_change":"2023-12-07T21:12:25.481161+0000","last_active":"2023-12-07T21:12:25.481129+0000","last_peered":"2023-12-07T21:12:25.481129+0000","last_clean":"2023-12-07T21:12:25.481129+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:12:25.481129+0000","last_undegraded":"2023-12-07T21:12:25.481129+0000","last_fullsized":"2023-12-07T21:12:25.481129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_clean_scrub_stamp":"2023-12-07T21:12:25.481005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:33:44.071058+0000","scrub_duration":0.001267064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767469+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:11:09.767469+0000","last_peered":"2023-12-07T21:11:09.767469+0000","last_clean":"2023-12-07T21:11:09.767469+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:11:09.767469+0000","last_undegraded":"2023-12-07T21:11:09.767469+0000","last_fullsized":"2023-12-07T21:11:09.767469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802682+0000","last_change":"2023-12-07T21:08:56.883281+0000","last_active":"2023-12-07T21:11:08.802682+0000","last_peered":"2023-12-07T21:11:08.802682+0000","last_clean":"2023-12-07T21:11:08.802682+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:11:08.802682+0000","last_undegraded":"2023-12-07T21:11:08.802682+0000","last_fullsized":"2023-12-07T21:11:08.802682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.804204+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:10:53.804204+0000","last_peered":"2023-12-07T21:10:53.804204+0000","last_clean":"2023-12-07T21:10:53.804204+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:10:53.804204+0000","last_undegraded":"2023-12-07T21:10:53.804204+0000","last_fullsized":"2023-12-07T21:10:53.804204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.799875+0000","last_change":"2023-12-07T21:08:54.881937+0000","last_active":"2023-12-07T21:10:58.799875+0000","last_peered":"2023-12-07T21:10:58.799875+0000","last_clean":"2023-12-07T21:10:58.799875+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:10:58.799875+0000","last_undegraded":"2023-12-07T21:10:58.799875+0000","last_fullsized":"2023-12-07T21:10:58.799875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.627959+0000","last_change":"2023-12-07T21:12:15.627991+0000","last_active":"2023-12-07T21:12:15.627959+0000","last_peered":"2023-12-07T21:12:15.627959+0000","last_clean":"2023-12-07T21:12:15.627959+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:12:15.627959+0000","last_undegraded":"2023-12-07T21:12:15.627959+0000","last_fullsized":"2023-12-07T21:12:15.627959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.627865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:38.318981+0000","scrub_duration":0.0028926030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'25","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:46.537878+0000","last_change":"2023-12-07T21:11:46.537922+0000","last_active":"2023-12-07T21:11:46.537878+0000","last_peered":"2023-12-07T21:11:46.537878+0000","last_clean":"2023-12-07T21:11:46.537878+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:46.537878+0000","last_undegraded":"2023-12-07T21:11:46.537878+0000","last_fullsized":"2023-12-07T21:11:46.537878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_clean_scrub_stamp":"2023-12-07T21:11:46.537795+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:57.338431+0000","scrub_duration":0.0057357379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642676+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642676+0000","last_peered":"2023-12-07T21:11:12.642676+0000","last_clean":"2023-12-07T21:11:12.642676+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642676+0000","last_undegraded":"2023-12-07T21:11:12.642676+0000","last_fullsized":"2023-12-07T21:11:12.642676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608815+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:11:10.608815+0000","last_peered":"2023-12-07T21:11:10.608815+0000","last_clean":"2023-12-07T21:11:10.608815+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:11:10.608815+0000","last_undegraded":"2023-12-07T21:11:10.608815+0000","last_fullsized":"2023-12-07T21:11:10.608815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801285+0000","last_change":"2023-12-07T21:08:56.872455+0000","last_active":"2023-12-07T21:11:03.801285+0000","last_peered":"2023-12-07T21:11:03.801285+0000","last_clean":"2023-12-07T21:11:03.801285+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:11:03.801285+0000","last_undegraded":"2023-12-07T21:11:03.801285+0000","last_fullsized":"2023-12-07T21:11:03.801285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806222+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:10:53.806222+0000","last_peered":"2023-12-07T21:10:53.806222+0000","last_clean":"2023-12-07T21:10:53.806222+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:10:53.806222+0000","last_undegraded":"2023-12-07T21:10:53.806222+0000","last_fullsized":"2023-12-07T21:10:53.806222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806975+0000","last_change":"2023-12-07T21:08:54.880674+0000","last_active":"2023-12-07T21:11:03.806975+0000","last_peered":"2023-12-07T21:11:03.806975+0000","last_clean":"2023-12-07T21:11:03.806975+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:11:03.806975+0000","last_undegraded":"2023-12-07T21:11:03.806975+0000","last_fullsized":"2023-12-07T21:11:03.806975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:57.727189+0000","last_change":"2023-12-07T21:11:57.727223+0000","last_active":"2023-12-07T21:11:57.727189+0000","last_peered":"2023-12-07T21:11:57.727189+0000","last_clean":"2023-12-07T21:11:57.727189+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:11:57.727189+0000","last_undegraded":"2023-12-07T21:11:57.727189+0000","last_fullsized":"2023-12-07T21:11:57.727189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_clean_scrub_stamp":"2023-12-07T21:11:57.727085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:53.015740+0000","scrub_duration":0.0013430639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608529+0000","last_change":"2023-12-07T21:09:00.892022+0000","last_active":"2023-12-07T21:11:10.608529+0000","last_peered":"2023-12-07T21:11:10.608529+0000","last_clean":"2023-12-07T21:11:10.608529+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:11:10.608529+0000","last_undegraded":"2023-12-07T21:11:10.608529+0000","last_fullsized":"2023-12-07T21:11:10.608529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608704+0000","last_change":"2023-12-07T21:09:02.907037+0000","last_active":"2023-12-07T21:11:10.608704+0000","last_peered":"2023-12-07T21:11:10.608704+0000","last_clean":"2023-12-07T21:11:10.608704+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:11:10.608704+0000","last_undegraded":"2023-12-07T21:11:10.608704+0000","last_fullsized":"2023-12-07T21:11:10.608704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767468+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:11:09.767468+0000","last_peered":"2023-12-07T21:11:09.767468+0000","last_clean":"2023-12-07T21:11:09.767468+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:11:09.767468+0000","last_undegraded":"2023-12-07T21:11:09.767468+0000","last_fullsized":"2023-12-07T21:11:09.767468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806997+0000","last_change":"2023-12-07T21:08:56.882954+0000","last_active":"2023-12-07T21:11:03.806997+0000","last_peered":"2023-12-07T21:11:03.806997+0000","last_clean":"2023-12-07T21:11:03.806997+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:11:03.806997+0000","last_undegraded":"2023-12-07T21:11:03.806997+0000","last_fullsized":"2023-12-07T21:11:03.806997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807157+0000","last_change":"2023-12-07T21:08:54.881143+0000","last_active":"2023-12-07T21:11:03.807157+0000","last_peered":"2023-12-07T21:11:03.807157+0000","last_clean":"2023-12-07T21:11:03.807157+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:11:03.807157+0000","last_undegraded":"2023-12-07T21:11:03.807157+0000","last_fullsized":"2023-12-07T21:11:03.807157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.799061+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:10:53.799061+0000","last_peered":"2023-12-07T21:10:53.799061+0000","last_clean":"2023-12-07T21:10:53.799061+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:10:53.799061+0000","last_undegraded":"2023-12-07T21:10:53.799061+0000","last_fullsized":"2023-12-07T21:10:53.799061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.771922+0000","last_change":"2023-12-07T21:12:11.771944+0000","last_active":"2023-12-07T21:12:11.771922+0000","last_peered":"2023-12-07T21:12:11.771922+0000","last_clean":"2023-12-07T21:12:11.771922+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:12:11.771922+0000","last_undegraded":"2023-12-07T21:12:11.771922+0000","last_fullsized":"2023-12-07T21:12:11.771922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.771816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:43.210676+0000","scrub_duration":0.0013479799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'72","reported_seq":141,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.762966+0000","last_change":"2023-12-07T21:11:45.763012+0000","last_active":"2023-12-07T21:11:45.762966+0000","last_peered":"2023-12-07T21:11:45.762966+0000","last_clean":"2023-12-07T21:11:45.762966+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:45.762966+0000","last_undegraded":"2023-12-07T21:11:45.762966+0000","last_fullsized":"2023-12-07T21:11:45.762966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.762875+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:27:47.809323+0000","scrub_duration":0.006706058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594393+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594393+0000","last_peered":"2023-12-07T21:11:25.594393+0000","last_clean":"2023-12-07T21:11:25.594393+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594393+0000","last_undegraded":"2023-12-07T21:11:25.594393+0000","last_fullsized":"2023-12-07T21:11:25.594393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345934+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:11:09.345934+0000","last_peered":"2023-12-07T21:11:09.345934+0000","last_clean":"2023-12-07T21:11:09.345934+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:11:09.345934+0000","last_undegraded":"2023-12-07T21:11:09.345934+0000","last_fullsized":"2023-12-07T21:11:09.345934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807102+0000","last_change":"2023-12-07T21:08:56.878924+0000","last_active":"2023-12-07T21:11:03.807102+0000","last_peered":"2023-12-07T21:11:03.807102+0000","last_clean":"2023-12-07T21:11:03.807102+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:11:03.807102+0000","last_undegraded":"2023-12-07T21:11:03.807102+0000","last_fullsized":"2023-12-07T21:11:03.807102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801254+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:11:03.801254+0000","last_peered":"2023-12-07T21:11:03.801254+0000","last_clean":"2023-12-07T21:11:03.801254+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:11:03.801254+0000","last_undegraded":"2023-12-07T21:11:03.801254+0000","last_fullsized":"2023-12-07T21:11:03.801254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806441+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:10:53.806441+0000","last_peered":"2023-12-07T21:10:53.806441+0000","last_clean":"2023-12-07T21:10:53.806441+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:10:53.806441+0000","last_undegraded":"2023-12-07T21:10:53.806441+0000","last_fullsized":"2023-12-07T21:10:53.806441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.626455+0000","last_change":"2023-12-07T21:11:42.626478+0000","last_active":"2023-12-07T21:11:42.626455+0000","last_peered":"2023-12-07T21:11:42.626455+0000","last_clean":"2023-12-07T21:11:42.626455+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:11:42.626455+0000","last_undegraded":"2023-12-07T21:11:42.626455+0000","last_fullsized":"2023-12-07T21:11:42.626455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.626356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:23.689571+0000","scrub_duration":0.001348258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.225002+0000","last_change":"2023-12-07T21:11:33.225043+0000","last_active":"2023-12-07T21:11:33.225002+0000","last_peered":"2023-12-07T21:11:33.225002+0000","last_clean":"2023-12-07T21:11:33.225002+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:33.225002+0000","last_undegraded":"2023-12-07T21:11:33.225002+0000","last_fullsized":"2023-12-07T21:11:33.225002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.224920+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:12.396025+0000","scrub_duration":0.0049945800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":300,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.065927+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:11:20.065927+0000","last_peered":"2023-12-07T21:11:20.065927+0000","last_clean":"2023-12-07T21:11:20.065927+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:20.065927+0000","last_undegraded":"2023-12-07T21:11:20.065927+0000","last_fullsized":"2023-12-07T21:11:20.065927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608840+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:11:10.608840+0000","last_peered":"2023-12-07T21:11:10.608840+0000","last_clean":"2023-12-07T21:11:10.608840+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:11:10.608840+0000","last_undegraded":"2023-12-07T21:11:10.608840+0000","last_fullsized":"2023-12-07T21:11:10.608840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.807179+0000","last_change":"2023-12-07T21:08:56.887962+0000","last_active":"2023-12-07T21:10:58.807179+0000","last_peered":"2023-12-07T21:10:58.807179+0000","last_clean":"2023-12-07T21:10:58.807179+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:10:58.807179+0000","last_undegraded":"2023-12-07T21:10:58.807179+0000","last_fullsized":"2023-12-07T21:10:58.807179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809841+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:11:08.809841+0000","last_peered":"2023-12-07T21:11:08.809841+0000","last_clean":"2023-12-07T21:11:08.809841+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:11:08.809841+0000","last_undegraded":"2023-12-07T21:11:08.809841+0000","last_fullsized":"2023-12-07T21:11:08.809841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800250+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:10:58.800250+0000","last_peered":"2023-12-07T21:10:58.800250+0000","last_clean":"2023-12-07T21:10:58.800250+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:10:58.800250+0000","last_undegraded":"2023-12-07T21:10:58.800250+0000","last_fullsized":"2023-12-07T21:10:58.800250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.865875+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:11:18.865875+0000","last_peered":"2023-12-07T21:11:18.865875+0000","last_clean":"2023-12-07T21:11:18.865875+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:11:18.865875+0000","last_undegraded":"2023-12-07T21:11:18.865875+0000","last_fullsized":"2023-12-07T21:11:18.865875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809460+0000","last_change":"2023-12-07T21:09:00.896503+0000","last_active":"2023-12-07T21:11:08.809460+0000","last_peered":"2023-12-07T21:11:08.809460+0000","last_clean":"2023-12-07T21:11:08.809460+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:11:08.809460+0000","last_undegraded":"2023-12-07T21:11:08.809460+0000","last_fullsized":"2023-12-07T21:11:08.809460+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":368,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712206+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712206+0000","last_peered":"2023-12-07T21:11:18.712206+0000","last_clean":"2023-12-07T21:11:18.712206+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712206+0000","last_undegraded":"2023-12-07T21:11:18.712206+0000","last_fullsized":"2023-12-07T21:11:18.712206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767478+0000","last_change":"2023-12-07T21:09:04.929420+0000","last_active":"2023-12-07T21:11:09.767478+0000","last_peered":"2023-12-07T21:11:09.767478+0000","last_clean":"2023-12-07T21:11:09.767478+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:11:09.767478+0000","last_undegraded":"2023-12-07T21:11:09.767478+0000","last_fullsized":"2023-12-07T21:11:09.767478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806772+0000","last_change":"2023-12-07T21:08:56.874336+0000","last_active":"2023-12-07T21:11:03.806772+0000","last_peered":"2023-12-07T21:11:03.806772+0000","last_clean":"2023-12-07T21:11:03.806772+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:11:03.806772+0000","last_undegraded":"2023-12-07T21:11:03.806772+0000","last_fullsized":"2023-12-07T21:11:03.806772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808876+0000","last_change":"2023-12-07T21:08:54.888557+0000","last_active":"2023-12-07T21:11:08.808876+0000","last_peered":"2023-12-07T21:11:08.808876+0000","last_clean":"2023-12-07T21:11:08.808876+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:11:08.808876+0000","last_undegraded":"2023-12-07T21:11:08.808876+0000","last_fullsized":"2023-12-07T21:11:08.808876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.807661+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:10:58.807661+0000","last_peered":"2023-12-07T21:10:58.807661+0000","last_clean":"2023-12-07T21:10:58.807661+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:10:58.807661+0000","last_undegraded":"2023-12-07T21:10:58.807661+0000","last_fullsized":"2023-12-07T21:10:58.807661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:37.651284+0000","last_change":"2023-12-07T21:11:37.651334+0000","last_active":"2023-12-07T21:11:37.651284+0000","last_peered":"2023-12-07T21:11:37.651284+0000","last_clean":"2023-12-07T21:11:37.651284+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:11:37.651284+0000","last_undegraded":"2023-12-07T21:11:37.651284+0000","last_fullsized":"2023-12-07T21:11:37.651284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_clean_scrub_stamp":"2023-12-07T21:11:37.651191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:09.090050+0000","scrub_duration":0.0012443790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'94","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:05.544462+0000","last_change":"2023-12-07T21:12:05.544503+0000","last_active":"2023-12-07T21:12:05.544462+0000","last_peered":"2023-12-07T21:12:05.544462+0000","last_clean":"2023-12-07T21:12:05.544462+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:12:05.544462+0000","last_undegraded":"2023-12-07T21:12:05.544462+0000","last_fullsized":"2023-12-07T21:12:05.544462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'94","last_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_deep_scrub":"33'94","last_deep_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_clean_scrub_stamp":"2023-12-07T21:12:05.544369+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:32:13.323537+0000","scrub_duration":0.006343095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.831630+0000","last_change":"2023-12-07T21:11:52.831678+0000","last_active":"2023-12-07T21:11:52.831630+0000","last_peered":"2023-12-07T21:11:52.831630+0000","last_clean":"2023-12-07T21:11:52.831630+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:52.831630+0000","last_undegraded":"2023-12-07T21:11:52.831630+0000","last_fullsized":"2023-12-07T21:11:52.831630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.831531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:22.265020+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188437+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:11:10.188437+0000","last_peered":"2023-12-07T21:11:10.188437+0000","last_clean":"2023-12-07T21:11:10.188437+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:11:10.188437+0000","last_undegraded":"2023-12-07T21:11:10.188437+0000","last_fullsized":"2023-12-07T21:11:10.188437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.528399+0000","last_change":"2023-12-07T21:12:23.528421+0000","last_active":"2023-12-07T21:12:23.528399+0000","last_peered":"2023-12-07T21:12:23.528399+0000","last_clean":"2023-12-07T21:12:23.528399+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:12:23.528399+0000","last_undegraded":"2023-12-07T21:12:23.528399+0000","last_fullsized":"2023-12-07T21:12:23.528399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.528299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:52.961788+0000","scrub_duration":0.00098274400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187815+0000","last_change":"2023-12-07T21:08:56.877160+0000","last_active":"2023-12-07T21:11:10.187815+0000","last_peered":"2023-12-07T21:11:10.187815+0000","last_clean":"2023-12-07T21:11:10.187815+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:11:10.187815+0000","last_undegraded":"2023-12-07T21:11:10.187815+0000","last_fullsized":"2023-12-07T21:11:10.187815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607705+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:11:10.607705+0000","last_peered":"2023-12-07T21:11:10.607705+0000","last_clean":"2023-12-07T21:11:10.607705+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:11:10.607705+0000","last_undegraded":"2023-12-07T21:11:10.607705+0000","last_fullsized":"2023-12-07T21:11:10.607705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.299949+0000","last_change":"2023-12-07T21:11:39.299988+0000","last_active":"2023-12-07T21:11:39.299949+0000","last_peered":"2023-12-07T21:11:39.299949+0000","last_clean":"2023-12-07T21:11:39.299949+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:39.299949+0000","last_undegraded":"2023-12-07T21:11:39.299949+0000","last_fullsized":"2023-12-07T21:11:39.299949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.299849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:48.997025+0000","scrub_duration":0.001356866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.839849+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:20.839849+0000","last_peered":"2023-12-07T21:11:20.839849+0000","last_clean":"2023-12-07T21:11:20.839849+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:20.839849+0000","last_undegraded":"2023-12-07T21:11:20.839849+0000","last_fullsized":"2023-12-07T21:11:20.839849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608769+0000","last_change":"2023-12-07T21:09:02.907875+0000","last_active":"2023-12-07T21:11:10.608769+0000","last_peered":"2023-12-07T21:11:10.608769+0000","last_clean":"2023-12-07T21:11:10.608769+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:11:10.608769+0000","last_undegraded":"2023-12-07T21:11:10.608769+0000","last_fullsized":"2023-12-07T21:11:10.608769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802571+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:11:08.802571+0000","last_peered":"2023-12-07T21:11:08.802571+0000","last_clean":"2023-12-07T21:11:08.802571+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:11:08.802571+0000","last_undegraded":"2023-12-07T21:11:08.802571+0000","last_fullsized":"2023-12-07T21:11:08.802571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766751+0000","last_change":"2023-12-07T21:08:56.879187+0000","last_active":"2023-12-07T21:11:09.766751+0000","last_peered":"2023-12-07T21:11:09.766751+0000","last_clean":"2023-12-07T21:11:09.766751+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:11:09.766751+0000","last_undegraded":"2023-12-07T21:11:09.766751+0000","last_fullsized":"2023-12-07T21:11:09.766751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187534+0000","last_change":"2023-12-07T21:08:54.880755+0000","last_active":"2023-12-07T21:11:10.187534+0000","last_peered":"2023-12-07T21:11:10.187534+0000","last_clean":"2023-12-07T21:11:10.187534+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:11:10.187534+0000","last_undegraded":"2023-12-07T21:11:10.187534+0000","last_fullsized":"2023-12-07T21:11:10.187534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.790833+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:15.790833+0000","last_peered":"2023-12-07T21:11:15.790833+0000","last_clean":"2023-12-07T21:11:15.790833+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:15.790833+0000","last_undegraded":"2023-12-07T21:11:15.790833+0000","last_fullsized":"2023-12-07T21:11:15.790833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'9","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.887014+0000","last_change":"2023-12-07T21:11:50.887056+0000","last_active":"2023-12-07T21:11:50.887014+0000","last_peered":"2023-12-07T21:11:50.887014+0000","last_clean":"2023-12-07T21:11:50.887014+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:50.887014+0000","last_undegraded":"2023-12-07T21:11:50.887014+0000","last_fullsized":"2023-12-07T21:11:50.887014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.886922+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:02.989113+0000","scrub_duration":0.0042007399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:19.515594+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:19.515594+0000","last_peered":"2023-12-07T21:11:19.515594+0000","last_clean":"2023-12-07T21:11:19.515594+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:19.515594+0000","last_undegraded":"2023-12-07T21:11:19.515594+0000","last_fullsized":"2023-12-07T21:11:19.515594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345954+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:11:09.345954+0000","last_peered":"2023-12-07T21:11:09.345954+0000","last_clean":"2023-12-07T21:11:09.345954+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:11:09.345954+0000","last_undegraded":"2023-12-07T21:11:09.345954+0000","last_fullsized":"2023-12-07T21:11:09.345954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345219+0000","last_change":"2023-12-07T21:08:56.874712+0000","last_active":"2023-12-07T21:11:09.345219+0000","last_peered":"2023-12-07T21:11:09.345219+0000","last_clean":"2023-12-07T21:11:09.345219+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:11:09.345219+0000","last_undegraded":"2023-12-07T21:11:09.345219+0000","last_fullsized":"2023-12-07T21:11:09.345219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187591+0000","last_change":"2023-12-07T21:08:54.885182+0000","last_active":"2023-12-07T21:11:10.187591+0000","last_peered":"2023-12-07T21:11:10.187591+0000","last_clean":"2023-12-07T21:11:10.187591+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:11:10.187591+0000","last_undegraded":"2023-12-07T21:11:10.187591+0000","last_fullsized":"2023-12-07T21:11:10.187591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.605088+0000","last_change":"2023-12-07T21:12:18.605108+0000","last_active":"2023-12-07T21:12:18.605088+0000","last_peered":"2023-12-07T21:12:18.605088+0000","last_clean":"2023-12-07T21:12:18.605088+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:12:18.605088+0000","last_undegraded":"2023-12-07T21:12:18.605088+0000","last_fullsized":"2023-12-07T21:12:18.605088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.605002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:30.707193+0000","scrub_duration":0.00090833899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.678798+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:11.678798+0000","last_peered":"2023-12-07T21:11:11.678798+0000","last_clean":"2023-12-07T21:11:11.678798+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:11.678798+0000","last_undegraded":"2023-12-07T21:11:11.678798+0000","last_fullsized":"2023-12-07T21:11:11.678798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.302787+0000","last_change":"2023-12-07T21:11:36.302809+0000","last_active":"2023-12-07T21:11:36.302787+0000","last_peered":"2023-12-07T21:11:36.302787+0000","last_clean":"2023-12-07T21:11:36.302787+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:36.302787+0000","last_undegraded":"2023-12-07T21:11:36.302787+0000","last_fullsized":"2023-12-07T21:11:36.302787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.302687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:01.567462+0000","scrub_duration":0.0014296669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608968+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:11:10.608968+0000","last_peered":"2023-12-07T21:11:10.608968+0000","last_clean":"2023-12-07T21:11:10.608968+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:11:10.608968+0000","last_undegraded":"2023-12-07T21:11:10.608968+0000","last_fullsized":"2023-12-07T21:11:10.608968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608103+0000","last_change":"2023-12-07T21:08:56.887184+0000","last_active":"2023-12-07T21:11:10.608103+0000","last_peered":"2023-12-07T21:11:10.608103+0000","last_clean":"2023-12-07T21:11:10.608103+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:11:10.608103+0000","last_undegraded":"2023-12-07T21:11:10.608103+0000","last_fullsized":"2023-12-07T21:11:10.608103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766431+0000","last_change":"2023-12-07T21:08:54.878542+0000","last_active":"2023-12-07T21:11:09.766431+0000","last_peered":"2023-12-07T21:11:09.766431+0000","last_clean":"2023-12-07T21:11:09.766431+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:11:09.766431+0000","last_undegraded":"2023-12-07T21:11:09.766431+0000","last_fullsized":"2023-12-07T21:11:09.766431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.514123+0000","last_change":"2023-12-07T21:11:52.514142+0000","last_active":"2023-12-07T21:11:52.514123+0000","last_peered":"2023-12-07T21:11:52.514123+0000","last_clean":"2023-12-07T21:11:52.514123+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:52.514123+0000","last_undegraded":"2023-12-07T21:11:52.514123+0000","last_fullsized":"2023-12-07T21:11:52.514123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.514035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:00:51.180837+0000","scrub_duration":0.00101976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.532757+0000","last_change":"2023-12-07T21:11:32.532802+0000","last_active":"2023-12-07T21:11:32.532757+0000","last_peered":"2023-12-07T21:11:32.532757+0000","last_clean":"2023-12-07T21:11:32.532757+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:32.532757+0000","last_undegraded":"2023-12-07T21:11:32.532757+0000","last_fullsized":"2023-12-07T21:11:32.532757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.532666+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:34.382885+0000","scrub_duration":0.0035860219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.544268+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:17.544268+0000","last_peered":"2023-12-07T21:11:17.544268+0000","last_clean":"2023-12-07T21:11:17.544268+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:17.544268+0000","last_undegraded":"2023-12-07T21:11:17.544268+0000","last_fullsized":"2023-12-07T21:11:17.544268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808681+0000","last_change":"2023-12-07T21:08:56.873185+0000","last_active":"2023-12-07T21:11:03.808681+0000","last_peered":"2023-12-07T21:11:03.808681+0000","last_clean":"2023-12-07T21:11:03.808681+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:11:03.808681+0000","last_undegraded":"2023-12-07T21:11:03.808681+0000","last_fullsized":"2023-12-07T21:11:03.808681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607720+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:11:10.607720+0000","last_peered":"2023-12-07T21:11:10.607720+0000","last_clean":"2023-12-07T21:11:10.607720+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:11:10.607720+0000","last_undegraded":"2023-12-07T21:11:10.607720+0000","last_fullsized":"2023-12-07T21:11:10.607720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:59.757098+0000","last_change":"2023-12-07T21:11:59.757120+0000","last_active":"2023-12-07T21:11:59.757098+0000","last_peered":"2023-12-07T21:11:59.757098+0000","last_clean":"2023-12-07T21:11:59.757098+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:11:59.757098+0000","last_undegraded":"2023-12-07T21:11:59.757098+0000","last_fullsized":"2023-12-07T21:11:59.757098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_clean_scrub_stamp":"2023-12-07T21:11:59.757017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:04:59.018197+0000","scrub_duration":0.001196353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'61","reported_seq":127,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.783931+0000","last_change":"2023-12-07T21:11:44.783993+0000","last_active":"2023-12-07T21:11:44.783931+0000","last_peered":"2023-12-07T21:11:44.783931+0000","last_clean":"2023-12-07T21:11:44.783931+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:44.783931+0000","last_undegraded":"2023-12-07T21:11:44.783931+0000","last_fullsized":"2023-12-07T21:11:44.783931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.783824+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:07.474940+0000","scrub_duration":0.004588193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.558888+0000","last_change":"2023-12-07T21:11:36.558908+0000","last_active":"2023-12-07T21:11:36.558888+0000","last_peered":"2023-12-07T21:11:36.558888+0000","last_clean":"2023-12-07T21:11:36.558888+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:11:36.558888+0000","last_undegraded":"2023-12-07T21:11:36.558888+0000","last_fullsized":"2023-12-07T21:11:36.558888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.558807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:33:06.320086+0000","scrub_duration":0.001387288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345942+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:11:09.345942+0000","last_peered":"2023-12-07T21:11:09.345942+0000","last_clean":"2023-12-07T21:11:09.345942+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:11:09.345942+0000","last_undegraded":"2023-12-07T21:11:09.345942+0000","last_fullsized":"2023-12-07T21:11:09.345942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:19.862158+0000","last_change":"2023-12-07T21:12:19.862179+0000","last_active":"2023-12-07T21:12:19.862158+0000","last_peered":"2023-12-07T21:12:19.862158+0000","last_clean":"2023-12-07T21:12:19.862158+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:12:19.862158+0000","last_undegraded":"2023-12-07T21:12:19.862158+0000","last_fullsized":"2023-12-07T21:12:19.862158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_clean_scrub_stamp":"2023-12-07T21:12:19.862069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:34.168058+0000","scrub_duration":0.0015085669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766432+0000","last_change":"2023-12-07T21:08:54.882363+0000","last_active":"2023-12-07T21:11:09.766432+0000","last_peered":"2023-12-07T21:11:09.766432+0000","last_clean":"2023-12-07T21:11:09.766432+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:11:09.766432+0000","last_undegraded":"2023-12-07T21:11:09.766432+0000","last_fullsized":"2023-12-07T21:11:09.766432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807381+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:11:03.807381+0000","last_peered":"2023-12-07T21:11:03.807381+0000","last_clean":"2023-12-07T21:11:03.807381+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:11:03.807381+0000","last_undegraded":"2023-12-07T21:11:03.807381+0000","last_fullsized":"2023-12-07T21:11:03.807381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.514700+0000","last_change":"2023-12-07T21:12:21.514738+0000","last_active":"2023-12-07T21:12:21.514700+0000","last_peered":"2023-12-07T21:12:21.514700+0000","last_clean":"2023-12-07T21:12:21.514700+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:12:21.514700+0000","last_undegraded":"2023-12-07T21:12:21.514700+0000","last_fullsized":"2023-12-07T21:12:21.514700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.514603+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:11.760175+0000","scrub_duration":0.0065721260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:13.398971+0000","last_change":"2023-12-07T21:12:13.399009+0000","last_active":"2023-12-07T21:12:13.398971+0000","last_peered":"2023-12-07T21:12:13.398971+0000","last_clean":"2023-12-07T21:12:13.398971+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:12:13.398971+0000","last_undegraded":"2023-12-07T21:12:13.398971+0000","last_fullsized":"2023-12-07T21:12:13.398971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_clean_scrub_stamp":"2023-12-07T21:12:13.398859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:54.725992+0000","scrub_duration":0.0011359600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608912+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:11:10.608912+0000","last_peered":"2023-12-07T21:11:10.608912+0000","last_clean":"2023-12-07T21:11:10.608912+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:11:10.608912+0000","last_undegraded":"2023-12-07T21:11:10.608912+0000","last_fullsized":"2023-12-07T21:11:10.608912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.432371+0000","last_change":"2023-12-07T21:12:11.432392+0000","last_active":"2023-12-07T21:12:11.432371+0000","last_peered":"2023-12-07T21:12:11.432371+0000","last_clean":"2023-12-07T21:12:11.432371+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:12:11.432371+0000","last_undegraded":"2023-12-07T21:12:11.432371+0000","last_fullsized":"2023-12-07T21:12:11.432371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.432277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:48.190145+0000","scrub_duration":0.0010618419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766451+0000","last_change":"2023-12-07T21:08:54.887587+0000","last_active":"2023-12-07T21:11:09.766451+0000","last_peered":"2023-12-07T21:11:09.766451+0000","last_clean":"2023-12-07T21:11:09.766451+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:11:09.766451+0000","last_undegraded":"2023-12-07T21:11:09.766451+0000","last_fullsized":"2023-12-07T21:11:09.766451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:10.553115+0000","last_change":"2023-12-07T21:12:10.553135+0000","last_active":"2023-12-07T21:12:10.553115+0000","last_peered":"2023-12-07T21:12:10.553115+0000","last_clean":"2023-12-07T21:12:10.553115+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:12:10.553115+0000","last_undegraded":"2023-12-07T21:12:10.553115+0000","last_fullsized":"2023-12-07T21:12:10.553115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_clean_scrub_stamp":"2023-12-07T21:12:10.553023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:52.504367+0000","scrub_duration":0.0013037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.745145+0000","last_change":"2023-12-07T21:11:36.745178+0000","last_active":"2023-12-07T21:11:36.745145+0000","last_peered":"2023-12-07T21:11:36.745145+0000","last_clean":"2023-12-07T21:11:36.745145+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:36.745145+0000","last_undegraded":"2023-12-07T21:11:36.745145+0000","last_fullsized":"2023-12-07T21:11:36.745145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.745068+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:09.080620+0000","scrub_duration":0.0072373669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:16.616692+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:11:16.616692+0000","last_peered":"2023-12-07T21:11:16.616692+0000","last_clean":"2023-12-07T21:11:16.616692+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:11:16.616692+0000","last_undegraded":"2023-12-07T21:11:16.616692+0000","last_fullsized":"2023-12-07T21:11:16.616692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608884+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:11:10.608884+0000","last_peered":"2023-12-07T21:11:10.608884+0000","last_clean":"2023-12-07T21:11:10.608884+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:11:10.608884+0000","last_undegraded":"2023-12-07T21:11:10.608884+0000","last_fullsized":"2023-12-07T21:11:10.608884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'3","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345230+0000","last_change":"2023-12-07T21:08:56.872465+0000","last_active":"2023-12-07T21:11:09.345230+0000","last_peered":"2023-12-07T21:11:09.345230+0000","last_clean":"2023-12-07T21:11:09.345230+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:11:09.345230+0000","last_undegraded":"2023-12-07T21:11:09.345230+0000","last_fullsized":"2023-12-07T21:11:09.345230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607746+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:11:10.607746+0000","last_peered":"2023-12-07T21:11:10.607746+0000","last_clean":"2023-12-07T21:11:10.607746+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:11:10.607746+0000","last_undegraded":"2023-12-07T21:11:10.607746+0000","last_fullsized":"2023-12-07T21:11:10.607746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.324406+0000","last_change":"2023-12-07T21:11:41.324449+0000","last_active":"2023-12-07T21:11:41.324406+0000","last_peered":"2023-12-07T21:11:41.324406+0000","last_clean":"2023-12-07T21:11:41.324406+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:41.324406+0000","last_undegraded":"2023-12-07T21:11:41.324406+0000","last_fullsized":"2023-12-07T21:11:41.324406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.324294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:18:22.956309+0000","scrub_duration":0.001431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808601+0000","last_change":"2023-12-07T21:09:00.896323+0000","last_active":"2023-12-07T21:11:03.808601+0000","last_peered":"2023-12-07T21:11:03.808601+0000","last_clean":"2023-12-07T21:11:03.808601+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:11:03.808601+0000","last_undegraded":"2023-12-07T21:11:03.808601+0000","last_fullsized":"2023-12-07T21:11:03.808601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411900+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411900+0000","last_peered":"2023-12-07T21:11:10.411900+0000","last_clean":"2023-12-07T21:11:10.411900+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411900+0000","last_undegraded":"2023-12-07T21:11:10.411900+0000","last_fullsized":"2023-12-07T21:11:10.411900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608864+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:11:10.608864+0000","last_peered":"2023-12-07T21:11:10.608864+0000","last_clean":"2023-12-07T21:11:10.608864+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:11:10.608864+0000","last_undegraded":"2023-12-07T21:11:10.608864+0000","last_fullsized":"2023-12-07T21:11:10.608864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187884+0000","last_change":"2023-12-07T21:08:56.871124+0000","last_active":"2023-12-07T21:11:10.187884+0000","last_peered":"2023-12-07T21:11:10.187884+0000","last_clean":"2023-12-07T21:11:10.187884+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:11:10.187884+0000","last_undegraded":"2023-12-07T21:11:10.187884+0000","last_fullsized":"2023-12-07T21:11:10.187884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766523+0000","last_change":"2023-12-07T21:08:54.876774+0000","last_active":"2023-12-07T21:11:09.766523+0000","last_peered":"2023-12-07T21:11:09.766523+0000","last_clean":"2023-12-07T21:11:09.766523+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:11:09.766523+0000","last_undegraded":"2023-12-07T21:11:09.766523+0000","last_fullsized":"2023-12-07T21:11:09.766523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.351535+0000","last_change":"2023-12-07T21:11:43.351557+0000","last_active":"2023-12-07T21:11:43.351535+0000","last_peered":"2023-12-07T21:11:43.351535+0000","last_clean":"2023-12-07T21:11:43.351535+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:43.351535+0000","last_undegraded":"2023-12-07T21:11:43.351535+0000","last_fullsized":"2023-12-07T21:11:43.351535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_clean_scrub_stamp":"2023-12-07T21:11:43.351414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:25.302758+0000","scrub_duration":0.001534795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.102589+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:17.102589+0000","last_peered":"2023-12-07T21:11:17.102589+0000","last_clean":"2023-12-07T21:11:17.102589+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:17.102589+0000","last_undegraded":"2023-12-07T21:11:17.102589+0000","last_fullsized":"2023-12-07T21:11:17.102589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.804304+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:27.804304+0000","last_peered":"2023-12-07T21:11:27.804304+0000","last_clean":"2023-12-07T21:11:27.804304+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:27.804304+0000","last_undegraded":"2023-12-07T21:11:27.804304+0000","last_fullsized":"2023-12-07T21:11:27.804304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767539+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:11:09.767539+0000","last_peered":"2023-12-07T21:11:09.767539+0000","last_clean":"2023-12-07T21:11:09.767539+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:11:09.767539+0000","last_undegraded":"2023-12-07T21:11:09.767539+0000","last_fullsized":"2023-12-07T21:11:09.767539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187796+0000","last_change":"2023-12-07T21:08:56.870984+0000","last_active":"2023-12-07T21:11:10.187796+0000","last_peered":"2023-12-07T21:11:10.187796+0000","last_clean":"2023-12-07T21:11:10.187796+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:11:10.187796+0000","last_undegraded":"2023-12-07T21:11:10.187796+0000","last_fullsized":"2023-12-07T21:11:10.187796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607752+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:11:10.607752+0000","last_peered":"2023-12-07T21:11:10.607752+0000","last_clean":"2023-12-07T21:11:10.607752+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:11:10.607752+0000","last_undegraded":"2023-12-07T21:11:10.607752+0000","last_fullsized":"2023-12-07T21:11:10.607752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.612324+0000","last_change":"2023-12-07T21:12:17.612358+0000","last_active":"2023-12-07T21:12:17.612324+0000","last_peered":"2023-12-07T21:12:17.612324+0000","last_clean":"2023-12-07T21:12:17.612324+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:12:17.612324+0000","last_undegraded":"2023-12-07T21:12:17.612324+0000","last_fullsized":"2023-12-07T21:12:17.612324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.612233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:19.658682+0000","scrub_duration":0.00093805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.713857+0000","last_change":"2023-12-07T21:11:41.713922+0000","last_active":"2023-12-07T21:11:41.713857+0000","last_peered":"2023-12-07T21:11:41.713857+0000","last_clean":"2023-12-07T21:11:41.713857+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:41.713857+0000","last_undegraded":"2023-12-07T21:11:41.713857+0000","last_fullsized":"2023-12-07T21:11:41.713857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.713762+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:20:34.087308+0000","scrub_duration":0.004054785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.510322+0000","last_change":"2023-12-07T21:12:27.510342+0000","last_active":"2023-12-07T21:12:27.510322+0000","last_peered":"2023-12-07T21:12:27.510322+0000","last_clean":"2023-12-07T21:12:27.510322+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:12:27.510322+0000","last_undegraded":"2023-12-07T21:12:27.510322+0000","last_fullsized":"2023-12-07T21:12:27.510322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.510237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:49.420820+0000","scrub_duration":0.00099611600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608952+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:11:10.608952+0000","last_peered":"2023-12-07T21:11:10.608952+0000","last_clean":"2023-12-07T21:11:10.608952+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:11:10.608952+0000","last_undegraded":"2023-12-07T21:11:10.608952+0000","last_fullsized":"2023-12-07T21:11:10.608952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608124+0000","last_change":"2023-12-07T21:08:56.873059+0000","last_active":"2023-12-07T21:11:10.608124+0000","last_peered":"2023-12-07T21:11:10.608124+0000","last_clean":"2023-12-07T21:11:10.608124+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:11:10.608124+0000","last_undegraded":"2023-12-07T21:11:10.608124+0000","last_fullsized":"2023-12-07T21:11:10.608124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800263+0000","last_change":"2023-12-07T21:08:54.890887+0000","last_active":"2023-12-07T21:10:58.800263+0000","last_peered":"2023-12-07T21:10:58.800263+0000","last_clean":"2023-12-07T21:10:58.800263+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:10:58.800263+0000","last_undegraded":"2023-12-07T21:10:58.800263+0000","last_fullsized":"2023-12-07T21:10:58.800263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.412338+0000","last_change":"2023-12-07T21:11:55.412366+0000","last_active":"2023-12-07T21:11:55.412338+0000","last_peered":"2023-12-07T21:11:55.412338+0000","last_clean":"2023-12-07T21:11:55.412338+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:55.412338+0000","last_undegraded":"2023-12-07T21:11:55.412338+0000","last_fullsized":"2023-12-07T21:11:55.412338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.412243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.514434+0000","scrub_duration":0.0010230090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:00.405899+0000","last_change":"2023-12-07T21:12:00.405945+0000","last_active":"2023-12-07T21:12:00.405899+0000","last_peered":"2023-12-07T21:12:00.405899+0000","last_clean":"2023-12-07T21:12:00.405899+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:12:00.405899+0000","last_undegraded":"2023-12-07T21:12:00.405899+0000","last_fullsized":"2023-12-07T21:12:00.405899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_clean_scrub_stamp":"2023-12-07T21:12:00.405797+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:22.672028+0000","scrub_duration":0.0030248670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608741+0000","last_change":"2023-12-07T21:09:02.906202+0000","last_active":"2023-12-07T21:11:10.608741+0000","last_peered":"2023-12-07T21:11:10.608741+0000","last_clean":"2023-12-07T21:11:10.608741+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:11:10.608741+0000","last_undegraded":"2023-12-07T21:11:10.608741+0000","last_fullsized":"2023-12-07T21:11:10.608741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608961+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:11:10.608961+0000","last_peered":"2023-12-07T21:11:10.608961+0000","last_clean":"2023-12-07T21:11:10.608961+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:11:10.608961+0000","last_undegraded":"2023-12-07T21:11:10.608961+0000","last_fullsized":"2023-12-07T21:11:10.608961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'13","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187822+0000","last_change":"2023-12-07T21:08:56.869733+0000","last_active":"2023-12-07T21:11:10.187822+0000","last_peered":"2023-12-07T21:11:10.187822+0000","last_clean":"2023-12-07T21:11:10.187822+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:11:10.187822+0000","last_undegraded":"2023-12-07T21:11:10.187822+0000","last_fullsized":"2023-12-07T21:11:10.187822+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807399+0000","last_change":"2023-12-07T21:08:54.878825+0000","last_active":"2023-12-07T21:11:03.807399+0000","last_peered":"2023-12-07T21:11:03.807399+0000","last_clean":"2023-12-07T21:11:03.807399+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:11:03.807399+0000","last_undegraded":"2023-12-07T21:11:03.807399+0000","last_fullsized":"2023-12-07T21:11:03.807399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.347674+0000","last_change":"2023-12-07T21:11:44.347728+0000","last_active":"2023-12-07T21:11:44.347674+0000","last_peered":"2023-12-07T21:11:44.347674+0000","last_clean":"2023-12-07T21:11:44.347674+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:44.347674+0000","last_undegraded":"2023-12-07T21:11:44.347674+0000","last_fullsized":"2023-12-07T21:11:44.347674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.347582+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:19:20.740832+0000","scrub_duration":0.0032839919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608679+0000","last_change":"2023-12-07T21:09:00.887872+0000","last_active":"2023-12-07T21:11:10.608679+0000","last_peered":"2023-12-07T21:11:10.608679+0000","last_clean":"2023-12-07T21:11:10.608679+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:11:10.608679+0000","last_undegraded":"2023-12-07T21:11:10.608679+0000","last_fullsized":"2023-12-07T21:11:10.608679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.597790+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:15.597790+0000","last_peered":"2023-12-07T21:11:15.597790+0000","last_clean":"2023-12-07T21:11:15.597790+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:15.597790+0000","last_undegraded":"2023-12-07T21:11:15.597790+0000","last_fullsized":"2023-12-07T21:11:15.597790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608930+0000","last_change":"2023-12-07T21:09:04.928655+0000","last_active":"2023-12-07T21:11:10.608930+0000","last_peered":"2023-12-07T21:11:10.608930+0000","last_clean":"2023-12-07T21:11:10.608930+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:11:10.608930+0000","last_undegraded":"2023-12-07T21:11:10.608930+0000","last_fullsized":"2023-12-07T21:11:10.608930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.282849+0000","last_change":"2023-12-07T21:12:20.282874+0000","last_active":"2023-12-07T21:12:20.282849+0000","last_peered":"2023-12-07T21:12:20.282849+0000","last_clean":"2023-12-07T21:12:20.282849+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:12:20.282849+0000","last_undegraded":"2023-12-07T21:12:20.282849+0000","last_fullsized":"2023-12-07T21:12:20.282849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.282741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:25.331572+0000","scrub_duration":0.001103185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806724+0000","last_change":"2023-12-07T21:08:54.888408+0000","last_active":"2023-12-07T21:11:03.806724+0000","last_peered":"2023-12-07T21:11:03.806724+0000","last_clean":"2023-12-07T21:11:03.806724+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:11:03.806724+0000","last_undegraded":"2023-12-07T21:11:03.806724+0000","last_fullsized":"2023-12-07T21:11:03.806724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802632+0000","last_change":"2023-12-07T21:08:56.873286+0000","last_active":"2023-12-07T21:11:08.802632+0000","last_peered":"2023-12-07T21:11:08.802632+0000","last_clean":"2023-12-07T21:11:08.802632+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:11:08.802632+0000","last_undegraded":"2023-12-07T21:11:08.802632+0000","last_fullsized":"2023-12-07T21:11:08.802632+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800891+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:11:03.800891+0000","last_peered":"2023-12-07T21:11:03.800891+0000","last_clean":"2023-12-07T21:11:03.800891+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:11:03.800891+0000","last_undegraded":"2023-12-07T21:11:03.800891+0000","last_fullsized":"2023-12-07T21:11:03.800891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.424101+0000","last_change":"2023-12-07T21:12:12.424126+0000","last_active":"2023-12-07T21:12:12.424101+0000","last_peered":"2023-12-07T21:12:12.424101+0000","last_clean":"2023-12-07T21:12:12.424101+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:12:12.424101+0000","last_undegraded":"2023-12-07T21:12:12.424101+0000","last_fullsized":"2023-12-07T21:12:12.424101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.424026+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:21.643939+0000","scrub_duration":0.002995218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808292+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:11:03.808292+0000","last_peered":"2023-12-07T21:11:03.808292+0000","last_clean":"2023-12-07T21:11:03.808292+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:11:03.808292+0000","last_undegraded":"2023-12-07T21:11:03.808292+0000","last_fullsized":"2023-12-07T21:11:03.808292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802478+0000","last_change":"2023-12-07T21:08:56.872273+0000","last_active":"2023-12-07T21:11:08.802478+0000","last_peered":"2023-12-07T21:11:08.802478+0000","last_clean":"2023-12-07T21:11:08.802478+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:11:08.802478+0000","last_undegraded":"2023-12-07T21:11:08.802478+0000","last_fullsized":"2023-12-07T21:11:08.802478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801133+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:11:03.801133+0000","last_peered":"2023-12-07T21:11:03.801133+0000","last_clean":"2023-12-07T21:11:03.801133+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:11:03.801133+0000","last_undegraded":"2023-12-07T21:11:03.801133+0000","last_fullsized":"2023-12-07T21:11:03.801133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801089+0000","last_change":"2023-12-07T21:08:56.876070+0000","last_active":"2023-12-07T21:11:03.801089+0000","last_peered":"2023-12-07T21:11:03.801089+0000","last_clean":"2023-12-07T21:11:03.801089+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:11:03.801089+0000","last_undegraded":"2023-12-07T21:11:03.801089+0000","last_fullsized":"2023-12-07T21:11:03.801089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802500+0000","last_change":"2023-12-07T21:08:54.874578+0000","last_active":"2023-12-07T21:11:08.802500+0000","last_peered":"2023-12-07T21:11:08.802500+0000","last_clean":"2023-12-07T21:11:08.802500+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:11:08.802500+0000","last_undegraded":"2023-12-07T21:11:08.802500+0000","last_fullsized":"2023-12-07T21:11:08.802500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807052+0000","last_change":"2023-12-07T21:08:56.883348+0000","last_active":"2023-12-07T21:11:03.807052+0000","last_peered":"2023-12-07T21:11:03.807052+0000","last_clean":"2023-12-07T21:11:03.807052+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:11:03.807052+0000","last_undegraded":"2023-12-07T21:11:03.807052+0000","last_fullsized":"2023-12-07T21:11:03.807052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808756+0000","last_change":"2023-12-07T21:08:54.887259+0000","last_active":"2023-12-07T21:11:08.808756+0000","last_peered":"2023-12-07T21:11:08.808756+0000","last_clean":"2023-12-07T21:11:08.808756+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:11:08.808756+0000","last_undegraded":"2023-12-07T21:11:08.808756+0000","last_fullsized":"2023-12-07T21:11:08.808756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.783785+0000","last_change":"2023-12-07T21:12:21.783809+0000","last_active":"2023-12-07T21:12:21.783785+0000","last_peered":"2023-12-07T21:12:21.783785+0000","last_clean":"2023-12-07T21:12:21.783785+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:12:21.783785+0000","last_undegraded":"2023-12-07T21:12:21.783785+0000","last_fullsized":"2023-12-07T21:12:21.783785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.783687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:25.104216+0000","scrub_duration":0.001223366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808785+0000","last_change":"2023-12-07T21:08:54.885457+0000","last_active":"2023-12-07T21:11:08.808785+0000","last_peered":"2023-12-07T21:11:08.808785+0000","last_clean":"2023-12-07T21:11:08.808785+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:11:08.808785+0000","last_undegraded":"2023-12-07T21:11:08.808785+0000","last_fullsized":"2023-12-07T21:11:08.808785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.393473+0000","last_change":"2023-12-07T21:12:14.393510+0000","last_active":"2023-12-07T21:12:14.393473+0000","last_peered":"2023-12-07T21:12:14.393473+0000","last_clean":"2023-12-07T21:12:14.393473+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:12:14.393473+0000","last_undegraded":"2023-12-07T21:12:14.393473+0000","last_fullsized":"2023-12-07T21:12:14.393473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.393370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:28.056034+0000","scrub_duration":0.0012787390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802670+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:11:08.802670+0000","last_peered":"2023-12-07T21:11:08.802670+0000","last_clean":"2023-12-07T21:11:08.802670+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:11:08.802670+0000","last_undegraded":"2023-12-07T21:11:08.802670+0000","last_fullsized":"2023-12-07T21:11:08.802670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:22.292045+0000","last_change":"2023-12-07T21:12:22.292065+0000","last_active":"2023-12-07T21:12:22.292045+0000","last_peered":"2023-12-07T21:12:22.292045+0000","last_clean":"2023-12-07T21:12:22.292045+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:12:22.292045+0000","last_undegraded":"2023-12-07T21:12:22.292045+0000","last_fullsized":"2023-12-07T21:12:22.292045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_clean_scrub_stamp":"2023-12-07T21:12:22.291964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:19:35.510802+0000","scrub_duration":0.000955034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809216+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:11:08.809216+0000","last_peered":"2023-12-07T21:11:08.809216+0000","last_clean":"2023-12-07T21:11:08.809216+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:11:08.809216+0000","last_undegraded":"2023-12-07T21:11:08.809216+0000","last_fullsized":"2023-12-07T21:11:08.809216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:24.489620+0000","last_change":"2023-12-07T21:12:24.489652+0000","last_active":"2023-12-07T21:12:24.489620+0000","last_peered":"2023-12-07T21:12:24.489620+0000","last_clean":"2023-12-07T21:12:24.489620+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:12:24.489620+0000","last_undegraded":"2023-12-07T21:12:24.489620+0000","last_fullsized":"2023-12-07T21:12:24.489620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_clean_scrub_stamp":"2023-12-07T21:12:24.489525+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:58:44.073512+0000","scrub_duration":0.0022717330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345160+0000","last_change":"2023-12-07T21:08:54.883629+0000","last_active":"2023-12-07T21:11:09.345160+0000","last_peered":"2023-12-07T21:11:09.345160+0000","last_clean":"2023-12-07T21:11:09.345160+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:11:09.345160+0000","last_undegraded":"2023-12-07T21:11:09.345160+0000","last_fullsized":"2023-12-07T21:11:09.345160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345344+0000","last_change":"2023-12-07T21:08:56.876309+0000","last_active":"2023-12-07T21:11:09.345344+0000","last_peered":"2023-12-07T21:11:09.345344+0000","last_clean":"2023-12-07T21:11:09.345344+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:11:09.345344+0000","last_undegraded":"2023-12-07T21:11:09.345344+0000","last_fullsized":"2023-12-07T21:11:09.345344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766567+0000","last_change":"2023-12-07T21:08:54.887130+0000","last_active":"2023-12-07T21:11:09.766567+0000","last_peered":"2023-12-07T21:11:09.766567+0000","last_clean":"2023-12-07T21:11:09.766567+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:11:09.766567+0000","last_undegraded":"2023-12-07T21:11:09.766567+0000","last_fullsized":"2023-12-07T21:11:09.766567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766855+0000","last_change":"2023-12-07T21:08:56.871205+0000","last_active":"2023-12-07T21:11:09.766855+0000","last_peered":"2023-12-07T21:11:09.766855+0000","last_clean":"2023-12-07T21:11:09.766855+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:11:09.766855+0000","last_undegraded":"2023-12-07T21:11:09.766855+0000","last_fullsized":"2023-12-07T21:11:09.766855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766587+0000","last_change":"2023-12-07T21:08:54.884013+0000","last_active":"2023-12-07T21:11:09.766587+0000","last_peered":"2023-12-07T21:11:09.766587+0000","last_clean":"2023-12-07T21:11:09.766587+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:11:09.766587+0000","last_undegraded":"2023-12-07T21:11:09.766587+0000","last_fullsized":"2023-12-07T21:11:09.766587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766814+0000","last_change":"2023-12-07T21:08:56.879513+0000","last_active":"2023-12-07T21:11:09.766814+0000","last_peered":"2023-12-07T21:11:09.766814+0000","last_clean":"2023-12-07T21:11:09.766814+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:11:09.766814+0000","last_undegraded":"2023-12-07T21:11:09.766814+0000","last_fullsized":"2023-12-07T21:11:09.766814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607834+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:11:10.607834+0000","last_peered":"2023-12-07T21:11:10.607834+0000","last_clean":"2023-12-07T21:11:10.607834+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:11:10.607834+0000","last_undegraded":"2023-12-07T21:11:10.607834+0000","last_fullsized":"2023-12-07T21:11:10.607834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.341241+0000","last_change":"2023-12-07T21:12:27.341269+0000","last_active":"2023-12-07T21:12:27.341241+0000","last_peered":"2023-12-07T21:12:27.341241+0000","last_clean":"2023-12-07T21:12:27.341241+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:12:27.341241+0000","last_undegraded":"2023-12-07T21:12:27.341241+0000","last_fullsized":"2023-12-07T21:12:27.341241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.341151+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:55:08.404366+0000","scrub_duration":0.0024774139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607826+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:11:10.607826+0000","last_peered":"2023-12-07T21:11:10.607826+0000","last_clean":"2023-12-07T21:11:10.607826+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:11:10.607826+0000","last_undegraded":"2023-12-07T21:11:10.607826+0000","last_fullsized":"2023-12-07T21:11:10.607826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608179+0000","last_change":"2023-12-07T21:08:56.876875+0000","last_active":"2023-12-07T21:11:10.608179+0000","last_peered":"2023-12-07T21:11:10.608179+0000","last_clean":"2023-12-07T21:11:10.608179+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:11:10.608179+0000","last_undegraded":"2023-12-07T21:11:10.608179+0000","last_fullsized":"2023-12-07T21:11:10.608179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187739+0000","last_change":"2023-12-07T21:08:54.885432+0000","last_active":"2023-12-07T21:11:10.187739+0000","last_peered":"2023-12-07T21:11:10.187739+0000","last_clean":"2023-12-07T21:11:10.187739+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:11:10.187739+0000","last_undegraded":"2023-12-07T21:11:10.187739+0000","last_fullsized":"2023-12-07T21:11:10.187739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:01.404024+0000","last_change":"2023-12-07T21:12:01.404048+0000","last_active":"2023-12-07T21:12:01.404024+0000","last_peered":"2023-12-07T21:12:01.404024+0000","last_clean":"2023-12-07T21:12:01.404024+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:12:01.404024+0000","last_undegraded":"2023-12-07T21:12:01.404024+0000","last_fullsized":"2023-12-07T21:12:01.404024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_clean_scrub_stamp":"2023-12-07T21:12:01.403925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:06:41.638050+0000","scrub_duration":0.0014963070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607856+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:11:10.607856+0000","last_peered":"2023-12-07T21:11:10.607856+0000","last_clean":"2023-12-07T21:11:10.607856+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:11:10.607856+0000","last_undegraded":"2023-12-07T21:11:10.607856+0000","last_fullsized":"2023-12-07T21:11:10.607856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607882+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:11:10.607882+0000","last_peered":"2023-12-07T21:11:10.607882+0000","last_clean":"2023-12-07T21:11:10.607882+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:11:10.607882+0000","last_undegraded":"2023-12-07T21:11:10.607882+0000","last_fullsized":"2023-12-07T21:11:10.607882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345392+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:11:09.345392+0000","last_peered":"2023-12-07T21:11:09.345392+0000","last_clean":"2023-12-07T21:11:09.345392+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:11:09.345392+0000","last_undegraded":"2023-12-07T21:11:09.345392+0000","last_fullsized":"2023-12-07T21:11:09.345392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345178+0000","last_change":"2023-12-07T21:08:54.883760+0000","last_active":"2023-12-07T21:11:09.345178+0000","last_peered":"2023-12-07T21:11:09.345178+0000","last_clean":"2023-12-07T21:11:09.345178+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:11:09.345178+0000","last_undegraded":"2023-12-07T21:11:09.345178+0000","last_fullsized":"2023-12-07T21:11:09.345178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766992+0000","last_change":"2023-12-07T21:08:56.881838+0000","last_active":"2023-12-07T21:11:09.766992+0000","last_peered":"2023-12-07T21:11:09.766992+0000","last_clean":"2023-12-07T21:11:09.766992+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:11:09.766992+0000","last_undegraded":"2023-12-07T21:11:09.766992+0000","last_fullsized":"2023-12-07T21:11:09.766992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1970,"ondisk_log_size":1970,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1403,"ondisk_log_size":1403,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705714,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.56899999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.433},{"interface":"front","average":{"1min":0.439,"5min":0.443,"15min":0.44600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54500000000000004,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.33700000000000002,"15min":0.34399999999999997},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.40200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34100000000000003,"15min":0.34599999999999997},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45300000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36799999999999999,"15min":0.37},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.52300000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.33600000000000002,"15min":0.33800000000000002},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.44700000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.30499999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.41799999999999998,"15min":0.41999999999999998},"min":{"1min":0.22900000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.373},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.42699999999999999,"15min":0.42999999999999999},"min":{"1min":0.24399999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.59499999999999997,"5min":0.621,"15min":0.621},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Dec 7 21:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.32600000000000001,"15min":0.32000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Dec 7 21:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.36599999999999999,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34399999999999997}]}]},{"osd":1,"up_from":9,"seq":38654705713,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.45200000000000001,"15min":0.45500000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.59199999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.222,"15min":0.222},"max":{"1min":0.57699999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Dec 7 21:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.35299999999999998,"15min":0.36299999999999999},"min":{"1min":0.22700000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.50600000000000001,"5min":0.629,"15min":0.629},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32600000000000001,"15min":0.32700000000000001},"min":{"1min":0.22900000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.48999999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Dec 7 21:11:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34100000000000003,"15min":0.34399999999999997},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.46400000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.379},{"interface":"front","average":{"1min":0.371,"5min":0.373,"15min":0.379},"min":{"1min":0.29099999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.48599999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.41799999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.67600000000000005,"5min":0.747,"15min":0.747},"last":0.439}]},{"osd":2,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.48699999999999999,"15min":0.47999999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.47499999999999998},"min":{"1min":0.28599999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67600000000000005,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Dec 7 21:11:41 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.29599999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.61399999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.49099999999999999,"15min":0.48899999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.40899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:12:32.429 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.429 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.429 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.429 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.430 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.430 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.430 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.430 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.430 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.431 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.431 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.431 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.431 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.431 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.431 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.431 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.432 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.432 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.432 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.432 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.432 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.432 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.433 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.433 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.433 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.433 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.433 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.433 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.434 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.434 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.434 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.434 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.434 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.434 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.435 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.435 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.435 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.435 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.435 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.435 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.436 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.436 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.436 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.436 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.436 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.436 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.436 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.437 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.437 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.437 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.437 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.437 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.437 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.438 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.438 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.438 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.438 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.438 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.439 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.439 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.439 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-07T21:08:40.790884+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=40, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.439 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.439 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.439 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.440 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.440 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.440 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.440 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.440 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.440 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.440 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.441 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.441 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.441 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.441 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.441 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.441 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.441 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.442 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.442 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.442 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.442 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.442 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.442 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.443 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.443 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.443 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.443 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.443 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.443 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.444 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.444 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.444 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.444 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.444 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.444 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.445 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.445 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.445 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.445 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.445 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.445 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.445 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.446 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.446 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.446 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.446 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.446 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.446 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.447 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.447 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.447 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.447 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.447 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.448 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.448 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.448 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.448 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.448 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.448 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.448 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.449 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.449 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.449 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.449 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.449 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.450 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.450 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.450 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.450 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.450 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.451 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.451 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.451 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.451 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.451 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.451 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.452 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.452 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.452 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.452 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.452 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.452 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.452 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.453 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.453 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.453 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.453 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.453 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.453 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.454 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.454 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.454 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.454 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.454 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.454 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.455 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.455 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.455 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.455 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.455 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:32.455 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:12:52.456 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:12:52.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.575+0000 7fa7b6533640 1 Processor -- start 2023-12-07T21:12:52.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.575+0000 7fa7b6533640 1 -- start start 2023-12-07T21:12:52.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.575+0000 7fa7b6533640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa7b006cc90 0x7fa7b006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:12:52.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.575+0000 7fa7b6533640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b0070340 con 0x7fa7b006d5b0 2023-12-07T21:12:52.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.575+0000 7fa7b6533640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b0097940 con 0x7fa7b006cc90 2023-12-07T21:12:52.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.575+0000 7fa7affff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa7b006cc90 0x7fa7b006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:12:52.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.575+0000 7fa7af7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa7b006d5b0 0x7fa7b00950b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:42660/0 (socket says 172.21.15.89:42660) 2023-12-07T21:12:52.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.575+0000 7fa7af7fe640 1 -- 172.21.15.89:0/3719628422 learned_addr learned my addr 172.21.15.89:0/3719628422 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:12:52.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.576+0000 7fa7affff640 1 -- 172.21.15.89:0/3719628422 >> v1:172.21.15.89:6789/0 conn(0x7fa7b006d5b0 legacy=0x7fa7b00950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:52.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.576+0000 7fa7affff640 1 -- 172.21.15.89:0/3719628422 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0071900 con 0x7fa7b006cc90 2023-12-07T21:12:52.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.576+0000 7fa7aeffd640 1 -- 172.21.15.89:0/3719628422 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440615749 0 0) 0x7fa7b0070340 con 0x7fa7b006d5b0 2023-12-07T21:12:52.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.576+0000 7fa7affff640 1 --2- 172.21.15.89:0/3719628422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b006cc90 0x7fa7b006d070 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009720 tx=0x7fa7a402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9593cf0edfb0ec4f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:12:52.571 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.577+0000 7fa7aeffd640 1 -- 172.21.15.89:0/3719628422 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7a402e070 con 0x7fa7b006cc90 2023-12-07T21:12:52.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.577+0000 7fa7aeffd640 1 -- 172.21.15.89:0/3719628422 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a40316d0 con 0x7fa7b006cc90 2023-12-07T21:12:52.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.577+0000 7fa7aeffd640 1 -- 172.21.15.89:0/3719628422 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7a4031990 con 0x7fa7b006cc90 2023-12-07T21:12:52.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.577+0000 7fa7b6533640 1 -- 172.21.15.89:0/3719628422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b006cc90 msgr2=0x7fa7b006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:52.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.577+0000 7fa7b6533640 1 --2- 172.21.15.89:0/3719628422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b006cc90 0x7fa7b006d070 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009720 tx=0x7fa7a402b840 comp rx=0 tx=0).stop 2023-12-07T21:12:52.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.577+0000 7fa7b6533640 1 -- 172.21.15.89:0/3719628422 shutdown_connections 2023-12-07T21:12:52.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.577+0000 7fa7b6533640 1 --2- 172.21.15.89:0/3719628422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b006cc90 0x7fa7b006d070 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:12:52.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.577+0000 7fa7b6533640 1 -- 172.21.15.89:0/3719628422 >> 172.21.15.89:0/3719628422 conn(0x7fa7b00987f0 msgr2=0x7fa7b0098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:12:52.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.577+0000 7fa7b6533640 1 -- 172.21.15.89:0/3719628422 shutdown_connections 2023-12-07T21:12:52.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.577+0000 7fa7b6533640 1 -- 172.21.15.89:0/3719628422 wait complete. 2023-12-07T21:12:52.572 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.578+0000 7fa7b6533640 1 Processor -- start 2023-12-07T21:12:52.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.578+0000 7fa7b6533640 1 -- start start 2023-12-07T21:12:52.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7b6533640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b006cc90 0x7fa7b01bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:12:52.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7b6533640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b0088ff0 con 0x7fa7b006cc90 2023-12-07T21:12:52.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7affff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b006cc90 0x7fa7b01bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:12:52.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7affff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b006cc90 0x7fa7b01bfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40108/0 (socket says 172.21.15.89:40108) 2023-12-07T21:12:52.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7affff640 1 -- 172.21.15.89:0/1969313786 learned_addr learned my addr 172.21.15.89:0/1969313786 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:12:52.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7affff640 1 -- 172.21.15.89:0/1969313786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a4009400 con 0x7fa7b006cc90 2023-12-07T21:12:52.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7affff640 1 --2- 172.21.15.89:0/1969313786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b006cc90 0x7fa7b01bfc60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4034040 tx=0x7fa7a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:12:52.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7acff9640 1 -- 172.21.15.89:0/1969313786 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7a4032830 con 0x7fa7b006cc90 2023-12-07T21:12:52.573 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7acff9640 1 -- 172.21.15.89:0/1969313786 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a4032990 con 0x7fa7b006cc90 2023-12-07T21:12:52.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7acff9640 1 -- 172.21.15.89:0/1969313786 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7a4032c50 con 0x7fa7b006cc90 2023-12-07T21:12:52.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7b6533640 1 -- 172.21.15.89:0/1969313786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b0124f20 con 0x7fa7b006cc90 2023-12-07T21:12:52.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.579+0000 7fa7b6533640 1 -- 172.21.15.89:0/1969313786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b0125690 con 0x7fa7b006cc90 2023-12-07T21:12:52.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.580+0000 7fa7acff9640 1 -- 172.21.15.89:0/1969313786 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fa7a404e450 con 0x7fa7b006cc90 2023-12-07T21:12:52.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.580+0000 7fa7acff9640 1 --2- 172.21.15.89:0/1969313786 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa79c037850 0x7fa79c039d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:12:52.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.580+0000 7fa7acff9640 1 -- 172.21.15.89:0/1969313786 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fa7a406cf20 con 0x7fa7b006cc90 2023-12-07T21:12:52.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.580+0000 7fa7b6533640 1 -- 172.21.15.89:0/1969313786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b008b8c0 con 0x7fa7b006cc90 2023-12-07T21:12:52.574 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.581+0000 7fa7af7fe640 1 --2- 172.21.15.89:0/1969313786 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa79c037850 0x7fa79c039d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:12:52.575 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.581+0000 7fa7af7fe640 1 --2- 172.21.15.89:0/1969313786 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa79c037850 0x7fa79c039d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0000c00 tx=0x7fa7a0007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:12:52.576 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.585+0000 7fa7acff9640 1 -- 172.21.15.89:0/1969313786 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa7a4032db0 con 0x7fa7b006cc90 2023-12-07T21:12:52.740 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.750+0000 7fa7b6533640 1 -- 172.21.15.89:0/1969313786 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7b0070bf0 con 0x7fa79c037850 2023-12-07T21:12:52.756 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.765+0000 7fa7acff9640 1 -- 172.21.15.89:0/1969313786 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+670013 (secure 0 0 0) 0x7fa7a00012b0 con 0x7fa79c037850 2023-12-07T21:12:52.764 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:12:52.769 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:12:52.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.770+0000 7fa7b6533640 1 -- 172.21.15.89:0/1969313786 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa79c037850 msgr2=0x7fa79c039d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:52.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.770+0000 7fa7b6533640 1 --2- 172.21.15.89:0/1969313786 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa79c037850 0x7fa79c039d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0000c00 tx=0x7fa7a0007910 comp rx=0 tx=0).stop 2023-12-07T21:12:52.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.770+0000 7fa7b6533640 1 -- 172.21.15.89:0/1969313786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b006cc90 msgr2=0x7fa7b01bfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:12:52.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.770+0000 7fa7b6533640 1 --2- 172.21.15.89:0/1969313786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b006cc90 0x7fa7b01bfc60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4034040 tx=0x7fa7a40046c0 comp rx=0 tx=0).stop 2023-12-07T21:12:52.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.770+0000 7fa7b6533640 1 -- 172.21.15.89:0/1969313786 shutdown_connections 2023-12-07T21:12:52.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.770+0000 7fa7b6533640 1 --2- 172.21.15.89:0/1969313786 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fa79c037850 0x7fa79c039d10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:12:52.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.770+0000 7fa7b6533640 1 --2- 172.21.15.89:0/1969313786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7b006cc90 0x7fa7b01bfc60 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:12:52.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.770+0000 7fa7b6533640 1 -- 172.21.15.89:0/1969313786 >> 172.21.15.89:0/1969313786 conn(0x7fa7b00987f0 msgr2=0x7fa7b009a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:12:52.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.770+0000 7fa7b6533640 1 -- 172.21.15.89:0/1969313786 shutdown_connections 2023-12-07T21:12:52.773 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:12:52.770+0000 7fa7b6533640 1 -- 172.21.15.89:0/1969313786 wait complete. 2023-12-07T21:12:52.773 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2023-12-07T21:12:52.122884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3982,"ondisk_log_size":3982,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003973"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807400+0000","last_change":"2023-12-07T21:08:54.882968+0000","last_active":"2023-12-07T21:11:03.807400+0000","last_peered":"2023-12-07T21:11:03.807400+0000","last_clean":"2023-12-07T21:11:03.807400+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:11:03.807400+0000","last_undegraded":"2023-12-07T21:11:03.807400+0000","last_fullsized":"2023-12-07T21:11:03.807400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.407237+0000","last_change":"2023-12-07T21:12:16.407256+0000","last_active":"2023-12-07T21:12:16.407237+0000","last_peered":"2023-12-07T21:12:16.407237+0000","last_clean":"2023-12-07T21:12:16.407237+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:12:16.407237+0000","last_undegraded":"2023-12-07T21:12:16.407237+0000","last_fullsized":"2023-12-07T21:12:16.407237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.407151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:53.647151+0000","scrub_duration":0.00097124400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801438+0000","last_change":"2023-12-07T21:08:54.890832+0000","last_active":"2023-12-07T21:11:03.801438+0000","last_peered":"2023-12-07T21:11:03.801438+0000","last_clean":"2023-12-07T21:11:03.801438+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:11:03.801438+0000","last_undegraded":"2023-12-07T21:11:03.801438+0000","last_fullsized":"2023-12-07T21:11:03.801438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345425+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:11:09.345425+0000","last_peered":"2023-12-07T21:11:09.345425+0000","last_clean":"2023-12-07T21:11:09.345425+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:11:09.345425+0000","last_undegraded":"2023-12-07T21:11:09.345425+0000","last_fullsized":"2023-12-07T21:11:09.345425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808550+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:11:03.808550+0000","last_peered":"2023-12-07T21:11:03.808550+0000","last_clean":"2023-12-07T21:11:03.808550+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:11:03.808550+0000","last_undegraded":"2023-12-07T21:11:03.808550+0000","last_fullsized":"2023-12-07T21:11:03.808550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608236+0000","last_change":"2023-12-07T21:08:56.873919+0000","last_active":"2023-12-07T21:11:10.608236+0000","last_peered":"2023-12-07T21:11:10.608236+0000","last_clean":"2023-12-07T21:11:10.608236+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:11:10.608236+0000","last_undegraded":"2023-12-07T21:11:10.608236+0000","last_fullsized":"2023-12-07T21:11:10.608236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.805663+0000","last_change":"2023-12-07T21:08:54.880442+0000","last_active":"2023-12-07T21:10:58.805663+0000","last_peered":"2023-12-07T21:10:58.805663+0000","last_clean":"2023-12-07T21:10:58.805663+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:10:58.805663+0000","last_undegraded":"2023-12-07T21:10:58.805663+0000","last_fullsized":"2023-12-07T21:10:58.805663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608264+0000","last_change":"2023-12-07T21:08:56.874751+0000","last_active":"2023-12-07T21:11:10.608264+0000","last_peered":"2023-12-07T21:11:10.608264+0000","last_clean":"2023-12-07T21:11:10.608264+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:11:10.608264+0000","last_undegraded":"2023-12-07T21:11:10.608264+0000","last_fullsized":"2023-12-07T21:11:10.608264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607907+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:11:10.607907+0000","last_peered":"2023-12-07T21:11:10.607907+0000","last_clean":"2023-12-07T21:11:10.607907+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:11:10.607907+0000","last_undegraded":"2023-12-07T21:11:10.607907+0000","last_fullsized":"2023-12-07T21:11:10.607907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:39.304126+0000","last_change":"2023-12-07T21:12:39.304151+0000","last_active":"2023-12-07T21:12:39.304126+0000","last_peered":"2023-12-07T21:12:39.304126+0000","last_clean":"2023-12-07T21:12:39.304126+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:12:39.304126+0000","last_undegraded":"2023-12-07T21:12:39.304126+0000","last_fullsized":"2023-12-07T21:12:39.304126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_clean_scrub_stamp":"2023-12-07T21:12:39.304039+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:10.499475+0000","scrub_duration":0.0026021579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187656+0000","last_change":"2023-12-07T21:08:54.880274+0000","last_active":"2023-12-07T21:11:10.187656+0000","last_peered":"2023-12-07T21:11:10.187656+0000","last_clean":"2023-12-07T21:11:10.187656+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:11:10.187656+0000","last_undegraded":"2023-12-07T21:11:10.187656+0000","last_fullsized":"2023-12-07T21:11:10.187656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187892+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:11:10.187892+0000","last_peered":"2023-12-07T21:11:10.187892+0000","last_clean":"2023-12-07T21:11:10.187892+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:11:10.187892+0000","last_undegraded":"2023-12-07T21:11:10.187892+0000","last_fullsized":"2023-12-07T21:11:10.187892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607886+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:11:10.607886+0000","last_peered":"2023-12-07T21:11:10.607886+0000","last_clean":"2023-12-07T21:11:10.607886+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:11:10.607886+0000","last_undegraded":"2023-12-07T21:11:10.607886+0000","last_fullsized":"2023-12-07T21:11:10.607886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807323+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:11:03.807323+0000","last_peered":"2023-12-07T21:11:03.807323+0000","last_clean":"2023-12-07T21:11:03.807323+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:11:03.807323+0000","last_undegraded":"2023-12-07T21:11:03.807323+0000","last_fullsized":"2023-12-07T21:11:03.807323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345133+0000","last_change":"2023-12-07T21:08:54.891021+0000","last_active":"2023-12-07T21:11:09.345133+0000","last_peered":"2023-12-07T21:11:09.345133+0000","last_clean":"2023-12-07T21:11:09.345133+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:11:09.345133+0000","last_undegraded":"2023-12-07T21:11:09.345133+0000","last_fullsized":"2023-12-07T21:11:09.345133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'13","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807362+0000","last_change":"2023-12-07T21:08:56.874321+0000","last_active":"2023-12-07T21:11:03.807362+0000","last_peered":"2023-12-07T21:11:03.807362+0000","last_clean":"2023-12-07T21:11:03.807362+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:11:03.807362+0000","last_undegraded":"2023-12-07T21:11:03.807362+0000","last_fullsized":"2023-12-07T21:11:03.807362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608172+0000","last_change":"2023-12-07T21:08:56.874409+0000","last_active":"2023-12-07T21:11:10.608172+0000","last_peered":"2023-12-07T21:11:10.608172+0000","last_clean":"2023-12-07T21:11:10.608172+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:11:10.608172+0000","last_undegraded":"2023-12-07T21:11:10.608172+0000","last_fullsized":"2023-12-07T21:11:10.608172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:46.400657+0000","last_change":"2023-12-07T21:12:46.400680+0000","last_active":"2023-12-07T21:12:46.400657+0000","last_peered":"2023-12-07T21:12:46.400657+0000","last_clean":"2023-12-07T21:12:46.400657+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:12:46.400657+0000","last_undegraded":"2023-12-07T21:12:46.400657+0000","last_fullsized":"2023-12-07T21:12:46.400657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_clean_scrub_stamp":"2023-12-07T21:12:46.400562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:25.935064+0000","scrub_duration":0.001127915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:34.273452+0000","last_change":"2023-12-07T21:12:34.273474+0000","last_active":"2023-12-07T21:12:34.273452+0000","last_peered":"2023-12-07T21:12:34.273452+0000","last_clean":"2023-12-07T21:12:34.273452+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:12:34.273452+0000","last_undegraded":"2023-12-07T21:12:34.273452+0000","last_fullsized":"2023-12-07T21:12:34.273452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_clean_scrub_stamp":"2023-12-07T21:12:34.273360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:01:32.940162+0000","scrub_duration":0.0011278239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187817+0000","last_change":"2023-12-07T21:08:54.885605+0000","last_active":"2023-12-07T21:11:10.187817+0000","last_peered":"2023-12-07T21:11:10.187817+0000","last_clean":"2023-12-07T21:11:10.187817+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:11:10.187817+0000","last_undegraded":"2023-12-07T21:11:10.187817+0000","last_fullsized":"2023-12-07T21:11:10.187817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'13","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766969+0000","last_change":"2023-12-07T21:08:56.882602+0000","last_active":"2023-12-07T21:11:09.766969+0000","last_peered":"2023-12-07T21:11:09.766969+0000","last_clean":"2023-12-07T21:11:09.766969+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:11:09.766969+0000","last_undegraded":"2023-12-07T21:11:09.766969+0000","last_fullsized":"2023-12-07T21:11:09.766969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766621+0000","last_change":"2023-12-07T21:08:54.889812+0000","last_active":"2023-12-07T21:11:09.766621+0000","last_peered":"2023-12-07T21:11:09.766621+0000","last_clean":"2023-12-07T21:11:09.766621+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:11:09.766621+0000","last_undegraded":"2023-12-07T21:11:09.766621+0000","last_fullsized":"2023-12-07T21:11:09.766621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:40.827223+0000","last_change":"2023-12-07T21:12:40.827245+0000","last_active":"2023-12-07T21:12:40.827223+0000","last_peered":"2023-12-07T21:12:40.827223+0000","last_clean":"2023-12-07T21:12:40.827223+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:12:40.827223+0000","last_undegraded":"2023-12-07T21:12:40.827223+0000","last_fullsized":"2023-12-07T21:12:40.827223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_clean_scrub_stamp":"2023-12-07T21:12:40.827135+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:20.361638+0000","scrub_duration":0.0013685839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766605+0000","last_change":"2023-12-07T21:08:54.878784+0000","last_active":"2023-12-07T21:11:09.766605+0000","last_peered":"2023-12-07T21:11:09.766605+0000","last_clean":"2023-12-07T21:11:09.766605+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:11:09.766605+0000","last_undegraded":"2023-12-07T21:11:09.766605+0000","last_fullsized":"2023-12-07T21:11:09.766605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187888+0000","last_change":"2023-12-07T21:08:56.875039+0000","last_active":"2023-12-07T21:11:10.187888+0000","last_peered":"2023-12-07T21:11:10.187888+0000","last_clean":"2023-12-07T21:11:10.187888+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:11:10.187888+0000","last_undegraded":"2023-12-07T21:11:10.187888+0000","last_fullsized":"2023-12-07T21:11:10.187888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345261+0000","last_change":"2023-12-07T21:08:54.890574+0000","last_active":"2023-12-07T21:11:09.345261+0000","last_peered":"2023-12-07T21:11:09.345261+0000","last_clean":"2023-12-07T21:11:09.345261+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:11:09.345261+0000","last_undegraded":"2023-12-07T21:11:09.345261+0000","last_fullsized":"2023-12-07T21:11:09.345261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.336912+0000","last_change":"2023-12-07T21:12:23.336936+0000","last_active":"2023-12-07T21:12:23.336912+0000","last_peered":"2023-12-07T21:12:23.336912+0000","last_clean":"2023-12-07T21:12:23.336912+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:12:23.336912+0000","last_undegraded":"2023-12-07T21:12:23.336912+0000","last_fullsized":"2023-12-07T21:12:23.336912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.336820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:54.775680+0000","scrub_duration":0.0015463409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607871+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:11:10.607871+0000","last_peered":"2023-12-07T21:11:10.607871+0000","last_clean":"2023-12-07T21:11:10.607871+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:11:10.607871+0000","last_undegraded":"2023-12-07T21:11:10.607871+0000","last_fullsized":"2023-12-07T21:11:10.607871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767525+0000","last_change":"2023-12-07T21:09:04.931981+0000","last_active":"2023-12-07T21:11:09.767525+0000","last_peered":"2023-12-07T21:11:09.767525+0000","last_clean":"2023-12-07T21:11:09.767525+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:11:09.767525+0000","last_undegraded":"2023-12-07T21:11:09.767525+0000","last_fullsized":"2023-12-07T21:11:09.767525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.461393+0000","last_change":"2023-12-07T21:12:20.461414+0000","last_active":"2023-12-07T21:12:20.461393+0000","last_peered":"2023-12-07T21:12:20.461393+0000","last_clean":"2023-12-07T21:12:20.461393+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:12:20.461393+0000","last_undegraded":"2023-12-07T21:12:20.461393+0000","last_fullsized":"2023-12-07T21:12:20.461393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.461275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:11:30.745289+0000","scrub_duration":0.0012528039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607680+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:11:10.607680+0000","last_peered":"2023-12-07T21:11:10.607680+0000","last_clean":"2023-12-07T21:11:10.607680+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:11:10.607680+0000","last_undegraded":"2023-12-07T21:11:10.607680+0000","last_fullsized":"2023-12-07T21:11:10.607680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.797174+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:12.797174+0000","last_peered":"2023-12-07T21:11:12.797174+0000","last_clean":"2023-12-07T21:11:12.797174+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:12.797174+0000","last_undegraded":"2023-12-07T21:11:12.797174+0000","last_fullsized":"2023-12-07T21:11:12.797174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'31","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608625+0000","last_change":"2023-12-07T21:09:00.895835+0000","last_active":"2023-12-07T21:11:10.608625+0000","last_peered":"2023-12-07T21:11:10.608625+0000","last_clean":"2023-12-07T21:11:10.608625+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:11:10.608625+0000","last_undegraded":"2023-12-07T21:11:10.608625+0000","last_fullsized":"2023-12-07T21:11:10.608625+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.345063+0000","last_change":"2023-12-07T21:12:18.345086+0000","last_active":"2023-12-07T21:12:18.345063+0000","last_peered":"2023-12-07T21:12:18.345063+0000","last_clean":"2023-12-07T21:12:18.345063+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:12:18.345063+0000","last_undegraded":"2023-12-07T21:12:18.345063+0000","last_fullsized":"2023-12-07T21:12:18.345063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.344968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:53:47.984483+0000","scrub_duration":0.00095218699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:26.318801+0000","last_change":"2023-12-07T21:12:26.318843+0000","last_active":"2023-12-07T21:12:26.318801+0000","last_peered":"2023-12-07T21:12:26.318801+0000","last_clean":"2023-12-07T21:12:26.318801+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:12:26.318801+0000","last_undegraded":"2023-12-07T21:12:26.318801+0000","last_fullsized":"2023-12-07T21:12:26.318801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:26.318685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:21.073203+0000","scrub_duration":0.0010887360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608060+0000","last_change":"2023-12-07T21:08:56.874761+0000","last_active":"2023-12-07T21:11:10.608060+0000","last_peered":"2023-12-07T21:11:10.608060+0000","last_clean":"2023-12-07T21:11:10.608060+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:11:10.608060+0000","last_undegraded":"2023-12-07T21:11:10.608060+0000","last_fullsized":"2023-12-07T21:11:10.608060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880632+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.830062+0000","last_change":"2023-12-07T21:11:53.830085+0000","last_active":"2023-12-07T21:11:53.830062+0000","last_peered":"2023-12-07T21:11:53.830062+0000","last_clean":"2023-12-07T21:11:53.830062+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:53.830062+0000","last_undegraded":"2023-12-07T21:11:53.830062+0000","last_fullsized":"2023-12-07T21:11:53.830062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_clean_scrub_stamp":"2023-12-07T21:11:53.829969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:45.205269+0000","scrub_duration":0.001216066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.053083+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:11.053083+0000","last_peered":"2023-12-07T21:11:11.053083+0000","last_clean":"2023-12-07T21:11:11.053083+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:11.053083+0000","last_undegraded":"2023-12-07T21:11:11.053083+0000","last_fullsized":"2023-12-07T21:11:11.053083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.304118+0000","last_change":"2023-12-07T21:11:42.304137+0000","last_active":"2023-12-07T21:11:42.304118+0000","last_peered":"2023-12-07T21:11:42.304118+0000","last_clean":"2023-12-07T21:11:42.304118+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:42.304118+0000","last_undegraded":"2023-12-07T21:11:42.304118+0000","last_fullsized":"2023-12-07T21:11:42.304118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.304031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:14.639583+0000","scrub_duration":0.0010594929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:31.746746+0000","last_change":"2023-12-07T21:12:31.746769+0000","last_active":"2023-12-07T21:12:31.746746+0000","last_peered":"2023-12-07T21:12:31.746746+0000","last_clean":"2023-12-07T21:12:31.746746+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:12:31.746746+0000","last_undegraded":"2023-12-07T21:12:31.746746+0000","last_fullsized":"2023-12-07T21:12:31.746746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_clean_scrub_stamp":"2023-12-07T21:12:31.746658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:02.942094+0000","scrub_duration":0.00135096,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'1","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608112+0000","last_change":"2023-12-07T21:08:56.875484+0000","last_active":"2023-12-07T21:11:10.608112+0000","last_peered":"2023-12-07T21:11:10.608112+0000","last_clean":"2023-12-07T21:11:10.608112+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:11:10.608112+0000","last_undegraded":"2023-12-07T21:11:10.608112+0000","last_fullsized":"2023-12-07T21:11:10.608112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607656+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:11:10.607656+0000","last_peered":"2023-12-07T21:11:10.607656+0000","last_clean":"2023-12-07T21:11:10.607656+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:11:10.607656+0000","last_undegraded":"2023-12-07T21:11:10.607656+0000","last_fullsized":"2023-12-07T21:11:10.607656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.707066+0000","last_change":"2023-12-07T21:11:58.707102+0000","last_active":"2023-12-07T21:11:58.707066+0000","last_peered":"2023-12-07T21:11:58.707066+0000","last_clean":"2023-12-07T21:11:58.707066+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:58.707066+0000","last_undegraded":"2023-12-07T21:11:58.707066+0000","last_fullsized":"2023-12-07T21:11:58.707066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.706965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:56:05.594599+0000","scrub_duration":0.0011023249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.554028+0000","last_change":"2023-12-07T21:11:35.554062+0000","last_active":"2023-12-07T21:11:35.554028+0000","last_peered":"2023-12-07T21:11:35.554028+0000","last_clean":"2023-12-07T21:11:35.554028+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:35.554028+0000","last_undegraded":"2023-12-07T21:11:35.554028+0000","last_fullsized":"2023-12-07T21:11:35.554028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.553946+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:56.699897+0000","scrub_duration":0.0042775269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'246","reported_seq":314,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608744+0000","last_change":"2023-12-07T21:09:02.906250+0000","last_active":"2023-12-07T21:11:10.608744+0000","last_peered":"2023-12-07T21:11:10.608744+0000","last_clean":"2023-12-07T21:11:10.608744+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:11:10.608744+0000","last_undegraded":"2023-12-07T21:11:10.608744+0000","last_fullsized":"2023-12-07T21:11:10.608744+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188448+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:11:10.188448+0000","last_peered":"2023-12-07T21:11:10.188448+0000","last_clean":"2023-12-07T21:11:10.188448+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:11:10.188448+0000","last_undegraded":"2023-12-07T21:11:10.188448+0000","last_fullsized":"2023-12-07T21:11:10.188448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.764627+0000","last_change":"2023-12-07T21:12:27.764650+0000","last_active":"2023-12-07T21:12:27.764627+0000","last_peered":"2023-12-07T21:12:27.764627+0000","last_clean":"2023-12-07T21:12:27.764627+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:12:27.764627+0000","last_undegraded":"2023-12-07T21:12:27.764627+0000","last_fullsized":"2023-12-07T21:12:27.764627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.764507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:17:01.731572+0000","scrub_duration":0.0015146649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766427+0000","last_change":"2023-12-07T21:08:54.878527+0000","last_active":"2023-12-07T21:11:09.766427+0000","last_peered":"2023-12-07T21:11:09.766427+0000","last_clean":"2023-12-07T21:11:09.766427+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:11:09.766427+0000","last_undegraded":"2023-12-07T21:11:09.766427+0000","last_fullsized":"2023-12-07T21:11:09.766427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.775119+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:14.775119+0000","last_peered":"2023-12-07T21:11:14.775119+0000","last_clean":"2023-12-07T21:11:14.775119+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:14.775119+0000","last_undegraded":"2023-12-07T21:11:14.775119+0000","last_fullsized":"2023-12-07T21:11:14.775119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:29.600052+0000","last_change":"2023-12-07T21:11:29.600086+0000","last_active":"2023-12-07T21:11:29.600052+0000","last_peered":"2023-12-07T21:11:29.600052+0000","last_clean":"2023-12-07T21:11:29.600052+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:29.600052+0000","last_undegraded":"2023-12-07T21:11:29.600052+0000","last_fullsized":"2023-12-07T21:11:29.600052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_clean_scrub_stamp":"2023-12-07T21:11:29.599963+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:30:03.772118+0000","scrub_duration":0.003554771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'247","reported_seq":340,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:02.790438+0000","last_change":"2023-12-07T21:12:02.790465+0000","last_active":"2023-12-07T21:12:02.790438+0000","last_peered":"2023-12-07T21:12:02.790438+0000","last_clean":"2023-12-07T21:12:02.790438+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:12:02.790438+0000","last_undegraded":"2023-12-07T21:12:02.790438+0000","last_fullsized":"2023-12-07T21:12:02.790438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_clean_scrub_stamp":"2023-12-07T21:12:02.790346+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:07.839178+0000","scrub_duration":0.0026089529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809281+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:11:08.809281+0000","last_peered":"2023-12-07T21:11:08.809281+0000","last_clean":"2023-12-07T21:11:08.809281+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:11:08.809281+0000","last_undegraded":"2023-12-07T21:11:08.809281+0000","last_fullsized":"2023-12-07T21:11:08.809281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880253+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.443130+0000","last_change":"2023-12-07T21:11:56.443153+0000","last_active":"2023-12-07T21:11:56.443130+0000","last_peered":"2023-12-07T21:11:56.443130+0000","last_clean":"2023-12-07T21:11:56.443130+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:56.443130+0000","last_undegraded":"2023-12-07T21:11:56.443130+0000","last_fullsized":"2023-12-07T21:11:56.443130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.443045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:05.069384+0000","scrub_duration":0.0010685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.606772+0000","last_change":"2023-12-07T21:11:39.606842+0000","last_active":"2023-12-07T21:11:39.606772+0000","last_peered":"2023-12-07T21:11:39.606772+0000","last_clean":"2023-12-07T21:11:39.606772+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:39.606772+0000","last_undegraded":"2023-12-07T21:11:39.606772+0000","last_fullsized":"2023-12-07T21:11:39.606772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.606684+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:36.950556+0000","scrub_duration":0.0069737849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:34.781691+0000","last_change":"2023-12-07T21:11:34.781711+0000","last_active":"2023-12-07T21:11:34.781691+0000","last_peered":"2023-12-07T21:11:34.781691+0000","last_clean":"2023-12-07T21:11:34.781691+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:34.781691+0000","last_undegraded":"2023-12-07T21:11:34.781691+0000","last_fullsized":"2023-12-07T21:11:34.781691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:34.781604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:44.478780+0000","scrub_duration":0.001255822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188362+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:11:10.188362+0000","last_peered":"2023-12-07T21:11:10.188362+0000","last_clean":"2023-12-07T21:11:10.188362+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:11:10.188362+0000","last_undegraded":"2023-12-07T21:11:10.188362+0000","last_fullsized":"2023-12-07T21:11:10.188362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'22","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.326816+0000","last_change":"2023-12-07T21:12:36.326862+0000","last_active":"2023-12-07T21:12:36.326816+0000","last_peered":"2023-12-07T21:12:36.326816+0000","last_clean":"2023-12-07T21:12:36.326816+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:12:36.326816+0000","last_undegraded":"2023-12-07T21:12:36.326816+0000","last_fullsized":"2023-12-07T21:12:36.326816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.326694+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:24:30.282151+0000","scrub_duration":0.0028268410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187590+0000","last_change":"2023-12-07T21:08:54.885249+0000","last_active":"2023-12-07T21:11:10.187590+0000","last_peered":"2023-12-07T21:11:10.187590+0000","last_clean":"2023-12-07T21:11:10.187590+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:11:10.187590+0000","last_undegraded":"2023-12-07T21:11:10.187590+0000","last_fullsized":"2023-12-07T21:11:10.187590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:07.717434+0000","last_change":"2023-12-07T21:12:07.717459+0000","last_active":"2023-12-07T21:12:07.717434+0000","last_peered":"2023-12-07T21:12:07.717434+0000","last_clean":"2023-12-07T21:12:07.717434+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:12:07.717434+0000","last_undegraded":"2023-12-07T21:12:07.717434+0000","last_fullsized":"2023-12-07T21:12:07.717434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_clean_scrub_stamp":"2023-12-07T21:12:07.717342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:32.009926+0000","scrub_duration":0.0014039289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:09.439719+0000","last_change":"2023-12-07T21:12:09.439747+0000","last_active":"2023-12-07T21:12:09.439719+0000","last_peered":"2023-12-07T21:12:09.439719+0000","last_clean":"2023-12-07T21:12:09.439719+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:12:09.439719+0000","last_undegraded":"2023-12-07T21:12:09.439719+0000","last_fullsized":"2023-12-07T21:12:09.439719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_clean_scrub_stamp":"2023-12-07T21:12:09.439641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:19.195035+0000","scrub_duration":0.0043223589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.735445+0000","last_change":"2023-12-07T21:11:33.735466+0000","last_active":"2023-12-07T21:11:33.735445+0000","last_peered":"2023-12-07T21:11:33.735445+0000","last_clean":"2023-12-07T21:11:33.735445+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:33.735445+0000","last_undegraded":"2023-12-07T21:11:33.735445+0000","last_fullsized":"2023-12-07T21:11:33.735445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.735352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:03.972116+0000","scrub_duration":0.0011441929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767437+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:11:09.767437+0000","last_peered":"2023-12-07T21:11:09.767437+0000","last_clean":"2023-12-07T21:11:09.767437+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:11:09.767437+0000","last_undegraded":"2023-12-07T21:11:09.767437+0000","last_fullsized":"2023-12-07T21:11:09.767437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.429249+0000","last_change":"2023-12-07T21:12:36.429281+0000","last_active":"2023-12-07T21:12:36.429249+0000","last_peered":"2023-12-07T21:12:36.429249+0000","last_clean":"2023-12-07T21:12:36.429249+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:12:36.429249+0000","last_undegraded":"2023-12-07T21:12:36.429249+0000","last_fullsized":"2023-12-07T21:12:36.429249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.429148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:19.936617+0000","scrub_duration":0.001111988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607665+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:11:10.607665+0000","last_peered":"2023-12-07T21:11:10.607665+0000","last_clean":"2023-12-07T21:11:10.607665+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:11:10.607665+0000","last_undegraded":"2023-12-07T21:11:10.607665+0000","last_fullsized":"2023-12-07T21:11:10.607665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.810355+0000","last_change":"2023-12-07T21:12:15.810375+0000","last_active":"2023-12-07T21:12:15.810355+0000","last_peered":"2023-12-07T21:12:15.810355+0000","last_clean":"2023-12-07T21:12:15.810355+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:12:15.810355+0000","last_undegraded":"2023-12-07T21:12:15.810355+0000","last_fullsized":"2023-12-07T21:12:15.810355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.810269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:33.566530+0000","scrub_duration":0.0014408579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.522055+0000","last_change":"2023-12-07T21:11:50.522112+0000","last_active":"2023-12-07T21:11:50.522055+0000","last_peered":"2023-12-07T21:11:50.522055+0000","last_clean":"2023-12-07T21:11:50.522055+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:50.522055+0000","last_undegraded":"2023-12-07T21:11:50.522055+0000","last_fullsized":"2023-12-07T21:11:50.522055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.521955+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:04.827943+0000","scrub_duration":0.0073561030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":307,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.761860+0000","last_change":"2023-12-07T21:11:35.761887+0000","last_active":"2023-12-07T21:11:35.761860+0000","last_peered":"2023-12-07T21:11:35.761860+0000","last_clean":"2023-12-07T21:11:35.761860+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:35.761860+0000","last_undegraded":"2023-12-07T21:11:35.761860+0000","last_fullsized":"2023-12-07T21:11:35.761860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.761766+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:14.383149+0000","scrub_duration":0.0016151640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345866+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:11:09.345866+0000","last_peered":"2023-12-07T21:11:09.345866+0000","last_clean":"2023-12-07T21:11:09.345866+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:11:09.345866+0000","last_undegraded":"2023-12-07T21:11:09.345866+0000","last_fullsized":"2023-12-07T21:11:09.345866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187733+0000","last_change":"2023-12-07T21:08:56.870949+0000","last_active":"2023-12-07T21:11:10.187733+0000","last_peered":"2023-12-07T21:11:10.187733+0000","last_clean":"2023-12-07T21:11:10.187733+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:11:10.187733+0000","last_undegraded":"2023-12-07T21:11:10.187733+0000","last_fullsized":"2023-12-07T21:11:10.187733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607649+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:11:10.607649+0000","last_peered":"2023-12-07T21:11:10.607649+0000","last_clean":"2023-12-07T21:11:10.607649+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:11:10.607649+0000","last_undegraded":"2023-12-07T21:11:10.607649+0000","last_fullsized":"2023-12-07T21:11:10.607649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.753680+0000","last_change":"2023-12-07T21:11:55.753724+0000","last_active":"2023-12-07T21:11:55.753680+0000","last_peered":"2023-12-07T21:11:55.753680+0000","last_clean":"2023-12-07T21:11:55.753680+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:55.753680+0000","last_undegraded":"2023-12-07T21:11:55.753680+0000","last_fullsized":"2023-12-07T21:11:55.753680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.753576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:53:37.572475+0000","scrub_duration":0.0013913199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:31.726530+0000","last_change":"2023-12-07T21:11:31.726564+0000","last_active":"2023-12-07T21:11:31.726530+0000","last_peered":"2023-12-07T21:11:31.726530+0000","last_clean":"2023-12-07T21:11:31.726530+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:31.726530+0000","last_undegraded":"2023-12-07T21:11:31.726530+0000","last_fullsized":"2023-12-07T21:11:31.726530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:31.726451+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:36.775283+0000","scrub_duration":0.0038601009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.752542+0000","last_change":"2023-12-07T21:11:56.752564+0000","last_active":"2023-12-07T21:11:56.752542+0000","last_peered":"2023-12-07T21:11:56.752542+0000","last_clean":"2023-12-07T21:11:56.752542+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:56.752542+0000","last_undegraded":"2023-12-07T21:11:56.752542+0000","last_fullsized":"2023-12-07T21:11:56.752542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.752450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:44.261937+0000","scrub_duration":0.0012919610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345867+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:11:09.345867+0000","last_peered":"2023-12-07T21:11:09.345867+0000","last_clean":"2023-12-07T21:11:09.345867+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:11:09.345867+0000","last_undegraded":"2023-12-07T21:11:09.345867+0000","last_fullsized":"2023-12-07T21:11:09.345867+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187760+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:11:10.187760+0000","last_peered":"2023-12-07T21:11:10.187760+0000","last_clean":"2023-12-07T21:11:10.187760+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:11:10.187760+0000","last_undegraded":"2023-12-07T21:11:10.187760+0000","last_fullsized":"2023-12-07T21:11:10.187760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345205+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:11:09.345205+0000","last_peered":"2023-12-07T21:11:09.345205+0000","last_clean":"2023-12-07T21:11:09.345205+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:11:09.345205+0000","last_undegraded":"2023-12-07T21:11:09.345205+0000","last_fullsized":"2023-12-07T21:11:09.345205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.578099+0000","last_change":"2023-12-07T21:12:12.578121+0000","last_active":"2023-12-07T21:12:12.578099+0000","last_peered":"2023-12-07T21:12:12.578099+0000","last_clean":"2023-12-07T21:12:12.578099+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:12:12.578099+0000","last_undegraded":"2023-12-07T21:12:12.578099+0000","last_fullsized":"2023-12-07T21:12:12.578099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.578001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:21:04.951547+0000","scrub_duration":0.0009980639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.222534+0000","last_change":"2023-12-07T21:11:32.222572+0000","last_active":"2023-12-07T21:11:32.222534+0000","last_peered":"2023-12-07T21:11:32.222534+0000","last_clean":"2023-12-07T21:11:32.222534+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:32.222534+0000","last_undegraded":"2023-12-07T21:11:32.222534+0000","last_fullsized":"2023-12-07T21:11:32.222534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.222451+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:29.566323+0000","scrub_duration":0.0042948600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608766+0000","last_change":"2023-12-07T21:09:02.906350+0000","last_active":"2023-12-07T21:11:10.608766+0000","last_peered":"2023-12-07T21:11:10.608766+0000","last_clean":"2023-12-07T21:11:10.608766+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:11:10.608766+0000","last_undegraded":"2023-12-07T21:11:10.608766+0000","last_fullsized":"2023-12-07T21:11:10.608766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809146+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:11:08.809146+0000","last_peered":"2023-12-07T21:11:08.809146+0000","last_clean":"2023-12-07T21:11:08.809146+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:11:08.809146+0000","last_undegraded":"2023-12-07T21:11:08.809146+0000","last_fullsized":"2023-12-07T21:11:08.809146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187764+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:11:10.187764+0000","last_peered":"2023-12-07T21:11:10.187764+0000","last_clean":"2023-12-07T21:11:10.187764+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:11:10.187764+0000","last_undegraded":"2023-12-07T21:11:10.187764+0000","last_fullsized":"2023-12-07T21:11:10.187764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809479+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:11:08.809479+0000","last_peered":"2023-12-07T21:11:08.809479+0000","last_clean":"2023-12-07T21:11:08.809479+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:11:08.809479+0000","last_undegraded":"2023-12-07T21:11:08.809479+0000","last_fullsized":"2023-12-07T21:11:08.809479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:54.784543+0000","last_change":"2023-12-07T21:11:54.784564+0000","last_active":"2023-12-07T21:11:54.784543+0000","last_peered":"2023-12-07T21:11:54.784543+0000","last_clean":"2023-12-07T21:11:54.784543+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:54.784543+0000","last_undegraded":"2023-12-07T21:11:54.784543+0000","last_fullsized":"2023-12-07T21:11:54.784543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_clean_scrub_stamp":"2023-12-07T21:11:54.784441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:06.366596+0000","scrub_duration":0.001044002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.576728+0000","last_change":"2023-12-07T21:11:38.576788+0000","last_active":"2023-12-07T21:11:38.576728+0000","last_peered":"2023-12-07T21:11:38.576728+0000","last_clean":"2023-12-07T21:11:38.576728+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:38.576728+0000","last_undegraded":"2023-12-07T21:11:38.576728+0000","last_fullsized":"2023-12-07T21:11:38.576728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.576637+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:37:48.632379+0000","scrub_duration":0.0068514220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":336,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625017+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625017+0000","last_peered":"2023-12-07T21:11:28.625017+0000","last_clean":"2023-12-07T21:11:28.625017+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625017+0000","last_undegraded":"2023-12-07T21:11:28.625017+0000","last_fullsized":"2023-12-07T21:11:28.625017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.858687+0000","last_change":"2023-12-07T21:12:16.858711+0000","last_active":"2023-12-07T21:12:16.858687+0000","last_peered":"2023-12-07T21:12:16.858687+0000","last_clean":"2023-12-07T21:12:16.858687+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:12:16.858687+0000","last_undegraded":"2023-12-07T21:12:16.858687+0000","last_fullsized":"2023-12-07T21:12:16.858687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.858602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:29:51.847246+0000","scrub_duration":0.0011473449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187852+0000","last_change":"2023-12-07T21:08:56.880261+0000","last_active":"2023-12-07T21:11:10.187852+0000","last_peered":"2023-12-07T21:11:10.187852+0000","last_clean":"2023-12-07T21:11:10.187852+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:11:10.187852+0000","last_undegraded":"2023-12-07T21:11:10.187852+0000","last_fullsized":"2023-12-07T21:11:10.187852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809380+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:11:08.809380+0000","last_peered":"2023-12-07T21:11:08.809380+0000","last_clean":"2023-12-07T21:11:08.809380+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:11:08.809380+0000","last_undegraded":"2023-12-07T21:11:08.809380+0000","last_fullsized":"2023-12-07T21:11:08.809380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.296670+0000","last_change":"2023-12-07T21:11:38.296697+0000","last_active":"2023-12-07T21:11:38.296670+0000","last_peered":"2023-12-07T21:11:38.296670+0000","last_clean":"2023-12-07T21:11:38.296670+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:38.296670+0000","last_undegraded":"2023-12-07T21:11:38.296670+0000","last_fullsized":"2023-12-07T21:11:38.296670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.296568+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:08.533333+0000","scrub_duration":0.0033144630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"31'10","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608582+0000","last_change":"2023-12-07T21:09:00.895566+0000","last_active":"2023-12-07T21:11:10.608582+0000","last_peered":"2023-12-07T21:11:10.608582+0000","last_clean":"2023-12-07T21:11:10.608582+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:11:10.608582+0000","last_undegraded":"2023-12-07T21:11:10.608582+0000","last_fullsized":"2023-12-07T21:11:10.608582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'247","reported_seq":372,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:47.359710+0000","last_change":"2023-12-07T21:11:47.359735+0000","last_active":"2023-12-07T21:11:47.359710+0000","last_peered":"2023-12-07T21:11:47.359710+0000","last_clean":"2023-12-07T21:11:47.359710+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:47.359710+0000","last_undegraded":"2023-12-07T21:11:47.359710+0000","last_fullsized":"2023-12-07T21:11:47.359710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_clean_scrub_stamp":"2023-12-07T21:11:47.359610+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:10.050726+0000","scrub_duration":0.0028663759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.579743+0000","last_change":"2023-12-07T21:12:14.579785+0000","last_active":"2023-12-07T21:12:14.579743+0000","last_peered":"2023-12-07T21:12:14.579743+0000","last_clean":"2023-12-07T21:12:14.579743+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:12:14.579743+0000","last_undegraded":"2023-12-07T21:12:14.579743+0000","last_fullsized":"2023-12-07T21:12:14.579743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.579627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:44.957962+0000","scrub_duration":0.0013656510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.375160+0000","last_change":"2023-12-07T21:12:17.375184+0000","last_active":"2023-12-07T21:12:17.375160+0000","last_peered":"2023-12-07T21:12:17.375160+0000","last_clean":"2023-12-07T21:12:17.375160+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:12:17.375160+0000","last_undegraded":"2023-12-07T21:12:17.375160+0000","last_fullsized":"2023-12-07T21:12:17.375160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.375067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:21:31.008297+0000","scrub_duration":0.001068486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809240+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:11:08.809240+0000","last_peered":"2023-12-07T21:11:08.809240+0000","last_clean":"2023-12-07T21:11:08.809240+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:11:08.809240+0000","last_undegraded":"2023-12-07T21:11:08.809240+0000","last_fullsized":"2023-12-07T21:11:08.809240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.847894+0000","last_change":"2023-12-07T21:11:28.847914+0000","last_active":"2023-12-07T21:11:28.847894+0000","last_peered":"2023-12-07T21:11:28.847894+0000","last_clean":"2023-12-07T21:11:28.847894+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:28.847894+0000","last_undegraded":"2023-12-07T21:11:28.847894+0000","last_fullsized":"2023-12-07T21:11:28.847894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.847797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:20:42.481026+0000","scrub_duration":0.001132973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262716+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262716+0000","last_peered":"2023-12-07T21:11:27.262716+0000","last_clean":"2023-12-07T21:11:27.262716+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262716+0000","last_undegraded":"2023-12-07T21:11:27.262716+0000","last_fullsized":"2023-12-07T21:11:27.262716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.426987+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:14.426987+0000","last_peered":"2023-12-07T21:11:14.426987+0000","last_clean":"2023-12-07T21:11:14.426987+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:14.426987+0000","last_undegraded":"2023-12-07T21:11:14.426987+0000","last_fullsized":"2023-12-07T21:11:14.426987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767450+0000","last_change":"2023-12-07T21:09:04.920277+0000","last_active":"2023-12-07T21:11:09.767450+0000","last_peered":"2023-12-07T21:11:09.767450+0000","last_clean":"2023-12-07T21:11:09.767450+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:11:09.767450+0000","last_undegraded":"2023-12-07T21:11:09.767450+0000","last_fullsized":"2023-12-07T21:11:09.767450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:08.448202+0000","last_change":"2023-12-07T21:12:08.448223+0000","last_active":"2023-12-07T21:12:08.448202+0000","last_peered":"2023-12-07T21:12:08.448202+0000","last_clean":"2023-12-07T21:12:08.448202+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:12:08.448202+0000","last_undegraded":"2023-12-07T21:12:08.448202+0000","last_fullsized":"2023-12-07T21:12:08.448202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_clean_scrub_stamp":"2023-12-07T21:12:08.448115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:53:48.563995+0000","scrub_duration":0.001037821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766378+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:11:09.766378+0000","last_peered":"2023-12-07T21:11:09.766378+0000","last_clean":"2023-12-07T21:11:09.766378+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:11:09.766378+0000","last_undegraded":"2023-12-07T21:11:09.766378+0000","last_fullsized":"2023-12-07T21:11:09.766378+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806332+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:10:53.806332+0000","last_peered":"2023-12-07T21:10:53.806332+0000","last_clean":"2023-12-07T21:10:53.806332+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:10:53.806332+0000","last_undegraded":"2023-12-07T21:10:53.806332+0000","last_fullsized":"2023-12-07T21:10:53.806332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808304+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:11:03.808304+0000","last_peered":"2023-12-07T21:11:03.808304+0000","last_clean":"2023-12-07T21:11:03.808304+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:11:03.808304+0000","last_undegraded":"2023-12-07T21:11:03.808304+0000","last_fullsized":"2023-12-07T21:11:03.808304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.324719+0000","last_change":"2023-12-07T21:11:45.324752+0000","last_active":"2023-12-07T21:11:45.324719+0000","last_peered":"2023-12-07T21:11:45.324719+0000","last_clean":"2023-12-07T21:11:45.324719+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:11:45.324719+0000","last_undegraded":"2023-12-07T21:11:45.324719+0000","last_fullsized":"2023-12-07T21:11:45.324719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.324596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:15.702930+0000","scrub_duration":0.001375037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'79","reported_seq":154,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608522+0000","last_change":"2023-12-07T21:09:00.891338+0000","last_active":"2023-12-07T21:11:10.608522+0000","last_peered":"2023-12-07T21:11:10.608522+0000","last_clean":"2023-12-07T21:11:10.608522+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:11:10.608522+0000","last_undegraded":"2023-12-07T21:11:10.608522+0000","last_fullsized":"2023-12-07T21:11:10.608522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.743690+0000","last_change":"2023-12-07T21:11:42.743712+0000","last_active":"2023-12-07T21:11:42.743690+0000","last_peered":"2023-12-07T21:11:42.743690+0000","last_clean":"2023-12-07T21:11:42.743690+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:42.743690+0000","last_undegraded":"2023-12-07T21:11:42.743690+0000","last_fullsized":"2023-12-07T21:11:42.743690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.743604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:58.016229+0000","scrub_duration":0.001386167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":148,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.433658+0000","last_change":"2023-12-07T21:11:58.433682+0000","last_active":"2023-12-07T21:11:58.433658+0000","last_peered":"2023-12-07T21:11:58.433658+0000","last_clean":"2023-12-07T21:11:58.433658+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:58.433658+0000","last_undegraded":"2023-12-07T21:11:58.433658+0000","last_fullsized":"2023-12-07T21:11:58.433658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.433567+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:08.130743+0000","scrub_duration":0.0014101739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809766+0000","last_change":"2023-12-07T21:08:56.872420+0000","last_active":"2023-12-07T21:11:08.809766+0000","last_peered":"2023-12-07T21:11:08.809766+0000","last_clean":"2023-12-07T21:11:08.809766+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:11:08.809766+0000","last_undegraded":"2023-12-07T21:11:08.809766+0000","last_fullsized":"2023-12-07T21:11:08.809766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607424+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:11:10.607424+0000","last_peered":"2023-12-07T21:11:10.607424+0000","last_clean":"2023-12-07T21:11:10.607424+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:11:10.607424+0000","last_undegraded":"2023-12-07T21:11:10.607424+0000","last_fullsized":"2023-12-07T21:11:10.607424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800912+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:11:03.800912+0000","last_peered":"2023-12-07T21:11:03.800912+0000","last_clean":"2023-12-07T21:11:03.800912+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:11:03.800912+0000","last_undegraded":"2023-12-07T21:11:03.800912+0000","last_fullsized":"2023-12-07T21:11:03.800912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.687459+0000","last_change":"2023-12-07T21:11:32.687480+0000","last_active":"2023-12-07T21:11:32.687459+0000","last_peered":"2023-12-07T21:11:32.687459+0000","last_clean":"2023-12-07T21:11:32.687459+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:32.687459+0000","last_undegraded":"2023-12-07T21:11:32.687459+0000","last_fullsized":"2023-12-07T21:11:32.687459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.687375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:18:45.906213+0000","scrub_duration":0.001283024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":450,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148355+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148355+0000","last_peered":"2023-12-07T21:11:18.148355+0000","last_clean":"2023-12-07T21:11:18.148355+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148355+0000","last_undegraded":"2023-12-07T21:11:18.148355+0000","last_fullsized":"2023-12-07T21:11:18.148355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:25.481129+0000","last_change":"2023-12-07T21:12:25.481161+0000","last_active":"2023-12-07T21:12:25.481129+0000","last_peered":"2023-12-07T21:12:25.481129+0000","last_clean":"2023-12-07T21:12:25.481129+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:12:25.481129+0000","last_undegraded":"2023-12-07T21:12:25.481129+0000","last_fullsized":"2023-12-07T21:12:25.481129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_clean_scrub_stamp":"2023-12-07T21:12:25.481005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:33:44.071058+0000","scrub_duration":0.001267064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767469+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:11:09.767469+0000","last_peered":"2023-12-07T21:11:09.767469+0000","last_clean":"2023-12-07T21:11:09.767469+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:11:09.767469+0000","last_undegraded":"2023-12-07T21:11:09.767469+0000","last_fullsized":"2023-12-07T21:11:09.767469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802682+0000","last_change":"2023-12-07T21:08:56.883281+0000","last_active":"2023-12-07T21:11:08.802682+0000","last_peered":"2023-12-07T21:11:08.802682+0000","last_clean":"2023-12-07T21:11:08.802682+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:11:08.802682+0000","last_undegraded":"2023-12-07T21:11:08.802682+0000","last_fullsized":"2023-12-07T21:11:08.802682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.804204+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:10:53.804204+0000","last_peered":"2023-12-07T21:10:53.804204+0000","last_clean":"2023-12-07T21:10:53.804204+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:10:53.804204+0000","last_undegraded":"2023-12-07T21:10:53.804204+0000","last_fullsized":"2023-12-07T21:10:53.804204+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.799875+0000","last_change":"2023-12-07T21:08:54.881937+0000","last_active":"2023-12-07T21:10:58.799875+0000","last_peered":"2023-12-07T21:10:58.799875+0000","last_clean":"2023-12-07T21:10:58.799875+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:10:58.799875+0000","last_undegraded":"2023-12-07T21:10:58.799875+0000","last_fullsized":"2023-12-07T21:10:58.799875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.627959+0000","last_change":"2023-12-07T21:12:15.627991+0000","last_active":"2023-12-07T21:12:15.627959+0000","last_peered":"2023-12-07T21:12:15.627959+0000","last_clean":"2023-12-07T21:12:15.627959+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:12:15.627959+0000","last_undegraded":"2023-12-07T21:12:15.627959+0000","last_fullsized":"2023-12-07T21:12:15.627959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.627865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:38.318981+0000","scrub_duration":0.0028926030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'25","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:46.537878+0000","last_change":"2023-12-07T21:11:46.537922+0000","last_active":"2023-12-07T21:11:46.537878+0000","last_peered":"2023-12-07T21:11:46.537878+0000","last_clean":"2023-12-07T21:11:46.537878+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:46.537878+0000","last_undegraded":"2023-12-07T21:11:46.537878+0000","last_fullsized":"2023-12-07T21:11:46.537878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_clean_scrub_stamp":"2023-12-07T21:11:46.537795+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:57.338431+0000","scrub_duration":0.0057357379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642676+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642676+0000","last_peered":"2023-12-07T21:11:12.642676+0000","last_clean":"2023-12-07T21:11:12.642676+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642676+0000","last_undegraded":"2023-12-07T21:11:12.642676+0000","last_fullsized":"2023-12-07T21:11:12.642676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608815+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:11:10.608815+0000","last_peered":"2023-12-07T21:11:10.608815+0000","last_clean":"2023-12-07T21:11:10.608815+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:11:10.608815+0000","last_undegraded":"2023-12-07T21:11:10.608815+0000","last_fullsized":"2023-12-07T21:11:10.608815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801285+0000","last_change":"2023-12-07T21:08:56.872455+0000","last_active":"2023-12-07T21:11:03.801285+0000","last_peered":"2023-12-07T21:11:03.801285+0000","last_clean":"2023-12-07T21:11:03.801285+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:11:03.801285+0000","last_undegraded":"2023-12-07T21:11:03.801285+0000","last_fullsized":"2023-12-07T21:11:03.801285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806222+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:10:53.806222+0000","last_peered":"2023-12-07T21:10:53.806222+0000","last_clean":"2023-12-07T21:10:53.806222+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:10:53.806222+0000","last_undegraded":"2023-12-07T21:10:53.806222+0000","last_fullsized":"2023-12-07T21:10:53.806222+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806975+0000","last_change":"2023-12-07T21:08:54.880674+0000","last_active":"2023-12-07T21:11:03.806975+0000","last_peered":"2023-12-07T21:11:03.806975+0000","last_clean":"2023-12-07T21:11:03.806975+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:11:03.806975+0000","last_undegraded":"2023-12-07T21:11:03.806975+0000","last_fullsized":"2023-12-07T21:11:03.806975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:57.727189+0000","last_change":"2023-12-07T21:11:57.727223+0000","last_active":"2023-12-07T21:11:57.727189+0000","last_peered":"2023-12-07T21:11:57.727189+0000","last_clean":"2023-12-07T21:11:57.727189+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:11:57.727189+0000","last_undegraded":"2023-12-07T21:11:57.727189+0000","last_fullsized":"2023-12-07T21:11:57.727189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_clean_scrub_stamp":"2023-12-07T21:11:57.727085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:53.015740+0000","scrub_duration":0.0013430639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608529+0000","last_change":"2023-12-07T21:09:00.892022+0000","last_active":"2023-12-07T21:11:10.608529+0000","last_peered":"2023-12-07T21:11:10.608529+0000","last_clean":"2023-12-07T21:11:10.608529+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:11:10.608529+0000","last_undegraded":"2023-12-07T21:11:10.608529+0000","last_fullsized":"2023-12-07T21:11:10.608529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608704+0000","last_change":"2023-12-07T21:09:02.907037+0000","last_active":"2023-12-07T21:11:10.608704+0000","last_peered":"2023-12-07T21:11:10.608704+0000","last_clean":"2023-12-07T21:11:10.608704+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:11:10.608704+0000","last_undegraded":"2023-12-07T21:11:10.608704+0000","last_fullsized":"2023-12-07T21:11:10.608704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767468+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:11:09.767468+0000","last_peered":"2023-12-07T21:11:09.767468+0000","last_clean":"2023-12-07T21:11:09.767468+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:11:09.767468+0000","last_undegraded":"2023-12-07T21:11:09.767468+0000","last_fullsized":"2023-12-07T21:11:09.767468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806997+0000","last_change":"2023-12-07T21:08:56.882954+0000","last_active":"2023-12-07T21:11:03.806997+0000","last_peered":"2023-12-07T21:11:03.806997+0000","last_clean":"2023-12-07T21:11:03.806997+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:11:03.806997+0000","last_undegraded":"2023-12-07T21:11:03.806997+0000","last_fullsized":"2023-12-07T21:11:03.806997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807157+0000","last_change":"2023-12-07T21:08:54.881143+0000","last_active":"2023-12-07T21:11:03.807157+0000","last_peered":"2023-12-07T21:11:03.807157+0000","last_clean":"2023-12-07T21:11:03.807157+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:11:03.807157+0000","last_undegraded":"2023-12-07T21:11:03.807157+0000","last_fullsized":"2023-12-07T21:11:03.807157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.799061+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:10:53.799061+0000","last_peered":"2023-12-07T21:10:53.799061+0000","last_clean":"2023-12-07T21:10:53.799061+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:10:53.799061+0000","last_undegraded":"2023-12-07T21:10:53.799061+0000","last_fullsized":"2023-12-07T21:10:53.799061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.771922+0000","last_change":"2023-12-07T21:12:11.771944+0000","last_active":"2023-12-07T21:12:11.771922+0000","last_peered":"2023-12-07T21:12:11.771922+0000","last_clean":"2023-12-07T21:12:11.771922+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:12:11.771922+0000","last_undegraded":"2023-12-07T21:12:11.771922+0000","last_fullsized":"2023-12-07T21:12:11.771922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.771816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:43.210676+0000","scrub_duration":0.0013479799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'72","reported_seq":141,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.762966+0000","last_change":"2023-12-07T21:11:45.763012+0000","last_active":"2023-12-07T21:11:45.762966+0000","last_peered":"2023-12-07T21:11:45.762966+0000","last_clean":"2023-12-07T21:11:45.762966+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:45.762966+0000","last_undegraded":"2023-12-07T21:11:45.762966+0000","last_fullsized":"2023-12-07T21:11:45.762966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.762875+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:27:47.809323+0000","scrub_duration":0.006706058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594393+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594393+0000","last_peered":"2023-12-07T21:11:25.594393+0000","last_clean":"2023-12-07T21:11:25.594393+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594393+0000","last_undegraded":"2023-12-07T21:11:25.594393+0000","last_fullsized":"2023-12-07T21:11:25.594393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345934+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:11:09.345934+0000","last_peered":"2023-12-07T21:11:09.345934+0000","last_clean":"2023-12-07T21:11:09.345934+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:11:09.345934+0000","last_undegraded":"2023-12-07T21:11:09.345934+0000","last_fullsized":"2023-12-07T21:11:09.345934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.332893+0000","last_change":"2023-12-07T21:12:42.332914+0000","last_active":"2023-12-07T21:12:42.332893+0000","last_peered":"2023-12-07T21:12:42.332893+0000","last_clean":"2023-12-07T21:12:42.332893+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:12:42.332893+0000","last_undegraded":"2023-12-07T21:12:42.332893+0000","last_fullsized":"2023-12-07T21:12:42.332893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.332776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:52.088170+0000","scrub_duration":0.00097994699999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801254+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:11:03.801254+0000","last_peered":"2023-12-07T21:11:03.801254+0000","last_clean":"2023-12-07T21:11:03.801254+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:11:03.801254+0000","last_undegraded":"2023-12-07T21:11:03.801254+0000","last_fullsized":"2023-12-07T21:11:03.801254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:53.806441+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:10:53.806441+0000","last_peered":"2023-12-07T21:10:53.806441+0000","last_clean":"2023-12-07T21:10:53.806441+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:10:53.806441+0000","last_undegraded":"2023-12-07T21:10:53.806441+0000","last_fullsized":"2023-12-07T21:10:53.806441+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.626455+0000","last_change":"2023-12-07T21:11:42.626478+0000","last_active":"2023-12-07T21:11:42.626455+0000","last_peered":"2023-12-07T21:11:42.626455+0000","last_clean":"2023-12-07T21:11:42.626455+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:11:42.626455+0000","last_undegraded":"2023-12-07T21:11:42.626455+0000","last_fullsized":"2023-12-07T21:11:42.626455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.626356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:23.689571+0000","scrub_duration":0.001348258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.225002+0000","last_change":"2023-12-07T21:11:33.225043+0000","last_active":"2023-12-07T21:11:33.225002+0000","last_peered":"2023-12-07T21:11:33.225002+0000","last_clean":"2023-12-07T21:11:33.225002+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:33.225002+0000","last_undegraded":"2023-12-07T21:11:33.225002+0000","last_fullsized":"2023-12-07T21:11:33.225002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.224920+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:12.396025+0000","scrub_duration":0.0049945800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":300,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.065927+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:11:20.065927+0000","last_peered":"2023-12-07T21:11:20.065927+0000","last_clean":"2023-12-07T21:11:20.065927+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:20.065927+0000","last_undegraded":"2023-12-07T21:11:20.065927+0000","last_fullsized":"2023-12-07T21:11:20.065927+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608840+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:11:10.608840+0000","last_peered":"2023-12-07T21:11:10.608840+0000","last_clean":"2023-12-07T21:11:10.608840+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:11:10.608840+0000","last_undegraded":"2023-12-07T21:11:10.608840+0000","last_fullsized":"2023-12-07T21:11:10.608840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.807179+0000","last_change":"2023-12-07T21:08:56.887962+0000","last_active":"2023-12-07T21:10:58.807179+0000","last_peered":"2023-12-07T21:10:58.807179+0000","last_clean":"2023-12-07T21:10:58.807179+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:10:58.807179+0000","last_undegraded":"2023-12-07T21:10:58.807179+0000","last_fullsized":"2023-12-07T21:10:58.807179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809841+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:11:08.809841+0000","last_peered":"2023-12-07T21:11:08.809841+0000","last_clean":"2023-12-07T21:11:08.809841+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:11:08.809841+0000","last_undegraded":"2023-12-07T21:11:08.809841+0000","last_fullsized":"2023-12-07T21:11:08.809841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800250+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:10:58.800250+0000","last_peered":"2023-12-07T21:10:58.800250+0000","last_clean":"2023-12-07T21:10:58.800250+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:10:58.800250+0000","last_undegraded":"2023-12-07T21:10:58.800250+0000","last_fullsized":"2023-12-07T21:10:58.800250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.865875+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:11:18.865875+0000","last_peered":"2023-12-07T21:11:18.865875+0000","last_clean":"2023-12-07T21:11:18.865875+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:11:18.865875+0000","last_undegraded":"2023-12-07T21:11:18.865875+0000","last_fullsized":"2023-12-07T21:11:18.865875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:44.632612+0000","last_change":"2023-12-07T21:12:44.632651+0000","last_active":"2023-12-07T21:12:44.632612+0000","last_peered":"2023-12-07T21:12:44.632612+0000","last_clean":"2023-12-07T21:12:44.632612+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:12:44.632612+0000","last_undegraded":"2023-12-07T21:12:44.632612+0000","last_fullsized":"2023-12-07T21:12:44.632612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_clean_scrub_stamp":"2023-12-07T21:12:44.632504+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:24.020207+0000","scrub_duration":0.0053067840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":368,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712206+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712206+0000","last_peered":"2023-12-07T21:11:18.712206+0000","last_clean":"2023-12-07T21:11:18.712206+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712206+0000","last_undegraded":"2023-12-07T21:11:18.712206+0000","last_fullsized":"2023-12-07T21:11:18.712206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767478+0000","last_change":"2023-12-07T21:09:04.929420+0000","last_active":"2023-12-07T21:11:09.767478+0000","last_peered":"2023-12-07T21:11:09.767478+0000","last_clean":"2023-12-07T21:11:09.767478+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:11:09.767478+0000","last_undegraded":"2023-12-07T21:11:09.767478+0000","last_fullsized":"2023-12-07T21:11:09.767478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:43.441593+0000","last_change":"2023-12-07T21:12:43.441643+0000","last_active":"2023-12-07T21:12:43.441593+0000","last_peered":"2023-12-07T21:12:43.441593+0000","last_clean":"2023-12-07T21:12:43.441593+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:12:43.441593+0000","last_undegraded":"2023-12-07T21:12:43.441593+0000","last_fullsized":"2023-12-07T21:12:43.441593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_clean_scrub_stamp":"2023-12-07T21:12:43.441484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:24.768617+0000","scrub_duration":0.0011182029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808876+0000","last_change":"2023-12-07T21:08:54.888557+0000","last_active":"2023-12-07T21:11:08.808876+0000","last_peered":"2023-12-07T21:11:08.808876+0000","last_clean":"2023-12-07T21:11:08.808876+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:11:08.808876+0000","last_undegraded":"2023-12-07T21:11:08.808876+0000","last_fullsized":"2023-12-07T21:11:08.808876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.807661+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:10:58.807661+0000","last_peered":"2023-12-07T21:10:58.807661+0000","last_clean":"2023-12-07T21:10:58.807661+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:10:58.807661+0000","last_undegraded":"2023-12-07T21:10:58.807661+0000","last_fullsized":"2023-12-07T21:10:58.807661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:37.651284+0000","last_change":"2023-12-07T21:11:37.651334+0000","last_active":"2023-12-07T21:11:37.651284+0000","last_peered":"2023-12-07T21:11:37.651284+0000","last_clean":"2023-12-07T21:11:37.651284+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:11:37.651284+0000","last_undegraded":"2023-12-07T21:11:37.651284+0000","last_fullsized":"2023-12-07T21:11:37.651284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_clean_scrub_stamp":"2023-12-07T21:11:37.651191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:09.090050+0000","scrub_duration":0.0012443790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'94","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:05.544462+0000","last_change":"2023-12-07T21:12:05.544503+0000","last_active":"2023-12-07T21:12:05.544462+0000","last_peered":"2023-12-07T21:12:05.544462+0000","last_clean":"2023-12-07T21:12:05.544462+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:12:05.544462+0000","last_undegraded":"2023-12-07T21:12:05.544462+0000","last_fullsized":"2023-12-07T21:12:05.544462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'94","last_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_deep_scrub":"33'94","last_deep_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_clean_scrub_stamp":"2023-12-07T21:12:05.544369+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:32:13.323537+0000","scrub_duration":0.006343095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.831630+0000","last_change":"2023-12-07T21:11:52.831678+0000","last_active":"2023-12-07T21:11:52.831630+0000","last_peered":"2023-12-07T21:11:52.831630+0000","last_clean":"2023-12-07T21:11:52.831630+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:52.831630+0000","last_undegraded":"2023-12-07T21:11:52.831630+0000","last_fullsized":"2023-12-07T21:11:52.831630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.831531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:22.265020+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188437+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:11:10.188437+0000","last_peered":"2023-12-07T21:11:10.188437+0000","last_clean":"2023-12-07T21:11:10.188437+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:11:10.188437+0000","last_undegraded":"2023-12-07T21:11:10.188437+0000","last_fullsized":"2023-12-07T21:11:10.188437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.528399+0000","last_change":"2023-12-07T21:12:23.528421+0000","last_active":"2023-12-07T21:12:23.528399+0000","last_peered":"2023-12-07T21:12:23.528399+0000","last_clean":"2023-12-07T21:12:23.528399+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:12:23.528399+0000","last_undegraded":"2023-12-07T21:12:23.528399+0000","last_fullsized":"2023-12-07T21:12:23.528399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.528299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:52.961788+0000","scrub_duration":0.00098274400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187815+0000","last_change":"2023-12-07T21:08:56.877160+0000","last_active":"2023-12-07T21:11:10.187815+0000","last_peered":"2023-12-07T21:11:10.187815+0000","last_clean":"2023-12-07T21:11:10.187815+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:11:10.187815+0000","last_undegraded":"2023-12-07T21:11:10.187815+0000","last_fullsized":"2023-12-07T21:11:10.187815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607705+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:11:10.607705+0000","last_peered":"2023-12-07T21:11:10.607705+0000","last_clean":"2023-12-07T21:11:10.607705+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:11:10.607705+0000","last_undegraded":"2023-12-07T21:11:10.607705+0000","last_fullsized":"2023-12-07T21:11:10.607705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.299949+0000","last_change":"2023-12-07T21:11:39.299988+0000","last_active":"2023-12-07T21:11:39.299949+0000","last_peered":"2023-12-07T21:11:39.299949+0000","last_clean":"2023-12-07T21:11:39.299949+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:39.299949+0000","last_undegraded":"2023-12-07T21:11:39.299949+0000","last_fullsized":"2023-12-07T21:11:39.299949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.299849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:48.997025+0000","scrub_duration":0.001356866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.839849+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:20.839849+0000","last_peered":"2023-12-07T21:11:20.839849+0000","last_clean":"2023-12-07T21:11:20.839849+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:20.839849+0000","last_undegraded":"2023-12-07T21:11:20.839849+0000","last_fullsized":"2023-12-07T21:11:20.839849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608769+0000","last_change":"2023-12-07T21:09:02.907875+0000","last_active":"2023-12-07T21:11:10.608769+0000","last_peered":"2023-12-07T21:11:10.608769+0000","last_clean":"2023-12-07T21:11:10.608769+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:11:10.608769+0000","last_undegraded":"2023-12-07T21:11:10.608769+0000","last_fullsized":"2023-12-07T21:11:10.608769+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802571+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:11:08.802571+0000","last_peered":"2023-12-07T21:11:08.802571+0000","last_clean":"2023-12-07T21:11:08.802571+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:11:08.802571+0000","last_undegraded":"2023-12-07T21:11:08.802571+0000","last_fullsized":"2023-12-07T21:11:08.802571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766751+0000","last_change":"2023-12-07T21:08:56.879187+0000","last_active":"2023-12-07T21:11:09.766751+0000","last_peered":"2023-12-07T21:11:09.766751+0000","last_clean":"2023-12-07T21:11:09.766751+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:11:09.766751+0000","last_undegraded":"2023-12-07T21:11:09.766751+0000","last_fullsized":"2023-12-07T21:11:09.766751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187534+0000","last_change":"2023-12-07T21:08:54.880755+0000","last_active":"2023-12-07T21:11:10.187534+0000","last_peered":"2023-12-07T21:11:10.187534+0000","last_clean":"2023-12-07T21:11:10.187534+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:11:10.187534+0000","last_undegraded":"2023-12-07T21:11:10.187534+0000","last_fullsized":"2023-12-07T21:11:10.187534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.790833+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:15.790833+0000","last_peered":"2023-12-07T21:11:15.790833+0000","last_clean":"2023-12-07T21:11:15.790833+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:15.790833+0000","last_undegraded":"2023-12-07T21:11:15.790833+0000","last_fullsized":"2023-12-07T21:11:15.790833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'9","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.887014+0000","last_change":"2023-12-07T21:11:50.887056+0000","last_active":"2023-12-07T21:11:50.887014+0000","last_peered":"2023-12-07T21:11:50.887014+0000","last_clean":"2023-12-07T21:11:50.887014+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:50.887014+0000","last_undegraded":"2023-12-07T21:11:50.887014+0000","last_fullsized":"2023-12-07T21:11:50.887014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.886922+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:02.989113+0000","scrub_duration":0.0042007399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:19.515594+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:19.515594+0000","last_peered":"2023-12-07T21:11:19.515594+0000","last_clean":"2023-12-07T21:11:19.515594+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:19.515594+0000","last_undegraded":"2023-12-07T21:11:19.515594+0000","last_fullsized":"2023-12-07T21:11:19.515594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345954+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:11:09.345954+0000","last_peered":"2023-12-07T21:11:09.345954+0000","last_clean":"2023-12-07T21:11:09.345954+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:11:09.345954+0000","last_undegraded":"2023-12-07T21:11:09.345954+0000","last_fullsized":"2023-12-07T21:11:09.345954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345219+0000","last_change":"2023-12-07T21:08:56.874712+0000","last_active":"2023-12-07T21:11:09.345219+0000","last_peered":"2023-12-07T21:11:09.345219+0000","last_clean":"2023-12-07T21:11:09.345219+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:11:09.345219+0000","last_undegraded":"2023-12-07T21:11:09.345219+0000","last_fullsized":"2023-12-07T21:11:09.345219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187591+0000","last_change":"2023-12-07T21:08:54.885182+0000","last_active":"2023-12-07T21:11:10.187591+0000","last_peered":"2023-12-07T21:11:10.187591+0000","last_clean":"2023-12-07T21:11:10.187591+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:11:10.187591+0000","last_undegraded":"2023-12-07T21:11:10.187591+0000","last_fullsized":"2023-12-07T21:11:10.187591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.605088+0000","last_change":"2023-12-07T21:12:18.605108+0000","last_active":"2023-12-07T21:12:18.605088+0000","last_peered":"2023-12-07T21:12:18.605088+0000","last_clean":"2023-12-07T21:12:18.605088+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:12:18.605088+0000","last_undegraded":"2023-12-07T21:12:18.605088+0000","last_fullsized":"2023-12-07T21:12:18.605088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.605002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:30.707193+0000","scrub_duration":0.00090833899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.678798+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:11.678798+0000","last_peered":"2023-12-07T21:11:11.678798+0000","last_clean":"2023-12-07T21:11:11.678798+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:11.678798+0000","last_undegraded":"2023-12-07T21:11:11.678798+0000","last_fullsized":"2023-12-07T21:11:11.678798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.302787+0000","last_change":"2023-12-07T21:11:36.302809+0000","last_active":"2023-12-07T21:11:36.302787+0000","last_peered":"2023-12-07T21:11:36.302787+0000","last_clean":"2023-12-07T21:11:36.302787+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:36.302787+0000","last_undegraded":"2023-12-07T21:11:36.302787+0000","last_fullsized":"2023-12-07T21:11:36.302787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.302687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:01.567462+0000","scrub_duration":0.0014296669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608968+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:11:10.608968+0000","last_peered":"2023-12-07T21:11:10.608968+0000","last_clean":"2023-12-07T21:11:10.608968+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:11:10.608968+0000","last_undegraded":"2023-12-07T21:11:10.608968+0000","last_fullsized":"2023-12-07T21:11:10.608968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608103+0000","last_change":"2023-12-07T21:08:56.887184+0000","last_active":"2023-12-07T21:11:10.608103+0000","last_peered":"2023-12-07T21:11:10.608103+0000","last_clean":"2023-12-07T21:11:10.608103+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:11:10.608103+0000","last_undegraded":"2023-12-07T21:11:10.608103+0000","last_fullsized":"2023-12-07T21:11:10.608103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766431+0000","last_change":"2023-12-07T21:08:54.878542+0000","last_active":"2023-12-07T21:11:09.766431+0000","last_peered":"2023-12-07T21:11:09.766431+0000","last_clean":"2023-12-07T21:11:09.766431+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:11:09.766431+0000","last_undegraded":"2023-12-07T21:11:09.766431+0000","last_fullsized":"2023-12-07T21:11:09.766431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.514123+0000","last_change":"2023-12-07T21:11:52.514142+0000","last_active":"2023-12-07T21:11:52.514123+0000","last_peered":"2023-12-07T21:11:52.514123+0000","last_clean":"2023-12-07T21:11:52.514123+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:52.514123+0000","last_undegraded":"2023-12-07T21:11:52.514123+0000","last_fullsized":"2023-12-07T21:11:52.514123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.514035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:00:51.180837+0000","scrub_duration":0.00101976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.532757+0000","last_change":"2023-12-07T21:11:32.532802+0000","last_active":"2023-12-07T21:11:32.532757+0000","last_peered":"2023-12-07T21:11:32.532757+0000","last_clean":"2023-12-07T21:11:32.532757+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:32.532757+0000","last_undegraded":"2023-12-07T21:11:32.532757+0000","last_fullsized":"2023-12-07T21:11:32.532757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.532666+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:34.382885+0000","scrub_duration":0.0035860219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.544268+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:17.544268+0000","last_peered":"2023-12-07T21:11:17.544268+0000","last_clean":"2023-12-07T21:11:17.544268+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:17.544268+0000","last_undegraded":"2023-12-07T21:11:17.544268+0000","last_fullsized":"2023-12-07T21:11:17.544268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808681+0000","last_change":"2023-12-07T21:08:56.873185+0000","last_active":"2023-12-07T21:11:03.808681+0000","last_peered":"2023-12-07T21:11:03.808681+0000","last_clean":"2023-12-07T21:11:03.808681+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:11:03.808681+0000","last_undegraded":"2023-12-07T21:11:03.808681+0000","last_fullsized":"2023-12-07T21:11:03.808681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607720+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:11:10.607720+0000","last_peered":"2023-12-07T21:11:10.607720+0000","last_clean":"2023-12-07T21:11:10.607720+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:11:10.607720+0000","last_undegraded":"2023-12-07T21:11:10.607720+0000","last_fullsized":"2023-12-07T21:11:10.607720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:59.757098+0000","last_change":"2023-12-07T21:11:59.757120+0000","last_active":"2023-12-07T21:11:59.757098+0000","last_peered":"2023-12-07T21:11:59.757098+0000","last_clean":"2023-12-07T21:11:59.757098+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:11:59.757098+0000","last_undegraded":"2023-12-07T21:11:59.757098+0000","last_fullsized":"2023-12-07T21:11:59.757098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_clean_scrub_stamp":"2023-12-07T21:11:59.757017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:04:59.018197+0000","scrub_duration":0.001196353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'61","reported_seq":127,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.783931+0000","last_change":"2023-12-07T21:11:44.783993+0000","last_active":"2023-12-07T21:11:44.783931+0000","last_peered":"2023-12-07T21:11:44.783931+0000","last_clean":"2023-12-07T21:11:44.783931+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:44.783931+0000","last_undegraded":"2023-12-07T21:11:44.783931+0000","last_fullsized":"2023-12-07T21:11:44.783931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.783824+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:07.474940+0000","scrub_duration":0.004588193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.558888+0000","last_change":"2023-12-07T21:11:36.558908+0000","last_active":"2023-12-07T21:11:36.558888+0000","last_peered":"2023-12-07T21:11:36.558888+0000","last_clean":"2023-12-07T21:11:36.558888+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:11:36.558888+0000","last_undegraded":"2023-12-07T21:11:36.558888+0000","last_fullsized":"2023-12-07T21:11:36.558888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.558807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:33:06.320086+0000","scrub_duration":0.001387288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345942+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:11:09.345942+0000","last_peered":"2023-12-07T21:11:09.345942+0000","last_clean":"2023-12-07T21:11:09.345942+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:11:09.345942+0000","last_undegraded":"2023-12-07T21:11:09.345942+0000","last_fullsized":"2023-12-07T21:11:09.345942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:19.862158+0000","last_change":"2023-12-07T21:12:19.862179+0000","last_active":"2023-12-07T21:12:19.862158+0000","last_peered":"2023-12-07T21:12:19.862158+0000","last_clean":"2023-12-07T21:12:19.862158+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:12:19.862158+0000","last_undegraded":"2023-12-07T21:12:19.862158+0000","last_fullsized":"2023-12-07T21:12:19.862158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_clean_scrub_stamp":"2023-12-07T21:12:19.862069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:34.168058+0000","scrub_duration":0.0015085669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766432+0000","last_change":"2023-12-07T21:08:54.882363+0000","last_active":"2023-12-07T21:11:09.766432+0000","last_peered":"2023-12-07T21:11:09.766432+0000","last_clean":"2023-12-07T21:11:09.766432+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:11:09.766432+0000","last_undegraded":"2023-12-07T21:11:09.766432+0000","last_fullsized":"2023-12-07T21:11:09.766432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807381+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:11:03.807381+0000","last_peered":"2023-12-07T21:11:03.807381+0000","last_clean":"2023-12-07T21:11:03.807381+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:11:03.807381+0000","last_undegraded":"2023-12-07T21:11:03.807381+0000","last_fullsized":"2023-12-07T21:11:03.807381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.514700+0000","last_change":"2023-12-07T21:12:21.514738+0000","last_active":"2023-12-07T21:12:21.514700+0000","last_peered":"2023-12-07T21:12:21.514700+0000","last_clean":"2023-12-07T21:12:21.514700+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:12:21.514700+0000","last_undegraded":"2023-12-07T21:12:21.514700+0000","last_fullsized":"2023-12-07T21:12:21.514700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.514603+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:11.760175+0000","scrub_duration":0.0065721260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:13.398971+0000","last_change":"2023-12-07T21:12:13.399009+0000","last_active":"2023-12-07T21:12:13.398971+0000","last_peered":"2023-12-07T21:12:13.398971+0000","last_clean":"2023-12-07T21:12:13.398971+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:12:13.398971+0000","last_undegraded":"2023-12-07T21:12:13.398971+0000","last_fullsized":"2023-12-07T21:12:13.398971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_clean_scrub_stamp":"2023-12-07T21:12:13.398859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:54.725992+0000","scrub_duration":0.0011359600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608912+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:11:10.608912+0000","last_peered":"2023-12-07T21:11:10.608912+0000","last_clean":"2023-12-07T21:11:10.608912+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:11:10.608912+0000","last_undegraded":"2023-12-07T21:11:10.608912+0000","last_fullsized":"2023-12-07T21:11:10.608912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.432371+0000","last_change":"2023-12-07T21:12:11.432392+0000","last_active":"2023-12-07T21:12:11.432371+0000","last_peered":"2023-12-07T21:12:11.432371+0000","last_clean":"2023-12-07T21:12:11.432371+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:12:11.432371+0000","last_undegraded":"2023-12-07T21:12:11.432371+0000","last_fullsized":"2023-12-07T21:12:11.432371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.432277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:48.190145+0000","scrub_duration":0.0010618419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766451+0000","last_change":"2023-12-07T21:08:54.887587+0000","last_active":"2023-12-07T21:11:09.766451+0000","last_peered":"2023-12-07T21:11:09.766451+0000","last_clean":"2023-12-07T21:11:09.766451+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:11:09.766451+0000","last_undegraded":"2023-12-07T21:11:09.766451+0000","last_fullsized":"2023-12-07T21:11:09.766451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:10.553115+0000","last_change":"2023-12-07T21:12:10.553135+0000","last_active":"2023-12-07T21:12:10.553115+0000","last_peered":"2023-12-07T21:12:10.553115+0000","last_clean":"2023-12-07T21:12:10.553115+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:12:10.553115+0000","last_undegraded":"2023-12-07T21:12:10.553115+0000","last_fullsized":"2023-12-07T21:12:10.553115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_clean_scrub_stamp":"2023-12-07T21:12:10.553023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:52.504367+0000","scrub_duration":0.0013037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.745145+0000","last_change":"2023-12-07T21:11:36.745178+0000","last_active":"2023-12-07T21:11:36.745145+0000","last_peered":"2023-12-07T21:11:36.745145+0000","last_clean":"2023-12-07T21:11:36.745145+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:36.745145+0000","last_undegraded":"2023-12-07T21:11:36.745145+0000","last_fullsized":"2023-12-07T21:11:36.745145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.745068+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:09.080620+0000","scrub_duration":0.0072373669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:16.616692+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:11:16.616692+0000","last_peered":"2023-12-07T21:11:16.616692+0000","last_clean":"2023-12-07T21:11:16.616692+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:11:16.616692+0000","last_undegraded":"2023-12-07T21:11:16.616692+0000","last_fullsized":"2023-12-07T21:11:16.616692+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608884+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:11:10.608884+0000","last_peered":"2023-12-07T21:11:10.608884+0000","last_clean":"2023-12-07T21:11:10.608884+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:11:10.608884+0000","last_undegraded":"2023-12-07T21:11:10.608884+0000","last_fullsized":"2023-12-07T21:11:10.608884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'3","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345230+0000","last_change":"2023-12-07T21:08:56.872465+0000","last_active":"2023-12-07T21:11:09.345230+0000","last_peered":"2023-12-07T21:11:09.345230+0000","last_clean":"2023-12-07T21:11:09.345230+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:11:09.345230+0000","last_undegraded":"2023-12-07T21:11:09.345230+0000","last_fullsized":"2023-12-07T21:11:09.345230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607746+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:11:10.607746+0000","last_peered":"2023-12-07T21:11:10.607746+0000","last_clean":"2023-12-07T21:11:10.607746+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:11:10.607746+0000","last_undegraded":"2023-12-07T21:11:10.607746+0000","last_fullsized":"2023-12-07T21:11:10.607746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.324406+0000","last_change":"2023-12-07T21:11:41.324449+0000","last_active":"2023-12-07T21:11:41.324406+0000","last_peered":"2023-12-07T21:11:41.324406+0000","last_clean":"2023-12-07T21:11:41.324406+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:41.324406+0000","last_undegraded":"2023-12-07T21:11:41.324406+0000","last_fullsized":"2023-12-07T21:11:41.324406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.324294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:18:22.956309+0000","scrub_duration":0.001431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.649677+0000","last_change":"2023-12-07T21:12:42.649725+0000","last_active":"2023-12-07T21:12:42.649677+0000","last_peered":"2023-12-07T21:12:42.649677+0000","last_clean":"2023-12-07T21:12:42.649677+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:12:42.649677+0000","last_undegraded":"2023-12-07T21:12:42.649677+0000","last_fullsized":"2023-12-07T21:12:42.649677+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.649582+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:55:46.065006+0000","scrub_duration":0.0041186950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411900+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411900+0000","last_peered":"2023-12-07T21:11:10.411900+0000","last_clean":"2023-12-07T21:11:10.411900+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411900+0000","last_undegraded":"2023-12-07T21:11:10.411900+0000","last_fullsized":"2023-12-07T21:11:10.411900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608864+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:11:10.608864+0000","last_peered":"2023-12-07T21:11:10.608864+0000","last_clean":"2023-12-07T21:11:10.608864+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:11:10.608864+0000","last_undegraded":"2023-12-07T21:11:10.608864+0000","last_fullsized":"2023-12-07T21:11:10.608864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187884+0000","last_change":"2023-12-07T21:08:56.871124+0000","last_active":"2023-12-07T21:11:10.187884+0000","last_peered":"2023-12-07T21:11:10.187884+0000","last_clean":"2023-12-07T21:11:10.187884+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:11:10.187884+0000","last_undegraded":"2023-12-07T21:11:10.187884+0000","last_fullsized":"2023-12-07T21:11:10.187884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766523+0000","last_change":"2023-12-07T21:08:54.876774+0000","last_active":"2023-12-07T21:11:09.766523+0000","last_peered":"2023-12-07T21:11:09.766523+0000","last_clean":"2023-12-07T21:11:09.766523+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:11:09.766523+0000","last_undegraded":"2023-12-07T21:11:09.766523+0000","last_fullsized":"2023-12-07T21:11:09.766523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.351535+0000","last_change":"2023-12-07T21:11:43.351557+0000","last_active":"2023-12-07T21:11:43.351535+0000","last_peered":"2023-12-07T21:11:43.351535+0000","last_clean":"2023-12-07T21:11:43.351535+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:43.351535+0000","last_undegraded":"2023-12-07T21:11:43.351535+0000","last_fullsized":"2023-12-07T21:11:43.351535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_clean_scrub_stamp":"2023-12-07T21:11:43.351414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:25.302758+0000","scrub_duration":0.001534795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.102589+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:17.102589+0000","last_peered":"2023-12-07T21:11:17.102589+0000","last_clean":"2023-12-07T21:11:17.102589+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:17.102589+0000","last_undegraded":"2023-12-07T21:11:17.102589+0000","last_fullsized":"2023-12-07T21:11:17.102589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.804304+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:27.804304+0000","last_peered":"2023-12-07T21:11:27.804304+0000","last_clean":"2023-12-07T21:11:27.804304+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:27.804304+0000","last_undegraded":"2023-12-07T21:11:27.804304+0000","last_fullsized":"2023-12-07T21:11:27.804304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767539+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:11:09.767539+0000","last_peered":"2023-12-07T21:11:09.767539+0000","last_clean":"2023-12-07T21:11:09.767539+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:11:09.767539+0000","last_undegraded":"2023-12-07T21:11:09.767539+0000","last_fullsized":"2023-12-07T21:11:09.767539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187796+0000","last_change":"2023-12-07T21:08:56.870984+0000","last_active":"2023-12-07T21:11:10.187796+0000","last_peered":"2023-12-07T21:11:10.187796+0000","last_clean":"2023-12-07T21:11:10.187796+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:11:10.187796+0000","last_undegraded":"2023-12-07T21:11:10.187796+0000","last_fullsized":"2023-12-07T21:11:10.187796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607752+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:11:10.607752+0000","last_peered":"2023-12-07T21:11:10.607752+0000","last_clean":"2023-12-07T21:11:10.607752+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:11:10.607752+0000","last_undegraded":"2023-12-07T21:11:10.607752+0000","last_fullsized":"2023-12-07T21:11:10.607752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.612324+0000","last_change":"2023-12-07T21:12:17.612358+0000","last_active":"2023-12-07T21:12:17.612324+0000","last_peered":"2023-12-07T21:12:17.612324+0000","last_clean":"2023-12-07T21:12:17.612324+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:12:17.612324+0000","last_undegraded":"2023-12-07T21:12:17.612324+0000","last_fullsized":"2023-12-07T21:12:17.612324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.612233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:19.658682+0000","scrub_duration":0.00093805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.713857+0000","last_change":"2023-12-07T21:11:41.713922+0000","last_active":"2023-12-07T21:11:41.713857+0000","last_peered":"2023-12-07T21:11:41.713857+0000","last_clean":"2023-12-07T21:11:41.713857+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:41.713857+0000","last_undegraded":"2023-12-07T21:11:41.713857+0000","last_fullsized":"2023-12-07T21:11:41.713857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.713762+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:20:34.087308+0000","scrub_duration":0.004054785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.510322+0000","last_change":"2023-12-07T21:12:27.510342+0000","last_active":"2023-12-07T21:12:27.510322+0000","last_peered":"2023-12-07T21:12:27.510322+0000","last_clean":"2023-12-07T21:12:27.510322+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:12:27.510322+0000","last_undegraded":"2023-12-07T21:12:27.510322+0000","last_fullsized":"2023-12-07T21:12:27.510322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.510237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:49.420820+0000","scrub_duration":0.00099611600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608952+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:11:10.608952+0000","last_peered":"2023-12-07T21:11:10.608952+0000","last_clean":"2023-12-07T21:11:10.608952+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:11:10.608952+0000","last_undegraded":"2023-12-07T21:11:10.608952+0000","last_fullsized":"2023-12-07T21:11:10.608952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608124+0000","last_change":"2023-12-07T21:08:56.873059+0000","last_active":"2023-12-07T21:11:10.608124+0000","last_peered":"2023-12-07T21:11:10.608124+0000","last_clean":"2023-12-07T21:11:10.608124+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:11:10.608124+0000","last_undegraded":"2023-12-07T21:11:10.608124+0000","last_fullsized":"2023-12-07T21:11:10.608124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:10:58.800263+0000","last_change":"2023-12-07T21:08:54.890887+0000","last_active":"2023-12-07T21:10:58.800263+0000","last_peered":"2023-12-07T21:10:58.800263+0000","last_clean":"2023-12-07T21:10:58.800263+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:10:58.800263+0000","last_undegraded":"2023-12-07T21:10:58.800263+0000","last_fullsized":"2023-12-07T21:10:58.800263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.412338+0000","last_change":"2023-12-07T21:11:55.412366+0000","last_active":"2023-12-07T21:11:55.412338+0000","last_peered":"2023-12-07T21:11:55.412338+0000","last_clean":"2023-12-07T21:11:55.412338+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:55.412338+0000","last_undegraded":"2023-12-07T21:11:55.412338+0000","last_fullsized":"2023-12-07T21:11:55.412338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.412243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.514434+0000","scrub_duration":0.0010230090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:00.405899+0000","last_change":"2023-12-07T21:12:00.405945+0000","last_active":"2023-12-07T21:12:00.405899+0000","last_peered":"2023-12-07T21:12:00.405899+0000","last_clean":"2023-12-07T21:12:00.405899+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:12:00.405899+0000","last_undegraded":"2023-12-07T21:12:00.405899+0000","last_fullsized":"2023-12-07T21:12:00.405899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_clean_scrub_stamp":"2023-12-07T21:12:00.405797+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:22.672028+0000","scrub_duration":0.0030248670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.620691+0000","last_change":"2023-12-07T21:12:35.620711+0000","last_active":"2023-12-07T21:12:35.620691+0000","last_peered":"2023-12-07T21:12:35.620691+0000","last_clean":"2023-12-07T21:12:35.620691+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:12:35.620691+0000","last_undegraded":"2023-12-07T21:12:35.620691+0000","last_fullsized":"2023-12-07T21:12:35.620691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.620604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:45:58.984206+0000","scrub_duration":0.00101417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608961+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:11:10.608961+0000","last_peered":"2023-12-07T21:11:10.608961+0000","last_clean":"2023-12-07T21:11:10.608961+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:11:10.608961+0000","last_undegraded":"2023-12-07T21:11:10.608961+0000","last_fullsized":"2023-12-07T21:11:10.608961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:45.443200+0000","last_change":"2023-12-07T21:12:45.443225+0000","last_active":"2023-12-07T21:12:45.443200+0000","last_peered":"2023-12-07T21:12:45.443200+0000","last_clean":"2023-12-07T21:12:45.443200+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:12:45.443200+0000","last_undegraded":"2023-12-07T21:12:45.443200+0000","last_fullsized":"2023-12-07T21:12:45.443200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_clean_scrub_stamp":"2023-12-07T21:12:45.443116+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:59.105780+0000","scrub_duration":0.003118975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:41.352170+0000","last_change":"2023-12-07T21:12:41.352194+0000","last_active":"2023-12-07T21:12:41.352170+0000","last_peered":"2023-12-07T21:12:41.352170+0000","last_clean":"2023-12-07T21:12:41.352170+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:12:41.352170+0000","last_undegraded":"2023-12-07T21:12:41.352170+0000","last_fullsized":"2023-12-07T21:12:41.352170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_clean_scrub_stamp":"2023-12-07T21:12:41.352075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:21.467955+0000","scrub_duration":0.001369671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.347674+0000","last_change":"2023-12-07T21:11:44.347728+0000","last_active":"2023-12-07T21:11:44.347674+0000","last_peered":"2023-12-07T21:11:44.347674+0000","last_clean":"2023-12-07T21:11:44.347674+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:44.347674+0000","last_undegraded":"2023-12-07T21:11:44.347674+0000","last_fullsized":"2023-12-07T21:11:44.347674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.347582+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:19:20.740832+0000","scrub_duration":0.0032839919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608679+0000","last_change":"2023-12-07T21:09:00.887872+0000","last_active":"2023-12-07T21:11:10.608679+0000","last_peered":"2023-12-07T21:11:10.608679+0000","last_clean":"2023-12-07T21:11:10.608679+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:11:10.608679+0000","last_undegraded":"2023-12-07T21:11:10.608679+0000","last_fullsized":"2023-12-07T21:11:10.608679+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:59.868669+0000","last_clean_scrub_stamp":"2023-12-07T21:08:59.868669+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.597790+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:15.597790+0000","last_peered":"2023-12-07T21:11:15.597790+0000","last_clean":"2023-12-07T21:11:15.597790+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:15.597790+0000","last_undegraded":"2023-12-07T21:11:15.597790+0000","last_fullsized":"2023-12-07T21:11:15.597790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608930+0000","last_change":"2023-12-07T21:09:04.928655+0000","last_active":"2023-12-07T21:11:10.608930+0000","last_peered":"2023-12-07T21:11:10.608930+0000","last_clean":"2023-12-07T21:11:10.608930+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:11:10.608930+0000","last_undegraded":"2023-12-07T21:11:10.608930+0000","last_fullsized":"2023-12-07T21:11:10.608930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.282849+0000","last_change":"2023-12-07T21:12:20.282874+0000","last_active":"2023-12-07T21:12:20.282849+0000","last_peered":"2023-12-07T21:12:20.282849+0000","last_clean":"2023-12-07T21:12:20.282849+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:12:20.282849+0000","last_undegraded":"2023-12-07T21:12:20.282849+0000","last_fullsized":"2023-12-07T21:12:20.282849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.282741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:25.331572+0000","scrub_duration":0.001103185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.806724+0000","last_change":"2023-12-07T21:08:54.888408+0000","last_active":"2023-12-07T21:11:03.806724+0000","last_peered":"2023-12-07T21:11:03.806724+0000","last_clean":"2023-12-07T21:11:03.806724+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:11:03.806724+0000","last_undegraded":"2023-12-07T21:11:03.806724+0000","last_fullsized":"2023-12-07T21:11:03.806724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.887032+0000","last_change":"2023-12-07T21:12:35.887062+0000","last_active":"2023-12-07T21:12:35.887032+0000","last_peered":"2023-12-07T21:12:35.887032+0000","last_clean":"2023-12-07T21:12:35.887032+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:12:35.887032+0000","last_undegraded":"2023-12-07T21:12:35.887032+0000","last_fullsized":"2023-12-07T21:12:35.887032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.886915+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:07.595951+0000","scrub_duration":0.0013132650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.800891+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:11:03.800891+0000","last_peered":"2023-12-07T21:11:03.800891+0000","last_clean":"2023-12-07T21:11:03.800891+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:11:03.800891+0000","last_undegraded":"2023-12-07T21:11:03.800891+0000","last_fullsized":"2023-12-07T21:11:03.800891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.424101+0000","last_change":"2023-12-07T21:12:12.424126+0000","last_active":"2023-12-07T21:12:12.424101+0000","last_peered":"2023-12-07T21:12:12.424101+0000","last_clean":"2023-12-07T21:12:12.424101+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:12:12.424101+0000","last_undegraded":"2023-12-07T21:12:12.424101+0000","last_fullsized":"2023-12-07T21:12:12.424101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.424026+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:21.643939+0000","scrub_duration":0.002995218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.808292+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:11:03.808292+0000","last_peered":"2023-12-07T21:11:03.808292+0000","last_clean":"2023-12-07T21:11:03.808292+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:11:03.808292+0000","last_undegraded":"2023-12-07T21:11:03.808292+0000","last_fullsized":"2023-12-07T21:11:03.808292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802478+0000","last_change":"2023-12-07T21:08:56.872273+0000","last_active":"2023-12-07T21:11:08.802478+0000","last_peered":"2023-12-07T21:11:08.802478+0000","last_clean":"2023-12-07T21:11:08.802478+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:11:08.802478+0000","last_undegraded":"2023-12-07T21:11:08.802478+0000","last_fullsized":"2023-12-07T21:11:08.802478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801133+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:11:03.801133+0000","last_peered":"2023-12-07T21:11:03.801133+0000","last_clean":"2023-12-07T21:11:03.801133+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:11:03.801133+0000","last_undegraded":"2023-12-07T21:11:03.801133+0000","last_fullsized":"2023-12-07T21:11:03.801133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.801089+0000","last_change":"2023-12-07T21:08:56.876070+0000","last_active":"2023-12-07T21:11:03.801089+0000","last_peered":"2023-12-07T21:11:03.801089+0000","last_clean":"2023-12-07T21:11:03.801089+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:11:03.801089+0000","last_undegraded":"2023-12-07T21:11:03.801089+0000","last_fullsized":"2023-12-07T21:11:03.801089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802500+0000","last_change":"2023-12-07T21:08:54.874578+0000","last_active":"2023-12-07T21:11:08.802500+0000","last_peered":"2023-12-07T21:11:08.802500+0000","last_clean":"2023-12-07T21:11:08.802500+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:11:08.802500+0000","last_undegraded":"2023-12-07T21:11:08.802500+0000","last_fullsized":"2023-12-07T21:11:08.802500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:03.807052+0000","last_change":"2023-12-07T21:08:56.883348+0000","last_active":"2023-12-07T21:11:03.807052+0000","last_peered":"2023-12-07T21:11:03.807052+0000","last_clean":"2023-12-07T21:11:03.807052+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:11:03.807052+0000","last_undegraded":"2023-12-07T21:11:03.807052+0000","last_fullsized":"2023-12-07T21:11:03.807052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808756+0000","last_change":"2023-12-07T21:08:54.887259+0000","last_active":"2023-12-07T21:11:08.808756+0000","last_peered":"2023-12-07T21:11:08.808756+0000","last_clean":"2023-12-07T21:11:08.808756+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:11:08.808756+0000","last_undegraded":"2023-12-07T21:11:08.808756+0000","last_fullsized":"2023-12-07T21:11:08.808756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.783785+0000","last_change":"2023-12-07T21:12:21.783809+0000","last_active":"2023-12-07T21:12:21.783785+0000","last_peered":"2023-12-07T21:12:21.783785+0000","last_clean":"2023-12-07T21:12:21.783785+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:12:21.783785+0000","last_undegraded":"2023-12-07T21:12:21.783785+0000","last_fullsized":"2023-12-07T21:12:21.783785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.783687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:25.104216+0000","scrub_duration":0.001223366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808785+0000","last_change":"2023-12-07T21:08:54.885457+0000","last_active":"2023-12-07T21:11:08.808785+0000","last_peered":"2023-12-07T21:11:08.808785+0000","last_clean":"2023-12-07T21:11:08.808785+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:11:08.808785+0000","last_undegraded":"2023-12-07T21:11:08.808785+0000","last_fullsized":"2023-12-07T21:11:08.808785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.393473+0000","last_change":"2023-12-07T21:12:14.393510+0000","last_active":"2023-12-07T21:12:14.393473+0000","last_peered":"2023-12-07T21:12:14.393473+0000","last_clean":"2023-12-07T21:12:14.393473+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:12:14.393473+0000","last_undegraded":"2023-12-07T21:12:14.393473+0000","last_fullsized":"2023-12-07T21:12:14.393473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.393370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:28.056034+0000","scrub_duration":0.0012787390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802670+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:11:08.802670+0000","last_peered":"2023-12-07T21:11:08.802670+0000","last_clean":"2023-12-07T21:11:08.802670+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:11:08.802670+0000","last_undegraded":"2023-12-07T21:11:08.802670+0000","last_fullsized":"2023-12-07T21:11:08.802670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:22.292045+0000","last_change":"2023-12-07T21:12:22.292065+0000","last_active":"2023-12-07T21:12:22.292045+0000","last_peered":"2023-12-07T21:12:22.292045+0000","last_clean":"2023-12-07T21:12:22.292045+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:12:22.292045+0000","last_undegraded":"2023-12-07T21:12:22.292045+0000","last_fullsized":"2023-12-07T21:12:22.292045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_clean_scrub_stamp":"2023-12-07T21:12:22.291964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:19:35.510802+0000","scrub_duration":0.000955034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809216+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:11:08.809216+0000","last_peered":"2023-12-07T21:11:08.809216+0000","last_clean":"2023-12-07T21:11:08.809216+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:11:08.809216+0000","last_undegraded":"2023-12-07T21:11:08.809216+0000","last_fullsized":"2023-12-07T21:11:08.809216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:24.489620+0000","last_change":"2023-12-07T21:12:24.489652+0000","last_active":"2023-12-07T21:12:24.489620+0000","last_peered":"2023-12-07T21:12:24.489620+0000","last_clean":"2023-12-07T21:12:24.489620+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:12:24.489620+0000","last_undegraded":"2023-12-07T21:12:24.489620+0000","last_fullsized":"2023-12-07T21:12:24.489620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_clean_scrub_stamp":"2023-12-07T21:12:24.489525+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:58:44.073512+0000","scrub_duration":0.0022717330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345160+0000","last_change":"2023-12-07T21:08:54.883629+0000","last_active":"2023-12-07T21:11:09.345160+0000","last_peered":"2023-12-07T21:11:09.345160+0000","last_clean":"2023-12-07T21:11:09.345160+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:11:09.345160+0000","last_undegraded":"2023-12-07T21:11:09.345160+0000","last_fullsized":"2023-12-07T21:11:09.345160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345344+0000","last_change":"2023-12-07T21:08:56.876309+0000","last_active":"2023-12-07T21:11:09.345344+0000","last_peered":"2023-12-07T21:11:09.345344+0000","last_clean":"2023-12-07T21:11:09.345344+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:11:09.345344+0000","last_undegraded":"2023-12-07T21:11:09.345344+0000","last_fullsized":"2023-12-07T21:11:09.345344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766567+0000","last_change":"2023-12-07T21:08:54.887130+0000","last_active":"2023-12-07T21:11:09.766567+0000","last_peered":"2023-12-07T21:11:09.766567+0000","last_clean":"2023-12-07T21:11:09.766567+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:11:09.766567+0000","last_undegraded":"2023-12-07T21:11:09.766567+0000","last_fullsized":"2023-12-07T21:11:09.766567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:33.322727+0000","last_change":"2023-12-07T21:12:33.322751+0000","last_active":"2023-12-07T21:12:33.322727+0000","last_peered":"2023-12-07T21:12:33.322727+0000","last_clean":"2023-12-07T21:12:33.322727+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:12:33.322727+0000","last_undegraded":"2023-12-07T21:12:33.322727+0000","last_fullsized":"2023-12-07T21:12:33.322727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_clean_scrub_stamp":"2023-12-07T21:12:33.322634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:25:00.599068+0000","scrub_duration":0.001216778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766587+0000","last_change":"2023-12-07T21:08:54.884013+0000","last_active":"2023-12-07T21:11:09.766587+0000","last_peered":"2023-12-07T21:11:09.766587+0000","last_clean":"2023-12-07T21:11:09.766587+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:11:09.766587+0000","last_undegraded":"2023-12-07T21:11:09.766587+0000","last_fullsized":"2023-12-07T21:11:09.766587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:32.342422+0000","last_change":"2023-12-07T21:12:32.342446+0000","last_active":"2023-12-07T21:12:32.342422+0000","last_peered":"2023-12-07T21:12:32.342422+0000","last_clean":"2023-12-07T21:12:32.342422+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:12:32.342422+0000","last_undegraded":"2023-12-07T21:12:32.342422+0000","last_fullsized":"2023-12-07T21:12:32.342422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_clean_scrub_stamp":"2023-12-07T21:12:32.342321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:46.648309+0000","scrub_duration":0.0011184750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607834+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:11:10.607834+0000","last_peered":"2023-12-07T21:11:10.607834+0000","last_clean":"2023-12-07T21:11:10.607834+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:11:10.607834+0000","last_undegraded":"2023-12-07T21:11:10.607834+0000","last_fullsized":"2023-12-07T21:11:10.607834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.341241+0000","last_change":"2023-12-07T21:12:27.341269+0000","last_active":"2023-12-07T21:12:27.341241+0000","last_peered":"2023-12-07T21:12:27.341241+0000","last_clean":"2023-12-07T21:12:27.341241+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:12:27.341241+0000","last_undegraded":"2023-12-07T21:12:27.341241+0000","last_fullsized":"2023-12-07T21:12:27.341241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.341151+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:55:08.404366+0000","scrub_duration":0.0024774139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607826+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:11:10.607826+0000","last_peered":"2023-12-07T21:11:10.607826+0000","last_clean":"2023-12-07T21:11:10.607826+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:11:10.607826+0000","last_undegraded":"2023-12-07T21:11:10.607826+0000","last_fullsized":"2023-12-07T21:11:10.607826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608179+0000","last_change":"2023-12-07T21:08:56.876875+0000","last_active":"2023-12-07T21:11:10.608179+0000","last_peered":"2023-12-07T21:11:10.608179+0000","last_clean":"2023-12-07T21:11:10.608179+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:11:10.608179+0000","last_undegraded":"2023-12-07T21:11:10.608179+0000","last_fullsized":"2023-12-07T21:11:10.608179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187739+0000","last_change":"2023-12-07T21:08:54.885432+0000","last_active":"2023-12-07T21:11:10.187739+0000","last_peered":"2023-12-07T21:11:10.187739+0000","last_clean":"2023-12-07T21:11:10.187739+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:11:10.187739+0000","last_undegraded":"2023-12-07T21:11:10.187739+0000","last_fullsized":"2023-12-07T21:11:10.187739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:01.404024+0000","last_change":"2023-12-07T21:12:01.404048+0000","last_active":"2023-12-07T21:12:01.404024+0000","last_peered":"2023-12-07T21:12:01.404024+0000","last_clean":"2023-12-07T21:12:01.404024+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:12:01.404024+0000","last_undegraded":"2023-12-07T21:12:01.404024+0000","last_fullsized":"2023-12-07T21:12:01.404024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_clean_scrub_stamp":"2023-12-07T21:12:01.403925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:06:41.638050+0000","scrub_duration":0.0014963070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607856+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:11:10.607856+0000","last_peered":"2023-12-07T21:11:10.607856+0000","last_clean":"2023-12-07T21:11:10.607856+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:11:10.607856+0000","last_undegraded":"2023-12-07T21:11:10.607856+0000","last_fullsized":"2023-12-07T21:11:10.607856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607882+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:11:10.607882+0000","last_peered":"2023-12-07T21:11:10.607882+0000","last_clean":"2023-12-07T21:11:10.607882+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:11:10.607882+0000","last_undegraded":"2023-12-07T21:11:10.607882+0000","last_fullsized":"2023-12-07T21:11:10.607882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345392+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:11:09.345392+0000","last_peered":"2023-12-07T21:11:09.345392+0000","last_clean":"2023-12-07T21:11:09.345392+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:11:09.345392+0000","last_undegraded":"2023-12-07T21:11:09.345392+0000","last_fullsized":"2023-12-07T21:11:09.345392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345178+0000","last_change":"2023-12-07T21:08:54.883760+0000","last_active":"2023-12-07T21:11:09.345178+0000","last_peered":"2023-12-07T21:11:09.345178+0000","last_clean":"2023-12-07T21:11:09.345178+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:11:09.345178+0000","last_undegraded":"2023-12-07T21:11:09.345178+0000","last_fullsized":"2023-12-07T21:11:09.345178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766992+0000","last_change":"2023-12-07T21:08:56.881838+0000","last_active":"2023-12-07T21:11:09.766992+0000","last_peered":"2023-12-07T21:11:09.766992+0000","last_clean":"2023-12-07T21:11:09.766992+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:11:09.766992+0000","last_undegraded":"2023-12-07T21:11:09.766992+0000","last_fullsized":"2023-12-07T21:11:09.766992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1970,"ondisk_log_size":1970,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1413,"ondisk_log_size":1413,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705718,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.309,"5min":0.182,"15min":0.182},"max":{"1min":0.58399999999999996,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.439,"15min":0.44500000000000001},"min":{"1min":0.31,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51800000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.51300000000000001}]},{"osd":1,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33400000000000002,"15min":0.34300000000000003},"min":{"1min":0.26500000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.435,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.24199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48899999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.37},"min":{"1min":0.28199999999999997,"5min":0.223,"15min":0.223},"max":{"1min":0.48299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33400000000000002,"15min":0.33700000000000002},"min":{"1min":0.24199999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.28699999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705717,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.443,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.56899999999999995,"5min":0.621,"15min":0.621},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.32100000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48899999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.308,"5min":0.32500000000000001,"15min":0.33200000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.42299999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32700000000000001,"15min":0.32900000000000001},"min":{"1min":0.245,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.40200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.26600000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.44900000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32600000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705717,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.27600000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.56100000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.32400000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33800000000000002,"15min":0.35799999999999998},"min":{"1min":0.20200000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.39600000000000002,"5min":0.629,"15min":0.629},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.32300000000000001,"15min":0.32600000000000001},"min":{"1min":0.214,"5min":0.186,"15min":0.186},"max":{"1min":0.5,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.316}]},{"osd":3,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33400000000000002,"15min":0.34200000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.43099999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36299999999999999,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.46200000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.27500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.25700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.70199999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.318,"5min":0.191,"15min":0.191},"max":{"1min":0.65200000000000002,"5min":0.747,"15min":0.747},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Dec 7 21:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.497,"15min":0.48299999999999998},"min":{"1min":0.38,"5min":0.223,"15min":0.223},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.49099999999999999,"15min":0.47699999999999998},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67500000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Dec 7 21:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.496,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.33700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68100000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.497}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:12:52.782 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.782 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.782 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.783 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.783 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.783 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.783 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.783 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.783 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.783 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.784 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.784 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.784 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.784 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.784 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.784 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.784 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.785 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.785 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.785 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.785 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.785 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.785 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.785 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.786 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.786 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.786 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.786 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.786 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.787 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.787 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.787 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.787 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.787 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.787 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.788 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.788 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.788 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.788 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.788 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.788 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.789 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.789 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.789 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.789 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.789 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.789 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.789 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.790 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.790 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.790 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.790 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.790 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.791 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-07T21:08:40.790884+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=40, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.791 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.791 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.791 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.791 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.791 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.792 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.792 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.792 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.792 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.792 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.792 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.793 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.793 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.793 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.793 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.793 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.793 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.794 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.794 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.794 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.794 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.794 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.795 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.795 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.795 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.795 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.795 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.795 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.796 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.796 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.796 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.796 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.796 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.796 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.796 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.797 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.797 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.797 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.797 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.797 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.797 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.797 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.798 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.798 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.798 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.798 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.798 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.798 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.799 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.799 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.799 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.799 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.799 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.800 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.800 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.800 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.800 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.800 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.800 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.800 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.801 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.801 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.801 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.801 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2023-12-07T21:08:59.868669+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=59, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.801 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.801 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.802 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.802 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.802 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.802 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.802 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.802 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.802 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.803 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.803 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.803 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.803 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.803 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.803 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.804 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.804 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.804 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.804 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.804 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.804 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.804 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.805 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.805 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.805 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.805 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:12:52.805 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:13:12.806 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:13:12.917 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.926+0000 7f3c75948640 1 Processor -- start 2023-12-07T21:13:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.926+0000 7f3c75948640 1 -- start start 2023-12-07T21:13:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.926+0000 7f3c75948640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3c7012d810 0x7f3c7012dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:13:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.926+0000 7f3c75948640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7012d450 con 0x7f3c7012e130 2023-12-07T21:13:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.926+0000 7f3c75948640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c70067e00 con 0x7f3c7012d810 2023-12-07T21:13:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.926+0000 7f3c6effd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3c7012d810 0x7f3c7012dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:13:12.918 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.926+0000 7f3c67fff640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3c7012e130 0x7f3c70090460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:41730/0 (socket says 172.21.15.89:41730) 2023-12-07T21:13:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.926+0000 7f3c67fff640 1 -- 172.21.15.89:0/3759372381 learned_addr learned my addr 172.21.15.89:0/3759372381 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:13:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.927+0000 7f3c6effd640 1 -- 172.21.15.89:0/3759372381 >> v1:172.21.15.89:6789/0 conn(0x7f3c7012e130 legacy=0x7f3c70090460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.927+0000 7f3c6effd640 1 -- 172.21.15.89:0/3759372381 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70071cb0 con 0x7f3c7012d810 2023-12-07T21:13:12.919 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.927+0000 7f3c6e7fc640 1 -- 172.21.15.89:0/3759372381 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165991767 0 0) 0x7f3c7012d450 con 0x7f3c7012e130 2023-12-07T21:13:12.922 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.927+0000 7f3c6effd640 1 --2- 172.21.15.89:0/3759372381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c7012d810 0x7f3c7012dbf0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009720 tx=0x7f3c6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86b2a3fa59cc774 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:13:12.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.927+0000 7f3c6e7fc640 1 -- 172.21.15.89:0/3759372381 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c60031760 con 0x7f3c7012d810 2023-12-07T21:13:12.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.928+0000 7f3c6e7fc640 1 -- 172.21.15.89:0/3759372381 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c600318c0 con 0x7f3c7012d810 2023-12-07T21:13:12.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.928+0000 7f3c6e7fc640 1 -- 172.21.15.89:0/3759372381 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c60031b80 con 0x7f3c7012d810 2023-12-07T21:13:12.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.928+0000 7f3c75948640 1 -- 172.21.15.89:0/3759372381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c7012d810 msgr2=0x7f3c7012dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:12.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.928+0000 7f3c75948640 1 --2- 172.21.15.89:0/3759372381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c7012d810 0x7f3c7012dbf0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009720 tx=0x7f3c6002b8d0 comp rx=0 tx=0).stop 2023-12-07T21:13:12.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.928+0000 7f3c75948640 1 -- 172.21.15.89:0/3759372381 shutdown_connections 2023-12-07T21:13:12.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.928+0000 7f3c75948640 1 --2- 172.21.15.89:0/3759372381 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c7012d810 0x7f3c7012dbf0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:13:12.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.928+0000 7f3c75948640 1 -- 172.21.15.89:0/3759372381 >> 172.21.15.89:0/3759372381 conn(0x7f3c7009a1d0 msgr2=0x7f3c7009a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:13:12.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.928+0000 7f3c75948640 1 -- 172.21.15.89:0/3759372381 shutdown_connections 2023-12-07T21:13:12.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.928+0000 7f3c75948640 1 -- 172.21.15.89:0/3759372381 wait complete. 2023-12-07T21:13:12.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.929+0000 7f3c75948640 1 Processor -- start 2023-12-07T21:13:12.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.929+0000 7f3c75948640 1 -- start start 2023-12-07T21:13:12.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.929+0000 7f3c75948640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c7012d810 0x7f3c701211b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:13:12.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.929+0000 7f3c75948640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c701238e0 con 0x7f3c7012d810 2023-12-07T21:13:12.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.929+0000 7f3c6effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c7012d810 0x7f3c701211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:13:12.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.930+0000 7f3c6effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c7012d810 0x7f3c701211b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51876/0 (socket says 172.21.15.89:51876) 2023-12-07T21:13:12.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.930+0000 7f3c6effd640 1 -- 172.21.15.89:0/3999762128 learned_addr learned my addr 172.21.15.89:0/3999762128 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:13:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.930+0000 7f3c6effd640 1 -- 172.21.15.89:0/3999762128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c60009400 con 0x7f3c7012d810 2023-12-07T21:13:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.930+0000 7f3c6effd640 1 --2- 172.21.15.89:0/3999762128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c7012d810 0x7f3c701211b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009840 tx=0x7f3c600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:13:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.930+0000 7f3c6cff9640 1 -- 172.21.15.89:0/3999762128 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c6003b8b0 con 0x7f3c7012d810 2023-12-07T21:13:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.930+0000 7f3c6cff9640 1 -- 172.21.15.89:0/3999762128 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6003ba10 con 0x7f3c7012d810 2023-12-07T21:13:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.930+0000 7f3c75948640 1 -- 172.21.15.89:0/3999762128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c70122c60 con 0x7f3c7012d810 2023-12-07T21:13:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.930+0000 7f3c6cff9640 1 -- 172.21.15.89:0/3999762128 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c6003bcf0 con 0x7f3c7012d810 2023-12-07T21:13:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.930+0000 7f3c75948640 1 -- 172.21.15.89:0/3999762128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c70095cb0 con 0x7f3c7012d810 2023-12-07T21:13:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.931+0000 7f3c6cff9640 1 -- 172.21.15.89:0/3999762128 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3c600453f0 con 0x7f3c7012d810 2023-12-07T21:13:12.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.931+0000 7f3c6cff9640 1 --2- 172.21.15.89:0/3999762128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3c50037820 0x7f3c50039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:13:12.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.931+0000 7f3c6cff9640 1 -- 172.21.15.89:0/3999762128 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f3c6006ce20 con 0x7f3c7012d810 2023-12-07T21:13:12.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.931+0000 7f3c75948640 1 -- 172.21.15.89:0/3999762128 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c70095cb0 con 0x7f3c7012d810 2023-12-07T21:13:12.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.931+0000 7f3c67fff640 1 --2- 172.21.15.89:0/3999762128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3c50037820 0x7f3c50039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:13:12.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.932+0000 7f3c67fff640 1 --2- 172.21.15.89:0/3999762128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3c50037820 0x7f3c50039ce0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c58000c00 tx=0x7f3c58007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:13:12.926 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:12.936+0000 7f3c6cff9640 1 -- 172.21.15.89:0/3999762128 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c70095cb0 con 0x7f3c7012d810 2023-12-07T21:13:13.088 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.097+0000 7f3c75948640 1 -- 172.21.15.89:0/3999762128 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c70071ed0 con 0x7f3c50037820 2023-12-07T21:13:13.103 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.113+0000 7f3c6cff9640 1 -- 172.21.15.89:0/3999762128 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+671500 (secure 0 0 0) 0x7f3c580012b0 con 0x7f3c50037820 2023-12-07T21:13:13.113 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:13:13.122 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:13:13.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.117+0000 7f3c75948640 1 -- 172.21.15.89:0/3999762128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3c50037820 msgr2=0x7f3c50039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:13.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.117+0000 7f3c75948640 1 --2- 172.21.15.89:0/3999762128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3c50037820 0x7f3c50039ce0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c58000c00 tx=0x7f3c58007910 comp rx=0 tx=0).stop 2023-12-07T21:13:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.117+0000 7f3c75948640 1 -- 172.21.15.89:0/3999762128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c7012d810 msgr2=0x7f3c701211b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.117+0000 7f3c75948640 1 --2- 172.21.15.89:0/3999762128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c7012d810 0x7f3c701211b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009840 tx=0x7f3c600046c0 comp rx=0 tx=0).stop 2023-12-07T21:13:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.117+0000 7f3c75948640 1 -- 172.21.15.89:0/3999762128 shutdown_connections 2023-12-07T21:13:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.117+0000 7f3c75948640 1 --2- 172.21.15.89:0/3999762128 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3c50037820 0x7f3c50039ce0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:13:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.117+0000 7f3c75948640 1 --2- 172.21.15.89:0/3999762128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c7012d810 0x7f3c701211b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:13:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.117+0000 7f3c75948640 1 -- 172.21.15.89:0/3999762128 >> 172.21.15.89:0/3999762128 conn(0x7f3c7009a1d0 msgr2=0x7f3c7009b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:13:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.117+0000 7f3c75948640 1 -- 172.21.15.89:0/3999762128 shutdown_connections 2023-12-07T21:13:13.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:13.117+0000 7f3c75948640 1 -- 172.21.15.89:0/3999762128 wait complete. 2023-12-07T21:13:13.126 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2023-12-07T21:13:12.129561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4011,"ondisk_log_size":4011,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004317"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187676+0000","last_change":"2023-12-07T21:08:54.882968+0000","last_active":"2023-12-07T21:11:10.187676+0000","last_peered":"2023-12-07T21:11:10.187676+0000","last_clean":"2023-12-07T21:11:10.187676+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:11:10.187676+0000","last_undegraded":"2023-12-07T21:11:10.187676+0000","last_fullsized":"2023-12-07T21:11:10.187676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.407237+0000","last_change":"2023-12-07T21:12:16.407256+0000","last_active":"2023-12-07T21:12:16.407237+0000","last_peered":"2023-12-07T21:12:16.407237+0000","last_clean":"2023-12-07T21:12:16.407237+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:12:16.407237+0000","last_undegraded":"2023-12-07T21:12:16.407237+0000","last_fullsized":"2023-12-07T21:12:16.407237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.407151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:53.647151+0000","scrub_duration":0.00097124400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345147+0000","last_change":"2023-12-07T21:08:54.890832+0000","last_active":"2023-12-07T21:11:09.345147+0000","last_peered":"2023-12-07T21:11:09.345147+0000","last_clean":"2023-12-07T21:11:09.345147+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:11:09.345147+0000","last_undegraded":"2023-12-07T21:11:09.345147+0000","last_fullsized":"2023-12-07T21:11:09.345147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345425+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:11:09.345425+0000","last_peered":"2023-12-07T21:11:09.345425+0000","last_clean":"2023-12-07T21:11:09.345425+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:11:09.345425+0000","last_undegraded":"2023-12-07T21:11:09.345425+0000","last_fullsized":"2023-12-07T21:11:09.345425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607997+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:11:10.607997+0000","last_peered":"2023-12-07T21:11:10.607997+0000","last_clean":"2023-12-07T21:11:10.607997+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:11:10.607997+0000","last_undegraded":"2023-12-07T21:11:10.607997+0000","last_fullsized":"2023-12-07T21:11:10.607997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608236+0000","last_change":"2023-12-07T21:08:56.873919+0000","last_active":"2023-12-07T21:11:10.608236+0000","last_peered":"2023-12-07T21:11:10.608236+0000","last_clean":"2023-12-07T21:11:10.608236+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:11:10.608236+0000","last_undegraded":"2023-12-07T21:11:10.608236+0000","last_fullsized":"2023-12-07T21:11:10.608236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187665+0000","last_change":"2023-12-07T21:08:54.880442+0000","last_active":"2023-12-07T21:11:10.187665+0000","last_peered":"2023-12-07T21:11:10.187665+0000","last_clean":"2023-12-07T21:11:10.187665+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:11:10.187665+0000","last_undegraded":"2023-12-07T21:11:10.187665+0000","last_fullsized":"2023-12-07T21:11:10.187665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608264+0000","last_change":"2023-12-07T21:08:56.874751+0000","last_active":"2023-12-07T21:11:10.608264+0000","last_peered":"2023-12-07T21:11:10.608264+0000","last_clean":"2023-12-07T21:11:10.608264+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:11:10.608264+0000","last_undegraded":"2023-12-07T21:11:10.608264+0000","last_fullsized":"2023-12-07T21:11:10.608264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607907+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:11:10.607907+0000","last_peered":"2023-12-07T21:11:10.607907+0000","last_clean":"2023-12-07T21:11:10.607907+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:11:10.607907+0000","last_undegraded":"2023-12-07T21:11:10.607907+0000","last_fullsized":"2023-12-07T21:11:10.607907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:39.304151+0000","last_change":"2023-12-07T21:12:39.304151+0000","last_active":"2023-12-07T21:12:39.304151+0000","last_peered":"2023-12-07T21:12:39.304151+0000","last_clean":"2023-12-07T21:12:39.304151+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:12:39.304151+0000","last_undegraded":"2023-12-07T21:12:39.304151+0000","last_fullsized":"2023-12-07T21:12:39.304151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_clean_scrub_stamp":"2023-12-07T21:12:39.304039+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:10.499475+0000","scrub_duration":0.0026021579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187656+0000","last_change":"2023-12-07T21:08:54.880274+0000","last_active":"2023-12-07T21:11:10.187656+0000","last_peered":"2023-12-07T21:11:10.187656+0000","last_clean":"2023-12-07T21:11:10.187656+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:11:10.187656+0000","last_undegraded":"2023-12-07T21:11:10.187656+0000","last_fullsized":"2023-12-07T21:11:10.187656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187892+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:11:10.187892+0000","last_peered":"2023-12-07T21:11:10.187892+0000","last_clean":"2023-12-07T21:11:10.187892+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:11:10.187892+0000","last_undegraded":"2023-12-07T21:11:10.187892+0000","last_fullsized":"2023-12-07T21:11:10.187892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607886+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:11:10.607886+0000","last_peered":"2023-12-07T21:11:10.607886+0000","last_clean":"2023-12-07T21:11:10.607886+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:11:10.607886+0000","last_undegraded":"2023-12-07T21:11:10.607886+0000","last_fullsized":"2023-12-07T21:11:10.607886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187911+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:11:10.187911+0000","last_peered":"2023-12-07T21:11:10.187911+0000","last_clean":"2023-12-07T21:11:10.187911+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:11:10.187911+0000","last_undegraded":"2023-12-07T21:11:10.187911+0000","last_fullsized":"2023-12-07T21:11:10.187911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.845887+0000","last_change":"2023-12-07T21:12:54.845908+0000","last_active":"2023-12-07T21:12:54.845887+0000","last_peered":"2023-12-07T21:12:54.845887+0000","last_clean":"2023-12-07T21:12:54.845887+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:12:54.845887+0000","last_undegraded":"2023-12-07T21:12:54.845887+0000","last_fullsized":"2023-12-07T21:12:54.845887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.845780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:05.129794+0000","scrub_duration":0.001437123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'14","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.396728+0000","last_change":"2023-12-07T21:12:49.396728+0000","last_active":"2023-12-07T21:12:49.396728+0000","last_peered":"2023-12-07T21:12:49.396728+0000","last_clean":"2023-12-07T21:12:49.396728+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:12:49.396728+0000","last_undegraded":"2023-12-07T21:12:49.396728+0000","last_fullsized":"2023-12-07T21:12:49.396728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.396576+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:24:16.481666+0000","scrub_duration":0.0022819030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608172+0000","last_change":"2023-12-07T21:08:56.874409+0000","last_active":"2023-12-07T21:11:10.608172+0000","last_peered":"2023-12-07T21:11:10.608172+0000","last_clean":"2023-12-07T21:11:10.608172+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:11:10.608172+0000","last_undegraded":"2023-12-07T21:11:10.608172+0000","last_fullsized":"2023-12-07T21:11:10.608172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:46.400657+0000","last_change":"2023-12-07T21:12:46.400680+0000","last_active":"2023-12-07T21:12:46.400657+0000","last_peered":"2023-12-07T21:12:46.400657+0000","last_clean":"2023-12-07T21:12:46.400657+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:12:46.400657+0000","last_undegraded":"2023-12-07T21:12:46.400657+0000","last_fullsized":"2023-12-07T21:12:46.400657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_clean_scrub_stamp":"2023-12-07T21:12:46.400562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:25.935064+0000","scrub_duration":0.001127915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:34.273452+0000","last_change":"2023-12-07T21:12:34.273474+0000","last_active":"2023-12-07T21:12:34.273452+0000","last_peered":"2023-12-07T21:12:34.273452+0000","last_clean":"2023-12-07T21:12:34.273452+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:12:34.273452+0000","last_undegraded":"2023-12-07T21:12:34.273452+0000","last_fullsized":"2023-12-07T21:12:34.273452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_clean_scrub_stamp":"2023-12-07T21:12:34.273360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:01:32.940162+0000","scrub_duration":0.0011278239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.451409+0000","last_change":"2023-12-07T21:12:52.451445+0000","last_active":"2023-12-07T21:12:52.451409+0000","last_peered":"2023-12-07T21:12:52.451409+0000","last_clean":"2023-12-07T21:12:52.451409+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:12:52.451409+0000","last_undegraded":"2023-12-07T21:12:52.451409+0000","last_fullsized":"2023-12-07T21:12:52.451409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.451316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:57.500148+0000","scrub_duration":0.001350272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'13","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766969+0000","last_change":"2023-12-07T21:08:56.882602+0000","last_active":"2023-12-07T21:11:09.766969+0000","last_peered":"2023-12-07T21:11:09.766969+0000","last_clean":"2023-12-07T21:11:09.766969+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:11:09.766969+0000","last_undegraded":"2023-12-07T21:11:09.766969+0000","last_fullsized":"2023-12-07T21:11:09.766969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766621+0000","last_change":"2023-12-07T21:08:54.889812+0000","last_active":"2023-12-07T21:11:09.766621+0000","last_peered":"2023-12-07T21:11:09.766621+0000","last_clean":"2023-12-07T21:11:09.766621+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:11:09.766621+0000","last_undegraded":"2023-12-07T21:11:09.766621+0000","last_fullsized":"2023-12-07T21:11:09.766621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:40.827223+0000","last_change":"2023-12-07T21:12:40.827245+0000","last_active":"2023-12-07T21:12:40.827223+0000","last_peered":"2023-12-07T21:12:40.827223+0000","last_clean":"2023-12-07T21:12:40.827223+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:12:40.827223+0000","last_undegraded":"2023-12-07T21:12:40.827223+0000","last_fullsized":"2023-12-07T21:12:40.827223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_clean_scrub_stamp":"2023-12-07T21:12:40.827135+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:20.361638+0000","scrub_duration":0.0013685839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766605+0000","last_change":"2023-12-07T21:08:54.878784+0000","last_active":"2023-12-07T21:11:09.766605+0000","last_peered":"2023-12-07T21:11:09.766605+0000","last_clean":"2023-12-07T21:11:09.766605+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:11:09.766605+0000","last_undegraded":"2023-12-07T21:11:09.766605+0000","last_fullsized":"2023-12-07T21:11:09.766605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:53.488111+0000","last_change":"2023-12-07T21:12:53.488138+0000","last_active":"2023-12-07T21:12:53.488111+0000","last_peered":"2023-12-07T21:12:53.488111+0000","last_clean":"2023-12-07T21:12:53.488111+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:12:53.488111+0000","last_undegraded":"2023-12-07T21:12:53.488111+0000","last_fullsized":"2023-12-07T21:12:53.488111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_clean_scrub_stamp":"2023-12-07T21:12:53.488022+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:20:06.706860+0000","scrub_duration":0.0010715880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.914082+0000","last_change":"2023-12-07T21:12:58.914123+0000","last_active":"2023-12-07T21:12:58.914082+0000","last_peered":"2023-12-07T21:12:58.914082+0000","last_clean":"2023-12-07T21:12:58.914082+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:12:58.914082+0000","last_undegraded":"2023-12-07T21:12:58.914082+0000","last_fullsized":"2023-12-07T21:12:58.914082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.913992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:18.497979+0000","scrub_duration":0.0013136269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.336912+0000","last_change":"2023-12-07T21:12:23.336936+0000","last_active":"2023-12-07T21:12:23.336912+0000","last_peered":"2023-12-07T21:12:23.336912+0000","last_clean":"2023-12-07T21:12:23.336912+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:12:23.336912+0000","last_undegraded":"2023-12-07T21:12:23.336912+0000","last_fullsized":"2023-12-07T21:12:23.336912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.336820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:54.775680+0000","scrub_duration":0.0015463409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607871+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:11:10.607871+0000","last_peered":"2023-12-07T21:11:10.607871+0000","last_clean":"2023-12-07T21:11:10.607871+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:11:10.607871+0000","last_undegraded":"2023-12-07T21:11:10.607871+0000","last_fullsized":"2023-12-07T21:11:10.607871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767525+0000","last_change":"2023-12-07T21:09:04.931981+0000","last_active":"2023-12-07T21:11:09.767525+0000","last_peered":"2023-12-07T21:11:09.767525+0000","last_clean":"2023-12-07T21:11:09.767525+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:11:09.767525+0000","last_undegraded":"2023-12-07T21:11:09.767525+0000","last_fullsized":"2023-12-07T21:11:09.767525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.461393+0000","last_change":"2023-12-07T21:12:20.461414+0000","last_active":"2023-12-07T21:12:20.461393+0000","last_peered":"2023-12-07T21:12:20.461393+0000","last_clean":"2023-12-07T21:12:20.461393+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:12:20.461393+0000","last_undegraded":"2023-12-07T21:12:20.461393+0000","last_fullsized":"2023-12-07T21:12:20.461393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.461275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:11:30.745289+0000","scrub_duration":0.0012528039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607680+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:11:10.607680+0000","last_peered":"2023-12-07T21:11:10.607680+0000","last_clean":"2023-12-07T21:11:10.607680+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:11:10.607680+0000","last_undegraded":"2023-12-07T21:11:10.607680+0000","last_fullsized":"2023-12-07T21:11:10.607680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.797174+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:12.797174+0000","last_peered":"2023-12-07T21:11:12.797174+0000","last_clean":"2023-12-07T21:11:12.797174+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:12.797174+0000","last_undegraded":"2023-12-07T21:11:12.797174+0000","last_fullsized":"2023-12-07T21:11:12.797174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:03.666647+0000","last_change":"2023-12-07T21:13:03.666683+0000","last_active":"2023-12-07T21:13:03.666647+0000","last_peered":"2023-12-07T21:13:03.666647+0000","last_clean":"2023-12-07T21:13:03.666647+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:13:03.666647+0000","last_undegraded":"2023-12-07T21:13:03.666647+0000","last_fullsized":"2023-12-07T21:13:03.666647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_clean_scrub_stamp":"2023-12-07T21:13:03.666541+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:29:58.918173+0000","scrub_duration":0.0039456209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.345063+0000","last_change":"2023-12-07T21:12:18.345086+0000","last_active":"2023-12-07T21:12:18.345063+0000","last_peered":"2023-12-07T21:12:18.345063+0000","last_clean":"2023-12-07T21:12:18.345063+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:12:18.345063+0000","last_undegraded":"2023-12-07T21:12:18.345063+0000","last_fullsized":"2023-12-07T21:12:18.345063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.344968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:53:47.984483+0000","scrub_duration":0.00095218699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:26.318801+0000","last_change":"2023-12-07T21:12:26.318843+0000","last_active":"2023-12-07T21:12:26.318801+0000","last_peered":"2023-12-07T21:12:26.318801+0000","last_clean":"2023-12-07T21:12:26.318801+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:12:26.318801+0000","last_undegraded":"2023-12-07T21:12:26.318801+0000","last_fullsized":"2023-12-07T21:12:26.318801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:26.318685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:21.073203+0000","scrub_duration":0.0010887360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.617992+0000","last_change":"2023-12-07T21:13:07.618014+0000","last_active":"2023-12-07T21:13:07.617992+0000","last_peered":"2023-12-07T21:13:07.617992+0000","last_clean":"2023-12-07T21:13:07.617992+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:13:07.617992+0000","last_undegraded":"2023-12-07T21:13:07.617992+0000","last_fullsized":"2023-12-07T21:13:07.617992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.617909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:13.457658+0000","scrub_duration":0.001206459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880632+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.830062+0000","last_change":"2023-12-07T21:11:53.830085+0000","last_active":"2023-12-07T21:11:53.830062+0000","last_peered":"2023-12-07T21:11:53.830062+0000","last_clean":"2023-12-07T21:11:53.830062+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:53.830062+0000","last_undegraded":"2023-12-07T21:11:53.830062+0000","last_fullsized":"2023-12-07T21:11:53.830062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_clean_scrub_stamp":"2023-12-07T21:11:53.829969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:45.205269+0000","scrub_duration":0.001216066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.053083+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:11.053083+0000","last_peered":"2023-12-07T21:11:11.053083+0000","last_clean":"2023-12-07T21:11:11.053083+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:11.053083+0000","last_undegraded":"2023-12-07T21:11:11.053083+0000","last_fullsized":"2023-12-07T21:11:11.053083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.304118+0000","last_change":"2023-12-07T21:11:42.304137+0000","last_active":"2023-12-07T21:11:42.304118+0000","last_peered":"2023-12-07T21:11:42.304118+0000","last_clean":"2023-12-07T21:11:42.304118+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:42.304118+0000","last_undegraded":"2023-12-07T21:11:42.304118+0000","last_fullsized":"2023-12-07T21:11:42.304118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.304031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:14.639583+0000","scrub_duration":0.0010594929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:31.746746+0000","last_change":"2023-12-07T21:12:31.746769+0000","last_active":"2023-12-07T21:12:31.746746+0000","last_peered":"2023-12-07T21:12:31.746746+0000","last_clean":"2023-12-07T21:12:31.746746+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:12:31.746746+0000","last_undegraded":"2023-12-07T21:12:31.746746+0000","last_fullsized":"2023-12-07T21:12:31.746746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_clean_scrub_stamp":"2023-12-07T21:12:31.746658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:02.942094+0000","scrub_duration":0.00135096,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'1","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608112+0000","last_change":"2023-12-07T21:08:56.875484+0000","last_active":"2023-12-07T21:11:10.608112+0000","last_peered":"2023-12-07T21:11:10.608112+0000","last_clean":"2023-12-07T21:11:10.608112+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:11:10.608112+0000","last_undegraded":"2023-12-07T21:11:10.608112+0000","last_fullsized":"2023-12-07T21:11:10.608112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607656+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:11:10.607656+0000","last_peered":"2023-12-07T21:11:10.607656+0000","last_clean":"2023-12-07T21:11:10.607656+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:11:10.607656+0000","last_undegraded":"2023-12-07T21:11:10.607656+0000","last_fullsized":"2023-12-07T21:11:10.607656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.707066+0000","last_change":"2023-12-07T21:11:58.707102+0000","last_active":"2023-12-07T21:11:58.707066+0000","last_peered":"2023-12-07T21:11:58.707066+0000","last_clean":"2023-12-07T21:11:58.707066+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:58.707066+0000","last_undegraded":"2023-12-07T21:11:58.707066+0000","last_fullsized":"2023-12-07T21:11:58.707066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.706965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:56:05.594599+0000","scrub_duration":0.0011023249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.554028+0000","last_change":"2023-12-07T21:11:35.554062+0000","last_active":"2023-12-07T21:11:35.554028+0000","last_peered":"2023-12-07T21:11:35.554028+0000","last_clean":"2023-12-07T21:11:35.554028+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:35.554028+0000","last_undegraded":"2023-12-07T21:11:35.554028+0000","last_fullsized":"2023-12-07T21:11:35.554028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.553946+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:56.699897+0000","scrub_duration":0.0042775269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'247","reported_seq":323,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:50.595128+0000","last_change":"2023-12-07T21:12:50.595156+0000","last_active":"2023-12-07T21:12:50.595128+0000","last_peered":"2023-12-07T21:12:50.595128+0000","last_clean":"2023-12-07T21:12:50.595128+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:12:50.595128+0000","last_undegraded":"2023-12-07T21:12:50.595128+0000","last_fullsized":"2023-12-07T21:12:50.595128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_clean_scrub_stamp":"2023-12-07T21:12:50.595047+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:57:35.203698+0000","scrub_duration":0.0029719099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188448+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:11:10.188448+0000","last_peered":"2023-12-07T21:11:10.188448+0000","last_clean":"2023-12-07T21:11:10.188448+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:11:10.188448+0000","last_undegraded":"2023-12-07T21:11:10.188448+0000","last_fullsized":"2023-12-07T21:11:10.188448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.764627+0000","last_change":"2023-12-07T21:12:27.764650+0000","last_active":"2023-12-07T21:12:27.764627+0000","last_peered":"2023-12-07T21:12:27.764627+0000","last_clean":"2023-12-07T21:12:27.764627+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:12:27.764627+0000","last_undegraded":"2023-12-07T21:12:27.764627+0000","last_fullsized":"2023-12-07T21:12:27.764627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.764507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:17:01.731572+0000","scrub_duration":0.0015146649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.348585+0000","last_change":"2023-12-07T21:13:00.348644+0000","last_active":"2023-12-07T21:13:00.348585+0000","last_peered":"2023-12-07T21:13:00.348585+0000","last_clean":"2023-12-07T21:13:00.348585+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:13:00.348585+0000","last_undegraded":"2023-12-07T21:13:00.348585+0000","last_fullsized":"2023-12-07T21:13:00.348585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.348476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:10.632490+0000","scrub_duration":0.001405367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.775119+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:14.775119+0000","last_peered":"2023-12-07T21:11:14.775119+0000","last_clean":"2023-12-07T21:11:14.775119+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:14.775119+0000","last_undegraded":"2023-12-07T21:11:14.775119+0000","last_fullsized":"2023-12-07T21:11:14.775119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:29.600052+0000","last_change":"2023-12-07T21:11:29.600086+0000","last_active":"2023-12-07T21:11:29.600052+0000","last_peered":"2023-12-07T21:11:29.600052+0000","last_clean":"2023-12-07T21:11:29.600052+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:29.600052+0000","last_undegraded":"2023-12-07T21:11:29.600052+0000","last_fullsized":"2023-12-07T21:11:29.600052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_clean_scrub_stamp":"2023-12-07T21:11:29.599963+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:30:03.772118+0000","scrub_duration":0.003554771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'247","reported_seq":340,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:02.790438+0000","last_change":"2023-12-07T21:12:02.790465+0000","last_active":"2023-12-07T21:12:02.790438+0000","last_peered":"2023-12-07T21:12:02.790438+0000","last_clean":"2023-12-07T21:12:02.790438+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:12:02.790438+0000","last_undegraded":"2023-12-07T21:12:02.790438+0000","last_fullsized":"2023-12-07T21:12:02.790438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_clean_scrub_stamp":"2023-12-07T21:12:02.790346+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:07.839178+0000","scrub_duration":0.0026089529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809281+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:11:08.809281+0000","last_peered":"2023-12-07T21:11:08.809281+0000","last_clean":"2023-12-07T21:11:08.809281+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:11:08.809281+0000","last_undegraded":"2023-12-07T21:11:08.809281+0000","last_fullsized":"2023-12-07T21:11:08.809281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880253+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.443130+0000","last_change":"2023-12-07T21:11:56.443153+0000","last_active":"2023-12-07T21:11:56.443130+0000","last_peered":"2023-12-07T21:11:56.443130+0000","last_clean":"2023-12-07T21:11:56.443130+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:56.443130+0000","last_undegraded":"2023-12-07T21:11:56.443130+0000","last_fullsized":"2023-12-07T21:11:56.443130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.443045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:05.069384+0000","scrub_duration":0.0010685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.606772+0000","last_change":"2023-12-07T21:11:39.606842+0000","last_active":"2023-12-07T21:11:39.606772+0000","last_peered":"2023-12-07T21:11:39.606772+0000","last_clean":"2023-12-07T21:11:39.606772+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:39.606772+0000","last_undegraded":"2023-12-07T21:11:39.606772+0000","last_fullsized":"2023-12-07T21:11:39.606772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.606684+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:36.950556+0000","scrub_duration":0.0069737849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:34.781691+0000","last_change":"2023-12-07T21:11:34.781711+0000","last_active":"2023-12-07T21:11:34.781691+0000","last_peered":"2023-12-07T21:11:34.781691+0000","last_clean":"2023-12-07T21:11:34.781691+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:34.781691+0000","last_undegraded":"2023-12-07T21:11:34.781691+0000","last_fullsized":"2023-12-07T21:11:34.781691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:34.781604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:44.478780+0000","scrub_duration":0.001255822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188362+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:11:10.188362+0000","last_peered":"2023-12-07T21:11:10.188362+0000","last_clean":"2023-12-07T21:11:10.188362+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:11:10.188362+0000","last_undegraded":"2023-12-07T21:11:10.188362+0000","last_fullsized":"2023-12-07T21:11:10.188362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'22","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.326816+0000","last_change":"2023-12-07T21:12:36.326862+0000","last_active":"2023-12-07T21:12:36.326816+0000","last_peered":"2023-12-07T21:12:36.326816+0000","last_clean":"2023-12-07T21:12:36.326816+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:12:36.326816+0000","last_undegraded":"2023-12-07T21:12:36.326816+0000","last_fullsized":"2023-12-07T21:12:36.326816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.326694+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:24:30.282151+0000","scrub_duration":0.0028268410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.338748+0000","last_change":"2023-12-07T21:13:06.338776+0000","last_active":"2023-12-07T21:13:06.338748+0000","last_peered":"2023-12-07T21:13:06.338748+0000","last_clean":"2023-12-07T21:13:06.338748+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:13:06.338748+0000","last_undegraded":"2023-12-07T21:13:06.338748+0000","last_fullsized":"2023-12-07T21:13:06.338748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.338641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:59:17.495976+0000","scrub_duration":0.001242176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:07.717434+0000","last_change":"2023-12-07T21:12:07.717459+0000","last_active":"2023-12-07T21:12:07.717434+0000","last_peered":"2023-12-07T21:12:07.717434+0000","last_clean":"2023-12-07T21:12:07.717434+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:12:07.717434+0000","last_undegraded":"2023-12-07T21:12:07.717434+0000","last_fullsized":"2023-12-07T21:12:07.717434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_clean_scrub_stamp":"2023-12-07T21:12:07.717342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:32.009926+0000","scrub_duration":0.0014039289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:09.439719+0000","last_change":"2023-12-07T21:12:09.439747+0000","last_active":"2023-12-07T21:12:09.439719+0000","last_peered":"2023-12-07T21:12:09.439719+0000","last_clean":"2023-12-07T21:12:09.439719+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:12:09.439719+0000","last_undegraded":"2023-12-07T21:12:09.439719+0000","last_fullsized":"2023-12-07T21:12:09.439719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_clean_scrub_stamp":"2023-12-07T21:12:09.439641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:19.195035+0000","scrub_duration":0.0043223589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.735445+0000","last_change":"2023-12-07T21:11:33.735466+0000","last_active":"2023-12-07T21:11:33.735445+0000","last_peered":"2023-12-07T21:11:33.735445+0000","last_clean":"2023-12-07T21:11:33.735445+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:33.735445+0000","last_undegraded":"2023-12-07T21:11:33.735445+0000","last_fullsized":"2023-12-07T21:11:33.735445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.735352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:03.972116+0000","scrub_duration":0.0011441929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767437+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:11:09.767437+0000","last_peered":"2023-12-07T21:11:09.767437+0000","last_clean":"2023-12-07T21:11:09.767437+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:11:09.767437+0000","last_undegraded":"2023-12-07T21:11:09.767437+0000","last_fullsized":"2023-12-07T21:11:09.767437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.429249+0000","last_change":"2023-12-07T21:12:36.429281+0000","last_active":"2023-12-07T21:12:36.429249+0000","last_peered":"2023-12-07T21:12:36.429249+0000","last_clean":"2023-12-07T21:12:36.429249+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:12:36.429249+0000","last_undegraded":"2023-12-07T21:12:36.429249+0000","last_fullsized":"2023-12-07T21:12:36.429249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.429148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:19.936617+0000","scrub_duration":0.001111988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607665+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:11:10.607665+0000","last_peered":"2023-12-07T21:11:10.607665+0000","last_clean":"2023-12-07T21:11:10.607665+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:11:10.607665+0000","last_undegraded":"2023-12-07T21:11:10.607665+0000","last_fullsized":"2023-12-07T21:11:10.607665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.810355+0000","last_change":"2023-12-07T21:12:15.810375+0000","last_active":"2023-12-07T21:12:15.810355+0000","last_peered":"2023-12-07T21:12:15.810355+0000","last_clean":"2023-12-07T21:12:15.810355+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:12:15.810355+0000","last_undegraded":"2023-12-07T21:12:15.810355+0000","last_fullsized":"2023-12-07T21:12:15.810355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.810269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:33.566530+0000","scrub_duration":0.0014408579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.522055+0000","last_change":"2023-12-07T21:11:50.522112+0000","last_active":"2023-12-07T21:11:50.522055+0000","last_peered":"2023-12-07T21:11:50.522055+0000","last_clean":"2023-12-07T21:11:50.522055+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:50.522055+0000","last_undegraded":"2023-12-07T21:11:50.522055+0000","last_fullsized":"2023-12-07T21:11:50.522055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.521955+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:04.827943+0000","scrub_duration":0.0073561030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":307,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.761860+0000","last_change":"2023-12-07T21:11:35.761887+0000","last_active":"2023-12-07T21:11:35.761860+0000","last_peered":"2023-12-07T21:11:35.761860+0000","last_clean":"2023-12-07T21:11:35.761860+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:35.761860+0000","last_undegraded":"2023-12-07T21:11:35.761860+0000","last_fullsized":"2023-12-07T21:11:35.761860+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.761766+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:14.383149+0000","scrub_duration":0.0016151640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345866+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:11:09.345866+0000","last_peered":"2023-12-07T21:11:09.345866+0000","last_clean":"2023-12-07T21:11:09.345866+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:11:09.345866+0000","last_undegraded":"2023-12-07T21:11:09.345866+0000","last_fullsized":"2023-12-07T21:11:09.345866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:55.462334+0000","last_change":"2023-12-07T21:12:55.462356+0000","last_active":"2023-12-07T21:12:55.462334+0000","last_peered":"2023-12-07T21:12:55.462334+0000","last_clean":"2023-12-07T21:12:55.462334+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:12:55.462334+0000","last_undegraded":"2023-12-07T21:12:55.462334+0000","last_fullsized":"2023-12-07T21:12:55.462334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_clean_scrub_stamp":"2023-12-07T21:12:55.462251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:57:45.150167+0000","scrub_duration":0.0012320580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607649+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:11:10.607649+0000","last_peered":"2023-12-07T21:11:10.607649+0000","last_clean":"2023-12-07T21:11:10.607649+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:11:10.607649+0000","last_undegraded":"2023-12-07T21:11:10.607649+0000","last_fullsized":"2023-12-07T21:11:10.607649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.753680+0000","last_change":"2023-12-07T21:11:55.753724+0000","last_active":"2023-12-07T21:11:55.753680+0000","last_peered":"2023-12-07T21:11:55.753680+0000","last_clean":"2023-12-07T21:11:55.753680+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:55.753680+0000","last_undegraded":"2023-12-07T21:11:55.753680+0000","last_fullsized":"2023-12-07T21:11:55.753680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.753576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:53:37.572475+0000","scrub_duration":0.0013913199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:31.726530+0000","last_change":"2023-12-07T21:11:31.726564+0000","last_active":"2023-12-07T21:11:31.726530+0000","last_peered":"2023-12-07T21:11:31.726530+0000","last_clean":"2023-12-07T21:11:31.726530+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:31.726530+0000","last_undegraded":"2023-12-07T21:11:31.726530+0000","last_fullsized":"2023-12-07T21:11:31.726530+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:31.726451+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:36.775283+0000","scrub_duration":0.0038601009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.752542+0000","last_change":"2023-12-07T21:11:56.752564+0000","last_active":"2023-12-07T21:11:56.752542+0000","last_peered":"2023-12-07T21:11:56.752542+0000","last_clean":"2023-12-07T21:11:56.752542+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:56.752542+0000","last_undegraded":"2023-12-07T21:11:56.752542+0000","last_fullsized":"2023-12-07T21:11:56.752542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.752450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:44.261937+0000","scrub_duration":0.0012919610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345867+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:11:09.345867+0000","last_peered":"2023-12-07T21:11:09.345867+0000","last_clean":"2023-12-07T21:11:09.345867+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:11:09.345867+0000","last_undegraded":"2023-12-07T21:11:09.345867+0000","last_fullsized":"2023-12-07T21:11:09.345867+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187760+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:11:10.187760+0000","last_peered":"2023-12-07T21:11:10.187760+0000","last_clean":"2023-12-07T21:11:10.187760+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:11:10.187760+0000","last_undegraded":"2023-12-07T21:11:10.187760+0000","last_fullsized":"2023-12-07T21:11:10.187760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345205+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:11:09.345205+0000","last_peered":"2023-12-07T21:11:09.345205+0000","last_clean":"2023-12-07T21:11:09.345205+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:11:09.345205+0000","last_undegraded":"2023-12-07T21:11:09.345205+0000","last_fullsized":"2023-12-07T21:11:09.345205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.578099+0000","last_change":"2023-12-07T21:12:12.578121+0000","last_active":"2023-12-07T21:12:12.578099+0000","last_peered":"2023-12-07T21:12:12.578099+0000","last_clean":"2023-12-07T21:12:12.578099+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:12:12.578099+0000","last_undegraded":"2023-12-07T21:12:12.578099+0000","last_fullsized":"2023-12-07T21:12:12.578099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.578001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:21:04.951547+0000","scrub_duration":0.0009980639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.222534+0000","last_change":"2023-12-07T21:11:32.222572+0000","last_active":"2023-12-07T21:11:32.222534+0000","last_peered":"2023-12-07T21:11:32.222534+0000","last_clean":"2023-12-07T21:11:32.222534+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:32.222534+0000","last_undegraded":"2023-12-07T21:11:32.222534+0000","last_fullsized":"2023-12-07T21:11:32.222534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.222451+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:29.566323+0000","scrub_duration":0.0042948600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608766+0000","last_change":"2023-12-07T21:09:02.906350+0000","last_active":"2023-12-07T21:11:10.608766+0000","last_peered":"2023-12-07T21:11:10.608766+0000","last_clean":"2023-12-07T21:11:10.608766+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:11:10.608766+0000","last_undegraded":"2023-12-07T21:11:10.608766+0000","last_fullsized":"2023-12-07T21:11:10.608766+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608819+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:11:10.608819+0000","last_peered":"2023-12-07T21:11:10.608819+0000","last_clean":"2023-12-07T21:11:10.608819+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:11:10.608819+0000","last_undegraded":"2023-12-07T21:11:10.608819+0000","last_fullsized":"2023-12-07T21:11:10.608819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187764+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:11:10.187764+0000","last_peered":"2023-12-07T21:11:10.187764+0000","last_clean":"2023-12-07T21:11:10.187764+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:11:10.187764+0000","last_undegraded":"2023-12-07T21:11:10.187764+0000","last_fullsized":"2023-12-07T21:11:10.187764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809479+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:11:08.809479+0000","last_peered":"2023-12-07T21:11:08.809479+0000","last_clean":"2023-12-07T21:11:08.809479+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:11:08.809479+0000","last_undegraded":"2023-12-07T21:11:08.809479+0000","last_fullsized":"2023-12-07T21:11:08.809479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:54.784543+0000","last_change":"2023-12-07T21:11:54.784564+0000","last_active":"2023-12-07T21:11:54.784543+0000","last_peered":"2023-12-07T21:11:54.784543+0000","last_clean":"2023-12-07T21:11:54.784543+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:54.784543+0000","last_undegraded":"2023-12-07T21:11:54.784543+0000","last_fullsized":"2023-12-07T21:11:54.784543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_clean_scrub_stamp":"2023-12-07T21:11:54.784441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:06.366596+0000","scrub_duration":0.001044002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.576728+0000","last_change":"2023-12-07T21:11:38.576788+0000","last_active":"2023-12-07T21:11:38.576728+0000","last_peered":"2023-12-07T21:11:38.576728+0000","last_clean":"2023-12-07T21:11:38.576728+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:38.576728+0000","last_undegraded":"2023-12-07T21:11:38.576728+0000","last_fullsized":"2023-12-07T21:11:38.576728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.576637+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:37:48.632379+0000","scrub_duration":0.0068514220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":336,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625017+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625017+0000","last_peered":"2023-12-07T21:11:28.625017+0000","last_clean":"2023-12-07T21:11:28.625017+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625017+0000","last_undegraded":"2023-12-07T21:11:28.625017+0000","last_fullsized":"2023-12-07T21:11:28.625017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.858687+0000","last_change":"2023-12-07T21:12:16.858711+0000","last_active":"2023-12-07T21:12:16.858687+0000","last_peered":"2023-12-07T21:12:16.858687+0000","last_clean":"2023-12-07T21:12:16.858687+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:12:16.858687+0000","last_undegraded":"2023-12-07T21:12:16.858687+0000","last_fullsized":"2023-12-07T21:12:16.858687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.858602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:29:51.847246+0000","scrub_duration":0.0011473449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187852+0000","last_change":"2023-12-07T21:08:56.880261+0000","last_active":"2023-12-07T21:11:10.187852+0000","last_peered":"2023-12-07T21:11:10.187852+0000","last_clean":"2023-12-07T21:11:10.187852+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:11:10.187852+0000","last_undegraded":"2023-12-07T21:11:10.187852+0000","last_fullsized":"2023-12-07T21:11:10.187852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809380+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:11:08.809380+0000","last_peered":"2023-12-07T21:11:08.809380+0000","last_clean":"2023-12-07T21:11:08.809380+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:11:08.809380+0000","last_undegraded":"2023-12-07T21:11:08.809380+0000","last_fullsized":"2023-12-07T21:11:08.809380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":205,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.296670+0000","last_change":"2023-12-07T21:11:38.296697+0000","last_active":"2023-12-07T21:11:38.296670+0000","last_peered":"2023-12-07T21:11:38.296670+0000","last_clean":"2023-12-07T21:11:38.296670+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:38.296670+0000","last_undegraded":"2023-12-07T21:11:38.296670+0000","last_fullsized":"2023-12-07T21:11:38.296670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.296568+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:08.533333+0000","scrub_duration":0.0033144630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.654287+0000","last_change":"2023-12-07T21:13:04.654323+0000","last_active":"2023-12-07T21:13:04.654287+0000","last_peered":"2023-12-07T21:13:04.654287+0000","last_clean":"2023-12-07T21:13:04.654287+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:13:04.654287+0000","last_undegraded":"2023-12-07T21:13:04.654287+0000","last_fullsized":"2023-12-07T21:13:04.654287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.654200+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:02:30.647135+0000","scrub_duration":0.0041448730000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'247","reported_seq":372,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:47.359710+0000","last_change":"2023-12-07T21:11:47.359735+0000","last_active":"2023-12-07T21:11:47.359710+0000","last_peered":"2023-12-07T21:11:47.359710+0000","last_clean":"2023-12-07T21:11:47.359710+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:47.359710+0000","last_undegraded":"2023-12-07T21:11:47.359710+0000","last_fullsized":"2023-12-07T21:11:47.359710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_clean_scrub_stamp":"2023-12-07T21:11:47.359610+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:10.050726+0000","scrub_duration":0.0028663759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.579743+0000","last_change":"2023-12-07T21:12:14.579785+0000","last_active":"2023-12-07T21:12:14.579743+0000","last_peered":"2023-12-07T21:12:14.579743+0000","last_clean":"2023-12-07T21:12:14.579743+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:12:14.579743+0000","last_undegraded":"2023-12-07T21:12:14.579743+0000","last_fullsized":"2023-12-07T21:12:14.579743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.579627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:44.957962+0000","scrub_duration":0.0013656510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.375160+0000","last_change":"2023-12-07T21:12:17.375184+0000","last_active":"2023-12-07T21:12:17.375160+0000","last_peered":"2023-12-07T21:12:17.375160+0000","last_clean":"2023-12-07T21:12:17.375160+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:12:17.375160+0000","last_undegraded":"2023-12-07T21:12:17.375160+0000","last_fullsized":"2023-12-07T21:12:17.375160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.375067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:21:31.008297+0000","scrub_duration":0.001068486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809240+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:11:08.809240+0000","last_peered":"2023-12-07T21:11:08.809240+0000","last_clean":"2023-12-07T21:11:08.809240+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:11:08.809240+0000","last_undegraded":"2023-12-07T21:11:08.809240+0000","last_fullsized":"2023-12-07T21:11:08.809240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.847894+0000","last_change":"2023-12-07T21:11:28.847914+0000","last_active":"2023-12-07T21:11:28.847894+0000","last_peered":"2023-12-07T21:11:28.847894+0000","last_clean":"2023-12-07T21:11:28.847894+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:28.847894+0000","last_undegraded":"2023-12-07T21:11:28.847894+0000","last_fullsized":"2023-12-07T21:11:28.847894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.847797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:20:42.481026+0000","scrub_duration":0.001132973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262716+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262716+0000","last_peered":"2023-12-07T21:11:27.262716+0000","last_clean":"2023-12-07T21:11:27.262716+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262716+0000","last_undegraded":"2023-12-07T21:11:27.262716+0000","last_fullsized":"2023-12-07T21:11:27.262716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.426987+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:14.426987+0000","last_peered":"2023-12-07T21:11:14.426987+0000","last_clean":"2023-12-07T21:11:14.426987+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:14.426987+0000","last_undegraded":"2023-12-07T21:11:14.426987+0000","last_fullsized":"2023-12-07T21:11:14.426987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767450+0000","last_change":"2023-12-07T21:09:04.920277+0000","last_active":"2023-12-07T21:11:09.767450+0000","last_peered":"2023-12-07T21:11:09.767450+0000","last_clean":"2023-12-07T21:11:09.767450+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:11:09.767450+0000","last_undegraded":"2023-12-07T21:11:09.767450+0000","last_fullsized":"2023-12-07T21:11:09.767450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:08.448223+0000","last_change":"2023-12-07T21:12:08.448223+0000","last_active":"2023-12-07T21:12:08.448223+0000","last_peered":"2023-12-07T21:12:08.448223+0000","last_clean":"2023-12-07T21:12:08.448223+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:12:08.448223+0000","last_undegraded":"2023-12-07T21:12:08.448223+0000","last_fullsized":"2023-12-07T21:12:08.448223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_clean_scrub_stamp":"2023-12-07T21:12:08.448115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:53:48.563995+0000","scrub_duration":0.001037821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":184,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766378+0000","last_change":"2023-12-07T21:08:41.979221+0000","last_active":"2023-12-07T21:11:09.766378+0000","last_peered":"2023-12-07T21:11:09.766378+0000","last_clean":"2023-12-07T21:11:09.766378+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:11:09.766378+0000","last_undegraded":"2023-12-07T21:11:09.766378+0000","last_fullsized":"2023-12-07T21:11:09.766378+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:40.790884+0000","last_clean_scrub_stamp":"2023-12-07T21:08:40.790884+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607432+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:11:10.607432+0000","last_peered":"2023-12-07T21:11:10.607432+0000","last_clean":"2023-12-07T21:11:10.607432+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:11:10.607432+0000","last_undegraded":"2023-12-07T21:11:10.607432+0000","last_fullsized":"2023-12-07T21:11:10.607432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607484+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:11:10.607484+0000","last_peered":"2023-12-07T21:11:10.607484+0000","last_clean":"2023-12-07T21:11:10.607484+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:11:10.607484+0000","last_undegraded":"2023-12-07T21:11:10.607484+0000","last_fullsized":"2023-12-07T21:11:10.607484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.324752+0000","last_change":"2023-12-07T21:11:45.324752+0000","last_active":"2023-12-07T21:11:45.324752+0000","last_peered":"2023-12-07T21:11:45.324752+0000","last_clean":"2023-12-07T21:11:45.324752+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:11:45.324752+0000","last_undegraded":"2023-12-07T21:11:45.324752+0000","last_fullsized":"2023-12-07T21:11:45.324752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.324596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:15.702930+0000","scrub_duration":0.001375037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'84","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.623169+0000","last_change":"2023-12-07T21:12:52.623237+0000","last_active":"2023-12-07T21:12:52.623169+0000","last_peered":"2023-12-07T21:12:52.623169+0000","last_clean":"2023-12-07T21:12:52.623169+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:12:52.623169+0000","last_undegraded":"2023-12-07T21:12:52.623169+0000","last_fullsized":"2023-12-07T21:12:52.623169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'84","last_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_deep_scrub":"33'84","last_deep_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.623072+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:11.772666+0000","scrub_duration":0.0042302950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.743690+0000","last_change":"2023-12-07T21:11:42.743712+0000","last_active":"2023-12-07T21:11:42.743690+0000","last_peered":"2023-12-07T21:11:42.743690+0000","last_clean":"2023-12-07T21:11:42.743690+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:42.743690+0000","last_undegraded":"2023-12-07T21:11:42.743690+0000","last_fullsized":"2023-12-07T21:11:42.743690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.743604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:58.016229+0000","scrub_duration":0.001386167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":148,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.433658+0000","last_change":"2023-12-07T21:11:58.433682+0000","last_active":"2023-12-07T21:11:58.433658+0000","last_peered":"2023-12-07T21:11:58.433658+0000","last_clean":"2023-12-07T21:11:58.433658+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:58.433658+0000","last_undegraded":"2023-12-07T21:11:58.433658+0000","last_fullsized":"2023-12-07T21:11:58.433658+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.433567+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:08.130743+0000","scrub_duration":0.0014101739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809766+0000","last_change":"2023-12-07T21:08:56.872420+0000","last_active":"2023-12-07T21:11:08.809766+0000","last_peered":"2023-12-07T21:11:08.809766+0000","last_clean":"2023-12-07T21:11:08.809766+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:11:08.809766+0000","last_undegraded":"2023-12-07T21:11:08.809766+0000","last_fullsized":"2023-12-07T21:11:08.809766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607424+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:11:10.607424+0000","last_peered":"2023-12-07T21:11:10.607424+0000","last_clean":"2023-12-07T21:11:10.607424+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:11:10.607424+0000","last_undegraded":"2023-12-07T21:11:10.607424+0000","last_fullsized":"2023-12-07T21:11:10.607424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345059+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:11:09.345059+0000","last_peered":"2023-12-07T21:11:09.345059+0000","last_clean":"2023-12-07T21:11:09.345059+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:11:09.345059+0000","last_undegraded":"2023-12-07T21:11:09.345059+0000","last_fullsized":"2023-12-07T21:11:09.345059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.687459+0000","last_change":"2023-12-07T21:11:32.687480+0000","last_active":"2023-12-07T21:11:32.687459+0000","last_peered":"2023-12-07T21:11:32.687459+0000","last_clean":"2023-12-07T21:11:32.687459+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:32.687459+0000","last_undegraded":"2023-12-07T21:11:32.687459+0000","last_fullsized":"2023-12-07T21:11:32.687459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.687375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:18:45.906213+0000","scrub_duration":0.001283024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":450,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148355+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148355+0000","last_peered":"2023-12-07T21:11:18.148355+0000","last_clean":"2023-12-07T21:11:18.148355+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148355+0000","last_undegraded":"2023-12-07T21:11:18.148355+0000","last_fullsized":"2023-12-07T21:11:18.148355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:25.481129+0000","last_change":"2023-12-07T21:12:25.481161+0000","last_active":"2023-12-07T21:12:25.481129+0000","last_peered":"2023-12-07T21:12:25.481129+0000","last_clean":"2023-12-07T21:12:25.481129+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:12:25.481129+0000","last_undegraded":"2023-12-07T21:12:25.481129+0000","last_fullsized":"2023-12-07T21:12:25.481129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_clean_scrub_stamp":"2023-12-07T21:12:25.481005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:33:44.071058+0000","scrub_duration":0.001267064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767469+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:11:09.767469+0000","last_peered":"2023-12-07T21:11:09.767469+0000","last_clean":"2023-12-07T21:11:09.767469+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:11:09.767469+0000","last_undegraded":"2023-12-07T21:11:09.767469+0000","last_fullsized":"2023-12-07T21:11:09.767469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802682+0000","last_change":"2023-12-07T21:08:56.883281+0000","last_active":"2023-12-07T21:11:08.802682+0000","last_peered":"2023-12-07T21:11:08.802682+0000","last_clean":"2023-12-07T21:11:08.802682+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:11:08.802682+0000","last_undegraded":"2023-12-07T21:11:08.802682+0000","last_fullsized":"2023-12-07T21:11:08.802682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187452+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:11:10.187452+0000","last_peered":"2023-12-07T21:11:10.187452+0000","last_clean":"2023-12-07T21:11:10.187452+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:11:10.187452+0000","last_undegraded":"2023-12-07T21:11:10.187452+0000","last_fullsized":"2023-12-07T21:11:10.187452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345044+0000","last_change":"2023-12-07T21:08:54.881937+0000","last_active":"2023-12-07T21:11:09.345044+0000","last_peered":"2023-12-07T21:11:09.345044+0000","last_clean":"2023-12-07T21:11:09.345044+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:11:09.345044+0000","last_undegraded":"2023-12-07T21:11:09.345044+0000","last_fullsized":"2023-12-07T21:11:09.345044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.627959+0000","last_change":"2023-12-07T21:12:15.627991+0000","last_active":"2023-12-07T21:12:15.627959+0000","last_peered":"2023-12-07T21:12:15.627959+0000","last_clean":"2023-12-07T21:12:15.627959+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:12:15.627959+0000","last_undegraded":"2023-12-07T21:12:15.627959+0000","last_fullsized":"2023-12-07T21:12:15.627959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.627865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:38.318981+0000","scrub_duration":0.0028926030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'25","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:46.537878+0000","last_change":"2023-12-07T21:11:46.537922+0000","last_active":"2023-12-07T21:11:46.537878+0000","last_peered":"2023-12-07T21:11:46.537878+0000","last_clean":"2023-12-07T21:11:46.537878+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:46.537878+0000","last_undegraded":"2023-12-07T21:11:46.537878+0000","last_fullsized":"2023-12-07T21:11:46.537878+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_clean_scrub_stamp":"2023-12-07T21:11:46.537795+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:57.338431+0000","scrub_duration":0.0057357379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642676+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642676+0000","last_peered":"2023-12-07T21:11:12.642676+0000","last_clean":"2023-12-07T21:11:12.642676+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642676+0000","last_undegraded":"2023-12-07T21:11:12.642676+0000","last_fullsized":"2023-12-07T21:11:12.642676+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608815+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:11:10.608815+0000","last_peered":"2023-12-07T21:11:10.608815+0000","last_clean":"2023-12-07T21:11:10.608815+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:11:10.608815+0000","last_undegraded":"2023-12-07T21:11:10.608815+0000","last_fullsized":"2023-12-07T21:11:10.608815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345154+0000","last_change":"2023-12-07T21:08:56.872455+0000","last_active":"2023-12-07T21:11:09.345154+0000","last_peered":"2023-12-07T21:11:09.345154+0000","last_clean":"2023-12-07T21:11:09.345154+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:11:09.345154+0000","last_undegraded":"2023-12-07T21:11:09.345154+0000","last_fullsized":"2023-12-07T21:11:09.345154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607422+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:11:10.607422+0000","last_peered":"2023-12-07T21:11:10.607422+0000","last_clean":"2023-12-07T21:11:10.607422+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:11:10.607422+0000","last_undegraded":"2023-12-07T21:11:10.607422+0000","last_fullsized":"2023-12-07T21:11:10.607422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187488+0000","last_change":"2023-12-07T21:08:54.880674+0000","last_active":"2023-12-07T21:11:10.187488+0000","last_peered":"2023-12-07T21:11:10.187488+0000","last_clean":"2023-12-07T21:11:10.187488+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:11:10.187488+0000","last_undegraded":"2023-12-07T21:11:10.187488+0000","last_fullsized":"2023-12-07T21:11:10.187488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:57.727223+0000","last_change":"2023-12-07T21:11:57.727223+0000","last_active":"2023-12-07T21:11:57.727223+0000","last_peered":"2023-12-07T21:11:57.727223+0000","last_clean":"2023-12-07T21:11:57.727223+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:11:57.727223+0000","last_undegraded":"2023-12-07T21:11:57.727223+0000","last_fullsized":"2023-12-07T21:11:57.727223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_clean_scrub_stamp":"2023-12-07T21:11:57.727085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:53.015740+0000","scrub_duration":0.0013430639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.630823+0000","last_change":"2023-12-07T21:12:49.630855+0000","last_active":"2023-12-07T21:12:49.630823+0000","last_peered":"2023-12-07T21:12:49.630823+0000","last_clean":"2023-12-07T21:12:49.630823+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:12:49.630823+0000","last_undegraded":"2023-12-07T21:12:49.630823+0000","last_fullsized":"2023-12-07T21:12:49.630823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.630741+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:01.513069+0000","scrub_duration":0.0051886659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608704+0000","last_change":"2023-12-07T21:09:02.907037+0000","last_active":"2023-12-07T21:11:10.608704+0000","last_peered":"2023-12-07T21:11:10.608704+0000","last_clean":"2023-12-07T21:11:10.608704+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:11:10.608704+0000","last_undegraded":"2023-12-07T21:11:10.608704+0000","last_fullsized":"2023-12-07T21:11:10.608704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767468+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:11:09.767468+0000","last_peered":"2023-12-07T21:11:09.767468+0000","last_clean":"2023-12-07T21:11:09.767468+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:11:09.767468+0000","last_undegraded":"2023-12-07T21:11:09.767468+0000","last_fullsized":"2023-12-07T21:11:09.767468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766668+0000","last_change":"2023-12-07T21:08:56.882954+0000","last_active":"2023-12-07T21:11:09.766668+0000","last_peered":"2023-12-07T21:11:09.766668+0000","last_clean":"2023-12-07T21:11:09.766668+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:11:09.766668+0000","last_undegraded":"2023-12-07T21:11:09.766668+0000","last_fullsized":"2023-12-07T21:11:09.766668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187482+0000","last_change":"2023-12-07T21:08:54.881143+0000","last_active":"2023-12-07T21:11:10.187482+0000","last_peered":"2023-12-07T21:11:10.187482+0000","last_clean":"2023-12-07T21:11:10.187482+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:11:10.187482+0000","last_undegraded":"2023-12-07T21:11:10.187482+0000","last_fullsized":"2023-12-07T21:11:10.187482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345020+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:11:09.345020+0000","last_peered":"2023-12-07T21:11:09.345020+0000","last_clean":"2023-12-07T21:11:09.345020+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:11:09.345020+0000","last_undegraded":"2023-12-07T21:11:09.345020+0000","last_fullsized":"2023-12-07T21:11:09.345020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.771944+0000","last_change":"2023-12-07T21:12:11.771944+0000","last_active":"2023-12-07T21:12:11.771944+0000","last_peered":"2023-12-07T21:12:11.771944+0000","last_clean":"2023-12-07T21:12:11.771944+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:12:11.771944+0000","last_undegraded":"2023-12-07T21:12:11.771944+0000","last_fullsized":"2023-12-07T21:12:11.771944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.771816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:43.210676+0000","scrub_duration":0.0013479799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'72","reported_seq":142,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.763012+0000","last_change":"2023-12-07T21:11:45.763012+0000","last_active":"2023-12-07T21:11:45.763012+0000","last_peered":"2023-12-07T21:11:45.763012+0000","last_clean":"2023-12-07T21:11:45.763012+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:45.763012+0000","last_undegraded":"2023-12-07T21:11:45.763012+0000","last_fullsized":"2023-12-07T21:11:45.763012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.762875+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:27:47.809323+0000","scrub_duration":0.006706058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594393+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594393+0000","last_peered":"2023-12-07T21:11:25.594393+0000","last_clean":"2023-12-07T21:11:25.594393+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594393+0000","last_undegraded":"2023-12-07T21:11:25.594393+0000","last_fullsized":"2023-12-07T21:11:25.594393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345934+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:11:09.345934+0000","last_peered":"2023-12-07T21:11:09.345934+0000","last_clean":"2023-12-07T21:11:09.345934+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:11:09.345934+0000","last_undegraded":"2023-12-07T21:11:09.345934+0000","last_fullsized":"2023-12-07T21:11:09.345934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.332914+0000","last_change":"2023-12-07T21:12:42.332914+0000","last_active":"2023-12-07T21:12:42.332914+0000","last_peered":"2023-12-07T21:12:42.332914+0000","last_clean":"2023-12-07T21:12:42.332914+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:12:42.332914+0000","last_undegraded":"2023-12-07T21:12:42.332914+0000","last_fullsized":"2023-12-07T21:12:42.332914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.332776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:52.088170+0000","scrub_duration":0.00097994699999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345087+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:11:09.345087+0000","last_peered":"2023-12-07T21:11:09.345087+0000","last_clean":"2023-12-07T21:11:09.345087+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:11:09.345087+0000","last_undegraded":"2023-12-07T21:11:09.345087+0000","last_fullsized":"2023-12-07T21:11:09.345087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607497+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:11:10.607497+0000","last_peered":"2023-12-07T21:11:10.607497+0000","last_clean":"2023-12-07T21:11:10.607497+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:11:10.607497+0000","last_undegraded":"2023-12-07T21:11:10.607497+0000","last_fullsized":"2023-12-07T21:11:10.607497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.626478+0000","last_change":"2023-12-07T21:11:42.626478+0000","last_active":"2023-12-07T21:11:42.626478+0000","last_peered":"2023-12-07T21:11:42.626478+0000","last_clean":"2023-12-07T21:11:42.626478+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:11:42.626478+0000","last_undegraded":"2023-12-07T21:11:42.626478+0000","last_fullsized":"2023-12-07T21:11:42.626478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.626356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:23.689571+0000","scrub_duration":0.001348258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.225002+0000","last_change":"2023-12-07T21:11:33.225043+0000","last_active":"2023-12-07T21:11:33.225002+0000","last_peered":"2023-12-07T21:11:33.225002+0000","last_clean":"2023-12-07T21:11:33.225002+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:33.225002+0000","last_undegraded":"2023-12-07T21:11:33.225002+0000","last_fullsized":"2023-12-07T21:11:33.225002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.224920+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:12.396025+0000","scrub_duration":0.0049945800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.065956+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:11:20.065956+0000","last_peered":"2023-12-07T21:11:20.065956+0000","last_clean":"2023-12-07T21:11:20.065956+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:20.065956+0000","last_undegraded":"2023-12-07T21:11:20.065956+0000","last_fullsized":"2023-12-07T21:11:20.065956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608840+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:11:10.608840+0000","last_peered":"2023-12-07T21:11:10.608840+0000","last_clean":"2023-12-07T21:11:10.608840+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:11:10.608840+0000","last_undegraded":"2023-12-07T21:11:10.608840+0000","last_fullsized":"2023-12-07T21:11:10.608840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608009+0000","last_change":"2023-12-07T21:08:56.887962+0000","last_active":"2023-12-07T21:11:10.608009+0000","last_peered":"2023-12-07T21:11:10.608009+0000","last_clean":"2023-12-07T21:11:10.608009+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:11:10.608009+0000","last_undegraded":"2023-12-07T21:11:10.608009+0000","last_fullsized":"2023-12-07T21:11:10.608009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809841+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:11:08.809841+0000","last_peered":"2023-12-07T21:11:08.809841+0000","last_clean":"2023-12-07T21:11:08.809841+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:11:08.809841+0000","last_undegraded":"2023-12-07T21:11:08.809841+0000","last_fullsized":"2023-12-07T21:11:08.809841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345020+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:11:09.345020+0000","last_peered":"2023-12-07T21:11:09.345020+0000","last_clean":"2023-12-07T21:11:09.345020+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:11:09.345020+0000","last_undegraded":"2023-12-07T21:11:09.345020+0000","last_fullsized":"2023-12-07T21:11:09.345020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.865911+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:11:18.865911+0000","last_peered":"2023-12-07T21:11:18.865911+0000","last_clean":"2023-12-07T21:11:18.865911+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:11:18.865911+0000","last_undegraded":"2023-12-07T21:11:18.865911+0000","last_fullsized":"2023-12-07T21:11:18.865911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:44.632612+0000","last_change":"2023-12-07T21:12:44.632651+0000","last_active":"2023-12-07T21:12:44.632612+0000","last_peered":"2023-12-07T21:12:44.632612+0000","last_clean":"2023-12-07T21:12:44.632612+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:12:44.632612+0000","last_undegraded":"2023-12-07T21:12:44.632612+0000","last_fullsized":"2023-12-07T21:12:44.632612+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_clean_scrub_stamp":"2023-12-07T21:12:44.632504+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:24.020207+0000","scrub_duration":0.0053067840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":368,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712206+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712206+0000","last_peered":"2023-12-07T21:11:18.712206+0000","last_clean":"2023-12-07T21:11:18.712206+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712206+0000","last_undegraded":"2023-12-07T21:11:18.712206+0000","last_fullsized":"2023-12-07T21:11:18.712206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767478+0000","last_change":"2023-12-07T21:09:04.929420+0000","last_active":"2023-12-07T21:11:09.767478+0000","last_peered":"2023-12-07T21:11:09.767478+0000","last_clean":"2023-12-07T21:11:09.767478+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:11:09.767478+0000","last_undegraded":"2023-12-07T21:11:09.767478+0000","last_fullsized":"2023-12-07T21:11:09.767478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:43.441643+0000","last_change":"2023-12-07T21:12:43.441643+0000","last_active":"2023-12-07T21:12:43.441643+0000","last_peered":"2023-12-07T21:12:43.441643+0000","last_clean":"2023-12-07T21:12:43.441643+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:12:43.441643+0000","last_undegraded":"2023-12-07T21:12:43.441643+0000","last_fullsized":"2023-12-07T21:12:43.441643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_clean_scrub_stamp":"2023-12-07T21:12:43.441484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:24.768617+0000","scrub_duration":0.0011182029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808876+0000","last_change":"2023-12-07T21:08:54.888557+0000","last_active":"2023-12-07T21:11:08.808876+0000","last_peered":"2023-12-07T21:11:08.808876+0000","last_clean":"2023-12-07T21:11:08.808876+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:11:08.808876+0000","last_undegraded":"2023-12-07T21:11:08.808876+0000","last_fullsized":"2023-12-07T21:11:08.808876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607479+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:11:10.607479+0000","last_peered":"2023-12-07T21:11:10.607479+0000","last_clean":"2023-12-07T21:11:10.607479+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:11:10.607479+0000","last_undegraded":"2023-12-07T21:11:10.607479+0000","last_fullsized":"2023-12-07T21:11:10.607479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:37.651334+0000","last_change":"2023-12-07T21:11:37.651334+0000","last_active":"2023-12-07T21:11:37.651334+0000","last_peered":"2023-12-07T21:11:37.651334+0000","last_clean":"2023-12-07T21:11:37.651334+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:11:37.651334+0000","last_undegraded":"2023-12-07T21:11:37.651334+0000","last_fullsized":"2023-12-07T21:11:37.651334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_clean_scrub_stamp":"2023-12-07T21:11:37.651191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:09.090050+0000","scrub_duration":0.0012443790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'94","reported_seq":180,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:05.544462+0000","last_change":"2023-12-07T21:12:05.544503+0000","last_active":"2023-12-07T21:12:05.544462+0000","last_peered":"2023-12-07T21:12:05.544462+0000","last_clean":"2023-12-07T21:12:05.544462+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:12:05.544462+0000","last_undegraded":"2023-12-07T21:12:05.544462+0000","last_fullsized":"2023-12-07T21:12:05.544462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'94","last_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_deep_scrub":"33'94","last_deep_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_clean_scrub_stamp":"2023-12-07T21:12:05.544369+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:32:13.323537+0000","scrub_duration":0.006343095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.831630+0000","last_change":"2023-12-07T21:11:52.831678+0000","last_active":"2023-12-07T21:11:52.831630+0000","last_peered":"2023-12-07T21:11:52.831630+0000","last_clean":"2023-12-07T21:11:52.831630+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:52.831630+0000","last_undegraded":"2023-12-07T21:11:52.831630+0000","last_fullsized":"2023-12-07T21:11:52.831630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.831531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:22.265020+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188437+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:11:10.188437+0000","last_peered":"2023-12-07T21:11:10.188437+0000","last_clean":"2023-12-07T21:11:10.188437+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:11:10.188437+0000","last_undegraded":"2023-12-07T21:11:10.188437+0000","last_fullsized":"2023-12-07T21:11:10.188437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.528399+0000","last_change":"2023-12-07T21:12:23.528421+0000","last_active":"2023-12-07T21:12:23.528399+0000","last_peered":"2023-12-07T21:12:23.528399+0000","last_clean":"2023-12-07T21:12:23.528399+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:12:23.528399+0000","last_undegraded":"2023-12-07T21:12:23.528399+0000","last_fullsized":"2023-12-07T21:12:23.528399+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.528299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:52.961788+0000","scrub_duration":0.00098274400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.407065+0000","last_change":"2023-12-07T21:13:04.407105+0000","last_active":"2023-12-07T21:13:04.407065+0000","last_peered":"2023-12-07T21:13:04.407065+0000","last_clean":"2023-12-07T21:13:04.407065+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:13:04.407065+0000","last_undegraded":"2023-12-07T21:13:04.407065+0000","last_fullsized":"2023-12-07T21:13:04.407065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.406964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:17:33.745379+0000","scrub_duration":0.001091641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607705+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:11:10.607705+0000","last_peered":"2023-12-07T21:11:10.607705+0000","last_clean":"2023-12-07T21:11:10.607705+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:11:10.607705+0000","last_undegraded":"2023-12-07T21:11:10.607705+0000","last_fullsized":"2023-12-07T21:11:10.607705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.299949+0000","last_change":"2023-12-07T21:11:39.299988+0000","last_active":"2023-12-07T21:11:39.299949+0000","last_peered":"2023-12-07T21:11:39.299949+0000","last_clean":"2023-12-07T21:11:39.299949+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:39.299949+0000","last_undegraded":"2023-12-07T21:11:39.299949+0000","last_fullsized":"2023-12-07T21:11:39.299949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.299849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:48.997025+0000","scrub_duration":0.001356866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.839849+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:20.839849+0000","last_peered":"2023-12-07T21:11:20.839849+0000","last_clean":"2023-12-07T21:11:20.839849+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:20.839849+0000","last_undegraded":"2023-12-07T21:11:20.839849+0000","last_fullsized":"2023-12-07T21:11:20.839849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.626958+0000","last_change":"2023-12-07T21:13:05.626993+0000","last_active":"2023-12-07T21:13:05.626958+0000","last_peered":"2023-12-07T21:13:05.626958+0000","last_clean":"2023-12-07T21:13:05.626958+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:13:05.626958+0000","last_undegraded":"2023-12-07T21:13:05.626958+0000","last_fullsized":"2023-12-07T21:13:05.626958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.626860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:01.027919+0000","scrub_duration":0.00097400899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345986+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:11:09.345986+0000","last_peered":"2023-12-07T21:11:09.345986+0000","last_clean":"2023-12-07T21:11:09.345986+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:11:09.345986+0000","last_undegraded":"2023-12-07T21:11:09.345986+0000","last_fullsized":"2023-12-07T21:11:09.345986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.340533+0000","last_change":"2023-12-07T21:13:05.340557+0000","last_active":"2023-12-07T21:13:05.340533+0000","last_peered":"2023-12-07T21:13:05.340533+0000","last_clean":"2023-12-07T21:13:05.340533+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:13:05.340533+0000","last_undegraded":"2023-12-07T21:13:05.340533+0000","last_fullsized":"2023-12-07T21:13:05.340533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.340431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:24.924419+0000","scrub_duration":0.001119035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187534+0000","last_change":"2023-12-07T21:08:54.880755+0000","last_active":"2023-12-07T21:11:10.187534+0000","last_peered":"2023-12-07T21:11:10.187534+0000","last_clean":"2023-12-07T21:11:10.187534+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:11:10.187534+0000","last_undegraded":"2023-12-07T21:11:10.187534+0000","last_fullsized":"2023-12-07T21:11:10.187534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.790833+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:15.790833+0000","last_peered":"2023-12-07T21:11:15.790833+0000","last_clean":"2023-12-07T21:11:15.790833+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:15.790833+0000","last_undegraded":"2023-12-07T21:11:15.790833+0000","last_fullsized":"2023-12-07T21:11:15.790833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'9","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.887014+0000","last_change":"2023-12-07T21:11:50.887056+0000","last_active":"2023-12-07T21:11:50.887014+0000","last_peered":"2023-12-07T21:11:50.887014+0000","last_clean":"2023-12-07T21:11:50.887014+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:50.887014+0000","last_undegraded":"2023-12-07T21:11:50.887014+0000","last_fullsized":"2023-12-07T21:11:50.887014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.886922+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:02.989113+0000","scrub_duration":0.0042007399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:19.515594+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:19.515594+0000","last_peered":"2023-12-07T21:11:19.515594+0000","last_clean":"2023-12-07T21:11:19.515594+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:19.515594+0000","last_undegraded":"2023-12-07T21:11:19.515594+0000","last_fullsized":"2023-12-07T21:11:19.515594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345954+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:11:09.345954+0000","last_peered":"2023-12-07T21:11:09.345954+0000","last_clean":"2023-12-07T21:11:09.345954+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:11:09.345954+0000","last_undegraded":"2023-12-07T21:11:09.345954+0000","last_fullsized":"2023-12-07T21:11:09.345954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345219+0000","last_change":"2023-12-07T21:08:56.874712+0000","last_active":"2023-12-07T21:11:09.345219+0000","last_peered":"2023-12-07T21:11:09.345219+0000","last_clean":"2023-12-07T21:11:09.345219+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:11:09.345219+0000","last_undegraded":"2023-12-07T21:11:09.345219+0000","last_fullsized":"2023-12-07T21:11:09.345219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187591+0000","last_change":"2023-12-07T21:08:54.885182+0000","last_active":"2023-12-07T21:11:10.187591+0000","last_peered":"2023-12-07T21:11:10.187591+0000","last_clean":"2023-12-07T21:11:10.187591+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:11:10.187591+0000","last_undegraded":"2023-12-07T21:11:10.187591+0000","last_fullsized":"2023-12-07T21:11:10.187591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.605088+0000","last_change":"2023-12-07T21:12:18.605108+0000","last_active":"2023-12-07T21:12:18.605088+0000","last_peered":"2023-12-07T21:12:18.605088+0000","last_clean":"2023-12-07T21:12:18.605088+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:12:18.605088+0000","last_undegraded":"2023-12-07T21:12:18.605088+0000","last_fullsized":"2023-12-07T21:12:18.605088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.605002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:30.707193+0000","scrub_duration":0.00090833899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.678798+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:11.678798+0000","last_peered":"2023-12-07T21:11:11.678798+0000","last_clean":"2023-12-07T21:11:11.678798+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:11.678798+0000","last_undegraded":"2023-12-07T21:11:11.678798+0000","last_fullsized":"2023-12-07T21:11:11.678798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.302787+0000","last_change":"2023-12-07T21:11:36.302809+0000","last_active":"2023-12-07T21:11:36.302787+0000","last_peered":"2023-12-07T21:11:36.302787+0000","last_clean":"2023-12-07T21:11:36.302787+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:36.302787+0000","last_undegraded":"2023-12-07T21:11:36.302787+0000","last_fullsized":"2023-12-07T21:11:36.302787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.302687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:01.567462+0000","scrub_duration":0.0014296669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608968+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:11:10.608968+0000","last_peered":"2023-12-07T21:11:10.608968+0000","last_clean":"2023-12-07T21:11:10.608968+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:11:10.608968+0000","last_undegraded":"2023-12-07T21:11:10.608968+0000","last_fullsized":"2023-12-07T21:11:10.608968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608103+0000","last_change":"2023-12-07T21:08:56.887184+0000","last_active":"2023-12-07T21:11:10.608103+0000","last_peered":"2023-12-07T21:11:10.608103+0000","last_clean":"2023-12-07T21:11:10.608103+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:11:10.608103+0000","last_undegraded":"2023-12-07T21:11:10.608103+0000","last_fullsized":"2023-12-07T21:11:10.608103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766431+0000","last_change":"2023-12-07T21:08:54.878542+0000","last_active":"2023-12-07T21:11:09.766431+0000","last_peered":"2023-12-07T21:11:09.766431+0000","last_clean":"2023-12-07T21:11:09.766431+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:11:09.766431+0000","last_undegraded":"2023-12-07T21:11:09.766431+0000","last_fullsized":"2023-12-07T21:11:09.766431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.514123+0000","last_change":"2023-12-07T21:11:52.514142+0000","last_active":"2023-12-07T21:11:52.514123+0000","last_peered":"2023-12-07T21:11:52.514123+0000","last_clean":"2023-12-07T21:11:52.514123+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:52.514123+0000","last_undegraded":"2023-12-07T21:11:52.514123+0000","last_fullsized":"2023-12-07T21:11:52.514123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.514035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:00:51.180837+0000","scrub_duration":0.00101976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.532757+0000","last_change":"2023-12-07T21:11:32.532802+0000","last_active":"2023-12-07T21:11:32.532757+0000","last_peered":"2023-12-07T21:11:32.532757+0000","last_clean":"2023-12-07T21:11:32.532757+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:32.532757+0000","last_undegraded":"2023-12-07T21:11:32.532757+0000","last_fullsized":"2023-12-07T21:11:32.532757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.532666+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:34.382885+0000","scrub_duration":0.0035860219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.544268+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:17.544268+0000","last_peered":"2023-12-07T21:11:17.544268+0000","last_clean":"2023-12-07T21:11:17.544268+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:17.544268+0000","last_undegraded":"2023-12-07T21:11:17.544268+0000","last_fullsized":"2023-12-07T21:11:17.544268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608158+0000","last_change":"2023-12-07T21:08:56.873185+0000","last_active":"2023-12-07T21:11:10.608158+0000","last_peered":"2023-12-07T21:11:10.608158+0000","last_clean":"2023-12-07T21:11:10.608158+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:11:10.608158+0000","last_undegraded":"2023-12-07T21:11:10.608158+0000","last_fullsized":"2023-12-07T21:11:10.608158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607720+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:11:10.607720+0000","last_peered":"2023-12-07T21:11:10.607720+0000","last_clean":"2023-12-07T21:11:10.607720+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:11:10.607720+0000","last_undegraded":"2023-12-07T21:11:10.607720+0000","last_fullsized":"2023-12-07T21:11:10.607720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:59.757120+0000","last_change":"2023-12-07T21:11:59.757120+0000","last_active":"2023-12-07T21:11:59.757120+0000","last_peered":"2023-12-07T21:11:59.757120+0000","last_clean":"2023-12-07T21:11:59.757120+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:11:59.757120+0000","last_undegraded":"2023-12-07T21:11:59.757120+0000","last_fullsized":"2023-12-07T21:11:59.757120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_clean_scrub_stamp":"2023-12-07T21:11:59.757017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:04:59.018197+0000","scrub_duration":0.001196353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'61","reported_seq":127,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.783931+0000","last_change":"2023-12-07T21:11:44.783993+0000","last_active":"2023-12-07T21:11:44.783931+0000","last_peered":"2023-12-07T21:11:44.783931+0000","last_clean":"2023-12-07T21:11:44.783931+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:44.783931+0000","last_undegraded":"2023-12-07T21:11:44.783931+0000","last_fullsized":"2023-12-07T21:11:44.783931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.783824+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:07.474940+0000","scrub_duration":0.004588193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.558888+0000","last_change":"2023-12-07T21:11:36.558908+0000","last_active":"2023-12-07T21:11:36.558888+0000","last_peered":"2023-12-07T21:11:36.558888+0000","last_clean":"2023-12-07T21:11:36.558888+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:11:36.558888+0000","last_undegraded":"2023-12-07T21:11:36.558888+0000","last_fullsized":"2023-12-07T21:11:36.558888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.558807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:33:06.320086+0000","scrub_duration":0.001387288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345942+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:11:09.345942+0000","last_peered":"2023-12-07T21:11:09.345942+0000","last_clean":"2023-12-07T21:11:09.345942+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:11:09.345942+0000","last_undegraded":"2023-12-07T21:11:09.345942+0000","last_fullsized":"2023-12-07T21:11:09.345942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:19.862179+0000","last_change":"2023-12-07T21:12:19.862179+0000","last_active":"2023-12-07T21:12:19.862179+0000","last_peered":"2023-12-07T21:12:19.862179+0000","last_clean":"2023-12-07T21:12:19.862179+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:12:19.862179+0000","last_undegraded":"2023-12-07T21:12:19.862179+0000","last_fullsized":"2023-12-07T21:12:19.862179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_clean_scrub_stamp":"2023-12-07T21:12:19.862069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:34.168058+0000","scrub_duration":0.0015085669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766432+0000","last_change":"2023-12-07T21:08:54.882363+0000","last_active":"2023-12-07T21:11:09.766432+0000","last_peered":"2023-12-07T21:11:09.766432+0000","last_clean":"2023-12-07T21:11:09.766432+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:11:09.766432+0000","last_undegraded":"2023-12-07T21:11:09.766432+0000","last_fullsized":"2023-12-07T21:11:09.766432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188111+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:11:10.188111+0000","last_peered":"2023-12-07T21:11:10.188111+0000","last_clean":"2023-12-07T21:11:10.188111+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:11:10.188111+0000","last_undegraded":"2023-12-07T21:11:10.188111+0000","last_fullsized":"2023-12-07T21:11:10.188111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.514700+0000","last_change":"2023-12-07T21:12:21.514738+0000","last_active":"2023-12-07T21:12:21.514700+0000","last_peered":"2023-12-07T21:12:21.514700+0000","last_clean":"2023-12-07T21:12:21.514700+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:12:21.514700+0000","last_undegraded":"2023-12-07T21:12:21.514700+0000","last_fullsized":"2023-12-07T21:12:21.514700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.514603+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:11.760175+0000","scrub_duration":0.0065721260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:13.398971+0000","last_change":"2023-12-07T21:12:13.399009+0000","last_active":"2023-12-07T21:12:13.398971+0000","last_peered":"2023-12-07T21:12:13.398971+0000","last_clean":"2023-12-07T21:12:13.398971+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:12:13.398971+0000","last_undegraded":"2023-12-07T21:12:13.398971+0000","last_fullsized":"2023-12-07T21:12:13.398971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_clean_scrub_stamp":"2023-12-07T21:12:13.398859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:54.725992+0000","scrub_duration":0.0011359600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608912+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:11:10.608912+0000","last_peered":"2023-12-07T21:11:10.608912+0000","last_clean":"2023-12-07T21:11:10.608912+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:11:10.608912+0000","last_undegraded":"2023-12-07T21:11:10.608912+0000","last_fullsized":"2023-12-07T21:11:10.608912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.432371+0000","last_change":"2023-12-07T21:12:11.432392+0000","last_active":"2023-12-07T21:12:11.432371+0000","last_peered":"2023-12-07T21:12:11.432371+0000","last_clean":"2023-12-07T21:12:11.432371+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:12:11.432371+0000","last_undegraded":"2023-12-07T21:12:11.432371+0000","last_fullsized":"2023-12-07T21:12:11.432371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.432277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:48.190145+0000","scrub_duration":0.0010618419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766451+0000","last_change":"2023-12-07T21:08:54.887587+0000","last_active":"2023-12-07T21:11:09.766451+0000","last_peered":"2023-12-07T21:11:09.766451+0000","last_clean":"2023-12-07T21:11:09.766451+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:11:09.766451+0000","last_undegraded":"2023-12-07T21:11:09.766451+0000","last_fullsized":"2023-12-07T21:11:09.766451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:10.553115+0000","last_change":"2023-12-07T21:12:10.553135+0000","last_active":"2023-12-07T21:12:10.553115+0000","last_peered":"2023-12-07T21:12:10.553115+0000","last_clean":"2023-12-07T21:12:10.553115+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:12:10.553115+0000","last_undegraded":"2023-12-07T21:12:10.553115+0000","last_fullsized":"2023-12-07T21:12:10.553115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_clean_scrub_stamp":"2023-12-07T21:12:10.553023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:52.504367+0000","scrub_duration":0.0013037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.745145+0000","last_change":"2023-12-07T21:11:36.745178+0000","last_active":"2023-12-07T21:11:36.745145+0000","last_peered":"2023-12-07T21:11:36.745145+0000","last_clean":"2023-12-07T21:11:36.745145+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:36.745145+0000","last_undegraded":"2023-12-07T21:11:36.745145+0000","last_fullsized":"2023-12-07T21:11:36.745145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.745068+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:09.080620+0000","scrub_duration":0.0072373669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:16.616710+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:11:16.616710+0000","last_peered":"2023-12-07T21:11:16.616710+0000","last_clean":"2023-12-07T21:11:16.616710+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:11:16.616710+0000","last_undegraded":"2023-12-07T21:11:16.616710+0000","last_fullsized":"2023-12-07T21:11:16.616710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608884+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:11:10.608884+0000","last_peered":"2023-12-07T21:11:10.608884+0000","last_clean":"2023-12-07T21:11:10.608884+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:11:10.608884+0000","last_undegraded":"2023-12-07T21:11:10.608884+0000","last_fullsized":"2023-12-07T21:11:10.608884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.879480+0000","last_change":"2023-12-07T21:12:56.879540+0000","last_active":"2023-12-07T21:12:56.879480+0000","last_peered":"2023-12-07T21:12:56.879480+0000","last_clean":"2023-12-07T21:12:56.879480+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:12:56.879480+0000","last_undegraded":"2023-12-07T21:12:56.879480+0000","last_fullsized":"2023-12-07T21:12:56.879480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.879389+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:47.124961+0000","scrub_duration":0.0034133409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607746+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:11:10.607746+0000","last_peered":"2023-12-07T21:11:10.607746+0000","last_clean":"2023-12-07T21:11:10.607746+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:11:10.607746+0000","last_undegraded":"2023-12-07T21:11:10.607746+0000","last_fullsized":"2023-12-07T21:11:10.607746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.324406+0000","last_change":"2023-12-07T21:11:41.324449+0000","last_active":"2023-12-07T21:11:41.324406+0000","last_peered":"2023-12-07T21:11:41.324406+0000","last_clean":"2023-12-07T21:11:41.324406+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:41.324406+0000","last_undegraded":"2023-12-07T21:11:41.324406+0000","last_fullsized":"2023-12-07T21:11:41.324406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.324294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:18:22.956309+0000","scrub_duration":0.001431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.649725+0000","last_change":"2023-12-07T21:12:42.649725+0000","last_active":"2023-12-07T21:12:42.649725+0000","last_peered":"2023-12-07T21:12:42.649725+0000","last_clean":"2023-12-07T21:12:42.649725+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:12:42.649725+0000","last_undegraded":"2023-12-07T21:12:42.649725+0000","last_fullsized":"2023-12-07T21:12:42.649725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.649582+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:55:46.065006+0000","scrub_duration":0.0041186950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411900+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411900+0000","last_peered":"2023-12-07T21:11:10.411900+0000","last_clean":"2023-12-07T21:11:10.411900+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411900+0000","last_undegraded":"2023-12-07T21:11:10.411900+0000","last_fullsized":"2023-12-07T21:11:10.411900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608864+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:11:10.608864+0000","last_peered":"2023-12-07T21:11:10.608864+0000","last_clean":"2023-12-07T21:11:10.608864+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:11:10.608864+0000","last_undegraded":"2023-12-07T21:11:10.608864+0000","last_fullsized":"2023-12-07T21:11:10.608864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.370708+0000","last_change":"2023-12-07T21:13:07.370762+0000","last_active":"2023-12-07T21:13:07.370708+0000","last_peered":"2023-12-07T21:13:07.370708+0000","last_clean":"2023-12-07T21:13:07.370708+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:13:07.370708+0000","last_undegraded":"2023-12-07T21:13:07.370708+0000","last_fullsized":"2023-12-07T21:13:07.370708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:06.037407+0000","scrub_duration":0.0014696010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766523+0000","last_change":"2023-12-07T21:08:54.876774+0000","last_active":"2023-12-07T21:11:09.766523+0000","last_peered":"2023-12-07T21:11:09.766523+0000","last_clean":"2023-12-07T21:11:09.766523+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:11:09.766523+0000","last_undegraded":"2023-12-07T21:11:09.766523+0000","last_fullsized":"2023-12-07T21:11:09.766523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.351535+0000","last_change":"2023-12-07T21:11:43.351557+0000","last_active":"2023-12-07T21:11:43.351535+0000","last_peered":"2023-12-07T21:11:43.351535+0000","last_clean":"2023-12-07T21:11:43.351535+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:43.351535+0000","last_undegraded":"2023-12-07T21:11:43.351535+0000","last_fullsized":"2023-12-07T21:11:43.351535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_clean_scrub_stamp":"2023-12-07T21:11:43.351414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:25.302758+0000","scrub_duration":0.001534795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.102589+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:17.102589+0000","last_peered":"2023-12-07T21:11:17.102589+0000","last_clean":"2023-12-07T21:11:17.102589+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:17.102589+0000","last_undegraded":"2023-12-07T21:11:17.102589+0000","last_fullsized":"2023-12-07T21:11:17.102589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.804304+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:27.804304+0000","last_peered":"2023-12-07T21:11:27.804304+0000","last_clean":"2023-12-07T21:11:27.804304+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:27.804304+0000","last_undegraded":"2023-12-07T21:11:27.804304+0000","last_fullsized":"2023-12-07T21:11:27.804304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767539+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:11:09.767539+0000","last_peered":"2023-12-07T21:11:09.767539+0000","last_clean":"2023-12-07T21:11:09.767539+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:11:09.767539+0000","last_undegraded":"2023-12-07T21:11:09.767539+0000","last_fullsized":"2023-12-07T21:11:09.767539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187796+0000","last_change":"2023-12-07T21:08:56.870984+0000","last_active":"2023-12-07T21:11:10.187796+0000","last_peered":"2023-12-07T21:11:10.187796+0000","last_clean":"2023-12-07T21:11:10.187796+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:11:10.187796+0000","last_undegraded":"2023-12-07T21:11:10.187796+0000","last_fullsized":"2023-12-07T21:11:10.187796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607752+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:11:10.607752+0000","last_peered":"2023-12-07T21:11:10.607752+0000","last_clean":"2023-12-07T21:11:10.607752+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:11:10.607752+0000","last_undegraded":"2023-12-07T21:11:10.607752+0000","last_fullsized":"2023-12-07T21:11:10.607752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.612324+0000","last_change":"2023-12-07T21:12:17.612358+0000","last_active":"2023-12-07T21:12:17.612324+0000","last_peered":"2023-12-07T21:12:17.612324+0000","last_clean":"2023-12-07T21:12:17.612324+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:12:17.612324+0000","last_undegraded":"2023-12-07T21:12:17.612324+0000","last_fullsized":"2023-12-07T21:12:17.612324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.612233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:19.658682+0000","scrub_duration":0.00093805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.713857+0000","last_change":"2023-12-07T21:11:41.713922+0000","last_active":"2023-12-07T21:11:41.713857+0000","last_peered":"2023-12-07T21:11:41.713857+0000","last_clean":"2023-12-07T21:11:41.713857+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:41.713857+0000","last_undegraded":"2023-12-07T21:11:41.713857+0000","last_fullsized":"2023-12-07T21:11:41.713857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.713762+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:20:34.087308+0000","scrub_duration":0.004054785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.510322+0000","last_change":"2023-12-07T21:12:27.510342+0000","last_active":"2023-12-07T21:12:27.510322+0000","last_peered":"2023-12-07T21:12:27.510322+0000","last_clean":"2023-12-07T21:12:27.510322+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:12:27.510322+0000","last_undegraded":"2023-12-07T21:12:27.510322+0000","last_fullsized":"2023-12-07T21:12:27.510322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.510237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:49.420820+0000","scrub_duration":0.00099611600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608952+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:11:10.608952+0000","last_peered":"2023-12-07T21:11:10.608952+0000","last_clean":"2023-12-07T21:11:10.608952+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:11:10.608952+0000","last_undegraded":"2023-12-07T21:11:10.608952+0000","last_fullsized":"2023-12-07T21:11:10.608952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608124+0000","last_change":"2023-12-07T21:08:56.873059+0000","last_active":"2023-12-07T21:11:10.608124+0000","last_peered":"2023-12-07T21:11:10.608124+0000","last_clean":"2023-12-07T21:11:10.608124+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:11:10.608124+0000","last_undegraded":"2023-12-07T21:11:10.608124+0000","last_fullsized":"2023-12-07T21:11:10.608124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345089+0000","last_change":"2023-12-07T21:08:54.890887+0000","last_active":"2023-12-07T21:11:09.345089+0000","last_peered":"2023-12-07T21:11:09.345089+0000","last_clean":"2023-12-07T21:11:09.345089+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:11:09.345089+0000","last_undegraded":"2023-12-07T21:11:09.345089+0000","last_fullsized":"2023-12-07T21:11:09.345089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.412338+0000","last_change":"2023-12-07T21:11:55.412366+0000","last_active":"2023-12-07T21:11:55.412338+0000","last_peered":"2023-12-07T21:11:55.412338+0000","last_clean":"2023-12-07T21:11:55.412338+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:55.412338+0000","last_undegraded":"2023-12-07T21:11:55.412338+0000","last_fullsized":"2023-12-07T21:11:55.412338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.412243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.514434+0000","scrub_duration":0.0010230090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:00.405899+0000","last_change":"2023-12-07T21:12:00.405945+0000","last_active":"2023-12-07T21:12:00.405899+0000","last_peered":"2023-12-07T21:12:00.405899+0000","last_clean":"2023-12-07T21:12:00.405899+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:12:00.405899+0000","last_undegraded":"2023-12-07T21:12:00.405899+0000","last_fullsized":"2023-12-07T21:12:00.405899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_clean_scrub_stamp":"2023-12-07T21:12:00.405797+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:22.672028+0000","scrub_duration":0.0030248670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.620691+0000","last_change":"2023-12-07T21:12:35.620711+0000","last_active":"2023-12-07T21:12:35.620691+0000","last_peered":"2023-12-07T21:12:35.620691+0000","last_clean":"2023-12-07T21:12:35.620691+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:12:35.620691+0000","last_undegraded":"2023-12-07T21:12:35.620691+0000","last_fullsized":"2023-12-07T21:12:35.620691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.620604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:45:58.984206+0000","scrub_duration":0.00101417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608961+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:11:10.608961+0000","last_peered":"2023-12-07T21:11:10.608961+0000","last_clean":"2023-12-07T21:11:10.608961+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:11:10.608961+0000","last_undegraded":"2023-12-07T21:11:10.608961+0000","last_fullsized":"2023-12-07T21:11:10.608961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:45.443200+0000","last_change":"2023-12-07T21:12:45.443225+0000","last_active":"2023-12-07T21:12:45.443200+0000","last_peered":"2023-12-07T21:12:45.443200+0000","last_clean":"2023-12-07T21:12:45.443200+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:12:45.443200+0000","last_undegraded":"2023-12-07T21:12:45.443200+0000","last_fullsized":"2023-12-07T21:12:45.443200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_clean_scrub_stamp":"2023-12-07T21:12:45.443116+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:59.105780+0000","scrub_duration":0.003118975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:41.352194+0000","last_change":"2023-12-07T21:12:41.352194+0000","last_active":"2023-12-07T21:12:41.352194+0000","last_peered":"2023-12-07T21:12:41.352194+0000","last_clean":"2023-12-07T21:12:41.352194+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:12:41.352194+0000","last_undegraded":"2023-12-07T21:12:41.352194+0000","last_fullsized":"2023-12-07T21:12:41.352194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_clean_scrub_stamp":"2023-12-07T21:12:41.352075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:21.467955+0000","scrub_duration":0.001369671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.347674+0000","last_change":"2023-12-07T21:11:44.347728+0000","last_active":"2023-12-07T21:11:44.347674+0000","last_peered":"2023-12-07T21:11:44.347674+0000","last_clean":"2023-12-07T21:11:44.347674+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:44.347674+0000","last_undegraded":"2023-12-07T21:11:44.347674+0000","last_fullsized":"2023-12-07T21:11:44.347674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.347582+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:19:20.740832+0000","scrub_duration":0.0032839919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.582439+0000","last_change":"2023-12-07T21:13:06.582486+0000","last_active":"2023-12-07T21:13:06.582439+0000","last_peered":"2023-12-07T21:13:06.582439+0000","last_clean":"2023-12-07T21:13:06.582439+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:13:06.582439+0000","last_undegraded":"2023-12-07T21:13:06.582439+0000","last_fullsized":"2023-12-07T21:13:06.582439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.582338+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:09:35.689720+0000","scrub_duration":0.0045970239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.597790+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:15.597790+0000","last_peered":"2023-12-07T21:11:15.597790+0000","last_clean":"2023-12-07T21:11:15.597790+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:15.597790+0000","last_undegraded":"2023-12-07T21:11:15.597790+0000","last_fullsized":"2023-12-07T21:11:15.597790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608930+0000","last_change":"2023-12-07T21:09:04.928655+0000","last_active":"2023-12-07T21:11:10.608930+0000","last_peered":"2023-12-07T21:11:10.608930+0000","last_clean":"2023-12-07T21:11:10.608930+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:11:10.608930+0000","last_undegraded":"2023-12-07T21:11:10.608930+0000","last_fullsized":"2023-12-07T21:11:10.608930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.282849+0000","last_change":"2023-12-07T21:12:20.282874+0000","last_active":"2023-12-07T21:12:20.282849+0000","last_peered":"2023-12-07T21:12:20.282849+0000","last_clean":"2023-12-07T21:12:20.282849+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:12:20.282849+0000","last_undegraded":"2023-12-07T21:12:20.282849+0000","last_fullsized":"2023-12-07T21:12:20.282849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.282741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:25.331572+0000","scrub_duration":0.001103185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187543+0000","last_change":"2023-12-07T21:08:54.888408+0000","last_active":"2023-12-07T21:11:10.187543+0000","last_peered":"2023-12-07T21:11:10.187543+0000","last_clean":"2023-12-07T21:11:10.187543+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:11:10.187543+0000","last_undegraded":"2023-12-07T21:11:10.187543+0000","last_fullsized":"2023-12-07T21:11:10.187543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.887032+0000","last_change":"2023-12-07T21:12:35.887062+0000","last_active":"2023-12-07T21:12:35.887032+0000","last_peered":"2023-12-07T21:12:35.887032+0000","last_clean":"2023-12-07T21:12:35.887032+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:12:35.887032+0000","last_undegraded":"2023-12-07T21:12:35.887032+0000","last_fullsized":"2023-12-07T21:12:35.887032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.886915+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:07.595951+0000","scrub_duration":0.0013132650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345119+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:11:09.345119+0000","last_peered":"2023-12-07T21:11:09.345119+0000","last_clean":"2023-12-07T21:11:09.345119+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:11:09.345119+0000","last_undegraded":"2023-12-07T21:11:09.345119+0000","last_fullsized":"2023-12-07T21:11:09.345119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.424101+0000","last_change":"2023-12-07T21:12:12.424126+0000","last_active":"2023-12-07T21:12:12.424101+0000","last_peered":"2023-12-07T21:12:12.424101+0000","last_clean":"2023-12-07T21:12:12.424101+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:12:12.424101+0000","last_undegraded":"2023-12-07T21:12:12.424101+0000","last_fullsized":"2023-12-07T21:12:12.424101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.424026+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:21.643939+0000","scrub_duration":0.002995218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607794+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:11:10.607794+0000","last_peered":"2023-12-07T21:11:10.607794+0000","last_clean":"2023-12-07T21:11:10.607794+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:11:10.607794+0000","last_undegraded":"2023-12-07T21:11:10.607794+0000","last_fullsized":"2023-12-07T21:11:10.607794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802478+0000","last_change":"2023-12-07T21:08:56.872273+0000","last_active":"2023-12-07T21:11:08.802478+0000","last_peered":"2023-12-07T21:11:08.802478+0000","last_clean":"2023-12-07T21:11:08.802478+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:11:08.802478+0000","last_undegraded":"2023-12-07T21:11:08.802478+0000","last_fullsized":"2023-12-07T21:11:08.802478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345250+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:11:09.345250+0000","last_peered":"2023-12-07T21:11:09.345250+0000","last_clean":"2023-12-07T21:11:09.345250+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:11:09.345250+0000","last_undegraded":"2023-12-07T21:11:09.345250+0000","last_fullsized":"2023-12-07T21:11:09.345250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.893908+0000","last_change":"2023-12-07T21:13:07.893908+0000","last_active":"2023-12-07T21:13:07.893908+0000","last_peered":"2023-12-07T21:13:07.893908+0000","last_clean":"2023-12-07T21:13:07.893908+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:13:07.893908+0000","last_undegraded":"2023-12-07T21:13:07.893908+0000","last_fullsized":"2023-12-07T21:13:07.893908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.893732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:21.957836+0000","scrub_duration":0.0014675510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802500+0000","last_change":"2023-12-07T21:08:54.874578+0000","last_active":"2023-12-07T21:11:08.802500+0000","last_peered":"2023-12-07T21:11:08.802500+0000","last_clean":"2023-12-07T21:11:08.802500+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:11:08.802500+0000","last_undegraded":"2023-12-07T21:11:08.802500+0000","last_fullsized":"2023-12-07T21:11:08.802500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766799+0000","last_change":"2023-12-07T21:08:56.883348+0000","last_active":"2023-12-07T21:11:09.766799+0000","last_peered":"2023-12-07T21:11:09.766799+0000","last_clean":"2023-12-07T21:11:09.766799+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:11:09.766799+0000","last_undegraded":"2023-12-07T21:11:09.766799+0000","last_fullsized":"2023-12-07T21:11:09.766799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.808756+0000","last_change":"2023-12-07T21:08:54.887259+0000","last_active":"2023-12-07T21:11:08.808756+0000","last_peered":"2023-12-07T21:11:08.808756+0000","last_clean":"2023-12-07T21:11:08.808756+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:11:08.808756+0000","last_undegraded":"2023-12-07T21:11:08.808756+0000","last_fullsized":"2023-12-07T21:11:08.808756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.783809+0000","last_change":"2023-12-07T21:12:21.783809+0000","last_active":"2023-12-07T21:12:21.783809+0000","last_peered":"2023-12-07T21:12:21.783809+0000","last_clean":"2023-12-07T21:12:21.783809+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:12:21.783809+0000","last_undegraded":"2023-12-07T21:12:21.783809+0000","last_fullsized":"2023-12-07T21:12:21.783809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.783687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:25.104216+0000","scrub_duration":0.001223366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.417788+0000","last_change":"2023-12-07T21:12:58.417813+0000","last_active":"2023-12-07T21:12:58.417788+0000","last_peered":"2023-12-07T21:12:58.417788+0000","last_clean":"2023-12-07T21:12:58.417788+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:12:58.417788+0000","last_undegraded":"2023-12-07T21:12:58.417788+0000","last_fullsized":"2023-12-07T21:12:58.417788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.417685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:16.173945+0000","scrub_duration":0.0012264019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.393510+0000","last_change":"2023-12-07T21:12:14.393510+0000","last_active":"2023-12-07T21:12:14.393510+0000","last_peered":"2023-12-07T21:12:14.393510+0000","last_clean":"2023-12-07T21:12:14.393510+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:12:14.393510+0000","last_undegraded":"2023-12-07T21:12:14.393510+0000","last_fullsized":"2023-12-07T21:12:14.393510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.393370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:28.056034+0000","scrub_duration":0.0012787390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.802670+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:11:08.802670+0000","last_peered":"2023-12-07T21:11:08.802670+0000","last_clean":"2023-12-07T21:11:08.802670+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:11:08.802670+0000","last_undegraded":"2023-12-07T21:11:08.802670+0000","last_fullsized":"2023-12-07T21:11:08.802670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:22.292045+0000","last_change":"2023-12-07T21:12:22.292065+0000","last_active":"2023-12-07T21:12:22.292045+0000","last_peered":"2023-12-07T21:12:22.292045+0000","last_clean":"2023-12-07T21:12:22.292045+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:12:22.292045+0000","last_undegraded":"2023-12-07T21:12:22.292045+0000","last_fullsized":"2023-12-07T21:12:22.292045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_clean_scrub_stamp":"2023-12-07T21:12:22.291964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:19:35.510802+0000","scrub_duration":0.000955034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:08.809216+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:11:08.809216+0000","last_peered":"2023-12-07T21:11:08.809216+0000","last_clean":"2023-12-07T21:11:08.809216+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:11:08.809216+0000","last_undegraded":"2023-12-07T21:11:08.809216+0000","last_fullsized":"2023-12-07T21:11:08.809216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:24.489620+0000","last_change":"2023-12-07T21:12:24.489652+0000","last_active":"2023-12-07T21:12:24.489620+0000","last_peered":"2023-12-07T21:12:24.489620+0000","last_clean":"2023-12-07T21:12:24.489620+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:12:24.489620+0000","last_undegraded":"2023-12-07T21:12:24.489620+0000","last_fullsized":"2023-12-07T21:12:24.489620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_clean_scrub_stamp":"2023-12-07T21:12:24.489525+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:58:44.073512+0000","scrub_duration":0.0022717330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345160+0000","last_change":"2023-12-07T21:08:54.883629+0000","last_active":"2023-12-07T21:11:09.345160+0000","last_peered":"2023-12-07T21:11:09.345160+0000","last_clean":"2023-12-07T21:11:09.345160+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:11:09.345160+0000","last_undegraded":"2023-12-07T21:11:09.345160+0000","last_fullsized":"2023-12-07T21:11:09.345160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.917483+0000","last_change":"2023-12-07T21:13:00.917521+0000","last_active":"2023-12-07T21:13:00.917483+0000","last_peered":"2023-12-07T21:13:00.917483+0000","last_clean":"2023-12-07T21:13:00.917483+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:13:00.917483+0000","last_undegraded":"2023-12-07T21:13:00.917483+0000","last_fullsized":"2023-12-07T21:13:00.917483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.917383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:19.507436+0000","scrub_duration":0.0013780719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766567+0000","last_change":"2023-12-07T21:08:54.887130+0000","last_active":"2023-12-07T21:11:09.766567+0000","last_peered":"2023-12-07T21:11:09.766567+0000","last_clean":"2023-12-07T21:11:09.766567+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:11:09.766567+0000","last_undegraded":"2023-12-07T21:11:09.766567+0000","last_fullsized":"2023-12-07T21:11:09.766567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:33.322727+0000","last_change":"2023-12-07T21:12:33.322751+0000","last_active":"2023-12-07T21:12:33.322727+0000","last_peered":"2023-12-07T21:12:33.322727+0000","last_clean":"2023-12-07T21:12:33.322727+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:12:33.322727+0000","last_undegraded":"2023-12-07T21:12:33.322727+0000","last_fullsized":"2023-12-07T21:12:33.322727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_clean_scrub_stamp":"2023-12-07T21:12:33.322634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:25:00.599068+0000","scrub_duration":0.001216778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766587+0000","last_change":"2023-12-07T21:08:54.884013+0000","last_active":"2023-12-07T21:11:09.766587+0000","last_peered":"2023-12-07T21:11:09.766587+0000","last_clean":"2023-12-07T21:11:09.766587+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:11:09.766587+0000","last_undegraded":"2023-12-07T21:11:09.766587+0000","last_fullsized":"2023-12-07T21:11:09.766587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:32.342422+0000","last_change":"2023-12-07T21:12:32.342446+0000","last_active":"2023-12-07T21:12:32.342422+0000","last_peered":"2023-12-07T21:12:32.342422+0000","last_clean":"2023-12-07T21:12:32.342422+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:12:32.342422+0000","last_undegraded":"2023-12-07T21:12:32.342422+0000","last_fullsized":"2023-12-07T21:12:32.342422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_clean_scrub_stamp":"2023-12-07T21:12:32.342321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:46.648309+0000","scrub_duration":0.0011184750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607834+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:11:10.607834+0000","last_peered":"2023-12-07T21:11:10.607834+0000","last_clean":"2023-12-07T21:11:10.607834+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:11:10.607834+0000","last_undegraded":"2023-12-07T21:11:10.607834+0000","last_fullsized":"2023-12-07T21:11:10.607834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'16","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.341241+0000","last_change":"2023-12-07T21:12:27.341269+0000","last_active":"2023-12-07T21:12:27.341241+0000","last_peered":"2023-12-07T21:12:27.341241+0000","last_clean":"2023-12-07T21:12:27.341241+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:12:27.341241+0000","last_undegraded":"2023-12-07T21:12:27.341241+0000","last_fullsized":"2023-12-07T21:12:27.341241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.341151+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:55:08.404366+0000","scrub_duration":0.0024774139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607826+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:11:10.607826+0000","last_peered":"2023-12-07T21:11:10.607826+0000","last_clean":"2023-12-07T21:11:10.607826+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:11:10.607826+0000","last_undegraded":"2023-12-07T21:11:10.607826+0000","last_fullsized":"2023-12-07T21:11:10.607826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608179+0000","last_change":"2023-12-07T21:08:56.876875+0000","last_active":"2023-12-07T21:11:10.608179+0000","last_peered":"2023-12-07T21:11:10.608179+0000","last_clean":"2023-12-07T21:11:10.608179+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:11:10.608179+0000","last_undegraded":"2023-12-07T21:11:10.608179+0000","last_fullsized":"2023-12-07T21:11:10.608179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.462632+0000","last_change":"2023-12-07T21:12:54.462656+0000","last_active":"2023-12-07T21:12:54.462632+0000","last_peered":"2023-12-07T21:12:54.462632+0000","last_clean":"2023-12-07T21:12:54.462632+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:12:54.462632+0000","last_undegraded":"2023-12-07T21:12:54.462632+0000","last_fullsized":"2023-12-07T21:12:54.462632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.462543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:12:35.524119+0000","scrub_duration":0.0012396099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:01.404024+0000","last_change":"2023-12-07T21:12:01.404048+0000","last_active":"2023-12-07T21:12:01.404024+0000","last_peered":"2023-12-07T21:12:01.404024+0000","last_clean":"2023-12-07T21:12:01.404024+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:12:01.404024+0000","last_undegraded":"2023-12-07T21:12:01.404024+0000","last_fullsized":"2023-12-07T21:12:01.404024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_clean_scrub_stamp":"2023-12-07T21:12:01.403925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:06:41.638050+0000","scrub_duration":0.0014963070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607856+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:11:10.607856+0000","last_peered":"2023-12-07T21:11:10.607856+0000","last_clean":"2023-12-07T21:11:10.607856+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:11:10.607856+0000","last_undegraded":"2023-12-07T21:11:10.607856+0000","last_fullsized":"2023-12-07T21:11:10.607856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607882+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:11:10.607882+0000","last_peered":"2023-12-07T21:11:10.607882+0000","last_clean":"2023-12-07T21:11:10.607882+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:11:10.607882+0000","last_undegraded":"2023-12-07T21:11:10.607882+0000","last_fullsized":"2023-12-07T21:11:10.607882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345392+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:11:09.345392+0000","last_peered":"2023-12-07T21:11:09.345392+0000","last_clean":"2023-12-07T21:11:09.345392+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:11:09.345392+0000","last_undegraded":"2023-12-07T21:11:09.345392+0000","last_fullsized":"2023-12-07T21:11:09.345392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.910394+0000","last_change":"2023-12-07T21:13:05.910417+0000","last_active":"2023-12-07T21:13:05.910394+0000","last_peered":"2023-12-07T21:13:05.910394+0000","last_clean":"2023-12-07T21:13:05.910394+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:13:05.910394+0000","last_undegraded":"2023-12-07T21:13:05.910394+0000","last_fullsized":"2023-12-07T21:13:05.910394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.910299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:31:57.708172+0000","scrub_duration":0.001525988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.272185+0000","last_change":"2023-12-07T21:12:56.272208+0000","last_active":"2023-12-07T21:12:56.272185+0000","last_peered":"2023-12-07T21:12:56.272185+0000","last_clean":"2023-12-07T21:12:56.272185+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:12:56.272185+0000","last_undegraded":"2023-12-07T21:12:56.272185+0000","last_fullsized":"2023-12-07T21:12:56.272185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.272079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:16.868178+0000","scrub_duration":0.0010823779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1971,"ondisk_log_size":1971,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1439,"ondisk_log_size":1439,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705722,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.309,"5min":0.182,"15min":0.182},"max":{"1min":0.58399999999999996,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.439,"15min":0.44500000000000001},"min":{"1min":0.31,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51800000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33400000000000002,"15min":0.34300000000000003},"min":{"1min":0.26500000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.435,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.24199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48899999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.37},"min":{"1min":0.28199999999999997,"5min":0.223,"15min":0.223},"max":{"1min":0.48299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33400000000000002,"15min":0.33700000000000002},"min":{"1min":0.24199999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.47499999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705721,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.56899999999999995,"5min":0.621,"15min":0.621},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.32100000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48899999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.308,"5min":0.32500000000000001,"15min":0.33200000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.42299999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32700000000000001,"15min":0.32900000000000001},"min":{"1min":0.245,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.40200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.26600000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.44900000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.38100000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705721,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.27600000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.56100000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.32400000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33800000000000002,"15min":0.35799999999999998},"min":{"1min":0.20200000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.39600000000000002,"5min":0.629,"15min":0.629},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.31,"5min":0.32300000000000001,"15min":0.32600000000000001},"min":{"1min":0.214,"5min":0.186,"15min":0.186},"max":{"1min":0.5,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33400000000000002,"15min":0.34200000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.43099999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36299999999999999,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.46200000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.36299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.25700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.70199999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.318,"5min":0.191,"15min":0.191},"max":{"1min":0.65200000000000002,"5min":0.747,"15min":0.747},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.497,"15min":0.48299999999999998},"min":{"1min":0.38,"5min":0.223,"15min":0.223},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.49099999999999999,"15min":0.47699999999999998},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67500000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Dec 7 21:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.496,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.504,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.33700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68100000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:13:13.135 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.135 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.135 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.136 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.136 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.136 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.136 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.136 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.136 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.136 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.137 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.137 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.137 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.137 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.137 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.137 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.138 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.138 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.138 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.138 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.138 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.138 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.139 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.139 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.139 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.139 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.139 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.139 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.140 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.140 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.140 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.140 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.140 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.140 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.141 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.141 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.141 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.141 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.141 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.141 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.141 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.142 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-07T21:08:40.790884+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=40, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.142 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.142 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.142 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.142 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.142 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.143 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.143 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.143 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.143 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.143 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.144 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.144 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.144 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.144 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.145 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.145 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.145 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.145 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.145 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.145 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.145 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.146 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.146 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.146 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.146 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.146 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.147 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.147 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.147 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.147 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.147 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.147 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.148 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.148 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.148 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.148 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.148 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.148 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.148 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.149 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.149 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.149 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.149 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.149 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.149 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.150 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.150 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.150 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.150 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.150 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.150 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.151 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.151 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.151 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.151 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.151 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.151 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.152 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.152 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.152 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.152 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.152 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.152 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.152 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.153 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.153 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.153 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.153 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.153 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.154 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.154 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.154 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.154 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.154 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.154 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.155 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:13.155 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:13:33.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:13:33.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.275+0000 7f2274bf0640 1 Processor -- start 2023-12-07T21:13:33.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.275+0000 7f2274bf0640 1 -- start start 2023-12-07T21:13:33.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.276+0000 7f2274bf0640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2270070610 0x7f22700709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:13:33.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.276+0000 7f2274bf0640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227006e240 con 0x7f227006cc90 2023-12-07T21:13:33.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.276+0000 7f2274bf0640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2270070140 con 0x7f2270070610 2023-12-07T21:13:33.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.276+0000 7f226e59c640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2270070610 0x7f22700709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:13:33.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.276+0000 7f226dd9b640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f227006cc90 0x7f227006d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:60232/0 (socket says 172.21.15.89:60232) 2023-12-07T21:13:33.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.276+0000 7f226dd9b640 1 -- 172.21.15.89:0/3682142425 learned_addr learned my addr 172.21.15.89:0/3682142425 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:13:33.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.276+0000 7f226e59c640 1 -- 172.21.15.89:0/3682142425 >> v1:172.21.15.89:6789/0 conn(0x7f227006cc90 legacy=0x7f227006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:33.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.276+0000 7f226e59c640 1 -- 172.21.15.89:0/3682142425 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227006e9a0 con 0x7f2270070610 2023-12-07T21:13:33.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.276+0000 7f226d59a640 1 -- 172.21.15.89:0/3682142425 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388514947 0 0) 0x7f227006e240 con 0x7f227006cc90 2023-12-07T21:13:33.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.277+0000 7f226e59c640 1 --2- 172.21.15.89:0/3682142425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2270070610 0x7f22700709f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2260009720 tx=0x7f226002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd8ebf42173b90a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:13:33.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.277+0000 7f226d59a640 1 -- 172.21.15.89:0/3682142425 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f226002e070 con 0x7f2270070610 2023-12-07T21:13:33.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.277+0000 7f226d59a640 1 -- 172.21.15.89:0/3682142425 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22600316d0 con 0x7f2270070610 2023-12-07T21:13:33.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.277+0000 7f226d59a640 1 -- 172.21.15.89:0/3682142425 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2260031990 con 0x7f2270070610 2023-12-07T21:13:33.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.277+0000 7f2274bf0640 1 -- 172.21.15.89:0/3682142425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2270070610 msgr2=0x7f22700709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:33.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.277+0000 7f2274bf0640 1 --2- 172.21.15.89:0/3682142425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2270070610 0x7f22700709f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2260009720 tx=0x7f226002b840 comp rx=0 tx=0).stop 2023-12-07T21:13:33.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.278+0000 7f2274bf0640 1 -- 172.21.15.89:0/3682142425 shutdown_connections 2023-12-07T21:13:33.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.278+0000 7f2274bf0640 1 --2- 172.21.15.89:0/3682142425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2270070610 0x7f22700709f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:13:33.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.278+0000 7f2274bf0640 1 -- 172.21.15.89:0/3682142425 >> 172.21.15.89:0/3682142425 conn(0x7f22700987f0 msgr2=0x7f2270098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:13:33.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.278+0000 7f2274bf0640 1 -- 172.21.15.89:0/3682142425 shutdown_connections 2023-12-07T21:13:33.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.278+0000 7f2274bf0640 1 -- 172.21.15.89:0/3682142425 wait complete. 2023-12-07T21:13:33.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.279+0000 7f2274bf0640 1 Processor -- start 2023-12-07T21:13:33.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.279+0000 7f2274bf0640 1 -- start start 2023-12-07T21:13:33.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.279+0000 7f2274bf0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227006cc90 0x7f22701bec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:13:33.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.279+0000 7f2274bf0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2270090650 con 0x7f227006cc90 2023-12-07T21:13:33.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.279+0000 7f226e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227006cc90 0x7f22701bec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:13:33.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.279+0000 7f226e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227006cc90 0x7f22701bec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36696/0 (socket says 172.21.15.89:36696) 2023-12-07T21:13:33.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.279+0000 7f226e59c640 1 -- 172.21.15.89:0/2455239538 learned_addr learned my addr 172.21.15.89:0/2455239538 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:13:33.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.279+0000 7f226e59c640 1 -- 172.21.15.89:0/2455239538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2260009400 con 0x7f227006cc90 2023-12-07T21:13:33.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.280+0000 7f226e59c640 1 --2- 172.21.15.89:0/2455239538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227006cc90 0x7f22701bec60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f226002b880 tx=0x7f22600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:13:33.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.280+0000 7f225effd640 1 -- 172.21.15.89:0/2455239538 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2260004160 con 0x7f227006cc90 2023-12-07T21:13:33.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.280+0000 7f225effd640 1 -- 172.21.15.89:0/2455239538 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22600042c0 con 0x7f227006cc90 2023-12-07T21:13:33.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.280+0000 7f225effd640 1 -- 172.21.15.89:0/2455239538 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2260032640 con 0x7f227006cc90 2023-12-07T21:13:33.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.280+0000 7f2274bf0640 1 -- 172.21.15.89:0/2455239538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227012a5e0 con 0x7f227006cc90 2023-12-07T21:13:33.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.280+0000 7f2274bf0640 1 -- 172.21.15.89:0/2455239538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2270090960 con 0x7f227006cc90 2023-12-07T21:13:33.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.281+0000 7f225effd640 1 -- 172.21.15.89:0/2455239538 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f22600327a0 con 0x7f227006cc90 2023-12-07T21:13:33.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.281+0000 7f2274bf0640 1 -- 172.21.15.89:0/2455239538 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2270090070 con 0x7f227006cc90 2023-12-07T21:13:33.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.281+0000 7f225effd640 1 --2- 172.21.15.89:0/2455239538 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2250037820 0x7f2250039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:13:33.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.281+0000 7f225effd640 1 -- 172.21.15.89:0/2455239538 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f226006d0f0 con 0x7f227006cc90 2023-12-07T21:13:33.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.281+0000 7f226dd9b640 1 --2- 172.21.15.89:0/2455239538 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2250037820 0x7f2250039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:13:33.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.282+0000 7f226dd9b640 1 --2- 172.21.15.89:0/2455239538 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2250037820 0x7f2250039ce0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2264000c00 tx=0x7f2264007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:13:33.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.286+0000 7f225effd640 1 -- 172.21.15.89:0/2455239538 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2260044520 con 0x7f227006cc90 2023-12-07T21:13:33.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.448+0000 7f2274bf0640 1 -- 172.21.15.89:0/2455239538 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2270070f30 con 0x7f2250037820 2023-12-07T21:13:33.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.464+0000 7f225effd640 1 -- 172.21.15.89:0/2455239538 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+672774 (secure 0 0 0) 0x7f22640012b0 con 0x7f2250037820 2023-12-07T21:13:33.462 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:13:33.468 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:13:33.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.469+0000 7f2274bf0640 1 -- 172.21.15.89:0/2455239538 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2250037820 msgr2=0x7f2250039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:33.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.469+0000 7f2274bf0640 1 --2- 172.21.15.89:0/2455239538 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2250037820 0x7f2250039ce0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2264000c00 tx=0x7f2264007910 comp rx=0 tx=0).stop 2023-12-07T21:13:33.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.469+0000 7f2274bf0640 1 -- 172.21.15.89:0/2455239538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227006cc90 msgr2=0x7f22701bec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:33.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.469+0000 7f2274bf0640 1 --2- 172.21.15.89:0/2455239538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227006cc90 0x7f22701bec60 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f226002b880 tx=0x7f22600046c0 comp rx=0 tx=0).stop 2023-12-07T21:13:33.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.469+0000 7f2274bf0640 1 -- 172.21.15.89:0/2455239538 shutdown_connections 2023-12-07T21:13:33.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.469+0000 7f2274bf0640 1 --2- 172.21.15.89:0/2455239538 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f2250037820 0x7f2250039ce0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:13:33.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.469+0000 7f2274bf0640 1 --2- 172.21.15.89:0/2455239538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f227006cc90 0x7f22701bec60 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:13:33.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.469+0000 7f2274bf0640 1 -- 172.21.15.89:0/2455239538 >> 172.21.15.89:0/2455239538 conn(0x7f22700987f0 msgr2=0x7f2270122e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:13:33.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.469+0000 7f2274bf0640 1 -- 172.21.15.89:0/2455239538 shutdown_connections 2023-12-07T21:13:33.471 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:33.469+0000 7f2274bf0640 1 -- 172.21.15.89:0/2455239538 wait complete. 2023-12-07T21:13:33.472 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2023-12-07T21:13:32.136232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1653,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4015,"ondisk_log_size":4015,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004396"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:19.413104+0000","last_change":"2023-12-07T21:13:19.413127+0000","last_active":"2023-12-07T21:13:19.413104+0000","last_peered":"2023-12-07T21:13:19.413104+0000","last_clean":"2023-12-07T21:13:19.413104+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:13:19.413104+0000","last_undegraded":"2023-12-07T21:13:19.413104+0000","last_fullsized":"2023-12-07T21:13:19.413104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_clean_scrub_stamp":"2023-12-07T21:13:19.413017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:51.122054+0000","scrub_duration":0.001250333,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.407237+0000","last_change":"2023-12-07T21:12:16.407256+0000","last_active":"2023-12-07T21:12:16.407237+0000","last_peered":"2023-12-07T21:12:16.407237+0000","last_clean":"2023-12-07T21:12:16.407237+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:12:16.407237+0000","last_undegraded":"2023-12-07T21:12:16.407237+0000","last_fullsized":"2023-12-07T21:12:16.407237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.407151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:53.647151+0000","scrub_duration":0.00097124400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.079685+0000","last_change":"2023-12-07T21:13:28.079732+0000","last_active":"2023-12-07T21:13:28.079685+0000","last_peered":"2023-12-07T21:13:28.079685+0000","last_clean":"2023-12-07T21:13:28.079685+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:13:28.079685+0000","last_undegraded":"2023-12-07T21:13:28.079685+0000","last_fullsized":"2023-12-07T21:13:28.079685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.079572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:44:03.747216+0000","scrub_duration":0.0011377760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345425+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:11:09.345425+0000","last_peered":"2023-12-07T21:11:09.345425+0000","last_clean":"2023-12-07T21:11:09.345425+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:11:09.345425+0000","last_undegraded":"2023-12-07T21:11:09.345425+0000","last_fullsized":"2023-12-07T21:11:09.345425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607997+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:11:10.607997+0000","last_peered":"2023-12-07T21:11:10.607997+0000","last_clean":"2023-12-07T21:11:10.607997+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:11:10.607997+0000","last_undegraded":"2023-12-07T21:11:10.607997+0000","last_fullsized":"2023-12-07T21:11:10.607997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608236+0000","last_change":"2023-12-07T21:08:56.873919+0000","last_active":"2023-12-07T21:11:10.608236+0000","last_peered":"2023-12-07T21:11:10.608236+0000","last_clean":"2023-12-07T21:11:10.608236+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:11:10.608236+0000","last_undegraded":"2023-12-07T21:11:10.608236+0000","last_fullsized":"2023-12-07T21:11:10.608236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187665+0000","last_change":"2023-12-07T21:08:54.880442+0000","last_active":"2023-12-07T21:11:10.187665+0000","last_peered":"2023-12-07T21:11:10.187665+0000","last_clean":"2023-12-07T21:11:10.187665+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:11:10.187665+0000","last_undegraded":"2023-12-07T21:11:10.187665+0000","last_fullsized":"2023-12-07T21:11:10.187665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608264+0000","last_change":"2023-12-07T21:08:56.874751+0000","last_active":"2023-12-07T21:11:10.608264+0000","last_peered":"2023-12-07T21:11:10.608264+0000","last_clean":"2023-12-07T21:11:10.608264+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:11:10.608264+0000","last_undegraded":"2023-12-07T21:11:10.608264+0000","last_fullsized":"2023-12-07T21:11:10.608264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607907+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:11:10.607907+0000","last_peered":"2023-12-07T21:11:10.607907+0000","last_clean":"2023-12-07T21:11:10.607907+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:11:10.607907+0000","last_undegraded":"2023-12-07T21:11:10.607907+0000","last_fullsized":"2023-12-07T21:11:10.607907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:39.304151+0000","last_change":"2023-12-07T21:12:39.304151+0000","last_active":"2023-12-07T21:12:39.304151+0000","last_peered":"2023-12-07T21:12:39.304151+0000","last_clean":"2023-12-07T21:12:39.304151+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:12:39.304151+0000","last_undegraded":"2023-12-07T21:12:39.304151+0000","last_fullsized":"2023-12-07T21:12:39.304151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_clean_scrub_stamp":"2023-12-07T21:12:39.304039+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:10.499475+0000","scrub_duration":0.0026021579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187656+0000","last_change":"2023-12-07T21:08:54.880274+0000","last_active":"2023-12-07T21:11:10.187656+0000","last_peered":"2023-12-07T21:11:10.187656+0000","last_clean":"2023-12-07T21:11:10.187656+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:11:10.187656+0000","last_undegraded":"2023-12-07T21:11:10.187656+0000","last_fullsized":"2023-12-07T21:11:10.187656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187892+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:11:10.187892+0000","last_peered":"2023-12-07T21:11:10.187892+0000","last_clean":"2023-12-07T21:11:10.187892+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:11:10.187892+0000","last_undegraded":"2023-12-07T21:11:10.187892+0000","last_fullsized":"2023-12-07T21:11:10.187892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607886+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:11:10.607886+0000","last_peered":"2023-12-07T21:11:10.607886+0000","last_clean":"2023-12-07T21:11:10.607886+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:11:10.607886+0000","last_undegraded":"2023-12-07T21:11:10.607886+0000","last_fullsized":"2023-12-07T21:11:10.607886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187911+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:11:10.187911+0000","last_peered":"2023-12-07T21:11:10.187911+0000","last_clean":"2023-12-07T21:11:10.187911+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:11:10.187911+0000","last_undegraded":"2023-12-07T21:11:10.187911+0000","last_fullsized":"2023-12-07T21:11:10.187911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.845887+0000","last_change":"2023-12-07T21:12:54.845908+0000","last_active":"2023-12-07T21:12:54.845887+0000","last_peered":"2023-12-07T21:12:54.845887+0000","last_clean":"2023-12-07T21:12:54.845887+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:12:54.845887+0000","last_undegraded":"2023-12-07T21:12:54.845887+0000","last_fullsized":"2023-12-07T21:12:54.845887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.845780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:05.129794+0000","scrub_duration":0.001437123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'14","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.396728+0000","last_change":"2023-12-07T21:12:49.396728+0000","last_active":"2023-12-07T21:12:49.396728+0000","last_peered":"2023-12-07T21:12:49.396728+0000","last_clean":"2023-12-07T21:12:49.396728+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:12:49.396728+0000","last_undegraded":"2023-12-07T21:12:49.396728+0000","last_fullsized":"2023-12-07T21:12:49.396728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.396576+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:24:16.481666+0000","scrub_duration":0.0022819030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608172+0000","last_change":"2023-12-07T21:08:56.874409+0000","last_active":"2023-12-07T21:11:10.608172+0000","last_peered":"2023-12-07T21:11:10.608172+0000","last_clean":"2023-12-07T21:11:10.608172+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:11:10.608172+0000","last_undegraded":"2023-12-07T21:11:10.608172+0000","last_fullsized":"2023-12-07T21:11:10.608172+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:46.400657+0000","last_change":"2023-12-07T21:12:46.400680+0000","last_active":"2023-12-07T21:12:46.400657+0000","last_peered":"2023-12-07T21:12:46.400657+0000","last_clean":"2023-12-07T21:12:46.400657+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:12:46.400657+0000","last_undegraded":"2023-12-07T21:12:46.400657+0000","last_fullsized":"2023-12-07T21:12:46.400657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_clean_scrub_stamp":"2023-12-07T21:12:46.400562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:25.935064+0000","scrub_duration":0.001127915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:34.273452+0000","last_change":"2023-12-07T21:12:34.273474+0000","last_active":"2023-12-07T21:12:34.273452+0000","last_peered":"2023-12-07T21:12:34.273452+0000","last_clean":"2023-12-07T21:12:34.273452+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:12:34.273452+0000","last_undegraded":"2023-12-07T21:12:34.273452+0000","last_fullsized":"2023-12-07T21:12:34.273452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_clean_scrub_stamp":"2023-12-07T21:12:34.273360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:01:32.940162+0000","scrub_duration":0.0011278239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.451409+0000","last_change":"2023-12-07T21:12:52.451445+0000","last_active":"2023-12-07T21:12:52.451409+0000","last_peered":"2023-12-07T21:12:52.451409+0000","last_clean":"2023-12-07T21:12:52.451409+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:12:52.451409+0000","last_undegraded":"2023-12-07T21:12:52.451409+0000","last_fullsized":"2023-12-07T21:12:52.451409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.451316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:57.500148+0000","scrub_duration":0.001350272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.263046+0000","last_change":"2023-12-07T21:13:14.263073+0000","last_active":"2023-12-07T21:13:14.263046+0000","last_peered":"2023-12-07T21:13:14.263046+0000","last_clean":"2023-12-07T21:13:14.263046+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:13:14.263046+0000","last_undegraded":"2023-12-07T21:13:14.263046+0000","last_fullsized":"2023-12-07T21:13:14.263046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.262960+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:28.327063+0000","scrub_duration":0.0023679700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:16.262702+0000","last_change":"2023-12-07T21:13:16.262731+0000","last_active":"2023-12-07T21:13:16.262702+0000","last_peered":"2023-12-07T21:13:16.262702+0000","last_clean":"2023-12-07T21:13:16.262702+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:13:16.262702+0000","last_undegraded":"2023-12-07T21:13:16.262702+0000","last_fullsized":"2023-12-07T21:13:16.262702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_clean_scrub_stamp":"2023-12-07T21:13:16.262599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:56:19.678023+0000","scrub_duration":0.001231251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:40.827223+0000","last_change":"2023-12-07T21:12:40.827245+0000","last_active":"2023-12-07T21:12:40.827223+0000","last_peered":"2023-12-07T21:12:40.827223+0000","last_clean":"2023-12-07T21:12:40.827223+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:12:40.827223+0000","last_undegraded":"2023-12-07T21:12:40.827223+0000","last_fullsized":"2023-12-07T21:12:40.827223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_clean_scrub_stamp":"2023-12-07T21:12:40.827135+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:20.361638+0000","scrub_duration":0.0013685839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766605+0000","last_change":"2023-12-07T21:08:54.878784+0000","last_active":"2023-12-07T21:11:09.766605+0000","last_peered":"2023-12-07T21:11:09.766605+0000","last_clean":"2023-12-07T21:11:09.766605+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:11:09.766605+0000","last_undegraded":"2023-12-07T21:11:09.766605+0000","last_fullsized":"2023-12-07T21:11:09.766605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:53.488111+0000","last_change":"2023-12-07T21:12:53.488138+0000","last_active":"2023-12-07T21:12:53.488111+0000","last_peered":"2023-12-07T21:12:53.488111+0000","last_clean":"2023-12-07T21:12:53.488111+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:12:53.488111+0000","last_undegraded":"2023-12-07T21:12:53.488111+0000","last_fullsized":"2023-12-07T21:12:53.488111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_clean_scrub_stamp":"2023-12-07T21:12:53.488022+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:20:06.706860+0000","scrub_duration":0.0010715880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.914082+0000","last_change":"2023-12-07T21:12:58.914123+0000","last_active":"2023-12-07T21:12:58.914082+0000","last_peered":"2023-12-07T21:12:58.914082+0000","last_clean":"2023-12-07T21:12:58.914082+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:12:58.914082+0000","last_undegraded":"2023-12-07T21:12:58.914082+0000","last_fullsized":"2023-12-07T21:12:58.914082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.913992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:18.497979+0000","scrub_duration":0.0013136269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.336912+0000","last_change":"2023-12-07T21:12:23.336936+0000","last_active":"2023-12-07T21:12:23.336912+0000","last_peered":"2023-12-07T21:12:23.336912+0000","last_clean":"2023-12-07T21:12:23.336912+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:12:23.336912+0000","last_undegraded":"2023-12-07T21:12:23.336912+0000","last_fullsized":"2023-12-07T21:12:23.336912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.336820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:54.775680+0000","scrub_duration":0.0015463409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607871+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:11:10.607871+0000","last_peered":"2023-12-07T21:11:10.607871+0000","last_clean":"2023-12-07T21:11:10.607871+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:11:10.607871+0000","last_undegraded":"2023-12-07T21:11:10.607871+0000","last_fullsized":"2023-12-07T21:11:10.607871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'19","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767525+0000","last_change":"2023-12-07T21:09:04.931981+0000","last_active":"2023-12-07T21:11:09.767525+0000","last_peered":"2023-12-07T21:11:09.767525+0000","last_clean":"2023-12-07T21:11:09.767525+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:11:09.767525+0000","last_undegraded":"2023-12-07T21:11:09.767525+0000","last_fullsized":"2023-12-07T21:11:09.767525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.461393+0000","last_change":"2023-12-07T21:12:20.461414+0000","last_active":"2023-12-07T21:12:20.461393+0000","last_peered":"2023-12-07T21:12:20.461393+0000","last_clean":"2023-12-07T21:12:20.461393+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:12:20.461393+0000","last_undegraded":"2023-12-07T21:12:20.461393+0000","last_fullsized":"2023-12-07T21:12:20.461393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.461275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:11:30.745289+0000","scrub_duration":0.0012528039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607680+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:11:10.607680+0000","last_peered":"2023-12-07T21:11:10.607680+0000","last_clean":"2023-12-07T21:11:10.607680+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:11:10.607680+0000","last_undegraded":"2023-12-07T21:11:10.607680+0000","last_fullsized":"2023-12-07T21:11:10.607680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":114,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.797174+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:12.797174+0000","last_peered":"2023-12-07T21:11:12.797174+0000","last_clean":"2023-12-07T21:11:12.797174+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:12.797174+0000","last_undegraded":"2023-12-07T21:11:12.797174+0000","last_fullsized":"2023-12-07T21:11:12.797174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:03.666647+0000","last_change":"2023-12-07T21:13:03.666683+0000","last_active":"2023-12-07T21:13:03.666647+0000","last_peered":"2023-12-07T21:13:03.666647+0000","last_clean":"2023-12-07T21:13:03.666647+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:13:03.666647+0000","last_undegraded":"2023-12-07T21:13:03.666647+0000","last_fullsized":"2023-12-07T21:13:03.666647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_clean_scrub_stamp":"2023-12-07T21:13:03.666541+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:29:58.918173+0000","scrub_duration":0.0039456209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.345063+0000","last_change":"2023-12-07T21:12:18.345086+0000","last_active":"2023-12-07T21:12:18.345063+0000","last_peered":"2023-12-07T21:12:18.345063+0000","last_clean":"2023-12-07T21:12:18.345063+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:12:18.345063+0000","last_undegraded":"2023-12-07T21:12:18.345063+0000","last_fullsized":"2023-12-07T21:12:18.345063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.344968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:53:47.984483+0000","scrub_duration":0.00095218699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:26.318801+0000","last_change":"2023-12-07T21:12:26.318843+0000","last_active":"2023-12-07T21:12:26.318801+0000","last_peered":"2023-12-07T21:12:26.318801+0000","last_clean":"2023-12-07T21:12:26.318801+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:12:26.318801+0000","last_undegraded":"2023-12-07T21:12:26.318801+0000","last_fullsized":"2023-12-07T21:12:26.318801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:26.318685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:21.073203+0000","scrub_duration":0.0010887360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.617992+0000","last_change":"2023-12-07T21:13:07.618014+0000","last_active":"2023-12-07T21:13:07.617992+0000","last_peered":"2023-12-07T21:13:07.617992+0000","last_clean":"2023-12-07T21:13:07.617992+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:13:07.617992+0000","last_undegraded":"2023-12-07T21:13:07.617992+0000","last_fullsized":"2023-12-07T21:13:07.617992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.617909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:13.457658+0000","scrub_duration":0.001206459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187522+0000","last_change":"2023-12-07T21:08:54.880632+0000","last_active":"2023-12-07T21:11:10.187522+0000","last_peered":"2023-12-07T21:11:10.187522+0000","last_clean":"2023-12-07T21:11:10.187522+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:11:10.187522+0000","last_undegraded":"2023-12-07T21:11:10.187522+0000","last_fullsized":"2023-12-07T21:11:10.187522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.830062+0000","last_change":"2023-12-07T21:11:53.830085+0000","last_active":"2023-12-07T21:11:53.830062+0000","last_peered":"2023-12-07T21:11:53.830062+0000","last_clean":"2023-12-07T21:11:53.830062+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:53.830062+0000","last_undegraded":"2023-12-07T21:11:53.830062+0000","last_fullsized":"2023-12-07T21:11:53.830062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_clean_scrub_stamp":"2023-12-07T21:11:53.829969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:45.205269+0000","scrub_duration":0.001216066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.053083+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:11.053083+0000","last_peered":"2023-12-07T21:11:11.053083+0000","last_clean":"2023-12-07T21:11:11.053083+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:11.053083+0000","last_undegraded":"2023-12-07T21:11:11.053083+0000","last_fullsized":"2023-12-07T21:11:11.053083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.304118+0000","last_change":"2023-12-07T21:11:42.304137+0000","last_active":"2023-12-07T21:11:42.304118+0000","last_peered":"2023-12-07T21:11:42.304118+0000","last_clean":"2023-12-07T21:11:42.304118+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:42.304118+0000","last_undegraded":"2023-12-07T21:11:42.304118+0000","last_fullsized":"2023-12-07T21:11:42.304118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.304031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:14.639583+0000","scrub_duration":0.0010594929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:31.746746+0000","last_change":"2023-12-07T21:12:31.746769+0000","last_active":"2023-12-07T21:12:31.746746+0000","last_peered":"2023-12-07T21:12:31.746746+0000","last_clean":"2023-12-07T21:12:31.746746+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:12:31.746746+0000","last_undegraded":"2023-12-07T21:12:31.746746+0000","last_fullsized":"2023-12-07T21:12:31.746746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_clean_scrub_stamp":"2023-12-07T21:12:31.746658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:02.942094+0000","scrub_duration":0.00135096,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.511141+0000","last_change":"2023-12-07T21:13:14.511164+0000","last_active":"2023-12-07T21:13:14.511141+0000","last_peered":"2023-12-07T21:13:14.511141+0000","last_clean":"2023-12-07T21:13:14.511141+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:13:14.511141+0000","last_undegraded":"2023-12-07T21:13:14.511141+0000","last_fullsized":"2023-12-07T21:13:14.511141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.511066+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:07.222427+0000","scrub_duration":0.0030400240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607656+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:11:10.607656+0000","last_peered":"2023-12-07T21:11:10.607656+0000","last_clean":"2023-12-07T21:11:10.607656+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:11:10.607656+0000","last_undegraded":"2023-12-07T21:11:10.607656+0000","last_fullsized":"2023-12-07T21:11:10.607656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.707066+0000","last_change":"2023-12-07T21:11:58.707102+0000","last_active":"2023-12-07T21:11:58.707066+0000","last_peered":"2023-12-07T21:11:58.707066+0000","last_clean":"2023-12-07T21:11:58.707066+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:58.707066+0000","last_undegraded":"2023-12-07T21:11:58.707066+0000","last_fullsized":"2023-12-07T21:11:58.707066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.706965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:56:05.594599+0000","scrub_duration":0.0011023249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.554028+0000","last_change":"2023-12-07T21:11:35.554062+0000","last_active":"2023-12-07T21:11:35.554028+0000","last_peered":"2023-12-07T21:11:35.554028+0000","last_clean":"2023-12-07T21:11:35.554028+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:35.554028+0000","last_undegraded":"2023-12-07T21:11:35.554028+0000","last_fullsized":"2023-12-07T21:11:35.554028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.553946+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:56.699897+0000","scrub_duration":0.0042775269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'247","reported_seq":323,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:50.595128+0000","last_change":"2023-12-07T21:12:50.595156+0000","last_active":"2023-12-07T21:12:50.595128+0000","last_peered":"2023-12-07T21:12:50.595128+0000","last_clean":"2023-12-07T21:12:50.595128+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:12:50.595128+0000","last_undegraded":"2023-12-07T21:12:50.595128+0000","last_fullsized":"2023-12-07T21:12:50.595128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_clean_scrub_stamp":"2023-12-07T21:12:50.595047+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:57:35.203698+0000","scrub_duration":0.0029719099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188448+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:11:10.188448+0000","last_peered":"2023-12-07T21:11:10.188448+0000","last_clean":"2023-12-07T21:11:10.188448+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:11:10.188448+0000","last_undegraded":"2023-12-07T21:11:10.188448+0000","last_fullsized":"2023-12-07T21:11:10.188448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.764627+0000","last_change":"2023-12-07T21:12:27.764650+0000","last_active":"2023-12-07T21:12:27.764627+0000","last_peered":"2023-12-07T21:12:27.764627+0000","last_clean":"2023-12-07T21:12:27.764627+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:12:27.764627+0000","last_undegraded":"2023-12-07T21:12:27.764627+0000","last_fullsized":"2023-12-07T21:12:27.764627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.764507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:17:01.731572+0000","scrub_duration":0.0015146649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.348585+0000","last_change":"2023-12-07T21:13:00.348644+0000","last_active":"2023-12-07T21:13:00.348585+0000","last_peered":"2023-12-07T21:13:00.348585+0000","last_clean":"2023-12-07T21:13:00.348585+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:13:00.348585+0000","last_undegraded":"2023-12-07T21:13:00.348585+0000","last_fullsized":"2023-12-07T21:13:00.348585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.348476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:10.632490+0000","scrub_duration":0.001405367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.775119+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:14.775119+0000","last_peered":"2023-12-07T21:11:14.775119+0000","last_clean":"2023-12-07T21:11:14.775119+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:14.775119+0000","last_undegraded":"2023-12-07T21:11:14.775119+0000","last_fullsized":"2023-12-07T21:11:14.775119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:29.600052+0000","last_change":"2023-12-07T21:11:29.600086+0000","last_active":"2023-12-07T21:11:29.600052+0000","last_peered":"2023-12-07T21:11:29.600052+0000","last_clean":"2023-12-07T21:11:29.600052+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:29.600052+0000","last_undegraded":"2023-12-07T21:11:29.600052+0000","last_fullsized":"2023-12-07T21:11:29.600052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_clean_scrub_stamp":"2023-12-07T21:11:29.599963+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:30:03.772118+0000","scrub_duration":0.003554771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'247","reported_seq":340,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:02.790438+0000","last_change":"2023-12-07T21:12:02.790465+0000","last_active":"2023-12-07T21:12:02.790438+0000","last_peered":"2023-12-07T21:12:02.790438+0000","last_clean":"2023-12-07T21:12:02.790438+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:12:02.790438+0000","last_undegraded":"2023-12-07T21:12:02.790438+0000","last_fullsized":"2023-12-07T21:12:02.790438+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_clean_scrub_stamp":"2023-12-07T21:12:02.790346+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:07.839178+0000","scrub_duration":0.0026089529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608027+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:11:10.608027+0000","last_peered":"2023-12-07T21:11:10.608027+0000","last_clean":"2023-12-07T21:11:10.608027+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:11:10.608027+0000","last_undegraded":"2023-12-07T21:11:10.608027+0000","last_fullsized":"2023-12-07T21:11:10.608027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.810404+0000","last_change":"2023-12-07T21:08:54.880253+0000","last_active":"2023-12-07T21:11:13.810404+0000","last_peered":"2023-12-07T21:11:13.810404+0000","last_clean":"2023-12-07T21:11:13.810404+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:11:13.810404+0000","last_undegraded":"2023-12-07T21:11:13.810404+0000","last_fullsized":"2023-12-07T21:11:13.810404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.443153+0000","last_change":"2023-12-07T21:11:56.443153+0000","last_active":"2023-12-07T21:11:56.443153+0000","last_peered":"2023-12-07T21:11:56.443153+0000","last_clean":"2023-12-07T21:11:56.443153+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:56.443153+0000","last_undegraded":"2023-12-07T21:11:56.443153+0000","last_fullsized":"2023-12-07T21:11:56.443153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.443045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:05.069384+0000","scrub_duration":0.0010685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.606842+0000","last_change":"2023-12-07T21:11:39.606842+0000","last_active":"2023-12-07T21:11:39.606842+0000","last_peered":"2023-12-07T21:11:39.606842+0000","last_clean":"2023-12-07T21:11:39.606842+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:39.606842+0000","last_undegraded":"2023-12-07T21:11:39.606842+0000","last_fullsized":"2023-12-07T21:11:39.606842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.606684+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:36.950556+0000","scrub_duration":0.0069737849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:34.781691+0000","last_change":"2023-12-07T21:11:34.781711+0000","last_active":"2023-12-07T21:11:34.781691+0000","last_peered":"2023-12-07T21:11:34.781691+0000","last_clean":"2023-12-07T21:11:34.781691+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:34.781691+0000","last_undegraded":"2023-12-07T21:11:34.781691+0000","last_fullsized":"2023-12-07T21:11:34.781691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:34.781604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:44.478780+0000","scrub_duration":0.001255822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.810015+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:11:13.810015+0000","last_peered":"2023-12-07T21:11:13.810015+0000","last_clean":"2023-12-07T21:11:13.810015+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:11:13.810015+0000","last_undegraded":"2023-12-07T21:11:13.810015+0000","last_fullsized":"2023-12-07T21:11:13.810015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'22","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.326862+0000","last_change":"2023-12-07T21:12:36.326862+0000","last_active":"2023-12-07T21:12:36.326862+0000","last_peered":"2023-12-07T21:12:36.326862+0000","last_clean":"2023-12-07T21:12:36.326862+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:12:36.326862+0000","last_undegraded":"2023-12-07T21:12:36.326862+0000","last_fullsized":"2023-12-07T21:12:36.326862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.326694+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:24:30.282151+0000","scrub_duration":0.0028268410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.338776+0000","last_change":"2023-12-07T21:13:06.338776+0000","last_active":"2023-12-07T21:13:06.338776+0000","last_peered":"2023-12-07T21:13:06.338776+0000","last_clean":"2023-12-07T21:13:06.338776+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:13:06.338776+0000","last_undegraded":"2023-12-07T21:13:06.338776+0000","last_fullsized":"2023-12-07T21:13:06.338776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.338641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:59:17.495976+0000","scrub_duration":0.001242176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:07.717459+0000","last_change":"2023-12-07T21:12:07.717459+0000","last_active":"2023-12-07T21:12:07.717459+0000","last_peered":"2023-12-07T21:12:07.717459+0000","last_clean":"2023-12-07T21:12:07.717459+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:12:07.717459+0000","last_undegraded":"2023-12-07T21:12:07.717459+0000","last_fullsized":"2023-12-07T21:12:07.717459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_clean_scrub_stamp":"2023-12-07T21:12:07.717342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:32.009926+0000","scrub_duration":0.0014039289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:09.439719+0000","last_change":"2023-12-07T21:12:09.439747+0000","last_active":"2023-12-07T21:12:09.439719+0000","last_peered":"2023-12-07T21:12:09.439719+0000","last_clean":"2023-12-07T21:12:09.439719+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:12:09.439719+0000","last_undegraded":"2023-12-07T21:12:09.439719+0000","last_fullsized":"2023-12-07T21:12:09.439719+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_clean_scrub_stamp":"2023-12-07T21:12:09.439641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:19.195035+0000","scrub_duration":0.0043223589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.735466+0000","last_change":"2023-12-07T21:11:33.735466+0000","last_active":"2023-12-07T21:11:33.735466+0000","last_peered":"2023-12-07T21:11:33.735466+0000","last_clean":"2023-12-07T21:11:33.735466+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:33.735466+0000","last_undegraded":"2023-12-07T21:11:33.735466+0000","last_fullsized":"2023-12-07T21:11:33.735466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.735352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:03.972116+0000","scrub_duration":0.0011441929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.810257+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:11:13.810257+0000","last_peered":"2023-12-07T21:11:13.810257+0000","last_clean":"2023-12-07T21:11:13.810257+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:11:13.810257+0000","last_undegraded":"2023-12-07T21:11:13.810257+0000","last_fullsized":"2023-12-07T21:11:13.810257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.429281+0000","last_change":"2023-12-07T21:12:36.429281+0000","last_active":"2023-12-07T21:12:36.429281+0000","last_peered":"2023-12-07T21:12:36.429281+0000","last_clean":"2023-12-07T21:12:36.429281+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:12:36.429281+0000","last_undegraded":"2023-12-07T21:12:36.429281+0000","last_fullsized":"2023-12-07T21:12:36.429281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.429148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:19.936617+0000","scrub_duration":0.001111988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.811064+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:11:13.811064+0000","last_peered":"2023-12-07T21:11:13.811064+0000","last_clean":"2023-12-07T21:11:13.811064+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:11:13.811064+0000","last_undegraded":"2023-12-07T21:11:13.811064+0000","last_fullsized":"2023-12-07T21:11:13.811064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.810375+0000","last_change":"2023-12-07T21:12:15.810375+0000","last_active":"2023-12-07T21:12:15.810375+0000","last_peered":"2023-12-07T21:12:15.810375+0000","last_clean":"2023-12-07T21:12:15.810375+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:12:15.810375+0000","last_undegraded":"2023-12-07T21:12:15.810375+0000","last_fullsized":"2023-12-07T21:12:15.810375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.810269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:33.566530+0000","scrub_duration":0.0014408579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.522112+0000","last_change":"2023-12-07T21:11:50.522112+0000","last_active":"2023-12-07T21:11:50.522112+0000","last_peered":"2023-12-07T21:11:50.522112+0000","last_clean":"2023-12-07T21:11:50.522112+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:50.522112+0000","last_undegraded":"2023-12-07T21:11:50.522112+0000","last_fullsized":"2023-12-07T21:11:50.522112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.521955+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:04.827943+0000","scrub_duration":0.0073561030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":308,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.761887+0000","last_change":"2023-12-07T21:11:35.761887+0000","last_active":"2023-12-07T21:11:35.761887+0000","last_peered":"2023-12-07T21:11:35.761887+0000","last_clean":"2023-12-07T21:11:35.761887+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:35.761887+0000","last_undegraded":"2023-12-07T21:11:35.761887+0000","last_fullsized":"2023-12-07T21:11:35.761887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.761766+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:14.383149+0000","scrub_duration":0.0016151640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.804846+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:11:18.804846+0000","last_peered":"2023-12-07T21:11:18.804846+0000","last_clean":"2023-12-07T21:11:18.804846+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:11:18.804846+0000","last_undegraded":"2023-12-07T21:11:18.804846+0000","last_fullsized":"2023-12-07T21:11:18.804846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:55.462356+0000","last_change":"2023-12-07T21:12:55.462356+0000","last_active":"2023-12-07T21:12:55.462356+0000","last_peered":"2023-12-07T21:12:55.462356+0000","last_clean":"2023-12-07T21:12:55.462356+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:12:55.462356+0000","last_undegraded":"2023-12-07T21:12:55.462356+0000","last_fullsized":"2023-12-07T21:12:55.462356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_clean_scrub_stamp":"2023-12-07T21:12:55.462251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:57:45.150167+0000","scrub_duration":0.0012320580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.810880+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:11:13.810880+0000","last_peered":"2023-12-07T21:11:13.810880+0000","last_clean":"2023-12-07T21:11:13.810880+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:11:13.810880+0000","last_undegraded":"2023-12-07T21:11:13.810880+0000","last_fullsized":"2023-12-07T21:11:13.810880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.753724+0000","last_change":"2023-12-07T21:11:55.753724+0000","last_active":"2023-12-07T21:11:55.753724+0000","last_peered":"2023-12-07T21:11:55.753724+0000","last_clean":"2023-12-07T21:11:55.753724+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:55.753724+0000","last_undegraded":"2023-12-07T21:11:55.753724+0000","last_fullsized":"2023-12-07T21:11:55.753724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.753576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:53:37.572475+0000","scrub_duration":0.0013913199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:31.726564+0000","last_change":"2023-12-07T21:11:31.726564+0000","last_active":"2023-12-07T21:11:31.726564+0000","last_peered":"2023-12-07T21:11:31.726564+0000","last_clean":"2023-12-07T21:11:31.726564+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:31.726564+0000","last_undegraded":"2023-12-07T21:11:31.726564+0000","last_fullsized":"2023-12-07T21:11:31.726564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:31.726451+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:36.775283+0000","scrub_duration":0.0038601009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.752564+0000","last_change":"2023-12-07T21:11:56.752564+0000","last_active":"2023-12-07T21:11:56.752564+0000","last_peered":"2023-12-07T21:11:56.752564+0000","last_clean":"2023-12-07T21:11:56.752564+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:56.752564+0000","last_undegraded":"2023-12-07T21:11:56.752564+0000","last_fullsized":"2023-12-07T21:11:56.752564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.752450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:44.261937+0000","scrub_duration":0.0012919610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.804944+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:11:18.804944+0000","last_peered":"2023-12-07T21:11:18.804944+0000","last_clean":"2023-12-07T21:11:18.804944+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:11:18.804944+0000","last_undegraded":"2023-12-07T21:11:18.804944+0000","last_fullsized":"2023-12-07T21:11:18.804944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187760+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:11:10.187760+0000","last_peered":"2023-12-07T21:11:10.187760+0000","last_clean":"2023-12-07T21:11:10.187760+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:11:10.187760+0000","last_undegraded":"2023-12-07T21:11:10.187760+0000","last_fullsized":"2023-12-07T21:11:10.187760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.803596+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:11:13.803596+0000","last_peered":"2023-12-07T21:11:13.803596+0000","last_clean":"2023-12-07T21:11:13.803596+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:11:13.803596+0000","last_undegraded":"2023-12-07T21:11:13.803596+0000","last_fullsized":"2023-12-07T21:11:13.803596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.578121+0000","last_change":"2023-12-07T21:12:12.578121+0000","last_active":"2023-12-07T21:12:12.578121+0000","last_peered":"2023-12-07T21:12:12.578121+0000","last_clean":"2023-12-07T21:12:12.578121+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:12:12.578121+0000","last_undegraded":"2023-12-07T21:12:12.578121+0000","last_fullsized":"2023-12-07T21:12:12.578121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.578001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:21:04.951547+0000","scrub_duration":0.0009980639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.222534+0000","last_change":"2023-12-07T21:11:32.222572+0000","last_active":"2023-12-07T21:11:32.222534+0000","last_peered":"2023-12-07T21:11:32.222534+0000","last_clean":"2023-12-07T21:11:32.222534+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:32.222534+0000","last_undegraded":"2023-12-07T21:11:32.222534+0000","last_fullsized":"2023-12-07T21:11:32.222534+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.222451+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:29.566323+0000","scrub_duration":0.0042948600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:25.579978+0000","last_change":"2023-12-07T21:13:25.579998+0000","last_active":"2023-12-07T21:13:25.579978+0000","last_peered":"2023-12-07T21:13:25.579978+0000","last_clean":"2023-12-07T21:13:25.579978+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:13:25.579978+0000","last_undegraded":"2023-12-07T21:13:25.579978+0000","last_fullsized":"2023-12-07T21:13:25.579978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_clean_scrub_stamp":"2023-12-07T21:13:25.579880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:22:49.341694+0000","scrub_duration":0.001424259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608819+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:11:10.608819+0000","last_peered":"2023-12-07T21:11:10.608819+0000","last_clean":"2023-12-07T21:11:10.608819+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:11:10.608819+0000","last_undegraded":"2023-12-07T21:11:10.608819+0000","last_fullsized":"2023-12-07T21:11:10.608819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187764+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:11:10.187764+0000","last_peered":"2023-12-07T21:11:10.187764+0000","last_clean":"2023-12-07T21:11:10.187764+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:11:10.187764+0000","last_undegraded":"2023-12-07T21:11:10.187764+0000","last_fullsized":"2023-12-07T21:11:10.187764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607638+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:11:10.607638+0000","last_peered":"2023-12-07T21:11:10.607638+0000","last_clean":"2023-12-07T21:11:10.607638+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:11:10.607638+0000","last_undegraded":"2023-12-07T21:11:10.607638+0000","last_fullsized":"2023-12-07T21:11:10.607638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:54.784564+0000","last_change":"2023-12-07T21:11:54.784564+0000","last_active":"2023-12-07T21:11:54.784564+0000","last_peered":"2023-12-07T21:11:54.784564+0000","last_clean":"2023-12-07T21:11:54.784564+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:54.784564+0000","last_undegraded":"2023-12-07T21:11:54.784564+0000","last_fullsized":"2023-12-07T21:11:54.784564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_clean_scrub_stamp":"2023-12-07T21:11:54.784441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:06.366596+0000","scrub_duration":0.001044002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.576728+0000","last_change":"2023-12-07T21:11:38.576788+0000","last_active":"2023-12-07T21:11:38.576728+0000","last_peered":"2023-12-07T21:11:38.576728+0000","last_clean":"2023-12-07T21:11:38.576728+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:38.576728+0000","last_undegraded":"2023-12-07T21:11:38.576728+0000","last_fullsized":"2023-12-07T21:11:38.576728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.576637+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:37:48.632379+0000","scrub_duration":0.0068514220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":336,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625017+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625017+0000","last_peered":"2023-12-07T21:11:28.625017+0000","last_clean":"2023-12-07T21:11:28.625017+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625017+0000","last_undegraded":"2023-12-07T21:11:28.625017+0000","last_fullsized":"2023-12-07T21:11:28.625017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.858711+0000","last_change":"2023-12-07T21:12:16.858711+0000","last_active":"2023-12-07T21:12:16.858711+0000","last_peered":"2023-12-07T21:12:16.858711+0000","last_clean":"2023-12-07T21:12:16.858711+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:12:16.858711+0000","last_undegraded":"2023-12-07T21:12:16.858711+0000","last_fullsized":"2023-12-07T21:12:16.858711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.858602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:29:51.847246+0000","scrub_duration":0.0011473449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.447750+0000","last_change":"2023-12-07T21:13:23.447750+0000","last_active":"2023-12-07T21:13:23.447750+0000","last_peered":"2023-12-07T21:13:23.447750+0000","last_clean":"2023-12-07T21:13:23.447750+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:13:23.447750+0000","last_undegraded":"2023-12-07T21:13:23.447750+0000","last_fullsized":"2023-12-07T21:13:23.447750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.447646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:28:02.982148+0000","scrub_duration":0.0010737139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607531+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:11:10.607531+0000","last_peered":"2023-12-07T21:11:10.607531+0000","last_clean":"2023-12-07T21:11:10.607531+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:11:10.607531+0000","last_undegraded":"2023-12-07T21:11:10.607531+0000","last_fullsized":"2023-12-07T21:11:10.607531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.296697+0000","last_change":"2023-12-07T21:11:38.296697+0000","last_active":"2023-12-07T21:11:38.296697+0000","last_peered":"2023-12-07T21:11:38.296697+0000","last_clean":"2023-12-07T21:11:38.296697+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:38.296697+0000","last_undegraded":"2023-12-07T21:11:38.296697+0000","last_fullsized":"2023-12-07T21:11:38.296697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.296568+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:08.533333+0000","scrub_duration":0.0033144630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.654287+0000","last_change":"2023-12-07T21:13:04.654323+0000","last_active":"2023-12-07T21:13:04.654287+0000","last_peered":"2023-12-07T21:13:04.654287+0000","last_clean":"2023-12-07T21:13:04.654287+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:13:04.654287+0000","last_undegraded":"2023-12-07T21:13:04.654287+0000","last_fullsized":"2023-12-07T21:13:04.654287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.654200+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:02:30.647135+0000","scrub_duration":0.0041448730000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'247","reported_seq":372,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:47.359710+0000","last_change":"2023-12-07T21:11:47.359735+0000","last_active":"2023-12-07T21:11:47.359710+0000","last_peered":"2023-12-07T21:11:47.359710+0000","last_clean":"2023-12-07T21:11:47.359710+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:47.359710+0000","last_undegraded":"2023-12-07T21:11:47.359710+0000","last_fullsized":"2023-12-07T21:11:47.359710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_clean_scrub_stamp":"2023-12-07T21:11:47.359610+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:10.050726+0000","scrub_duration":0.0028663759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.579785+0000","last_change":"2023-12-07T21:12:14.579785+0000","last_active":"2023-12-07T21:12:14.579785+0000","last_peered":"2023-12-07T21:12:14.579785+0000","last_clean":"2023-12-07T21:12:14.579785+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:12:14.579785+0000","last_undegraded":"2023-12-07T21:12:14.579785+0000","last_fullsized":"2023-12-07T21:12:14.579785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.579627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:44.957962+0000","scrub_duration":0.0013656510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.375184+0000","last_change":"2023-12-07T21:12:17.375184+0000","last_active":"2023-12-07T21:12:17.375184+0000","last_peered":"2023-12-07T21:12:17.375184+0000","last_clean":"2023-12-07T21:12:17.375184+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:12:17.375184+0000","last_undegraded":"2023-12-07T21:12:17.375184+0000","last_fullsized":"2023-12-07T21:12:17.375184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.375067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:21:31.008297+0000","scrub_duration":0.001068486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607511+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:11:10.607511+0000","last_peered":"2023-12-07T21:11:10.607511+0000","last_clean":"2023-12-07T21:11:10.607511+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:11:10.607511+0000","last_undegraded":"2023-12-07T21:11:10.607511+0000","last_fullsized":"2023-12-07T21:11:10.607511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.847914+0000","last_change":"2023-12-07T21:11:28.847914+0000","last_active":"2023-12-07T21:11:28.847914+0000","last_peered":"2023-12-07T21:11:28.847914+0000","last_clean":"2023-12-07T21:11:28.847914+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:28.847914+0000","last_undegraded":"2023-12-07T21:11:28.847914+0000","last_fullsized":"2023-12-07T21:11:28.847914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.847797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:20:42.481026+0000","scrub_duration":0.001132973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262716+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262716+0000","last_peered":"2023-12-07T21:11:27.262716+0000","last_clean":"2023-12-07T21:11:27.262716+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262716+0000","last_undegraded":"2023-12-07T21:11:27.262716+0000","last_fullsized":"2023-12-07T21:11:27.262716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:14.426987+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:14.426987+0000","last_peered":"2023-12-07T21:11:14.426987+0000","last_clean":"2023-12-07T21:11:14.426987+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:14.426987+0000","last_undegraded":"2023-12-07T21:11:14.426987+0000","last_fullsized":"2023-12-07T21:11:14.426987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.810079+0000","last_change":"2023-12-07T21:09:04.920277+0000","last_active":"2023-12-07T21:11:13.810079+0000","last_peered":"2023-12-07T21:11:13.810079+0000","last_clean":"2023-12-07T21:11:13.810079+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:11:13.810079+0000","last_undegraded":"2023-12-07T21:11:13.810079+0000","last_fullsized":"2023-12-07T21:11:13.810079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:08.448223+0000","last_change":"2023-12-07T21:12:08.448223+0000","last_active":"2023-12-07T21:12:08.448223+0000","last_peered":"2023-12-07T21:12:08.448223+0000","last_clean":"2023-12-07T21:12:08.448223+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:12:08.448223+0000","last_undegraded":"2023-12-07T21:12:08.448223+0000","last_fullsized":"2023-12-07T21:12:08.448223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_clean_scrub_stamp":"2023-12-07T21:12:08.448115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:53:48.563995+0000","scrub_duration":0.001037821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:18.321344+0000","last_change":"2023-12-07T21:13:18.321375+0000","last_active":"2023-12-07T21:13:18.321344+0000","last_peered":"2023-12-07T21:13:18.321344+0000","last_clean":"2023-12-07T21:13:18.321344+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:13:18.321344+0000","last_undegraded":"2023-12-07T21:13:18.321344+0000","last_fullsized":"2023-12-07T21:13:18.321344+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_clean_scrub_stamp":"2023-12-07T21:13:18.321258+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:57.708960+0000","scrub_duration":0.0041701730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607432+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:11:10.607432+0000","last_peered":"2023-12-07T21:11:10.607432+0000","last_clean":"2023-12-07T21:11:10.607432+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:11:10.607432+0000","last_undegraded":"2023-12-07T21:11:10.607432+0000","last_fullsized":"2023-12-07T21:11:10.607432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607484+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:11:10.607484+0000","last_peered":"2023-12-07T21:11:10.607484+0000","last_clean":"2023-12-07T21:11:10.607484+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:11:10.607484+0000","last_undegraded":"2023-12-07T21:11:10.607484+0000","last_fullsized":"2023-12-07T21:11:10.607484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.324752+0000","last_change":"2023-12-07T21:11:45.324752+0000","last_active":"2023-12-07T21:11:45.324752+0000","last_peered":"2023-12-07T21:11:45.324752+0000","last_clean":"2023-12-07T21:11:45.324752+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:11:45.324752+0000","last_undegraded":"2023-12-07T21:11:45.324752+0000","last_fullsized":"2023-12-07T21:11:45.324752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.324596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:15.702930+0000","scrub_duration":0.001375037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'84","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.623237+0000","last_change":"2023-12-07T21:12:52.623237+0000","last_active":"2023-12-07T21:12:52.623237+0000","last_peered":"2023-12-07T21:12:52.623237+0000","last_clean":"2023-12-07T21:12:52.623237+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:12:52.623237+0000","last_undegraded":"2023-12-07T21:12:52.623237+0000","last_fullsized":"2023-12-07T21:12:52.623237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'84","last_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_deep_scrub":"33'84","last_deep_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.623072+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:11.772666+0000","scrub_duration":0.0042302950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.743712+0000","last_change":"2023-12-07T21:11:42.743712+0000","last_active":"2023-12-07T21:11:42.743712+0000","last_peered":"2023-12-07T21:11:42.743712+0000","last_clean":"2023-12-07T21:11:42.743712+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:42.743712+0000","last_undegraded":"2023-12-07T21:11:42.743712+0000","last_fullsized":"2023-12-07T21:11:42.743712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.743604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:58.016229+0000","scrub_duration":0.001386167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.433682+0000","last_change":"2023-12-07T21:11:58.433682+0000","last_active":"2023-12-07T21:11:58.433682+0000","last_peered":"2023-12-07T21:11:58.433682+0000","last_clean":"2023-12-07T21:11:58.433682+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:58.433682+0000","last_undegraded":"2023-12-07T21:11:58.433682+0000","last_fullsized":"2023-12-07T21:11:58.433682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.433567+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:08.130743+0000","scrub_duration":0.0014101739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608031+0000","last_change":"2023-12-07T21:08:56.872420+0000","last_active":"2023-12-07T21:11:10.608031+0000","last_peered":"2023-12-07T21:11:10.608031+0000","last_clean":"2023-12-07T21:11:10.608031+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:11:10.608031+0000","last_undegraded":"2023-12-07T21:11:10.608031+0000","last_fullsized":"2023-12-07T21:11:10.608031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607424+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:11:10.607424+0000","last_peered":"2023-12-07T21:11:10.607424+0000","last_clean":"2023-12-07T21:11:10.607424+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:11:10.607424+0000","last_undegraded":"2023-12-07T21:11:10.607424+0000","last_fullsized":"2023-12-07T21:11:10.607424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345059+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:11:09.345059+0000","last_peered":"2023-12-07T21:11:09.345059+0000","last_clean":"2023-12-07T21:11:09.345059+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:11:09.345059+0000","last_undegraded":"2023-12-07T21:11:09.345059+0000","last_fullsized":"2023-12-07T21:11:09.345059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.687480+0000","last_change":"2023-12-07T21:11:32.687480+0000","last_active":"2023-12-07T21:11:32.687480+0000","last_peered":"2023-12-07T21:11:32.687480+0000","last_clean":"2023-12-07T21:11:32.687480+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:32.687480+0000","last_undegraded":"2023-12-07T21:11:32.687480+0000","last_fullsized":"2023-12-07T21:11:32.687480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.687375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:18:45.906213+0000","scrub_duration":0.001283024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":451,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148420+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148420+0000","last_peered":"2023-12-07T21:11:18.148420+0000","last_clean":"2023-12-07T21:11:18.148420+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148420+0000","last_undegraded":"2023-12-07T21:11:18.148420+0000","last_fullsized":"2023-12-07T21:11:18.148420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:25.481161+0000","last_change":"2023-12-07T21:12:25.481161+0000","last_active":"2023-12-07T21:12:25.481161+0000","last_peered":"2023-12-07T21:12:25.481161+0000","last_clean":"2023-12-07T21:12:25.481161+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:12:25.481161+0000","last_undegraded":"2023-12-07T21:12:25.481161+0000","last_fullsized":"2023-12-07T21:12:25.481161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_clean_scrub_stamp":"2023-12-07T21:12:25.481005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:33:44.071058+0000","scrub_duration":0.001267064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811322+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:11:18.811322+0000","last_peered":"2023-12-07T21:11:18.811322+0000","last_clean":"2023-12-07T21:11:18.811322+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:11:18.811322+0000","last_undegraded":"2023-12-07T21:11:18.811322+0000","last_fullsized":"2023-12-07T21:11:18.811322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.103368+0000","last_change":"2023-12-07T21:13:27.103392+0000","last_active":"2023-12-07T21:13:27.103368+0000","last_peered":"2023-12-07T21:13:27.103368+0000","last_clean":"2023-12-07T21:13:27.103368+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:13:27.103368+0000","last_undegraded":"2023-12-07T21:13:27.103368+0000","last_fullsized":"2023-12-07T21:13:27.103368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:04.121495+0000","scrub_duration":0.0012535599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187452+0000","last_change":"2023-12-07T21:08:46.819723+0000","last_active":"2023-12-07T21:11:10.187452+0000","last_peered":"2023-12-07T21:11:10.187452+0000","last_clean":"2023-12-07T21:11:10.187452+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:11:10.187452+0000","last_undegraded":"2023-12-07T21:11:10.187452+0000","last_fullsized":"2023-12-07T21:11:10.187452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345044+0000","last_change":"2023-12-07T21:08:54.881937+0000","last_active":"2023-12-07T21:11:09.345044+0000","last_peered":"2023-12-07T21:11:09.345044+0000","last_clean":"2023-12-07T21:11:09.345044+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:11:09.345044+0000","last_undegraded":"2023-12-07T21:11:09.345044+0000","last_fullsized":"2023-12-07T21:11:09.345044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.627991+0000","last_change":"2023-12-07T21:12:15.627991+0000","last_active":"2023-12-07T21:12:15.627991+0000","last_peered":"2023-12-07T21:12:15.627991+0000","last_clean":"2023-12-07T21:12:15.627991+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:12:15.627991+0000","last_undegraded":"2023-12-07T21:12:15.627991+0000","last_fullsized":"2023-12-07T21:12:15.627991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.627865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:38.318981+0000","scrub_duration":0.0028926030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'25","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:46.537922+0000","last_change":"2023-12-07T21:11:46.537922+0000","last_active":"2023-12-07T21:11:46.537922+0000","last_peered":"2023-12-07T21:11:46.537922+0000","last_clean":"2023-12-07T21:11:46.537922+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:46.537922+0000","last_undegraded":"2023-12-07T21:11:46.537922+0000","last_fullsized":"2023-12-07T21:11:46.537922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_clean_scrub_stamp":"2023-12-07T21:11:46.537795+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:57.338431+0000","scrub_duration":0.0057357379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642698+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642698+0000","last_peered":"2023-12-07T21:11:12.642698+0000","last_clean":"2023-12-07T21:11:12.642698+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642698+0000","last_undegraded":"2023-12-07T21:11:12.642698+0000","last_fullsized":"2023-12-07T21:11:12.642698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608815+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:11:10.608815+0000","last_peered":"2023-12-07T21:11:10.608815+0000","last_clean":"2023-12-07T21:11:10.608815+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:11:10.608815+0000","last_undegraded":"2023-12-07T21:11:10.608815+0000","last_fullsized":"2023-12-07T21:11:10.608815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.097020+0000","last_change":"2023-12-07T21:13:20.097065+0000","last_active":"2023-12-07T21:13:20.097020+0000","last_peered":"2023-12-07T21:13:20.097020+0000","last_clean":"2023-12-07T21:13:20.097020+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:13:20.097020+0000","last_undegraded":"2023-12-07T21:13:20.097020+0000","last_fullsized":"2023-12-07T21:13:20.097020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.096899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.485657+0000","scrub_duration":0.001542213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607422+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:11:10.607422+0000","last_peered":"2023-12-07T21:11:10.607422+0000","last_clean":"2023-12-07T21:11:10.607422+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:11:10.607422+0000","last_undegraded":"2023-12-07T21:11:10.607422+0000","last_fullsized":"2023-12-07T21:11:10.607422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187488+0000","last_change":"2023-12-07T21:08:54.880674+0000","last_active":"2023-12-07T21:11:10.187488+0000","last_peered":"2023-12-07T21:11:10.187488+0000","last_clean":"2023-12-07T21:11:10.187488+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:11:10.187488+0000","last_undegraded":"2023-12-07T21:11:10.187488+0000","last_fullsized":"2023-12-07T21:11:10.187488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:57.727223+0000","last_change":"2023-12-07T21:11:57.727223+0000","last_active":"2023-12-07T21:11:57.727223+0000","last_peered":"2023-12-07T21:11:57.727223+0000","last_clean":"2023-12-07T21:11:57.727223+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:11:57.727223+0000","last_undegraded":"2023-12-07T21:11:57.727223+0000","last_fullsized":"2023-12-07T21:11:57.727223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_clean_scrub_stamp":"2023-12-07T21:11:57.727085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:53.015740+0000","scrub_duration":0.0013430639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.630855+0000","last_change":"2023-12-07T21:12:49.630855+0000","last_active":"2023-12-07T21:12:49.630855+0000","last_peered":"2023-12-07T21:12:49.630855+0000","last_clean":"2023-12-07T21:12:49.630855+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:12:49.630855+0000","last_undegraded":"2023-12-07T21:12:49.630855+0000","last_fullsized":"2023-12-07T21:12:49.630855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.630741+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:01.513069+0000","scrub_duration":0.0051886659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.811269+0000","last_change":"2023-12-07T21:09:02.907037+0000","last_active":"2023-12-07T21:11:13.811269+0000","last_peered":"2023-12-07T21:11:13.811269+0000","last_clean":"2023-12-07T21:11:13.811269+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:11:13.811269+0000","last_undegraded":"2023-12-07T21:11:13.811269+0000","last_fullsized":"2023-12-07T21:11:13.811269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:01.881726+0000","last_clean_scrub_stamp":"2023-12-07T21:09:01.881726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811119+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:11:18.811119+0000","last_peered":"2023-12-07T21:11:18.811119+0000","last_clean":"2023-12-07T21:11:18.811119+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:11:18.811119+0000","last_undegraded":"2023-12-07T21:11:18.811119+0000","last_fullsized":"2023-12-07T21:11:18.811119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:10.299642+0000","last_change":"2023-12-07T21:13:10.299666+0000","last_active":"2023-12-07T21:13:10.299642+0000","last_peered":"2023-12-07T21:13:10.299642+0000","last_clean":"2023-12-07T21:13:10.299642+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:13:10.299642+0000","last_undegraded":"2023-12-07T21:13:10.299642+0000","last_fullsized":"2023-12-07T21:13:10.299642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_clean_scrub_stamp":"2023-12-07T21:13:10.299548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:18:32.210130+0000","scrub_duration":0.00096658499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187482+0000","last_change":"2023-12-07T21:08:54.881143+0000","last_active":"2023-12-07T21:11:10.187482+0000","last_peered":"2023-12-07T21:11:10.187482+0000","last_clean":"2023-12-07T21:11:10.187482+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:11:10.187482+0000","last_undegraded":"2023-12-07T21:11:10.187482+0000","last_fullsized":"2023-12-07T21:11:10.187482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345020+0000","last_change":"2023-12-07T21:08:46.821942+0000","last_active":"2023-12-07T21:11:09.345020+0000","last_peered":"2023-12-07T21:11:09.345020+0000","last_clean":"2023-12-07T21:11:09.345020+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:11:09.345020+0000","last_undegraded":"2023-12-07T21:11:09.345020+0000","last_fullsized":"2023-12-07T21:11:09.345020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.771944+0000","last_change":"2023-12-07T21:12:11.771944+0000","last_active":"2023-12-07T21:12:11.771944+0000","last_peered":"2023-12-07T21:12:11.771944+0000","last_clean":"2023-12-07T21:12:11.771944+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:12:11.771944+0000","last_undegraded":"2023-12-07T21:12:11.771944+0000","last_fullsized":"2023-12-07T21:12:11.771944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.771816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:43.210676+0000","scrub_duration":0.0013479799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'72","reported_seq":142,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.763012+0000","last_change":"2023-12-07T21:11:45.763012+0000","last_active":"2023-12-07T21:11:45.763012+0000","last_peered":"2023-12-07T21:11:45.763012+0000","last_clean":"2023-12-07T21:11:45.763012+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:45.763012+0000","last_undegraded":"2023-12-07T21:11:45.763012+0000","last_fullsized":"2023-12-07T21:11:45.763012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.762875+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:27:47.809323+0000","scrub_duration":0.006706058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594416+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594416+0000","last_peered":"2023-12-07T21:11:25.594416+0000","last_clean":"2023-12-07T21:11:25.594416+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594416+0000","last_undegraded":"2023-12-07T21:11:25.594416+0000","last_fullsized":"2023-12-07T21:11:25.594416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345934+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:11:09.345934+0000","last_peered":"2023-12-07T21:11:09.345934+0000","last_clean":"2023-12-07T21:11:09.345934+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:11:09.345934+0000","last_undegraded":"2023-12-07T21:11:09.345934+0000","last_fullsized":"2023-12-07T21:11:09.345934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.332914+0000","last_change":"2023-12-07T21:12:42.332914+0000","last_active":"2023-12-07T21:12:42.332914+0000","last_peered":"2023-12-07T21:12:42.332914+0000","last_clean":"2023-12-07T21:12:42.332914+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:12:42.332914+0000","last_undegraded":"2023-12-07T21:12:42.332914+0000","last_fullsized":"2023-12-07T21:12:42.332914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.332776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:52.088170+0000","scrub_duration":0.00097994699999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345087+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:11:09.345087+0000","last_peered":"2023-12-07T21:11:09.345087+0000","last_clean":"2023-12-07T21:11:09.345087+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:11:09.345087+0000","last_undegraded":"2023-12-07T21:11:09.345087+0000","last_fullsized":"2023-12-07T21:11:09.345087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607497+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:11:10.607497+0000","last_peered":"2023-12-07T21:11:10.607497+0000","last_clean":"2023-12-07T21:11:10.607497+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:11:10.607497+0000","last_undegraded":"2023-12-07T21:11:10.607497+0000","last_fullsized":"2023-12-07T21:11:10.607497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.626478+0000","last_change":"2023-12-07T21:11:42.626478+0000","last_active":"2023-12-07T21:11:42.626478+0000","last_peered":"2023-12-07T21:11:42.626478+0000","last_clean":"2023-12-07T21:11:42.626478+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:11:42.626478+0000","last_undegraded":"2023-12-07T21:11:42.626478+0000","last_fullsized":"2023-12-07T21:11:42.626478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.626356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:23.689571+0000","scrub_duration":0.001348258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.225043+0000","last_change":"2023-12-07T21:11:33.225043+0000","last_active":"2023-12-07T21:11:33.225043+0000","last_peered":"2023-12-07T21:11:33.225043+0000","last_clean":"2023-12-07T21:11:33.225043+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:33.225043+0000","last_undegraded":"2023-12-07T21:11:33.225043+0000","last_fullsized":"2023-12-07T21:11:33.225043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.224920+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:12.396025+0000","scrub_duration":0.0049945800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.065956+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:11:20.065956+0000","last_peered":"2023-12-07T21:11:20.065956+0000","last_clean":"2023-12-07T21:11:20.065956+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:20.065956+0000","last_undegraded":"2023-12-07T21:11:20.065956+0000","last_fullsized":"2023-12-07T21:11:20.065956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608840+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:11:10.608840+0000","last_peered":"2023-12-07T21:11:10.608840+0000","last_clean":"2023-12-07T21:11:10.608840+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:11:10.608840+0000","last_undegraded":"2023-12-07T21:11:10.608840+0000","last_fullsized":"2023-12-07T21:11:10.608840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:26.538543+0000","last_change":"2023-12-07T21:13:26.538591+0000","last_active":"2023-12-07T21:13:26.538543+0000","last_peered":"2023-12-07T21:13:26.538543+0000","last_clean":"2023-12-07T21:13:26.538543+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:13:26.538543+0000","last_undegraded":"2023-12-07T21:13:26.538543+0000","last_fullsized":"2023-12-07T21:13:26.538543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_clean_scrub_stamp":"2023-12-07T21:13:26.538439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:32:03.233013+0000","scrub_duration":0.0011404239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607526+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:11:10.607526+0000","last_peered":"2023-12-07T21:11:10.607526+0000","last_clean":"2023-12-07T21:11:10.607526+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:11:10.607526+0000","last_undegraded":"2023-12-07T21:11:10.607526+0000","last_fullsized":"2023-12-07T21:11:10.607526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345020+0000","last_change":"2023-12-07T21:08:46.822097+0000","last_active":"2023-12-07T21:11:09.345020+0000","last_peered":"2023-12-07T21:11:09.345020+0000","last_clean":"2023-12-07T21:11:09.345020+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:11:09.345020+0000","last_undegraded":"2023-12-07T21:11:09.345020+0000","last_fullsized":"2023-12-07T21:11:09.345020+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.865911+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:11:18.865911+0000","last_peered":"2023-12-07T21:11:18.865911+0000","last_clean":"2023-12-07T21:11:18.865911+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:11:18.865911+0000","last_undegraded":"2023-12-07T21:11:18.865911+0000","last_fullsized":"2023-12-07T21:11:18.865911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:44.632651+0000","last_change":"2023-12-07T21:12:44.632651+0000","last_active":"2023-12-07T21:12:44.632651+0000","last_peered":"2023-12-07T21:12:44.632651+0000","last_clean":"2023-12-07T21:12:44.632651+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:12:44.632651+0000","last_undegraded":"2023-12-07T21:12:44.632651+0000","last_fullsized":"2023-12-07T21:12:44.632651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_clean_scrub_stamp":"2023-12-07T21:12:44.632504+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:24.020207+0000","scrub_duration":0.0053067840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":369,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712229+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712229+0000","last_peered":"2023-12-07T21:11:18.712229+0000","last_clean":"2023-12-07T21:11:18.712229+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712229+0000","last_undegraded":"2023-12-07T21:11:18.712229+0000","last_fullsized":"2023-12-07T21:11:18.712229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767478+0000","last_change":"2023-12-07T21:09:04.929420+0000","last_active":"2023-12-07T21:11:09.767478+0000","last_peered":"2023-12-07T21:11:09.767478+0000","last_clean":"2023-12-07T21:11:09.767478+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:11:09.767478+0000","last_undegraded":"2023-12-07T21:11:09.767478+0000","last_fullsized":"2023-12-07T21:11:09.767478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:43.441643+0000","last_change":"2023-12-07T21:12:43.441643+0000","last_active":"2023-12-07T21:12:43.441643+0000","last_peered":"2023-12-07T21:12:43.441643+0000","last_clean":"2023-12-07T21:12:43.441643+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:12:43.441643+0000","last_undegraded":"2023-12-07T21:12:43.441643+0000","last_fullsized":"2023-12-07T21:12:43.441643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_clean_scrub_stamp":"2023-12-07T21:12:43.441484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:24.768617+0000","scrub_duration":0.0011182029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:22.456099+0000","last_change":"2023-12-07T21:13:22.456119+0000","last_active":"2023-12-07T21:13:22.456099+0000","last_peered":"2023-12-07T21:13:22.456099+0000","last_clean":"2023-12-07T21:13:22.456099+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:13:22.456099+0000","last_undegraded":"2023-12-07T21:13:22.456099+0000","last_fullsized":"2023-12-07T21:13:22.456099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_clean_scrub_stamp":"2023-12-07T21:13:22.456021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:49.190223+0000","scrub_duration":0.001272902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607479+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:11:10.607479+0000","last_peered":"2023-12-07T21:11:10.607479+0000","last_clean":"2023-12-07T21:11:10.607479+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:11:10.607479+0000","last_undegraded":"2023-12-07T21:11:10.607479+0000","last_fullsized":"2023-12-07T21:11:10.607479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:37.651334+0000","last_change":"2023-12-07T21:11:37.651334+0000","last_active":"2023-12-07T21:11:37.651334+0000","last_peered":"2023-12-07T21:11:37.651334+0000","last_clean":"2023-12-07T21:11:37.651334+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:11:37.651334+0000","last_undegraded":"2023-12-07T21:11:37.651334+0000","last_fullsized":"2023-12-07T21:11:37.651334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_clean_scrub_stamp":"2023-12-07T21:11:37.651191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:09.090050+0000","scrub_duration":0.0012443790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'94","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:05.544503+0000","last_change":"2023-12-07T21:12:05.544503+0000","last_active":"2023-12-07T21:12:05.544503+0000","last_peered":"2023-12-07T21:12:05.544503+0000","last_clean":"2023-12-07T21:12:05.544503+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:12:05.544503+0000","last_undegraded":"2023-12-07T21:12:05.544503+0000","last_fullsized":"2023-12-07T21:12:05.544503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'94","last_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_deep_scrub":"33'94","last_deep_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_clean_scrub_stamp":"2023-12-07T21:12:05.544369+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:32:13.323537+0000","scrub_duration":0.006343095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.831678+0000","last_change":"2023-12-07T21:11:52.831678+0000","last_active":"2023-12-07T21:11:52.831678+0000","last_peered":"2023-12-07T21:11:52.831678+0000","last_clean":"2023-12-07T21:11:52.831678+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:52.831678+0000","last_undegraded":"2023-12-07T21:11:52.831678+0000","last_fullsized":"2023-12-07T21:11:52.831678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.831531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:22.265020+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188437+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:11:10.188437+0000","last_peered":"2023-12-07T21:11:10.188437+0000","last_clean":"2023-12-07T21:11:10.188437+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:11:10.188437+0000","last_undegraded":"2023-12-07T21:11:10.188437+0000","last_fullsized":"2023-12-07T21:11:10.188437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.528421+0000","last_change":"2023-12-07T21:12:23.528421+0000","last_active":"2023-12-07T21:12:23.528421+0000","last_peered":"2023-12-07T21:12:23.528421+0000","last_clean":"2023-12-07T21:12:23.528421+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:12:23.528421+0000","last_undegraded":"2023-12-07T21:12:23.528421+0000","last_fullsized":"2023-12-07T21:12:23.528421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.528299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:52.961788+0000","scrub_duration":0.00098274400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.407065+0000","last_change":"2023-12-07T21:13:04.407105+0000","last_active":"2023-12-07T21:13:04.407065+0000","last_peered":"2023-12-07T21:13:04.407065+0000","last_clean":"2023-12-07T21:13:04.407065+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:13:04.407065+0000","last_undegraded":"2023-12-07T21:13:04.407065+0000","last_fullsized":"2023-12-07T21:13:04.407065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.406964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:17:33.745379+0000","scrub_duration":0.001091641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607705+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:11:10.607705+0000","last_peered":"2023-12-07T21:11:10.607705+0000","last_clean":"2023-12-07T21:11:10.607705+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:11:10.607705+0000","last_undegraded":"2023-12-07T21:11:10.607705+0000","last_fullsized":"2023-12-07T21:11:10.607705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.299949+0000","last_change":"2023-12-07T21:11:39.299988+0000","last_active":"2023-12-07T21:11:39.299949+0000","last_peered":"2023-12-07T21:11:39.299949+0000","last_clean":"2023-12-07T21:11:39.299949+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:39.299949+0000","last_undegraded":"2023-12-07T21:11:39.299949+0000","last_fullsized":"2023-12-07T21:11:39.299949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.299849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:48.997025+0000","scrub_duration":0.001356866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.839849+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:20.839849+0000","last_peered":"2023-12-07T21:11:20.839849+0000","last_clean":"2023-12-07T21:11:20.839849+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:20.839849+0000","last_undegraded":"2023-12-07T21:11:20.839849+0000","last_fullsized":"2023-12-07T21:11:20.839849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.626958+0000","last_change":"2023-12-07T21:13:05.626993+0000","last_active":"2023-12-07T21:13:05.626958+0000","last_peered":"2023-12-07T21:13:05.626958+0000","last_clean":"2023-12-07T21:13:05.626958+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:13:05.626958+0000","last_undegraded":"2023-12-07T21:13:05.626958+0000","last_fullsized":"2023-12-07T21:13:05.626958+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.626860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:01.027919+0000","scrub_duration":0.00097400899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345986+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:11:09.345986+0000","last_peered":"2023-12-07T21:11:09.345986+0000","last_clean":"2023-12-07T21:11:09.345986+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:11:09.345986+0000","last_undegraded":"2023-12-07T21:11:09.345986+0000","last_fullsized":"2023-12-07T21:11:09.345986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.340533+0000","last_change":"2023-12-07T21:13:05.340557+0000","last_active":"2023-12-07T21:13:05.340533+0000","last_peered":"2023-12-07T21:13:05.340533+0000","last_clean":"2023-12-07T21:13:05.340533+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:13:05.340533+0000","last_undegraded":"2023-12-07T21:13:05.340533+0000","last_fullsized":"2023-12-07T21:13:05.340533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.340431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:24.924419+0000","scrub_duration":0.001119035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187534+0000","last_change":"2023-12-07T21:08:54.880755+0000","last_active":"2023-12-07T21:11:10.187534+0000","last_peered":"2023-12-07T21:11:10.187534+0000","last_clean":"2023-12-07T21:11:10.187534+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:11:10.187534+0000","last_undegraded":"2023-12-07T21:11:10.187534+0000","last_fullsized":"2023-12-07T21:11:10.187534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.790833+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:15.790833+0000","last_peered":"2023-12-07T21:11:15.790833+0000","last_clean":"2023-12-07T21:11:15.790833+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:15.790833+0000","last_undegraded":"2023-12-07T21:11:15.790833+0000","last_fullsized":"2023-12-07T21:11:15.790833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'9","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.887014+0000","last_change":"2023-12-07T21:11:50.887056+0000","last_active":"2023-12-07T21:11:50.887014+0000","last_peered":"2023-12-07T21:11:50.887014+0000","last_clean":"2023-12-07T21:11:50.887014+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:50.887014+0000","last_undegraded":"2023-12-07T21:11:50.887014+0000","last_fullsized":"2023-12-07T21:11:50.887014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.886922+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:02.989113+0000","scrub_duration":0.0042007399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:19.515594+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:19.515594+0000","last_peered":"2023-12-07T21:11:19.515594+0000","last_clean":"2023-12-07T21:11:19.515594+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:19.515594+0000","last_undegraded":"2023-12-07T21:11:19.515594+0000","last_fullsized":"2023-12-07T21:11:19.515594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345954+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:11:09.345954+0000","last_peered":"2023-12-07T21:11:09.345954+0000","last_clean":"2023-12-07T21:11:09.345954+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:11:09.345954+0000","last_undegraded":"2023-12-07T21:11:09.345954+0000","last_fullsized":"2023-12-07T21:11:09.345954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345219+0000","last_change":"2023-12-07T21:08:56.874712+0000","last_active":"2023-12-07T21:11:09.345219+0000","last_peered":"2023-12-07T21:11:09.345219+0000","last_clean":"2023-12-07T21:11:09.345219+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:11:09.345219+0000","last_undegraded":"2023-12-07T21:11:09.345219+0000","last_fullsized":"2023-12-07T21:11:09.345219+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.434871+0000","last_change":"2023-12-07T21:13:28.434901+0000","last_active":"2023-12-07T21:13:28.434871+0000","last_peered":"2023-12-07T21:13:28.434871+0000","last_clean":"2023-12-07T21:13:28.434871+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:13:28.434871+0000","last_undegraded":"2023-12-07T21:13:28.434871+0000","last_fullsized":"2023-12-07T21:13:28.434871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.434771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:49.030870+0000","scrub_duration":0.001230061,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.605088+0000","last_change":"2023-12-07T21:12:18.605108+0000","last_active":"2023-12-07T21:12:18.605088+0000","last_peered":"2023-12-07T21:12:18.605088+0000","last_clean":"2023-12-07T21:12:18.605088+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:12:18.605088+0000","last_undegraded":"2023-12-07T21:12:18.605088+0000","last_fullsized":"2023-12-07T21:12:18.605088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.605002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:30.707193+0000","scrub_duration":0.00090833899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":98,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.678798+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:11.678798+0000","last_peered":"2023-12-07T21:11:11.678798+0000","last_clean":"2023-12-07T21:11:11.678798+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:11.678798+0000","last_undegraded":"2023-12-07T21:11:11.678798+0000","last_fullsized":"2023-12-07T21:11:11.678798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.302787+0000","last_change":"2023-12-07T21:11:36.302809+0000","last_active":"2023-12-07T21:11:36.302787+0000","last_peered":"2023-12-07T21:11:36.302787+0000","last_clean":"2023-12-07T21:11:36.302787+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:36.302787+0000","last_undegraded":"2023-12-07T21:11:36.302787+0000","last_fullsized":"2023-12-07T21:11:36.302787+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.302687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:01.567462+0000","scrub_duration":0.0014296669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608968+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:11:10.608968+0000","last_peered":"2023-12-07T21:11:10.608968+0000","last_clean":"2023-12-07T21:11:10.608968+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:11:10.608968+0000","last_undegraded":"2023-12-07T21:11:10.608968+0000","last_fullsized":"2023-12-07T21:11:10.608968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608103+0000","last_change":"2023-12-07T21:08:56.887184+0000","last_active":"2023-12-07T21:11:10.608103+0000","last_peered":"2023-12-07T21:11:10.608103+0000","last_clean":"2023-12-07T21:11:10.608103+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:11:10.608103+0000","last_undegraded":"2023-12-07T21:11:10.608103+0000","last_fullsized":"2023-12-07T21:11:10.608103+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:09.325661+0000","last_change":"2023-12-07T21:13:09.325688+0000","last_active":"2023-12-07T21:13:09.325661+0000","last_peered":"2023-12-07T21:13:09.325661+0000","last_clean":"2023-12-07T21:13:09.325661+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:13:09.325661+0000","last_undegraded":"2023-12-07T21:13:09.325661+0000","last_fullsized":"2023-12-07T21:13:09.325661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_clean_scrub_stamp":"2023-12-07T21:13:09.325568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:45:40.066890+0000","scrub_duration":0.00116248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.514123+0000","last_change":"2023-12-07T21:11:52.514142+0000","last_active":"2023-12-07T21:11:52.514123+0000","last_peered":"2023-12-07T21:11:52.514123+0000","last_clean":"2023-12-07T21:11:52.514123+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:52.514123+0000","last_undegraded":"2023-12-07T21:11:52.514123+0000","last_fullsized":"2023-12-07T21:11:52.514123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.514035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:00:51.180837+0000","scrub_duration":0.00101976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.532757+0000","last_change":"2023-12-07T21:11:32.532802+0000","last_active":"2023-12-07T21:11:32.532757+0000","last_peered":"2023-12-07T21:11:32.532757+0000","last_clean":"2023-12-07T21:11:32.532757+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:32.532757+0000","last_undegraded":"2023-12-07T21:11:32.532757+0000","last_fullsized":"2023-12-07T21:11:32.532757+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.532666+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:34.382885+0000","scrub_duration":0.0035860219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.544268+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:17.544268+0000","last_peered":"2023-12-07T21:11:17.544268+0000","last_clean":"2023-12-07T21:11:17.544268+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:17.544268+0000","last_undegraded":"2023-12-07T21:11:17.544268+0000","last_fullsized":"2023-12-07T21:11:17.544268+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608158+0000","last_change":"2023-12-07T21:08:56.873185+0000","last_active":"2023-12-07T21:11:10.608158+0000","last_peered":"2023-12-07T21:11:10.608158+0000","last_clean":"2023-12-07T21:11:10.608158+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:11:10.608158+0000","last_undegraded":"2023-12-07T21:11:10.608158+0000","last_fullsized":"2023-12-07T21:11:10.608158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607720+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:11:10.607720+0000","last_peered":"2023-12-07T21:11:10.607720+0000","last_clean":"2023-12-07T21:11:10.607720+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:11:10.607720+0000","last_undegraded":"2023-12-07T21:11:10.607720+0000","last_fullsized":"2023-12-07T21:11:10.607720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:59.757120+0000","last_change":"2023-12-07T21:11:59.757120+0000","last_active":"2023-12-07T21:11:59.757120+0000","last_peered":"2023-12-07T21:11:59.757120+0000","last_clean":"2023-12-07T21:11:59.757120+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:11:59.757120+0000","last_undegraded":"2023-12-07T21:11:59.757120+0000","last_fullsized":"2023-12-07T21:11:59.757120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_clean_scrub_stamp":"2023-12-07T21:11:59.757017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:04:59.018197+0000","scrub_duration":0.001196353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'61","reported_seq":127,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.783931+0000","last_change":"2023-12-07T21:11:44.783993+0000","last_active":"2023-12-07T21:11:44.783931+0000","last_peered":"2023-12-07T21:11:44.783931+0000","last_clean":"2023-12-07T21:11:44.783931+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:44.783931+0000","last_undegraded":"2023-12-07T21:11:44.783931+0000","last_fullsized":"2023-12-07T21:11:44.783931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.783824+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:07.474940+0000","scrub_duration":0.004588193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.558888+0000","last_change":"2023-12-07T21:11:36.558908+0000","last_active":"2023-12-07T21:11:36.558888+0000","last_peered":"2023-12-07T21:11:36.558888+0000","last_clean":"2023-12-07T21:11:36.558888+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:11:36.558888+0000","last_undegraded":"2023-12-07T21:11:36.558888+0000","last_fullsized":"2023-12-07T21:11:36.558888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.558807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:33:06.320086+0000","scrub_duration":0.001387288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345942+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:11:09.345942+0000","last_peered":"2023-12-07T21:11:09.345942+0000","last_clean":"2023-12-07T21:11:09.345942+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:11:09.345942+0000","last_undegraded":"2023-12-07T21:11:09.345942+0000","last_fullsized":"2023-12-07T21:11:09.345942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:19.862179+0000","last_change":"2023-12-07T21:12:19.862179+0000","last_active":"2023-12-07T21:12:19.862179+0000","last_peered":"2023-12-07T21:12:19.862179+0000","last_clean":"2023-12-07T21:12:19.862179+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:12:19.862179+0000","last_undegraded":"2023-12-07T21:12:19.862179+0000","last_fullsized":"2023-12-07T21:12:19.862179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_clean_scrub_stamp":"2023-12-07T21:12:19.862069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:34.168058+0000","scrub_duration":0.0015085669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.431822+0000","last_change":"2023-12-07T21:13:21.431844+0000","last_active":"2023-12-07T21:13:21.431822+0000","last_peered":"2023-12-07T21:13:21.431822+0000","last_clean":"2023-12-07T21:13:21.431822+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:13:21.431822+0000","last_undegraded":"2023-12-07T21:13:21.431822+0000","last_fullsized":"2023-12-07T21:13:21.431822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.431724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:58:06.040375+0000","scrub_duration":0.0012195439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188111+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:11:10.188111+0000","last_peered":"2023-12-07T21:11:10.188111+0000","last_clean":"2023-12-07T21:11:10.188111+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:11:10.188111+0000","last_undegraded":"2023-12-07T21:11:10.188111+0000","last_fullsized":"2023-12-07T21:11:10.188111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.514700+0000","last_change":"2023-12-07T21:12:21.514738+0000","last_active":"2023-12-07T21:12:21.514700+0000","last_peered":"2023-12-07T21:12:21.514700+0000","last_clean":"2023-12-07T21:12:21.514700+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:12:21.514700+0000","last_undegraded":"2023-12-07T21:12:21.514700+0000","last_fullsized":"2023-12-07T21:12:21.514700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.514603+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:11.760175+0000","scrub_duration":0.0065721260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:13.398971+0000","last_change":"2023-12-07T21:12:13.399009+0000","last_active":"2023-12-07T21:12:13.398971+0000","last_peered":"2023-12-07T21:12:13.398971+0000","last_clean":"2023-12-07T21:12:13.398971+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:12:13.398971+0000","last_undegraded":"2023-12-07T21:12:13.398971+0000","last_fullsized":"2023-12-07T21:12:13.398971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_clean_scrub_stamp":"2023-12-07T21:12:13.398859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:54.725992+0000","scrub_duration":0.0011359600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608912+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:11:10.608912+0000","last_peered":"2023-12-07T21:11:10.608912+0000","last_clean":"2023-12-07T21:11:10.608912+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:11:10.608912+0000","last_undegraded":"2023-12-07T21:11:10.608912+0000","last_fullsized":"2023-12-07T21:11:10.608912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.432371+0000","last_change":"2023-12-07T21:12:11.432392+0000","last_active":"2023-12-07T21:12:11.432371+0000","last_peered":"2023-12-07T21:12:11.432371+0000","last_clean":"2023-12-07T21:12:11.432371+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:12:11.432371+0000","last_undegraded":"2023-12-07T21:12:11.432371+0000","last_fullsized":"2023-12-07T21:12:11.432371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.432277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:48.190145+0000","scrub_duration":0.0010618419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766451+0000","last_change":"2023-12-07T21:08:54.887587+0000","last_active":"2023-12-07T21:11:09.766451+0000","last_peered":"2023-12-07T21:11:09.766451+0000","last_clean":"2023-12-07T21:11:09.766451+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:11:09.766451+0000","last_undegraded":"2023-12-07T21:11:09.766451+0000","last_fullsized":"2023-12-07T21:11:09.766451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:10.553115+0000","last_change":"2023-12-07T21:12:10.553135+0000","last_active":"2023-12-07T21:12:10.553115+0000","last_peered":"2023-12-07T21:12:10.553115+0000","last_clean":"2023-12-07T21:12:10.553115+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:12:10.553115+0000","last_undegraded":"2023-12-07T21:12:10.553115+0000","last_fullsized":"2023-12-07T21:12:10.553115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_clean_scrub_stamp":"2023-12-07T21:12:10.553023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:52.504367+0000","scrub_duration":0.0013037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.745178+0000","last_change":"2023-12-07T21:11:36.745178+0000","last_active":"2023-12-07T21:11:36.745178+0000","last_peered":"2023-12-07T21:11:36.745178+0000","last_clean":"2023-12-07T21:11:36.745178+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:36.745178+0000","last_undegraded":"2023-12-07T21:11:36.745178+0000","last_fullsized":"2023-12-07T21:11:36.745178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.745068+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:09.080620+0000","scrub_duration":0.0072373669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:16.616710+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:11:16.616710+0000","last_peered":"2023-12-07T21:11:16.616710+0000","last_clean":"2023-12-07T21:11:16.616710+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:11:16.616710+0000","last_undegraded":"2023-12-07T21:11:16.616710+0000","last_fullsized":"2023-12-07T21:11:16.616710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608884+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:11:10.608884+0000","last_peered":"2023-12-07T21:11:10.608884+0000","last_clean":"2023-12-07T21:11:10.608884+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:11:10.608884+0000","last_undegraded":"2023-12-07T21:11:10.608884+0000","last_fullsized":"2023-12-07T21:11:10.608884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.879480+0000","last_change":"2023-12-07T21:12:56.879540+0000","last_active":"2023-12-07T21:12:56.879480+0000","last_peered":"2023-12-07T21:12:56.879480+0000","last_clean":"2023-12-07T21:12:56.879480+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:12:56.879480+0000","last_undegraded":"2023-12-07T21:12:56.879480+0000","last_fullsized":"2023-12-07T21:12:56.879480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.879389+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:47.124961+0000","scrub_duration":0.0034133409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607746+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:11:10.607746+0000","last_peered":"2023-12-07T21:11:10.607746+0000","last_clean":"2023-12-07T21:11:10.607746+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:11:10.607746+0000","last_undegraded":"2023-12-07T21:11:10.607746+0000","last_fullsized":"2023-12-07T21:11:10.607746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.324406+0000","last_change":"2023-12-07T21:11:41.324449+0000","last_active":"2023-12-07T21:11:41.324406+0000","last_peered":"2023-12-07T21:11:41.324406+0000","last_clean":"2023-12-07T21:11:41.324406+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:41.324406+0000","last_undegraded":"2023-12-07T21:11:41.324406+0000","last_fullsized":"2023-12-07T21:11:41.324406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.324294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:18:22.956309+0000","scrub_duration":0.001431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.649725+0000","last_change":"2023-12-07T21:12:42.649725+0000","last_active":"2023-12-07T21:12:42.649725+0000","last_peered":"2023-12-07T21:12:42.649725+0000","last_clean":"2023-12-07T21:12:42.649725+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:12:42.649725+0000","last_undegraded":"2023-12-07T21:12:42.649725+0000","last_fullsized":"2023-12-07T21:12:42.649725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.649582+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:55:46.065006+0000","scrub_duration":0.0041186950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":325,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411924+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411924+0000","last_peered":"2023-12-07T21:11:10.411924+0000","last_clean":"2023-12-07T21:11:10.411924+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411924+0000","last_undegraded":"2023-12-07T21:11:10.411924+0000","last_fullsized":"2023-12-07T21:11:10.411924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608864+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:11:10.608864+0000","last_peered":"2023-12-07T21:11:10.608864+0000","last_clean":"2023-12-07T21:11:10.608864+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:11:10.608864+0000","last_undegraded":"2023-12-07T21:11:10.608864+0000","last_fullsized":"2023-12-07T21:11:10.608864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.370708+0000","last_change":"2023-12-07T21:13:07.370762+0000","last_active":"2023-12-07T21:13:07.370708+0000","last_peered":"2023-12-07T21:13:07.370708+0000","last_clean":"2023-12-07T21:13:07.370708+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:13:07.370708+0000","last_undegraded":"2023-12-07T21:13:07.370708+0000","last_fullsized":"2023-12-07T21:13:07.370708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:06.037407+0000","scrub_duration":0.0014696010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.432241+0000","last_change":"2023-12-07T21:13:23.432268+0000","last_active":"2023-12-07T21:13:23.432241+0000","last_peered":"2023-12-07T21:13:23.432241+0000","last_clean":"2023-12-07T21:13:23.432241+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:13:23.432241+0000","last_undegraded":"2023-12-07T21:13:23.432241+0000","last_fullsized":"2023-12-07T21:13:23.432241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.432146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:02:08.854218+0000","scrub_duration":0.001156783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.351535+0000","last_change":"2023-12-07T21:11:43.351557+0000","last_active":"2023-12-07T21:11:43.351535+0000","last_peered":"2023-12-07T21:11:43.351535+0000","last_clean":"2023-12-07T21:11:43.351535+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:43.351535+0000","last_undegraded":"2023-12-07T21:11:43.351535+0000","last_fullsized":"2023-12-07T21:11:43.351535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_clean_scrub_stamp":"2023-12-07T21:11:43.351414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:25.302758+0000","scrub_duration":0.001534795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.102589+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:17.102589+0000","last_peered":"2023-12-07T21:11:17.102589+0000","last_clean":"2023-12-07T21:11:17.102589+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:17.102589+0000","last_undegraded":"2023-12-07T21:11:17.102589+0000","last_fullsized":"2023-12-07T21:11:17.102589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.804304+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:27.804304+0000","last_peered":"2023-12-07T21:11:27.804304+0000","last_clean":"2023-12-07T21:11:27.804304+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:27.804304+0000","last_undegraded":"2023-12-07T21:11:27.804304+0000","last_fullsized":"2023-12-07T21:11:27.804304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767539+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:11:09.767539+0000","last_peered":"2023-12-07T21:11:09.767539+0000","last_clean":"2023-12-07T21:11:09.767539+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:11:09.767539+0000","last_undegraded":"2023-12-07T21:11:09.767539+0000","last_fullsized":"2023-12-07T21:11:09.767539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:17.462502+0000","last_change":"2023-12-07T21:13:17.462525+0000","last_active":"2023-12-07T21:13:17.462502+0000","last_peered":"2023-12-07T21:13:17.462502+0000","last_clean":"2023-12-07T21:13:17.462502+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:13:17.462502+0000","last_undegraded":"2023-12-07T21:13:17.462502+0000","last_fullsized":"2023-12-07T21:13:17.462502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_clean_scrub_stamp":"2023-12-07T21:13:17.462415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:57.578294+0000","scrub_duration":0.0013457709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607752+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:11:10.607752+0000","last_peered":"2023-12-07T21:11:10.607752+0000","last_clean":"2023-12-07T21:11:10.607752+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:11:10.607752+0000","last_undegraded":"2023-12-07T21:11:10.607752+0000","last_fullsized":"2023-12-07T21:11:10.607752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.612324+0000","last_change":"2023-12-07T21:12:17.612358+0000","last_active":"2023-12-07T21:12:17.612324+0000","last_peered":"2023-12-07T21:12:17.612324+0000","last_clean":"2023-12-07T21:12:17.612324+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:12:17.612324+0000","last_undegraded":"2023-12-07T21:12:17.612324+0000","last_fullsized":"2023-12-07T21:12:17.612324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.612233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:19.658682+0000","scrub_duration":0.00093805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.713857+0000","last_change":"2023-12-07T21:11:41.713922+0000","last_active":"2023-12-07T21:11:41.713857+0000","last_peered":"2023-12-07T21:11:41.713857+0000","last_clean":"2023-12-07T21:11:41.713857+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:41.713857+0000","last_undegraded":"2023-12-07T21:11:41.713857+0000","last_fullsized":"2023-12-07T21:11:41.713857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.713762+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:20:34.087308+0000","scrub_duration":0.004054785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.510322+0000","last_change":"2023-12-07T21:12:27.510342+0000","last_active":"2023-12-07T21:12:27.510322+0000","last_peered":"2023-12-07T21:12:27.510322+0000","last_clean":"2023-12-07T21:12:27.510322+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:12:27.510322+0000","last_undegraded":"2023-12-07T21:12:27.510322+0000","last_fullsized":"2023-12-07T21:12:27.510322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.510237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:49.420820+0000","scrub_duration":0.00099611600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608952+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:11:10.608952+0000","last_peered":"2023-12-07T21:11:10.608952+0000","last_clean":"2023-12-07T21:11:10.608952+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:11:10.608952+0000","last_undegraded":"2023-12-07T21:11:10.608952+0000","last_fullsized":"2023-12-07T21:11:10.608952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.564300+0000","last_change":"2023-12-07T21:13:28.564326+0000","last_active":"2023-12-07T21:13:28.564300+0000","last_peered":"2023-12-07T21:13:28.564300+0000","last_clean":"2023-12-07T21:13:28.564300+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:13:28.564300+0000","last_undegraded":"2023-12-07T21:13:28.564300+0000","last_fullsized":"2023-12-07T21:13:28.564300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.564212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:00.422576+0000","scrub_duration":0.0013779650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.878922+0000","last_change":"2023-12-07T21:13:08.878977+0000","last_active":"2023-12-07T21:13:08.878922+0000","last_peered":"2023-12-07T21:13:08.878922+0000","last_clean":"2023-12-07T21:13:08.878922+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:13:08.878922+0000","last_undegraded":"2023-12-07T21:13:08.878922+0000","last_fullsized":"2023-12-07T21:13:08.878922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_clean_scrub_stamp":"2023-12-07T21:13:08.878805+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:03.437843+0000","scrub_duration":0.0021145529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.412338+0000","last_change":"2023-12-07T21:11:55.412366+0000","last_active":"2023-12-07T21:11:55.412338+0000","last_peered":"2023-12-07T21:11:55.412338+0000","last_clean":"2023-12-07T21:11:55.412338+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:55.412338+0000","last_undegraded":"2023-12-07T21:11:55.412338+0000","last_fullsized":"2023-12-07T21:11:55.412338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.412243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.514434+0000","scrub_duration":0.0010230090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:00.405899+0000","last_change":"2023-12-07T21:12:00.405945+0000","last_active":"2023-12-07T21:12:00.405899+0000","last_peered":"2023-12-07T21:12:00.405899+0000","last_clean":"2023-12-07T21:12:00.405899+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:12:00.405899+0000","last_undegraded":"2023-12-07T21:12:00.405899+0000","last_fullsized":"2023-12-07T21:12:00.405899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_clean_scrub_stamp":"2023-12-07T21:12:00.405797+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:22.672028+0000","scrub_duration":0.0030248670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.620691+0000","last_change":"2023-12-07T21:12:35.620711+0000","last_active":"2023-12-07T21:12:35.620691+0000","last_peered":"2023-12-07T21:12:35.620691+0000","last_clean":"2023-12-07T21:12:35.620691+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:12:35.620691+0000","last_undegraded":"2023-12-07T21:12:35.620691+0000","last_fullsized":"2023-12-07T21:12:35.620691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.620604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:45:58.984206+0000","scrub_duration":0.00101417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608961+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:11:10.608961+0000","last_peered":"2023-12-07T21:11:10.608961+0000","last_clean":"2023-12-07T21:11:10.608961+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:11:10.608961+0000","last_undegraded":"2023-12-07T21:11:10.608961+0000","last_fullsized":"2023-12-07T21:11:10.608961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:45.443200+0000","last_change":"2023-12-07T21:12:45.443225+0000","last_active":"2023-12-07T21:12:45.443200+0000","last_peered":"2023-12-07T21:12:45.443200+0000","last_clean":"2023-12-07T21:12:45.443200+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:12:45.443200+0000","last_undegraded":"2023-12-07T21:12:45.443200+0000","last_fullsized":"2023-12-07T21:12:45.443200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_clean_scrub_stamp":"2023-12-07T21:12:45.443116+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:59.105780+0000","scrub_duration":0.003118975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:41.352194+0000","last_change":"2023-12-07T21:12:41.352194+0000","last_active":"2023-12-07T21:12:41.352194+0000","last_peered":"2023-12-07T21:12:41.352194+0000","last_clean":"2023-12-07T21:12:41.352194+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:12:41.352194+0000","last_undegraded":"2023-12-07T21:12:41.352194+0000","last_fullsized":"2023-12-07T21:12:41.352194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_clean_scrub_stamp":"2023-12-07T21:12:41.352075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:21.467955+0000","scrub_duration":0.001369671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.347674+0000","last_change":"2023-12-07T21:11:44.347728+0000","last_active":"2023-12-07T21:11:44.347674+0000","last_peered":"2023-12-07T21:11:44.347674+0000","last_clean":"2023-12-07T21:11:44.347674+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:44.347674+0000","last_undegraded":"2023-12-07T21:11:44.347674+0000","last_fullsized":"2023-12-07T21:11:44.347674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.347582+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:19:20.740832+0000","scrub_duration":0.0032839919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.582439+0000","last_change":"2023-12-07T21:13:06.582486+0000","last_active":"2023-12-07T21:13:06.582439+0000","last_peered":"2023-12-07T21:13:06.582439+0000","last_clean":"2023-12-07T21:13:06.582439+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:13:06.582439+0000","last_undegraded":"2023-12-07T21:13:06.582439+0000","last_fullsized":"2023-12-07T21:13:06.582439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.582338+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:09:35.689720+0000","scrub_duration":0.0045970239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.597790+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:15.597790+0000","last_peered":"2023-12-07T21:11:15.597790+0000","last_clean":"2023-12-07T21:11:15.597790+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:15.597790+0000","last_undegraded":"2023-12-07T21:11:15.597790+0000","last_fullsized":"2023-12-07T21:11:15.597790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608930+0000","last_change":"2023-12-07T21:09:04.928655+0000","last_active":"2023-12-07T21:11:10.608930+0000","last_peered":"2023-12-07T21:11:10.608930+0000","last_clean":"2023-12-07T21:11:10.608930+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:11:10.608930+0000","last_undegraded":"2023-12-07T21:11:10.608930+0000","last_fullsized":"2023-12-07T21:11:10.608930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.282874+0000","last_change":"2023-12-07T21:12:20.282874+0000","last_active":"2023-12-07T21:12:20.282874+0000","last_peered":"2023-12-07T21:12:20.282874+0000","last_clean":"2023-12-07T21:12:20.282874+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:12:20.282874+0000","last_undegraded":"2023-12-07T21:12:20.282874+0000","last_fullsized":"2023-12-07T21:12:20.282874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.282741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:25.331572+0000","scrub_duration":0.001103185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.410433+0000","last_change":"2023-12-07T21:13:11.410456+0000","last_active":"2023-12-07T21:13:11.410433+0000","last_peered":"2023-12-07T21:13:11.410433+0000","last_clean":"2023-12-07T21:13:11.410433+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:13:11.410433+0000","last_undegraded":"2023-12-07T21:13:11.410433+0000","last_fullsized":"2023-12-07T21:13:11.410433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.410343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:25:05.365800+0000","scrub_duration":0.00143078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.887062+0000","last_change":"2023-12-07T21:12:35.887062+0000","last_active":"2023-12-07T21:12:35.887062+0000","last_peered":"2023-12-07T21:12:35.887062+0000","last_clean":"2023-12-07T21:12:35.887062+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:12:35.887062+0000","last_undegraded":"2023-12-07T21:12:35.887062+0000","last_fullsized":"2023-12-07T21:12:35.887062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.886915+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:07.595951+0000","scrub_duration":0.0013132650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345119+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:11:09.345119+0000","last_peered":"2023-12-07T21:11:09.345119+0000","last_clean":"2023-12-07T21:11:09.345119+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:11:09.345119+0000","last_undegraded":"2023-12-07T21:11:09.345119+0000","last_fullsized":"2023-12-07T21:11:09.345119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.424126+0000","last_change":"2023-12-07T21:12:12.424126+0000","last_active":"2023-12-07T21:12:12.424126+0000","last_peered":"2023-12-07T21:12:12.424126+0000","last_clean":"2023-12-07T21:12:12.424126+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:12:12.424126+0000","last_undegraded":"2023-12-07T21:12:12.424126+0000","last_fullsized":"2023-12-07T21:12:12.424126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.424026+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:21.643939+0000","scrub_duration":0.002995218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607794+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:11:10.607794+0000","last_peered":"2023-12-07T21:11:10.607794+0000","last_clean":"2023-12-07T21:11:10.607794+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:11:10.607794+0000","last_undegraded":"2023-12-07T21:11:10.607794+0000","last_fullsized":"2023-12-07T21:11:10.607794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345325+0000","last_change":"2023-12-07T21:08:56.872273+0000","last_active":"2023-12-07T21:11:09.345325+0000","last_peered":"2023-12-07T21:11:09.345325+0000","last_clean":"2023-12-07T21:11:09.345325+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:11:09.345325+0000","last_undegraded":"2023-12-07T21:11:09.345325+0000","last_fullsized":"2023-12-07T21:11:09.345325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345250+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:11:09.345250+0000","last_peered":"2023-12-07T21:11:09.345250+0000","last_clean":"2023-12-07T21:11:09.345250+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:11:09.345250+0000","last_undegraded":"2023-12-07T21:11:09.345250+0000","last_fullsized":"2023-12-07T21:11:09.345250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.893908+0000","last_change":"2023-12-07T21:13:07.893908+0000","last_active":"2023-12-07T21:13:07.893908+0000","last_peered":"2023-12-07T21:13:07.893908+0000","last_clean":"2023-12-07T21:13:07.893908+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:13:07.893908+0000","last_undegraded":"2023-12-07T21:13:07.893908+0000","last_fullsized":"2023-12-07T21:13:07.893908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.893732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:21.957836+0000","scrub_duration":0.0014675510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345108+0000","last_change":"2023-12-07T21:08:54.874578+0000","last_active":"2023-12-07T21:11:09.345108+0000","last_peered":"2023-12-07T21:11:09.345108+0000","last_clean":"2023-12-07T21:11:09.345108+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:11:09.345108+0000","last_undegraded":"2023-12-07T21:11:09.345108+0000","last_fullsized":"2023-12-07T21:11:09.345108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.766799+0000","last_change":"2023-12-07T21:08:56.883348+0000","last_active":"2023-12-07T21:11:09.766799+0000","last_peered":"2023-12-07T21:11:09.766799+0000","last_clean":"2023-12-07T21:11:09.766799+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:11:09.766799+0000","last_undegraded":"2023-12-07T21:11:09.766799+0000","last_fullsized":"2023-12-07T21:11:09.766799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.488346+0000","last_change":"2023-12-07T21:13:27.488385+0000","last_active":"2023-12-07T21:13:27.488346+0000","last_peered":"2023-12-07T21:13:27.488346+0000","last_clean":"2023-12-07T21:13:27.488346+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:13:27.488346+0000","last_undegraded":"2023-12-07T21:13:27.488346+0000","last_fullsized":"2023-12-07T21:13:27.488346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.488243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:20.217342+0000","scrub_duration":0.0011396240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.783809+0000","last_change":"2023-12-07T21:12:21.783809+0000","last_active":"2023-12-07T21:12:21.783809+0000","last_peered":"2023-12-07T21:12:21.783809+0000","last_clean":"2023-12-07T21:12:21.783809+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:12:21.783809+0000","last_undegraded":"2023-12-07T21:12:21.783809+0000","last_fullsized":"2023-12-07T21:12:21.783809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.783687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:25.104216+0000","scrub_duration":0.001223366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.417813+0000","last_change":"2023-12-07T21:12:58.417813+0000","last_active":"2023-12-07T21:12:58.417813+0000","last_peered":"2023-12-07T21:12:58.417813+0000","last_clean":"2023-12-07T21:12:58.417813+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:12:58.417813+0000","last_undegraded":"2023-12-07T21:12:58.417813+0000","last_fullsized":"2023-12-07T21:12:58.417813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.417685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:16.173945+0000","scrub_duration":0.0012264019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.393510+0000","last_change":"2023-12-07T21:12:14.393510+0000","last_active":"2023-12-07T21:12:14.393510+0000","last_peered":"2023-12-07T21:12:14.393510+0000","last_clean":"2023-12-07T21:12:14.393510+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:12:14.393510+0000","last_undegraded":"2023-12-07T21:12:14.393510+0000","last_fullsized":"2023-12-07T21:12:14.393510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.393370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:28.056034+0000","scrub_duration":0.0012787390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345102+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:11:09.345102+0000","last_peered":"2023-12-07T21:11:09.345102+0000","last_clean":"2023-12-07T21:11:09.345102+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:11:09.345102+0000","last_undegraded":"2023-12-07T21:11:09.345102+0000","last_fullsized":"2023-12-07T21:11:09.345102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:22.292045+0000","last_change":"2023-12-07T21:12:22.292065+0000","last_active":"2023-12-07T21:12:22.292045+0000","last_peered":"2023-12-07T21:12:22.292045+0000","last_clean":"2023-12-07T21:12:22.292045+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:12:22.292045+0000","last_undegraded":"2023-12-07T21:12:22.292045+0000","last_fullsized":"2023-12-07T21:12:22.292045+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_clean_scrub_stamp":"2023-12-07T21:12:22.291964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:19:35.510802+0000","scrub_duration":0.000955034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607807+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:11:10.607807+0000","last_peered":"2023-12-07T21:11:10.607807+0000","last_clean":"2023-12-07T21:11:10.607807+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:11:10.607807+0000","last_undegraded":"2023-12-07T21:11:10.607807+0000","last_fullsized":"2023-12-07T21:11:10.607807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:24.489620+0000","last_change":"2023-12-07T21:12:24.489652+0000","last_active":"2023-12-07T21:12:24.489620+0000","last_peered":"2023-12-07T21:12:24.489620+0000","last_clean":"2023-12-07T21:12:24.489620+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:12:24.489620+0000","last_undegraded":"2023-12-07T21:12:24.489620+0000","last_fullsized":"2023-12-07T21:12:24.489620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_clean_scrub_stamp":"2023-12-07T21:12:24.489525+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:58:44.073512+0000","scrub_duration":0.0022717330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.088717+0000","last_change":"2023-12-07T21:13:21.088717+0000","last_active":"2023-12-07T21:13:21.088717+0000","last_peered":"2023-12-07T21:13:21.088717+0000","last_clean":"2023-12-07T21:13:21.088717+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:13:21.088717+0000","last_undegraded":"2023-12-07T21:13:21.088717+0000","last_fullsized":"2023-12-07T21:13:21.088717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.088571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:31:27.226694+0000","scrub_duration":0.0016712599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.917521+0000","last_change":"2023-12-07T21:13:00.917521+0000","last_active":"2023-12-07T21:13:00.917521+0000","last_peered":"2023-12-07T21:13:00.917521+0000","last_clean":"2023-12-07T21:13:00.917521+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:13:00.917521+0000","last_undegraded":"2023-12-07T21:13:00.917521+0000","last_fullsized":"2023-12-07T21:13:00.917521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.917383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:19.507436+0000","scrub_duration":0.0013780719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.318731+0000","last_change":"2023-12-07T21:13:11.318731+0000","last_active":"2023-12-07T21:13:11.318731+0000","last_peered":"2023-12-07T21:13:11.318731+0000","last_clean":"2023-12-07T21:13:11.318731+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:13:11.318731+0000","last_undegraded":"2023-12-07T21:13:11.318731+0000","last_fullsized":"2023-12-07T21:13:11.318731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.318563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:32:03.116436+0000","scrub_duration":0.0013115340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:33.322751+0000","last_change":"2023-12-07T21:12:33.322751+0000","last_active":"2023-12-07T21:12:33.322751+0000","last_peered":"2023-12-07T21:12:33.322751+0000","last_clean":"2023-12-07T21:12:33.322751+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:12:33.322751+0000","last_undegraded":"2023-12-07T21:12:33.322751+0000","last_fullsized":"2023-12-07T21:12:33.322751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_clean_scrub_stamp":"2023-12-07T21:12:33.322634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:25:00.599068+0000","scrub_duration":0.001216778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.401789+0000","last_change":"2023-12-07T21:13:20.401789+0000","last_active":"2023-12-07T21:13:20.401789+0000","last_peered":"2023-12-07T21:13:20.401789+0000","last_clean":"2023-12-07T21:13:20.401789+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:13:20.401789+0000","last_undegraded":"2023-12-07T21:13:20.401789+0000","last_fullsized":"2023-12-07T21:13:20.401789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.401627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.790385+0000","scrub_duration":0.001405433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:32.342446+0000","last_change":"2023-12-07T21:12:32.342446+0000","last_active":"2023-12-07T21:12:32.342446+0000","last_peered":"2023-12-07T21:12:32.342446+0000","last_clean":"2023-12-07T21:12:32.342446+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:12:32.342446+0000","last_undegraded":"2023-12-07T21:12:32.342446+0000","last_fullsized":"2023-12-07T21:12:32.342446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_clean_scrub_stamp":"2023-12-07T21:12:32.342321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:46.648309+0000","scrub_duration":0.0011184750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.810923+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:11:13.810923+0000","last_peered":"2023-12-07T21:11:13.810923+0000","last_clean":"2023-12-07T21:11:13.810923+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:11:13.810923+0000","last_undegraded":"2023-12-07T21:11:13.810923+0000","last_fullsized":"2023-12-07T21:11:13.810923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'16","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.341269+0000","last_change":"2023-12-07T21:12:27.341269+0000","last_active":"2023-12-07T21:12:27.341269+0000","last_peered":"2023-12-07T21:12:27.341269+0000","last_clean":"2023-12-07T21:12:27.341269+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:12:27.341269+0000","last_undegraded":"2023-12-07T21:12:27.341269+0000","last_fullsized":"2023-12-07T21:12:27.341269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.341151+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:55:08.404366+0000","scrub_duration":0.0024774139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.811045+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:11:13.811045+0000","last_peered":"2023-12-07T21:11:13.811045+0000","last_clean":"2023-12-07T21:11:13.811045+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:11:13.811045+0000","last_undegraded":"2023-12-07T21:11:13.811045+0000","last_fullsized":"2023-12-07T21:11:13.811045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.810606+0000","last_change":"2023-12-07T21:08:56.876875+0000","last_active":"2023-12-07T21:11:13.810606+0000","last_peered":"2023-12-07T21:11:13.810606+0000","last_clean":"2023-12-07T21:11:13.810606+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:11:13.810606+0000","last_undegraded":"2023-12-07T21:11:13.810606+0000","last_fullsized":"2023-12-07T21:11:13.810606+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.462632+0000","last_change":"2023-12-07T21:12:54.462656+0000","last_active":"2023-12-07T21:12:54.462632+0000","last_peered":"2023-12-07T21:12:54.462632+0000","last_clean":"2023-12-07T21:12:54.462632+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:12:54.462632+0000","last_undegraded":"2023-12-07T21:12:54.462632+0000","last_fullsized":"2023-12-07T21:12:54.462632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.462543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:12:35.524119+0000","scrub_duration":0.0012396099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:01.404048+0000","last_change":"2023-12-07T21:12:01.404048+0000","last_active":"2023-12-07T21:12:01.404048+0000","last_peered":"2023-12-07T21:12:01.404048+0000","last_clean":"2023-12-07T21:12:01.404048+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:12:01.404048+0000","last_undegraded":"2023-12-07T21:12:01.404048+0000","last_fullsized":"2023-12-07T21:12:01.404048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_clean_scrub_stamp":"2023-12-07T21:12:01.403925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:06:41.638050+0000","scrub_duration":0.0014963070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607856+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:11:10.607856+0000","last_peered":"2023-12-07T21:11:10.607856+0000","last_clean":"2023-12-07T21:11:10.607856+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:11:10.607856+0000","last_undegraded":"2023-12-07T21:11:10.607856+0000","last_fullsized":"2023-12-07T21:11:10.607856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607882+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:11:10.607882+0000","last_peered":"2023-12-07T21:11:10.607882+0000","last_clean":"2023-12-07T21:11:10.607882+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:11:10.607882+0000","last_undegraded":"2023-12-07T21:11:10.607882+0000","last_fullsized":"2023-12-07T21:11:10.607882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345392+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:11:09.345392+0000","last_peered":"2023-12-07T21:11:09.345392+0000","last_clean":"2023-12-07T21:11:09.345392+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:11:09.345392+0000","last_undegraded":"2023-12-07T21:11:09.345392+0000","last_fullsized":"2023-12-07T21:11:09.345392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.910394+0000","last_change":"2023-12-07T21:13:05.910417+0000","last_active":"2023-12-07T21:13:05.910394+0000","last_peered":"2023-12-07T21:13:05.910394+0000","last_clean":"2023-12-07T21:13:05.910394+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:13:05.910394+0000","last_undegraded":"2023-12-07T21:13:05.910394+0000","last_fullsized":"2023-12-07T21:13:05.910394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.910299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:31:57.708172+0000","scrub_duration":0.001525988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.272185+0000","last_change":"2023-12-07T21:12:56.272208+0000","last_active":"2023-12-07T21:12:56.272185+0000","last_peered":"2023-12-07T21:12:56.272185+0000","last_clean":"2023-12-07T21:12:56.272185+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:12:56.272185+0000","last_undegraded":"2023-12-07T21:12:56.272185+0000","last_fullsized":"2023-12-07T21:12:56.272185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.272079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:16.868178+0000","scrub_duration":0.0010823779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1971,"ondisk_log_size":1971,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1439,"ondisk_log_size":1439,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705726,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.309,"5min":0.182,"15min":0.182},"max":{"1min":0.58399999999999996,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.439,"15min":0.44500000000000001},"min":{"1min":0.31,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.51800000000000002,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.37}]},{"osd":1,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33400000000000002,"15min":0.34300000000000003},"min":{"1min":0.26500000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.435,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34000000000000002,"15min":0.34599999999999997},"min":{"1min":0.24199999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48899999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36699999999999999,"15min":0.37},"min":{"1min":0.28199999999999997,"5min":0.223,"15min":0.223},"max":{"1min":0.48299999999999998,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.33400000000000002,"15min":0.33700000000000002},"min":{"1min":0.24199999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.46100000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.27800000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.38},{"interface":"front","average":{"1min":0.443,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.56899999999999995,"5min":0.621,"15min":0.621},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.32100000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48899999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.308,"5min":0.32500000000000001,"15min":0.33200000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.42299999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.253}]},{"osd":3,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32700000000000001,"15min":0.32900000000000001},"min":{"1min":0.245,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.40200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.26600000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.44900000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32800000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705725,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.27600000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.56100000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.32400000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.495}]},{"osd":2,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33800000000000002,"15min":0.35799999999999998},"min":{"1min":0.20200000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.39600000000000002,"5min":0.629,"15min":0.629},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.32300000000000001,"15min":0.32600000000000001},"min":{"1min":0.214,"5min":0.186,"15min":0.186},"max":{"1min":0.5,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.28000000000000003}]},{"osd":3,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33400000000000002,"15min":0.34200000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.43099999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36299999999999999,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.46200000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.29699999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.25700000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.70199999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.318,"5min":0.191,"15min":0.191},"max":{"1min":0.65200000000000002,"5min":0.747,"15min":0.747},"last":0.505}]},{"osd":2,"last update":"Thu Dec 7 21:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.497,"15min":0.48299999999999998},"min":{"1min":0.38,"5min":0.223,"15min":0.223},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.49099999999999999,"15min":0.47699999999999998},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67500000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.64700000000000002}]},{"osd":3,"last update":"Thu Dec 7 21:12:44 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.496,"15min":0.495},"min":{"1min":0.35299999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.504,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.33700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68100000000000005,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.624}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:13:33.481 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.481 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.481 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.481 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.481 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.482 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.482 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.482 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.482 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.482 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.482 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.483 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.483 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.483 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.483 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.483 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.483 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.484 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.484 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.484 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.484 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.484 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.485 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.485 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.485 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.485 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.485 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.485 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.486 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.486 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.486 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.486 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.486 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.487 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.487 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.487 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.487 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.487 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.487 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.487 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.488 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.488 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.488 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.488 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.488 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.489 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2023-12-07T21:09:01.881726+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=1, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.489 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.489 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.489 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.489 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.489 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.489 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.490 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.490 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.490 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.490 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.490 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.491 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.491 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.491 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.491 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.491 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.491 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.492 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.492 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.492 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.492 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.492 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.492 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.493 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.493 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.493 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.493 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.493 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.493 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.494 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.494 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.494 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.494 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.494 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.495 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.495 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.495 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.495 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.495 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.495 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.496 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.496 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.496 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.496 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.496 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.496 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.497 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:33.497 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:13:53.498 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:13:53.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.618+0000 7f7d62789640 1 Processor -- start 2023-12-07T21:13:53.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.618+0000 7f7d62789640 1 -- start start 2023-12-07T21:13:53.609 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.618+0000 7f7d62789640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d5c12a5a0 0x7f7d5c12a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:13:53.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.618+0000 7f7d62789640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c12a1e0 con 0x7f7d5c12aec0 2023-12-07T21:13:53.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.618+0000 7f7d62789640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c06f890 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.618+0000 7f7d5bfff640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d5c12a5a0 0x7f7d5c12a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:13:53.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.618+0000 7f7d5b7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7d5c12aec0 0x7f7d5c126ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:54764/0 (socket says 172.21.15.89:54764) 2023-12-07T21:13:53.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.618+0000 7f7d5b7fe640 1 -- 172.21.15.89:0/1729673844 learned_addr learned my addr 172.21.15.89:0/1729673844 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:13:53.610 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.619+0000 7f7d5bfff640 1 -- 172.21.15.89:0/1729673844 >> v1:172.21.15.89:6789/0 conn(0x7f7d5c12aec0 legacy=0x7f7d5c126ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:53.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.619+0000 7f7d5bfff640 1 -- 172.21.15.89:0/1729673844 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c06f220 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.611 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.619+0000 7f7d5affd640 1 -- 172.21.15.89:0/1729673844 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756511891 0 0) 0x7f7d5c12a1e0 con 0x7f7d5c12aec0 2023-12-07T21:13:53.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.619+0000 7f7d5bfff640 1 --2- 172.21.15.89:0/1729673844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d5c12a5a0 0x7f7d5c12a980 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009720 tx=0x7f7d4c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96e53a86eb62331 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:13:53.613 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.620+0000 7f7d5affd640 1 -- 172.21.15.89:0/1729673844 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c031760 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.620+0000 7f7d5affd640 1 -- 172.21.15.89:0/1729673844 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c0318c0 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.620+0000 7f7d5affd640 1 -- 172.21.15.89:0/1729673844 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c031b80 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.620+0000 7f7d62789640 1 -- 172.21.15.89:0/1729673844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d5c12a5a0 msgr2=0x7f7d5c12a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:53.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.620+0000 7f7d62789640 1 --2- 172.21.15.89:0/1729673844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d5c12a5a0 0x7f7d5c12a980 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009720 tx=0x7f7d4c02b8d0 comp rx=0 tx=0).stop 2023-12-07T21:13:53.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.620+0000 7f7d62789640 1 -- 172.21.15.89:0/1729673844 shutdown_connections 2023-12-07T21:13:53.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.620+0000 7f7d62789640 1 --2- 172.21.15.89:0/1729673844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d5c12a5a0 0x7f7d5c12a980 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:13:53.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.620+0000 7f7d62789640 1 -- 172.21.15.89:0/1729673844 >> 172.21.15.89:0/1729673844 conn(0x7f7d5c0987f0 msgr2=0x7f7d5c098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:13:53.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.620+0000 7f7d62789640 1 -- 172.21.15.89:0/1729673844 shutdown_connections 2023-12-07T21:13:53.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.620+0000 7f7d62789640 1 -- 172.21.15.89:0/1729673844 wait complete. 2023-12-07T21:13:53.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.621+0000 7f7d62789640 1 Processor -- start 2023-12-07T21:13:53.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.621+0000 7f7d62789640 1 -- start start 2023-12-07T21:13:53.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d62789640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d5c12a5a0 0x7f7d5c1bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:13:53.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d62789640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c08c500 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d5bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d5c12a5a0 0x7f7d5c1bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:13:53.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d5bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d5c12a5a0 0x7f7d5c1bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34100/0 (socket says 172.21.15.89:34100) 2023-12-07T21:13:53.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d5bfff640 1 -- 172.21.15.89:0/3643783219 learned_addr learned my addr 172.21.15.89:0/3643783219 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:13:53.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d5bfff640 1 -- 172.21.15.89:0/3643783219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c009400 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d5bfff640 1 --2- 172.21.15.89:0/3643783219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d5c12a5a0 0x7f7d5c1bf360 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009840 tx=0x7f7d4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:13:53.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d58ff9640 1 -- 172.21.15.89:0/3643783219 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c040070 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d58ff9640 1 -- 172.21.15.89:0/3643783219 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c03b790 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d62789640 1 -- 172.21.15.89:0/3643783219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c08b7e0 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d58ff9640 1 -- 172.21.15.89:0/3643783219 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d4c03ba70 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.622+0000 7f7d62789640 1 -- 172.21.15.89:0/3643783219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c08cfb0 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.623+0000 7f7d58ff9640 1 -- 172.21.15.89:0/3643783219 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f7d4c044070 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.623+0000 7f7d62789640 1 -- 172.21.15.89:0/3643783219 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c08b5a0 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.623+0000 7f7d58ff9640 1 --2- 172.21.15.89:0/3643783219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7d48037820 0x7f7d48039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:13:53.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.623+0000 7f7d58ff9640 1 -- 172.21.15.89:0/3643783219 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f7d4c06e8d0 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.624+0000 7f7d5b7fe640 1 --2- 172.21.15.89:0/3643783219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7d48037820 0x7f7d48039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:13:53.617 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.624+0000 7f7d5b7fe640 1 --2- 172.21.15.89:0/3643783219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7d48037820 0x7f7d48039ce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7d50000c00 tx=0x7f7d50007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:13:53.618 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.628+0000 7f7d58ff9640 1 -- 172.21.15.89:0/3643783219 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7d4c045740 con 0x7f7d5c12a5a0 2023-12-07T21:13:53.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.789+0000 7f7d62789640 1 -- 172.21.15.89:0/3643783219 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d5c08d140 con 0x7f7d48037820 2023-12-07T21:13:53.797 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.805+0000 7f7d58ff9640 1 -- 172.21.15.89:0/3643783219 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+674438 (secure 0 0 0) 0x7f7d500058d0 con 0x7f7d48037820 2023-12-07T21:13:53.804 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:13:53.809 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:13:53.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.809+0000 7f7d62789640 1 -- 172.21.15.89:0/3643783219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7d48037820 msgr2=0x7f7d48039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:53.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.809+0000 7f7d62789640 1 --2- 172.21.15.89:0/3643783219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7d48037820 0x7f7d48039ce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7d50000c00 tx=0x7f7d50007970 comp rx=0 tx=0).stop 2023-12-07T21:13:53.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.809+0000 7f7d62789640 1 -- 172.21.15.89:0/3643783219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d5c12a5a0 msgr2=0x7f7d5c1bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:13:53.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.809+0000 7f7d62789640 1 --2- 172.21.15.89:0/3643783219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d5c12a5a0 0x7f7d5c1bf360 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009840 tx=0x7f7d4c0046c0 comp rx=0 tx=0).stop 2023-12-07T21:13:53.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.809+0000 7f7d62789640 1 -- 172.21.15.89:0/3643783219 shutdown_connections 2023-12-07T21:13:53.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.809+0000 7f7d62789640 1 --2- 172.21.15.89:0/3643783219 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f7d48037820 0x7f7d48039ce0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:13:53.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.809+0000 7f7d62789640 1 --2- 172.21.15.89:0/3643783219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d5c12a5a0 0x7f7d5c1bf360 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:13:53.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.809+0000 7f7d62789640 1 -- 172.21.15.89:0/3643783219 >> 172.21.15.89:0/3643783219 conn(0x7f7d5c0987f0 msgr2=0x7f7d5c124be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:13:53.812 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.809+0000 7f7d62789640 1 -- 172.21.15.89:0/3643783219 shutdown_connections 2023-12-07T21:13:53.813 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:13:53.809+0000 7f7d62789640 1 -- 172.21.15.89:0/3643783219 wait complete. 2023-12-07T21:13:53.813 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2023-12-07T21:13:52.142691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1653,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4019,"ondisk_log_size":4019,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004209"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:19.413104+0000","last_change":"2023-12-07T21:13:19.413127+0000","last_active":"2023-12-07T21:13:19.413104+0000","last_peered":"2023-12-07T21:13:19.413104+0000","last_clean":"2023-12-07T21:13:19.413104+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:13:19.413104+0000","last_undegraded":"2023-12-07T21:13:19.413104+0000","last_fullsized":"2023-12-07T21:13:19.413104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_clean_scrub_stamp":"2023-12-07T21:13:19.413017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:51.122054+0000","scrub_duration":0.001250333,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.407237+0000","last_change":"2023-12-07T21:12:16.407256+0000","last_active":"2023-12-07T21:12:16.407237+0000","last_peered":"2023-12-07T21:12:16.407237+0000","last_clean":"2023-12-07T21:12:16.407237+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:12:16.407237+0000","last_undegraded":"2023-12-07T21:12:16.407237+0000","last_fullsized":"2023-12-07T21:12:16.407237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.407151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:53.647151+0000","scrub_duration":0.00097124400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.079685+0000","last_change":"2023-12-07T21:13:28.079732+0000","last_active":"2023-12-07T21:13:28.079685+0000","last_peered":"2023-12-07T21:13:28.079685+0000","last_clean":"2023-12-07T21:13:28.079685+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:13:28.079685+0000","last_undegraded":"2023-12-07T21:13:28.079685+0000","last_fullsized":"2023-12-07T21:13:28.079685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.079572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:44:03.747216+0000","scrub_duration":0.0011377760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345425+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:11:09.345425+0000","last_peered":"2023-12-07T21:11:09.345425+0000","last_clean":"2023-12-07T21:11:09.345425+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:11:09.345425+0000","last_undegraded":"2023-12-07T21:11:09.345425+0000","last_fullsized":"2023-12-07T21:11:09.345425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607997+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:11:10.607997+0000","last_peered":"2023-12-07T21:11:10.607997+0000","last_clean":"2023-12-07T21:11:10.607997+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:11:10.607997+0000","last_undegraded":"2023-12-07T21:11:10.607997+0000","last_fullsized":"2023-12-07T21:11:10.607997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.314608+0000","last_change":"2023-12-07T21:13:48.314629+0000","last_active":"2023-12-07T21:13:48.314608+0000","last_peered":"2023-12-07T21:13:48.314608+0000","last_clean":"2023-12-07T21:13:48.314608+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:13:48.314608+0000","last_undegraded":"2023-12-07T21:13:48.314608+0000","last_fullsized":"2023-12-07T21:13:48.314608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:48.314524+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:48.314524+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.314524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:17:28.252223+0000","scrub_duration":0.00098961300000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:39.350102+0000","last_change":"2023-12-07T21:13:39.350144+0000","last_active":"2023-12-07T21:13:39.350102+0000","last_peered":"2023-12-07T21:13:39.350102+0000","last_clean":"2023-12-07T21:13:39.350102+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:13:39.350102+0000","last_undegraded":"2023-12-07T21:13:39.350102+0000","last_fullsized":"2023-12-07T21:13:39.350102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:39.350003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:39.350003+0000","last_clean_scrub_stamp":"2023-12-07T21:13:39.350003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:26:22.544329+0000","scrub_duration":0.0013539439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:32.502166+0000","last_change":"2023-12-07T21:13:32.502187+0000","last_active":"2023-12-07T21:13:32.502166+0000","last_peered":"2023-12-07T21:13:32.502166+0000","last_clean":"2023-12-07T21:13:32.502166+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:13:32.502166+0000","last_undegraded":"2023-12-07T21:13:32.502166+0000","last_fullsized":"2023-12-07T21:13:32.502166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:32.502047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:32.502047+0000","last_clean_scrub_stamp":"2023-12-07T21:13:32.502047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:14:30.083430+0000","scrub_duration":0.001154356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607907+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:11:10.607907+0000","last_peered":"2023-12-07T21:11:10.607907+0000","last_clean":"2023-12-07T21:11:10.607907+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:11:10.607907+0000","last_undegraded":"2023-12-07T21:11:10.607907+0000","last_fullsized":"2023-12-07T21:11:10.607907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:39.304151+0000","last_change":"2023-12-07T21:12:39.304151+0000","last_active":"2023-12-07T21:12:39.304151+0000","last_peered":"2023-12-07T21:12:39.304151+0000","last_clean":"2023-12-07T21:12:39.304151+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:12:39.304151+0000","last_undegraded":"2023-12-07T21:12:39.304151+0000","last_fullsized":"2023-12-07T21:12:39.304151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_clean_scrub_stamp":"2023-12-07T21:12:39.304039+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:10.499475+0000","scrub_duration":0.0026021579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:35.274246+0000","last_change":"2023-12-07T21:13:35.274268+0000","last_active":"2023-12-07T21:13:35.274246+0000","last_peered":"2023-12-07T21:13:35.274246+0000","last_clean":"2023-12-07T21:13:35.274246+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:13:35.274246+0000","last_undegraded":"2023-12-07T21:13:35.274246+0000","last_fullsized":"2023-12-07T21:13:35.274246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:35.274152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:35.274152+0000","last_clean_scrub_stamp":"2023-12-07T21:13:35.274152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:55:25.519724+0000","scrub_duration":0.0012329559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.817727+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:11:43.817727+0000","last_peered":"2023-12-07T21:11:43.817727+0000","last_clean":"2023-12-07T21:11:43.817727+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:11:43.817727+0000","last_undegraded":"2023-12-07T21:11:43.817727+0000","last_fullsized":"2023-12-07T21:11:43.817727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607886+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:11:10.607886+0000","last_peered":"2023-12-07T21:11:10.607886+0000","last_clean":"2023-12-07T21:11:10.607886+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:11:10.607886+0000","last_undegraded":"2023-12-07T21:11:10.607886+0000","last_fullsized":"2023-12-07T21:11:10.607886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187911+0000","last_change":"2023-12-07T21:08:56.878331+0000","last_active":"2023-12-07T21:11:10.187911+0000","last_peered":"2023-12-07T21:11:10.187911+0000","last_clean":"2023-12-07T21:11:10.187911+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:11:10.187911+0000","last_undegraded":"2023-12-07T21:11:10.187911+0000","last_fullsized":"2023-12-07T21:11:10.187911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.845887+0000","last_change":"2023-12-07T21:12:54.845908+0000","last_active":"2023-12-07T21:12:54.845887+0000","last_peered":"2023-12-07T21:12:54.845887+0000","last_clean":"2023-12-07T21:12:54.845887+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:12:54.845887+0000","last_undegraded":"2023-12-07T21:12:54.845887+0000","last_fullsized":"2023-12-07T21:12:54.845887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.845780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:05.129794+0000","scrub_duration":0.001437123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'14","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.396728+0000","last_change":"2023-12-07T21:12:49.396728+0000","last_active":"2023-12-07T21:12:49.396728+0000","last_peered":"2023-12-07T21:12:49.396728+0000","last_clean":"2023-12-07T21:12:49.396728+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:12:49.396728+0000","last_undegraded":"2023-12-07T21:12:49.396728+0000","last_fullsized":"2023-12-07T21:12:49.396728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.396576+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:24:16.481666+0000","scrub_duration":0.0022819030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.406138+0000","last_change":"2023-12-07T21:13:44.406161+0000","last_active":"2023-12-07T21:13:44.406138+0000","last_peered":"2023-12-07T21:13:44.406138+0000","last_clean":"2023-12-07T21:13:44.406138+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:13:44.406138+0000","last_undegraded":"2023-12-07T21:13:44.406138+0000","last_fullsized":"2023-12-07T21:13:44.406138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:44.406055+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:44.406055+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.406055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:05:23.635609+0000","scrub_duration":0.001103677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:46.400680+0000","last_change":"2023-12-07T21:12:46.400680+0000","last_active":"2023-12-07T21:12:46.400680+0000","last_peered":"2023-12-07T21:12:46.400680+0000","last_clean":"2023-12-07T21:12:46.400680+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:12:46.400680+0000","last_undegraded":"2023-12-07T21:12:46.400680+0000","last_fullsized":"2023-12-07T21:12:46.400680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_clean_scrub_stamp":"2023-12-07T21:12:46.400562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:25.935064+0000","scrub_duration":0.001127915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:34.273474+0000","last_change":"2023-12-07T21:12:34.273474+0000","last_active":"2023-12-07T21:12:34.273474+0000","last_peered":"2023-12-07T21:12:34.273474+0000","last_clean":"2023-12-07T21:12:34.273474+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:12:34.273474+0000","last_undegraded":"2023-12-07T21:12:34.273474+0000","last_fullsized":"2023-12-07T21:12:34.273474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_clean_scrub_stamp":"2023-12-07T21:12:34.273360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:01:32.940162+0000","scrub_duration":0.0011278239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.451445+0000","last_change":"2023-12-07T21:12:52.451445+0000","last_active":"2023-12-07T21:12:52.451445+0000","last_peered":"2023-12-07T21:12:52.451445+0000","last_clean":"2023-12-07T21:12:52.451445+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:12:52.451445+0000","last_undegraded":"2023-12-07T21:12:52.451445+0000","last_fullsized":"2023-12-07T21:12:52.451445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.451316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:57.500148+0000","scrub_duration":0.001350272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.263073+0000","last_change":"2023-12-07T21:13:14.263073+0000","last_active":"2023-12-07T21:13:14.263073+0000","last_peered":"2023-12-07T21:13:14.263073+0000","last_clean":"2023-12-07T21:13:14.263073+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:13:14.263073+0000","last_undegraded":"2023-12-07T21:13:14.263073+0000","last_fullsized":"2023-12-07T21:13:14.263073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.262960+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:28.327063+0000","scrub_duration":0.0023679700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:16.262731+0000","last_change":"2023-12-07T21:13:16.262731+0000","last_active":"2023-12-07T21:13:16.262731+0000","last_peered":"2023-12-07T21:13:16.262731+0000","last_clean":"2023-12-07T21:13:16.262731+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:13:16.262731+0000","last_undegraded":"2023-12-07T21:13:16.262731+0000","last_fullsized":"2023-12-07T21:13:16.262731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_clean_scrub_stamp":"2023-12-07T21:13:16.262599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:56:19.678023+0000","scrub_duration":0.001231251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:40.827245+0000","last_change":"2023-12-07T21:12:40.827245+0000","last_active":"2023-12-07T21:12:40.827245+0000","last_peered":"2023-12-07T21:12:40.827245+0000","last_clean":"2023-12-07T21:12:40.827245+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:12:40.827245+0000","last_undegraded":"2023-12-07T21:12:40.827245+0000","last_fullsized":"2023-12-07T21:12:40.827245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_clean_scrub_stamp":"2023-12-07T21:12:40.827135+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:20.361638+0000","scrub_duration":0.0013685839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:31.449807+0000","last_change":"2023-12-07T21:13:31.449807+0000","last_active":"2023-12-07T21:13:31.449807+0000","last_peered":"2023-12-07T21:13:31.449807+0000","last_clean":"2023-12-07T21:13:31.449807+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:13:31.449807+0000","last_undegraded":"2023-12-07T21:13:31.449807+0000","last_fullsized":"2023-12-07T21:13:31.449807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:31.449683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:31.449683+0000","last_clean_scrub_stamp":"2023-12-07T21:13:31.449683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:54:42.768855+0000","scrub_duration":0.001302246,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:53.488138+0000","last_change":"2023-12-07T21:12:53.488138+0000","last_active":"2023-12-07T21:12:53.488138+0000","last_peered":"2023-12-07T21:12:53.488138+0000","last_clean":"2023-12-07T21:12:53.488138+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:12:53.488138+0000","last_undegraded":"2023-12-07T21:12:53.488138+0000","last_fullsized":"2023-12-07T21:12:53.488138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_clean_scrub_stamp":"2023-12-07T21:12:53.488022+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:20:06.706860+0000","scrub_duration":0.0010715880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.914123+0000","last_change":"2023-12-07T21:12:58.914123+0000","last_active":"2023-12-07T21:12:58.914123+0000","last_peered":"2023-12-07T21:12:58.914123+0000","last_clean":"2023-12-07T21:12:58.914123+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:12:58.914123+0000","last_undegraded":"2023-12-07T21:12:58.914123+0000","last_fullsized":"2023-12-07T21:12:58.914123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.913992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:18.497979+0000","scrub_duration":0.0013136269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.336936+0000","last_change":"2023-12-07T21:12:23.336936+0000","last_active":"2023-12-07T21:12:23.336936+0000","last_peered":"2023-12-07T21:12:23.336936+0000","last_clean":"2023-12-07T21:12:23.336936+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:12:23.336936+0000","last_undegraded":"2023-12-07T21:12:23.336936+0000","last_fullsized":"2023-12-07T21:12:23.336936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.336820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:54.775680+0000","scrub_duration":0.0015463409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812173+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:11:18.812173+0000","last_peered":"2023-12-07T21:11:18.812173+0000","last_clean":"2023-12-07T21:11:18.812173+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:11:18.812173+0000","last_undegraded":"2023-12-07T21:11:18.812173+0000","last_fullsized":"2023-12-07T21:11:18.812173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'22","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.448626+0000","last_change":"2023-12-07T21:13:44.448678+0000","last_active":"2023-12-07T21:13:44.448626+0000","last_peered":"2023-12-07T21:13:44.448626+0000","last_clean":"2023-12-07T21:13:44.448626+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:13:44.448626+0000","last_undegraded":"2023-12-07T21:13:44.448626+0000","last_fullsized":"2023-12-07T21:13:44.448626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:13:44.448523+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:13:44.448523+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.448523+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:44:57.772201+0000","scrub_duration":0.0035836259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.461414+0000","last_change":"2023-12-07T21:12:20.461414+0000","last_active":"2023-12-07T21:12:20.461414+0000","last_peered":"2023-12-07T21:12:20.461414+0000","last_clean":"2023-12-07T21:12:20.461414+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:12:20.461414+0000","last_undegraded":"2023-12-07T21:12:20.461414+0000","last_fullsized":"2023-12-07T21:12:20.461414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.461275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:11:30.745289+0000","scrub_duration":0.0012528039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812279+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:11:18.812279+0000","last_peered":"2023-12-07T21:11:18.812279+0000","last_clean":"2023-12-07T21:11:18.812279+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:11:18.812279+0000","last_undegraded":"2023-12-07T21:11:18.812279+0000","last_fullsized":"2023-12-07T21:11:18.812279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":115,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813687+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:23.813687+0000","last_peered":"2023-12-07T21:11:23.813687+0000","last_clean":"2023-12-07T21:11:23.813687+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:23.813687+0000","last_undegraded":"2023-12-07T21:11:23.813687+0000","last_fullsized":"2023-12-07T21:11:23.813687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:03.666647+0000","last_change":"2023-12-07T21:13:03.666683+0000","last_active":"2023-12-07T21:13:03.666647+0000","last_peered":"2023-12-07T21:13:03.666647+0000","last_clean":"2023-12-07T21:13:03.666647+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:13:03.666647+0000","last_undegraded":"2023-12-07T21:13:03.666647+0000","last_fullsized":"2023-12-07T21:13:03.666647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_clean_scrub_stamp":"2023-12-07T21:13:03.666541+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:29:58.918173+0000","scrub_duration":0.0039456209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.345063+0000","last_change":"2023-12-07T21:12:18.345086+0000","last_active":"2023-12-07T21:12:18.345063+0000","last_peered":"2023-12-07T21:12:18.345063+0000","last_clean":"2023-12-07T21:12:18.345063+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:12:18.345063+0000","last_undegraded":"2023-12-07T21:12:18.345063+0000","last_fullsized":"2023-12-07T21:12:18.345063+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.344968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:53:47.984483+0000","scrub_duration":0.00095218699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:26.318801+0000","last_change":"2023-12-07T21:12:26.318843+0000","last_active":"2023-12-07T21:12:26.318801+0000","last_peered":"2023-12-07T21:12:26.318801+0000","last_clean":"2023-12-07T21:12:26.318801+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:12:26.318801+0000","last_undegraded":"2023-12-07T21:12:26.318801+0000","last_fullsized":"2023-12-07T21:12:26.318801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:26.318685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:21.073203+0000","scrub_duration":0.0010887360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.618014+0000","last_change":"2023-12-07T21:13:07.618014+0000","last_active":"2023-12-07T21:13:07.618014+0000","last_peered":"2023-12-07T21:13:07.618014+0000","last_clean":"2023-12-07T21:13:07.618014+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:13:07.618014+0000","last_undegraded":"2023-12-07T21:13:07.618014+0000","last_fullsized":"2023-12-07T21:13:07.618014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.617909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:13.457658+0000","scrub_duration":0.001206459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:46.387428+0000","last_change":"2023-12-07T21:13:46.387471+0000","last_active":"2023-12-07T21:13:46.387428+0000","last_peered":"2023-12-07T21:13:46.387428+0000","last_clean":"2023-12-07T21:13:46.387428+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:13:46.387428+0000","last_undegraded":"2023-12-07T21:13:46.387428+0000","last_fullsized":"2023-12-07T21:13:46.387428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:46.387320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:46.387320+0000","last_clean_scrub_stamp":"2023-12-07T21:13:46.387320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:00.451423+0000","scrub_duration":0.0012501120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.830085+0000","last_change":"2023-12-07T21:11:53.830085+0000","last_active":"2023-12-07T21:11:53.830085+0000","last_peered":"2023-12-07T21:11:53.830085+0000","last_clean":"2023-12-07T21:11:53.830085+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:53.830085+0000","last_undegraded":"2023-12-07T21:11:53.830085+0000","last_fullsized":"2023-12-07T21:11:53.830085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_clean_scrub_stamp":"2023-12-07T21:11:53.829969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:45.205269+0000","scrub_duration":0.001216066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:11.053083+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:11.053083+0000","last_peered":"2023-12-07T21:11:11.053083+0000","last_clean":"2023-12-07T21:11:11.053083+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:11.053083+0000","last_undegraded":"2023-12-07T21:11:11.053083+0000","last_fullsized":"2023-12-07T21:11:11.053083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.304118+0000","last_change":"2023-12-07T21:11:42.304137+0000","last_active":"2023-12-07T21:11:42.304118+0000","last_peered":"2023-12-07T21:11:42.304118+0000","last_clean":"2023-12-07T21:11:42.304118+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:42.304118+0000","last_undegraded":"2023-12-07T21:11:42.304118+0000","last_fullsized":"2023-12-07T21:11:42.304118+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.304031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:14.639583+0000","scrub_duration":0.0010594929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:31.746746+0000","last_change":"2023-12-07T21:12:31.746769+0000","last_active":"2023-12-07T21:12:31.746746+0000","last_peered":"2023-12-07T21:12:31.746746+0000","last_clean":"2023-12-07T21:12:31.746746+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:12:31.746746+0000","last_undegraded":"2023-12-07T21:12:31.746746+0000","last_fullsized":"2023-12-07T21:12:31.746746+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_clean_scrub_stamp":"2023-12-07T21:12:31.746658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:02.942094+0000","scrub_duration":0.00135096,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.511164+0000","last_change":"2023-12-07T21:13:14.511164+0000","last_active":"2023-12-07T21:13:14.511164+0000","last_peered":"2023-12-07T21:13:14.511164+0000","last_clean":"2023-12-07T21:13:14.511164+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:13:14.511164+0000","last_undegraded":"2023-12-07T21:13:14.511164+0000","last_fullsized":"2023-12-07T21:13:14.511164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.511066+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:07.222427+0000","scrub_duration":0.0030400240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812011+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:11:18.812011+0000","last_peered":"2023-12-07T21:11:18.812011+0000","last_clean":"2023-12-07T21:11:18.812011+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:11:18.812011+0000","last_undegraded":"2023-12-07T21:11:18.812011+0000","last_fullsized":"2023-12-07T21:11:18.812011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.707102+0000","last_change":"2023-12-07T21:11:58.707102+0000","last_active":"2023-12-07T21:11:58.707102+0000","last_peered":"2023-12-07T21:11:58.707102+0000","last_clean":"2023-12-07T21:11:58.707102+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:58.707102+0000","last_undegraded":"2023-12-07T21:11:58.707102+0000","last_fullsized":"2023-12-07T21:11:58.707102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.706965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:56:05.594599+0000","scrub_duration":0.0011023249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.554062+0000","last_change":"2023-12-07T21:11:35.554062+0000","last_active":"2023-12-07T21:11:35.554062+0000","last_peered":"2023-12-07T21:11:35.554062+0000","last_clean":"2023-12-07T21:11:35.554062+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:35.554062+0000","last_undegraded":"2023-12-07T21:11:35.554062+0000","last_fullsized":"2023-12-07T21:11:35.554062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.553946+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:56.699897+0000","scrub_duration":0.0042775269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'247","reported_seq":323,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:50.595128+0000","last_change":"2023-12-07T21:12:50.595156+0000","last_active":"2023-12-07T21:12:50.595128+0000","last_peered":"2023-12-07T21:12:50.595128+0000","last_clean":"2023-12-07T21:12:50.595128+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:12:50.595128+0000","last_undegraded":"2023-12-07T21:12:50.595128+0000","last_fullsized":"2023-12-07T21:12:50.595128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_clean_scrub_stamp":"2023-12-07T21:12:50.595047+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:57:35.203698+0000","scrub_duration":0.0029719099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188448+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:11:10.188448+0000","last_peered":"2023-12-07T21:11:10.188448+0000","last_clean":"2023-12-07T21:11:10.188448+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:11:10.188448+0000","last_undegraded":"2023-12-07T21:11:10.188448+0000","last_fullsized":"2023-12-07T21:11:10.188448+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.764650+0000","last_change":"2023-12-07T21:12:27.764650+0000","last_active":"2023-12-07T21:12:27.764650+0000","last_peered":"2023-12-07T21:12:27.764650+0000","last_clean":"2023-12-07T21:12:27.764650+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:12:27.764650+0000","last_undegraded":"2023-12-07T21:12:27.764650+0000","last_fullsized":"2023-12-07T21:12:27.764650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.764507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:17:01.731572+0000","scrub_duration":0.0015146649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.348644+0000","last_change":"2023-12-07T21:13:00.348644+0000","last_active":"2023-12-07T21:13:00.348644+0000","last_peered":"2023-12-07T21:13:00.348644+0000","last_clean":"2023-12-07T21:13:00.348644+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:13:00.348644+0000","last_undegraded":"2023-12-07T21:13:00.348644+0000","last_fullsized":"2023-12-07T21:13:00.348644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.348476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:10.632490+0000","scrub_duration":0.001405367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813847+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:23.813847+0000","last_peered":"2023-12-07T21:11:23.813847+0000","last_clean":"2023-12-07T21:11:23.813847+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:23.813847+0000","last_undegraded":"2023-12-07T21:11:23.813847+0000","last_fullsized":"2023-12-07T21:11:23.813847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:29.600052+0000","last_change":"2023-12-07T21:11:29.600086+0000","last_active":"2023-12-07T21:11:29.600052+0000","last_peered":"2023-12-07T21:11:29.600052+0000","last_clean":"2023-12-07T21:11:29.600052+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:29.600052+0000","last_undegraded":"2023-12-07T21:11:29.600052+0000","last_fullsized":"2023-12-07T21:11:29.600052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_clean_scrub_stamp":"2023-12-07T21:11:29.599963+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:30:03.772118+0000","scrub_duration":0.003554771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'247","reported_seq":341,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:02.790465+0000","last_change":"2023-12-07T21:12:02.790465+0000","last_active":"2023-12-07T21:12:02.790465+0000","last_peered":"2023-12-07T21:12:02.790465+0000","last_clean":"2023-12-07T21:12:02.790465+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:12:02.790465+0000","last_undegraded":"2023-12-07T21:12:02.790465+0000","last_fullsized":"2023-12-07T21:12:02.790465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_clean_scrub_stamp":"2023-12-07T21:12:02.790346+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:07.839178+0000","scrub_duration":0.0026089529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608027+0000","last_change":"2023-12-07T21:08:56.889614+0000","last_active":"2023-12-07T21:11:10.608027+0000","last_peered":"2023-12-07T21:11:10.608027+0000","last_clean":"2023-12-07T21:11:10.608027+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:11:10.608027+0000","last_undegraded":"2023-12-07T21:11:10.608027+0000","last_fullsized":"2023-12-07T21:11:10.608027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.293568+0000","last_change":"2023-12-07T21:13:36.293592+0000","last_active":"2023-12-07T21:13:36.293568+0000","last_peered":"2023-12-07T21:13:36.293568+0000","last_clean":"2023-12-07T21:13:36.293568+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:13:36.293568+0000","last_undegraded":"2023-12-07T21:13:36.293568+0000","last_fullsized":"2023-12-07T21:13:36.293568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:36.293469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:36.293469+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.293469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:55.877457+0000","scrub_duration":0.0012759609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.443153+0000","last_change":"2023-12-07T21:11:56.443153+0000","last_active":"2023-12-07T21:11:56.443153+0000","last_peered":"2023-12-07T21:11:56.443153+0000","last_clean":"2023-12-07T21:11:56.443153+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:56.443153+0000","last_undegraded":"2023-12-07T21:11:56.443153+0000","last_fullsized":"2023-12-07T21:11:56.443153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.443045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:05.069384+0000","scrub_duration":0.0010685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.606842+0000","last_change":"2023-12-07T21:11:39.606842+0000","last_active":"2023-12-07T21:11:39.606842+0000","last_peered":"2023-12-07T21:11:39.606842+0000","last_clean":"2023-12-07T21:11:39.606842+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:39.606842+0000","last_undegraded":"2023-12-07T21:11:39.606842+0000","last_fullsized":"2023-12-07T21:11:39.606842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.606684+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:36.950556+0000","scrub_duration":0.0069737849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:34.781711+0000","last_change":"2023-12-07T21:11:34.781711+0000","last_active":"2023-12-07T21:11:34.781711+0000","last_peered":"2023-12-07T21:11:34.781711+0000","last_clean":"2023-12-07T21:11:34.781711+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:34.781711+0000","last_undegraded":"2023-12-07T21:11:34.781711+0000","last_fullsized":"2023-12-07T21:11:34.781711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:34.781604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:44.478780+0000","scrub_duration":0.001255822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.810015+0000","last_change":"2023-12-07T21:09:04.931164+0000","last_active":"2023-12-07T21:11:13.810015+0000","last_peered":"2023-12-07T21:11:13.810015+0000","last_clean":"2023-12-07T21:11:13.810015+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:11:13.810015+0000","last_undegraded":"2023-12-07T21:11:13.810015+0000","last_fullsized":"2023-12-07T21:11:13.810015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'22","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.326862+0000","last_change":"2023-12-07T21:12:36.326862+0000","last_active":"2023-12-07T21:12:36.326862+0000","last_peered":"2023-12-07T21:12:36.326862+0000","last_clean":"2023-12-07T21:12:36.326862+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:12:36.326862+0000","last_undegraded":"2023-12-07T21:12:36.326862+0000","last_fullsized":"2023-12-07T21:12:36.326862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.326694+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:24:30.282151+0000","scrub_duration":0.0028268410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.338776+0000","last_change":"2023-12-07T21:13:06.338776+0000","last_active":"2023-12-07T21:13:06.338776+0000","last_peered":"2023-12-07T21:13:06.338776+0000","last_clean":"2023-12-07T21:13:06.338776+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:13:06.338776+0000","last_undegraded":"2023-12-07T21:13:06.338776+0000","last_fullsized":"2023-12-07T21:13:06.338776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.338641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:59:17.495976+0000","scrub_duration":0.001242176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:07.717459+0000","last_change":"2023-12-07T21:12:07.717459+0000","last_active":"2023-12-07T21:12:07.717459+0000","last_peered":"2023-12-07T21:12:07.717459+0000","last_clean":"2023-12-07T21:12:07.717459+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:12:07.717459+0000","last_undegraded":"2023-12-07T21:12:07.717459+0000","last_fullsized":"2023-12-07T21:12:07.717459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_clean_scrub_stamp":"2023-12-07T21:12:07.717342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:32.009926+0000","scrub_duration":0.0014039289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:09.439747+0000","last_change":"2023-12-07T21:12:09.439747+0000","last_active":"2023-12-07T21:12:09.439747+0000","last_peered":"2023-12-07T21:12:09.439747+0000","last_clean":"2023-12-07T21:12:09.439747+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:12:09.439747+0000","last_undegraded":"2023-12-07T21:12:09.439747+0000","last_fullsized":"2023-12-07T21:12:09.439747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_clean_scrub_stamp":"2023-12-07T21:12:09.439641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:19.195035+0000","scrub_duration":0.0043223589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.735466+0000","last_change":"2023-12-07T21:11:33.735466+0000","last_active":"2023-12-07T21:11:33.735466+0000","last_peered":"2023-12-07T21:11:33.735466+0000","last_clean":"2023-12-07T21:11:33.735466+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:33.735466+0000","last_undegraded":"2023-12-07T21:11:33.735466+0000","last_fullsized":"2023-12-07T21:11:33.735466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.735352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:03.972116+0000","scrub_duration":0.0011441929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.810257+0000","last_change":"2023-12-07T21:09:04.926042+0000","last_active":"2023-12-07T21:11:13.810257+0000","last_peered":"2023-12-07T21:11:13.810257+0000","last_clean":"2023-12-07T21:11:13.810257+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:11:13.810257+0000","last_undegraded":"2023-12-07T21:11:13.810257+0000","last_fullsized":"2023-12-07T21:11:13.810257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.429281+0000","last_change":"2023-12-07T21:12:36.429281+0000","last_active":"2023-12-07T21:12:36.429281+0000","last_peered":"2023-12-07T21:12:36.429281+0000","last_clean":"2023-12-07T21:12:36.429281+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:12:36.429281+0000","last_undegraded":"2023-12-07T21:12:36.429281+0000","last_fullsized":"2023-12-07T21:12:36.429281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.429148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:19.936617+0000","scrub_duration":0.001111988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.811064+0000","last_change":"2023-12-07T21:08:54.876336+0000","last_active":"2023-12-07T21:11:13.811064+0000","last_peered":"2023-12-07T21:11:13.811064+0000","last_clean":"2023-12-07T21:11:13.811064+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:11:13.811064+0000","last_undegraded":"2023-12-07T21:11:13.811064+0000","last_fullsized":"2023-12-07T21:11:13.811064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.810375+0000","last_change":"2023-12-07T21:12:15.810375+0000","last_active":"2023-12-07T21:12:15.810375+0000","last_peered":"2023-12-07T21:12:15.810375+0000","last_clean":"2023-12-07T21:12:15.810375+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:12:15.810375+0000","last_undegraded":"2023-12-07T21:12:15.810375+0000","last_fullsized":"2023-12-07T21:12:15.810375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.810269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:33.566530+0000","scrub_duration":0.0014408579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.522112+0000","last_change":"2023-12-07T21:11:50.522112+0000","last_active":"2023-12-07T21:11:50.522112+0000","last_peered":"2023-12-07T21:11:50.522112+0000","last_clean":"2023-12-07T21:11:50.522112+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:50.522112+0000","last_undegraded":"2023-12-07T21:11:50.522112+0000","last_fullsized":"2023-12-07T21:11:50.522112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.521955+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:04.827943+0000","scrub_duration":0.0073561030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":308,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.761887+0000","last_change":"2023-12-07T21:11:35.761887+0000","last_active":"2023-12-07T21:11:35.761887+0000","last_peered":"2023-12-07T21:11:35.761887+0000","last_clean":"2023-12-07T21:11:35.761887+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:35.761887+0000","last_undegraded":"2023-12-07T21:11:35.761887+0000","last_fullsized":"2023-12-07T21:11:35.761887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.761766+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:14.383149+0000","scrub_duration":0.0016151640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.804846+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:11:18.804846+0000","last_peered":"2023-12-07T21:11:18.804846+0000","last_clean":"2023-12-07T21:11:18.804846+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:11:18.804846+0000","last_undegraded":"2023-12-07T21:11:18.804846+0000","last_fullsized":"2023-12-07T21:11:18.804846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:55.462356+0000","last_change":"2023-12-07T21:12:55.462356+0000","last_active":"2023-12-07T21:12:55.462356+0000","last_peered":"2023-12-07T21:12:55.462356+0000","last_clean":"2023-12-07T21:12:55.462356+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:12:55.462356+0000","last_undegraded":"2023-12-07T21:12:55.462356+0000","last_fullsized":"2023-12-07T21:12:55.462356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_clean_scrub_stamp":"2023-12-07T21:12:55.462251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:57:45.150167+0000","scrub_duration":0.0012320580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.810880+0000","last_change":"2023-12-07T21:08:54.884313+0000","last_active":"2023-12-07T21:11:13.810880+0000","last_peered":"2023-12-07T21:11:13.810880+0000","last_clean":"2023-12-07T21:11:13.810880+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:11:13.810880+0000","last_undegraded":"2023-12-07T21:11:13.810880+0000","last_fullsized":"2023-12-07T21:11:13.810880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.753724+0000","last_change":"2023-12-07T21:11:55.753724+0000","last_active":"2023-12-07T21:11:55.753724+0000","last_peered":"2023-12-07T21:11:55.753724+0000","last_clean":"2023-12-07T21:11:55.753724+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:55.753724+0000","last_undegraded":"2023-12-07T21:11:55.753724+0000","last_fullsized":"2023-12-07T21:11:55.753724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.753576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:53:37.572475+0000","scrub_duration":0.0013913199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:31.726564+0000","last_change":"2023-12-07T21:11:31.726564+0000","last_active":"2023-12-07T21:11:31.726564+0000","last_peered":"2023-12-07T21:11:31.726564+0000","last_clean":"2023-12-07T21:11:31.726564+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:31.726564+0000","last_undegraded":"2023-12-07T21:11:31.726564+0000","last_fullsized":"2023-12-07T21:11:31.726564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:31.726451+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:36.775283+0000","scrub_duration":0.0038601009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.752564+0000","last_change":"2023-12-07T21:11:56.752564+0000","last_active":"2023-12-07T21:11:56.752564+0000","last_peered":"2023-12-07T21:11:56.752564+0000","last_clean":"2023-12-07T21:11:56.752564+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:56.752564+0000","last_undegraded":"2023-12-07T21:11:56.752564+0000","last_fullsized":"2023-12-07T21:11:56.752564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.752450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:44.261937+0000","scrub_duration":0.0012919610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.804944+0000","last_change":"2023-12-07T21:09:04.931858+0000","last_active":"2023-12-07T21:11:18.804944+0000","last_peered":"2023-12-07T21:11:18.804944+0000","last_clean":"2023-12-07T21:11:18.804944+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:11:18.804944+0000","last_undegraded":"2023-12-07T21:11:18.804944+0000","last_fullsized":"2023-12-07T21:11:18.804944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187760+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:11:10.187760+0000","last_peered":"2023-12-07T21:11:10.187760+0000","last_clean":"2023-12-07T21:11:10.187760+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:11:10.187760+0000","last_undegraded":"2023-12-07T21:11:10.187760+0000","last_fullsized":"2023-12-07T21:11:10.187760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.803596+0000","last_change":"2023-12-07T21:08:54.874233+0000","last_active":"2023-12-07T21:11:13.803596+0000","last_peered":"2023-12-07T21:11:13.803596+0000","last_clean":"2023-12-07T21:11:13.803596+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:11:13.803596+0000","last_undegraded":"2023-12-07T21:11:13.803596+0000","last_fullsized":"2023-12-07T21:11:13.803596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.578121+0000","last_change":"2023-12-07T21:12:12.578121+0000","last_active":"2023-12-07T21:12:12.578121+0000","last_peered":"2023-12-07T21:12:12.578121+0000","last_clean":"2023-12-07T21:12:12.578121+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:12:12.578121+0000","last_undegraded":"2023-12-07T21:12:12.578121+0000","last_fullsized":"2023-12-07T21:12:12.578121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.578001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:21:04.951547+0000","scrub_duration":0.0009980639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.222572+0000","last_change":"2023-12-07T21:11:32.222572+0000","last_active":"2023-12-07T21:11:32.222572+0000","last_peered":"2023-12-07T21:11:32.222572+0000","last_clean":"2023-12-07T21:11:32.222572+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:32.222572+0000","last_undegraded":"2023-12-07T21:11:32.222572+0000","last_fullsized":"2023-12-07T21:11:32.222572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.222451+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:29.566323+0000","scrub_duration":0.0042948600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:25.579998+0000","last_change":"2023-12-07T21:13:25.579998+0000","last_active":"2023-12-07T21:13:25.579998+0000","last_peered":"2023-12-07T21:13:25.579998+0000","last_clean":"2023-12-07T21:13:25.579998+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:13:25.579998+0000","last_undegraded":"2023-12-07T21:13:25.579998+0000","last_fullsized":"2023-12-07T21:13:25.579998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_clean_scrub_stamp":"2023-12-07T21:13:25.579880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:22:49.341694+0000","scrub_duration":0.001424259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608819+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:11:10.608819+0000","last_peered":"2023-12-07T21:11:10.608819+0000","last_clean":"2023-12-07T21:11:10.608819+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:11:10.608819+0000","last_undegraded":"2023-12-07T21:11:10.608819+0000","last_fullsized":"2023-12-07T21:11:10.608819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.187764+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:11:10.187764+0000","last_peered":"2023-12-07T21:11:10.187764+0000","last_clean":"2023-12-07T21:11:10.187764+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:11:10.187764+0000","last_undegraded":"2023-12-07T21:11:10.187764+0000","last_fullsized":"2023-12-07T21:11:10.187764+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607638+0000","last_change":"2023-12-07T21:08:54.875744+0000","last_active":"2023-12-07T21:11:10.607638+0000","last_peered":"2023-12-07T21:11:10.607638+0000","last_clean":"2023-12-07T21:11:10.607638+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:11:10.607638+0000","last_undegraded":"2023-12-07T21:11:10.607638+0000","last_fullsized":"2023-12-07T21:11:10.607638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:54.784564+0000","last_change":"2023-12-07T21:11:54.784564+0000","last_active":"2023-12-07T21:11:54.784564+0000","last_peered":"2023-12-07T21:11:54.784564+0000","last_clean":"2023-12-07T21:11:54.784564+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:54.784564+0000","last_undegraded":"2023-12-07T21:11:54.784564+0000","last_fullsized":"2023-12-07T21:11:54.784564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_clean_scrub_stamp":"2023-12-07T21:11:54.784441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:06.366596+0000","scrub_duration":0.001044002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.576788+0000","last_change":"2023-12-07T21:11:38.576788+0000","last_active":"2023-12-07T21:11:38.576788+0000","last_peered":"2023-12-07T21:11:38.576788+0000","last_clean":"2023-12-07T21:11:38.576788+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:38.576788+0000","last_undegraded":"2023-12-07T21:11:38.576788+0000","last_fullsized":"2023-12-07T21:11:38.576788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.576637+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:37:48.632379+0000","scrub_duration":0.0068514220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":337,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625046+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625046+0000","last_peered":"2023-12-07T21:11:28.625046+0000","last_clean":"2023-12-07T21:11:28.625046+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625046+0000","last_undegraded":"2023-12-07T21:11:28.625046+0000","last_fullsized":"2023-12-07T21:11:28.625046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.858711+0000","last_change":"2023-12-07T21:12:16.858711+0000","last_active":"2023-12-07T21:12:16.858711+0000","last_peered":"2023-12-07T21:12:16.858711+0000","last_clean":"2023-12-07T21:12:16.858711+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:12:16.858711+0000","last_undegraded":"2023-12-07T21:12:16.858711+0000","last_fullsized":"2023-12-07T21:12:16.858711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.858602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:29:51.847246+0000","scrub_duration":0.0011473449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.447750+0000","last_change":"2023-12-07T21:13:23.447750+0000","last_active":"2023-12-07T21:13:23.447750+0000","last_peered":"2023-12-07T21:13:23.447750+0000","last_clean":"2023-12-07T21:13:23.447750+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:13:23.447750+0000","last_undegraded":"2023-12-07T21:13:23.447750+0000","last_fullsized":"2023-12-07T21:13:23.447750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.447646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:28:02.982148+0000","scrub_duration":0.0010737139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607531+0000","last_change":"2023-12-07T21:08:54.883083+0000","last_active":"2023-12-07T21:11:10.607531+0000","last_peered":"2023-12-07T21:11:10.607531+0000","last_clean":"2023-12-07T21:11:10.607531+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:11:10.607531+0000","last_undegraded":"2023-12-07T21:11:10.607531+0000","last_fullsized":"2023-12-07T21:11:10.607531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.296697+0000","last_change":"2023-12-07T21:11:38.296697+0000","last_active":"2023-12-07T21:11:38.296697+0000","last_peered":"2023-12-07T21:11:38.296697+0000","last_clean":"2023-12-07T21:11:38.296697+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:38.296697+0000","last_undegraded":"2023-12-07T21:11:38.296697+0000","last_fullsized":"2023-12-07T21:11:38.296697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.296568+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:08.533333+0000","scrub_duration":0.0033144630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.654323+0000","last_change":"2023-12-07T21:13:04.654323+0000","last_active":"2023-12-07T21:13:04.654323+0000","last_peered":"2023-12-07T21:13:04.654323+0000","last_clean":"2023-12-07T21:13:04.654323+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:13:04.654323+0000","last_undegraded":"2023-12-07T21:13:04.654323+0000","last_fullsized":"2023-12-07T21:13:04.654323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.654200+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:02:30.647135+0000","scrub_duration":0.0041448730000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'247","reported_seq":373,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:47.359735+0000","last_change":"2023-12-07T21:11:47.359735+0000","last_active":"2023-12-07T21:11:47.359735+0000","last_peered":"2023-12-07T21:11:47.359735+0000","last_clean":"2023-12-07T21:11:47.359735+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:47.359735+0000","last_undegraded":"2023-12-07T21:11:47.359735+0000","last_fullsized":"2023-12-07T21:11:47.359735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_clean_scrub_stamp":"2023-12-07T21:11:47.359610+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:10.050726+0000","scrub_duration":0.0028663759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.579785+0000","last_change":"2023-12-07T21:12:14.579785+0000","last_active":"2023-12-07T21:12:14.579785+0000","last_peered":"2023-12-07T21:12:14.579785+0000","last_clean":"2023-12-07T21:12:14.579785+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:12:14.579785+0000","last_undegraded":"2023-12-07T21:12:14.579785+0000","last_fullsized":"2023-12-07T21:12:14.579785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.579627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:44.957962+0000","scrub_duration":0.0013656510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.375184+0000","last_change":"2023-12-07T21:12:17.375184+0000","last_active":"2023-12-07T21:12:17.375184+0000","last_peered":"2023-12-07T21:12:17.375184+0000","last_clean":"2023-12-07T21:12:17.375184+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:12:17.375184+0000","last_undegraded":"2023-12-07T21:12:17.375184+0000","last_fullsized":"2023-12-07T21:12:17.375184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.375067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:21:31.008297+0000","scrub_duration":0.001068486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607511+0000","last_change":"2023-12-07T21:08:54.882764+0000","last_active":"2023-12-07T21:11:10.607511+0000","last_peered":"2023-12-07T21:11:10.607511+0000","last_clean":"2023-12-07T21:11:10.607511+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:11:10.607511+0000","last_undegraded":"2023-12-07T21:11:10.607511+0000","last_fullsized":"2023-12-07T21:11:10.607511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.847914+0000","last_change":"2023-12-07T21:11:28.847914+0000","last_active":"2023-12-07T21:11:28.847914+0000","last_peered":"2023-12-07T21:11:28.847914+0000","last_clean":"2023-12-07T21:11:28.847914+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:28.847914+0000","last_undegraded":"2023-12-07T21:11:28.847914+0000","last_fullsized":"2023-12-07T21:11:28.847914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.847797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:20:42.481026+0000","scrub_duration":0.001132973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262786+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262786+0000","last_peered":"2023-12-07T21:11:27.262786+0000","last_clean":"2023-12-07T21:11:27.262786+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262786+0000","last_undegraded":"2023-12-07T21:11:27.262786+0000","last_fullsized":"2023-12-07T21:11:27.262786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811401+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:18.811401+0000","last_peered":"2023-12-07T21:11:18.811401+0000","last_clean":"2023-12-07T21:11:18.811401+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:18.811401+0000","last_undegraded":"2023-12-07T21:11:18.811401+0000","last_fullsized":"2023-12-07T21:11:18.811401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:42.422577+0000","last_change":"2023-12-07T21:13:42.422626+0000","last_active":"2023-12-07T21:13:42.422577+0000","last_peered":"2023-12-07T21:13:42.422577+0000","last_clean":"2023-12-07T21:13:42.422577+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:13:42.422577+0000","last_undegraded":"2023-12-07T21:13:42.422577+0000","last_fullsized":"2023-12-07T21:13:42.422577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:42.422461+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:42.422461+0000","last_clean_scrub_stamp":"2023-12-07T21:13:42.422461+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:15.762102+0000","scrub_duration":0.0036148259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:08.448223+0000","last_change":"2023-12-07T21:12:08.448223+0000","last_active":"2023-12-07T21:12:08.448223+0000","last_peered":"2023-12-07T21:12:08.448223+0000","last_clean":"2023-12-07T21:12:08.448223+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:12:08.448223+0000","last_undegraded":"2023-12-07T21:12:08.448223+0000","last_fullsized":"2023-12-07T21:12:08.448223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_clean_scrub_stamp":"2023-12-07T21:12:08.448115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:53:48.563995+0000","scrub_duration":0.001037821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:18.321344+0000","last_change":"2023-12-07T21:13:18.321375+0000","last_active":"2023-12-07T21:13:18.321344+0000","last_peered":"2023-12-07T21:13:18.321344+0000","last_clean":"2023-12-07T21:13:18.321344+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:13:18.321344+0000","last_undegraded":"2023-12-07T21:13:18.321344+0000","last_fullsized":"2023-12-07T21:13:18.321344+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_clean_scrub_stamp":"2023-12-07T21:13:18.321258+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:57.708960+0000","scrub_duration":0.0041701730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607432+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:11:10.607432+0000","last_peered":"2023-12-07T21:11:10.607432+0000","last_clean":"2023-12-07T21:11:10.607432+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:11:10.607432+0000","last_undegraded":"2023-12-07T21:11:10.607432+0000","last_fullsized":"2023-12-07T21:11:10.607432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607484+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:11:10.607484+0000","last_peered":"2023-12-07T21:11:10.607484+0000","last_clean":"2023-12-07T21:11:10.607484+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:11:10.607484+0000","last_undegraded":"2023-12-07T21:11:10.607484+0000","last_fullsized":"2023-12-07T21:11:10.607484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.324752+0000","last_change":"2023-12-07T21:11:45.324752+0000","last_active":"2023-12-07T21:11:45.324752+0000","last_peered":"2023-12-07T21:11:45.324752+0000","last_clean":"2023-12-07T21:11:45.324752+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:11:45.324752+0000","last_undegraded":"2023-12-07T21:11:45.324752+0000","last_fullsized":"2023-12-07T21:11:45.324752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.324596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:15.702930+0000","scrub_duration":0.001375037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'84","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.623237+0000","last_change":"2023-12-07T21:12:52.623237+0000","last_active":"2023-12-07T21:12:52.623237+0000","last_peered":"2023-12-07T21:12:52.623237+0000","last_clean":"2023-12-07T21:12:52.623237+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:12:52.623237+0000","last_undegraded":"2023-12-07T21:12:52.623237+0000","last_fullsized":"2023-12-07T21:12:52.623237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'84","last_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_deep_scrub":"33'84","last_deep_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.623072+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:11.772666+0000","scrub_duration":0.0042302950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.743712+0000","last_change":"2023-12-07T21:11:42.743712+0000","last_active":"2023-12-07T21:11:42.743712+0000","last_peered":"2023-12-07T21:11:42.743712+0000","last_clean":"2023-12-07T21:11:42.743712+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:42.743712+0000","last_undegraded":"2023-12-07T21:11:42.743712+0000","last_fullsized":"2023-12-07T21:11:42.743712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.743604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:58.016229+0000","scrub_duration":0.001386167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.433682+0000","last_change":"2023-12-07T21:11:58.433682+0000","last_active":"2023-12-07T21:11:58.433682+0000","last_peered":"2023-12-07T21:11:58.433682+0000","last_clean":"2023-12-07T21:11:58.433682+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:58.433682+0000","last_undegraded":"2023-12-07T21:11:58.433682+0000","last_fullsized":"2023-12-07T21:11:58.433682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.433567+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:08.130743+0000","scrub_duration":0.0014101739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:37.409865+0000","last_change":"2023-12-07T21:13:37.409909+0000","last_active":"2023-12-07T21:13:37.409865+0000","last_peered":"2023-12-07T21:13:37.409865+0000","last_clean":"2023-12-07T21:13:37.409865+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:13:37.409865+0000","last_undegraded":"2023-12-07T21:13:37.409865+0000","last_fullsized":"2023-12-07T21:13:37.409865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:37.409759+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:37.409759+0000","last_clean_scrub_stamp":"2023-12-07T21:13:37.409759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:10.604294+0000","scrub_duration":0.001212444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607424+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:11:10.607424+0000","last_peered":"2023-12-07T21:11:10.607424+0000","last_clean":"2023-12-07T21:11:10.607424+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:11:10.607424+0000","last_undegraded":"2023-12-07T21:11:10.607424+0000","last_fullsized":"2023-12-07T21:11:10.607424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345059+0000","last_change":"2023-12-07T21:08:54.880261+0000","last_active":"2023-12-07T21:11:09.345059+0000","last_peered":"2023-12-07T21:11:09.345059+0000","last_clean":"2023-12-07T21:11:09.345059+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:11:09.345059+0000","last_undegraded":"2023-12-07T21:11:09.345059+0000","last_fullsized":"2023-12-07T21:11:09.345059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.687480+0000","last_change":"2023-12-07T21:11:32.687480+0000","last_active":"2023-12-07T21:11:32.687480+0000","last_peered":"2023-12-07T21:11:32.687480+0000","last_clean":"2023-12-07T21:11:32.687480+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:32.687480+0000","last_undegraded":"2023-12-07T21:11:32.687480+0000","last_fullsized":"2023-12-07T21:11:32.687480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.687375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:18:45.906213+0000","scrub_duration":0.001283024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":451,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148420+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148420+0000","last_peered":"2023-12-07T21:11:18.148420+0000","last_clean":"2023-12-07T21:11:18.148420+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148420+0000","last_undegraded":"2023-12-07T21:11:18.148420+0000","last_fullsized":"2023-12-07T21:11:18.148420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:25.481161+0000","last_change":"2023-12-07T21:12:25.481161+0000","last_active":"2023-12-07T21:12:25.481161+0000","last_peered":"2023-12-07T21:12:25.481161+0000","last_clean":"2023-12-07T21:12:25.481161+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:12:25.481161+0000","last_undegraded":"2023-12-07T21:12:25.481161+0000","last_fullsized":"2023-12-07T21:12:25.481161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_clean_scrub_stamp":"2023-12-07T21:12:25.481005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:33:44.071058+0000","scrub_duration":0.001267064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811322+0000","last_change":"2023-12-07T21:09:04.926286+0000","last_active":"2023-12-07T21:11:18.811322+0000","last_peered":"2023-12-07T21:11:18.811322+0000","last_clean":"2023-12-07T21:11:18.811322+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:11:18.811322+0000","last_undegraded":"2023-12-07T21:11:18.811322+0000","last_fullsized":"2023-12-07T21:11:18.811322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.103368+0000","last_change":"2023-12-07T21:13:27.103392+0000","last_active":"2023-12-07T21:13:27.103368+0000","last_peered":"2023-12-07T21:13:27.103368+0000","last_clean":"2023-12-07T21:13:27.103368+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:13:27.103368+0000","last_undegraded":"2023-12-07T21:13:27.103368+0000","last_fullsized":"2023-12-07T21:13:27.103368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:04.121495+0000","scrub_duration":0.0012535599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:33.338278+0000","last_change":"2023-12-07T21:13:33.338298+0000","last_active":"2023-12-07T21:13:33.338278+0000","last_peered":"2023-12-07T21:13:33.338278+0000","last_clean":"2023-12-07T21:13:33.338278+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:13:33.338278+0000","last_undegraded":"2023-12-07T21:13:33.338278+0000","last_fullsized":"2023-12-07T21:13:33.338278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:33.338194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:33.338194+0000","last_clean_scrub_stamp":"2023-12-07T21:13:33.338194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:43.622208+0000","scrub_duration":0.001353496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:37.050040+0000","last_change":"2023-12-07T21:13:37.050079+0000","last_active":"2023-12-07T21:13:37.050040+0000","last_peered":"2023-12-07T21:13:37.050040+0000","last_clean":"2023-12-07T21:13:37.050040+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:13:37.050040+0000","last_undegraded":"2023-12-07T21:13:37.050040+0000","last_fullsized":"2023-12-07T21:13:37.050040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:37.049937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:37.049937+0000","last_clean_scrub_stamp":"2023-12-07T21:13:37.049937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:03:03.042871+0000","scrub_duration":0.0012947099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.627991+0000","last_change":"2023-12-07T21:12:15.627991+0000","last_active":"2023-12-07T21:12:15.627991+0000","last_peered":"2023-12-07T21:12:15.627991+0000","last_clean":"2023-12-07T21:12:15.627991+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:12:15.627991+0000","last_undegraded":"2023-12-07T21:12:15.627991+0000","last_fullsized":"2023-12-07T21:12:15.627991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.627865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:38.318981+0000","scrub_duration":0.0028926030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'25","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:46.537922+0000","last_change":"2023-12-07T21:11:46.537922+0000","last_active":"2023-12-07T21:11:46.537922+0000","last_peered":"2023-12-07T21:11:46.537922+0000","last_clean":"2023-12-07T21:11:46.537922+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:46.537922+0000","last_undegraded":"2023-12-07T21:11:46.537922+0000","last_fullsized":"2023-12-07T21:11:46.537922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_clean_scrub_stamp":"2023-12-07T21:11:46.537795+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:57.338431+0000","scrub_duration":0.0057357379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642698+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642698+0000","last_peered":"2023-12-07T21:11:12.642698+0000","last_clean":"2023-12-07T21:11:12.642698+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642698+0000","last_undegraded":"2023-12-07T21:11:12.642698+0000","last_fullsized":"2023-12-07T21:11:12.642698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813540+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:11:23.813540+0000","last_peered":"2023-12-07T21:11:23.813540+0000","last_clean":"2023-12-07T21:11:23.813540+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:11:23.813540+0000","last_undegraded":"2023-12-07T21:11:23.813540+0000","last_fullsized":"2023-12-07T21:11:23.813540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.097020+0000","last_change":"2023-12-07T21:13:20.097065+0000","last_active":"2023-12-07T21:13:20.097020+0000","last_peered":"2023-12-07T21:13:20.097020+0000","last_clean":"2023-12-07T21:13:20.097020+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:13:20.097020+0000","last_undegraded":"2023-12-07T21:13:20.097020+0000","last_fullsized":"2023-12-07T21:13:20.097020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.096899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.485657+0000","scrub_duration":0.001542213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607422+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:11:10.607422+0000","last_peered":"2023-12-07T21:11:10.607422+0000","last_clean":"2023-12-07T21:11:10.607422+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:11:10.607422+0000","last_undegraded":"2023-12-07T21:11:10.607422+0000","last_fullsized":"2023-12-07T21:11:10.607422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.309172+0000","last_change":"2023-12-07T21:13:38.309196+0000","last_active":"2023-12-07T21:13:38.309172+0000","last_peered":"2023-12-07T21:13:38.309172+0000","last_clean":"2023-12-07T21:13:38.309172+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:13:38.309172+0000","last_undegraded":"2023-12-07T21:13:38.309172+0000","last_fullsized":"2023-12-07T21:13:38.309172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:38.309082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:38.309082+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.309082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:56.899135+0000","scrub_duration":0.0011541360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:57.727223+0000","last_change":"2023-12-07T21:11:57.727223+0000","last_active":"2023-12-07T21:11:57.727223+0000","last_peered":"2023-12-07T21:11:57.727223+0000","last_clean":"2023-12-07T21:11:57.727223+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:11:57.727223+0000","last_undegraded":"2023-12-07T21:11:57.727223+0000","last_fullsized":"2023-12-07T21:11:57.727223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_clean_scrub_stamp":"2023-12-07T21:11:57.727085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:53.015740+0000","scrub_duration":0.0013430639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.630855+0000","last_change":"2023-12-07T21:12:49.630855+0000","last_active":"2023-12-07T21:12:49.630855+0000","last_peered":"2023-12-07T21:12:49.630855+0000","last_clean":"2023-12-07T21:12:49.630855+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:12:49.630855+0000","last_undegraded":"2023-12-07T21:12:49.630855+0000","last_fullsized":"2023-12-07T21:12:49.630855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.630741+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:01.513069+0000","scrub_duration":0.0051886659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:30.531782+0000","last_change":"2023-12-07T21:13:30.531836+0000","last_active":"2023-12-07T21:13:30.531782+0000","last_peered":"2023-12-07T21:13:30.531782+0000","last_clean":"2023-12-07T21:13:30.531782+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:13:30.531782+0000","last_undegraded":"2023-12-07T21:13:30.531782+0000","last_fullsized":"2023-12-07T21:13:30.531782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:30.531646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:30.531646+0000","last_clean_scrub_stamp":"2023-12-07T21:13:30.531646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:08:23.567547+0000","scrub_duration":0.001461323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811119+0000","last_change":"2023-12-07T21:09:04.932313+0000","last_active":"2023-12-07T21:11:18.811119+0000","last_peered":"2023-12-07T21:11:18.811119+0000","last_clean":"2023-12-07T21:11:18.811119+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:11:18.811119+0000","last_undegraded":"2023-12-07T21:11:18.811119+0000","last_fullsized":"2023-12-07T21:11:18.811119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:10.299642+0000","last_change":"2023-12-07T21:13:10.299666+0000","last_active":"2023-12-07T21:13:10.299642+0000","last_peered":"2023-12-07T21:13:10.299642+0000","last_clean":"2023-12-07T21:13:10.299642+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:13:10.299642+0000","last_undegraded":"2023-12-07T21:13:10.299642+0000","last_fullsized":"2023-12-07T21:13:10.299642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_clean_scrub_stamp":"2023-12-07T21:13:10.299548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:18:32.210130+0000","scrub_duration":0.00096658499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:45.355307+0000","last_change":"2023-12-07T21:13:45.355332+0000","last_active":"2023-12-07T21:13:45.355307+0000","last_peered":"2023-12-07T21:13:45.355307+0000","last_clean":"2023-12-07T21:13:45.355307+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:13:45.355307+0000","last_undegraded":"2023-12-07T21:13:45.355307+0000","last_fullsized":"2023-12-07T21:13:45.355307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:45.355224+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:45.355224+0000","last_clean_scrub_stamp":"2023-12-07T21:13:45.355224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:23:41.232871+0000","scrub_duration":0.0012797419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.037891+0000","last_change":"2023-12-07T21:13:44.037911+0000","last_active":"2023-12-07T21:13:44.037891+0000","last_peered":"2023-12-07T21:13:44.037891+0000","last_clean":"2023-12-07T21:13:44.037891+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:13:44.037891+0000","last_undegraded":"2023-12-07T21:13:44.037891+0000","last_fullsized":"2023-12-07T21:13:44.037891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:44.037804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:44.037804+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.037804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:44:57.361482+0000","scrub_duration":0.0012532349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.771944+0000","last_change":"2023-12-07T21:12:11.771944+0000","last_active":"2023-12-07T21:12:11.771944+0000","last_peered":"2023-12-07T21:12:11.771944+0000","last_clean":"2023-12-07T21:12:11.771944+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:12:11.771944+0000","last_undegraded":"2023-12-07T21:12:11.771944+0000","last_fullsized":"2023-12-07T21:12:11.771944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.771816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:43.210676+0000","scrub_duration":0.0013479799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'72","reported_seq":142,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.763012+0000","last_change":"2023-12-07T21:11:45.763012+0000","last_active":"2023-12-07T21:11:45.763012+0000","last_peered":"2023-12-07T21:11:45.763012+0000","last_clean":"2023-12-07T21:11:45.763012+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:45.763012+0000","last_undegraded":"2023-12-07T21:11:45.763012+0000","last_fullsized":"2023-12-07T21:11:45.763012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.762875+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:27:47.809323+0000","scrub_duration":0.006706058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594416+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594416+0000","last_peered":"2023-12-07T21:11:25.594416+0000","last_clean":"2023-12-07T21:11:25.594416+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594416+0000","last_undegraded":"2023-12-07T21:11:25.594416+0000","last_fullsized":"2023-12-07T21:11:25.594416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.806069+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:11:23.806069+0000","last_peered":"2023-12-07T21:11:23.806069+0000","last_clean":"2023-12-07T21:11:23.806069+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:11:23.806069+0000","last_undegraded":"2023-12-07T21:11:23.806069+0000","last_fullsized":"2023-12-07T21:11:23.806069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.332914+0000","last_change":"2023-12-07T21:12:42.332914+0000","last_active":"2023-12-07T21:12:42.332914+0000","last_peered":"2023-12-07T21:12:42.332914+0000","last_clean":"2023-12-07T21:12:42.332914+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:12:42.332914+0000","last_undegraded":"2023-12-07T21:12:42.332914+0000","last_fullsized":"2023-12-07T21:12:42.332914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.332776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:52.088170+0000","scrub_duration":0.00097994699999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345087+0000","last_change":"2023-12-07T21:08:54.880231+0000","last_active":"2023-12-07T21:11:09.345087+0000","last_peered":"2023-12-07T21:11:09.345087+0000","last_clean":"2023-12-07T21:11:09.345087+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:11:09.345087+0000","last_undegraded":"2023-12-07T21:11:09.345087+0000","last_fullsized":"2023-12-07T21:11:09.345087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607497+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:11:10.607497+0000","last_peered":"2023-12-07T21:11:10.607497+0000","last_clean":"2023-12-07T21:11:10.607497+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:11:10.607497+0000","last_undegraded":"2023-12-07T21:11:10.607497+0000","last_fullsized":"2023-12-07T21:11:10.607497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.626478+0000","last_change":"2023-12-07T21:11:42.626478+0000","last_active":"2023-12-07T21:11:42.626478+0000","last_peered":"2023-12-07T21:11:42.626478+0000","last_clean":"2023-12-07T21:11:42.626478+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:11:42.626478+0000","last_undegraded":"2023-12-07T21:11:42.626478+0000","last_fullsized":"2023-12-07T21:11:42.626478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.626356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:23.689571+0000","scrub_duration":0.001348258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.225043+0000","last_change":"2023-12-07T21:11:33.225043+0000","last_active":"2023-12-07T21:11:33.225043+0000","last_peered":"2023-12-07T21:11:33.225043+0000","last_clean":"2023-12-07T21:11:33.225043+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:33.225043+0000","last_undegraded":"2023-12-07T21:11:33.225043+0000","last_fullsized":"2023-12-07T21:11:33.225043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.224920+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:12.396025+0000","scrub_duration":0.0049945800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.065956+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:11:20.065956+0000","last_peered":"2023-12-07T21:11:20.065956+0000","last_clean":"2023-12-07T21:11:20.065956+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:20.065956+0000","last_undegraded":"2023-12-07T21:11:20.065956+0000","last_fullsized":"2023-12-07T21:11:20.065956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813858+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:11:23.813858+0000","last_peered":"2023-12-07T21:11:23.813858+0000","last_clean":"2023-12-07T21:11:23.813858+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:11:23.813858+0000","last_undegraded":"2023-12-07T21:11:23.813858+0000","last_fullsized":"2023-12-07T21:11:23.813858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:26.538543+0000","last_change":"2023-12-07T21:13:26.538591+0000","last_active":"2023-12-07T21:13:26.538543+0000","last_peered":"2023-12-07T21:13:26.538543+0000","last_clean":"2023-12-07T21:13:26.538543+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:13:26.538543+0000","last_undegraded":"2023-12-07T21:13:26.538543+0000","last_fullsized":"2023-12-07T21:13:26.538543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_clean_scrub_stamp":"2023-12-07T21:13:26.538439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:32:03.233013+0000","scrub_duration":0.0011404239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607526+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:11:10.607526+0000","last_peered":"2023-12-07T21:11:10.607526+0000","last_clean":"2023-12-07T21:11:10.607526+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:11:10.607526+0000","last_undegraded":"2023-12-07T21:11:10.607526+0000","last_fullsized":"2023-12-07T21:11:10.607526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:47.017061+0000","last_change":"2023-12-07T21:13:47.017082+0000","last_active":"2023-12-07T21:13:47.017061+0000","last_peered":"2023-12-07T21:13:47.017061+0000","last_clean":"2023-12-07T21:13:47.017061+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:13:47.017061+0000","last_undegraded":"2023-12-07T21:13:47.017061+0000","last_fullsized":"2023-12-07T21:13:47.017061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:47.016927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:47.016927+0000","last_clean_scrub_stamp":"2023-12-07T21:13:47.016927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:39.728287+0000","scrub_duration":0.0013272259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.865911+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:11:18.865911+0000","last_peered":"2023-12-07T21:11:18.865911+0000","last_clean":"2023-12-07T21:11:18.865911+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:11:18.865911+0000","last_undegraded":"2023-12-07T21:11:18.865911+0000","last_fullsized":"2023-12-07T21:11:18.865911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:44.632651+0000","last_change":"2023-12-07T21:12:44.632651+0000","last_active":"2023-12-07T21:12:44.632651+0000","last_peered":"2023-12-07T21:12:44.632651+0000","last_clean":"2023-12-07T21:12:44.632651+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:12:44.632651+0000","last_undegraded":"2023-12-07T21:12:44.632651+0000","last_fullsized":"2023-12-07T21:12:44.632651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_clean_scrub_stamp":"2023-12-07T21:12:44.632504+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:24.020207+0000","scrub_duration":0.0053067840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":369,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712229+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712229+0000","last_peered":"2023-12-07T21:11:18.712229+0000","last_clean":"2023-12-07T21:11:18.712229+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712229+0000","last_undegraded":"2023-12-07T21:11:18.712229+0000","last_fullsized":"2023-12-07T21:11:18.712229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.351712+0000","last_change":"2023-12-07T21:13:48.351733+0000","last_active":"2023-12-07T21:13:48.351712+0000","last_peered":"2023-12-07T21:13:48.351712+0000","last_clean":"2023-12-07T21:13:48.351712+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:13:48.351712+0000","last_undegraded":"2023-12-07T21:13:48.351712+0000","last_fullsized":"2023-12-07T21:13:48.351712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-07T21:13:48.351626+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-07T21:13:48.351626+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.351626+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:41.062986+0000","scrub_duration":0.0010460479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:43.441643+0000","last_change":"2023-12-07T21:12:43.441643+0000","last_active":"2023-12-07T21:12:43.441643+0000","last_peered":"2023-12-07T21:12:43.441643+0000","last_clean":"2023-12-07T21:12:43.441643+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:12:43.441643+0000","last_undegraded":"2023-12-07T21:12:43.441643+0000","last_fullsized":"2023-12-07T21:12:43.441643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_clean_scrub_stamp":"2023-12-07T21:12:43.441484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:24.768617+0000","scrub_duration":0.0011182029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:22.456099+0000","last_change":"2023-12-07T21:13:22.456119+0000","last_active":"2023-12-07T21:13:22.456099+0000","last_peered":"2023-12-07T21:13:22.456099+0000","last_clean":"2023-12-07T21:13:22.456099+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:13:22.456099+0000","last_undegraded":"2023-12-07T21:13:22.456099+0000","last_fullsized":"2023-12-07T21:13:22.456099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_clean_scrub_stamp":"2023-12-07T21:13:22.456021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:49.190223+0000","scrub_duration":0.001272902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607479+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:11:10.607479+0000","last_peered":"2023-12-07T21:11:10.607479+0000","last_clean":"2023-12-07T21:11:10.607479+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:11:10.607479+0000","last_undegraded":"2023-12-07T21:11:10.607479+0000","last_fullsized":"2023-12-07T21:11:10.607479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:37.651334+0000","last_change":"2023-12-07T21:11:37.651334+0000","last_active":"2023-12-07T21:11:37.651334+0000","last_peered":"2023-12-07T21:11:37.651334+0000","last_clean":"2023-12-07T21:11:37.651334+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:11:37.651334+0000","last_undegraded":"2023-12-07T21:11:37.651334+0000","last_fullsized":"2023-12-07T21:11:37.651334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_clean_scrub_stamp":"2023-12-07T21:11:37.651191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:09.090050+0000","scrub_duration":0.0012443790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'94","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:05.544503+0000","last_change":"2023-12-07T21:12:05.544503+0000","last_active":"2023-12-07T21:12:05.544503+0000","last_peered":"2023-12-07T21:12:05.544503+0000","last_clean":"2023-12-07T21:12:05.544503+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:12:05.544503+0000","last_undegraded":"2023-12-07T21:12:05.544503+0000","last_fullsized":"2023-12-07T21:12:05.544503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'94","last_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_deep_scrub":"33'94","last_deep_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_clean_scrub_stamp":"2023-12-07T21:12:05.544369+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:32:13.323537+0000","scrub_duration":0.006343095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.831678+0000","last_change":"2023-12-07T21:11:52.831678+0000","last_active":"2023-12-07T21:11:52.831678+0000","last_peered":"2023-12-07T21:11:52.831678+0000","last_clean":"2023-12-07T21:11:52.831678+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:52.831678+0000","last_undegraded":"2023-12-07T21:11:52.831678+0000","last_fullsized":"2023-12-07T21:11:52.831678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.831531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:22.265020+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.812760+0000","last_change":"2023-12-07T21:09:04.924445+0000","last_active":"2023-12-07T21:11:23.812760+0000","last_peered":"2023-12-07T21:11:23.812760+0000","last_clean":"2023-12-07T21:11:23.812760+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:11:23.812760+0000","last_undegraded":"2023-12-07T21:11:23.812760+0000","last_fullsized":"2023-12-07T21:11:23.812760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.528421+0000","last_change":"2023-12-07T21:12:23.528421+0000","last_active":"2023-12-07T21:12:23.528421+0000","last_peered":"2023-12-07T21:12:23.528421+0000","last_clean":"2023-12-07T21:12:23.528421+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:12:23.528421+0000","last_undegraded":"2023-12-07T21:12:23.528421+0000","last_fullsized":"2023-12-07T21:12:23.528421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.528299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:52.961788+0000","scrub_duration":0.00098274400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.407105+0000","last_change":"2023-12-07T21:13:04.407105+0000","last_active":"2023-12-07T21:13:04.407105+0000","last_peered":"2023-12-07T21:13:04.407105+0000","last_clean":"2023-12-07T21:13:04.407105+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:13:04.407105+0000","last_undegraded":"2023-12-07T21:13:04.407105+0000","last_fullsized":"2023-12-07T21:13:04.407105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.406964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:17:33.745379+0000","scrub_duration":0.001091641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812380+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:11:18.812380+0000","last_peered":"2023-12-07T21:11:18.812380+0000","last_clean":"2023-12-07T21:11:18.812380+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:11:18.812380+0000","last_undegraded":"2023-12-07T21:11:18.812380+0000","last_fullsized":"2023-12-07T21:11:18.812380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.299988+0000","last_change":"2023-12-07T21:11:39.299988+0000","last_active":"2023-12-07T21:11:39.299988+0000","last_peered":"2023-12-07T21:11:39.299988+0000","last_clean":"2023-12-07T21:11:39.299988+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:39.299988+0000","last_undegraded":"2023-12-07T21:11:39.299988+0000","last_fullsized":"2023-12-07T21:11:39.299988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.299849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:48.997025+0000","scrub_duration":0.001356866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813364+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:23.813364+0000","last_peered":"2023-12-07T21:11:23.813364+0000","last_clean":"2023-12-07T21:11:23.813364+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:23.813364+0000","last_undegraded":"2023-12-07T21:11:23.813364+0000","last_fullsized":"2023-12-07T21:11:23.813364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.626993+0000","last_change":"2023-12-07T21:13:05.626993+0000","last_active":"2023-12-07T21:13:05.626993+0000","last_peered":"2023-12-07T21:13:05.626993+0000","last_clean":"2023-12-07T21:13:05.626993+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:13:05.626993+0000","last_undegraded":"2023-12-07T21:13:05.626993+0000","last_fullsized":"2023-12-07T21:13:05.626993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.626860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:01.027919+0000","scrub_duration":0.00097400899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345986+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:11:09.345986+0000","last_peered":"2023-12-07T21:11:09.345986+0000","last_clean":"2023-12-07T21:11:09.345986+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:11:09.345986+0000","last_undegraded":"2023-12-07T21:11:09.345986+0000","last_fullsized":"2023-12-07T21:11:09.345986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.340557+0000","last_change":"2023-12-07T21:13:05.340557+0000","last_active":"2023-12-07T21:13:05.340557+0000","last_peered":"2023-12-07T21:13:05.340557+0000","last_clean":"2023-12-07T21:13:05.340557+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:13:05.340557+0000","last_undegraded":"2023-12-07T21:13:05.340557+0000","last_fullsized":"2023-12-07T21:13:05.340557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.340431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:24.924419+0000","scrub_duration":0.001119035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.409426+0000","last_change":"2023-12-07T21:13:48.409426+0000","last_active":"2023-12-07T21:13:48.409426+0000","last_peered":"2023-12-07T21:13:48.409426+0000","last_clean":"2023-12-07T21:13:48.409426+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:13:48.409426+0000","last_undegraded":"2023-12-07T21:13:48.409426+0000","last_fullsized":"2023-12-07T21:13:48.409426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:48.409284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:48.409284+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.409284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:42.968321+0000","scrub_duration":0.0012408199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812340+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:18.812340+0000","last_peered":"2023-12-07T21:11:18.812340+0000","last_clean":"2023-12-07T21:11:18.812340+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:18.812340+0000","last_undegraded":"2023-12-07T21:11:18.812340+0000","last_fullsized":"2023-12-07T21:11:18.812340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'9","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.887056+0000","last_change":"2023-12-07T21:11:50.887056+0000","last_active":"2023-12-07T21:11:50.887056+0000","last_peered":"2023-12-07T21:11:50.887056+0000","last_clean":"2023-12-07T21:11:50.887056+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:50.887056+0000","last_undegraded":"2023-12-07T21:11:50.887056+0000","last_fullsized":"2023-12-07T21:11:50.887056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.886922+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:02.989113+0000","scrub_duration":0.0042007399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.812347+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:23.812347+0000","last_peered":"2023-12-07T21:11:23.812347+0000","last_clean":"2023-12-07T21:11:23.812347+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:23.812347+0000","last_undegraded":"2023-12-07T21:11:23.812347+0000","last_fullsized":"2023-12-07T21:11:23.812347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345954+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:11:09.345954+0000","last_peered":"2023-12-07T21:11:09.345954+0000","last_clean":"2023-12-07T21:11:09.345954+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:11:09.345954+0000","last_undegraded":"2023-12-07T21:11:09.345954+0000","last_fullsized":"2023-12-07T21:11:09.345954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.033989+0000","last_change":"2023-12-07T21:13:38.033989+0000","last_active":"2023-12-07T21:13:38.033989+0000","last_peered":"2023-12-07T21:13:38.033989+0000","last_clean":"2023-12-07T21:13:38.033989+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:13:38.033989+0000","last_undegraded":"2023-12-07T21:13:38.033989+0000","last_fullsized":"2023-12-07T21:13:38.033989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:38.033840+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:38.033840+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.033840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:33.434899+0000","scrub_duration":0.001381462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.434901+0000","last_change":"2023-12-07T21:13:28.434901+0000","last_active":"2023-12-07T21:13:28.434901+0000","last_peered":"2023-12-07T21:13:28.434901+0000","last_clean":"2023-12-07T21:13:28.434901+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:13:28.434901+0000","last_undegraded":"2023-12-07T21:13:28.434901+0000","last_fullsized":"2023-12-07T21:13:28.434901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.434771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:49.030870+0000","scrub_duration":0.001230061,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.605108+0000","last_change":"2023-12-07T21:12:18.605108+0000","last_active":"2023-12-07T21:12:18.605108+0000","last_peered":"2023-12-07T21:12:18.605108+0000","last_clean":"2023-12-07T21:12:18.605108+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:12:18.605108+0000","last_undegraded":"2023-12-07T21:12:18.605108+0000","last_fullsized":"2023-12-07T21:12:18.605108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.605002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:30.707193+0000","scrub_duration":0.00090833899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.805867+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:23.805867+0000","last_peered":"2023-12-07T21:11:23.805867+0000","last_clean":"2023-12-07T21:11:23.805867+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:23.805867+0000","last_undegraded":"2023-12-07T21:11:23.805867+0000","last_fullsized":"2023-12-07T21:11:23.805867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.302809+0000","last_change":"2023-12-07T21:11:36.302809+0000","last_active":"2023-12-07T21:11:36.302809+0000","last_peered":"2023-12-07T21:11:36.302809+0000","last_clean":"2023-12-07T21:11:36.302809+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:36.302809+0000","last_undegraded":"2023-12-07T21:11:36.302809+0000","last_fullsized":"2023-12-07T21:11:36.302809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.302687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:01.567462+0000","scrub_duration":0.0014296669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608968+0000","last_change":"2023-12-07T21:09:04.928461+0000","last_active":"2023-12-07T21:11:10.608968+0000","last_peered":"2023-12-07T21:11:10.608968+0000","last_clean":"2023-12-07T21:11:10.608968+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:11:10.608968+0000","last_undegraded":"2023-12-07T21:11:10.608968+0000","last_fullsized":"2023-12-07T21:11:10.608968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:29.521893+0000","last_change":"2023-12-07T21:13:29.521893+0000","last_active":"2023-12-07T21:13:29.521893+0000","last_peered":"2023-12-07T21:13:29.521893+0000","last_clean":"2023-12-07T21:13:29.521893+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:13:29.521893+0000","last_undegraded":"2023-12-07T21:13:29.521893+0000","last_fullsized":"2023-12-07T21:13:29.521893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:29.521772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:29.521772+0000","last_clean_scrub_stamp":"2023-12-07T21:13:29.521772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:51:27.306062+0000","scrub_duration":0.001149186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:09.325688+0000","last_change":"2023-12-07T21:13:09.325688+0000","last_active":"2023-12-07T21:13:09.325688+0000","last_peered":"2023-12-07T21:13:09.325688+0000","last_clean":"2023-12-07T21:13:09.325688+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:13:09.325688+0000","last_undegraded":"2023-12-07T21:13:09.325688+0000","last_fullsized":"2023-12-07T21:13:09.325688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_clean_scrub_stamp":"2023-12-07T21:13:09.325568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:45:40.066890+0000","scrub_duration":0.00116248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.514142+0000","last_change":"2023-12-07T21:11:52.514142+0000","last_active":"2023-12-07T21:11:52.514142+0000","last_peered":"2023-12-07T21:11:52.514142+0000","last_clean":"2023-12-07T21:11:52.514142+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:52.514142+0000","last_undegraded":"2023-12-07T21:11:52.514142+0000","last_fullsized":"2023-12-07T21:11:52.514142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.514035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:00:51.180837+0000","scrub_duration":0.00101976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.532802+0000","last_change":"2023-12-07T21:11:32.532802+0000","last_active":"2023-12-07T21:11:32.532802+0000","last_peered":"2023-12-07T21:11:32.532802+0000","last_clean":"2023-12-07T21:11:32.532802+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:32.532802+0000","last_undegraded":"2023-12-07T21:11:32.532802+0000","last_fullsized":"2023-12-07T21:11:32.532802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.532666+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:34.382885+0000","scrub_duration":0.0035860219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.812477+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:23.812477+0000","last_peered":"2023-12-07T21:11:23.812477+0000","last_clean":"2023-12-07T21:11:23.812477+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:23.812477+0000","last_undegraded":"2023-12-07T21:11:23.812477+0000","last_fullsized":"2023-12-07T21:11:23.812477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:31.506721+0000","last_change":"2023-12-07T21:13:31.506752+0000","last_active":"2023-12-07T21:13:31.506721+0000","last_peered":"2023-12-07T21:13:31.506721+0000","last_clean":"2023-12-07T21:13:31.506721+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:13:31.506721+0000","last_undegraded":"2023-12-07T21:13:31.506721+0000","last_fullsized":"2023-12-07T21:13:31.506721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:31.506641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:31.506641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:31.506641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:57:50.535477+0000","scrub_duration":0.0015893470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813265+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:11:23.813265+0000","last_peered":"2023-12-07T21:11:23.813265+0000","last_clean":"2023-12-07T21:11:23.813265+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:11:23.813265+0000","last_undegraded":"2023-12-07T21:11:23.813265+0000","last_fullsized":"2023-12-07T21:11:23.813265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:59.757120+0000","last_change":"2023-12-07T21:11:59.757120+0000","last_active":"2023-12-07T21:11:59.757120+0000","last_peered":"2023-12-07T21:11:59.757120+0000","last_clean":"2023-12-07T21:11:59.757120+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:11:59.757120+0000","last_undegraded":"2023-12-07T21:11:59.757120+0000","last_fullsized":"2023-12-07T21:11:59.757120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_clean_scrub_stamp":"2023-12-07T21:11:59.757017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:04:59.018197+0000","scrub_duration":0.001196353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'61","reported_seq":127,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.783931+0000","last_change":"2023-12-07T21:11:44.783993+0000","last_active":"2023-12-07T21:11:44.783931+0000","last_peered":"2023-12-07T21:11:44.783931+0000","last_clean":"2023-12-07T21:11:44.783931+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:44.783931+0000","last_undegraded":"2023-12-07T21:11:44.783931+0000","last_fullsized":"2023-12-07T21:11:44.783931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.783824+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:07.474940+0000","scrub_duration":0.004588193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.558888+0000","last_change":"2023-12-07T21:11:36.558908+0000","last_active":"2023-12-07T21:11:36.558888+0000","last_peered":"2023-12-07T21:11:36.558888+0000","last_clean":"2023-12-07T21:11:36.558888+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:11:36.558888+0000","last_undegraded":"2023-12-07T21:11:36.558888+0000","last_fullsized":"2023-12-07T21:11:36.558888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.558807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:33:06.320086+0000","scrub_duration":0.001387288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.806853+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:11:28.806853+0000","last_peered":"2023-12-07T21:11:28.806853+0000","last_clean":"2023-12-07T21:11:28.806853+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:11:28.806853+0000","last_undegraded":"2023-12-07T21:11:28.806853+0000","last_fullsized":"2023-12-07T21:11:28.806853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:19.862179+0000","last_change":"2023-12-07T21:12:19.862179+0000","last_active":"2023-12-07T21:12:19.862179+0000","last_peered":"2023-12-07T21:12:19.862179+0000","last_clean":"2023-12-07T21:12:19.862179+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:12:19.862179+0000","last_undegraded":"2023-12-07T21:12:19.862179+0000","last_fullsized":"2023-12-07T21:12:19.862179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_clean_scrub_stamp":"2023-12-07T21:12:19.862069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:34.168058+0000","scrub_duration":0.0015085669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.431844+0000","last_change":"2023-12-07T21:13:21.431844+0000","last_active":"2023-12-07T21:13:21.431844+0000","last_peered":"2023-12-07T21:13:21.431844+0000","last_clean":"2023-12-07T21:13:21.431844+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:13:21.431844+0000","last_undegraded":"2023-12-07T21:13:21.431844+0000","last_fullsized":"2023-12-07T21:13:21.431844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.431724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:58:06.040375+0000","scrub_duration":0.0012195439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188111+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:11:10.188111+0000","last_peered":"2023-12-07T21:11:10.188111+0000","last_clean":"2023-12-07T21:11:10.188111+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:11:10.188111+0000","last_undegraded":"2023-12-07T21:11:10.188111+0000","last_fullsized":"2023-12-07T21:11:10.188111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.514700+0000","last_change":"2023-12-07T21:12:21.514738+0000","last_active":"2023-12-07T21:12:21.514700+0000","last_peered":"2023-12-07T21:12:21.514700+0000","last_clean":"2023-12-07T21:12:21.514700+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:12:21.514700+0000","last_undegraded":"2023-12-07T21:12:21.514700+0000","last_fullsized":"2023-12-07T21:12:21.514700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.514603+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:11.760175+0000","scrub_duration":0.0065721260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:13.398971+0000","last_change":"2023-12-07T21:12:13.399009+0000","last_active":"2023-12-07T21:12:13.398971+0000","last_peered":"2023-12-07T21:12:13.398971+0000","last_clean":"2023-12-07T21:12:13.398971+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:12:13.398971+0000","last_undegraded":"2023-12-07T21:12:13.398971+0000","last_fullsized":"2023-12-07T21:12:13.398971+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_clean_scrub_stamp":"2023-12-07T21:12:13.398859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:54.725992+0000","scrub_duration":0.0011359600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814648+0000","last_change":"2023-12-07T21:09:04.927981+0000","last_active":"2023-12-07T21:11:28.814648+0000","last_peered":"2023-12-07T21:11:28.814648+0000","last_clean":"2023-12-07T21:11:28.814648+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:11:28.814648+0000","last_undegraded":"2023-12-07T21:11:28.814648+0000","last_fullsized":"2023-12-07T21:11:28.814648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.432371+0000","last_change":"2023-12-07T21:12:11.432392+0000","last_active":"2023-12-07T21:12:11.432371+0000","last_peered":"2023-12-07T21:12:11.432371+0000","last_clean":"2023-12-07T21:12:11.432371+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:12:11.432371+0000","last_undegraded":"2023-12-07T21:12:11.432371+0000","last_fullsized":"2023-12-07T21:12:11.432371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.432277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:48.190145+0000","scrub_duration":0.0010618419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.427544+0000","last_change":"2023-12-07T21:13:36.427565+0000","last_active":"2023-12-07T21:13:36.427544+0000","last_peered":"2023-12-07T21:13:36.427544+0000","last_clean":"2023-12-07T21:13:36.427544+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:13:36.427544+0000","last_undegraded":"2023-12-07T21:13:36.427544+0000","last_fullsized":"2023-12-07T21:13:36.427544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:36.427462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:36.427462+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.427462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:00:09.657217+0000","scrub_duration":0.0011997139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:10.553115+0000","last_change":"2023-12-07T21:12:10.553135+0000","last_active":"2023-12-07T21:12:10.553115+0000","last_peered":"2023-12-07T21:12:10.553115+0000","last_clean":"2023-12-07T21:12:10.553115+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:12:10.553115+0000","last_undegraded":"2023-12-07T21:12:10.553115+0000","last_fullsized":"2023-12-07T21:12:10.553115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_clean_scrub_stamp":"2023-12-07T21:12:10.553023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:52.504367+0000","scrub_duration":0.0013037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.745178+0000","last_change":"2023-12-07T21:11:36.745178+0000","last_active":"2023-12-07T21:11:36.745178+0000","last_peered":"2023-12-07T21:11:36.745178+0000","last_clean":"2023-12-07T21:11:36.745178+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:36.745178+0000","last_undegraded":"2023-12-07T21:11:36.745178+0000","last_fullsized":"2023-12-07T21:11:36.745178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.745068+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:09.080620+0000","scrub_duration":0.0072373669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:16.616710+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:11:16.616710+0000","last_peered":"2023-12-07T21:11:16.616710+0000","last_clean":"2023-12-07T21:11:16.616710+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:11:16.616710+0000","last_undegraded":"2023-12-07T21:11:16.616710+0000","last_fullsized":"2023-12-07T21:11:16.616710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814594+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:11:28.814594+0000","last_peered":"2023-12-07T21:11:28.814594+0000","last_clean":"2023-12-07T21:11:28.814594+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:11:28.814594+0000","last_undegraded":"2023-12-07T21:11:28.814594+0000","last_fullsized":"2023-12-07T21:11:28.814594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.879480+0000","last_change":"2023-12-07T21:12:56.879540+0000","last_active":"2023-12-07T21:12:56.879480+0000","last_peered":"2023-12-07T21:12:56.879480+0000","last_clean":"2023-12-07T21:12:56.879480+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:12:56.879480+0000","last_undegraded":"2023-12-07T21:12:56.879480+0000","last_fullsized":"2023-12-07T21:12:56.879480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.879389+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:47.124961+0000","scrub_duration":0.0034133409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607746+0000","last_change":"2023-12-07T21:08:54.880987+0000","last_active":"2023-12-07T21:11:10.607746+0000","last_peered":"2023-12-07T21:11:10.607746+0000","last_clean":"2023-12-07T21:11:10.607746+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:11:10.607746+0000","last_undegraded":"2023-12-07T21:11:10.607746+0000","last_fullsized":"2023-12-07T21:11:10.607746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.324406+0000","last_change":"2023-12-07T21:11:41.324449+0000","last_active":"2023-12-07T21:11:41.324406+0000","last_peered":"2023-12-07T21:11:41.324406+0000","last_clean":"2023-12-07T21:11:41.324406+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:41.324406+0000","last_undegraded":"2023-12-07T21:11:41.324406+0000","last_fullsized":"2023-12-07T21:11:41.324406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.324294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:18:22.956309+0000","scrub_duration":0.001431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.649725+0000","last_change":"2023-12-07T21:12:42.649725+0000","last_active":"2023-12-07T21:12:42.649725+0000","last_peered":"2023-12-07T21:12:42.649725+0000","last_clean":"2023-12-07T21:12:42.649725+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:12:42.649725+0000","last_undegraded":"2023-12-07T21:12:42.649725+0000","last_fullsized":"2023-12-07T21:12:42.649725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.649582+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:55:46.065006+0000","scrub_duration":0.0041186950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":325,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411924+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411924+0000","last_peered":"2023-12-07T21:11:10.411924+0000","last_clean":"2023-12-07T21:11:10.411924+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411924+0000","last_undegraded":"2023-12-07T21:11:10.411924+0000","last_fullsized":"2023-12-07T21:11:10.411924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814347+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:11:28.814347+0000","last_peered":"2023-12-07T21:11:28.814347+0000","last_clean":"2023-12-07T21:11:28.814347+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:11:28.814347+0000","last_undegraded":"2023-12-07T21:11:28.814347+0000","last_fullsized":"2023-12-07T21:11:28.814347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.370708+0000","last_change":"2023-12-07T21:13:07.370762+0000","last_active":"2023-12-07T21:13:07.370708+0000","last_peered":"2023-12-07T21:13:07.370708+0000","last_clean":"2023-12-07T21:13:07.370708+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:13:07.370708+0000","last_undegraded":"2023-12-07T21:13:07.370708+0000","last_fullsized":"2023-12-07T21:13:07.370708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:06.037407+0000","scrub_duration":0.0014696010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.432241+0000","last_change":"2023-12-07T21:13:23.432268+0000","last_active":"2023-12-07T21:13:23.432241+0000","last_peered":"2023-12-07T21:13:23.432241+0000","last_clean":"2023-12-07T21:13:23.432241+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:13:23.432241+0000","last_undegraded":"2023-12-07T21:13:23.432241+0000","last_fullsized":"2023-12-07T21:13:23.432241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.432146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:02:08.854218+0000","scrub_duration":0.001156783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.351535+0000","last_change":"2023-12-07T21:11:43.351557+0000","last_active":"2023-12-07T21:11:43.351535+0000","last_peered":"2023-12-07T21:11:43.351535+0000","last_clean":"2023-12-07T21:11:43.351535+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:43.351535+0000","last_undegraded":"2023-12-07T21:11:43.351535+0000","last_fullsized":"2023-12-07T21:11:43.351535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_clean_scrub_stamp":"2023-12-07T21:11:43.351414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:25.302758+0000","scrub_duration":0.001534795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:17.102589+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:17.102589+0000","last_peered":"2023-12-07T21:11:17.102589+0000","last_clean":"2023-12-07T21:11:17.102589+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:17.102589+0000","last_undegraded":"2023-12-07T21:11:17.102589+0000","last_fullsized":"2023-12-07T21:11:17.102589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.804304+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:27.804304+0000","last_peered":"2023-12-07T21:11:27.804304+0000","last_clean":"2023-12-07T21:11:27.804304+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:27.804304+0000","last_undegraded":"2023-12-07T21:11:27.804304+0000","last_fullsized":"2023-12-07T21:11:27.804304+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.767539+0000","last_change":"2023-12-07T21:09:04.925622+0000","last_active":"2023-12-07T21:11:09.767539+0000","last_peered":"2023-12-07T21:11:09.767539+0000","last_clean":"2023-12-07T21:11:09.767539+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:11:09.767539+0000","last_undegraded":"2023-12-07T21:11:09.767539+0000","last_fullsized":"2023-12-07T21:11:09.767539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:17.462502+0000","last_change":"2023-12-07T21:13:17.462525+0000","last_active":"2023-12-07T21:13:17.462502+0000","last_peered":"2023-12-07T21:13:17.462502+0000","last_clean":"2023-12-07T21:13:17.462502+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:13:17.462502+0000","last_undegraded":"2023-12-07T21:13:17.462502+0000","last_fullsized":"2023-12-07T21:13:17.462502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_clean_scrub_stamp":"2023-12-07T21:13:17.462415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:57.578294+0000","scrub_duration":0.0013457709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607752+0000","last_change":"2023-12-07T21:08:54.892339+0000","last_active":"2023-12-07T21:11:10.607752+0000","last_peered":"2023-12-07T21:11:10.607752+0000","last_clean":"2023-12-07T21:11:10.607752+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:11:10.607752+0000","last_undegraded":"2023-12-07T21:11:10.607752+0000","last_fullsized":"2023-12-07T21:11:10.607752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.612324+0000","last_change":"2023-12-07T21:12:17.612358+0000","last_active":"2023-12-07T21:12:17.612324+0000","last_peered":"2023-12-07T21:12:17.612324+0000","last_clean":"2023-12-07T21:12:17.612324+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:12:17.612324+0000","last_undegraded":"2023-12-07T21:12:17.612324+0000","last_fullsized":"2023-12-07T21:12:17.612324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.612233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:19.658682+0000","scrub_duration":0.00093805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.713857+0000","last_change":"2023-12-07T21:11:41.713922+0000","last_active":"2023-12-07T21:11:41.713857+0000","last_peered":"2023-12-07T21:11:41.713857+0000","last_clean":"2023-12-07T21:11:41.713857+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:41.713857+0000","last_undegraded":"2023-12-07T21:11:41.713857+0000","last_fullsized":"2023-12-07T21:11:41.713857+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.713762+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:20:34.087308+0000","scrub_duration":0.004054785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.510322+0000","last_change":"2023-12-07T21:12:27.510342+0000","last_active":"2023-12-07T21:12:27.510322+0000","last_peered":"2023-12-07T21:12:27.510322+0000","last_clean":"2023-12-07T21:12:27.510322+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:12:27.510322+0000","last_undegraded":"2023-12-07T21:12:27.510322+0000","last_fullsized":"2023-12-07T21:12:27.510322+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.510237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:49.420820+0000","scrub_duration":0.00099611600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608952+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:11:10.608952+0000","last_peered":"2023-12-07T21:11:10.608952+0000","last_clean":"2023-12-07T21:11:10.608952+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:11:10.608952+0000","last_undegraded":"2023-12-07T21:11:10.608952+0000","last_fullsized":"2023-12-07T21:11:10.608952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.564326+0000","last_change":"2023-12-07T21:13:28.564326+0000","last_active":"2023-12-07T21:13:28.564326+0000","last_peered":"2023-12-07T21:13:28.564326+0000","last_clean":"2023-12-07T21:13:28.564326+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:13:28.564326+0000","last_undegraded":"2023-12-07T21:13:28.564326+0000","last_fullsized":"2023-12-07T21:13:28.564326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.564212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:00.422576+0000","scrub_duration":0.0013779650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.878922+0000","last_change":"2023-12-07T21:13:08.878977+0000","last_active":"2023-12-07T21:13:08.878922+0000","last_peered":"2023-12-07T21:13:08.878922+0000","last_clean":"2023-12-07T21:13:08.878922+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:13:08.878922+0000","last_undegraded":"2023-12-07T21:13:08.878922+0000","last_fullsized":"2023-12-07T21:13:08.878922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_clean_scrub_stamp":"2023-12-07T21:13:08.878805+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:03.437843+0000","scrub_duration":0.0021145529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.412366+0000","last_change":"2023-12-07T21:11:55.412366+0000","last_active":"2023-12-07T21:11:55.412366+0000","last_peered":"2023-12-07T21:11:55.412366+0000","last_clean":"2023-12-07T21:11:55.412366+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:55.412366+0000","last_undegraded":"2023-12-07T21:11:55.412366+0000","last_fullsized":"2023-12-07T21:11:55.412366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.412243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.514434+0000","scrub_duration":0.0010230090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:00.405899+0000","last_change":"2023-12-07T21:12:00.405945+0000","last_active":"2023-12-07T21:12:00.405899+0000","last_peered":"2023-12-07T21:12:00.405899+0000","last_clean":"2023-12-07T21:12:00.405899+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:12:00.405899+0000","last_undegraded":"2023-12-07T21:12:00.405899+0000","last_fullsized":"2023-12-07T21:12:00.405899+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_clean_scrub_stamp":"2023-12-07T21:12:00.405797+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:22.672028+0000","scrub_duration":0.0030248670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.620691+0000","last_change":"2023-12-07T21:12:35.620711+0000","last_active":"2023-12-07T21:12:35.620691+0000","last_peered":"2023-12-07T21:12:35.620691+0000","last_clean":"2023-12-07T21:12:35.620691+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:12:35.620691+0000","last_undegraded":"2023-12-07T21:12:35.620691+0000","last_fullsized":"2023-12-07T21:12:35.620691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.620604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:45:58.984206+0000","scrub_duration":0.00101417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608961+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:11:10.608961+0000","last_peered":"2023-12-07T21:11:10.608961+0000","last_clean":"2023-12-07T21:11:10.608961+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:11:10.608961+0000","last_undegraded":"2023-12-07T21:11:10.608961+0000","last_fullsized":"2023-12-07T21:11:10.608961+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'14","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:45.443225+0000","last_change":"2023-12-07T21:12:45.443225+0000","last_active":"2023-12-07T21:12:45.443225+0000","last_peered":"2023-12-07T21:12:45.443225+0000","last_clean":"2023-12-07T21:12:45.443225+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:12:45.443225+0000","last_undegraded":"2023-12-07T21:12:45.443225+0000","last_fullsized":"2023-12-07T21:12:45.443225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_clean_scrub_stamp":"2023-12-07T21:12:45.443116+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:59.105780+0000","scrub_duration":0.003118975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:41.352194+0000","last_change":"2023-12-07T21:12:41.352194+0000","last_active":"2023-12-07T21:12:41.352194+0000","last_peered":"2023-12-07T21:12:41.352194+0000","last_clean":"2023-12-07T21:12:41.352194+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:12:41.352194+0000","last_undegraded":"2023-12-07T21:12:41.352194+0000","last_fullsized":"2023-12-07T21:12:41.352194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_clean_scrub_stamp":"2023-12-07T21:12:41.352075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:21.467955+0000","scrub_duration":0.001369671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.347728+0000","last_change":"2023-12-07T21:11:44.347728+0000","last_active":"2023-12-07T21:11:44.347728+0000","last_peered":"2023-12-07T21:11:44.347728+0000","last_clean":"2023-12-07T21:11:44.347728+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:44.347728+0000","last_undegraded":"2023-12-07T21:11:44.347728+0000","last_fullsized":"2023-12-07T21:11:44.347728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.347582+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:19:20.740832+0000","scrub_duration":0.0032839919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'37","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.582439+0000","last_change":"2023-12-07T21:13:06.582486+0000","last_active":"2023-12-07T21:13:06.582439+0000","last_peered":"2023-12-07T21:13:06.582439+0000","last_clean":"2023-12-07T21:13:06.582439+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:13:06.582439+0000","last_undegraded":"2023-12-07T21:13:06.582439+0000","last_fullsized":"2023-12-07T21:13:06.582439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.582338+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:09:35.689720+0000","scrub_duration":0.0045970239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:15.597790+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:15.597790+0000","last_peered":"2023-12-07T21:11:15.597790+0000","last_clean":"2023-12-07T21:11:15.597790+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:15.597790+0000","last_undegraded":"2023-12-07T21:11:15.597790+0000","last_fullsized":"2023-12-07T21:11:15.597790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.425991+0000","last_change":"2023-12-07T21:13:38.425991+0000","last_active":"2023-12-07T21:13:38.425991+0000","last_peered":"2023-12-07T21:13:38.425991+0000","last_clean":"2023-12-07T21:13:38.425991+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:13:38.425991+0000","last_undegraded":"2023-12-07T21:13:38.425991+0000","last_fullsized":"2023-12-07T21:13:38.425991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:38.425888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:38.425888+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.425888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:24:24.944080+0000","scrub_duration":0.0010394829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.282874+0000","last_change":"2023-12-07T21:12:20.282874+0000","last_active":"2023-12-07T21:12:20.282874+0000","last_peered":"2023-12-07T21:12:20.282874+0000","last_clean":"2023-12-07T21:12:20.282874+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:12:20.282874+0000","last_undegraded":"2023-12-07T21:12:20.282874+0000","last_fullsized":"2023-12-07T21:12:20.282874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.282741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:25.331572+0000","scrub_duration":0.001103185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.410433+0000","last_change":"2023-12-07T21:13:11.410456+0000","last_active":"2023-12-07T21:13:11.410433+0000","last_peered":"2023-12-07T21:13:11.410433+0000","last_clean":"2023-12-07T21:13:11.410433+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:13:11.410433+0000","last_undegraded":"2023-12-07T21:13:11.410433+0000","last_fullsized":"2023-12-07T21:13:11.410433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.410343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:25:05.365800+0000","scrub_duration":0.00143078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.887062+0000","last_change":"2023-12-07T21:12:35.887062+0000","last_active":"2023-12-07T21:12:35.887062+0000","last_peered":"2023-12-07T21:12:35.887062+0000","last_clean":"2023-12-07T21:12:35.887062+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:12:35.887062+0000","last_undegraded":"2023-12-07T21:12:35.887062+0000","last_fullsized":"2023-12-07T21:12:35.887062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.886915+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:07.595951+0000","scrub_duration":0.0013132650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345119+0000","last_change":"2023-12-07T21:08:54.874308+0000","last_active":"2023-12-07T21:11:09.345119+0000","last_peered":"2023-12-07T21:11:09.345119+0000","last_clean":"2023-12-07T21:11:09.345119+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:11:09.345119+0000","last_undegraded":"2023-12-07T21:11:09.345119+0000","last_fullsized":"2023-12-07T21:11:09.345119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.424126+0000","last_change":"2023-12-07T21:12:12.424126+0000","last_active":"2023-12-07T21:12:12.424126+0000","last_peered":"2023-12-07T21:12:12.424126+0000","last_clean":"2023-12-07T21:12:12.424126+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:12:12.424126+0000","last_undegraded":"2023-12-07T21:12:12.424126+0000","last_fullsized":"2023-12-07T21:12:12.424126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.424026+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:21.643939+0000","scrub_duration":0.002995218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607794+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:11:10.607794+0000","last_peered":"2023-12-07T21:11:10.607794+0000","last_clean":"2023-12-07T21:11:10.607794+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:11:10.607794+0000","last_undegraded":"2023-12-07T21:11:10.607794+0000","last_fullsized":"2023-12-07T21:11:10.607794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.040427+0000","last_change":"2023-12-07T21:13:36.040464+0000","last_active":"2023-12-07T21:13:36.040427+0000","last_peered":"2023-12-07T21:13:36.040427+0000","last_clean":"2023-12-07T21:13:36.040427+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:13:36.040427+0000","last_undegraded":"2023-12-07T21:13:36.040427+0000","last_fullsized":"2023-12-07T21:13:36.040427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:36.040303+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:36.040303+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.040303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:27:20.323619+0000","scrub_duration":0.0015351799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345250+0000","last_change":"2023-12-07T21:08:54.882125+0000","last_active":"2023-12-07T21:11:09.345250+0000","last_peered":"2023-12-07T21:11:09.345250+0000","last_clean":"2023-12-07T21:11:09.345250+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:11:09.345250+0000","last_undegraded":"2023-12-07T21:11:09.345250+0000","last_fullsized":"2023-12-07T21:11:09.345250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.893908+0000","last_change":"2023-12-07T21:13:07.893908+0000","last_active":"2023-12-07T21:13:07.893908+0000","last_peered":"2023-12-07T21:13:07.893908+0000","last_clean":"2023-12-07T21:13:07.893908+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:13:07.893908+0000","last_undegraded":"2023-12-07T21:13:07.893908+0000","last_fullsized":"2023-12-07T21:13:07.893908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.893732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:21.957836+0000","scrub_duration":0.0014675510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:43.075446+0000","last_change":"2023-12-07T21:13:43.075468+0000","last_active":"2023-12-07T21:13:43.075446+0000","last_peered":"2023-12-07T21:13:43.075446+0000","last_clean":"2023-12-07T21:13:43.075446+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:13:43.075446+0000","last_undegraded":"2023-12-07T21:13:43.075446+0000","last_fullsized":"2023-12-07T21:13:43.075446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:43.075357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:43.075357+0000","last_clean_scrub_stamp":"2023-12-07T21:13:43.075357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:16.414998+0000","scrub_duration":0.001175125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:39.400478+0000","last_change":"2023-12-07T21:13:39.400502+0000","last_active":"2023-12-07T21:13:39.400478+0000","last_peered":"2023-12-07T21:13:39.400478+0000","last_clean":"2023-12-07T21:13:39.400478+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:13:39.400478+0000","last_undegraded":"2023-12-07T21:13:39.400478+0000","last_fullsized":"2023-12-07T21:13:39.400478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:39.400392+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:39.400392+0000","last_clean_scrub_stamp":"2023-12-07T21:13:39.400392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:58:58.675909+0000","scrub_duration":0.0010690470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.488346+0000","last_change":"2023-12-07T21:13:27.488385+0000","last_active":"2023-12-07T21:13:27.488346+0000","last_peered":"2023-12-07T21:13:27.488346+0000","last_clean":"2023-12-07T21:13:27.488346+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:13:27.488346+0000","last_undegraded":"2023-12-07T21:13:27.488346+0000","last_fullsized":"2023-12-07T21:13:27.488346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.488243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:20.217342+0000","scrub_duration":0.0011396240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.783809+0000","last_change":"2023-12-07T21:12:21.783809+0000","last_active":"2023-12-07T21:12:21.783809+0000","last_peered":"2023-12-07T21:12:21.783809+0000","last_clean":"2023-12-07T21:12:21.783809+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:12:21.783809+0000","last_undegraded":"2023-12-07T21:12:21.783809+0000","last_fullsized":"2023-12-07T21:12:21.783809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.783687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:25.104216+0000","scrub_duration":0.001223366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.417813+0000","last_change":"2023-12-07T21:12:58.417813+0000","last_active":"2023-12-07T21:12:58.417813+0000","last_peered":"2023-12-07T21:12:58.417813+0000","last_clean":"2023-12-07T21:12:58.417813+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:12:58.417813+0000","last_undegraded":"2023-12-07T21:12:58.417813+0000","last_fullsized":"2023-12-07T21:12:58.417813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.417685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:16.173945+0000","scrub_duration":0.0012264019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.393510+0000","last_change":"2023-12-07T21:12:14.393510+0000","last_active":"2023-12-07T21:12:14.393510+0000","last_peered":"2023-12-07T21:12:14.393510+0000","last_clean":"2023-12-07T21:12:14.393510+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:12:14.393510+0000","last_undegraded":"2023-12-07T21:12:14.393510+0000","last_fullsized":"2023-12-07T21:12:14.393510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.393370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:28.056034+0000","scrub_duration":0.0012787390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345102+0000","last_change":"2023-12-07T21:08:54.882147+0000","last_active":"2023-12-07T21:11:09.345102+0000","last_peered":"2023-12-07T21:11:09.345102+0000","last_clean":"2023-12-07T21:11:09.345102+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:11:09.345102+0000","last_undegraded":"2023-12-07T21:11:09.345102+0000","last_fullsized":"2023-12-07T21:11:09.345102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:22.292065+0000","last_change":"2023-12-07T21:12:22.292065+0000","last_active":"2023-12-07T21:12:22.292065+0000","last_peered":"2023-12-07T21:12:22.292065+0000","last_clean":"2023-12-07T21:12:22.292065+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:12:22.292065+0000","last_undegraded":"2023-12-07T21:12:22.292065+0000","last_fullsized":"2023-12-07T21:12:22.292065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_clean_scrub_stamp":"2023-12-07T21:12:22.291964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:19:35.510802+0000","scrub_duration":0.000955034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607807+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:11:10.607807+0000","last_peered":"2023-12-07T21:11:10.607807+0000","last_clean":"2023-12-07T21:11:10.607807+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:11:10.607807+0000","last_undegraded":"2023-12-07T21:11:10.607807+0000","last_fullsized":"2023-12-07T21:11:10.607807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:24.489652+0000","last_change":"2023-12-07T21:12:24.489652+0000","last_active":"2023-12-07T21:12:24.489652+0000","last_peered":"2023-12-07T21:12:24.489652+0000","last_clean":"2023-12-07T21:12:24.489652+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:12:24.489652+0000","last_undegraded":"2023-12-07T21:12:24.489652+0000","last_fullsized":"2023-12-07T21:12:24.489652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_clean_scrub_stamp":"2023-12-07T21:12:24.489525+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:58:44.073512+0000","scrub_duration":0.0022717330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.088717+0000","last_change":"2023-12-07T21:13:21.088717+0000","last_active":"2023-12-07T21:13:21.088717+0000","last_peered":"2023-12-07T21:13:21.088717+0000","last_clean":"2023-12-07T21:13:21.088717+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:13:21.088717+0000","last_undegraded":"2023-12-07T21:13:21.088717+0000","last_fullsized":"2023-12-07T21:13:21.088717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.088571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:31:27.226694+0000","scrub_duration":0.0016712599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.917521+0000","last_change":"2023-12-07T21:13:00.917521+0000","last_active":"2023-12-07T21:13:00.917521+0000","last_peered":"2023-12-07T21:13:00.917521+0000","last_clean":"2023-12-07T21:13:00.917521+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:13:00.917521+0000","last_undegraded":"2023-12-07T21:13:00.917521+0000","last_fullsized":"2023-12-07T21:13:00.917521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.917383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:19.507436+0000","scrub_duration":0.0013780719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.318731+0000","last_change":"2023-12-07T21:13:11.318731+0000","last_active":"2023-12-07T21:13:11.318731+0000","last_peered":"2023-12-07T21:13:11.318731+0000","last_clean":"2023-12-07T21:13:11.318731+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:13:11.318731+0000","last_undegraded":"2023-12-07T21:13:11.318731+0000","last_fullsized":"2023-12-07T21:13:11.318731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.318563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:32:03.116436+0000","scrub_duration":0.0013115340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:33.322751+0000","last_change":"2023-12-07T21:12:33.322751+0000","last_active":"2023-12-07T21:12:33.322751+0000","last_peered":"2023-12-07T21:12:33.322751+0000","last_clean":"2023-12-07T21:12:33.322751+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:12:33.322751+0000","last_undegraded":"2023-12-07T21:12:33.322751+0000","last_fullsized":"2023-12-07T21:12:33.322751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_clean_scrub_stamp":"2023-12-07T21:12:33.322634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:25:00.599068+0000","scrub_duration":0.001216778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.401789+0000","last_change":"2023-12-07T21:13:20.401789+0000","last_active":"2023-12-07T21:13:20.401789+0000","last_peered":"2023-12-07T21:13:20.401789+0000","last_clean":"2023-12-07T21:13:20.401789+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:13:20.401789+0000","last_undegraded":"2023-12-07T21:13:20.401789+0000","last_fullsized":"2023-12-07T21:13:20.401789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.401627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.790385+0000","scrub_duration":0.001405433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:32.342446+0000","last_change":"2023-12-07T21:12:32.342446+0000","last_active":"2023-12-07T21:12:32.342446+0000","last_peered":"2023-12-07T21:12:32.342446+0000","last_clean":"2023-12-07T21:12:32.342446+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:12:32.342446+0000","last_undegraded":"2023-12-07T21:12:32.342446+0000","last_fullsized":"2023-12-07T21:12:32.342446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_clean_scrub_stamp":"2023-12-07T21:12:32.342321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:46.648309+0000","scrub_duration":0.0011184750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.810923+0000","last_change":"2023-12-07T21:08:54.875245+0000","last_active":"2023-12-07T21:11:13.810923+0000","last_peered":"2023-12-07T21:11:13.810923+0000","last_clean":"2023-12-07T21:11:13.810923+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:11:13.810923+0000","last_undegraded":"2023-12-07T21:11:13.810923+0000","last_fullsized":"2023-12-07T21:11:13.810923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'16","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.341269+0000","last_change":"2023-12-07T21:12:27.341269+0000","last_active":"2023-12-07T21:12:27.341269+0000","last_peered":"2023-12-07T21:12:27.341269+0000","last_clean":"2023-12-07T21:12:27.341269+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:12:27.341269+0000","last_undegraded":"2023-12-07T21:12:27.341269+0000","last_fullsized":"2023-12-07T21:12:27.341269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.341151+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:55:08.404366+0000","scrub_duration":0.0024774139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.811045+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:11:13.811045+0000","last_peered":"2023-12-07T21:11:13.811045+0000","last_clean":"2023-12-07T21:11:13.811045+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:11:13.811045+0000","last_undegraded":"2023-12-07T21:11:13.811045+0000","last_fullsized":"2023-12-07T21:11:13.811045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:46.318458+0000","last_change":"2023-12-07T21:13:46.318480+0000","last_active":"2023-12-07T21:13:46.318458+0000","last_peered":"2023-12-07T21:13:46.318458+0000","last_clean":"2023-12-07T21:13:46.318458+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:13:46.318458+0000","last_undegraded":"2023-12-07T21:13:46.318458+0000","last_fullsized":"2023-12-07T21:13:46.318458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:46.318375+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:46.318375+0000","last_clean_scrub_stamp":"2023-12-07T21:13:46.318375+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:20:30.826377+0000","scrub_duration":0.001152574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.462656+0000","last_change":"2023-12-07T21:12:54.462656+0000","last_active":"2023-12-07T21:12:54.462656+0000","last_peered":"2023-12-07T21:12:54.462656+0000","last_clean":"2023-12-07T21:12:54.462656+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:12:54.462656+0000","last_undegraded":"2023-12-07T21:12:54.462656+0000","last_fullsized":"2023-12-07T21:12:54.462656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.462543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:12:35.524119+0000","scrub_duration":0.0012396099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:01.404048+0000","last_change":"2023-12-07T21:12:01.404048+0000","last_active":"2023-12-07T21:12:01.404048+0000","last_peered":"2023-12-07T21:12:01.404048+0000","last_clean":"2023-12-07T21:12:01.404048+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:12:01.404048+0000","last_undegraded":"2023-12-07T21:12:01.404048+0000","last_fullsized":"2023-12-07T21:12:01.404048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_clean_scrub_stamp":"2023-12-07T21:12:01.403925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:06:41.638050+0000","scrub_duration":0.0014963070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812768+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:11:18.812768+0000","last_peered":"2023-12-07T21:11:18.812768+0000","last_clean":"2023-12-07T21:11:18.812768+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:11:18.812768+0000","last_undegraded":"2023-12-07T21:11:18.812768+0000","last_fullsized":"2023-12-07T21:11:18.812768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811892+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:11:18.811892+0000","last_peered":"2023-12-07T21:11:18.811892+0000","last_clean":"2023-12-07T21:11:18.811892+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:11:18.811892+0000","last_undegraded":"2023-12-07T21:11:18.811892+0000","last_fullsized":"2023-12-07T21:11:18.811892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.806164+0000","last_change":"2023-12-07T21:08:56.883296+0000","last_active":"2023-12-07T21:11:23.806164+0000","last_peered":"2023-12-07T21:11:23.806164+0000","last_clean":"2023-12-07T21:11:23.806164+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:11:23.806164+0000","last_undegraded":"2023-12-07T21:11:23.806164+0000","last_fullsized":"2023-12-07T21:11:23.806164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.910417+0000","last_change":"2023-12-07T21:13:05.910417+0000","last_active":"2023-12-07T21:13:05.910417+0000","last_peered":"2023-12-07T21:13:05.910417+0000","last_clean":"2023-12-07T21:13:05.910417+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:13:05.910417+0000","last_undegraded":"2023-12-07T21:13:05.910417+0000","last_fullsized":"2023-12-07T21:13:05.910417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.910299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:31:57.708172+0000","scrub_duration":0.001525988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.272208+0000","last_change":"2023-12-07T21:12:56.272208+0000","last_active":"2023-12-07T21:12:56.272208+0000","last_peered":"2023-12-07T21:12:56.272208+0000","last_clean":"2023-12-07T21:12:56.272208+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:12:56.272208+0000","last_undegraded":"2023-12-07T21:12:56.272208+0000","last_fullsized":"2023-12-07T21:12:56.272208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.272079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:16.868178+0000","scrub_duration":0.0010823779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1971,"ondisk_log_size":1971,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1439,"ondisk_log_size":1439,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705730,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.42499999999999999},"min":{"1min":0.32100000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.56399999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.35999999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56999999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Dec 7 21:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32900000000000001,"15min":0.34100000000000003},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.434,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.379},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.24099999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44800000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Dec 7 21:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.26600000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.51000000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.33100000000000002,"15min":0.33600000000000002},"min":{"1min":0.251,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.47499999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.34499999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705729,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.30399999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.42899999999999999,"15min":0.43099999999999999},"min":{"1min":0.30599999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.56899999999999995,"5min":0.621,"15min":0.621},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.32900000000000001,"15min":0.32100000000000001},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48899999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.308,"5min":0.32500000000000001,"15min":0.33200000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.42299999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.24099999999999999}]},{"osd":3,"last update":"Thu Dec 7 21:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32700000000000001,"15min":0.32900000000000001},"min":{"1min":0.245,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.40200000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36199999999999999,"15min":0.36699999999999999},"min":{"1min":0.26600000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.44900000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.28899999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705729,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45100000000000001,"15min":0.45500000000000002},"min":{"1min":0.27600000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.56100000000000005,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45800000000000002,"15min":0.46700000000000003},"min":{"1min":0.32400000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.57799999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.371}]},{"osd":2,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.33800000000000002,"15min":0.35799999999999998},"min":{"1min":0.20200000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.39600000000000002,"5min":0.629,"15min":0.629},"last":0.31},{"interface":"front","average":{"1min":0.31,"5min":0.32300000000000001,"15min":0.32600000000000001},"min":{"1min":0.214,"5min":0.186,"15min":0.186},"max":{"1min":0.5,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.24399999999999999}]},{"osd":3,"last update":"Thu Dec 7 21:12:45 2023","interfaces":[{"interface":"back","average":{"1min":0.312,"5min":0.33400000000000002,"15min":0.34200000000000003},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.43099999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36299999999999999,"15min":0.376},"min":{"1min":0.25600000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.46200000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.26600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.495},"min":{"1min":0.22800000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.67700000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28299999999999997,"5min":0.191,"15min":0.191},"max":{"1min":0.68100000000000005,"5min":0.747,"15min":0.747},"last":0.498}]},{"osd":2,"last update":"Thu Dec 7 21:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.503,"15min":0.48499999999999999},"min":{"1min":0.26900000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.503,"15min":0.48099999999999998},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Dec 7 21:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.5,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.67500000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.504,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:13:53.823 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.823 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.823 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.824 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.824 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.824 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.824 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.824 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.825 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.825 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.825 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.825 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.825 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.826 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.826 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.826 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.826 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.826 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.826 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.827 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.827 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.827 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.827 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.827 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.827 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.828 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.828 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.828 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.828 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.828 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.828 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.829 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.829 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.829 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.829 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.829 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.830 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.830 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.830 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.830 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.830 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.831 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.831 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.831 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.831 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.831 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.832 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.832 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.832 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.832 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.833 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.833 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.833 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.833 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.833 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.834 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.834 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.834 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.835 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.835 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.835 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.835 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.835 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.835 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:13:53.836 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:14:13.837 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:14:13.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.957+0000 7f3d4a0e7640 1 Processor -- start 2023-12-07T21:14:13.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.957+0000 7f3d4a0e7640 1 -- start start 2023-12-07T21:14:13.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.958+0000 7f3d4a0e7640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3d4412a5a0 0x7f3d4412a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:14:13.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.958+0000 7f3d4a0e7640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4412a1e0 con 0x7f3d4412aec0 2023-12-07T21:14:13.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.958+0000 7f3d4a0e7640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4406f890 con 0x7f3d4412a5a0 2023-12-07T21:14:13.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.958+0000 7f3d42ffd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3d4412aec0 0x7f3d44126ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35952/0 (socket says 172.21.15.89:35952) 2023-12-07T21:14:13.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.958+0000 7f3d42ffd640 1 -- 172.21.15.89:0/3568874627 learned_addr learned my addr 172.21.15.89:0/3568874627 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:14:13.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.958+0000 7f3d437fe640 1 --2- 172.21.15.89:0/3568874627 >> v2:172.21.15.89:3300/0 conn(0x7f3d4412a5a0 0x7f3d4412a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:14:13.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.958+0000 7f3d427fc640 1 -- 172.21.15.89:0/3568874627 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437274981 0 0) 0x7f3d4412a1e0 con 0x7f3d4412aec0 2023-12-07T21:14:13.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.958+0000 7f3d427fc640 1 -- 172.21.15.89:0/3568874627 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d2c003520 con 0x7f3d4412aec0 2023-12-07T21:14:13.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.958+0000 7f3d437fe640 1 -- 172.21.15.89:0/3568874627 >> v1:172.21.15.89:6789/0 conn(0x7f3d4412aec0 legacy=0x7f3d44126ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:13.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.958+0000 7f3d437fe640 1 -- 172.21.15.89:0/3568874627 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4406f220 con 0x7f3d4412a5a0 2023-12-07T21:14:13.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.959+0000 7f3d437fe640 1 --2- 172.21.15.89:0/3568874627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d4412a5a0 0x7f3d4412a980 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009720 tx=0x7f3d3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8eadfa1c457a7c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:14:13.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.959+0000 7f3d427fc640 1 -- 172.21.15.89:0/3568874627 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d34031760 con 0x7f3d4412a5a0 2023-12-07T21:14:13.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.959+0000 7f3d427fc640 1 -- 172.21.15.89:0/3568874627 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d340318c0 con 0x7f3d4412a5a0 2023-12-07T21:14:13.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.959+0000 7f3d427fc640 1 -- 172.21.15.89:0/3568874627 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d34031b80 con 0x7f3d4412a5a0 2023-12-07T21:14:13.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.959+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/3568874627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d4412a5a0 msgr2=0x7f3d4412a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.959+0000 7f3d4a0e7640 1 --2- 172.21.15.89:0/3568874627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d4412a5a0 0x7f3d4412a980 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009720 tx=0x7f3d3402b8d0 comp rx=0 tx=0).stop 2023-12-07T21:14:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.960+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/3568874627 shutdown_connections 2023-12-07T21:14:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.960+0000 7f3d4a0e7640 1 --2- 172.21.15.89:0/3568874627 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d4412a5a0 0x7f3d4412a980 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:14:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.960+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/3568874627 >> 172.21.15.89:0/3568874627 conn(0x7f3d440987f0 msgr2=0x7f3d44098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:14:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.960+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/3568874627 shutdown_connections 2023-12-07T21:14:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.960+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/3568874627 wait complete. 2023-12-07T21:14:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.960+0000 7f3d4a0e7640 1 Processor -- start 2023-12-07T21:14:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.961+0000 7f3d4a0e7640 1 -- start start 2023-12-07T21:14:13.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.961+0000 7f3d4a0e7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d4412a5a0 0x7f3d441c0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:14:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.961+0000 7f3d4a0e7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4408e020 con 0x7f3d4412a5a0 2023-12-07T21:14:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.961+0000 7f3d437fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d4412a5a0 0x7f3d441c0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:14:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.961+0000 7f3d437fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d4412a5a0 0x7f3d441c0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49850/0 (socket says 172.21.15.89:49850) 2023-12-07T21:14:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.961+0000 7f3d437fe640 1 -- 172.21.15.89:0/1781422558 learned_addr learned my addr 172.21.15.89:0/1781422558 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:14:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.961+0000 7f3d437fe640 1 -- 172.21.15.89:0/1781422558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d34009400 con 0x7f3d4412a5a0 2023-12-07T21:14:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.961+0000 7f3d437fe640 1 --2- 172.21.15.89:0/1781422558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d4412a5a0 0x7f3d441c0370 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3d34000c00 tx=0x7f3d340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:14:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.961+0000 7f3d2bfff640 1 -- 172.21.15.89:0/1781422558 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d3403a760 con 0x7f3d4412a5a0 2023-12-07T21:14:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.962+0000 7f3d2bfff640 1 -- 172.21.15.89:0/1781422558 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3403a8c0 con 0x7f3d4412a5a0 2023-12-07T21:14:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.962+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/1781422558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4406eb70 con 0x7f3d4412a5a0 2023-12-07T21:14:13.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.962+0000 7f3d2bfff640 1 -- 172.21.15.89:0/1781422558 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d3403aba0 con 0x7f3d4412a5a0 2023-12-07T21:14:13.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.962+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/1781422558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4408c4c0 con 0x7f3d4412a5a0 2023-12-07T21:14:13.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.962+0000 7f3d2bfff640 1 -- 172.21.15.89:0/1781422558 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f3d3403ad00 con 0x7f3d4412a5a0 2023-12-07T21:14:13.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.963+0000 7f3d2bfff640 1 --2- 172.21.15.89:0/1781422558 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3d30037850 0x7f3d30039d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:14:13.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.963+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/1781422558 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4408cec0 con 0x7f3d4412a5a0 2023-12-07T21:14:13.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.963+0000 7f3d2bfff640 1 -- 172.21.15.89:0/1781422558 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f3d3406cc00 con 0x7f3d4412a5a0 2023-12-07T21:14:13.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.963+0000 7f3d42ffd640 1 --2- 172.21.15.89:0/1781422558 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3d30037850 0x7f3d30039d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:14:13.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.963+0000 7f3d42ffd640 1 --2- 172.21.15.89:0/1781422558 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3d30037850 0x7f3d30039d10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3d38001610 tx=0x7f3d38007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:14:13.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:13.967+0000 7f3d2bfff640 1 -- 172.21.15.89:0/1781422558 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d34042370 con 0x7f3d4412a5a0 2023-12-07T21:14:14.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.129+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/1781422558 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d44070000 con 0x7f3d30037850 2023-12-07T21:14:14.135 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.145+0000 7f3d2bfff640 1 -- 172.21.15.89:0/1781422558 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+675891 (secure 0 0 0) 0x7f3d380058b0 con 0x7f3d30037850 2023-12-07T21:14:14.142 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:14:14.148 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:14:14.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.149+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/1781422558 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3d30037850 msgr2=0x7f3d30039d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:14.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.149+0000 7f3d4a0e7640 1 --2- 172.21.15.89:0/1781422558 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3d30037850 0x7f3d30039d10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3d38001610 tx=0x7f3d38007970 comp rx=0 tx=0).stop 2023-12-07T21:14:14.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.149+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/1781422558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d4412a5a0 msgr2=0x7f3d441c0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:14.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.149+0000 7f3d4a0e7640 1 --2- 172.21.15.89:0/1781422558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d4412a5a0 0x7f3d441c0370 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3d34000c00 tx=0x7f3d340046c0 comp rx=0 tx=0).stop 2023-12-07T21:14:14.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.149+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/1781422558 shutdown_connections 2023-12-07T21:14:14.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.149+0000 7f3d4a0e7640 1 --2- 172.21.15.89:0/1781422558 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f3d30037850 0x7f3d30039d10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:14:14.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.149+0000 7f3d4a0e7640 1 --2- 172.21.15.89:0/1781422558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d4412a5a0 0x7f3d441c0370 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:14:14.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.149+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/1781422558 >> 172.21.15.89:0/1781422558 conn(0x7f3d440987f0 msgr2=0x7f3d4409a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:14:14.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.149+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/1781422558 shutdown_connections 2023-12-07T21:14:14.151 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:14.149+0000 7f3d4a0e7640 1 -- 172.21.15.89:0/1781422558 wait complete. 2023-12-07T21:14:14.151 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2023-12-07T21:14:12.149013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1822,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4022,"ondisk_log_size":4022,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003941"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:19.413104+0000","last_change":"2023-12-07T21:13:19.413127+0000","last_active":"2023-12-07T21:13:19.413104+0000","last_peered":"2023-12-07T21:13:19.413104+0000","last_clean":"2023-12-07T21:13:19.413104+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:13:19.413104+0000","last_undegraded":"2023-12-07T21:13:19.413104+0000","last_fullsized":"2023-12-07T21:13:19.413104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_clean_scrub_stamp":"2023-12-07T21:13:19.413017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:51.122054+0000","scrub_duration":0.001250333,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.407256+0000","last_change":"2023-12-07T21:12:16.407256+0000","last_active":"2023-12-07T21:12:16.407256+0000","last_peered":"2023-12-07T21:12:16.407256+0000","last_clean":"2023-12-07T21:12:16.407256+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:12:16.407256+0000","last_undegraded":"2023-12-07T21:12:16.407256+0000","last_fullsized":"2023-12-07T21:12:16.407256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.407151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:53.647151+0000","scrub_duration":0.00097124400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.079685+0000","last_change":"2023-12-07T21:13:28.079732+0000","last_active":"2023-12-07T21:13:28.079685+0000","last_peered":"2023-12-07T21:13:28.079685+0000","last_clean":"2023-12-07T21:13:28.079685+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:13:28.079685+0000","last_undegraded":"2023-12-07T21:13:28.079685+0000","last_fullsized":"2023-12-07T21:13:28.079685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.079572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:44:03.747216+0000","scrub_duration":0.0011377760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345425+0000","last_change":"2023-12-07T21:09:35.948350+0000","last_active":"2023-12-07T21:11:09.345425+0000","last_peered":"2023-12-07T21:11:09.345425+0000","last_clean":"2023-12-07T21:11:09.345425+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:11:09.345425+0000","last_undegraded":"2023-12-07T21:11:09.345425+0000","last_fullsized":"2023-12-07T21:11:09.345425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607997+0000","last_change":"2023-12-07T21:08:54.892715+0000","last_active":"2023-12-07T21:11:10.607997+0000","last_peered":"2023-12-07T21:11:10.607997+0000","last_clean":"2023-12-07T21:11:10.607997+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:11:10.607997+0000","last_undegraded":"2023-12-07T21:11:10.607997+0000","last_fullsized":"2023-12-07T21:11:10.607997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.314629+0000","last_change":"2023-12-07T21:13:48.314629+0000","last_active":"2023-12-07T21:13:48.314629+0000","last_peered":"2023-12-07T21:13:48.314629+0000","last_clean":"2023-12-07T21:13:48.314629+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:13:48.314629+0000","last_undegraded":"2023-12-07T21:13:48.314629+0000","last_fullsized":"2023-12-07T21:13:48.314629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:48.314524+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:48.314524+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.314524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:17:28.252223+0000","scrub_duration":0.00098961300000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:39.350102+0000","last_change":"2023-12-07T21:13:39.350144+0000","last_active":"2023-12-07T21:13:39.350102+0000","last_peered":"2023-12-07T21:13:39.350102+0000","last_clean":"2023-12-07T21:13:39.350102+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:13:39.350102+0000","last_undegraded":"2023-12-07T21:13:39.350102+0000","last_fullsized":"2023-12-07T21:13:39.350102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:39.350003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:39.350003+0000","last_clean_scrub_stamp":"2023-12-07T21:13:39.350003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:26:22.544329+0000","scrub_duration":0.0013539439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:32.502187+0000","last_change":"2023-12-07T21:13:32.502187+0000","last_active":"2023-12-07T21:13:32.502187+0000","last_peered":"2023-12-07T21:13:32.502187+0000","last_clean":"2023-12-07T21:13:32.502187+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:13:32.502187+0000","last_undegraded":"2023-12-07T21:13:32.502187+0000","last_fullsized":"2023-12-07T21:13:32.502187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:32.502047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:32.502047+0000","last_clean_scrub_stamp":"2023-12-07T21:13:32.502047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:14:30.083430+0000","scrub_duration":0.001154356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814800+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:11:28.814800+0000","last_peered":"2023-12-07T21:11:28.814800+0000","last_clean":"2023-12-07T21:11:28.814800+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:11:28.814800+0000","last_undegraded":"2023-12-07T21:11:28.814800+0000","last_fullsized":"2023-12-07T21:11:28.814800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:39.304151+0000","last_change":"2023-12-07T21:12:39.304151+0000","last_active":"2023-12-07T21:12:39.304151+0000","last_peered":"2023-12-07T21:12:39.304151+0000","last_clean":"2023-12-07T21:12:39.304151+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:12:39.304151+0000","last_undegraded":"2023-12-07T21:12:39.304151+0000","last_fullsized":"2023-12-07T21:12:39.304151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_clean_scrub_stamp":"2023-12-07T21:12:39.304039+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:10.499475+0000","scrub_duration":0.0026021579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:35.274268+0000","last_change":"2023-12-07T21:13:35.274268+0000","last_active":"2023-12-07T21:13:35.274268+0000","last_peered":"2023-12-07T21:13:35.274268+0000","last_clean":"2023-12-07T21:13:35.274268+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:13:35.274268+0000","last_undegraded":"2023-12-07T21:13:35.274268+0000","last_fullsized":"2023-12-07T21:13:35.274268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:35.274152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:35.274152+0000","last_clean_scrub_stamp":"2023-12-07T21:13:35.274152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:55:25.519724+0000","scrub_duration":0.0012329559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.817727+0000","last_change":"2023-12-07T21:09:35.955752+0000","last_active":"2023-12-07T21:11:43.817727+0000","last_peered":"2023-12-07T21:11:43.817727+0000","last_clean":"2023-12-07T21:11:43.817727+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:11:43.817727+0000","last_undegraded":"2023-12-07T21:11:43.817727+0000","last_fullsized":"2023-12-07T21:11:43.817727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814572+0000","last_change":"2023-12-07T21:08:54.876223+0000","last_active":"2023-12-07T21:11:28.814572+0000","last_peered":"2023-12-07T21:11:28.814572+0000","last_clean":"2023-12-07T21:11:28.814572+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:11:28.814572+0000","last_undegraded":"2023-12-07T21:11:28.814572+0000","last_fullsized":"2023-12-07T21:11:28.814572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.406511+0000","last_change":"2023-12-07T21:13:54.406569+0000","last_active":"2023-12-07T21:13:54.406511+0000","last_peered":"2023-12-07T21:13:54.406511+0000","last_clean":"2023-12-07T21:13:54.406511+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:13:54.406511+0000","last_undegraded":"2023-12-07T21:13:54.406511+0000","last_fullsized":"2023-12-07T21:13:54.406511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:54.406416+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:54.406416+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.406416+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:23:33.794119+0000","scrub_duration":0.001131316,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.845908+0000","last_change":"2023-12-07T21:12:54.845908+0000","last_active":"2023-12-07T21:12:54.845908+0000","last_peered":"2023-12-07T21:12:54.845908+0000","last_clean":"2023-12-07T21:12:54.845908+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:12:54.845908+0000","last_undegraded":"2023-12-07T21:12:54.845908+0000","last_fullsized":"2023-12-07T21:12:54.845908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.845780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:05.129794+0000","scrub_duration":0.001437123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'14","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.396728+0000","last_change":"2023-12-07T21:12:49.396728+0000","last_active":"2023-12-07T21:12:49.396728+0000","last_peered":"2023-12-07T21:12:49.396728+0000","last_clean":"2023-12-07T21:12:49.396728+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:12:49.396728+0000","last_undegraded":"2023-12-07T21:12:49.396728+0000","last_fullsized":"2023-12-07T21:12:49.396728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.396576+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:24:16.481666+0000","scrub_duration":0.0022819030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.406138+0000","last_change":"2023-12-07T21:13:44.406161+0000","last_active":"2023-12-07T21:13:44.406138+0000","last_peered":"2023-12-07T21:13:44.406138+0000","last_clean":"2023-12-07T21:13:44.406138+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:13:44.406138+0000","last_undegraded":"2023-12-07T21:13:44.406138+0000","last_fullsized":"2023-12-07T21:13:44.406138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:44.406055+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:44.406055+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.406055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:05:23.635609+0000","scrub_duration":0.001103677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:46.400680+0000","last_change":"2023-12-07T21:12:46.400680+0000","last_active":"2023-12-07T21:12:46.400680+0000","last_peered":"2023-12-07T21:12:46.400680+0000","last_clean":"2023-12-07T21:12:46.400680+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:12:46.400680+0000","last_undegraded":"2023-12-07T21:12:46.400680+0000","last_fullsized":"2023-12-07T21:12:46.400680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_clean_scrub_stamp":"2023-12-07T21:12:46.400562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:25.935064+0000","scrub_duration":0.001127915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:34.273474+0000","last_change":"2023-12-07T21:12:34.273474+0000","last_active":"2023-12-07T21:12:34.273474+0000","last_peered":"2023-12-07T21:12:34.273474+0000","last_clean":"2023-12-07T21:12:34.273474+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:12:34.273474+0000","last_undegraded":"2023-12-07T21:12:34.273474+0000","last_fullsized":"2023-12-07T21:12:34.273474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_clean_scrub_stamp":"2023-12-07T21:12:34.273360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:01:32.940162+0000","scrub_duration":0.0011278239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.451445+0000","last_change":"2023-12-07T21:12:52.451445+0000","last_active":"2023-12-07T21:12:52.451445+0000","last_peered":"2023-12-07T21:12:52.451445+0000","last_clean":"2023-12-07T21:12:52.451445+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:12:52.451445+0000","last_undegraded":"2023-12-07T21:12:52.451445+0000","last_fullsized":"2023-12-07T21:12:52.451445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.451316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:57.500148+0000","scrub_duration":0.001350272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.263073+0000","last_change":"2023-12-07T21:13:14.263073+0000","last_active":"2023-12-07T21:13:14.263073+0000","last_peered":"2023-12-07T21:13:14.263073+0000","last_clean":"2023-12-07T21:13:14.263073+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:13:14.263073+0000","last_undegraded":"2023-12-07T21:13:14.263073+0000","last_fullsized":"2023-12-07T21:13:14.263073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.262960+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:28.327063+0000","scrub_duration":0.0023679700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:16.262731+0000","last_change":"2023-12-07T21:13:16.262731+0000","last_active":"2023-12-07T21:13:16.262731+0000","last_peered":"2023-12-07T21:13:16.262731+0000","last_clean":"2023-12-07T21:13:16.262731+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:13:16.262731+0000","last_undegraded":"2023-12-07T21:13:16.262731+0000","last_fullsized":"2023-12-07T21:13:16.262731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_clean_scrub_stamp":"2023-12-07T21:13:16.262599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:56:19.678023+0000","scrub_duration":0.001231251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:40.827245+0000","last_change":"2023-12-07T21:12:40.827245+0000","last_active":"2023-12-07T21:12:40.827245+0000","last_peered":"2023-12-07T21:12:40.827245+0000","last_clean":"2023-12-07T21:12:40.827245+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:12:40.827245+0000","last_undegraded":"2023-12-07T21:12:40.827245+0000","last_fullsized":"2023-12-07T21:12:40.827245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_clean_scrub_stamp":"2023-12-07T21:12:40.827135+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:20.361638+0000","scrub_duration":0.0013685839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:31.449807+0000","last_change":"2023-12-07T21:13:31.449807+0000","last_active":"2023-12-07T21:13:31.449807+0000","last_peered":"2023-12-07T21:13:31.449807+0000","last_clean":"2023-12-07T21:13:31.449807+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:13:31.449807+0000","last_undegraded":"2023-12-07T21:13:31.449807+0000","last_fullsized":"2023-12-07T21:13:31.449807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:31.449683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:31.449683+0000","last_clean_scrub_stamp":"2023-12-07T21:13:31.449683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:54:42.768855+0000","scrub_duration":0.001302246,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:53.488138+0000","last_change":"2023-12-07T21:12:53.488138+0000","last_active":"2023-12-07T21:12:53.488138+0000","last_peered":"2023-12-07T21:12:53.488138+0000","last_clean":"2023-12-07T21:12:53.488138+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:12:53.488138+0000","last_undegraded":"2023-12-07T21:12:53.488138+0000","last_fullsized":"2023-12-07T21:12:53.488138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_clean_scrub_stamp":"2023-12-07T21:12:53.488022+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:20:06.706860+0000","scrub_duration":0.0010715880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.914123+0000","last_change":"2023-12-07T21:12:58.914123+0000","last_active":"2023-12-07T21:12:58.914123+0000","last_peered":"2023-12-07T21:12:58.914123+0000","last_clean":"2023-12-07T21:12:58.914123+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:12:58.914123+0000","last_undegraded":"2023-12-07T21:12:58.914123+0000","last_fullsized":"2023-12-07T21:12:58.914123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.913992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:18.497979+0000","scrub_duration":0.0013136269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.336936+0000","last_change":"2023-12-07T21:12:23.336936+0000","last_active":"2023-12-07T21:12:23.336936+0000","last_peered":"2023-12-07T21:12:23.336936+0000","last_clean":"2023-12-07T21:12:23.336936+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:12:23.336936+0000","last_undegraded":"2023-12-07T21:12:23.336936+0000","last_fullsized":"2023-12-07T21:12:23.336936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.336820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:54.775680+0000","scrub_duration":0.0015463409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812173+0000","last_change":"2023-12-07T21:08:54.876719+0000","last_active":"2023-12-07T21:11:18.812173+0000","last_peered":"2023-12-07T21:11:18.812173+0000","last_clean":"2023-12-07T21:11:18.812173+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:11:18.812173+0000","last_undegraded":"2023-12-07T21:11:18.812173+0000","last_fullsized":"2023-12-07T21:11:18.812173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'22","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.448678+0000","last_change":"2023-12-07T21:13:44.448678+0000","last_active":"2023-12-07T21:13:44.448678+0000","last_peered":"2023-12-07T21:13:44.448678+0000","last_clean":"2023-12-07T21:13:44.448678+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:13:44.448678+0000","last_undegraded":"2023-12-07T21:13:44.448678+0000","last_fullsized":"2023-12-07T21:13:44.448678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:13:44.448523+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:13:44.448523+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.448523+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:44:57.772201+0000","scrub_duration":0.0035836259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.461414+0000","last_change":"2023-12-07T21:12:20.461414+0000","last_active":"2023-12-07T21:12:20.461414+0000","last_peered":"2023-12-07T21:12:20.461414+0000","last_clean":"2023-12-07T21:12:20.461414+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:12:20.461414+0000","last_undegraded":"2023-12-07T21:12:20.461414+0000","last_fullsized":"2023-12-07T21:12:20.461414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.461275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:11:30.745289+0000","scrub_duration":0.0012528039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812279+0000","last_change":"2023-12-07T21:08:54.886014+0000","last_active":"2023-12-07T21:11:18.812279+0000","last_peered":"2023-12-07T21:11:18.812279+0000","last_clean":"2023-12-07T21:11:18.812279+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:11:18.812279+0000","last_undegraded":"2023-12-07T21:11:18.812279+0000","last_fullsized":"2023-12-07T21:11:18.812279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":115,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813687+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:23.813687+0000","last_peered":"2023-12-07T21:11:23.813687+0000","last_clean":"2023-12-07T21:11:23.813687+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:23.813687+0000","last_undegraded":"2023-12-07T21:11:23.813687+0000","last_fullsized":"2023-12-07T21:11:23.813687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:03.666683+0000","last_change":"2023-12-07T21:13:03.666683+0000","last_active":"2023-12-07T21:13:03.666683+0000","last_peered":"2023-12-07T21:13:03.666683+0000","last_clean":"2023-12-07T21:13:03.666683+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:13:03.666683+0000","last_undegraded":"2023-12-07T21:13:03.666683+0000","last_fullsized":"2023-12-07T21:13:03.666683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_clean_scrub_stamp":"2023-12-07T21:13:03.666541+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:29:58.918173+0000","scrub_duration":0.0039456209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.345086+0000","last_change":"2023-12-07T21:12:18.345086+0000","last_active":"2023-12-07T21:12:18.345086+0000","last_peered":"2023-12-07T21:12:18.345086+0000","last_clean":"2023-12-07T21:12:18.345086+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:12:18.345086+0000","last_undegraded":"2023-12-07T21:12:18.345086+0000","last_fullsized":"2023-12-07T21:12:18.345086+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.344968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:53:47.984483+0000","scrub_duration":0.00095218699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:26.318843+0000","last_change":"2023-12-07T21:12:26.318843+0000","last_active":"2023-12-07T21:12:26.318843+0000","last_peered":"2023-12-07T21:12:26.318843+0000","last_clean":"2023-12-07T21:12:26.318843+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:12:26.318843+0000","last_undegraded":"2023-12-07T21:12:26.318843+0000","last_fullsized":"2023-12-07T21:12:26.318843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:26.318685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:21.073203+0000","scrub_duration":0.0010887360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.618014+0000","last_change":"2023-12-07T21:13:07.618014+0000","last_active":"2023-12-07T21:13:07.618014+0000","last_peered":"2023-12-07T21:13:07.618014+0000","last_clean":"2023-12-07T21:13:07.618014+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:13:07.618014+0000","last_undegraded":"2023-12-07T21:13:07.618014+0000","last_fullsized":"2023-12-07T21:13:07.618014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.617909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:13.457658+0000","scrub_duration":0.001206459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:46.387428+0000","last_change":"2023-12-07T21:13:46.387471+0000","last_active":"2023-12-07T21:13:46.387428+0000","last_peered":"2023-12-07T21:13:46.387428+0000","last_clean":"2023-12-07T21:13:46.387428+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:13:46.387428+0000","last_undegraded":"2023-12-07T21:13:46.387428+0000","last_fullsized":"2023-12-07T21:13:46.387428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:46.387320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:46.387320+0000","last_clean_scrub_stamp":"2023-12-07T21:13:46.387320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:00.451423+0000","scrub_duration":0.0012501120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.830085+0000","last_change":"2023-12-07T21:11:53.830085+0000","last_active":"2023-12-07T21:11:53.830085+0000","last_peered":"2023-12-07T21:11:53.830085+0000","last_clean":"2023-12-07T21:11:53.830085+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:53.830085+0000","last_undegraded":"2023-12-07T21:11:53.830085+0000","last_fullsized":"2023-12-07T21:11:53.830085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_clean_scrub_stamp":"2023-12-07T21:11:53.829969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:45.205269+0000","scrub_duration":0.001216066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814302+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:28.814302+0000","last_peered":"2023-12-07T21:11:28.814302+0000","last_clean":"2023-12-07T21:11:28.814302+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:28.814302+0000","last_undegraded":"2023-12-07T21:11:28.814302+0000","last_fullsized":"2023-12-07T21:11:28.814302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.304137+0000","last_change":"2023-12-07T21:11:42.304137+0000","last_active":"2023-12-07T21:11:42.304137+0000","last_peered":"2023-12-07T21:11:42.304137+0000","last_clean":"2023-12-07T21:11:42.304137+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:42.304137+0000","last_undegraded":"2023-12-07T21:11:42.304137+0000","last_fullsized":"2023-12-07T21:11:42.304137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.304031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:14.639583+0000","scrub_duration":0.0010594929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:31.746769+0000","last_change":"2023-12-07T21:12:31.746769+0000","last_active":"2023-12-07T21:12:31.746769+0000","last_peered":"2023-12-07T21:12:31.746769+0000","last_clean":"2023-12-07T21:12:31.746769+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:12:31.746769+0000","last_undegraded":"2023-12-07T21:12:31.746769+0000","last_fullsized":"2023-12-07T21:12:31.746769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_clean_scrub_stamp":"2023-12-07T21:12:31.746658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:02.942094+0000","scrub_duration":0.00135096,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.511164+0000","last_change":"2023-12-07T21:13:14.511164+0000","last_active":"2023-12-07T21:13:14.511164+0000","last_peered":"2023-12-07T21:13:14.511164+0000","last_clean":"2023-12-07T21:13:14.511164+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:13:14.511164+0000","last_undegraded":"2023-12-07T21:13:14.511164+0000","last_fullsized":"2023-12-07T21:13:14.511164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.511066+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:07.222427+0000","scrub_duration":0.0030400240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812011+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:11:18.812011+0000","last_peered":"2023-12-07T21:11:18.812011+0000","last_clean":"2023-12-07T21:11:18.812011+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:11:18.812011+0000","last_undegraded":"2023-12-07T21:11:18.812011+0000","last_fullsized":"2023-12-07T21:11:18.812011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.707102+0000","last_change":"2023-12-07T21:11:58.707102+0000","last_active":"2023-12-07T21:11:58.707102+0000","last_peered":"2023-12-07T21:11:58.707102+0000","last_clean":"2023-12-07T21:11:58.707102+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:58.707102+0000","last_undegraded":"2023-12-07T21:11:58.707102+0000","last_fullsized":"2023-12-07T21:11:58.707102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.706965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:56:05.594599+0000","scrub_duration":0.0011023249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.554062+0000","last_change":"2023-12-07T21:11:35.554062+0000","last_active":"2023-12-07T21:11:35.554062+0000","last_peered":"2023-12-07T21:11:35.554062+0000","last_clean":"2023-12-07T21:11:35.554062+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:35.554062+0000","last_undegraded":"2023-12-07T21:11:35.554062+0000","last_fullsized":"2023-12-07T21:11:35.554062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.553946+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:56.699897+0000","scrub_duration":0.0042775269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'247","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:50.595156+0000","last_change":"2023-12-07T21:12:50.595156+0000","last_active":"2023-12-07T21:12:50.595156+0000","last_peered":"2023-12-07T21:12:50.595156+0000","last_clean":"2023-12-07T21:12:50.595156+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:12:50.595156+0000","last_undegraded":"2023-12-07T21:12:50.595156+0000","last_fullsized":"2023-12-07T21:12:50.595156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_clean_scrub_stamp":"2023-12-07T21:12:50.595047+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:57:35.203698+0000","scrub_duration":0.0029719099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.816330+0000","last_change":"2023-12-07T21:09:04.928457+0000","last_active":"2023-12-07T21:11:38.816330+0000","last_peered":"2023-12-07T21:11:38.816330+0000","last_clean":"2023-12-07T21:11:38.816330+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:11:38.816330+0000","last_undegraded":"2023-12-07T21:11:38.816330+0000","last_fullsized":"2023-12-07T21:11:38.816330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.764650+0000","last_change":"2023-12-07T21:12:27.764650+0000","last_active":"2023-12-07T21:12:27.764650+0000","last_peered":"2023-12-07T21:12:27.764650+0000","last_clean":"2023-12-07T21:12:27.764650+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:12:27.764650+0000","last_undegraded":"2023-12-07T21:12:27.764650+0000","last_fullsized":"2023-12-07T21:12:27.764650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.764507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:17:01.731572+0000","scrub_duration":0.0015146649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.348644+0000","last_change":"2023-12-07T21:13:00.348644+0000","last_active":"2023-12-07T21:13:00.348644+0000","last_peered":"2023-12-07T21:13:00.348644+0000","last_clean":"2023-12-07T21:13:00.348644+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:13:00.348644+0000","last_undegraded":"2023-12-07T21:13:00.348644+0000","last_fullsized":"2023-12-07T21:13:00.348644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.348476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:10.632490+0000","scrub_duration":0.001405367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813847+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:23.813847+0000","last_peered":"2023-12-07T21:11:23.813847+0000","last_clean":"2023-12-07T21:11:23.813847+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:23.813847+0000","last_undegraded":"2023-12-07T21:11:23.813847+0000","last_fullsized":"2023-12-07T21:11:23.813847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:29.600086+0000","last_change":"2023-12-07T21:11:29.600086+0000","last_active":"2023-12-07T21:11:29.600086+0000","last_peered":"2023-12-07T21:11:29.600086+0000","last_clean":"2023-12-07T21:11:29.600086+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:29.600086+0000","last_undegraded":"2023-12-07T21:11:29.600086+0000","last_fullsized":"2023-12-07T21:11:29.600086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_clean_scrub_stamp":"2023-12-07T21:11:29.599963+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:30:03.772118+0000","scrub_duration":0.003554771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'247","reported_seq":341,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:02.790465+0000","last_change":"2023-12-07T21:12:02.790465+0000","last_active":"2023-12-07T21:12:02.790465+0000","last_peered":"2023-12-07T21:12:02.790465+0000","last_clean":"2023-12-07T21:12:02.790465+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:12:02.790465+0000","last_undegraded":"2023-12-07T21:12:02.790465+0000","last_fullsized":"2023-12-07T21:12:02.790465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_clean_scrub_stamp":"2023-12-07T21:12:02.790346+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:07.839178+0000","scrub_duration":0.0026089529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:51.249565+0000","last_change":"2023-12-07T21:13:51.249634+0000","last_active":"2023-12-07T21:13:51.249565+0000","last_peered":"2023-12-07T21:13:51.249565+0000","last_clean":"2023-12-07T21:13:51.249565+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:13:51.249565+0000","last_undegraded":"2023-12-07T21:13:51.249565+0000","last_fullsized":"2023-12-07T21:13:51.249565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:51.249439+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:51.249439+0000","last_clean_scrub_stamp":"2023-12-07T21:13:51.249439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:43.146224+0000","scrub_duration":0.001108798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.293568+0000","last_change":"2023-12-07T21:13:36.293592+0000","last_active":"2023-12-07T21:13:36.293568+0000","last_peered":"2023-12-07T21:13:36.293568+0000","last_clean":"2023-12-07T21:13:36.293568+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:13:36.293568+0000","last_undegraded":"2023-12-07T21:13:36.293568+0000","last_fullsized":"2023-12-07T21:13:36.293568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:36.293469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:36.293469+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.293469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:55.877457+0000","scrub_duration":0.0012759609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.443153+0000","last_change":"2023-12-07T21:11:56.443153+0000","last_active":"2023-12-07T21:11:56.443153+0000","last_peered":"2023-12-07T21:11:56.443153+0000","last_clean":"2023-12-07T21:11:56.443153+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:56.443153+0000","last_undegraded":"2023-12-07T21:11:56.443153+0000","last_fullsized":"2023-12-07T21:11:56.443153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.443045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:05.069384+0000","scrub_duration":0.0010685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.606842+0000","last_change":"2023-12-07T21:11:39.606842+0000","last_active":"2023-12-07T21:11:39.606842+0000","last_peered":"2023-12-07T21:11:39.606842+0000","last_clean":"2023-12-07T21:11:39.606842+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:39.606842+0000","last_undegraded":"2023-12-07T21:11:39.606842+0000","last_fullsized":"2023-12-07T21:11:39.606842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.606684+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:36.950556+0000","scrub_duration":0.0069737849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:34.781711+0000","last_change":"2023-12-07T21:11:34.781711+0000","last_active":"2023-12-07T21:11:34.781711+0000","last_peered":"2023-12-07T21:11:34.781711+0000","last_clean":"2023-12-07T21:11:34.781711+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:34.781711+0000","last_undegraded":"2023-12-07T21:11:34.781711+0000","last_fullsized":"2023-12-07T21:11:34.781711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:34.781604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:44.478780+0000","scrub_duration":0.001255822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.468162+0000","last_change":"2023-12-07T21:14:02.468187+0000","last_active":"2023-12-07T21:14:02.468162+0000","last_peered":"2023-12-07T21:14:02.468162+0000","last_clean":"2023-12-07T21:14:02.468162+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:14:02.468162+0000","last_undegraded":"2023-12-07T21:14:02.468162+0000","last_fullsized":"2023-12-07T21:14:02.468162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2023-12-07T21:14:02.468073+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2023-12-07T21:14:02.468073+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.468073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:15.400853+0000","scrub_duration":0.001158437,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'22","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.326862+0000","last_change":"2023-12-07T21:12:36.326862+0000","last_active":"2023-12-07T21:12:36.326862+0000","last_peered":"2023-12-07T21:12:36.326862+0000","last_clean":"2023-12-07T21:12:36.326862+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:12:36.326862+0000","last_undegraded":"2023-12-07T21:12:36.326862+0000","last_fullsized":"2023-12-07T21:12:36.326862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.326694+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:24:30.282151+0000","scrub_duration":0.0028268410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.338776+0000","last_change":"2023-12-07T21:13:06.338776+0000","last_active":"2023-12-07T21:13:06.338776+0000","last_peered":"2023-12-07T21:13:06.338776+0000","last_clean":"2023-12-07T21:13:06.338776+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:13:06.338776+0000","last_undegraded":"2023-12-07T21:13:06.338776+0000","last_fullsized":"2023-12-07T21:13:06.338776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.338641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:59:17.495976+0000","scrub_duration":0.001242176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:07.717459+0000","last_change":"2023-12-07T21:12:07.717459+0000","last_active":"2023-12-07T21:12:07.717459+0000","last_peered":"2023-12-07T21:12:07.717459+0000","last_clean":"2023-12-07T21:12:07.717459+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:12:07.717459+0000","last_undegraded":"2023-12-07T21:12:07.717459+0000","last_fullsized":"2023-12-07T21:12:07.717459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_clean_scrub_stamp":"2023-12-07T21:12:07.717342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:32.009926+0000","scrub_duration":0.0014039289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:09.439747+0000","last_change":"2023-12-07T21:12:09.439747+0000","last_active":"2023-12-07T21:12:09.439747+0000","last_peered":"2023-12-07T21:12:09.439747+0000","last_clean":"2023-12-07T21:12:09.439747+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:12:09.439747+0000","last_undegraded":"2023-12-07T21:12:09.439747+0000","last_fullsized":"2023-12-07T21:12:09.439747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_clean_scrub_stamp":"2023-12-07T21:12:09.439641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:19.195035+0000","scrub_duration":0.0043223589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.735466+0000","last_change":"2023-12-07T21:11:33.735466+0000","last_active":"2023-12-07T21:11:33.735466+0000","last_peered":"2023-12-07T21:11:33.735466+0000","last_clean":"2023-12-07T21:11:33.735466+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:33.735466+0000","last_undegraded":"2023-12-07T21:11:33.735466+0000","last_fullsized":"2023-12-07T21:11:33.735466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.735352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:03.972116+0000","scrub_duration":0.0011441929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:55.388916+0000","last_change":"2023-12-07T21:13:55.388945+0000","last_active":"2023-12-07T21:13:55.388916+0000","last_peered":"2023-12-07T21:13:55.388916+0000","last_clean":"2023-12-07T21:13:55.388916+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:13:55.388916+0000","last_undegraded":"2023-12-07T21:13:55.388916+0000","last_fullsized":"2023-12-07T21:13:55.388916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:55.388828+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:55.388828+0000","last_clean_scrub_stamp":"2023-12-07T21:13:55.388828+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:43:17.552727+0000","scrub_duration":0.0021899129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.429281+0000","last_change":"2023-12-07T21:12:36.429281+0000","last_active":"2023-12-07T21:12:36.429281+0000","last_peered":"2023-12-07T21:12:36.429281+0000","last_clean":"2023-12-07T21:12:36.429281+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:12:36.429281+0000","last_undegraded":"2023-12-07T21:12:36.429281+0000","last_fullsized":"2023-12-07T21:12:36.429281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.429148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:19.936617+0000","scrub_duration":0.001111988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.297715+0000","last_change":"2023-12-07T21:13:52.297739+0000","last_active":"2023-12-07T21:13:52.297715+0000","last_peered":"2023-12-07T21:13:52.297715+0000","last_clean":"2023-12-07T21:13:52.297715+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:13:52.297715+0000","last_undegraded":"2023-12-07T21:13:52.297715+0000","last_fullsized":"2023-12-07T21:13:52.297715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:52.297625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:52.297625+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.297625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:57:04.497787+0000","scrub_duration":0.0012997989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.810375+0000","last_change":"2023-12-07T21:12:15.810375+0000","last_active":"2023-12-07T21:12:15.810375+0000","last_peered":"2023-12-07T21:12:15.810375+0000","last_clean":"2023-12-07T21:12:15.810375+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:12:15.810375+0000","last_undegraded":"2023-12-07T21:12:15.810375+0000","last_fullsized":"2023-12-07T21:12:15.810375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.810269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:33.566530+0000","scrub_duration":0.0014408579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.522112+0000","last_change":"2023-12-07T21:11:50.522112+0000","last_active":"2023-12-07T21:11:50.522112+0000","last_peered":"2023-12-07T21:11:50.522112+0000","last_clean":"2023-12-07T21:11:50.522112+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:50.522112+0000","last_undegraded":"2023-12-07T21:11:50.522112+0000","last_fullsized":"2023-12-07T21:11:50.522112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.521955+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:04.827943+0000","scrub_duration":0.0073561030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":308,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.761887+0000","last_change":"2023-12-07T21:11:35.761887+0000","last_active":"2023-12-07T21:11:35.761887+0000","last_peered":"2023-12-07T21:11:35.761887+0000","last_clean":"2023-12-07T21:11:35.761887+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:35.761887+0000","last_undegraded":"2023-12-07T21:11:35.761887+0000","last_fullsized":"2023-12-07T21:11:35.761887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.761766+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:14.383149+0000","scrub_duration":0.0016151640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.804846+0000","last_change":"2023-12-07T21:09:04.919383+0000","last_active":"2023-12-07T21:11:18.804846+0000","last_peered":"2023-12-07T21:11:18.804846+0000","last_clean":"2023-12-07T21:11:18.804846+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:11:18.804846+0000","last_undegraded":"2023-12-07T21:11:18.804846+0000","last_fullsized":"2023-12-07T21:11:18.804846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:55.462356+0000","last_change":"2023-12-07T21:12:55.462356+0000","last_active":"2023-12-07T21:12:55.462356+0000","last_peered":"2023-12-07T21:12:55.462356+0000","last_clean":"2023-12-07T21:12:55.462356+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:12:55.462356+0000","last_undegraded":"2023-12-07T21:12:55.462356+0000","last_fullsized":"2023-12-07T21:12:55.462356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_clean_scrub_stamp":"2023-12-07T21:12:55.462251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:57:45.150167+0000","scrub_duration":0.0012320580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:07.335753+0000","last_change":"2023-12-07T21:14:07.335776+0000","last_active":"2023-12-07T21:14:07.335753+0000","last_peered":"2023-12-07T21:14:07.335753+0000","last_clean":"2023-12-07T21:14:07.335753+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:14:07.335753+0000","last_undegraded":"2023-12-07T21:14:07.335753+0000","last_fullsized":"2023-12-07T21:14:07.335753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:07.335666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:07.335666+0000","last_clean_scrub_stamp":"2023-12-07T21:14:07.335666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:32:21.017600+0000","scrub_duration":0.0011737270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.753724+0000","last_change":"2023-12-07T21:11:55.753724+0000","last_active":"2023-12-07T21:11:55.753724+0000","last_peered":"2023-12-07T21:11:55.753724+0000","last_clean":"2023-12-07T21:11:55.753724+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:55.753724+0000","last_undegraded":"2023-12-07T21:11:55.753724+0000","last_fullsized":"2023-12-07T21:11:55.753724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.753576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:53:37.572475+0000","scrub_duration":0.0013913199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:31.726564+0000","last_change":"2023-12-07T21:11:31.726564+0000","last_active":"2023-12-07T21:11:31.726564+0000","last_peered":"2023-12-07T21:11:31.726564+0000","last_clean":"2023-12-07T21:11:31.726564+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:31.726564+0000","last_undegraded":"2023-12-07T21:11:31.726564+0000","last_fullsized":"2023-12-07T21:11:31.726564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:31.726451+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:36.775283+0000","scrub_duration":0.0038601009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.752564+0000","last_change":"2023-12-07T21:11:56.752564+0000","last_active":"2023-12-07T21:11:56.752564+0000","last_peered":"2023-12-07T21:11:56.752564+0000","last_clean":"2023-12-07T21:11:56.752564+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:56.752564+0000","last_undegraded":"2023-12-07T21:11:56.752564+0000","last_fullsized":"2023-12-07T21:11:56.752564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.752450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:44.261937+0000","scrub_duration":0.0012919610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'6","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:07.983141+0000","last_change":"2023-12-07T21:14:07.983170+0000","last_active":"2023-12-07T21:14:07.983141+0000","last_peered":"2023-12-07T21:14:07.983141+0000","last_clean":"2023-12-07T21:14:07.983141+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:14:07.983141+0000","last_undegraded":"2023-12-07T21:14:07.983141+0000","last_fullsized":"2023-12-07T21:14:07.983141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:14:07.983055+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:14:07.983055+0000","last_clean_scrub_stamp":"2023-12-07T21:14:07.983055+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:09:22.412930+0000","scrub_duration":0.0032971929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.820173+0000","last_change":"2023-12-07T21:09:35.950501+0000","last_active":"2023-12-07T21:11:53.820173+0000","last_peered":"2023-12-07T21:11:53.820173+0000","last_clean":"2023-12-07T21:11:53.820173+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:11:53.820173+0000","last_undegraded":"2023-12-07T21:11:53.820173+0000","last_fullsized":"2023-12-07T21:11:53.820173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:58.953267+0000","last_change":"2023-12-07T21:13:58.953288+0000","last_active":"2023-12-07T21:13:58.953267+0000","last_peered":"2023-12-07T21:13:58.953267+0000","last_clean":"2023-12-07T21:13:58.953267+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:13:58.953267+0000","last_undegraded":"2023-12-07T21:13:58.953267+0000","last_fullsized":"2023-12-07T21:13:58.953267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:58.953174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:58.953174+0000","last_clean_scrub_stamp":"2023-12-07T21:13:58.953174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:58.135287+0000","scrub_duration":0.0012512140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.578121+0000","last_change":"2023-12-07T21:12:12.578121+0000","last_active":"2023-12-07T21:12:12.578121+0000","last_peered":"2023-12-07T21:12:12.578121+0000","last_clean":"2023-12-07T21:12:12.578121+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:12:12.578121+0000","last_undegraded":"2023-12-07T21:12:12.578121+0000","last_fullsized":"2023-12-07T21:12:12.578121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.578001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:21:04.951547+0000","scrub_duration":0.0009980639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.222572+0000","last_change":"2023-12-07T21:11:32.222572+0000","last_active":"2023-12-07T21:11:32.222572+0000","last_peered":"2023-12-07T21:11:32.222572+0000","last_clean":"2023-12-07T21:11:32.222572+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:32.222572+0000","last_undegraded":"2023-12-07T21:11:32.222572+0000","last_fullsized":"2023-12-07T21:11:32.222572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.222451+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:29.566323+0000","scrub_duration":0.0042948600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:25.579998+0000","last_change":"2023-12-07T21:13:25.579998+0000","last_active":"2023-12-07T21:13:25.579998+0000","last_peered":"2023-12-07T21:13:25.579998+0000","last_clean":"2023-12-07T21:13:25.579998+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:13:25.579998+0000","last_undegraded":"2023-12-07T21:13:25.579998+0000","last_fullsized":"2023-12-07T21:13:25.579998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_clean_scrub_stamp":"2023-12-07T21:13:25.579880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:22:49.341694+0000","scrub_duration":0.001424259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608819+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:11:10.608819+0000","last_peered":"2023-12-07T21:11:10.608819+0000","last_clean":"2023-12-07T21:11:10.608819+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:11:10.608819+0000","last_undegraded":"2023-12-07T21:11:10.608819+0000","last_fullsized":"2023-12-07T21:11:10.608819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.820291+0000","last_change":"2023-12-07T21:09:35.960060+0000","last_active":"2023-12-07T21:11:53.820291+0000","last_peered":"2023-12-07T21:11:53.820291+0000","last_clean":"2023-12-07T21:11:53.820291+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:11:53.820291+0000","last_undegraded":"2023-12-07T21:11:53.820291+0000","last_fullsized":"2023-12-07T21:11:53.820291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:55.851861+0000","last_clean_scrub_stamp":"2023-12-07T21:08:55.851861+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:04.345887+0000","last_change":"2023-12-07T21:14:04.345941+0000","last_active":"2023-12-07T21:14:04.345887+0000","last_peered":"2023-12-07T21:14:04.345887+0000","last_clean":"2023-12-07T21:14:04.345887+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:14:04.345887+0000","last_undegraded":"2023-12-07T21:14:04.345887+0000","last_fullsized":"2023-12-07T21:14:04.345887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:04.345774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:04.345774+0000","last_clean_scrub_stamp":"2023-12-07T21:14:04.345774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:45.945110+0000","scrub_duration":0.0013151079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:54.784564+0000","last_change":"2023-12-07T21:11:54.784564+0000","last_active":"2023-12-07T21:11:54.784564+0000","last_peered":"2023-12-07T21:11:54.784564+0000","last_clean":"2023-12-07T21:11:54.784564+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:54.784564+0000","last_undegraded":"2023-12-07T21:11:54.784564+0000","last_fullsized":"2023-12-07T21:11:54.784564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_clean_scrub_stamp":"2023-12-07T21:11:54.784441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:06.366596+0000","scrub_duration":0.001044002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.576788+0000","last_change":"2023-12-07T21:11:38.576788+0000","last_active":"2023-12-07T21:11:38.576788+0000","last_peered":"2023-12-07T21:11:38.576788+0000","last_clean":"2023-12-07T21:11:38.576788+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:38.576788+0000","last_undegraded":"2023-12-07T21:11:38.576788+0000","last_fullsized":"2023-12-07T21:11:38.576788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.576637+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:37:48.632379+0000","scrub_duration":0.0068514220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":337,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625046+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625046+0000","last_peered":"2023-12-07T21:11:28.625046+0000","last_clean":"2023-12-07T21:11:28.625046+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625046+0000","last_undegraded":"2023-12-07T21:11:28.625046+0000","last_fullsized":"2023-12-07T21:11:28.625046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.858711+0000","last_change":"2023-12-07T21:12:16.858711+0000","last_active":"2023-12-07T21:12:16.858711+0000","last_peered":"2023-12-07T21:12:16.858711+0000","last_clean":"2023-12-07T21:12:16.858711+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:12:16.858711+0000","last_undegraded":"2023-12-07T21:12:16.858711+0000","last_fullsized":"2023-12-07T21:12:16.858711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.858602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:29:51.847246+0000","scrub_duration":0.0011473449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.447750+0000","last_change":"2023-12-07T21:13:23.447750+0000","last_active":"2023-12-07T21:13:23.447750+0000","last_peered":"2023-12-07T21:13:23.447750+0000","last_clean":"2023-12-07T21:13:23.447750+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:13:23.447750+0000","last_undegraded":"2023-12-07T21:13:23.447750+0000","last_fullsized":"2023-12-07T21:13:23.447750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.447646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:28:02.982148+0000","scrub_duration":0.0010737139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:03.361960+0000","last_change":"2023-12-07T21:14:03.361984+0000","last_active":"2023-12-07T21:14:03.361960+0000","last_peered":"2023-12-07T21:14:03.361960+0000","last_clean":"2023-12-07T21:14:03.361960+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:14:03.361960+0000","last_undegraded":"2023-12-07T21:14:03.361960+0000","last_fullsized":"2023-12-07T21:14:03.361960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:14:03.361875+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:14:03.361875+0000","last_clean_scrub_stamp":"2023-12-07T21:14:03.361875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:49.744783+0000","scrub_duration":0.0013072349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.296697+0000","last_change":"2023-12-07T21:11:38.296697+0000","last_active":"2023-12-07T21:11:38.296697+0000","last_peered":"2023-12-07T21:11:38.296697+0000","last_clean":"2023-12-07T21:11:38.296697+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:38.296697+0000","last_undegraded":"2023-12-07T21:11:38.296697+0000","last_fullsized":"2023-12-07T21:11:38.296697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.296568+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:08.533333+0000","scrub_duration":0.0033144630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.654323+0000","last_change":"2023-12-07T21:13:04.654323+0000","last_active":"2023-12-07T21:13:04.654323+0000","last_peered":"2023-12-07T21:13:04.654323+0000","last_clean":"2023-12-07T21:13:04.654323+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:13:04.654323+0000","last_undegraded":"2023-12-07T21:13:04.654323+0000","last_fullsized":"2023-12-07T21:13:04.654323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.654200+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:02:30.647135+0000","scrub_duration":0.0041448730000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'247","reported_seq":373,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:47.359735+0000","last_change":"2023-12-07T21:11:47.359735+0000","last_active":"2023-12-07T21:11:47.359735+0000","last_peered":"2023-12-07T21:11:47.359735+0000","last_clean":"2023-12-07T21:11:47.359735+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:47.359735+0000","last_undegraded":"2023-12-07T21:11:47.359735+0000","last_fullsized":"2023-12-07T21:11:47.359735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_clean_scrub_stamp":"2023-12-07T21:11:47.359610+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:10.050726+0000","scrub_duration":0.0028663759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.579785+0000","last_change":"2023-12-07T21:12:14.579785+0000","last_active":"2023-12-07T21:12:14.579785+0000","last_peered":"2023-12-07T21:12:14.579785+0000","last_clean":"2023-12-07T21:12:14.579785+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:12:14.579785+0000","last_undegraded":"2023-12-07T21:12:14.579785+0000","last_fullsized":"2023-12-07T21:12:14.579785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.579627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:44.957962+0000","scrub_duration":0.0013656510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.375184+0000","last_change":"2023-12-07T21:12:17.375184+0000","last_active":"2023-12-07T21:12:17.375184+0000","last_peered":"2023-12-07T21:12:17.375184+0000","last_clean":"2023-12-07T21:12:17.375184+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:12:17.375184+0000","last_undegraded":"2023-12-07T21:12:17.375184+0000","last_fullsized":"2023-12-07T21:12:17.375184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.375067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:21:31.008297+0000","scrub_duration":0.001068486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:56.280215+0000","last_change":"2023-12-07T21:13:56.280253+0000","last_active":"2023-12-07T21:13:56.280215+0000","last_peered":"2023-12-07T21:13:56.280215+0000","last_clean":"2023-12-07T21:13:56.280215+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:13:56.280215+0000","last_undegraded":"2023-12-07T21:13:56.280215+0000","last_fullsized":"2023-12-07T21:13:56.280215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:56.280106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:56.280106+0000","last_clean_scrub_stamp":"2023-12-07T21:13:56.280106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:21.512744+0000","scrub_duration":0.001246306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.847914+0000","last_change":"2023-12-07T21:11:28.847914+0000","last_active":"2023-12-07T21:11:28.847914+0000","last_peered":"2023-12-07T21:11:28.847914+0000","last_clean":"2023-12-07T21:11:28.847914+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:28.847914+0000","last_undegraded":"2023-12-07T21:11:28.847914+0000","last_fullsized":"2023-12-07T21:11:28.847914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.847797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:20:42.481026+0000","scrub_duration":0.001132973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262786+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262786+0000","last_peered":"2023-12-07T21:11:27.262786+0000","last_clean":"2023-12-07T21:11:27.262786+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262786+0000","last_undegraded":"2023-12-07T21:11:27.262786+0000","last_fullsized":"2023-12-07T21:11:27.262786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811401+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:18.811401+0000","last_peered":"2023-12-07T21:11:18.811401+0000","last_clean":"2023-12-07T21:11:18.811401+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:18.811401+0000","last_undegraded":"2023-12-07T21:11:18.811401+0000","last_fullsized":"2023-12-07T21:11:18.811401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:42.422577+0000","last_change":"2023-12-07T21:13:42.422626+0000","last_active":"2023-12-07T21:13:42.422577+0000","last_peered":"2023-12-07T21:13:42.422577+0000","last_clean":"2023-12-07T21:13:42.422577+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:13:42.422577+0000","last_undegraded":"2023-12-07T21:13:42.422577+0000","last_fullsized":"2023-12-07T21:13:42.422577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:42.422461+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:42.422461+0000","last_clean_scrub_stamp":"2023-12-07T21:13:42.422461+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:15.762102+0000","scrub_duration":0.0036148259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:08.448223+0000","last_change":"2023-12-07T21:12:08.448223+0000","last_active":"2023-12-07T21:12:08.448223+0000","last_peered":"2023-12-07T21:12:08.448223+0000","last_clean":"2023-12-07T21:12:08.448223+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:12:08.448223+0000","last_undegraded":"2023-12-07T21:12:08.448223+0000","last_fullsized":"2023-12-07T21:12:08.448223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_clean_scrub_stamp":"2023-12-07T21:12:08.448115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:53:48.563995+0000","scrub_duration":0.001037821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:18.321344+0000","last_change":"2023-12-07T21:13:18.321375+0000","last_active":"2023-12-07T21:13:18.321344+0000","last_peered":"2023-12-07T21:13:18.321344+0000","last_clean":"2023-12-07T21:13:18.321344+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:13:18.321344+0000","last_undegraded":"2023-12-07T21:13:18.321344+0000","last_fullsized":"2023-12-07T21:13:18.321344+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_clean_scrub_stamp":"2023-12-07T21:13:18.321258+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:57.708960+0000","scrub_duration":0.0041701730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607432+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:11:10.607432+0000","last_peered":"2023-12-07T21:11:10.607432+0000","last_clean":"2023-12-07T21:11:10.607432+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:11:10.607432+0000","last_undegraded":"2023-12-07T21:11:10.607432+0000","last_fullsized":"2023-12-07T21:11:10.607432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607484+0000","last_change":"2023-12-07T21:08:54.883560+0000","last_active":"2023-12-07T21:11:10.607484+0000","last_peered":"2023-12-07T21:11:10.607484+0000","last_clean":"2023-12-07T21:11:10.607484+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:11:10.607484+0000","last_undegraded":"2023-12-07T21:11:10.607484+0000","last_fullsized":"2023-12-07T21:11:10.607484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.324752+0000","last_change":"2023-12-07T21:11:45.324752+0000","last_active":"2023-12-07T21:11:45.324752+0000","last_peered":"2023-12-07T21:11:45.324752+0000","last_clean":"2023-12-07T21:11:45.324752+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:11:45.324752+0000","last_undegraded":"2023-12-07T21:11:45.324752+0000","last_fullsized":"2023-12-07T21:11:45.324752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.324596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:15.702930+0000","scrub_duration":0.001375037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'84","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.623237+0000","last_change":"2023-12-07T21:12:52.623237+0000","last_active":"2023-12-07T21:12:52.623237+0000","last_peered":"2023-12-07T21:12:52.623237+0000","last_clean":"2023-12-07T21:12:52.623237+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:12:52.623237+0000","last_undegraded":"2023-12-07T21:12:52.623237+0000","last_fullsized":"2023-12-07T21:12:52.623237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'84","last_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_deep_scrub":"33'84","last_deep_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.623072+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:11.772666+0000","scrub_duration":0.0042302950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.743712+0000","last_change":"2023-12-07T21:11:42.743712+0000","last_active":"2023-12-07T21:11:42.743712+0000","last_peered":"2023-12-07T21:11:42.743712+0000","last_clean":"2023-12-07T21:11:42.743712+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:42.743712+0000","last_undegraded":"2023-12-07T21:11:42.743712+0000","last_fullsized":"2023-12-07T21:11:42.743712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.743604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:58.016229+0000","scrub_duration":0.001386167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.433682+0000","last_change":"2023-12-07T21:11:58.433682+0000","last_active":"2023-12-07T21:11:58.433682+0000","last_peered":"2023-12-07T21:11:58.433682+0000","last_clean":"2023-12-07T21:11:58.433682+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:58.433682+0000","last_undegraded":"2023-12-07T21:11:58.433682+0000","last_fullsized":"2023-12-07T21:11:58.433682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.433567+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:08.130743+0000","scrub_duration":0.0014101739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:37.409865+0000","last_change":"2023-12-07T21:13:37.409909+0000","last_active":"2023-12-07T21:13:37.409865+0000","last_peered":"2023-12-07T21:13:37.409865+0000","last_clean":"2023-12-07T21:13:37.409865+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:13:37.409865+0000","last_undegraded":"2023-12-07T21:13:37.409865+0000","last_fullsized":"2023-12-07T21:13:37.409865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:37.409759+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:37.409759+0000","last_clean_scrub_stamp":"2023-12-07T21:13:37.409759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:10.604294+0000","scrub_duration":0.001212444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607424+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:11:10.607424+0000","last_peered":"2023-12-07T21:11:10.607424+0000","last_clean":"2023-12-07T21:11:10.607424+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:11:10.607424+0000","last_undegraded":"2023-12-07T21:11:10.607424+0000","last_fullsized":"2023-12-07T21:11:10.607424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.966870+0000","last_change":"2023-12-07T21:13:54.966898+0000","last_active":"2023-12-07T21:13:54.966870+0000","last_peered":"2023-12-07T21:13:54.966870+0000","last_clean":"2023-12-07T21:13:54.966870+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:13:54.966870+0000","last_undegraded":"2023-12-07T21:13:54.966870+0000","last_fullsized":"2023-12-07T21:13:54.966870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:54.966763+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:54.966763+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.966763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:07.675533+0000","scrub_duration":0.0013427319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.687480+0000","last_change":"2023-12-07T21:11:32.687480+0000","last_active":"2023-12-07T21:11:32.687480+0000","last_peered":"2023-12-07T21:11:32.687480+0000","last_clean":"2023-12-07T21:11:32.687480+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:32.687480+0000","last_undegraded":"2023-12-07T21:11:32.687480+0000","last_fullsized":"2023-12-07T21:11:32.687480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.687375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:18:45.906213+0000","scrub_duration":0.001283024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":451,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148420+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148420+0000","last_peered":"2023-12-07T21:11:18.148420+0000","last_clean":"2023-12-07T21:11:18.148420+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148420+0000","last_undegraded":"2023-12-07T21:11:18.148420+0000","last_fullsized":"2023-12-07T21:11:18.148420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:25.481161+0000","last_change":"2023-12-07T21:12:25.481161+0000","last_active":"2023-12-07T21:12:25.481161+0000","last_peered":"2023-12-07T21:12:25.481161+0000","last_clean":"2023-12-07T21:12:25.481161+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:12:25.481161+0000","last_undegraded":"2023-12-07T21:12:25.481161+0000","last_fullsized":"2023-12-07T21:12:25.481161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_clean_scrub_stamp":"2023-12-07T21:12:25.481005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:33:44.071058+0000","scrub_duration":0.001267064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.375053+0000","last_change":"2023-12-07T21:13:54.375076+0000","last_active":"2023-12-07T21:13:54.375053+0000","last_peered":"2023-12-07T21:13:54.375053+0000","last_clean":"2023-12-07T21:13:54.375053+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:13:54.375053+0000","last_undegraded":"2023-12-07T21:13:54.375053+0000","last_fullsized":"2023-12-07T21:13:54.375053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:13:54.374958+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:13:54.374958+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.374958+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:07.083727+0000","scrub_duration":0.0012241019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.103368+0000","last_change":"2023-12-07T21:13:27.103392+0000","last_active":"2023-12-07T21:13:27.103368+0000","last_peered":"2023-12-07T21:13:27.103368+0000","last_clean":"2023-12-07T21:13:27.103368+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:13:27.103368+0000","last_undegraded":"2023-12-07T21:13:27.103368+0000","last_fullsized":"2023-12-07T21:13:27.103368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:04.121495+0000","scrub_duration":0.0012535599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:33.338278+0000","last_change":"2023-12-07T21:13:33.338298+0000","last_active":"2023-12-07T21:13:33.338278+0000","last_peered":"2023-12-07T21:13:33.338278+0000","last_clean":"2023-12-07T21:13:33.338278+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:13:33.338278+0000","last_undegraded":"2023-12-07T21:13:33.338278+0000","last_fullsized":"2023-12-07T21:13:33.338278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:33.338194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:33.338194+0000","last_clean_scrub_stamp":"2023-12-07T21:13:33.338194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:43.622208+0000","scrub_duration":0.001353496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:37.050040+0000","last_change":"2023-12-07T21:13:37.050079+0000","last_active":"2023-12-07T21:13:37.050040+0000","last_peered":"2023-12-07T21:13:37.050040+0000","last_clean":"2023-12-07T21:13:37.050040+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:13:37.050040+0000","last_undegraded":"2023-12-07T21:13:37.050040+0000","last_fullsized":"2023-12-07T21:13:37.050040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:37.049937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:37.049937+0000","last_clean_scrub_stamp":"2023-12-07T21:13:37.049937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:03:03.042871+0000","scrub_duration":0.0012947099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.627991+0000","last_change":"2023-12-07T21:12:15.627991+0000","last_active":"2023-12-07T21:12:15.627991+0000","last_peered":"2023-12-07T21:12:15.627991+0000","last_clean":"2023-12-07T21:12:15.627991+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:12:15.627991+0000","last_undegraded":"2023-12-07T21:12:15.627991+0000","last_fullsized":"2023-12-07T21:12:15.627991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.627865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:38.318981+0000","scrub_duration":0.0028926030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'25","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:46.537922+0000","last_change":"2023-12-07T21:11:46.537922+0000","last_active":"2023-12-07T21:11:46.537922+0000","last_peered":"2023-12-07T21:11:46.537922+0000","last_clean":"2023-12-07T21:11:46.537922+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:46.537922+0000","last_undegraded":"2023-12-07T21:11:46.537922+0000","last_fullsized":"2023-12-07T21:11:46.537922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_clean_scrub_stamp":"2023-12-07T21:11:46.537795+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:57.338431+0000","scrub_duration":0.0057357379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642698+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642698+0000","last_peered":"2023-12-07T21:11:12.642698+0000","last_clean":"2023-12-07T21:11:12.642698+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642698+0000","last_undegraded":"2023-12-07T21:11:12.642698+0000","last_fullsized":"2023-12-07T21:11:12.642698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813540+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:11:23.813540+0000","last_peered":"2023-12-07T21:11:23.813540+0000","last_clean":"2023-12-07T21:11:23.813540+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:11:23.813540+0000","last_undegraded":"2023-12-07T21:11:23.813540+0000","last_fullsized":"2023-12-07T21:11:23.813540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.097020+0000","last_change":"2023-12-07T21:13:20.097065+0000","last_active":"2023-12-07T21:13:20.097020+0000","last_peered":"2023-12-07T21:13:20.097020+0000","last_clean":"2023-12-07T21:13:20.097020+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:13:20.097020+0000","last_undegraded":"2023-12-07T21:13:20.097020+0000","last_fullsized":"2023-12-07T21:13:20.097020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.096899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.485657+0000","scrub_duration":0.001542213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607422+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:11:10.607422+0000","last_peered":"2023-12-07T21:11:10.607422+0000","last_clean":"2023-12-07T21:11:10.607422+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:11:10.607422+0000","last_undegraded":"2023-12-07T21:11:10.607422+0000","last_fullsized":"2023-12-07T21:11:10.607422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.309172+0000","last_change":"2023-12-07T21:13:38.309196+0000","last_active":"2023-12-07T21:13:38.309172+0000","last_peered":"2023-12-07T21:13:38.309172+0000","last_clean":"2023-12-07T21:13:38.309172+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:13:38.309172+0000","last_undegraded":"2023-12-07T21:13:38.309172+0000","last_fullsized":"2023-12-07T21:13:38.309172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:38.309082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:38.309082+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.309082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:56.899135+0000","scrub_duration":0.0011541360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:57.727223+0000","last_change":"2023-12-07T21:11:57.727223+0000","last_active":"2023-12-07T21:11:57.727223+0000","last_peered":"2023-12-07T21:11:57.727223+0000","last_clean":"2023-12-07T21:11:57.727223+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:11:57.727223+0000","last_undegraded":"2023-12-07T21:11:57.727223+0000","last_fullsized":"2023-12-07T21:11:57.727223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_clean_scrub_stamp":"2023-12-07T21:11:57.727085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:53.015740+0000","scrub_duration":0.0013430639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.630855+0000","last_change":"2023-12-07T21:12:49.630855+0000","last_active":"2023-12-07T21:12:49.630855+0000","last_peered":"2023-12-07T21:12:49.630855+0000","last_clean":"2023-12-07T21:12:49.630855+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:12:49.630855+0000","last_undegraded":"2023-12-07T21:12:49.630855+0000","last_fullsized":"2023-12-07T21:12:49.630855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.630741+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:01.513069+0000","scrub_duration":0.0051886659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:30.531782+0000","last_change":"2023-12-07T21:13:30.531836+0000","last_active":"2023-12-07T21:13:30.531782+0000","last_peered":"2023-12-07T21:13:30.531782+0000","last_clean":"2023-12-07T21:13:30.531782+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:13:30.531782+0000","last_undegraded":"2023-12-07T21:13:30.531782+0000","last_fullsized":"2023-12-07T21:13:30.531782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:30.531646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:30.531646+0000","last_clean_scrub_stamp":"2023-12-07T21:13:30.531646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:08:23.567547+0000","scrub_duration":0.001461323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.342736+0000","last_change":"2023-12-07T21:13:52.342759+0000","last_active":"2023-12-07T21:13:52.342736+0000","last_peered":"2023-12-07T21:13:52.342736+0000","last_clean":"2023-12-07T21:13:52.342736+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:13:52.342736+0000","last_undegraded":"2023-12-07T21:13:52.342736+0000","last_fullsized":"2023-12-07T21:13:52.342736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:52.342650+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:52.342650+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.342650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:23:16.104463+0000","scrub_duration":0.0010492120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:10.299642+0000","last_change":"2023-12-07T21:13:10.299666+0000","last_active":"2023-12-07T21:13:10.299642+0000","last_peered":"2023-12-07T21:13:10.299642+0000","last_clean":"2023-12-07T21:13:10.299642+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:13:10.299642+0000","last_undegraded":"2023-12-07T21:13:10.299642+0000","last_fullsized":"2023-12-07T21:13:10.299642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_clean_scrub_stamp":"2023-12-07T21:13:10.299548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:18:32.210130+0000","scrub_duration":0.00096658499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:45.355307+0000","last_change":"2023-12-07T21:13:45.355332+0000","last_active":"2023-12-07T21:13:45.355307+0000","last_peered":"2023-12-07T21:13:45.355307+0000","last_clean":"2023-12-07T21:13:45.355307+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:13:45.355307+0000","last_undegraded":"2023-12-07T21:13:45.355307+0000","last_fullsized":"2023-12-07T21:13:45.355307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:45.355224+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:45.355224+0000","last_clean_scrub_stamp":"2023-12-07T21:13:45.355224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:23:41.232871+0000","scrub_duration":0.0012797419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.037891+0000","last_change":"2023-12-07T21:13:44.037911+0000","last_active":"2023-12-07T21:13:44.037891+0000","last_peered":"2023-12-07T21:13:44.037891+0000","last_clean":"2023-12-07T21:13:44.037891+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:13:44.037891+0000","last_undegraded":"2023-12-07T21:13:44.037891+0000","last_fullsized":"2023-12-07T21:13:44.037891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:44.037804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:44.037804+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.037804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:44:57.361482+0000","scrub_duration":0.0012532349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.771944+0000","last_change":"2023-12-07T21:12:11.771944+0000","last_active":"2023-12-07T21:12:11.771944+0000","last_peered":"2023-12-07T21:12:11.771944+0000","last_clean":"2023-12-07T21:12:11.771944+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:12:11.771944+0000","last_undegraded":"2023-12-07T21:12:11.771944+0000","last_fullsized":"2023-12-07T21:12:11.771944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.771816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:43.210676+0000","scrub_duration":0.0013479799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'72","reported_seq":142,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.763012+0000","last_change":"2023-12-07T21:11:45.763012+0000","last_active":"2023-12-07T21:11:45.763012+0000","last_peered":"2023-12-07T21:11:45.763012+0000","last_clean":"2023-12-07T21:11:45.763012+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:45.763012+0000","last_undegraded":"2023-12-07T21:11:45.763012+0000","last_fullsized":"2023-12-07T21:11:45.763012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.762875+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:27:47.809323+0000","scrub_duration":0.006706058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594416+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594416+0000","last_peered":"2023-12-07T21:11:25.594416+0000","last_clean":"2023-12-07T21:11:25.594416+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594416+0000","last_undegraded":"2023-12-07T21:11:25.594416+0000","last_fullsized":"2023-12-07T21:11:25.594416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.806069+0000","last_change":"2023-12-07T21:09:04.918926+0000","last_active":"2023-12-07T21:11:23.806069+0000","last_peered":"2023-12-07T21:11:23.806069+0000","last_clean":"2023-12-07T21:11:23.806069+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:11:23.806069+0000","last_undegraded":"2023-12-07T21:11:23.806069+0000","last_fullsized":"2023-12-07T21:11:23.806069+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.332914+0000","last_change":"2023-12-07T21:12:42.332914+0000","last_active":"2023-12-07T21:12:42.332914+0000","last_peered":"2023-12-07T21:12:42.332914+0000","last_clean":"2023-12-07T21:12:42.332914+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:12:42.332914+0000","last_undegraded":"2023-12-07T21:12:42.332914+0000","last_fullsized":"2023-12-07T21:12:42.332914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.332776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:52.088170+0000","scrub_duration":0.00097994699999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:57.984155+0000","last_change":"2023-12-07T21:13:57.984179+0000","last_active":"2023-12-07T21:13:57.984155+0000","last_peered":"2023-12-07T21:13:57.984155+0000","last_clean":"2023-12-07T21:13:57.984155+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:13:57.984155+0000","last_undegraded":"2023-12-07T21:13:57.984155+0000","last_fullsized":"2023-12-07T21:13:57.984155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:57.984065+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:57.984065+0000","last_clean_scrub_stamp":"2023-12-07T21:13:57.984065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:29.842428+0000","scrub_duration":0.0015299650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607497+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:11:10.607497+0000","last_peered":"2023-12-07T21:11:10.607497+0000","last_clean":"2023-12-07T21:11:10.607497+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:11:10.607497+0000","last_undegraded":"2023-12-07T21:11:10.607497+0000","last_fullsized":"2023-12-07T21:11:10.607497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.626478+0000","last_change":"2023-12-07T21:11:42.626478+0000","last_active":"2023-12-07T21:11:42.626478+0000","last_peered":"2023-12-07T21:11:42.626478+0000","last_clean":"2023-12-07T21:11:42.626478+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:11:42.626478+0000","last_undegraded":"2023-12-07T21:11:42.626478+0000","last_fullsized":"2023-12-07T21:11:42.626478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.626356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:23.689571+0000","scrub_duration":0.001348258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.225043+0000","last_change":"2023-12-07T21:11:33.225043+0000","last_active":"2023-12-07T21:11:33.225043+0000","last_peered":"2023-12-07T21:11:33.225043+0000","last_clean":"2023-12-07T21:11:33.225043+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:33.225043+0000","last_undegraded":"2023-12-07T21:11:33.225043+0000","last_fullsized":"2023-12-07T21:11:33.225043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.224920+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:12.396025+0000","scrub_duration":0.0049945800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.065956+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:11:20.065956+0000","last_peered":"2023-12-07T21:11:20.065956+0000","last_clean":"2023-12-07T21:11:20.065956+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:20.065956+0000","last_undegraded":"2023-12-07T21:11:20.065956+0000","last_fullsized":"2023-12-07T21:11:20.065956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813858+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:11:23.813858+0000","last_peered":"2023-12-07T21:11:23.813858+0000","last_clean":"2023-12-07T21:11:23.813858+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:11:23.813858+0000","last_undegraded":"2023-12-07T21:11:23.813858+0000","last_fullsized":"2023-12-07T21:11:23.813858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:26.538543+0000","last_change":"2023-12-07T21:13:26.538591+0000","last_active":"2023-12-07T21:13:26.538543+0000","last_peered":"2023-12-07T21:13:26.538543+0000","last_clean":"2023-12-07T21:13:26.538543+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:13:26.538543+0000","last_undegraded":"2023-12-07T21:13:26.538543+0000","last_fullsized":"2023-12-07T21:13:26.538543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_clean_scrub_stamp":"2023-12-07T21:13:26.538439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:32:03.233013+0000","scrub_duration":0.0011404239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607526+0000","last_change":"2023-12-07T21:08:54.875571+0000","last_active":"2023-12-07T21:11:10.607526+0000","last_peered":"2023-12-07T21:11:10.607526+0000","last_clean":"2023-12-07T21:11:10.607526+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:11:10.607526+0000","last_undegraded":"2023-12-07T21:11:10.607526+0000","last_fullsized":"2023-12-07T21:11:10.607526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:47.017061+0000","last_change":"2023-12-07T21:13:47.017082+0000","last_active":"2023-12-07T21:13:47.017061+0000","last_peered":"2023-12-07T21:13:47.017061+0000","last_clean":"2023-12-07T21:13:47.017061+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:13:47.017061+0000","last_undegraded":"2023-12-07T21:13:47.017061+0000","last_fullsized":"2023-12-07T21:13:47.017061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:47.016927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:47.016927+0000","last_clean_scrub_stamp":"2023-12-07T21:13:47.016927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:39.728287+0000","scrub_duration":0.0013272259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.865911+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:11:18.865911+0000","last_peered":"2023-12-07T21:11:18.865911+0000","last_clean":"2023-12-07T21:11:18.865911+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:11:18.865911+0000","last_undegraded":"2023-12-07T21:11:18.865911+0000","last_fullsized":"2023-12-07T21:11:18.865911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:44.632651+0000","last_change":"2023-12-07T21:12:44.632651+0000","last_active":"2023-12-07T21:12:44.632651+0000","last_peered":"2023-12-07T21:12:44.632651+0000","last_clean":"2023-12-07T21:12:44.632651+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:12:44.632651+0000","last_undegraded":"2023-12-07T21:12:44.632651+0000","last_fullsized":"2023-12-07T21:12:44.632651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_clean_scrub_stamp":"2023-12-07T21:12:44.632504+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:24.020207+0000","scrub_duration":0.0053067840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":369,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712229+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712229+0000","last_peered":"2023-12-07T21:11:18.712229+0000","last_clean":"2023-12-07T21:11:18.712229+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712229+0000","last_undegraded":"2023-12-07T21:11:18.712229+0000","last_fullsized":"2023-12-07T21:11:18.712229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.351712+0000","last_change":"2023-12-07T21:13:48.351733+0000","last_active":"2023-12-07T21:13:48.351712+0000","last_peered":"2023-12-07T21:13:48.351712+0000","last_clean":"2023-12-07T21:13:48.351712+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:13:48.351712+0000","last_undegraded":"2023-12-07T21:13:48.351712+0000","last_fullsized":"2023-12-07T21:13:48.351712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-07T21:13:48.351626+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-07T21:13:48.351626+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.351626+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:41.062986+0000","scrub_duration":0.0010460479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:43.441643+0000","last_change":"2023-12-07T21:12:43.441643+0000","last_active":"2023-12-07T21:12:43.441643+0000","last_peered":"2023-12-07T21:12:43.441643+0000","last_clean":"2023-12-07T21:12:43.441643+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:12:43.441643+0000","last_undegraded":"2023-12-07T21:12:43.441643+0000","last_fullsized":"2023-12-07T21:12:43.441643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_clean_scrub_stamp":"2023-12-07T21:12:43.441484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:24.768617+0000","scrub_duration":0.0011182029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:22.456099+0000","last_change":"2023-12-07T21:13:22.456119+0000","last_active":"2023-12-07T21:13:22.456099+0000","last_peered":"2023-12-07T21:13:22.456099+0000","last_clean":"2023-12-07T21:13:22.456099+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:13:22.456099+0000","last_undegraded":"2023-12-07T21:13:22.456099+0000","last_fullsized":"2023-12-07T21:13:22.456099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_clean_scrub_stamp":"2023-12-07T21:13:22.456021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:49.190223+0000","scrub_duration":0.001272902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607479+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:11:10.607479+0000","last_peered":"2023-12-07T21:11:10.607479+0000","last_clean":"2023-12-07T21:11:10.607479+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:11:10.607479+0000","last_undegraded":"2023-12-07T21:11:10.607479+0000","last_fullsized":"2023-12-07T21:11:10.607479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:37.651334+0000","last_change":"2023-12-07T21:11:37.651334+0000","last_active":"2023-12-07T21:11:37.651334+0000","last_peered":"2023-12-07T21:11:37.651334+0000","last_clean":"2023-12-07T21:11:37.651334+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:11:37.651334+0000","last_undegraded":"2023-12-07T21:11:37.651334+0000","last_fullsized":"2023-12-07T21:11:37.651334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_clean_scrub_stamp":"2023-12-07T21:11:37.651191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:09.090050+0000","scrub_duration":0.0012443790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'94","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:05.544503+0000","last_change":"2023-12-07T21:12:05.544503+0000","last_active":"2023-12-07T21:12:05.544503+0000","last_peered":"2023-12-07T21:12:05.544503+0000","last_clean":"2023-12-07T21:12:05.544503+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:12:05.544503+0000","last_undegraded":"2023-12-07T21:12:05.544503+0000","last_fullsized":"2023-12-07T21:12:05.544503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'94","last_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_deep_scrub":"33'94","last_deep_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_clean_scrub_stamp":"2023-12-07T21:12:05.544369+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:32:13.323537+0000","scrub_duration":0.006343095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.831678+0000","last_change":"2023-12-07T21:11:52.831678+0000","last_active":"2023-12-07T21:11:52.831678+0000","last_peered":"2023-12-07T21:11:52.831678+0000","last_clean":"2023-12-07T21:11:52.831678+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:52.831678+0000","last_undegraded":"2023-12-07T21:11:52.831678+0000","last_fullsized":"2023-12-07T21:11:52.831678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.831531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:22.265020+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:56.419273+0000","last_change":"2023-12-07T21:13:56.419293+0000","last_active":"2023-12-07T21:13:56.419273+0000","last_peered":"2023-12-07T21:13:56.419273+0000","last_clean":"2023-12-07T21:13:56.419273+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:13:56.419273+0000","last_undegraded":"2023-12-07T21:13:56.419273+0000","last_fullsized":"2023-12-07T21:13:56.419273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:56.419176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:56.419176+0000","last_clean_scrub_stamp":"2023-12-07T21:13:56.419176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:37:31.807934+0000","scrub_duration":0.001158671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.528421+0000","last_change":"2023-12-07T21:12:23.528421+0000","last_active":"2023-12-07T21:12:23.528421+0000","last_peered":"2023-12-07T21:12:23.528421+0000","last_clean":"2023-12-07T21:12:23.528421+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:12:23.528421+0000","last_undegraded":"2023-12-07T21:12:23.528421+0000","last_fullsized":"2023-12-07T21:12:23.528421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.528299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:52.961788+0000","scrub_duration":0.00098274400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.407105+0000","last_change":"2023-12-07T21:13:04.407105+0000","last_active":"2023-12-07T21:13:04.407105+0000","last_peered":"2023-12-07T21:13:04.407105+0000","last_clean":"2023-12-07T21:13:04.407105+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:13:04.407105+0000","last_undegraded":"2023-12-07T21:13:04.407105+0000","last_fullsized":"2023-12-07T21:13:04.407105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.406964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:17:33.745379+0000","scrub_duration":0.001091641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812380+0000","last_change":"2023-12-07T21:08:54.886615+0000","last_active":"2023-12-07T21:11:18.812380+0000","last_peered":"2023-12-07T21:11:18.812380+0000","last_clean":"2023-12-07T21:11:18.812380+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:11:18.812380+0000","last_undegraded":"2023-12-07T21:11:18.812380+0000","last_fullsized":"2023-12-07T21:11:18.812380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.299988+0000","last_change":"2023-12-07T21:11:39.299988+0000","last_active":"2023-12-07T21:11:39.299988+0000","last_peered":"2023-12-07T21:11:39.299988+0000","last_clean":"2023-12-07T21:11:39.299988+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:39.299988+0000","last_undegraded":"2023-12-07T21:11:39.299988+0000","last_fullsized":"2023-12-07T21:11:39.299988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.299849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:48.997025+0000","scrub_duration":0.001356866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813364+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:23.813364+0000","last_peered":"2023-12-07T21:11:23.813364+0000","last_clean":"2023-12-07T21:11:23.813364+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:23.813364+0000","last_undegraded":"2023-12-07T21:11:23.813364+0000","last_fullsized":"2023-12-07T21:11:23.813364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.626993+0000","last_change":"2023-12-07T21:13:05.626993+0000","last_active":"2023-12-07T21:13:05.626993+0000","last_peered":"2023-12-07T21:13:05.626993+0000","last_clean":"2023-12-07T21:13:05.626993+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:13:05.626993+0000","last_undegraded":"2023-12-07T21:13:05.626993+0000","last_fullsized":"2023-12-07T21:13:05.626993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.626860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:01.027919+0000","scrub_duration":0.00097400899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:09.345986+0000","last_change":"2023-12-07T21:09:04.931189+0000","last_active":"2023-12-07T21:11:09.345986+0000","last_peered":"2023-12-07T21:11:09.345986+0000","last_clean":"2023-12-07T21:11:09.345986+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:11:09.345986+0000","last_undegraded":"2023-12-07T21:11:09.345986+0000","last_fullsized":"2023-12-07T21:11:09.345986+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.340557+0000","last_change":"2023-12-07T21:13:05.340557+0000","last_active":"2023-12-07T21:13:05.340557+0000","last_peered":"2023-12-07T21:13:05.340557+0000","last_clean":"2023-12-07T21:13:05.340557+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:13:05.340557+0000","last_undegraded":"2023-12-07T21:13:05.340557+0000","last_fullsized":"2023-12-07T21:13:05.340557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.340431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:24.924419+0000","scrub_duration":0.001119035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.409426+0000","last_change":"2023-12-07T21:13:48.409426+0000","last_active":"2023-12-07T21:13:48.409426+0000","last_peered":"2023-12-07T21:13:48.409426+0000","last_clean":"2023-12-07T21:13:48.409426+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:13:48.409426+0000","last_undegraded":"2023-12-07T21:13:48.409426+0000","last_fullsized":"2023-12-07T21:13:48.409426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:48.409284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:48.409284+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.409284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:42.968321+0000","scrub_duration":0.0012408199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812340+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:18.812340+0000","last_peered":"2023-12-07T21:11:18.812340+0000","last_clean":"2023-12-07T21:11:18.812340+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:18.812340+0000","last_undegraded":"2023-12-07T21:11:18.812340+0000","last_fullsized":"2023-12-07T21:11:18.812340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'9","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.887056+0000","last_change":"2023-12-07T21:11:50.887056+0000","last_active":"2023-12-07T21:11:50.887056+0000","last_peered":"2023-12-07T21:11:50.887056+0000","last_clean":"2023-12-07T21:11:50.887056+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:50.887056+0000","last_undegraded":"2023-12-07T21:11:50.887056+0000","last_fullsized":"2023-12-07T21:11:50.887056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.886922+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:02.989113+0000","scrub_duration":0.0042007399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.812347+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:23.812347+0000","last_peered":"2023-12-07T21:11:23.812347+0000","last_clean":"2023-12-07T21:11:23.812347+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:23.812347+0000","last_undegraded":"2023-12-07T21:11:23.812347+0000","last_fullsized":"2023-12-07T21:11:23.812347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.809025+0000","last_change":"2023-12-07T21:09:04.925706+0000","last_active":"2023-12-07T21:11:38.809025+0000","last_peered":"2023-12-07T21:11:38.809025+0000","last_clean":"2023-12-07T21:11:38.809025+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:11:38.809025+0000","last_undegraded":"2023-12-07T21:11:38.809025+0000","last_fullsized":"2023-12-07T21:11:38.809025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.033989+0000","last_change":"2023-12-07T21:13:38.033989+0000","last_active":"2023-12-07T21:13:38.033989+0000","last_peered":"2023-12-07T21:13:38.033989+0000","last_clean":"2023-12-07T21:13:38.033989+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:13:38.033989+0000","last_undegraded":"2023-12-07T21:13:38.033989+0000","last_fullsized":"2023-12-07T21:13:38.033989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:38.033840+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:38.033840+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.033840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:33.434899+0000","scrub_duration":0.001381462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.434901+0000","last_change":"2023-12-07T21:13:28.434901+0000","last_active":"2023-12-07T21:13:28.434901+0000","last_peered":"2023-12-07T21:13:28.434901+0000","last_clean":"2023-12-07T21:13:28.434901+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:13:28.434901+0000","last_undegraded":"2023-12-07T21:13:28.434901+0000","last_fullsized":"2023-12-07T21:13:28.434901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.434771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:49.030870+0000","scrub_duration":0.001230061,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.605108+0000","last_change":"2023-12-07T21:12:18.605108+0000","last_active":"2023-12-07T21:12:18.605108+0000","last_peered":"2023-12-07T21:12:18.605108+0000","last_clean":"2023-12-07T21:12:18.605108+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:12:18.605108+0000","last_undegraded":"2023-12-07T21:12:18.605108+0000","last_fullsized":"2023-12-07T21:12:18.605108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.605002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:30.707193+0000","scrub_duration":0.00090833899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.805867+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:23.805867+0000","last_peered":"2023-12-07T21:11:23.805867+0000","last_clean":"2023-12-07T21:11:23.805867+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:23.805867+0000","last_undegraded":"2023-12-07T21:11:23.805867+0000","last_fullsized":"2023-12-07T21:11:23.805867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.302809+0000","last_change":"2023-12-07T21:11:36.302809+0000","last_active":"2023-12-07T21:11:36.302809+0000","last_peered":"2023-12-07T21:11:36.302809+0000","last_clean":"2023-12-07T21:11:36.302809+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:36.302809+0000","last_undegraded":"2023-12-07T21:11:36.302809+0000","last_fullsized":"2023-12-07T21:11:36.302809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.302687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:01.567462+0000","scrub_duration":0.0014296669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:00.345915+0000","last_change":"2023-12-07T21:14:00.345915+0000","last_active":"2023-12-07T21:14:00.345915+0000","last_peered":"2023-12-07T21:14:00.345915+0000","last_clean":"2023-12-07T21:14:00.345915+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:14:00.345915+0000","last_undegraded":"2023-12-07T21:14:00.345915+0000","last_fullsized":"2023-12-07T21:14:00.345915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:00.345796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:00.345796+0000","last_clean_scrub_stamp":"2023-12-07T21:14:00.345796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:47.511446+0000","scrub_duration":0.0010293559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:29.521893+0000","last_change":"2023-12-07T21:13:29.521893+0000","last_active":"2023-12-07T21:13:29.521893+0000","last_peered":"2023-12-07T21:13:29.521893+0000","last_clean":"2023-12-07T21:13:29.521893+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:13:29.521893+0000","last_undegraded":"2023-12-07T21:13:29.521893+0000","last_fullsized":"2023-12-07T21:13:29.521893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:29.521772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:29.521772+0000","last_clean_scrub_stamp":"2023-12-07T21:13:29.521772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:51:27.306062+0000","scrub_duration":0.001149186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:09.325688+0000","last_change":"2023-12-07T21:13:09.325688+0000","last_active":"2023-12-07T21:13:09.325688+0000","last_peered":"2023-12-07T21:13:09.325688+0000","last_clean":"2023-12-07T21:13:09.325688+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:13:09.325688+0000","last_undegraded":"2023-12-07T21:13:09.325688+0000","last_fullsized":"2023-12-07T21:13:09.325688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_clean_scrub_stamp":"2023-12-07T21:13:09.325568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:45:40.066890+0000","scrub_duration":0.00116248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.514142+0000","last_change":"2023-12-07T21:11:52.514142+0000","last_active":"2023-12-07T21:11:52.514142+0000","last_peered":"2023-12-07T21:11:52.514142+0000","last_clean":"2023-12-07T21:11:52.514142+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:52.514142+0000","last_undegraded":"2023-12-07T21:11:52.514142+0000","last_fullsized":"2023-12-07T21:11:52.514142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.514035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:00:51.180837+0000","scrub_duration":0.00101976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.532802+0000","last_change":"2023-12-07T21:11:32.532802+0000","last_active":"2023-12-07T21:11:32.532802+0000","last_peered":"2023-12-07T21:11:32.532802+0000","last_clean":"2023-12-07T21:11:32.532802+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:32.532802+0000","last_undegraded":"2023-12-07T21:11:32.532802+0000","last_fullsized":"2023-12-07T21:11:32.532802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.532666+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:34.382885+0000","scrub_duration":0.0035860219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.812477+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:23.812477+0000","last_peered":"2023-12-07T21:11:23.812477+0000","last_clean":"2023-12-07T21:11:23.812477+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:23.812477+0000","last_undegraded":"2023-12-07T21:11:23.812477+0000","last_fullsized":"2023-12-07T21:11:23.812477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:31.506721+0000","last_change":"2023-12-07T21:13:31.506752+0000","last_active":"2023-12-07T21:13:31.506721+0000","last_peered":"2023-12-07T21:13:31.506721+0000","last_clean":"2023-12-07T21:13:31.506721+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:13:31.506721+0000","last_undegraded":"2023-12-07T21:13:31.506721+0000","last_fullsized":"2023-12-07T21:13:31.506721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:31.506641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:31.506641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:31.506641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:57:50.535477+0000","scrub_duration":0.0015893470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813265+0000","last_change":"2023-12-07T21:08:54.893173+0000","last_active":"2023-12-07T21:11:23.813265+0000","last_peered":"2023-12-07T21:11:23.813265+0000","last_clean":"2023-12-07T21:11:23.813265+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:11:23.813265+0000","last_undegraded":"2023-12-07T21:11:23.813265+0000","last_fullsized":"2023-12-07T21:11:23.813265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:59.757120+0000","last_change":"2023-12-07T21:11:59.757120+0000","last_active":"2023-12-07T21:11:59.757120+0000","last_peered":"2023-12-07T21:11:59.757120+0000","last_clean":"2023-12-07T21:11:59.757120+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:11:59.757120+0000","last_undegraded":"2023-12-07T21:11:59.757120+0000","last_fullsized":"2023-12-07T21:11:59.757120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_clean_scrub_stamp":"2023-12-07T21:11:59.757017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:04:59.018197+0000","scrub_duration":0.001196353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'61","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.783993+0000","last_change":"2023-12-07T21:11:44.783993+0000","last_active":"2023-12-07T21:11:44.783993+0000","last_peered":"2023-12-07T21:11:44.783993+0000","last_clean":"2023-12-07T21:11:44.783993+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:44.783993+0000","last_undegraded":"2023-12-07T21:11:44.783993+0000","last_fullsized":"2023-12-07T21:11:44.783993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.783824+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:07.474940+0000","scrub_duration":0.004588193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.558908+0000","last_change":"2023-12-07T21:11:36.558908+0000","last_active":"2023-12-07T21:11:36.558908+0000","last_peered":"2023-12-07T21:11:36.558908+0000","last_clean":"2023-12-07T21:11:36.558908+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:11:36.558908+0000","last_undegraded":"2023-12-07T21:11:36.558908+0000","last_fullsized":"2023-12-07T21:11:36.558908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.558807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:33:06.320086+0000","scrub_duration":0.001387288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.806853+0000","last_change":"2023-12-07T21:09:04.929681+0000","last_active":"2023-12-07T21:11:28.806853+0000","last_peered":"2023-12-07T21:11:28.806853+0000","last_clean":"2023-12-07T21:11:28.806853+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:11:28.806853+0000","last_undegraded":"2023-12-07T21:11:28.806853+0000","last_fullsized":"2023-12-07T21:11:28.806853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:19.862179+0000","last_change":"2023-12-07T21:12:19.862179+0000","last_active":"2023-12-07T21:12:19.862179+0000","last_peered":"2023-12-07T21:12:19.862179+0000","last_clean":"2023-12-07T21:12:19.862179+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:12:19.862179+0000","last_undegraded":"2023-12-07T21:12:19.862179+0000","last_fullsized":"2023-12-07T21:12:19.862179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_clean_scrub_stamp":"2023-12-07T21:12:19.862069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:34.168058+0000","scrub_duration":0.0015085669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.431844+0000","last_change":"2023-12-07T21:13:21.431844+0000","last_active":"2023-12-07T21:13:21.431844+0000","last_peered":"2023-12-07T21:13:21.431844+0000","last_clean":"2023-12-07T21:13:21.431844+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:13:21.431844+0000","last_undegraded":"2023-12-07T21:13:21.431844+0000","last_fullsized":"2023-12-07T21:13:21.431844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.431724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:58:06.040375+0000","scrub_duration":0.0012195439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.188111+0000","last_change":"2023-12-07T21:09:35.953448+0000","last_active":"2023-12-07T21:11:10.188111+0000","last_peered":"2023-12-07T21:11:10.188111+0000","last_clean":"2023-12-07T21:11:10.188111+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:11:10.188111+0000","last_undegraded":"2023-12-07T21:11:10.188111+0000","last_fullsized":"2023-12-07T21:11:10.188111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:57.858336+0000","last_clean_scrub_stamp":"2023-12-07T21:08:57.858336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.514738+0000","last_change":"2023-12-07T21:12:21.514738+0000","last_active":"2023-12-07T21:12:21.514738+0000","last_peered":"2023-12-07T21:12:21.514738+0000","last_clean":"2023-12-07T21:12:21.514738+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:12:21.514738+0000","last_undegraded":"2023-12-07T21:12:21.514738+0000","last_fullsized":"2023-12-07T21:12:21.514738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.514603+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:11.760175+0000","scrub_duration":0.0065721260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:13.399009+0000","last_change":"2023-12-07T21:12:13.399009+0000","last_active":"2023-12-07T21:12:13.399009+0000","last_peered":"2023-12-07T21:12:13.399009+0000","last_clean":"2023-12-07T21:12:13.399009+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:12:13.399009+0000","last_undegraded":"2023-12-07T21:12:13.399009+0000","last_fullsized":"2023-12-07T21:12:13.399009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_clean_scrub_stamp":"2023-12-07T21:12:13.398859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:54.725992+0000","scrub_duration":0.0011359600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:50.253895+0000","last_change":"2023-12-07T21:13:50.253916+0000","last_active":"2023-12-07T21:13:50.253895+0000","last_peered":"2023-12-07T21:13:50.253895+0000","last_clean":"2023-12-07T21:13:50.253895+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:13:50.253895+0000","last_undegraded":"2023-12-07T21:13:50.253895+0000","last_fullsized":"2023-12-07T21:13:50.253895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:50.253806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:50.253806+0000","last_clean_scrub_stamp":"2023-12-07T21:13:50.253806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:34:11.268340+0000","scrub_duration":0.0010687579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.432392+0000","last_change":"2023-12-07T21:12:11.432392+0000","last_active":"2023-12-07T21:12:11.432392+0000","last_peered":"2023-12-07T21:12:11.432392+0000","last_clean":"2023-12-07T21:12:11.432392+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:12:11.432392+0000","last_undegraded":"2023-12-07T21:12:11.432392+0000","last_fullsized":"2023-12-07T21:12:11.432392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.432277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:48.190145+0000","scrub_duration":0.0010618419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.427565+0000","last_change":"2023-12-07T21:13:36.427565+0000","last_active":"2023-12-07T21:13:36.427565+0000","last_peered":"2023-12-07T21:13:36.427565+0000","last_clean":"2023-12-07T21:13:36.427565+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:13:36.427565+0000","last_undegraded":"2023-12-07T21:13:36.427565+0000","last_fullsized":"2023-12-07T21:13:36.427565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:36.427462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:36.427462+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.427462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:00:09.657217+0000","scrub_duration":0.0011997139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:10.553135+0000","last_change":"2023-12-07T21:12:10.553135+0000","last_active":"2023-12-07T21:12:10.553135+0000","last_peered":"2023-12-07T21:12:10.553135+0000","last_clean":"2023-12-07T21:12:10.553135+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:12:10.553135+0000","last_undegraded":"2023-12-07T21:12:10.553135+0000","last_fullsized":"2023-12-07T21:12:10.553135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_clean_scrub_stamp":"2023-12-07T21:12:10.553023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:52.504367+0000","scrub_duration":0.0013037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.745178+0000","last_change":"2023-12-07T21:11:36.745178+0000","last_active":"2023-12-07T21:11:36.745178+0000","last_peered":"2023-12-07T21:11:36.745178+0000","last_clean":"2023-12-07T21:11:36.745178+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:36.745178+0000","last_undegraded":"2023-12-07T21:11:36.745178+0000","last_fullsized":"2023-12-07T21:11:36.745178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.745068+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:09.080620+0000","scrub_duration":0.0072373669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:16.616710+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:11:16.616710+0000","last_peered":"2023-12-07T21:11:16.616710+0000","last_clean":"2023-12-07T21:11:16.616710+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:11:16.616710+0000","last_undegraded":"2023-12-07T21:11:16.616710+0000","last_fullsized":"2023-12-07T21:11:16.616710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814594+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:11:28.814594+0000","last_peered":"2023-12-07T21:11:28.814594+0000","last_clean":"2023-12-07T21:11:28.814594+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:11:28.814594+0000","last_undegraded":"2023-12-07T21:11:28.814594+0000","last_fullsized":"2023-12-07T21:11:28.814594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.879540+0000","last_change":"2023-12-07T21:12:56.879540+0000","last_active":"2023-12-07T21:12:56.879540+0000","last_peered":"2023-12-07T21:12:56.879540+0000","last_clean":"2023-12-07T21:12:56.879540+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:12:56.879540+0000","last_undegraded":"2023-12-07T21:12:56.879540+0000","last_fullsized":"2023-12-07T21:12:56.879540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.879389+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:47.124961+0000","scrub_duration":0.0034133409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.341852+0000","last_change":"2023-12-07T21:14:02.341875+0000","last_active":"2023-12-07T21:14:02.341852+0000","last_peered":"2023-12-07T21:14:02.341852+0000","last_clean":"2023-12-07T21:14:02.341852+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:14:02.341852+0000","last_undegraded":"2023-12-07T21:14:02.341852+0000","last_fullsized":"2023-12-07T21:14:02.341852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:02.341757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:02.341757+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.341757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:42.946314+0000","scrub_duration":0.001137264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.324449+0000","last_change":"2023-12-07T21:11:41.324449+0000","last_active":"2023-12-07T21:11:41.324449+0000","last_peered":"2023-12-07T21:11:41.324449+0000","last_clean":"2023-12-07T21:11:41.324449+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:41.324449+0000","last_undegraded":"2023-12-07T21:11:41.324449+0000","last_fullsized":"2023-12-07T21:11:41.324449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.324294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:18:22.956309+0000","scrub_duration":0.001431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.649725+0000","last_change":"2023-12-07T21:12:42.649725+0000","last_active":"2023-12-07T21:12:42.649725+0000","last_peered":"2023-12-07T21:12:42.649725+0000","last_clean":"2023-12-07T21:12:42.649725+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:12:42.649725+0000","last_undegraded":"2023-12-07T21:12:42.649725+0000","last_fullsized":"2023-12-07T21:12:42.649725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.649582+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:55:46.065006+0000","scrub_duration":0.0041186950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":325,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411924+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411924+0000","last_peered":"2023-12-07T21:11:10.411924+0000","last_clean":"2023-12-07T21:11:10.411924+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411924+0000","last_undegraded":"2023-12-07T21:11:10.411924+0000","last_fullsized":"2023-12-07T21:11:10.411924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814347+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:11:28.814347+0000","last_peered":"2023-12-07T21:11:28.814347+0000","last_clean":"2023-12-07T21:11:28.814347+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:11:28.814347+0000","last_undegraded":"2023-12-07T21:11:28.814347+0000","last_fullsized":"2023-12-07T21:11:28.814347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.370762+0000","last_change":"2023-12-07T21:13:07.370762+0000","last_active":"2023-12-07T21:13:07.370762+0000","last_peered":"2023-12-07T21:13:07.370762+0000","last_clean":"2023-12-07T21:13:07.370762+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:13:07.370762+0000","last_undegraded":"2023-12-07T21:13:07.370762+0000","last_fullsized":"2023-12-07T21:13:07.370762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:06.037407+0000","scrub_duration":0.0014696010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.432268+0000","last_change":"2023-12-07T21:13:23.432268+0000","last_active":"2023-12-07T21:13:23.432268+0000","last_peered":"2023-12-07T21:13:23.432268+0000","last_clean":"2023-12-07T21:13:23.432268+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:13:23.432268+0000","last_undegraded":"2023-12-07T21:13:23.432268+0000","last_fullsized":"2023-12-07T21:13:23.432268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.432146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:02:08.854218+0000","scrub_duration":0.001156783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.351557+0000","last_change":"2023-12-07T21:11:43.351557+0000","last_active":"2023-12-07T21:11:43.351557+0000","last_peered":"2023-12-07T21:11:43.351557+0000","last_clean":"2023-12-07T21:11:43.351557+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:43.351557+0000","last_undegraded":"2023-12-07T21:11:43.351557+0000","last_fullsized":"2023-12-07T21:11:43.351557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_clean_scrub_stamp":"2023-12-07T21:11:43.351414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:25.302758+0000","scrub_duration":0.001534795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.813759+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:28.813759+0000","last_peered":"2023-12-07T21:11:28.813759+0000","last_clean":"2023-12-07T21:11:28.813759+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:28.813759+0000","last_undegraded":"2023-12-07T21:11:28.813759+0000","last_fullsized":"2023-12-07T21:11:28.813759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.806704+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:28.806704+0000","last_peered":"2023-12-07T21:11:28.806704+0000","last_clean":"2023-12-07T21:11:28.806704+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:28.806704+0000","last_undegraded":"2023-12-07T21:11:28.806704+0000","last_fullsized":"2023-12-07T21:11:28.806704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:58.411345+0000","last_change":"2023-12-07T21:13:58.411345+0000","last_active":"2023-12-07T21:13:58.411345+0000","last_peered":"2023-12-07T21:13:58.411345+0000","last_clean":"2023-12-07T21:13:58.411345+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:13:58.411345+0000","last_undegraded":"2023-12-07T21:13:58.411345+0000","last_fullsized":"2023-12-07T21:13:58.411345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:58.411237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:58.411237+0000","last_clean_scrub_stamp":"2023-12-07T21:13:58.411237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:57.593351+0000","scrub_duration":0.00098503999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:17.462525+0000","last_change":"2023-12-07T21:13:17.462525+0000","last_active":"2023-12-07T21:13:17.462525+0000","last_peered":"2023-12-07T21:13:17.462525+0000","last_clean":"2023-12-07T21:13:17.462525+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:13:17.462525+0000","last_undegraded":"2023-12-07T21:13:17.462525+0000","last_fullsized":"2023-12-07T21:13:17.462525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_clean_scrub_stamp":"2023-12-07T21:13:17.462415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:57.578294+0000","scrub_duration":0.0013457709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:01.338926+0000","last_change":"2023-12-07T21:14:01.338946+0000","last_active":"2023-12-07T21:14:01.338926+0000","last_peered":"2023-12-07T21:14:01.338926+0000","last_clean":"2023-12-07T21:14:01.338926+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:14:01.338926+0000","last_undegraded":"2023-12-07T21:14:01.338926+0000","last_fullsized":"2023-12-07T21:14:01.338926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:01.338826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:01.338826+0000","last_clean_scrub_stamp":"2023-12-07T21:14:01.338826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:19.893425+0000","scrub_duration":0.0012369779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.612358+0000","last_change":"2023-12-07T21:12:17.612358+0000","last_active":"2023-12-07T21:12:17.612358+0000","last_peered":"2023-12-07T21:12:17.612358+0000","last_clean":"2023-12-07T21:12:17.612358+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:12:17.612358+0000","last_undegraded":"2023-12-07T21:12:17.612358+0000","last_fullsized":"2023-12-07T21:12:17.612358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.612233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:19.658682+0000","scrub_duration":0.00093805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.713922+0000","last_change":"2023-12-07T21:11:41.713922+0000","last_active":"2023-12-07T21:11:41.713922+0000","last_peered":"2023-12-07T21:11:41.713922+0000","last_clean":"2023-12-07T21:11:41.713922+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:41.713922+0000","last_undegraded":"2023-12-07T21:11:41.713922+0000","last_fullsized":"2023-12-07T21:11:41.713922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.713762+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:20:34.087308+0000","scrub_duration":0.004054785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.510342+0000","last_change":"2023-12-07T21:12:27.510342+0000","last_active":"2023-12-07T21:12:27.510342+0000","last_peered":"2023-12-07T21:12:27.510342+0000","last_clean":"2023-12-07T21:12:27.510342+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:12:27.510342+0000","last_undegraded":"2023-12-07T21:12:27.510342+0000","last_fullsized":"2023-12-07T21:12:27.510342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.510237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:49.420820+0000","scrub_duration":0.00099611600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.816275+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:11:33.816275+0000","last_peered":"2023-12-07T21:11:33.816275+0000","last_clean":"2023-12-07T21:11:33.816275+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:11:33.816275+0000","last_undegraded":"2023-12-07T21:11:33.816275+0000","last_fullsized":"2023-12-07T21:11:33.816275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.564326+0000","last_change":"2023-12-07T21:13:28.564326+0000","last_active":"2023-12-07T21:13:28.564326+0000","last_peered":"2023-12-07T21:13:28.564326+0000","last_clean":"2023-12-07T21:13:28.564326+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:13:28.564326+0000","last_undegraded":"2023-12-07T21:13:28.564326+0000","last_fullsized":"2023-12-07T21:13:28.564326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.564212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:00.422576+0000","scrub_duration":0.0013779650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.878922+0000","last_change":"2023-12-07T21:13:08.878977+0000","last_active":"2023-12-07T21:13:08.878922+0000","last_peered":"2023-12-07T21:13:08.878922+0000","last_clean":"2023-12-07T21:13:08.878922+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:13:08.878922+0000","last_undegraded":"2023-12-07T21:13:08.878922+0000","last_fullsized":"2023-12-07T21:13:08.878922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_clean_scrub_stamp":"2023-12-07T21:13:08.878805+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:03.437843+0000","scrub_duration":0.0021145529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.412366+0000","last_change":"2023-12-07T21:11:55.412366+0000","last_active":"2023-12-07T21:11:55.412366+0000","last_peered":"2023-12-07T21:11:55.412366+0000","last_clean":"2023-12-07T21:11:55.412366+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:55.412366+0000","last_undegraded":"2023-12-07T21:11:55.412366+0000","last_fullsized":"2023-12-07T21:11:55.412366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.412243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.514434+0000","scrub_duration":0.0010230090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:00.405945+0000","last_change":"2023-12-07T21:12:00.405945+0000","last_active":"2023-12-07T21:12:00.405945+0000","last_peered":"2023-12-07T21:12:00.405945+0000","last_clean":"2023-12-07T21:12:00.405945+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:12:00.405945+0000","last_undegraded":"2023-12-07T21:12:00.405945+0000","last_fullsized":"2023-12-07T21:12:00.405945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_clean_scrub_stamp":"2023-12-07T21:12:00.405797+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:22.672028+0000","scrub_duration":0.0030248670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.620711+0000","last_change":"2023-12-07T21:12:35.620711+0000","last_active":"2023-12-07T21:12:35.620711+0000","last_peered":"2023-12-07T21:12:35.620711+0000","last_clean":"2023-12-07T21:12:35.620711+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:12:35.620711+0000","last_undegraded":"2023-12-07T21:12:35.620711+0000","last_fullsized":"2023-12-07T21:12:35.620711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.620604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:45:58.984206+0000","scrub_duration":0.00101417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.816183+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:11:33.816183+0000","last_peered":"2023-12-07T21:11:33.816183+0000","last_clean":"2023-12-07T21:11:33.816183+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:11:33.816183+0000","last_undegraded":"2023-12-07T21:11:33.816183+0000","last_fullsized":"2023-12-07T21:11:33.816183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'14","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:45.443225+0000","last_change":"2023-12-07T21:12:45.443225+0000","last_active":"2023-12-07T21:12:45.443225+0000","last_peered":"2023-12-07T21:12:45.443225+0000","last_clean":"2023-12-07T21:12:45.443225+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:12:45.443225+0000","last_undegraded":"2023-12-07T21:12:45.443225+0000","last_fullsized":"2023-12-07T21:12:45.443225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_clean_scrub_stamp":"2023-12-07T21:12:45.443116+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:59.105780+0000","scrub_duration":0.003118975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:41.352194+0000","last_change":"2023-12-07T21:12:41.352194+0000","last_active":"2023-12-07T21:12:41.352194+0000","last_peered":"2023-12-07T21:12:41.352194+0000","last_clean":"2023-12-07T21:12:41.352194+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:12:41.352194+0000","last_undegraded":"2023-12-07T21:12:41.352194+0000","last_fullsized":"2023-12-07T21:12:41.352194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_clean_scrub_stamp":"2023-12-07T21:12:41.352075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:21.467955+0000","scrub_duration":0.001369671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.347728+0000","last_change":"2023-12-07T21:11:44.347728+0000","last_active":"2023-12-07T21:11:44.347728+0000","last_peered":"2023-12-07T21:11:44.347728+0000","last_clean":"2023-12-07T21:11:44.347728+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:44.347728+0000","last_undegraded":"2023-12-07T21:11:44.347728+0000","last_fullsized":"2023-12-07T21:11:44.347728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.347582+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:19:20.740832+0000","scrub_duration":0.0032839919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.582486+0000","last_change":"2023-12-07T21:13:06.582486+0000","last_active":"2023-12-07T21:13:06.582486+0000","last_peered":"2023-12-07T21:13:06.582486+0000","last_clean":"2023-12-07T21:13:06.582486+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:13:06.582486+0000","last_undegraded":"2023-12-07T21:13:06.582486+0000","last_fullsized":"2023-12-07T21:13:06.582486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.582338+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:09:35.689720+0000","scrub_duration":0.0045970239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.807904+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:33.807904+0000","last_peered":"2023-12-07T21:11:33.807904+0000","last_clean":"2023-12-07T21:11:33.807904+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:33.807904+0000","last_undegraded":"2023-12-07T21:11:33.807904+0000","last_fullsized":"2023-12-07T21:11:33.807904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.425991+0000","last_change":"2023-12-07T21:13:38.425991+0000","last_active":"2023-12-07T21:13:38.425991+0000","last_peered":"2023-12-07T21:13:38.425991+0000","last_clean":"2023-12-07T21:13:38.425991+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:13:38.425991+0000","last_undegraded":"2023-12-07T21:13:38.425991+0000","last_fullsized":"2023-12-07T21:13:38.425991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:38.425888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:38.425888+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.425888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:24:24.944080+0000","scrub_duration":0.0010394829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.282874+0000","last_change":"2023-12-07T21:12:20.282874+0000","last_active":"2023-12-07T21:12:20.282874+0000","last_peered":"2023-12-07T21:12:20.282874+0000","last_clean":"2023-12-07T21:12:20.282874+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:12:20.282874+0000","last_undegraded":"2023-12-07T21:12:20.282874+0000","last_fullsized":"2023-12-07T21:12:20.282874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.282741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:25.331572+0000","scrub_duration":0.001103185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.410433+0000","last_change":"2023-12-07T21:13:11.410456+0000","last_active":"2023-12-07T21:13:11.410433+0000","last_peered":"2023-12-07T21:13:11.410433+0000","last_clean":"2023-12-07T21:13:11.410433+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:13:11.410433+0000","last_undegraded":"2023-12-07T21:13:11.410433+0000","last_fullsized":"2023-12-07T21:13:11.410433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.410343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:25:05.365800+0000","scrub_duration":0.00143078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.887062+0000","last_change":"2023-12-07T21:12:35.887062+0000","last_active":"2023-12-07T21:12:35.887062+0000","last_peered":"2023-12-07T21:12:35.887062+0000","last_clean":"2023-12-07T21:12:35.887062+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:12:35.887062+0000","last_undegraded":"2023-12-07T21:12:35.887062+0000","last_fullsized":"2023-12-07T21:12:35.887062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.886915+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:07.595951+0000","scrub_duration":0.0013132650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.022855+0000","last_change":"2023-12-07T21:13:52.022881+0000","last_active":"2023-12-07T21:13:52.022855+0000","last_peered":"2023-12-07T21:13:52.022855+0000","last_clean":"2023-12-07T21:13:52.022855+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:13:52.022855+0000","last_undegraded":"2023-12-07T21:13:52.022855+0000","last_fullsized":"2023-12-07T21:13:52.022855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:52.022763+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:52.022763+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.022763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:23:15.784577+0000","scrub_duration":0.001528983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.424126+0000","last_change":"2023-12-07T21:12:12.424126+0000","last_active":"2023-12-07T21:12:12.424126+0000","last_peered":"2023-12-07T21:12:12.424126+0000","last_clean":"2023-12-07T21:12:12.424126+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:12:12.424126+0000","last_undegraded":"2023-12-07T21:12:12.424126+0000","last_fullsized":"2023-12-07T21:12:12.424126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.424026+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:21.643939+0000","scrub_duration":0.002995218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607794+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:11:10.607794+0000","last_peered":"2023-12-07T21:11:10.607794+0000","last_clean":"2023-12-07T21:11:10.607794+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:11:10.607794+0000","last_undegraded":"2023-12-07T21:11:10.607794+0000","last_fullsized":"2023-12-07T21:11:10.607794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.040427+0000","last_change":"2023-12-07T21:13:36.040464+0000","last_active":"2023-12-07T21:13:36.040427+0000","last_peered":"2023-12-07T21:13:36.040427+0000","last_clean":"2023-12-07T21:13:36.040427+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:13:36.040427+0000","last_undegraded":"2023-12-07T21:13:36.040427+0000","last_fullsized":"2023-12-07T21:13:36.040427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:36.040303+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:36.040303+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.040303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:27:20.323619+0000","scrub_duration":0.0015351799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:59.931829+0000","last_change":"2023-12-07T21:13:59.931849+0000","last_active":"2023-12-07T21:13:59.931829+0000","last_peered":"2023-12-07T21:13:59.931829+0000","last_clean":"2023-12-07T21:13:59.931829+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:13:59.931829+0000","last_undegraded":"2023-12-07T21:13:59.931829+0000","last_fullsized":"2023-12-07T21:13:59.931829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:59.931743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:59.931743+0000","last_clean_scrub_stamp":"2023-12-07T21:13:59.931743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:27.479281+0000","scrub_duration":0.0012518340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.893908+0000","last_change":"2023-12-07T21:13:07.893908+0000","last_active":"2023-12-07T21:13:07.893908+0000","last_peered":"2023-12-07T21:13:07.893908+0000","last_clean":"2023-12-07T21:13:07.893908+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:13:07.893908+0000","last_undegraded":"2023-12-07T21:13:07.893908+0000","last_fullsized":"2023-12-07T21:13:07.893908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.893732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:21.957836+0000","scrub_duration":0.0014675510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:43.075446+0000","last_change":"2023-12-07T21:13:43.075468+0000","last_active":"2023-12-07T21:13:43.075446+0000","last_peered":"2023-12-07T21:13:43.075446+0000","last_clean":"2023-12-07T21:13:43.075446+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:13:43.075446+0000","last_undegraded":"2023-12-07T21:13:43.075446+0000","last_fullsized":"2023-12-07T21:13:43.075446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:43.075357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:43.075357+0000","last_clean_scrub_stamp":"2023-12-07T21:13:43.075357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:16.414998+0000","scrub_duration":0.001175125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:39.400478+0000","last_change":"2023-12-07T21:13:39.400502+0000","last_active":"2023-12-07T21:13:39.400478+0000","last_peered":"2023-12-07T21:13:39.400478+0000","last_clean":"2023-12-07T21:13:39.400478+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:13:39.400478+0000","last_undegraded":"2023-12-07T21:13:39.400478+0000","last_fullsized":"2023-12-07T21:13:39.400478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:39.400392+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:39.400392+0000","last_clean_scrub_stamp":"2023-12-07T21:13:39.400392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:58:58.675909+0000","scrub_duration":0.0010690470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.488346+0000","last_change":"2023-12-07T21:13:27.488385+0000","last_active":"2023-12-07T21:13:27.488346+0000","last_peered":"2023-12-07T21:13:27.488346+0000","last_clean":"2023-12-07T21:13:27.488346+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:13:27.488346+0000","last_undegraded":"2023-12-07T21:13:27.488346+0000","last_fullsized":"2023-12-07T21:13:27.488346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.488243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:20.217342+0000","scrub_duration":0.0011396240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.783809+0000","last_change":"2023-12-07T21:12:21.783809+0000","last_active":"2023-12-07T21:12:21.783809+0000","last_peered":"2023-12-07T21:12:21.783809+0000","last_clean":"2023-12-07T21:12:21.783809+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:12:21.783809+0000","last_undegraded":"2023-12-07T21:12:21.783809+0000","last_fullsized":"2023-12-07T21:12:21.783809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.783687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:25.104216+0000","scrub_duration":0.001223366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.417813+0000","last_change":"2023-12-07T21:12:58.417813+0000","last_active":"2023-12-07T21:12:58.417813+0000","last_peered":"2023-12-07T21:12:58.417813+0000","last_clean":"2023-12-07T21:12:58.417813+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:12:58.417813+0000","last_undegraded":"2023-12-07T21:12:58.417813+0000","last_fullsized":"2023-12-07T21:12:58.417813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.417685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:16.173945+0000","scrub_duration":0.0012264019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.393510+0000","last_change":"2023-12-07T21:12:14.393510+0000","last_active":"2023-12-07T21:12:14.393510+0000","last_peered":"2023-12-07T21:12:14.393510+0000","last_clean":"2023-12-07T21:12:14.393510+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:12:14.393510+0000","last_undegraded":"2023-12-07T21:12:14.393510+0000","last_fullsized":"2023-12-07T21:12:14.393510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.393370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:28.056034+0000","scrub_duration":0.0012787390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.892420+0000","last_change":"2023-12-07T21:14:02.892444+0000","last_active":"2023-12-07T21:14:02.892420+0000","last_peered":"2023-12-07T21:14:02.892420+0000","last_clean":"2023-12-07T21:14:02.892420+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:14:02.892420+0000","last_undegraded":"2023-12-07T21:14:02.892420+0000","last_fullsized":"2023-12-07T21:14:02.892420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:14:02.892333+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:14:02.892333+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.892333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:08:55.928235+0000","scrub_duration":0.001620423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:22.292065+0000","last_change":"2023-12-07T21:12:22.292065+0000","last_active":"2023-12-07T21:12:22.292065+0000","last_peered":"2023-12-07T21:12:22.292065+0000","last_clean":"2023-12-07T21:12:22.292065+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:12:22.292065+0000","last_undegraded":"2023-12-07T21:12:22.292065+0000","last_fullsized":"2023-12-07T21:12:22.292065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_clean_scrub_stamp":"2023-12-07T21:12:22.291964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:19:35.510802+0000","scrub_duration":0.000955034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607807+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:11:10.607807+0000","last_peered":"2023-12-07T21:11:10.607807+0000","last_clean":"2023-12-07T21:11:10.607807+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:11:10.607807+0000","last_undegraded":"2023-12-07T21:11:10.607807+0000","last_fullsized":"2023-12-07T21:11:10.607807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:24.489652+0000","last_change":"2023-12-07T21:12:24.489652+0000","last_active":"2023-12-07T21:12:24.489652+0000","last_peered":"2023-12-07T21:12:24.489652+0000","last_clean":"2023-12-07T21:12:24.489652+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:12:24.489652+0000","last_undegraded":"2023-12-07T21:12:24.489652+0000","last_fullsized":"2023-12-07T21:12:24.489652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_clean_scrub_stamp":"2023-12-07T21:12:24.489525+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:58:44.073512+0000","scrub_duration":0.0022717330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.088717+0000","last_change":"2023-12-07T21:13:21.088717+0000","last_active":"2023-12-07T21:13:21.088717+0000","last_peered":"2023-12-07T21:13:21.088717+0000","last_clean":"2023-12-07T21:13:21.088717+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:13:21.088717+0000","last_undegraded":"2023-12-07T21:13:21.088717+0000","last_fullsized":"2023-12-07T21:13:21.088717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.088571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:31:27.226694+0000","scrub_duration":0.0016712599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.917521+0000","last_change":"2023-12-07T21:13:00.917521+0000","last_active":"2023-12-07T21:13:00.917521+0000","last_peered":"2023-12-07T21:13:00.917521+0000","last_clean":"2023-12-07T21:13:00.917521+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:13:00.917521+0000","last_undegraded":"2023-12-07T21:13:00.917521+0000","last_fullsized":"2023-12-07T21:13:00.917521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.917383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:19.507436+0000","scrub_duration":0.0013780719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.318731+0000","last_change":"2023-12-07T21:13:11.318731+0000","last_active":"2023-12-07T21:13:11.318731+0000","last_peered":"2023-12-07T21:13:11.318731+0000","last_clean":"2023-12-07T21:13:11.318731+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:13:11.318731+0000","last_undegraded":"2023-12-07T21:13:11.318731+0000","last_fullsized":"2023-12-07T21:13:11.318731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.318563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:32:03.116436+0000","scrub_duration":0.0013115340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:33.322751+0000","last_change":"2023-12-07T21:12:33.322751+0000","last_active":"2023-12-07T21:12:33.322751+0000","last_peered":"2023-12-07T21:12:33.322751+0000","last_clean":"2023-12-07T21:12:33.322751+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:12:33.322751+0000","last_undegraded":"2023-12-07T21:12:33.322751+0000","last_fullsized":"2023-12-07T21:12:33.322751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_clean_scrub_stamp":"2023-12-07T21:12:33.322634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:25:00.599068+0000","scrub_duration":0.001216778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.401789+0000","last_change":"2023-12-07T21:13:20.401789+0000","last_active":"2023-12-07T21:13:20.401789+0000","last_peered":"2023-12-07T21:13:20.401789+0000","last_clean":"2023-12-07T21:13:20.401789+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:13:20.401789+0000","last_undegraded":"2023-12-07T21:13:20.401789+0000","last_fullsized":"2023-12-07T21:13:20.401789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.401627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.790385+0000","scrub_duration":0.001405433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:32.342446+0000","last_change":"2023-12-07T21:12:32.342446+0000","last_active":"2023-12-07T21:12:32.342446+0000","last_peered":"2023-12-07T21:12:32.342446+0000","last_clean":"2023-12-07T21:12:32.342446+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:12:32.342446+0000","last_undegraded":"2023-12-07T21:12:32.342446+0000","last_fullsized":"2023-12-07T21:12:32.342446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_clean_scrub_stamp":"2023-12-07T21:12:32.342321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:46.648309+0000","scrub_duration":0.0011184750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:06.373937+0000","last_change":"2023-12-07T21:14:06.373997+0000","last_active":"2023-12-07T21:14:06.373937+0000","last_peered":"2023-12-07T21:14:06.373937+0000","last_clean":"2023-12-07T21:14:06.373937+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:14:06.373937+0000","last_undegraded":"2023-12-07T21:14:06.373937+0000","last_fullsized":"2023-12-07T21:14:06.373937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:14:06.373834+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:14:06.373834+0000","last_clean_scrub_stamp":"2023-12-07T21:14:06.373834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:02:26.088876+0000","scrub_duration":0.0014409469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'16","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.341269+0000","last_change":"2023-12-07T21:12:27.341269+0000","last_active":"2023-12-07T21:12:27.341269+0000","last_peered":"2023-12-07T21:12:27.341269+0000","last_clean":"2023-12-07T21:12:27.341269+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:12:27.341269+0000","last_undegraded":"2023-12-07T21:12:27.341269+0000","last_fullsized":"2023-12-07T21:12:27.341269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.341151+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:55:08.404366+0000","scrub_duration":0.0024774139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.811045+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:11:13.811045+0000","last_peered":"2023-12-07T21:11:13.811045+0000","last_clean":"2023-12-07T21:11:13.811045+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:11:13.811045+0000","last_undegraded":"2023-12-07T21:11:13.811045+0000","last_fullsized":"2023-12-07T21:11:13.811045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:46.318458+0000","last_change":"2023-12-07T21:13:46.318480+0000","last_active":"2023-12-07T21:13:46.318458+0000","last_peered":"2023-12-07T21:13:46.318458+0000","last_clean":"2023-12-07T21:13:46.318458+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:13:46.318458+0000","last_undegraded":"2023-12-07T21:13:46.318458+0000","last_fullsized":"2023-12-07T21:13:46.318458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:46.318375+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:46.318375+0000","last_clean_scrub_stamp":"2023-12-07T21:13:46.318375+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:20:30.826377+0000","scrub_duration":0.001152574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.462656+0000","last_change":"2023-12-07T21:12:54.462656+0000","last_active":"2023-12-07T21:12:54.462656+0000","last_peered":"2023-12-07T21:12:54.462656+0000","last_clean":"2023-12-07T21:12:54.462656+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:12:54.462656+0000","last_undegraded":"2023-12-07T21:12:54.462656+0000","last_fullsized":"2023-12-07T21:12:54.462656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.462543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:12:35.524119+0000","scrub_duration":0.0012396099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:01.404048+0000","last_change":"2023-12-07T21:12:01.404048+0000","last_active":"2023-12-07T21:12:01.404048+0000","last_peered":"2023-12-07T21:12:01.404048+0000","last_clean":"2023-12-07T21:12:01.404048+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:12:01.404048+0000","last_undegraded":"2023-12-07T21:12:01.404048+0000","last_fullsized":"2023-12-07T21:12:01.404048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_clean_scrub_stamp":"2023-12-07T21:12:01.403925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:06:41.638050+0000","scrub_duration":0.0014963070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812768+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:11:18.812768+0000","last_peered":"2023-12-07T21:11:18.812768+0000","last_clean":"2023-12-07T21:11:18.812768+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:11:18.812768+0000","last_undegraded":"2023-12-07T21:11:18.812768+0000","last_fullsized":"2023-12-07T21:11:18.812768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811892+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:11:18.811892+0000","last_peered":"2023-12-07T21:11:18.811892+0000","last_clean":"2023-12-07T21:11:18.811892+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:11:18.811892+0000","last_undegraded":"2023-12-07T21:11:18.811892+0000","last_fullsized":"2023-12-07T21:11:18.811892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:06.990943+0000","last_change":"2023-12-07T21:14:06.990967+0000","last_active":"2023-12-07T21:14:06.990943+0000","last_peered":"2023-12-07T21:14:06.990943+0000","last_clean":"2023-12-07T21:14:06.990943+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:14:06.990943+0000","last_undegraded":"2023-12-07T21:14:06.990943+0000","last_fullsized":"2023-12-07T21:14:06.990943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:14:06.990856+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:14:06.990856+0000","last_clean_scrub_stamp":"2023-12-07T21:14:06.990856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:26.019692+0000","scrub_duration":0.0015824859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.910417+0000","last_change":"2023-12-07T21:13:05.910417+0000","last_active":"2023-12-07T21:13:05.910417+0000","last_peered":"2023-12-07T21:13:05.910417+0000","last_clean":"2023-12-07T21:13:05.910417+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:13:05.910417+0000","last_undegraded":"2023-12-07T21:13:05.910417+0000","last_fullsized":"2023-12-07T21:13:05.910417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.910299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:31:57.708172+0000","scrub_duration":0.001525988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.272208+0000","last_change":"2023-12-07T21:12:56.272208+0000","last_active":"2023-12-07T21:12:56.272208+0000","last_peered":"2023-12-07T21:12:56.272208+0000","last_clean":"2023-12-07T21:12:56.272208+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:12:56.272208+0000","last_undegraded":"2023-12-07T21:12:56.272208+0000","last_fullsized":"2023-12-07T21:12:56.272208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.272079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:16.868178+0000","scrub_duration":0.0010823779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1971,"ondisk_log_size":1971,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1439,"ondisk_log_size":1439,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705734,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.42499999999999999},"min":{"1min":0.32100000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.56399999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.373},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.35999999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56999999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Dec 7 21:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32900000000000001,"15min":0.34100000000000003},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.434,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.24099999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44800000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.26600000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.51000000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.33100000000000002,"15min":0.33600000000000002},"min":{"1min":0.251,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.47499999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.30499999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705733,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.36599999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52600000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.433,"15min":0.432},"min":{"1min":0.33800000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.55000000000000004,"5min":0.621,"15min":0.621},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.32300000000000001},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.42699999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.308,"5min":0.32000000000000001,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.40300000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32500000000000001,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.40699999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.318},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.26000000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48699999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.36399999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705733,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.45500000000000002},"min":{"1min":0.36799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.58999999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.371,"5min":0.222,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33400000000000002,"15min":0.35699999999999998},"min":{"1min":0.26000000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.441,"5min":0.629,"15min":0.629},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32100000000000001,"15min":0.32500000000000001},"min":{"1min":0.24399999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.47799999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.22}]},{"osd":3,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.34000000000000002},"min":{"1min":0.251,"5min":0.191,"15min":0.191},"max":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.252},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35699999999999998,"15min":0.374},"min":{"1min":0.26600000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.497,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.313}]}]},{"osd":0,"up_from":9,"seq":38654705734,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.495},"min":{"1min":0.22800000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.67700000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28299999999999997,"5min":0.191,"15min":0.191},"max":{"1min":0.68100000000000005,"5min":0.747,"15min":0.747},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.503,"15min":0.48499999999999999},"min":{"1min":0.26900000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.503,"15min":0.48099999999999998},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Dec 7 21:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.5,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.67500000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.504,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.59799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:14:14.161 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.161 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.161 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.162 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.162 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.162 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.162 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.162 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.163 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.163 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.163 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.163 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.164 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-12-07T21:08:55.851861+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=55, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.164 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.164 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.164 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.165 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.165 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.165 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.165 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.165 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.166 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.166 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.166 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.166 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.167 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.167 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.167 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.167 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-12-07T21:08:57.858336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=57, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.167 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.168 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.168 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.168 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.168 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.169 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.169 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.169 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.169 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:14.169 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:14:34.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:14:34.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.290+0000 7f744f989640 1 Processor -- start 2023-12-07T21:14:34.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.290+0000 7f744f989640 1 -- start start 2023-12-07T21:14:34.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.290+0000 7f744f989640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f744812a5a0 0x7f744812a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:14:34.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.290+0000 7f744f989640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744812a1e0 con 0x7f744812aec0 2023-12-07T21:14:34.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.290+0000 7f744f989640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744806f890 con 0x7f744812a5a0 2023-12-07T21:14:34.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.290+0000 7f744d725640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f744812a5a0 0x7f744812a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:14:34.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.290+0000 7f744cf24640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f744812aec0 0x7f7448126ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:49754/0 (socket says 172.21.15.89:49754) 2023-12-07T21:14:34.281 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.291+0000 7f744cf24640 1 -- 172.21.15.89:0/3404613166 learned_addr learned my addr 172.21.15.89:0/3404613166 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:14:34.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.291+0000 7f744d725640 1 -- 172.21.15.89:0/3404613166 >> v1:172.21.15.89:6789/0 conn(0x7f744812aec0 legacy=0x7f7448126ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:34.282 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.291+0000 7f744d725640 1 -- 172.21.15.89:0/3404613166 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744806f220 con 0x7f744812a5a0 2023-12-07T21:14:34.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.291+0000 7f744d725640 1 --2- 172.21.15.89:0/3404613166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744812a5a0 0x7f744812a980 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f744400b9c0 tx=0x7f744402e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b12641c9cc024 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:14:34.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.292+0000 7f743ffff640 1 -- 172.21.15.89:0/3404613166 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f744402ed80 con 0x7f744812a5a0 2023-12-07T21:14:34.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.292+0000 7f743ffff640 1 -- 172.21.15.89:0/3404613166 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444036440 con 0x7f744812a5a0 2023-12-07T21:14:34.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.292+0000 7f743ffff640 1 -- 172.21.15.89:0/3404613166 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7444036700 con 0x7f744812a5a0 2023-12-07T21:14:34.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.292+0000 7f744f989640 1 -- 172.21.15.89:0/3404613166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744812a5a0 msgr2=0x7f744812a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:34.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.292+0000 7f744f989640 1 --2- 172.21.15.89:0/3404613166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744812a5a0 0x7f744812a980 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f744400b9c0 tx=0x7f744402e0a0 comp rx=0 tx=0).stop 2023-12-07T21:14:34.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.292+0000 7f744f989640 1 -- 172.21.15.89:0/3404613166 shutdown_connections 2023-12-07T21:14:34.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.292+0000 7f744f989640 1 --2- 172.21.15.89:0/3404613166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744812a5a0 0x7f744812a980 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:14:34.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.292+0000 7f744f989640 1 -- 172.21.15.89:0/3404613166 >> 172.21.15.89:0/3404613166 conn(0x7f74480987f0 msgr2=0x7f7448098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:14:34.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.292+0000 7f744f989640 1 -- 172.21.15.89:0/3404613166 shutdown_connections 2023-12-07T21:14:34.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.292+0000 7f744f989640 1 -- 172.21.15.89:0/3404613166 wait complete. 2023-12-07T21:14:34.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.293+0000 7f744f989640 1 Processor -- start 2023-12-07T21:14:34.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.293+0000 7f744f989640 1 -- start start 2023-12-07T21:14:34.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.293+0000 7f744f989640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744812a5a0 0x7f7448088ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:14:34.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.293+0000 7f744f989640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744808bfb0 con 0x7f744812a5a0 2023-12-07T21:14:34.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.294+0000 7f744d725640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744812a5a0 0x7f7448088ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:14:34.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.294+0000 7f744d725640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744812a5a0 0x7f7448088ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40326/0 (socket says 172.21.15.89:40326) 2023-12-07T21:14:34.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.294+0000 7f744d725640 1 -- 172.21.15.89:0/1431099507 learned_addr learned my addr 172.21.15.89:0/1431099507 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:14:34.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.294+0000 7f744d725640 1 -- 172.21.15.89:0/1431099507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744400b6a0 con 0x7f744812a5a0 2023-12-07T21:14:34.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.294+0000 7f744d725640 1 --2- 172.21.15.89:0/1431099507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744812a5a0 0x7f7448088ff0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7444039040 tx=0x7f74440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:14:34.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.294+0000 7f743dffb640 1 -- 172.21.15.89:0/1431099507 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7444040620 con 0x7f744812a5a0 2023-12-07T21:14:34.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.294+0000 7f743dffb640 1 -- 172.21.15.89:0/1431099507 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444040780 con 0x7f744812a5a0 2023-12-07T21:14:34.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.294+0000 7f744f989640 1 -- 172.21.15.89:0/1431099507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744808a470 con 0x7f744812a5a0 2023-12-07T21:14:34.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.294+0000 7f743dffb640 1 -- 172.21.15.89:0/1431099507 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7444040a40 con 0x7f744812a5a0 2023-12-07T21:14:34.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.294+0000 7f744f989640 1 -- 172.21.15.89:0/1431099507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7448124340 con 0x7f744812a5a0 2023-12-07T21:14:34.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.295+0000 7f743dffb640 1 -- 172.21.15.89:0/1431099507 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7f744403d050 con 0x7f744812a5a0 2023-12-07T21:14:34.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.295+0000 7f744f989640 1 -- 172.21.15.89:0/1431099507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744808ae50 con 0x7f744812a5a0 2023-12-07T21:14:34.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.295+0000 7f743dffb640 1 --2- 172.21.15.89:0/1431099507 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f742c037820 0x7f742c039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:14:34.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.295+0000 7f743dffb640 1 -- 172.21.15.89:0/1431099507 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7f744406f7c0 con 0x7f744812a5a0 2023-12-07T21:14:34.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.296+0000 7f744cf24640 1 --2- 172.21.15.89:0/1431099507 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f742c037820 0x7f742c039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:14:34.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.296+0000 7f744cf24640 1 --2- 172.21.15.89:0/1431099507 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f742c037820 0x7f742c039ce0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7438007fd0 tx=0x7f7438007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:14:34.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.300+0000 7f743dffb640 1 -- 172.21.15.89:0/1431099507 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7444034930 con 0x7f744812a5a0 2023-12-07T21:14:34.454 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.464+0000 7f744f989640 1 -- 172.21.15.89:0/1431099507 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7448070000 con 0x7f742c037820 2023-12-07T21:14:34.470 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.480+0000 7f743dffb640 1 -- 172.21.15.89:0/1431099507 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+676962 (secure 0 0 0) 0x7f74380012f0 con 0x7f742c037820 2023-12-07T21:14:34.477 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:14:34.483 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:14:34.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.485+0000 7f744f989640 1 -- 172.21.15.89:0/1431099507 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f742c037820 msgr2=0x7f742c039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:34.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.485+0000 7f744f989640 1 --2- 172.21.15.89:0/1431099507 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f742c037820 0x7f742c039ce0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7438007fd0 tx=0x7f7438007ac0 comp rx=0 tx=0).stop 2023-12-07T21:14:34.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.485+0000 7f744f989640 1 -- 172.21.15.89:0/1431099507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744812a5a0 msgr2=0x7f7448088ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:34.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.485+0000 7f744f989640 1 --2- 172.21.15.89:0/1431099507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744812a5a0 0x7f7448088ff0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7444039040 tx=0x7f74440046c0 comp rx=0 tx=0).stop 2023-12-07T21:14:34.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.485+0000 7f744f989640 1 -- 172.21.15.89:0/1431099507 shutdown_connections 2023-12-07T21:14:34.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.485+0000 7f744f989640 1 --2- 172.21.15.89:0/1431099507 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7f742c037820 0x7f742c039ce0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:14:34.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.485+0000 7f744f989640 1 --2- 172.21.15.89:0/1431099507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f744812a5a0 0x7f7448088ff0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:14:34.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.485+0000 7f744f989640 1 -- 172.21.15.89:0/1431099507 >> 172.21.15.89:0/1431099507 conn(0x7f74480987f0 msgr2=0x7f744809a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:14:34.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.485+0000 7f744f989640 1 -- 172.21.15.89:0/1431099507 shutdown_connections 2023-12-07T21:14:34.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:34.485+0000 7f744f989640 1 -- 172.21.15.89:0/1431099507 wait complete. 2023-12-07T21:14:34.487 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2023-12-07T21:14:34.155954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1822,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4023,"ondisk_log_size":4023,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148380,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338980,"statfs":{"total":386547056640,"available":386395115520,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":148956952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003824"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:19.413104+0000","last_change":"2023-12-07T21:13:19.413127+0000","last_active":"2023-12-07T21:13:19.413104+0000","last_peered":"2023-12-07T21:13:19.413104+0000","last_clean":"2023-12-07T21:13:19.413104+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:13:19.413104+0000","last_undegraded":"2023-12-07T21:13:19.413104+0000","last_fullsized":"2023-12-07T21:13:19.413104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_clean_scrub_stamp":"2023-12-07T21:13:19.413017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:51.122054+0000","scrub_duration":0.001250333,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.407256+0000","last_change":"2023-12-07T21:12:16.407256+0000","last_active":"2023-12-07T21:12:16.407256+0000","last_peered":"2023-12-07T21:12:16.407256+0000","last_clean":"2023-12-07T21:12:16.407256+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:12:16.407256+0000","last_undegraded":"2023-12-07T21:12:16.407256+0000","last_fullsized":"2023-12-07T21:12:16.407256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.407151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:53.647151+0000","scrub_duration":0.00097124400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.079685+0000","last_change":"2023-12-07T21:13:28.079732+0000","last_active":"2023-12-07T21:13:28.079685+0000","last_peered":"2023-12-07T21:13:28.079685+0000","last_clean":"2023-12-07T21:13:28.079685+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:13:28.079685+0000","last_undegraded":"2023-12-07T21:13:28.079685+0000","last_fullsized":"2023-12-07T21:13:28.079685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.079572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:44:03.747216+0000","scrub_duration":0.0011377760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:30.001134+0000","last_change":"2023-12-07T21:14:30.001172+0000","last_active":"2023-12-07T21:14:30.001134+0000","last_peered":"2023-12-07T21:14:30.001134+0000","last_clean":"2023-12-07T21:14:30.001134+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:14:30.001134+0000","last_undegraded":"2023-12-07T21:14:30.001134+0000","last_fullsized":"2023-12-07T21:14:30.001134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:14:30.001034+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:14:30.001034+0000","last_clean_scrub_stamp":"2023-12-07T21:14:30.001034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:47:32.102632+0000","scrub_duration":0.0013113129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:14.442373+0000","last_change":"2023-12-07T21:14:14.442399+0000","last_active":"2023-12-07T21:14:14.442373+0000","last_peered":"2023-12-07T21:14:14.442373+0000","last_clean":"2023-12-07T21:14:14.442373+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:14:14.442373+0000","last_undegraded":"2023-12-07T21:14:14.442373+0000","last_fullsized":"2023-12-07T21:14:14.442373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:14:14.442278+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:14:14.442278+0000","last_clean_scrub_stamp":"2023-12-07T21:14:14.442278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:47:40.059438+0000","scrub_duration":0.001334046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.314629+0000","last_change":"2023-12-07T21:13:48.314629+0000","last_active":"2023-12-07T21:13:48.314629+0000","last_peered":"2023-12-07T21:13:48.314629+0000","last_clean":"2023-12-07T21:13:48.314629+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:13:48.314629+0000","last_undegraded":"2023-12-07T21:13:48.314629+0000","last_fullsized":"2023-12-07T21:13:48.314629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:48.314524+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:48.314524+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.314524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:17:28.252223+0000","scrub_duration":0.00098961300000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:39.350102+0000","last_change":"2023-12-07T21:13:39.350144+0000","last_active":"2023-12-07T21:13:39.350102+0000","last_peered":"2023-12-07T21:13:39.350102+0000","last_clean":"2023-12-07T21:13:39.350102+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:13:39.350102+0000","last_undegraded":"2023-12-07T21:13:39.350102+0000","last_fullsized":"2023-12-07T21:13:39.350102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:39.350003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:39.350003+0000","last_clean_scrub_stamp":"2023-12-07T21:13:39.350003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:26:22.544329+0000","scrub_duration":0.0013539439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:32.502187+0000","last_change":"2023-12-07T21:13:32.502187+0000","last_active":"2023-12-07T21:13:32.502187+0000","last_peered":"2023-12-07T21:13:32.502187+0000","last_clean":"2023-12-07T21:13:32.502187+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:13:32.502187+0000","last_undegraded":"2023-12-07T21:13:32.502187+0000","last_fullsized":"2023-12-07T21:13:32.502187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:32.502047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:32.502047+0000","last_clean_scrub_stamp":"2023-12-07T21:13:32.502047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:14:30.083430+0000","scrub_duration":0.001154356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814800+0000","last_change":"2023-12-07T21:08:54.886504+0000","last_active":"2023-12-07T21:11:28.814800+0000","last_peered":"2023-12-07T21:11:28.814800+0000","last_clean":"2023-12-07T21:11:28.814800+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:11:28.814800+0000","last_undegraded":"2023-12-07T21:11:28.814800+0000","last_fullsized":"2023-12-07T21:11:28.814800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:39.304151+0000","last_change":"2023-12-07T21:12:39.304151+0000","last_active":"2023-12-07T21:12:39.304151+0000","last_peered":"2023-12-07T21:12:39.304151+0000","last_clean":"2023-12-07T21:12:39.304151+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:12:39.304151+0000","last_undegraded":"2023-12-07T21:12:39.304151+0000","last_fullsized":"2023-12-07T21:12:39.304151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_clean_scrub_stamp":"2023-12-07T21:12:39.304039+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:10.499475+0000","scrub_duration":0.0026021579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:35.274268+0000","last_change":"2023-12-07T21:13:35.274268+0000","last_active":"2023-12-07T21:13:35.274268+0000","last_peered":"2023-12-07T21:13:35.274268+0000","last_clean":"2023-12-07T21:13:35.274268+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:13:35.274268+0000","last_undegraded":"2023-12-07T21:13:35.274268+0000","last_fullsized":"2023-12-07T21:13:35.274268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:35.274152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:35.274152+0000","last_clean_scrub_stamp":"2023-12-07T21:13:35.274152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:55:25.519724+0000","scrub_duration":0.0012329559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:16.527864+0000","last_change":"2023-12-07T21:14:16.527886+0000","last_active":"2023-12-07T21:14:16.527864+0000","last_peered":"2023-12-07T21:14:16.527864+0000","last_clean":"2023-12-07T21:14:16.527864+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:14:16.527864+0000","last_undegraded":"2023-12-07T21:14:16.527864+0000","last_fullsized":"2023-12-07T21:14:16.527864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:14:16.527771+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:14:16.527771+0000","last_clean_scrub_stamp":"2023-12-07T21:14:16.527771+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:34:09.256870+0000","scrub_duration":0.0023275589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:28.377582+0000","last_change":"2023-12-07T21:14:28.377606+0000","last_active":"2023-12-07T21:14:28.377582+0000","last_peered":"2023-12-07T21:14:28.377582+0000","last_clean":"2023-12-07T21:14:28.377582+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:14:28.377582+0000","last_undegraded":"2023-12-07T21:14:28.377582+0000","last_fullsized":"2023-12-07T21:14:28.377582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:28.377486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:28.377486+0000","last_clean_scrub_stamp":"2023-12-07T21:14:28.377486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:22.031779+0000","scrub_duration":0.0011797929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.406511+0000","last_change":"2023-12-07T21:13:54.406569+0000","last_active":"2023-12-07T21:13:54.406511+0000","last_peered":"2023-12-07T21:13:54.406511+0000","last_clean":"2023-12-07T21:13:54.406511+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:13:54.406511+0000","last_undegraded":"2023-12-07T21:13:54.406511+0000","last_fullsized":"2023-12-07T21:13:54.406511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:54.406416+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:54.406416+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.406416+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:23:33.794119+0000","scrub_duration":0.001131316,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.845908+0000","last_change":"2023-12-07T21:12:54.845908+0000","last_active":"2023-12-07T21:12:54.845908+0000","last_peered":"2023-12-07T21:12:54.845908+0000","last_clean":"2023-12-07T21:12:54.845908+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:12:54.845908+0000","last_undegraded":"2023-12-07T21:12:54.845908+0000","last_fullsized":"2023-12-07T21:12:54.845908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.845780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:05.129794+0000","scrub_duration":0.001437123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'14","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.396728+0000","last_change":"2023-12-07T21:12:49.396728+0000","last_active":"2023-12-07T21:12:49.396728+0000","last_peered":"2023-12-07T21:12:49.396728+0000","last_clean":"2023-12-07T21:12:49.396728+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:12:49.396728+0000","last_undegraded":"2023-12-07T21:12:49.396728+0000","last_fullsized":"2023-12-07T21:12:49.396728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.396576+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:24:16.481666+0000","scrub_duration":0.0022819030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.406138+0000","last_change":"2023-12-07T21:13:44.406161+0000","last_active":"2023-12-07T21:13:44.406138+0000","last_peered":"2023-12-07T21:13:44.406138+0000","last_clean":"2023-12-07T21:13:44.406138+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:13:44.406138+0000","last_undegraded":"2023-12-07T21:13:44.406138+0000","last_fullsized":"2023-12-07T21:13:44.406138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:44.406055+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:44.406055+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.406055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:05:23.635609+0000","scrub_duration":0.001103677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:46.400680+0000","last_change":"2023-12-07T21:12:46.400680+0000","last_active":"2023-12-07T21:12:46.400680+0000","last_peered":"2023-12-07T21:12:46.400680+0000","last_clean":"2023-12-07T21:12:46.400680+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:12:46.400680+0000","last_undegraded":"2023-12-07T21:12:46.400680+0000","last_fullsized":"2023-12-07T21:12:46.400680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_clean_scrub_stamp":"2023-12-07T21:12:46.400562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:25.935064+0000","scrub_duration":0.001127915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:34.273474+0000","last_change":"2023-12-07T21:12:34.273474+0000","last_active":"2023-12-07T21:12:34.273474+0000","last_peered":"2023-12-07T21:12:34.273474+0000","last_clean":"2023-12-07T21:12:34.273474+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:12:34.273474+0000","last_undegraded":"2023-12-07T21:12:34.273474+0000","last_fullsized":"2023-12-07T21:12:34.273474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_clean_scrub_stamp":"2023-12-07T21:12:34.273360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:01:32.940162+0000","scrub_duration":0.0011278239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.451445+0000","last_change":"2023-12-07T21:12:52.451445+0000","last_active":"2023-12-07T21:12:52.451445+0000","last_peered":"2023-12-07T21:12:52.451445+0000","last_clean":"2023-12-07T21:12:52.451445+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:12:52.451445+0000","last_undegraded":"2023-12-07T21:12:52.451445+0000","last_fullsized":"2023-12-07T21:12:52.451445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.451316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:57.500148+0000","scrub_duration":0.001350272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.263073+0000","last_change":"2023-12-07T21:13:14.263073+0000","last_active":"2023-12-07T21:13:14.263073+0000","last_peered":"2023-12-07T21:13:14.263073+0000","last_clean":"2023-12-07T21:13:14.263073+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:13:14.263073+0000","last_undegraded":"2023-12-07T21:13:14.263073+0000","last_fullsized":"2023-12-07T21:13:14.263073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.262960+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:28.327063+0000","scrub_duration":0.0023679700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:16.262731+0000","last_change":"2023-12-07T21:13:16.262731+0000","last_active":"2023-12-07T21:13:16.262731+0000","last_peered":"2023-12-07T21:13:16.262731+0000","last_clean":"2023-12-07T21:13:16.262731+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:13:16.262731+0000","last_undegraded":"2023-12-07T21:13:16.262731+0000","last_fullsized":"2023-12-07T21:13:16.262731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_clean_scrub_stamp":"2023-12-07T21:13:16.262599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:56:19.678023+0000","scrub_duration":0.001231251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:40.827245+0000","last_change":"2023-12-07T21:12:40.827245+0000","last_active":"2023-12-07T21:12:40.827245+0000","last_peered":"2023-12-07T21:12:40.827245+0000","last_clean":"2023-12-07T21:12:40.827245+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:12:40.827245+0000","last_undegraded":"2023-12-07T21:12:40.827245+0000","last_fullsized":"2023-12-07T21:12:40.827245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_clean_scrub_stamp":"2023-12-07T21:12:40.827135+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:20.361638+0000","scrub_duration":0.0013685839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:31.449807+0000","last_change":"2023-12-07T21:13:31.449807+0000","last_active":"2023-12-07T21:13:31.449807+0000","last_peered":"2023-12-07T21:13:31.449807+0000","last_clean":"2023-12-07T21:13:31.449807+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:13:31.449807+0000","last_undegraded":"2023-12-07T21:13:31.449807+0000","last_fullsized":"2023-12-07T21:13:31.449807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:31.449683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:31.449683+0000","last_clean_scrub_stamp":"2023-12-07T21:13:31.449683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:54:42.768855+0000","scrub_duration":0.001302246,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:53.488138+0000","last_change":"2023-12-07T21:12:53.488138+0000","last_active":"2023-12-07T21:12:53.488138+0000","last_peered":"2023-12-07T21:12:53.488138+0000","last_clean":"2023-12-07T21:12:53.488138+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:12:53.488138+0000","last_undegraded":"2023-12-07T21:12:53.488138+0000","last_fullsized":"2023-12-07T21:12:53.488138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_clean_scrub_stamp":"2023-12-07T21:12:53.488022+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:20:06.706860+0000","scrub_duration":0.0010715880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.914123+0000","last_change":"2023-12-07T21:12:58.914123+0000","last_active":"2023-12-07T21:12:58.914123+0000","last_peered":"2023-12-07T21:12:58.914123+0000","last_clean":"2023-12-07T21:12:58.914123+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:12:58.914123+0000","last_undegraded":"2023-12-07T21:12:58.914123+0000","last_fullsized":"2023-12-07T21:12:58.914123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.913992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:18.497979+0000","scrub_duration":0.0013136269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.336936+0000","last_change":"2023-12-07T21:12:23.336936+0000","last_active":"2023-12-07T21:12:23.336936+0000","last_peered":"2023-12-07T21:12:23.336936+0000","last_clean":"2023-12-07T21:12:23.336936+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:12:23.336936+0000","last_undegraded":"2023-12-07T21:12:23.336936+0000","last_fullsized":"2023-12-07T21:12:23.336936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.336820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:54.775680+0000","scrub_duration":0.0015463409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:09.312912+0000","last_change":"2023-12-07T21:14:09.312936+0000","last_active":"2023-12-07T21:14:09.312912+0000","last_peered":"2023-12-07T21:14:09.312912+0000","last_clean":"2023-12-07T21:14:09.312912+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:14:09.312912+0000","last_undegraded":"2023-12-07T21:14:09.312912+0000","last_fullsized":"2023-12-07T21:14:09.312912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:09.312814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:09.312814+0000","last_clean_scrub_stamp":"2023-12-07T21:14:09.312814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:15.357851+0000","scrub_duration":0.001286113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'22","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.448678+0000","last_change":"2023-12-07T21:13:44.448678+0000","last_active":"2023-12-07T21:13:44.448678+0000","last_peered":"2023-12-07T21:13:44.448678+0000","last_clean":"2023-12-07T21:13:44.448678+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:13:44.448678+0000","last_undegraded":"2023-12-07T21:13:44.448678+0000","last_fullsized":"2023-12-07T21:13:44.448678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:13:44.448523+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:13:44.448523+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.448523+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:44:57.772201+0000","scrub_duration":0.0035836259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.461414+0000","last_change":"2023-12-07T21:12:20.461414+0000","last_active":"2023-12-07T21:12:20.461414+0000","last_peered":"2023-12-07T21:12:20.461414+0000","last_clean":"2023-12-07T21:12:20.461414+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:12:20.461414+0000","last_undegraded":"2023-12-07T21:12:20.461414+0000","last_fullsized":"2023-12-07T21:12:20.461414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.461275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:11:30.745289+0000","scrub_duration":0.0012528039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:23.380288+0000","last_change":"2023-12-07T21:14:23.380309+0000","last_active":"2023-12-07T21:14:23.380288+0000","last_peered":"2023-12-07T21:14:23.380288+0000","last_clean":"2023-12-07T21:14:23.380288+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:14:23.380288+0000","last_undegraded":"2023-12-07T21:14:23.380288+0000","last_fullsized":"2023-12-07T21:14:23.380288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:23.380196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:23.380196+0000","last_clean_scrub_stamp":"2023-12-07T21:14:23.380196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:43:39.407879+0000","scrub_duration":0.0011949759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":115,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813687+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:23.813687+0000","last_peered":"2023-12-07T21:11:23.813687+0000","last_clean":"2023-12-07T21:11:23.813687+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:23.813687+0000","last_undegraded":"2023-12-07T21:11:23.813687+0000","last_fullsized":"2023-12-07T21:11:23.813687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:03.666683+0000","last_change":"2023-12-07T21:13:03.666683+0000","last_active":"2023-12-07T21:13:03.666683+0000","last_peered":"2023-12-07T21:13:03.666683+0000","last_clean":"2023-12-07T21:13:03.666683+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:13:03.666683+0000","last_undegraded":"2023-12-07T21:13:03.666683+0000","last_fullsized":"2023-12-07T21:13:03.666683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_clean_scrub_stamp":"2023-12-07T21:13:03.666541+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:29:58.918173+0000","scrub_duration":0.0039456209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.345086+0000","last_change":"2023-12-07T21:12:18.345086+0000","last_active":"2023-12-07T21:12:18.345086+0000","last_peered":"2023-12-07T21:12:18.345086+0000","last_clean":"2023-12-07T21:12:18.345086+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:12:18.345086+0000","last_undegraded":"2023-12-07T21:12:18.345086+0000","last_fullsized":"2023-12-07T21:12:18.345086+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.344968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:53:47.984483+0000","scrub_duration":0.00095218699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:26.318843+0000","last_change":"2023-12-07T21:12:26.318843+0000","last_active":"2023-12-07T21:12:26.318843+0000","last_peered":"2023-12-07T21:12:26.318843+0000","last_clean":"2023-12-07T21:12:26.318843+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:12:26.318843+0000","last_undegraded":"2023-12-07T21:12:26.318843+0000","last_fullsized":"2023-12-07T21:12:26.318843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:26.318685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:21.073203+0000","scrub_duration":0.0010887360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.618014+0000","last_change":"2023-12-07T21:13:07.618014+0000","last_active":"2023-12-07T21:13:07.618014+0000","last_peered":"2023-12-07T21:13:07.618014+0000","last_clean":"2023-12-07T21:13:07.618014+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:13:07.618014+0000","last_undegraded":"2023-12-07T21:13:07.618014+0000","last_fullsized":"2023-12-07T21:13:07.618014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.617909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:13.457658+0000","scrub_duration":0.001206459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:46.387428+0000","last_change":"2023-12-07T21:13:46.387471+0000","last_active":"2023-12-07T21:13:46.387428+0000","last_peered":"2023-12-07T21:13:46.387428+0000","last_clean":"2023-12-07T21:13:46.387428+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:13:46.387428+0000","last_undegraded":"2023-12-07T21:13:46.387428+0000","last_fullsized":"2023-12-07T21:13:46.387428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:46.387320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:46.387320+0000","last_clean_scrub_stamp":"2023-12-07T21:13:46.387320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:00.451423+0000","scrub_duration":0.0012501120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.830085+0000","last_change":"2023-12-07T21:11:53.830085+0000","last_active":"2023-12-07T21:11:53.830085+0000","last_peered":"2023-12-07T21:11:53.830085+0000","last_clean":"2023-12-07T21:11:53.830085+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:53.830085+0000","last_undegraded":"2023-12-07T21:11:53.830085+0000","last_fullsized":"2023-12-07T21:11:53.830085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_clean_scrub_stamp":"2023-12-07T21:11:53.829969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:45.205269+0000","scrub_duration":0.001216066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814302+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:28.814302+0000","last_peered":"2023-12-07T21:11:28.814302+0000","last_clean":"2023-12-07T21:11:28.814302+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:28.814302+0000","last_undegraded":"2023-12-07T21:11:28.814302+0000","last_fullsized":"2023-12-07T21:11:28.814302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.304137+0000","last_change":"2023-12-07T21:11:42.304137+0000","last_active":"2023-12-07T21:11:42.304137+0000","last_peered":"2023-12-07T21:11:42.304137+0000","last_clean":"2023-12-07T21:11:42.304137+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:42.304137+0000","last_undegraded":"2023-12-07T21:11:42.304137+0000","last_fullsized":"2023-12-07T21:11:42.304137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.304031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:14.639583+0000","scrub_duration":0.0010594929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:31.746769+0000","last_change":"2023-12-07T21:12:31.746769+0000","last_active":"2023-12-07T21:12:31.746769+0000","last_peered":"2023-12-07T21:12:31.746769+0000","last_clean":"2023-12-07T21:12:31.746769+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:12:31.746769+0000","last_undegraded":"2023-12-07T21:12:31.746769+0000","last_fullsized":"2023-12-07T21:12:31.746769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_clean_scrub_stamp":"2023-12-07T21:12:31.746658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:02.942094+0000","scrub_duration":0.00135096,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.511164+0000","last_change":"2023-12-07T21:13:14.511164+0000","last_active":"2023-12-07T21:13:14.511164+0000","last_peered":"2023-12-07T21:13:14.511164+0000","last_clean":"2023-12-07T21:13:14.511164+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:13:14.511164+0000","last_undegraded":"2023-12-07T21:13:14.511164+0000","last_fullsized":"2023-12-07T21:13:14.511164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.511066+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:07.222427+0000","scrub_duration":0.0030400240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812011+0000","last_change":"2023-12-07T21:08:54.884974+0000","last_active":"2023-12-07T21:11:18.812011+0000","last_peered":"2023-12-07T21:11:18.812011+0000","last_clean":"2023-12-07T21:11:18.812011+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:11:18.812011+0000","last_undegraded":"2023-12-07T21:11:18.812011+0000","last_fullsized":"2023-12-07T21:11:18.812011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.707102+0000","last_change":"2023-12-07T21:11:58.707102+0000","last_active":"2023-12-07T21:11:58.707102+0000","last_peered":"2023-12-07T21:11:58.707102+0000","last_clean":"2023-12-07T21:11:58.707102+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:58.707102+0000","last_undegraded":"2023-12-07T21:11:58.707102+0000","last_fullsized":"2023-12-07T21:11:58.707102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.706965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:56:05.594599+0000","scrub_duration":0.0011023249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.554062+0000","last_change":"2023-12-07T21:11:35.554062+0000","last_active":"2023-12-07T21:11:35.554062+0000","last_peered":"2023-12-07T21:11:35.554062+0000","last_clean":"2023-12-07T21:11:35.554062+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:35.554062+0000","last_undegraded":"2023-12-07T21:11:35.554062+0000","last_fullsized":"2023-12-07T21:11:35.554062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.553946+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:56.699897+0000","scrub_duration":0.0042775269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'247","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:50.595156+0000","last_change":"2023-12-07T21:12:50.595156+0000","last_active":"2023-12-07T21:12:50.595156+0000","last_peered":"2023-12-07T21:12:50.595156+0000","last_clean":"2023-12-07T21:12:50.595156+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:12:50.595156+0000","last_undegraded":"2023-12-07T21:12:50.595156+0000","last_fullsized":"2023-12-07T21:12:50.595156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_clean_scrub_stamp":"2023-12-07T21:12:50.595047+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:57:35.203698+0000","scrub_duration":0.0029719099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:10.459036+0000","last_change":"2023-12-07T21:14:10.459058+0000","last_active":"2023-12-07T21:14:10.459036+0000","last_peered":"2023-12-07T21:14:10.459036+0000","last_clean":"2023-12-07T21:14:10.459036+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:14:10.459036+0000","last_undegraded":"2023-12-07T21:14:10.459036+0000","last_fullsized":"2023-12-07T21:14:10.459036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:10.458940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:10.458940+0000","last_clean_scrub_stamp":"2023-12-07T21:14:10.458940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:42:58.903975+0000","scrub_duration":0.0010316520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.764650+0000","last_change":"2023-12-07T21:12:27.764650+0000","last_active":"2023-12-07T21:12:27.764650+0000","last_peered":"2023-12-07T21:12:27.764650+0000","last_clean":"2023-12-07T21:12:27.764650+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:12:27.764650+0000","last_undegraded":"2023-12-07T21:12:27.764650+0000","last_fullsized":"2023-12-07T21:12:27.764650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.764507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:17:01.731572+0000","scrub_duration":0.0015146649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.348644+0000","last_change":"2023-12-07T21:13:00.348644+0000","last_active":"2023-12-07T21:13:00.348644+0000","last_peered":"2023-12-07T21:13:00.348644+0000","last_clean":"2023-12-07T21:13:00.348644+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:13:00.348644+0000","last_undegraded":"2023-12-07T21:13:00.348644+0000","last_fullsized":"2023-12-07T21:13:00.348644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.348476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:10.632490+0000","scrub_duration":0.001405367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813847+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:23.813847+0000","last_peered":"2023-12-07T21:11:23.813847+0000","last_clean":"2023-12-07T21:11:23.813847+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:23.813847+0000","last_undegraded":"2023-12-07T21:11:23.813847+0000","last_fullsized":"2023-12-07T21:11:23.813847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:29.600086+0000","last_change":"2023-12-07T21:11:29.600086+0000","last_active":"2023-12-07T21:11:29.600086+0000","last_peered":"2023-12-07T21:11:29.600086+0000","last_clean":"2023-12-07T21:11:29.600086+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:29.600086+0000","last_undegraded":"2023-12-07T21:11:29.600086+0000","last_fullsized":"2023-12-07T21:11:29.600086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_clean_scrub_stamp":"2023-12-07T21:11:29.599963+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:30:03.772118+0000","scrub_duration":0.003554771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'247","reported_seq":341,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:02.790465+0000","last_change":"2023-12-07T21:12:02.790465+0000","last_active":"2023-12-07T21:12:02.790465+0000","last_peered":"2023-12-07T21:12:02.790465+0000","last_clean":"2023-12-07T21:12:02.790465+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:12:02.790465+0000","last_undegraded":"2023-12-07T21:12:02.790465+0000","last_fullsized":"2023-12-07T21:12:02.790465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_clean_scrub_stamp":"2023-12-07T21:12:02.790346+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:07.839178+0000","scrub_duration":0.0026089529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:51.249565+0000","last_change":"2023-12-07T21:13:51.249634+0000","last_active":"2023-12-07T21:13:51.249565+0000","last_peered":"2023-12-07T21:13:51.249565+0000","last_clean":"2023-12-07T21:13:51.249565+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:13:51.249565+0000","last_undegraded":"2023-12-07T21:13:51.249565+0000","last_fullsized":"2023-12-07T21:13:51.249565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:51.249439+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:51.249439+0000","last_clean_scrub_stamp":"2023-12-07T21:13:51.249439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:43.146224+0000","scrub_duration":0.001108798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.293568+0000","last_change":"2023-12-07T21:13:36.293592+0000","last_active":"2023-12-07T21:13:36.293568+0000","last_peered":"2023-12-07T21:13:36.293568+0000","last_clean":"2023-12-07T21:13:36.293568+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:13:36.293568+0000","last_undegraded":"2023-12-07T21:13:36.293568+0000","last_fullsized":"2023-12-07T21:13:36.293568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:36.293469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:36.293469+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.293469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:55.877457+0000","scrub_duration":0.0012759609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.443153+0000","last_change":"2023-12-07T21:11:56.443153+0000","last_active":"2023-12-07T21:11:56.443153+0000","last_peered":"2023-12-07T21:11:56.443153+0000","last_clean":"2023-12-07T21:11:56.443153+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:56.443153+0000","last_undegraded":"2023-12-07T21:11:56.443153+0000","last_fullsized":"2023-12-07T21:11:56.443153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.443045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:05.069384+0000","scrub_duration":0.0010685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.606842+0000","last_change":"2023-12-07T21:11:39.606842+0000","last_active":"2023-12-07T21:11:39.606842+0000","last_peered":"2023-12-07T21:11:39.606842+0000","last_clean":"2023-12-07T21:11:39.606842+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:39.606842+0000","last_undegraded":"2023-12-07T21:11:39.606842+0000","last_fullsized":"2023-12-07T21:11:39.606842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.606684+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:36.950556+0000","scrub_duration":0.0069737849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:34.781711+0000","last_change":"2023-12-07T21:11:34.781711+0000","last_active":"2023-12-07T21:11:34.781711+0000","last_peered":"2023-12-07T21:11:34.781711+0000","last_clean":"2023-12-07T21:11:34.781711+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:34.781711+0000","last_undegraded":"2023-12-07T21:11:34.781711+0000","last_fullsized":"2023-12-07T21:11:34.781711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:34.781604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:44.478780+0000","scrub_duration":0.001255822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.468162+0000","last_change":"2023-12-07T21:14:02.468187+0000","last_active":"2023-12-07T21:14:02.468162+0000","last_peered":"2023-12-07T21:14:02.468162+0000","last_clean":"2023-12-07T21:14:02.468162+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:14:02.468162+0000","last_undegraded":"2023-12-07T21:14:02.468162+0000","last_fullsized":"2023-12-07T21:14:02.468162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2023-12-07T21:14:02.468073+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2023-12-07T21:14:02.468073+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.468073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:15.400853+0000","scrub_duration":0.001158437,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'22","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.326862+0000","last_change":"2023-12-07T21:12:36.326862+0000","last_active":"2023-12-07T21:12:36.326862+0000","last_peered":"2023-12-07T21:12:36.326862+0000","last_clean":"2023-12-07T21:12:36.326862+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:12:36.326862+0000","last_undegraded":"2023-12-07T21:12:36.326862+0000","last_fullsized":"2023-12-07T21:12:36.326862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.326694+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:24:30.282151+0000","scrub_duration":0.0028268410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.338776+0000","last_change":"2023-12-07T21:13:06.338776+0000","last_active":"2023-12-07T21:13:06.338776+0000","last_peered":"2023-12-07T21:13:06.338776+0000","last_clean":"2023-12-07T21:13:06.338776+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:13:06.338776+0000","last_undegraded":"2023-12-07T21:13:06.338776+0000","last_fullsized":"2023-12-07T21:13:06.338776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.338641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:59:17.495976+0000","scrub_duration":0.001242176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:07.717459+0000","last_change":"2023-12-07T21:12:07.717459+0000","last_active":"2023-12-07T21:12:07.717459+0000","last_peered":"2023-12-07T21:12:07.717459+0000","last_clean":"2023-12-07T21:12:07.717459+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:12:07.717459+0000","last_undegraded":"2023-12-07T21:12:07.717459+0000","last_fullsized":"2023-12-07T21:12:07.717459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_clean_scrub_stamp":"2023-12-07T21:12:07.717342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:32.009926+0000","scrub_duration":0.0014039289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:09.439747+0000","last_change":"2023-12-07T21:12:09.439747+0000","last_active":"2023-12-07T21:12:09.439747+0000","last_peered":"2023-12-07T21:12:09.439747+0000","last_clean":"2023-12-07T21:12:09.439747+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:12:09.439747+0000","last_undegraded":"2023-12-07T21:12:09.439747+0000","last_fullsized":"2023-12-07T21:12:09.439747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_clean_scrub_stamp":"2023-12-07T21:12:09.439641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:19.195035+0000","scrub_duration":0.0043223589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.735466+0000","last_change":"2023-12-07T21:11:33.735466+0000","last_active":"2023-12-07T21:11:33.735466+0000","last_peered":"2023-12-07T21:11:33.735466+0000","last_clean":"2023-12-07T21:11:33.735466+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:33.735466+0000","last_undegraded":"2023-12-07T21:11:33.735466+0000","last_fullsized":"2023-12-07T21:11:33.735466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.735352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:03.972116+0000","scrub_duration":0.0011441929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:55.388916+0000","last_change":"2023-12-07T21:13:55.388945+0000","last_active":"2023-12-07T21:13:55.388916+0000","last_peered":"2023-12-07T21:13:55.388916+0000","last_clean":"2023-12-07T21:13:55.388916+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:13:55.388916+0000","last_undegraded":"2023-12-07T21:13:55.388916+0000","last_fullsized":"2023-12-07T21:13:55.388916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:55.388828+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:55.388828+0000","last_clean_scrub_stamp":"2023-12-07T21:13:55.388828+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:43:17.552727+0000","scrub_duration":0.0021899129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.429281+0000","last_change":"2023-12-07T21:12:36.429281+0000","last_active":"2023-12-07T21:12:36.429281+0000","last_peered":"2023-12-07T21:12:36.429281+0000","last_clean":"2023-12-07T21:12:36.429281+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:12:36.429281+0000","last_undegraded":"2023-12-07T21:12:36.429281+0000","last_fullsized":"2023-12-07T21:12:36.429281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.429148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:19.936617+0000","scrub_duration":0.001111988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.297715+0000","last_change":"2023-12-07T21:13:52.297739+0000","last_active":"2023-12-07T21:13:52.297715+0000","last_peered":"2023-12-07T21:13:52.297715+0000","last_clean":"2023-12-07T21:13:52.297715+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:13:52.297715+0000","last_undegraded":"2023-12-07T21:13:52.297715+0000","last_fullsized":"2023-12-07T21:13:52.297715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:52.297625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:52.297625+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.297625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:57:04.497787+0000","scrub_duration":0.0012997989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.810375+0000","last_change":"2023-12-07T21:12:15.810375+0000","last_active":"2023-12-07T21:12:15.810375+0000","last_peered":"2023-12-07T21:12:15.810375+0000","last_clean":"2023-12-07T21:12:15.810375+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:12:15.810375+0000","last_undegraded":"2023-12-07T21:12:15.810375+0000","last_fullsized":"2023-12-07T21:12:15.810375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.810269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:33.566530+0000","scrub_duration":0.0014408579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.522112+0000","last_change":"2023-12-07T21:11:50.522112+0000","last_active":"2023-12-07T21:11:50.522112+0000","last_peered":"2023-12-07T21:11:50.522112+0000","last_clean":"2023-12-07T21:11:50.522112+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:50.522112+0000","last_undegraded":"2023-12-07T21:11:50.522112+0000","last_fullsized":"2023-12-07T21:11:50.522112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.521955+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:04.827943+0000","scrub_duration":0.0073561030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":308,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.761887+0000","last_change":"2023-12-07T21:11:35.761887+0000","last_active":"2023-12-07T21:11:35.761887+0000","last_peered":"2023-12-07T21:11:35.761887+0000","last_clean":"2023-12-07T21:11:35.761887+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:35.761887+0000","last_undegraded":"2023-12-07T21:11:35.761887+0000","last_fullsized":"2023-12-07T21:11:35.761887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.761766+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:14.383149+0000","scrub_duration":0.0016151640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:10.903257+0000","last_change":"2023-12-07T21:14:10.903279+0000","last_active":"2023-12-07T21:14:10.903257+0000","last_peered":"2023-12-07T21:14:10.903257+0000","last_clean":"2023-12-07T21:14:10.903257+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:14:10.903257+0000","last_undegraded":"2023-12-07T21:14:10.903257+0000","last_fullsized":"2023-12-07T21:14:10.903257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:14:10.903156+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:14:10.903156+0000","last_clean_scrub_stamp":"2023-12-07T21:14:10.903156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:37.591921+0000","scrub_duration":0.001103047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:55.462356+0000","last_change":"2023-12-07T21:12:55.462356+0000","last_active":"2023-12-07T21:12:55.462356+0000","last_peered":"2023-12-07T21:12:55.462356+0000","last_clean":"2023-12-07T21:12:55.462356+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:12:55.462356+0000","last_undegraded":"2023-12-07T21:12:55.462356+0000","last_fullsized":"2023-12-07T21:12:55.462356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_clean_scrub_stamp":"2023-12-07T21:12:55.462251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:57:45.150167+0000","scrub_duration":0.0012320580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:07.335753+0000","last_change":"2023-12-07T21:14:07.335776+0000","last_active":"2023-12-07T21:14:07.335753+0000","last_peered":"2023-12-07T21:14:07.335753+0000","last_clean":"2023-12-07T21:14:07.335753+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:14:07.335753+0000","last_undegraded":"2023-12-07T21:14:07.335753+0000","last_fullsized":"2023-12-07T21:14:07.335753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:07.335666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:07.335666+0000","last_clean_scrub_stamp":"2023-12-07T21:14:07.335666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:32:21.017600+0000","scrub_duration":0.0011737270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.753724+0000","last_change":"2023-12-07T21:11:55.753724+0000","last_active":"2023-12-07T21:11:55.753724+0000","last_peered":"2023-12-07T21:11:55.753724+0000","last_clean":"2023-12-07T21:11:55.753724+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:55.753724+0000","last_undegraded":"2023-12-07T21:11:55.753724+0000","last_fullsized":"2023-12-07T21:11:55.753724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.753576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:53:37.572475+0000","scrub_duration":0.0013913199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:31.726564+0000","last_change":"2023-12-07T21:11:31.726564+0000","last_active":"2023-12-07T21:11:31.726564+0000","last_peered":"2023-12-07T21:11:31.726564+0000","last_clean":"2023-12-07T21:11:31.726564+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:31.726564+0000","last_undegraded":"2023-12-07T21:11:31.726564+0000","last_fullsized":"2023-12-07T21:11:31.726564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:31.726451+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:36.775283+0000","scrub_duration":0.0038601009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.752564+0000","last_change":"2023-12-07T21:11:56.752564+0000","last_active":"2023-12-07T21:11:56.752564+0000","last_peered":"2023-12-07T21:11:56.752564+0000","last_clean":"2023-12-07T21:11:56.752564+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:56.752564+0000","last_undegraded":"2023-12-07T21:11:56.752564+0000","last_fullsized":"2023-12-07T21:11:56.752564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.752450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:44.261937+0000","scrub_duration":0.0012919610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'6","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:07.983141+0000","last_change":"2023-12-07T21:14:07.983170+0000","last_active":"2023-12-07T21:14:07.983141+0000","last_peered":"2023-12-07T21:14:07.983141+0000","last_clean":"2023-12-07T21:14:07.983141+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:14:07.983141+0000","last_undegraded":"2023-12-07T21:14:07.983141+0000","last_fullsized":"2023-12-07T21:14:07.983141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:14:07.983055+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:14:07.983055+0000","last_clean_scrub_stamp":"2023-12-07T21:14:07.983055+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:09:22.412930+0000","scrub_duration":0.0032971929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:17.483370+0000","last_change":"2023-12-07T21:14:17.483392+0000","last_active":"2023-12-07T21:14:17.483370+0000","last_peered":"2023-12-07T21:14:17.483370+0000","last_clean":"2023-12-07T21:14:17.483370+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:14:17.483370+0000","last_undegraded":"2023-12-07T21:14:17.483370+0000","last_fullsized":"2023-12-07T21:14:17.483370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:17.483282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:17.483282+0000","last_clean_scrub_stamp":"2023-12-07T21:14:17.483282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:28:01.766599+0000","scrub_duration":0.001092197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:58.953267+0000","last_change":"2023-12-07T21:13:58.953288+0000","last_active":"2023-12-07T21:13:58.953267+0000","last_peered":"2023-12-07T21:13:58.953267+0000","last_clean":"2023-12-07T21:13:58.953267+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:13:58.953267+0000","last_undegraded":"2023-12-07T21:13:58.953267+0000","last_fullsized":"2023-12-07T21:13:58.953267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:58.953174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:58.953174+0000","last_clean_scrub_stamp":"2023-12-07T21:13:58.953174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:58.135287+0000","scrub_duration":0.0012512140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.578121+0000","last_change":"2023-12-07T21:12:12.578121+0000","last_active":"2023-12-07T21:12:12.578121+0000","last_peered":"2023-12-07T21:12:12.578121+0000","last_clean":"2023-12-07T21:12:12.578121+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:12:12.578121+0000","last_undegraded":"2023-12-07T21:12:12.578121+0000","last_fullsized":"2023-12-07T21:12:12.578121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.578001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:21:04.951547+0000","scrub_duration":0.0009980639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.222572+0000","last_change":"2023-12-07T21:11:32.222572+0000","last_active":"2023-12-07T21:11:32.222572+0000","last_peered":"2023-12-07T21:11:32.222572+0000","last_clean":"2023-12-07T21:11:32.222572+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:32.222572+0000","last_undegraded":"2023-12-07T21:11:32.222572+0000","last_fullsized":"2023-12-07T21:11:32.222572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.222451+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:29.566323+0000","scrub_duration":0.0042948600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:25.579998+0000","last_change":"2023-12-07T21:13:25.579998+0000","last_active":"2023-12-07T21:13:25.579998+0000","last_peered":"2023-12-07T21:13:25.579998+0000","last_clean":"2023-12-07T21:13:25.579998+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:13:25.579998+0000","last_undegraded":"2023-12-07T21:13:25.579998+0000","last_fullsized":"2023-12-07T21:13:25.579998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_clean_scrub_stamp":"2023-12-07T21:13:25.579880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:22:49.341694+0000","scrub_duration":0.001424259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608819+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:11:10.608819+0000","last_peered":"2023-12-07T21:11:10.608819+0000","last_clean":"2023-12-07T21:11:10.608819+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:11:10.608819+0000","last_undegraded":"2023-12-07T21:11:10.608819+0000","last_fullsized":"2023-12-07T21:11:10.608819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:18.499430+0000","last_change":"2023-12-07T21:14:18.499472+0000","last_active":"2023-12-07T21:14:18.499430+0000","last_peered":"2023-12-07T21:14:18.499430+0000","last_clean":"2023-12-07T21:14:18.499430+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:14:18.499430+0000","last_undegraded":"2023-12-07T21:14:18.499430+0000","last_fullsized":"2023-12-07T21:14:18.499430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:14:18.499337+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:14:18.499337+0000","last_clean_scrub_stamp":"2023-12-07T21:14:18.499337+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:40:45.976981+0000","scrub_duration":0.0011107020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:04.345887+0000","last_change":"2023-12-07T21:14:04.345941+0000","last_active":"2023-12-07T21:14:04.345887+0000","last_peered":"2023-12-07T21:14:04.345887+0000","last_clean":"2023-12-07T21:14:04.345887+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:14:04.345887+0000","last_undegraded":"2023-12-07T21:14:04.345887+0000","last_fullsized":"2023-12-07T21:14:04.345887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:04.345774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:04.345774+0000","last_clean_scrub_stamp":"2023-12-07T21:14:04.345774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:45.945110+0000","scrub_duration":0.0013151079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:54.784564+0000","last_change":"2023-12-07T21:11:54.784564+0000","last_active":"2023-12-07T21:11:54.784564+0000","last_peered":"2023-12-07T21:11:54.784564+0000","last_clean":"2023-12-07T21:11:54.784564+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:54.784564+0000","last_undegraded":"2023-12-07T21:11:54.784564+0000","last_fullsized":"2023-12-07T21:11:54.784564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_clean_scrub_stamp":"2023-12-07T21:11:54.784441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:06.366596+0000","scrub_duration":0.001044002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.576788+0000","last_change":"2023-12-07T21:11:38.576788+0000","last_active":"2023-12-07T21:11:38.576788+0000","last_peered":"2023-12-07T21:11:38.576788+0000","last_clean":"2023-12-07T21:11:38.576788+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:38.576788+0000","last_undegraded":"2023-12-07T21:11:38.576788+0000","last_fullsized":"2023-12-07T21:11:38.576788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.576637+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:37:48.632379+0000","scrub_duration":0.0068514220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":337,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625046+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625046+0000","last_peered":"2023-12-07T21:11:28.625046+0000","last_clean":"2023-12-07T21:11:28.625046+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625046+0000","last_undegraded":"2023-12-07T21:11:28.625046+0000","last_fullsized":"2023-12-07T21:11:28.625046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.858711+0000","last_change":"2023-12-07T21:12:16.858711+0000","last_active":"2023-12-07T21:12:16.858711+0000","last_peered":"2023-12-07T21:12:16.858711+0000","last_clean":"2023-12-07T21:12:16.858711+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:12:16.858711+0000","last_undegraded":"2023-12-07T21:12:16.858711+0000","last_fullsized":"2023-12-07T21:12:16.858711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.858602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:29:51.847246+0000","scrub_duration":0.0011473449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.447750+0000","last_change":"2023-12-07T21:13:23.447750+0000","last_active":"2023-12-07T21:13:23.447750+0000","last_peered":"2023-12-07T21:13:23.447750+0000","last_clean":"2023-12-07T21:13:23.447750+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:13:23.447750+0000","last_undegraded":"2023-12-07T21:13:23.447750+0000","last_fullsized":"2023-12-07T21:13:23.447750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.447646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:28:02.982148+0000","scrub_duration":0.0010737139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:03.361960+0000","last_change":"2023-12-07T21:14:03.361984+0000","last_active":"2023-12-07T21:14:03.361960+0000","last_peered":"2023-12-07T21:14:03.361960+0000","last_clean":"2023-12-07T21:14:03.361960+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:14:03.361960+0000","last_undegraded":"2023-12-07T21:14:03.361960+0000","last_fullsized":"2023-12-07T21:14:03.361960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:14:03.361875+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:14:03.361875+0000","last_clean_scrub_stamp":"2023-12-07T21:14:03.361875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:49.744783+0000","scrub_duration":0.0013072349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.296697+0000","last_change":"2023-12-07T21:11:38.296697+0000","last_active":"2023-12-07T21:11:38.296697+0000","last_peered":"2023-12-07T21:11:38.296697+0000","last_clean":"2023-12-07T21:11:38.296697+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:38.296697+0000","last_undegraded":"2023-12-07T21:11:38.296697+0000","last_fullsized":"2023-12-07T21:11:38.296697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.296568+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:08.533333+0000","scrub_duration":0.0033144630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.654323+0000","last_change":"2023-12-07T21:13:04.654323+0000","last_active":"2023-12-07T21:13:04.654323+0000","last_peered":"2023-12-07T21:13:04.654323+0000","last_clean":"2023-12-07T21:13:04.654323+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:13:04.654323+0000","last_undegraded":"2023-12-07T21:13:04.654323+0000","last_fullsized":"2023-12-07T21:13:04.654323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.654200+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:02:30.647135+0000","scrub_duration":0.0041448730000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'247","reported_seq":373,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:47.359735+0000","last_change":"2023-12-07T21:11:47.359735+0000","last_active":"2023-12-07T21:11:47.359735+0000","last_peered":"2023-12-07T21:11:47.359735+0000","last_clean":"2023-12-07T21:11:47.359735+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:47.359735+0000","last_undegraded":"2023-12-07T21:11:47.359735+0000","last_fullsized":"2023-12-07T21:11:47.359735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_clean_scrub_stamp":"2023-12-07T21:11:47.359610+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:10.050726+0000","scrub_duration":0.0028663759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.579785+0000","last_change":"2023-12-07T21:12:14.579785+0000","last_active":"2023-12-07T21:12:14.579785+0000","last_peered":"2023-12-07T21:12:14.579785+0000","last_clean":"2023-12-07T21:12:14.579785+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:12:14.579785+0000","last_undegraded":"2023-12-07T21:12:14.579785+0000","last_fullsized":"2023-12-07T21:12:14.579785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.579627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:44.957962+0000","scrub_duration":0.0013656510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.375184+0000","last_change":"2023-12-07T21:12:17.375184+0000","last_active":"2023-12-07T21:12:17.375184+0000","last_peered":"2023-12-07T21:12:17.375184+0000","last_clean":"2023-12-07T21:12:17.375184+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:12:17.375184+0000","last_undegraded":"2023-12-07T21:12:17.375184+0000","last_fullsized":"2023-12-07T21:12:17.375184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.375067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:21:31.008297+0000","scrub_duration":0.001068486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:56.280215+0000","last_change":"2023-12-07T21:13:56.280253+0000","last_active":"2023-12-07T21:13:56.280215+0000","last_peered":"2023-12-07T21:13:56.280215+0000","last_clean":"2023-12-07T21:13:56.280215+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:13:56.280215+0000","last_undegraded":"2023-12-07T21:13:56.280215+0000","last_fullsized":"2023-12-07T21:13:56.280215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:56.280106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:56.280106+0000","last_clean_scrub_stamp":"2023-12-07T21:13:56.280106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:21.512744+0000","scrub_duration":0.001246306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.847914+0000","last_change":"2023-12-07T21:11:28.847914+0000","last_active":"2023-12-07T21:11:28.847914+0000","last_peered":"2023-12-07T21:11:28.847914+0000","last_clean":"2023-12-07T21:11:28.847914+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:28.847914+0000","last_undegraded":"2023-12-07T21:11:28.847914+0000","last_fullsized":"2023-12-07T21:11:28.847914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.847797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:20:42.481026+0000","scrub_duration":0.001132973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262786+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262786+0000","last_peered":"2023-12-07T21:11:27.262786+0000","last_clean":"2023-12-07T21:11:27.262786+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262786+0000","last_undegraded":"2023-12-07T21:11:27.262786+0000","last_fullsized":"2023-12-07T21:11:27.262786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811401+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:18.811401+0000","last_peered":"2023-12-07T21:11:18.811401+0000","last_clean":"2023-12-07T21:11:18.811401+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:18.811401+0000","last_undegraded":"2023-12-07T21:11:18.811401+0000","last_fullsized":"2023-12-07T21:11:18.811401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:42.422577+0000","last_change":"2023-12-07T21:13:42.422626+0000","last_active":"2023-12-07T21:13:42.422577+0000","last_peered":"2023-12-07T21:13:42.422577+0000","last_clean":"2023-12-07T21:13:42.422577+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:13:42.422577+0000","last_undegraded":"2023-12-07T21:13:42.422577+0000","last_fullsized":"2023-12-07T21:13:42.422577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:42.422461+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:42.422461+0000","last_clean_scrub_stamp":"2023-12-07T21:13:42.422461+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:15.762102+0000","scrub_duration":0.0036148259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:08.448223+0000","last_change":"2023-12-07T21:12:08.448223+0000","last_active":"2023-12-07T21:12:08.448223+0000","last_peered":"2023-12-07T21:12:08.448223+0000","last_clean":"2023-12-07T21:12:08.448223+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:12:08.448223+0000","last_undegraded":"2023-12-07T21:12:08.448223+0000","last_fullsized":"2023-12-07T21:12:08.448223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_clean_scrub_stamp":"2023-12-07T21:12:08.448115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:53:48.563995+0000","scrub_duration":0.001037821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":194,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:18.321344+0000","last_change":"2023-12-07T21:13:18.321375+0000","last_active":"2023-12-07T21:13:18.321344+0000","last_peered":"2023-12-07T21:13:18.321344+0000","last_clean":"2023-12-07T21:13:18.321344+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:13:18.321344+0000","last_undegraded":"2023-12-07T21:13:18.321344+0000","last_fullsized":"2023-12-07T21:13:18.321344+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_clean_scrub_stamp":"2023-12-07T21:13:18.321258+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:57.708960+0000","scrub_duration":0.0041701730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607432+0000","last_change":"2023-12-07T21:08:46.820016+0000","last_active":"2023-12-07T21:11:10.607432+0000","last_peered":"2023-12-07T21:11:10.607432+0000","last_clean":"2023-12-07T21:11:10.607432+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:11:10.607432+0000","last_undegraded":"2023-12-07T21:11:10.607432+0000","last_fullsized":"2023-12-07T21:11:10.607432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:22.413684+0000","last_change":"2023-12-07T21:14:22.413706+0000","last_active":"2023-12-07T21:14:22.413684+0000","last_peered":"2023-12-07T21:14:22.413684+0000","last_clean":"2023-12-07T21:14:22.413684+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:14:22.413684+0000","last_undegraded":"2023-12-07T21:14:22.413684+0000","last_fullsized":"2023-12-07T21:14:22.413684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:22.413596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:22.413596+0000","last_clean_scrub_stamp":"2023-12-07T21:14:22.413596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:58:45.461092+0000","scrub_duration":0.0012623840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.324752+0000","last_change":"2023-12-07T21:11:45.324752+0000","last_active":"2023-12-07T21:11:45.324752+0000","last_peered":"2023-12-07T21:11:45.324752+0000","last_clean":"2023-12-07T21:11:45.324752+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:11:45.324752+0000","last_undegraded":"2023-12-07T21:11:45.324752+0000","last_fullsized":"2023-12-07T21:11:45.324752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.324596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:15.702930+0000","scrub_duration":0.001375037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'84","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.623237+0000","last_change":"2023-12-07T21:12:52.623237+0000","last_active":"2023-12-07T21:12:52.623237+0000","last_peered":"2023-12-07T21:12:52.623237+0000","last_clean":"2023-12-07T21:12:52.623237+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:12:52.623237+0000","last_undegraded":"2023-12-07T21:12:52.623237+0000","last_fullsized":"2023-12-07T21:12:52.623237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'84","last_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_deep_scrub":"33'84","last_deep_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.623072+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:11.772666+0000","scrub_duration":0.0042302950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.743712+0000","last_change":"2023-12-07T21:11:42.743712+0000","last_active":"2023-12-07T21:11:42.743712+0000","last_peered":"2023-12-07T21:11:42.743712+0000","last_clean":"2023-12-07T21:11:42.743712+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:42.743712+0000","last_undegraded":"2023-12-07T21:11:42.743712+0000","last_fullsized":"2023-12-07T21:11:42.743712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.743604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:58.016229+0000","scrub_duration":0.001386167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.433682+0000","last_change":"2023-12-07T21:11:58.433682+0000","last_active":"2023-12-07T21:11:58.433682+0000","last_peered":"2023-12-07T21:11:58.433682+0000","last_clean":"2023-12-07T21:11:58.433682+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:58.433682+0000","last_undegraded":"2023-12-07T21:11:58.433682+0000","last_fullsized":"2023-12-07T21:11:58.433682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.433567+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:08.130743+0000","scrub_duration":0.0014101739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:37.409865+0000","last_change":"2023-12-07T21:13:37.409909+0000","last_active":"2023-12-07T21:13:37.409865+0000","last_peered":"2023-12-07T21:13:37.409865+0000","last_clean":"2023-12-07T21:13:37.409865+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:13:37.409865+0000","last_undegraded":"2023-12-07T21:13:37.409865+0000","last_fullsized":"2023-12-07T21:13:37.409865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:37.409759+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:37.409759+0000","last_clean_scrub_stamp":"2023-12-07T21:13:37.409759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:10.604294+0000","scrub_duration":0.001212444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607424+0000","last_change":"2023-12-07T21:08:46.819640+0000","last_active":"2023-12-07T21:11:10.607424+0000","last_peered":"2023-12-07T21:11:10.607424+0000","last_clean":"2023-12-07T21:11:10.607424+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:11:10.607424+0000","last_undegraded":"2023-12-07T21:11:10.607424+0000","last_fullsized":"2023-12-07T21:11:10.607424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.966870+0000","last_change":"2023-12-07T21:13:54.966898+0000","last_active":"2023-12-07T21:13:54.966870+0000","last_peered":"2023-12-07T21:13:54.966870+0000","last_clean":"2023-12-07T21:13:54.966870+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:13:54.966870+0000","last_undegraded":"2023-12-07T21:13:54.966870+0000","last_fullsized":"2023-12-07T21:13:54.966870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:54.966763+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:54.966763+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.966763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:07.675533+0000","scrub_duration":0.0013427319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.687480+0000","last_change":"2023-12-07T21:11:32.687480+0000","last_active":"2023-12-07T21:11:32.687480+0000","last_peered":"2023-12-07T21:11:32.687480+0000","last_clean":"2023-12-07T21:11:32.687480+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:32.687480+0000","last_undegraded":"2023-12-07T21:11:32.687480+0000","last_fullsized":"2023-12-07T21:11:32.687480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.687375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:18:45.906213+0000","scrub_duration":0.001283024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":451,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148420+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148420+0000","last_peered":"2023-12-07T21:11:18.148420+0000","last_clean":"2023-12-07T21:11:18.148420+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148420+0000","last_undegraded":"2023-12-07T21:11:18.148420+0000","last_fullsized":"2023-12-07T21:11:18.148420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:25.481161+0000","last_change":"2023-12-07T21:12:25.481161+0000","last_active":"2023-12-07T21:12:25.481161+0000","last_peered":"2023-12-07T21:12:25.481161+0000","last_clean":"2023-12-07T21:12:25.481161+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:12:25.481161+0000","last_undegraded":"2023-12-07T21:12:25.481161+0000","last_fullsized":"2023-12-07T21:12:25.481161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_clean_scrub_stamp":"2023-12-07T21:12:25.481005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:33:44.071058+0000","scrub_duration":0.001267064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.375053+0000","last_change":"2023-12-07T21:13:54.375076+0000","last_active":"2023-12-07T21:13:54.375053+0000","last_peered":"2023-12-07T21:13:54.375053+0000","last_clean":"2023-12-07T21:13:54.375053+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:13:54.375053+0000","last_undegraded":"2023-12-07T21:13:54.375053+0000","last_fullsized":"2023-12-07T21:13:54.375053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:13:54.374958+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:13:54.374958+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.374958+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:07.083727+0000","scrub_duration":0.0012241019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.103368+0000","last_change":"2023-12-07T21:13:27.103392+0000","last_active":"2023-12-07T21:13:27.103368+0000","last_peered":"2023-12-07T21:13:27.103368+0000","last_clean":"2023-12-07T21:13:27.103368+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:13:27.103368+0000","last_undegraded":"2023-12-07T21:13:27.103368+0000","last_fullsized":"2023-12-07T21:13:27.103368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:04.121495+0000","scrub_duration":0.0012535599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:33.338278+0000","last_change":"2023-12-07T21:13:33.338298+0000","last_active":"2023-12-07T21:13:33.338278+0000","last_peered":"2023-12-07T21:13:33.338278+0000","last_clean":"2023-12-07T21:13:33.338278+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:13:33.338278+0000","last_undegraded":"2023-12-07T21:13:33.338278+0000","last_fullsized":"2023-12-07T21:13:33.338278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:33.338194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:33.338194+0000","last_clean_scrub_stamp":"2023-12-07T21:13:33.338194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:43.622208+0000","scrub_duration":0.001353496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:37.050040+0000","last_change":"2023-12-07T21:13:37.050079+0000","last_active":"2023-12-07T21:13:37.050040+0000","last_peered":"2023-12-07T21:13:37.050040+0000","last_clean":"2023-12-07T21:13:37.050040+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:13:37.050040+0000","last_undegraded":"2023-12-07T21:13:37.050040+0000","last_fullsized":"2023-12-07T21:13:37.050040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:37.049937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:37.049937+0000","last_clean_scrub_stamp":"2023-12-07T21:13:37.049937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:03:03.042871+0000","scrub_duration":0.0012947099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.627991+0000","last_change":"2023-12-07T21:12:15.627991+0000","last_active":"2023-12-07T21:12:15.627991+0000","last_peered":"2023-12-07T21:12:15.627991+0000","last_clean":"2023-12-07T21:12:15.627991+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:12:15.627991+0000","last_undegraded":"2023-12-07T21:12:15.627991+0000","last_fullsized":"2023-12-07T21:12:15.627991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.627865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:38.318981+0000","scrub_duration":0.0028926030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'25","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:46.537922+0000","last_change":"2023-12-07T21:11:46.537922+0000","last_active":"2023-12-07T21:11:46.537922+0000","last_peered":"2023-12-07T21:11:46.537922+0000","last_clean":"2023-12-07T21:11:46.537922+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:46.537922+0000","last_undegraded":"2023-12-07T21:11:46.537922+0000","last_fullsized":"2023-12-07T21:11:46.537922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_clean_scrub_stamp":"2023-12-07T21:11:46.537795+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:57.338431+0000","scrub_duration":0.0057357379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642698+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642698+0000","last_peered":"2023-12-07T21:11:12.642698+0000","last_clean":"2023-12-07T21:11:12.642698+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642698+0000","last_undegraded":"2023-12-07T21:11:12.642698+0000","last_fullsized":"2023-12-07T21:11:12.642698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813540+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:11:23.813540+0000","last_peered":"2023-12-07T21:11:23.813540+0000","last_clean":"2023-12-07T21:11:23.813540+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:11:23.813540+0000","last_undegraded":"2023-12-07T21:11:23.813540+0000","last_fullsized":"2023-12-07T21:11:23.813540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.097020+0000","last_change":"2023-12-07T21:13:20.097065+0000","last_active":"2023-12-07T21:13:20.097020+0000","last_peered":"2023-12-07T21:13:20.097020+0000","last_clean":"2023-12-07T21:13:20.097020+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:13:20.097020+0000","last_undegraded":"2023-12-07T21:13:20.097020+0000","last_fullsized":"2023-12-07T21:13:20.097020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.096899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.485657+0000","scrub_duration":0.001542213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607422+0000","last_change":"2023-12-07T21:08:46.819685+0000","last_active":"2023-12-07T21:11:10.607422+0000","last_peered":"2023-12-07T21:11:10.607422+0000","last_clean":"2023-12-07T21:11:10.607422+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:11:10.607422+0000","last_undegraded":"2023-12-07T21:11:10.607422+0000","last_fullsized":"2023-12-07T21:11:10.607422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.309172+0000","last_change":"2023-12-07T21:13:38.309196+0000","last_active":"2023-12-07T21:13:38.309172+0000","last_peered":"2023-12-07T21:13:38.309172+0000","last_clean":"2023-12-07T21:13:38.309172+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:13:38.309172+0000","last_undegraded":"2023-12-07T21:13:38.309172+0000","last_fullsized":"2023-12-07T21:13:38.309172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:38.309082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:38.309082+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.309082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:56.899135+0000","scrub_duration":0.0011541360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:57.727223+0000","last_change":"2023-12-07T21:11:57.727223+0000","last_active":"2023-12-07T21:11:57.727223+0000","last_peered":"2023-12-07T21:11:57.727223+0000","last_clean":"2023-12-07T21:11:57.727223+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:11:57.727223+0000","last_undegraded":"2023-12-07T21:11:57.727223+0000","last_fullsized":"2023-12-07T21:11:57.727223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_clean_scrub_stamp":"2023-12-07T21:11:57.727085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:53.015740+0000","scrub_duration":0.0013430639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.630855+0000","last_change":"2023-12-07T21:12:49.630855+0000","last_active":"2023-12-07T21:12:49.630855+0000","last_peered":"2023-12-07T21:12:49.630855+0000","last_clean":"2023-12-07T21:12:49.630855+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:12:49.630855+0000","last_undegraded":"2023-12-07T21:12:49.630855+0000","last_fullsized":"2023-12-07T21:12:49.630855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.630741+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:01.513069+0000","scrub_duration":0.0051886659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:30.531782+0000","last_change":"2023-12-07T21:13:30.531836+0000","last_active":"2023-12-07T21:13:30.531782+0000","last_peered":"2023-12-07T21:13:30.531782+0000","last_clean":"2023-12-07T21:13:30.531782+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:13:30.531782+0000","last_undegraded":"2023-12-07T21:13:30.531782+0000","last_fullsized":"2023-12-07T21:13:30.531782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:30.531646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:30.531646+0000","last_clean_scrub_stamp":"2023-12-07T21:13:30.531646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:08:23.567547+0000","scrub_duration":0.001461323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.342736+0000","last_change":"2023-12-07T21:13:52.342759+0000","last_active":"2023-12-07T21:13:52.342736+0000","last_peered":"2023-12-07T21:13:52.342736+0000","last_clean":"2023-12-07T21:13:52.342736+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:13:52.342736+0000","last_undegraded":"2023-12-07T21:13:52.342736+0000","last_fullsized":"2023-12-07T21:13:52.342736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:52.342650+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:52.342650+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.342650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:23:16.104463+0000","scrub_duration":0.0010492120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:10.299642+0000","last_change":"2023-12-07T21:13:10.299666+0000","last_active":"2023-12-07T21:13:10.299642+0000","last_peered":"2023-12-07T21:13:10.299642+0000","last_clean":"2023-12-07T21:13:10.299642+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:13:10.299642+0000","last_undegraded":"2023-12-07T21:13:10.299642+0000","last_fullsized":"2023-12-07T21:13:10.299642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_clean_scrub_stamp":"2023-12-07T21:13:10.299548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:18:32.210130+0000","scrub_duration":0.00096658499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:45.355307+0000","last_change":"2023-12-07T21:13:45.355332+0000","last_active":"2023-12-07T21:13:45.355307+0000","last_peered":"2023-12-07T21:13:45.355307+0000","last_clean":"2023-12-07T21:13:45.355307+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:13:45.355307+0000","last_undegraded":"2023-12-07T21:13:45.355307+0000","last_fullsized":"2023-12-07T21:13:45.355307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:45.355224+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:45.355224+0000","last_clean_scrub_stamp":"2023-12-07T21:13:45.355224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:23:41.232871+0000","scrub_duration":0.0012797419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.037891+0000","last_change":"2023-12-07T21:13:44.037911+0000","last_active":"2023-12-07T21:13:44.037891+0000","last_peered":"2023-12-07T21:13:44.037891+0000","last_clean":"2023-12-07T21:13:44.037891+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:13:44.037891+0000","last_undegraded":"2023-12-07T21:13:44.037891+0000","last_fullsized":"2023-12-07T21:13:44.037891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:44.037804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:44.037804+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.037804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:44:57.361482+0000","scrub_duration":0.0012532349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.771944+0000","last_change":"2023-12-07T21:12:11.771944+0000","last_active":"2023-12-07T21:12:11.771944+0000","last_peered":"2023-12-07T21:12:11.771944+0000","last_clean":"2023-12-07T21:12:11.771944+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:12:11.771944+0000","last_undegraded":"2023-12-07T21:12:11.771944+0000","last_fullsized":"2023-12-07T21:12:11.771944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.771816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:43.210676+0000","scrub_duration":0.0013479799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'72","reported_seq":142,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.763012+0000","last_change":"2023-12-07T21:11:45.763012+0000","last_active":"2023-12-07T21:11:45.763012+0000","last_peered":"2023-12-07T21:11:45.763012+0000","last_clean":"2023-12-07T21:11:45.763012+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:45.763012+0000","last_undegraded":"2023-12-07T21:11:45.763012+0000","last_fullsized":"2023-12-07T21:11:45.763012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.762875+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:27:47.809323+0000","scrub_duration":0.006706058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594416+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594416+0000","last_peered":"2023-12-07T21:11:25.594416+0000","last_clean":"2023-12-07T21:11:25.594416+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594416+0000","last_undegraded":"2023-12-07T21:11:25.594416+0000","last_fullsized":"2023-12-07T21:11:25.594416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:11.946294+0000","last_change":"2023-12-07T21:14:11.946317+0000","last_active":"2023-12-07T21:14:11.946294+0000","last_peered":"2023-12-07T21:14:11.946294+0000","last_clean":"2023-12-07T21:14:11.946294+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:14:11.946294+0000","last_undegraded":"2023-12-07T21:14:11.946294+0000","last_fullsized":"2023-12-07T21:14:11.946294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:14:11.946210+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:14:11.946210+0000","last_clean_scrub_stamp":"2023-12-07T21:14:11.946210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:06:44.474703+0000","scrub_duration":0.001277083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.332914+0000","last_change":"2023-12-07T21:12:42.332914+0000","last_active":"2023-12-07T21:12:42.332914+0000","last_peered":"2023-12-07T21:12:42.332914+0000","last_clean":"2023-12-07T21:12:42.332914+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:12:42.332914+0000","last_undegraded":"2023-12-07T21:12:42.332914+0000","last_fullsized":"2023-12-07T21:12:42.332914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.332776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:52.088170+0000","scrub_duration":0.00097994699999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:57.984155+0000","last_change":"2023-12-07T21:13:57.984179+0000","last_active":"2023-12-07T21:13:57.984155+0000","last_peered":"2023-12-07T21:13:57.984155+0000","last_clean":"2023-12-07T21:13:57.984155+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:13:57.984155+0000","last_undegraded":"2023-12-07T21:13:57.984155+0000","last_fullsized":"2023-12-07T21:13:57.984155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:57.984065+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:57.984065+0000","last_clean_scrub_stamp":"2023-12-07T21:13:57.984065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:29.842428+0000","scrub_duration":0.0015299650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607497+0000","last_change":"2023-12-07T21:08:46.820008+0000","last_active":"2023-12-07T21:11:10.607497+0000","last_peered":"2023-12-07T21:11:10.607497+0000","last_clean":"2023-12-07T21:11:10.607497+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:11:10.607497+0000","last_undegraded":"2023-12-07T21:11:10.607497+0000","last_fullsized":"2023-12-07T21:11:10.607497+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.626478+0000","last_change":"2023-12-07T21:11:42.626478+0000","last_active":"2023-12-07T21:11:42.626478+0000","last_peered":"2023-12-07T21:11:42.626478+0000","last_clean":"2023-12-07T21:11:42.626478+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:11:42.626478+0000","last_undegraded":"2023-12-07T21:11:42.626478+0000","last_fullsized":"2023-12-07T21:11:42.626478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.626356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:23.689571+0000","scrub_duration":0.001348258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.225043+0000","last_change":"2023-12-07T21:11:33.225043+0000","last_active":"2023-12-07T21:11:33.225043+0000","last_peered":"2023-12-07T21:11:33.225043+0000","last_clean":"2023-12-07T21:11:33.225043+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:33.225043+0000","last_undegraded":"2023-12-07T21:11:33.225043+0000","last_fullsized":"2023-12-07T21:11:33.225043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.224920+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:12.396025+0000","scrub_duration":0.0049945800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.065956+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:11:20.065956+0000","last_peered":"2023-12-07T21:11:20.065956+0000","last_clean":"2023-12-07T21:11:20.065956+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:20.065956+0000","last_undegraded":"2023-12-07T21:11:20.065956+0000","last_fullsized":"2023-12-07T21:11:20.065956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813858+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:11:23.813858+0000","last_peered":"2023-12-07T21:11:23.813858+0000","last_clean":"2023-12-07T21:11:23.813858+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:11:23.813858+0000","last_undegraded":"2023-12-07T21:11:23.813858+0000","last_fullsized":"2023-12-07T21:11:23.813858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:26.538543+0000","last_change":"2023-12-07T21:13:26.538591+0000","last_active":"2023-12-07T21:13:26.538543+0000","last_peered":"2023-12-07T21:13:26.538543+0000","last_clean":"2023-12-07T21:13:26.538543+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:13:26.538543+0000","last_undegraded":"2023-12-07T21:13:26.538543+0000","last_fullsized":"2023-12-07T21:13:26.538543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_clean_scrub_stamp":"2023-12-07T21:13:26.538439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:32:03.233013+0000","scrub_duration":0.0011404239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:16.404893+0000","last_change":"2023-12-07T21:14:16.404929+0000","last_active":"2023-12-07T21:14:16.404893+0000","last_peered":"2023-12-07T21:14:16.404893+0000","last_clean":"2023-12-07T21:14:16.404893+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:14:16.404893+0000","last_undegraded":"2023-12-07T21:14:16.404893+0000","last_fullsized":"2023-12-07T21:14:16.404893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:16.404773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:16.404773+0000","last_clean_scrub_stamp":"2023-12-07T21:14:16.404773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:54.222075+0000","scrub_duration":0.0014842950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:47.017061+0000","last_change":"2023-12-07T21:13:47.017082+0000","last_active":"2023-12-07T21:13:47.017061+0000","last_peered":"2023-12-07T21:13:47.017061+0000","last_clean":"2023-12-07T21:13:47.017061+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:13:47.017061+0000","last_undegraded":"2023-12-07T21:13:47.017061+0000","last_fullsized":"2023-12-07T21:13:47.017061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:47.016927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:47.016927+0000","last_clean_scrub_stamp":"2023-12-07T21:13:47.016927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:39.728287+0000","scrub_duration":0.0013272259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.865911+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:11:18.865911+0000","last_peered":"2023-12-07T21:11:18.865911+0000","last_clean":"2023-12-07T21:11:18.865911+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:11:18.865911+0000","last_undegraded":"2023-12-07T21:11:18.865911+0000","last_fullsized":"2023-12-07T21:11:18.865911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:44.632651+0000","last_change":"2023-12-07T21:12:44.632651+0000","last_active":"2023-12-07T21:12:44.632651+0000","last_peered":"2023-12-07T21:12:44.632651+0000","last_clean":"2023-12-07T21:12:44.632651+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:12:44.632651+0000","last_undegraded":"2023-12-07T21:12:44.632651+0000","last_fullsized":"2023-12-07T21:12:44.632651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_clean_scrub_stamp":"2023-12-07T21:12:44.632504+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:24.020207+0000","scrub_duration":0.0053067840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":369,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712229+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712229+0000","last_peered":"2023-12-07T21:11:18.712229+0000","last_clean":"2023-12-07T21:11:18.712229+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712229+0000","last_undegraded":"2023-12-07T21:11:18.712229+0000","last_fullsized":"2023-12-07T21:11:18.712229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.351712+0000","last_change":"2023-12-07T21:13:48.351733+0000","last_active":"2023-12-07T21:13:48.351712+0000","last_peered":"2023-12-07T21:13:48.351712+0000","last_clean":"2023-12-07T21:13:48.351712+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:13:48.351712+0000","last_undegraded":"2023-12-07T21:13:48.351712+0000","last_fullsized":"2023-12-07T21:13:48.351712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-07T21:13:48.351626+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-07T21:13:48.351626+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.351626+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:41.062986+0000","scrub_duration":0.0010460479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:43.441643+0000","last_change":"2023-12-07T21:12:43.441643+0000","last_active":"2023-12-07T21:12:43.441643+0000","last_peered":"2023-12-07T21:12:43.441643+0000","last_clean":"2023-12-07T21:12:43.441643+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:12:43.441643+0000","last_undegraded":"2023-12-07T21:12:43.441643+0000","last_fullsized":"2023-12-07T21:12:43.441643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_clean_scrub_stamp":"2023-12-07T21:12:43.441484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:24.768617+0000","scrub_duration":0.0011182029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:22.456099+0000","last_change":"2023-12-07T21:13:22.456119+0000","last_active":"2023-12-07T21:13:22.456099+0000","last_peered":"2023-12-07T21:13:22.456099+0000","last_clean":"2023-12-07T21:13:22.456099+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:13:22.456099+0000","last_undegraded":"2023-12-07T21:13:22.456099+0000","last_fullsized":"2023-12-07T21:13:22.456099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_clean_scrub_stamp":"2023-12-07T21:13:22.456021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:49.190223+0000","scrub_duration":0.001272902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607479+0000","last_change":"2023-12-07T21:08:47.170647+0000","last_active":"2023-12-07T21:11:10.607479+0000","last_peered":"2023-12-07T21:11:10.607479+0000","last_clean":"2023-12-07T21:11:10.607479+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:11:10.607479+0000","last_undegraded":"2023-12-07T21:11:10.607479+0000","last_fullsized":"2023-12-07T21:11:10.607479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:45.807521+0000","last_clean_scrub_stamp":"2023-12-07T21:08:45.807521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:37.651334+0000","last_change":"2023-12-07T21:11:37.651334+0000","last_active":"2023-12-07T21:11:37.651334+0000","last_peered":"2023-12-07T21:11:37.651334+0000","last_clean":"2023-12-07T21:11:37.651334+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:11:37.651334+0000","last_undegraded":"2023-12-07T21:11:37.651334+0000","last_fullsized":"2023-12-07T21:11:37.651334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_clean_scrub_stamp":"2023-12-07T21:11:37.651191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:09.090050+0000","scrub_duration":0.0012443790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'94","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:05.544503+0000","last_change":"2023-12-07T21:12:05.544503+0000","last_active":"2023-12-07T21:12:05.544503+0000","last_peered":"2023-12-07T21:12:05.544503+0000","last_clean":"2023-12-07T21:12:05.544503+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:12:05.544503+0000","last_undegraded":"2023-12-07T21:12:05.544503+0000","last_fullsized":"2023-12-07T21:12:05.544503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'94","last_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_deep_scrub":"33'94","last_deep_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_clean_scrub_stamp":"2023-12-07T21:12:05.544369+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:32:13.323537+0000","scrub_duration":0.006343095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.831678+0000","last_change":"2023-12-07T21:11:52.831678+0000","last_active":"2023-12-07T21:11:52.831678+0000","last_peered":"2023-12-07T21:11:52.831678+0000","last_clean":"2023-12-07T21:11:52.831678+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:52.831678+0000","last_undegraded":"2023-12-07T21:11:52.831678+0000","last_fullsized":"2023-12-07T21:11:52.831678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.831531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:22.265020+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:56.419273+0000","last_change":"2023-12-07T21:13:56.419293+0000","last_active":"2023-12-07T21:13:56.419273+0000","last_peered":"2023-12-07T21:13:56.419273+0000","last_clean":"2023-12-07T21:13:56.419273+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:13:56.419273+0000","last_undegraded":"2023-12-07T21:13:56.419273+0000","last_fullsized":"2023-12-07T21:13:56.419273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:56.419176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:56.419176+0000","last_clean_scrub_stamp":"2023-12-07T21:13:56.419176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:37:31.807934+0000","scrub_duration":0.001158671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.528421+0000","last_change":"2023-12-07T21:12:23.528421+0000","last_active":"2023-12-07T21:12:23.528421+0000","last_peered":"2023-12-07T21:12:23.528421+0000","last_clean":"2023-12-07T21:12:23.528421+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:12:23.528421+0000","last_undegraded":"2023-12-07T21:12:23.528421+0000","last_fullsized":"2023-12-07T21:12:23.528421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.528299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:52.961788+0000","scrub_duration":0.00098274400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.407105+0000","last_change":"2023-12-07T21:13:04.407105+0000","last_active":"2023-12-07T21:13:04.407105+0000","last_peered":"2023-12-07T21:13:04.407105+0000","last_clean":"2023-12-07T21:13:04.407105+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:13:04.407105+0000","last_undegraded":"2023-12-07T21:13:04.407105+0000","last_fullsized":"2023-12-07T21:13:04.407105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.406964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:17:33.745379+0000","scrub_duration":0.001091641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:25.352978+0000","last_change":"2023-12-07T21:14:25.353002+0000","last_active":"2023-12-07T21:14:25.352978+0000","last_peered":"2023-12-07T21:14:25.352978+0000","last_clean":"2023-12-07T21:14:25.352978+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:14:25.352978+0000","last_undegraded":"2023-12-07T21:14:25.352978+0000","last_fullsized":"2023-12-07T21:14:25.352978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:25.352881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:25.352881+0000","last_clean_scrub_stamp":"2023-12-07T21:14:25.352881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:50:05.152759+0000","scrub_duration":0.0013146939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.299988+0000","last_change":"2023-12-07T21:11:39.299988+0000","last_active":"2023-12-07T21:11:39.299988+0000","last_peered":"2023-12-07T21:11:39.299988+0000","last_clean":"2023-12-07T21:11:39.299988+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:39.299988+0000","last_undegraded":"2023-12-07T21:11:39.299988+0000","last_fullsized":"2023-12-07T21:11:39.299988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.299849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:48.997025+0000","scrub_duration":0.001356866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813364+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:23.813364+0000","last_peered":"2023-12-07T21:11:23.813364+0000","last_clean":"2023-12-07T21:11:23.813364+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:23.813364+0000","last_undegraded":"2023-12-07T21:11:23.813364+0000","last_fullsized":"2023-12-07T21:11:23.813364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.626993+0000","last_change":"2023-12-07T21:13:05.626993+0000","last_active":"2023-12-07T21:13:05.626993+0000","last_peered":"2023-12-07T21:13:05.626993+0000","last_clean":"2023-12-07T21:13:05.626993+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:13:05.626993+0000","last_undegraded":"2023-12-07T21:13:05.626993+0000","last_fullsized":"2023-12-07T21:13:05.626993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.626860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:01.027919+0000","scrub_duration":0.00097400899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:29.046519+0000","last_change":"2023-12-07T21:14:29.046540+0000","last_active":"2023-12-07T21:14:29.046519+0000","last_peered":"2023-12-07T21:14:29.046519+0000","last_clean":"2023-12-07T21:14:29.046519+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:14:29.046519+0000","last_undegraded":"2023-12-07T21:14:29.046519+0000","last_fullsized":"2023-12-07T21:14:29.046519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:29.046420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:29.046420+0000","last_clean_scrub_stamp":"2023-12-07T21:14:29.046420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:59:49.084841+0000","scrub_duration":0.0013829269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.340557+0000","last_change":"2023-12-07T21:13:05.340557+0000","last_active":"2023-12-07T21:13:05.340557+0000","last_peered":"2023-12-07T21:13:05.340557+0000","last_clean":"2023-12-07T21:13:05.340557+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:13:05.340557+0000","last_undegraded":"2023-12-07T21:13:05.340557+0000","last_fullsized":"2023-12-07T21:13:05.340557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.340431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:24.924419+0000","scrub_duration":0.001119035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.409426+0000","last_change":"2023-12-07T21:13:48.409426+0000","last_active":"2023-12-07T21:13:48.409426+0000","last_peered":"2023-12-07T21:13:48.409426+0000","last_clean":"2023-12-07T21:13:48.409426+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:13:48.409426+0000","last_undegraded":"2023-12-07T21:13:48.409426+0000","last_fullsized":"2023-12-07T21:13:48.409426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:48.409284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:48.409284+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.409284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:42.968321+0000","scrub_duration":0.0012408199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812340+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:18.812340+0000","last_peered":"2023-12-07T21:11:18.812340+0000","last_clean":"2023-12-07T21:11:18.812340+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:18.812340+0000","last_undegraded":"2023-12-07T21:11:18.812340+0000","last_fullsized":"2023-12-07T21:11:18.812340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'9","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.887056+0000","last_change":"2023-12-07T21:11:50.887056+0000","last_active":"2023-12-07T21:11:50.887056+0000","last_peered":"2023-12-07T21:11:50.887056+0000","last_clean":"2023-12-07T21:11:50.887056+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:50.887056+0000","last_undegraded":"2023-12-07T21:11:50.887056+0000","last_fullsized":"2023-12-07T21:11:50.887056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.886922+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:02.989113+0000","scrub_duration":0.0042007399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.812347+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:23.812347+0000","last_peered":"2023-12-07T21:11:23.812347+0000","last_clean":"2023-12-07T21:11:23.812347+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:23.812347+0000","last_undegraded":"2023-12-07T21:11:23.812347+0000","last_fullsized":"2023-12-07T21:11:23.812347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:13.973529+0000","last_change":"2023-12-07T21:14:13.973547+0000","last_active":"2023-12-07T21:14:13.973529+0000","last_peered":"2023-12-07T21:14:13.973529+0000","last_clean":"2023-12-07T21:14:13.973529+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:14:13.973529+0000","last_undegraded":"2023-12-07T21:14:13.973529+0000","last_fullsized":"2023-12-07T21:14:13.973529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:13.973453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:13.973453+0000","last_clean_scrub_stamp":"2023-12-07T21:14:13.973453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:22.652134+0000","scrub_duration":0.0014016110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.033989+0000","last_change":"2023-12-07T21:13:38.033989+0000","last_active":"2023-12-07T21:13:38.033989+0000","last_peered":"2023-12-07T21:13:38.033989+0000","last_clean":"2023-12-07T21:13:38.033989+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:13:38.033989+0000","last_undegraded":"2023-12-07T21:13:38.033989+0000","last_fullsized":"2023-12-07T21:13:38.033989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:38.033840+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:38.033840+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.033840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:33.434899+0000","scrub_duration":0.001381462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.434901+0000","last_change":"2023-12-07T21:13:28.434901+0000","last_active":"2023-12-07T21:13:28.434901+0000","last_peered":"2023-12-07T21:13:28.434901+0000","last_clean":"2023-12-07T21:13:28.434901+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:13:28.434901+0000","last_undegraded":"2023-12-07T21:13:28.434901+0000","last_fullsized":"2023-12-07T21:13:28.434901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.434771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:49.030870+0000","scrub_duration":0.001230061,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.605108+0000","last_change":"2023-12-07T21:12:18.605108+0000","last_active":"2023-12-07T21:12:18.605108+0000","last_peered":"2023-12-07T21:12:18.605108+0000","last_clean":"2023-12-07T21:12:18.605108+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:12:18.605108+0000","last_undegraded":"2023-12-07T21:12:18.605108+0000","last_fullsized":"2023-12-07T21:12:18.605108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.605002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:30.707193+0000","scrub_duration":0.00090833899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.805867+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:23.805867+0000","last_peered":"2023-12-07T21:11:23.805867+0000","last_clean":"2023-12-07T21:11:23.805867+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:23.805867+0000","last_undegraded":"2023-12-07T21:11:23.805867+0000","last_fullsized":"2023-12-07T21:11:23.805867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.302809+0000","last_change":"2023-12-07T21:11:36.302809+0000","last_active":"2023-12-07T21:11:36.302809+0000","last_peered":"2023-12-07T21:11:36.302809+0000","last_clean":"2023-12-07T21:11:36.302809+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:36.302809+0000","last_undegraded":"2023-12-07T21:11:36.302809+0000","last_fullsized":"2023-12-07T21:11:36.302809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.302687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:01.567462+0000","scrub_duration":0.0014296669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:00.345915+0000","last_change":"2023-12-07T21:14:00.345915+0000","last_active":"2023-12-07T21:14:00.345915+0000","last_peered":"2023-12-07T21:14:00.345915+0000","last_clean":"2023-12-07T21:14:00.345915+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:14:00.345915+0000","last_undegraded":"2023-12-07T21:14:00.345915+0000","last_fullsized":"2023-12-07T21:14:00.345915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:00.345796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:00.345796+0000","last_clean_scrub_stamp":"2023-12-07T21:14:00.345796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:47.511446+0000","scrub_duration":0.0010293559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:29.521893+0000","last_change":"2023-12-07T21:13:29.521893+0000","last_active":"2023-12-07T21:13:29.521893+0000","last_peered":"2023-12-07T21:13:29.521893+0000","last_clean":"2023-12-07T21:13:29.521893+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:13:29.521893+0000","last_undegraded":"2023-12-07T21:13:29.521893+0000","last_fullsized":"2023-12-07T21:13:29.521893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:29.521772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:29.521772+0000","last_clean_scrub_stamp":"2023-12-07T21:13:29.521772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:51:27.306062+0000","scrub_duration":0.001149186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:09.325688+0000","last_change":"2023-12-07T21:13:09.325688+0000","last_active":"2023-12-07T21:13:09.325688+0000","last_peered":"2023-12-07T21:13:09.325688+0000","last_clean":"2023-12-07T21:13:09.325688+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:13:09.325688+0000","last_undegraded":"2023-12-07T21:13:09.325688+0000","last_fullsized":"2023-12-07T21:13:09.325688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_clean_scrub_stamp":"2023-12-07T21:13:09.325568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:45:40.066890+0000","scrub_duration":0.00116248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.514142+0000","last_change":"2023-12-07T21:11:52.514142+0000","last_active":"2023-12-07T21:11:52.514142+0000","last_peered":"2023-12-07T21:11:52.514142+0000","last_clean":"2023-12-07T21:11:52.514142+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:52.514142+0000","last_undegraded":"2023-12-07T21:11:52.514142+0000","last_fullsized":"2023-12-07T21:11:52.514142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.514035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:00:51.180837+0000","scrub_duration":0.00101976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.532802+0000","last_change":"2023-12-07T21:11:32.532802+0000","last_active":"2023-12-07T21:11:32.532802+0000","last_peered":"2023-12-07T21:11:32.532802+0000","last_clean":"2023-12-07T21:11:32.532802+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:32.532802+0000","last_undegraded":"2023-12-07T21:11:32.532802+0000","last_fullsized":"2023-12-07T21:11:32.532802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.532666+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:34.382885+0000","scrub_duration":0.0035860219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.812477+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:23.812477+0000","last_peered":"2023-12-07T21:11:23.812477+0000","last_clean":"2023-12-07T21:11:23.812477+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:23.812477+0000","last_undegraded":"2023-12-07T21:11:23.812477+0000","last_fullsized":"2023-12-07T21:11:23.812477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:31.506721+0000","last_change":"2023-12-07T21:13:31.506752+0000","last_active":"2023-12-07T21:13:31.506721+0000","last_peered":"2023-12-07T21:13:31.506721+0000","last_clean":"2023-12-07T21:13:31.506721+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:13:31.506721+0000","last_undegraded":"2023-12-07T21:13:31.506721+0000","last_fullsized":"2023-12-07T21:13:31.506721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:31.506641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:31.506641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:31.506641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:57:50.535477+0000","scrub_duration":0.0015893470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:33.305958+0000","last_change":"2023-12-07T21:14:33.305979+0000","last_active":"2023-12-07T21:14:33.305958+0000","last_peered":"2023-12-07T21:14:33.305958+0000","last_clean":"2023-12-07T21:14:33.305958+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:14:33.305958+0000","last_undegraded":"2023-12-07T21:14:33.305958+0000","last_fullsized":"2023-12-07T21:14:33.305958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:33.305845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:33.305845+0000","last_clean_scrub_stamp":"2023-12-07T21:14:33.305845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:37:20.389797+0000","scrub_duration":0.001218537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:59.757120+0000","last_change":"2023-12-07T21:11:59.757120+0000","last_active":"2023-12-07T21:11:59.757120+0000","last_peered":"2023-12-07T21:11:59.757120+0000","last_clean":"2023-12-07T21:11:59.757120+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:11:59.757120+0000","last_undegraded":"2023-12-07T21:11:59.757120+0000","last_fullsized":"2023-12-07T21:11:59.757120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_clean_scrub_stamp":"2023-12-07T21:11:59.757017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:04:59.018197+0000","scrub_duration":0.001196353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'61","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.783993+0000","last_change":"2023-12-07T21:11:44.783993+0000","last_active":"2023-12-07T21:11:44.783993+0000","last_peered":"2023-12-07T21:11:44.783993+0000","last_clean":"2023-12-07T21:11:44.783993+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:44.783993+0000","last_undegraded":"2023-12-07T21:11:44.783993+0000","last_fullsized":"2023-12-07T21:11:44.783993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.783824+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:07.474940+0000","scrub_duration":0.004588193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.558908+0000","last_change":"2023-12-07T21:11:36.558908+0000","last_active":"2023-12-07T21:11:36.558908+0000","last_peered":"2023-12-07T21:11:36.558908+0000","last_clean":"2023-12-07T21:11:36.558908+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:11:36.558908+0000","last_undegraded":"2023-12-07T21:11:36.558908+0000","last_fullsized":"2023-12-07T21:11:36.558908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.558807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:33:06.320086+0000","scrub_duration":0.001387288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:22.966818+0000","last_change":"2023-12-07T21:14:22.966859+0000","last_active":"2023-12-07T21:14:22.966818+0000","last_peered":"2023-12-07T21:14:22.966818+0000","last_clean":"2023-12-07T21:14:22.966818+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:14:22.966818+0000","last_undegraded":"2023-12-07T21:14:22.966818+0000","last_fullsized":"2023-12-07T21:14:22.966818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:14:22.966677+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:14:22.966677+0000","last_clean_scrub_stamp":"2023-12-07T21:14:22.966677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:21:07.474679+0000","scrub_duration":0.0015071959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:19.862179+0000","last_change":"2023-12-07T21:12:19.862179+0000","last_active":"2023-12-07T21:12:19.862179+0000","last_peered":"2023-12-07T21:12:19.862179+0000","last_clean":"2023-12-07T21:12:19.862179+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:12:19.862179+0000","last_undegraded":"2023-12-07T21:12:19.862179+0000","last_fullsized":"2023-12-07T21:12:19.862179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_clean_scrub_stamp":"2023-12-07T21:12:19.862069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:34.168058+0000","scrub_duration":0.0015085669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.431844+0000","last_change":"2023-12-07T21:13:21.431844+0000","last_active":"2023-12-07T21:13:21.431844+0000","last_peered":"2023-12-07T21:13:21.431844+0000","last_clean":"2023-12-07T21:13:21.431844+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:13:21.431844+0000","last_undegraded":"2023-12-07T21:13:21.431844+0000","last_fullsized":"2023-12-07T21:13:21.431844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.431724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:58:06.040375+0000","scrub_duration":0.0012195439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:23.469100+0000","last_change":"2023-12-07T21:14:23.469123+0000","last_active":"2023-12-07T21:14:23.469100+0000","last_peered":"2023-12-07T21:14:23.469100+0000","last_clean":"2023-12-07T21:14:23.469100+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:14:23.469100+0000","last_undegraded":"2023-12-07T21:14:23.469100+0000","last_fullsized":"2023-12-07T21:14:23.469100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:23.469019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:23.469019+0000","last_clean_scrub_stamp":"2023-12-07T21:14:23.469019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:10:52.576401+0000","scrub_duration":0.00098617400000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.514738+0000","last_change":"2023-12-07T21:12:21.514738+0000","last_active":"2023-12-07T21:12:21.514738+0000","last_peered":"2023-12-07T21:12:21.514738+0000","last_clean":"2023-12-07T21:12:21.514738+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:12:21.514738+0000","last_undegraded":"2023-12-07T21:12:21.514738+0000","last_fullsized":"2023-12-07T21:12:21.514738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.514603+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:11.760175+0000","scrub_duration":0.0065721260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:13.399009+0000","last_change":"2023-12-07T21:12:13.399009+0000","last_active":"2023-12-07T21:12:13.399009+0000","last_peered":"2023-12-07T21:12:13.399009+0000","last_clean":"2023-12-07T21:12:13.399009+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:12:13.399009+0000","last_undegraded":"2023-12-07T21:12:13.399009+0000","last_fullsized":"2023-12-07T21:12:13.399009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_clean_scrub_stamp":"2023-12-07T21:12:13.398859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:54.725992+0000","scrub_duration":0.0011359600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:50.253895+0000","last_change":"2023-12-07T21:13:50.253916+0000","last_active":"2023-12-07T21:13:50.253895+0000","last_peered":"2023-12-07T21:13:50.253895+0000","last_clean":"2023-12-07T21:13:50.253895+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:13:50.253895+0000","last_undegraded":"2023-12-07T21:13:50.253895+0000","last_fullsized":"2023-12-07T21:13:50.253895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:50.253806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:50.253806+0000","last_clean_scrub_stamp":"2023-12-07T21:13:50.253806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:34:11.268340+0000","scrub_duration":0.0010687579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.432392+0000","last_change":"2023-12-07T21:12:11.432392+0000","last_active":"2023-12-07T21:12:11.432392+0000","last_peered":"2023-12-07T21:12:11.432392+0000","last_clean":"2023-12-07T21:12:11.432392+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:12:11.432392+0000","last_undegraded":"2023-12-07T21:12:11.432392+0000","last_fullsized":"2023-12-07T21:12:11.432392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.432277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:48.190145+0000","scrub_duration":0.0010618419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.427565+0000","last_change":"2023-12-07T21:13:36.427565+0000","last_active":"2023-12-07T21:13:36.427565+0000","last_peered":"2023-12-07T21:13:36.427565+0000","last_clean":"2023-12-07T21:13:36.427565+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:13:36.427565+0000","last_undegraded":"2023-12-07T21:13:36.427565+0000","last_fullsized":"2023-12-07T21:13:36.427565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:36.427462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:36.427462+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.427462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:00:09.657217+0000","scrub_duration":0.0011997139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:10.553135+0000","last_change":"2023-12-07T21:12:10.553135+0000","last_active":"2023-12-07T21:12:10.553135+0000","last_peered":"2023-12-07T21:12:10.553135+0000","last_clean":"2023-12-07T21:12:10.553135+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:12:10.553135+0000","last_undegraded":"2023-12-07T21:12:10.553135+0000","last_fullsized":"2023-12-07T21:12:10.553135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_clean_scrub_stamp":"2023-12-07T21:12:10.553023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:52.504367+0000","scrub_duration":0.0013037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.745178+0000","last_change":"2023-12-07T21:11:36.745178+0000","last_active":"2023-12-07T21:11:36.745178+0000","last_peered":"2023-12-07T21:11:36.745178+0000","last_clean":"2023-12-07T21:11:36.745178+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:36.745178+0000","last_undegraded":"2023-12-07T21:11:36.745178+0000","last_fullsized":"2023-12-07T21:11:36.745178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.745068+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:09.080620+0000","scrub_duration":0.0072373669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:16.616710+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:11:16.616710+0000","last_peered":"2023-12-07T21:11:16.616710+0000","last_clean":"2023-12-07T21:11:16.616710+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:11:16.616710+0000","last_undegraded":"2023-12-07T21:11:16.616710+0000","last_fullsized":"2023-12-07T21:11:16.616710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814594+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:11:28.814594+0000","last_peered":"2023-12-07T21:11:28.814594+0000","last_clean":"2023-12-07T21:11:28.814594+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:11:28.814594+0000","last_undegraded":"2023-12-07T21:11:28.814594+0000","last_fullsized":"2023-12-07T21:11:28.814594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.879540+0000","last_change":"2023-12-07T21:12:56.879540+0000","last_active":"2023-12-07T21:12:56.879540+0000","last_peered":"2023-12-07T21:12:56.879540+0000","last_clean":"2023-12-07T21:12:56.879540+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:12:56.879540+0000","last_undegraded":"2023-12-07T21:12:56.879540+0000","last_fullsized":"2023-12-07T21:12:56.879540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.879389+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:47.124961+0000","scrub_duration":0.0034133409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.341852+0000","last_change":"2023-12-07T21:14:02.341875+0000","last_active":"2023-12-07T21:14:02.341852+0000","last_peered":"2023-12-07T21:14:02.341852+0000","last_clean":"2023-12-07T21:14:02.341852+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:14:02.341852+0000","last_undegraded":"2023-12-07T21:14:02.341852+0000","last_fullsized":"2023-12-07T21:14:02.341852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:02.341757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:02.341757+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.341757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:42.946314+0000","scrub_duration":0.001137264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.324449+0000","last_change":"2023-12-07T21:11:41.324449+0000","last_active":"2023-12-07T21:11:41.324449+0000","last_peered":"2023-12-07T21:11:41.324449+0000","last_clean":"2023-12-07T21:11:41.324449+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:41.324449+0000","last_undegraded":"2023-12-07T21:11:41.324449+0000","last_fullsized":"2023-12-07T21:11:41.324449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.324294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:18:22.956309+0000","scrub_duration":0.001431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.649725+0000","last_change":"2023-12-07T21:12:42.649725+0000","last_active":"2023-12-07T21:12:42.649725+0000","last_peered":"2023-12-07T21:12:42.649725+0000","last_clean":"2023-12-07T21:12:42.649725+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:12:42.649725+0000","last_undegraded":"2023-12-07T21:12:42.649725+0000","last_fullsized":"2023-12-07T21:12:42.649725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.649582+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:55:46.065006+0000","scrub_duration":0.0041186950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":325,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411924+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411924+0000","last_peered":"2023-12-07T21:11:10.411924+0000","last_clean":"2023-12-07T21:11:10.411924+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411924+0000","last_undegraded":"2023-12-07T21:11:10.411924+0000","last_fullsized":"2023-12-07T21:11:10.411924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814347+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:11:28.814347+0000","last_peered":"2023-12-07T21:11:28.814347+0000","last_clean":"2023-12-07T21:11:28.814347+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:11:28.814347+0000","last_undegraded":"2023-12-07T21:11:28.814347+0000","last_fullsized":"2023-12-07T21:11:28.814347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.370762+0000","last_change":"2023-12-07T21:13:07.370762+0000","last_active":"2023-12-07T21:13:07.370762+0000","last_peered":"2023-12-07T21:13:07.370762+0000","last_clean":"2023-12-07T21:13:07.370762+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:13:07.370762+0000","last_undegraded":"2023-12-07T21:13:07.370762+0000","last_fullsized":"2023-12-07T21:13:07.370762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:06.037407+0000","scrub_duration":0.0014696010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.432268+0000","last_change":"2023-12-07T21:13:23.432268+0000","last_active":"2023-12-07T21:13:23.432268+0000","last_peered":"2023-12-07T21:13:23.432268+0000","last_clean":"2023-12-07T21:13:23.432268+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:13:23.432268+0000","last_undegraded":"2023-12-07T21:13:23.432268+0000","last_fullsized":"2023-12-07T21:13:23.432268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.432146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:02:08.854218+0000","scrub_duration":0.001156783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.351557+0000","last_change":"2023-12-07T21:11:43.351557+0000","last_active":"2023-12-07T21:11:43.351557+0000","last_peered":"2023-12-07T21:11:43.351557+0000","last_clean":"2023-12-07T21:11:43.351557+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:43.351557+0000","last_undegraded":"2023-12-07T21:11:43.351557+0000","last_fullsized":"2023-12-07T21:11:43.351557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_clean_scrub_stamp":"2023-12-07T21:11:43.351414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:25.302758+0000","scrub_duration":0.001534795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.813759+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:28.813759+0000","last_peered":"2023-12-07T21:11:28.813759+0000","last_clean":"2023-12-07T21:11:28.813759+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:28.813759+0000","last_undegraded":"2023-12-07T21:11:28.813759+0000","last_fullsized":"2023-12-07T21:11:28.813759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.806704+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:28.806704+0000","last_peered":"2023-12-07T21:11:28.806704+0000","last_clean":"2023-12-07T21:11:28.806704+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:28.806704+0000","last_undegraded":"2023-12-07T21:11:28.806704+0000","last_fullsized":"2023-12-07T21:11:28.806704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:58.411345+0000","last_change":"2023-12-07T21:13:58.411345+0000","last_active":"2023-12-07T21:13:58.411345+0000","last_peered":"2023-12-07T21:13:58.411345+0000","last_clean":"2023-12-07T21:13:58.411345+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:13:58.411345+0000","last_undegraded":"2023-12-07T21:13:58.411345+0000","last_fullsized":"2023-12-07T21:13:58.411345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:58.411237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:58.411237+0000","last_clean_scrub_stamp":"2023-12-07T21:13:58.411237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:57.593351+0000","scrub_duration":0.00098503999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:17.462525+0000","last_change":"2023-12-07T21:13:17.462525+0000","last_active":"2023-12-07T21:13:17.462525+0000","last_peered":"2023-12-07T21:13:17.462525+0000","last_clean":"2023-12-07T21:13:17.462525+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:13:17.462525+0000","last_undegraded":"2023-12-07T21:13:17.462525+0000","last_fullsized":"2023-12-07T21:13:17.462525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_clean_scrub_stamp":"2023-12-07T21:13:17.462415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:57.578294+0000","scrub_duration":0.0013457709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:01.338926+0000","last_change":"2023-12-07T21:14:01.338946+0000","last_active":"2023-12-07T21:14:01.338926+0000","last_peered":"2023-12-07T21:14:01.338926+0000","last_clean":"2023-12-07T21:14:01.338926+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:14:01.338926+0000","last_undegraded":"2023-12-07T21:14:01.338926+0000","last_fullsized":"2023-12-07T21:14:01.338926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:01.338826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:01.338826+0000","last_clean_scrub_stamp":"2023-12-07T21:14:01.338826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:19.893425+0000","scrub_duration":0.0012369779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.612358+0000","last_change":"2023-12-07T21:12:17.612358+0000","last_active":"2023-12-07T21:12:17.612358+0000","last_peered":"2023-12-07T21:12:17.612358+0000","last_clean":"2023-12-07T21:12:17.612358+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:12:17.612358+0000","last_undegraded":"2023-12-07T21:12:17.612358+0000","last_fullsized":"2023-12-07T21:12:17.612358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.612233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:19.658682+0000","scrub_duration":0.00093805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.713922+0000","last_change":"2023-12-07T21:11:41.713922+0000","last_active":"2023-12-07T21:11:41.713922+0000","last_peered":"2023-12-07T21:11:41.713922+0000","last_clean":"2023-12-07T21:11:41.713922+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:41.713922+0000","last_undegraded":"2023-12-07T21:11:41.713922+0000","last_fullsized":"2023-12-07T21:11:41.713922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.713762+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:20:34.087308+0000","scrub_duration":0.004054785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.510342+0000","last_change":"2023-12-07T21:12:27.510342+0000","last_active":"2023-12-07T21:12:27.510342+0000","last_peered":"2023-12-07T21:12:27.510342+0000","last_clean":"2023-12-07T21:12:27.510342+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:12:27.510342+0000","last_undegraded":"2023-12-07T21:12:27.510342+0000","last_fullsized":"2023-12-07T21:12:27.510342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.510237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:49.420820+0000","scrub_duration":0.00099611600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.816275+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:11:33.816275+0000","last_peered":"2023-12-07T21:11:33.816275+0000","last_clean":"2023-12-07T21:11:33.816275+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:11:33.816275+0000","last_undegraded":"2023-12-07T21:11:33.816275+0000","last_fullsized":"2023-12-07T21:11:33.816275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.564326+0000","last_change":"2023-12-07T21:13:28.564326+0000","last_active":"2023-12-07T21:13:28.564326+0000","last_peered":"2023-12-07T21:13:28.564326+0000","last_clean":"2023-12-07T21:13:28.564326+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:13:28.564326+0000","last_undegraded":"2023-12-07T21:13:28.564326+0000","last_fullsized":"2023-12-07T21:13:28.564326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.564212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:00.422576+0000","scrub_duration":0.0013779650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.878922+0000","last_change":"2023-12-07T21:13:08.878977+0000","last_active":"2023-12-07T21:13:08.878922+0000","last_peered":"2023-12-07T21:13:08.878922+0000","last_clean":"2023-12-07T21:13:08.878922+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:13:08.878922+0000","last_undegraded":"2023-12-07T21:13:08.878922+0000","last_fullsized":"2023-12-07T21:13:08.878922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_clean_scrub_stamp":"2023-12-07T21:13:08.878805+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:03.437843+0000","scrub_duration":0.0021145529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.412366+0000","last_change":"2023-12-07T21:11:55.412366+0000","last_active":"2023-12-07T21:11:55.412366+0000","last_peered":"2023-12-07T21:11:55.412366+0000","last_clean":"2023-12-07T21:11:55.412366+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:55.412366+0000","last_undegraded":"2023-12-07T21:11:55.412366+0000","last_fullsized":"2023-12-07T21:11:55.412366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.412243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.514434+0000","scrub_duration":0.0010230090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:00.405945+0000","last_change":"2023-12-07T21:12:00.405945+0000","last_active":"2023-12-07T21:12:00.405945+0000","last_peered":"2023-12-07T21:12:00.405945+0000","last_clean":"2023-12-07T21:12:00.405945+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:12:00.405945+0000","last_undegraded":"2023-12-07T21:12:00.405945+0000","last_fullsized":"2023-12-07T21:12:00.405945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_clean_scrub_stamp":"2023-12-07T21:12:00.405797+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:22.672028+0000","scrub_duration":0.0030248670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.620711+0000","last_change":"2023-12-07T21:12:35.620711+0000","last_active":"2023-12-07T21:12:35.620711+0000","last_peered":"2023-12-07T21:12:35.620711+0000","last_clean":"2023-12-07T21:12:35.620711+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:12:35.620711+0000","last_undegraded":"2023-12-07T21:12:35.620711+0000","last_fullsized":"2023-12-07T21:12:35.620711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.620604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:45:58.984206+0000","scrub_duration":0.00101417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.816183+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:11:33.816183+0000","last_peered":"2023-12-07T21:11:33.816183+0000","last_clean":"2023-12-07T21:11:33.816183+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:11:33.816183+0000","last_undegraded":"2023-12-07T21:11:33.816183+0000","last_fullsized":"2023-12-07T21:11:33.816183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'14","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:45.443225+0000","last_change":"2023-12-07T21:12:45.443225+0000","last_active":"2023-12-07T21:12:45.443225+0000","last_peered":"2023-12-07T21:12:45.443225+0000","last_clean":"2023-12-07T21:12:45.443225+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:12:45.443225+0000","last_undegraded":"2023-12-07T21:12:45.443225+0000","last_fullsized":"2023-12-07T21:12:45.443225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_clean_scrub_stamp":"2023-12-07T21:12:45.443116+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:59.105780+0000","scrub_duration":0.003118975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:41.352194+0000","last_change":"2023-12-07T21:12:41.352194+0000","last_active":"2023-12-07T21:12:41.352194+0000","last_peered":"2023-12-07T21:12:41.352194+0000","last_clean":"2023-12-07T21:12:41.352194+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:12:41.352194+0000","last_undegraded":"2023-12-07T21:12:41.352194+0000","last_fullsized":"2023-12-07T21:12:41.352194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_clean_scrub_stamp":"2023-12-07T21:12:41.352075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:21.467955+0000","scrub_duration":0.001369671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.347728+0000","last_change":"2023-12-07T21:11:44.347728+0000","last_active":"2023-12-07T21:11:44.347728+0000","last_peered":"2023-12-07T21:11:44.347728+0000","last_clean":"2023-12-07T21:11:44.347728+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:44.347728+0000","last_undegraded":"2023-12-07T21:11:44.347728+0000","last_fullsized":"2023-12-07T21:11:44.347728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.347582+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:19:20.740832+0000","scrub_duration":0.0032839919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.582486+0000","last_change":"2023-12-07T21:13:06.582486+0000","last_active":"2023-12-07T21:13:06.582486+0000","last_peered":"2023-12-07T21:13:06.582486+0000","last_clean":"2023-12-07T21:13:06.582486+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:13:06.582486+0000","last_undegraded":"2023-12-07T21:13:06.582486+0000","last_fullsized":"2023-12-07T21:13:06.582486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.582338+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:09:35.689720+0000","scrub_duration":0.0045970239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.807904+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:33.807904+0000","last_peered":"2023-12-07T21:11:33.807904+0000","last_clean":"2023-12-07T21:11:33.807904+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:33.807904+0000","last_undegraded":"2023-12-07T21:11:33.807904+0000","last_fullsized":"2023-12-07T21:11:33.807904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.425991+0000","last_change":"2023-12-07T21:13:38.425991+0000","last_active":"2023-12-07T21:13:38.425991+0000","last_peered":"2023-12-07T21:13:38.425991+0000","last_clean":"2023-12-07T21:13:38.425991+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:13:38.425991+0000","last_undegraded":"2023-12-07T21:13:38.425991+0000","last_fullsized":"2023-12-07T21:13:38.425991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:38.425888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:38.425888+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.425888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:24:24.944080+0000","scrub_duration":0.0010394829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.282874+0000","last_change":"2023-12-07T21:12:20.282874+0000","last_active":"2023-12-07T21:12:20.282874+0000","last_peered":"2023-12-07T21:12:20.282874+0000","last_clean":"2023-12-07T21:12:20.282874+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:12:20.282874+0000","last_undegraded":"2023-12-07T21:12:20.282874+0000","last_fullsized":"2023-12-07T21:12:20.282874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.282741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:25.331572+0000","scrub_duration":0.001103185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.410433+0000","last_change":"2023-12-07T21:13:11.410456+0000","last_active":"2023-12-07T21:13:11.410433+0000","last_peered":"2023-12-07T21:13:11.410433+0000","last_clean":"2023-12-07T21:13:11.410433+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:13:11.410433+0000","last_undegraded":"2023-12-07T21:13:11.410433+0000","last_fullsized":"2023-12-07T21:13:11.410433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.410343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:25:05.365800+0000","scrub_duration":0.00143078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.887062+0000","last_change":"2023-12-07T21:12:35.887062+0000","last_active":"2023-12-07T21:12:35.887062+0000","last_peered":"2023-12-07T21:12:35.887062+0000","last_clean":"2023-12-07T21:12:35.887062+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:12:35.887062+0000","last_undegraded":"2023-12-07T21:12:35.887062+0000","last_fullsized":"2023-12-07T21:12:35.887062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.886915+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:07.595951+0000","scrub_duration":0.0013132650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.022855+0000","last_change":"2023-12-07T21:13:52.022881+0000","last_active":"2023-12-07T21:13:52.022855+0000","last_peered":"2023-12-07T21:13:52.022855+0000","last_clean":"2023-12-07T21:13:52.022855+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:13:52.022855+0000","last_undegraded":"2023-12-07T21:13:52.022855+0000","last_fullsized":"2023-12-07T21:13:52.022855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:52.022763+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:52.022763+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.022763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:23:15.784577+0000","scrub_duration":0.001528983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.424126+0000","last_change":"2023-12-07T21:12:12.424126+0000","last_active":"2023-12-07T21:12:12.424126+0000","last_peered":"2023-12-07T21:12:12.424126+0000","last_clean":"2023-12-07T21:12:12.424126+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:12:12.424126+0000","last_undegraded":"2023-12-07T21:12:12.424126+0000","last_fullsized":"2023-12-07T21:12:12.424126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.424026+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:21.643939+0000","scrub_duration":0.002995218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607794+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:11:10.607794+0000","last_peered":"2023-12-07T21:11:10.607794+0000","last_clean":"2023-12-07T21:11:10.607794+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:11:10.607794+0000","last_undegraded":"2023-12-07T21:11:10.607794+0000","last_fullsized":"2023-12-07T21:11:10.607794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.040427+0000","last_change":"2023-12-07T21:13:36.040464+0000","last_active":"2023-12-07T21:13:36.040427+0000","last_peered":"2023-12-07T21:13:36.040427+0000","last_clean":"2023-12-07T21:13:36.040427+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:13:36.040427+0000","last_undegraded":"2023-12-07T21:13:36.040427+0000","last_fullsized":"2023-12-07T21:13:36.040427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:36.040303+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:36.040303+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.040303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:27:20.323619+0000","scrub_duration":0.0015351799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:59.931829+0000","last_change":"2023-12-07T21:13:59.931849+0000","last_active":"2023-12-07T21:13:59.931829+0000","last_peered":"2023-12-07T21:13:59.931829+0000","last_clean":"2023-12-07T21:13:59.931829+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:13:59.931829+0000","last_undegraded":"2023-12-07T21:13:59.931829+0000","last_fullsized":"2023-12-07T21:13:59.931829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:59.931743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:59.931743+0000","last_clean_scrub_stamp":"2023-12-07T21:13:59.931743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:27.479281+0000","scrub_duration":0.0012518340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.893908+0000","last_change":"2023-12-07T21:13:07.893908+0000","last_active":"2023-12-07T21:13:07.893908+0000","last_peered":"2023-12-07T21:13:07.893908+0000","last_clean":"2023-12-07T21:13:07.893908+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:13:07.893908+0000","last_undegraded":"2023-12-07T21:13:07.893908+0000","last_fullsized":"2023-12-07T21:13:07.893908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.893732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:21.957836+0000","scrub_duration":0.0014675510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:43.075446+0000","last_change":"2023-12-07T21:13:43.075468+0000","last_active":"2023-12-07T21:13:43.075446+0000","last_peered":"2023-12-07T21:13:43.075446+0000","last_clean":"2023-12-07T21:13:43.075446+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:13:43.075446+0000","last_undegraded":"2023-12-07T21:13:43.075446+0000","last_fullsized":"2023-12-07T21:13:43.075446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:43.075357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:43.075357+0000","last_clean_scrub_stamp":"2023-12-07T21:13:43.075357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:16.414998+0000","scrub_duration":0.001175125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:39.400478+0000","last_change":"2023-12-07T21:13:39.400502+0000","last_active":"2023-12-07T21:13:39.400478+0000","last_peered":"2023-12-07T21:13:39.400478+0000","last_clean":"2023-12-07T21:13:39.400478+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:13:39.400478+0000","last_undegraded":"2023-12-07T21:13:39.400478+0000","last_fullsized":"2023-12-07T21:13:39.400478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:39.400392+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:39.400392+0000","last_clean_scrub_stamp":"2023-12-07T21:13:39.400392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:58:58.675909+0000","scrub_duration":0.0010690470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.488346+0000","last_change":"2023-12-07T21:13:27.488385+0000","last_active":"2023-12-07T21:13:27.488346+0000","last_peered":"2023-12-07T21:13:27.488346+0000","last_clean":"2023-12-07T21:13:27.488346+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:13:27.488346+0000","last_undegraded":"2023-12-07T21:13:27.488346+0000","last_fullsized":"2023-12-07T21:13:27.488346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.488243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:20.217342+0000","scrub_duration":0.0011396240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.783809+0000","last_change":"2023-12-07T21:12:21.783809+0000","last_active":"2023-12-07T21:12:21.783809+0000","last_peered":"2023-12-07T21:12:21.783809+0000","last_clean":"2023-12-07T21:12:21.783809+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:12:21.783809+0000","last_undegraded":"2023-12-07T21:12:21.783809+0000","last_fullsized":"2023-12-07T21:12:21.783809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.783687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:25.104216+0000","scrub_duration":0.001223366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.417813+0000","last_change":"2023-12-07T21:12:58.417813+0000","last_active":"2023-12-07T21:12:58.417813+0000","last_peered":"2023-12-07T21:12:58.417813+0000","last_clean":"2023-12-07T21:12:58.417813+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:12:58.417813+0000","last_undegraded":"2023-12-07T21:12:58.417813+0000","last_fullsized":"2023-12-07T21:12:58.417813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.417685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:16.173945+0000","scrub_duration":0.0012264019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.393510+0000","last_change":"2023-12-07T21:12:14.393510+0000","last_active":"2023-12-07T21:12:14.393510+0000","last_peered":"2023-12-07T21:12:14.393510+0000","last_clean":"2023-12-07T21:12:14.393510+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:12:14.393510+0000","last_undegraded":"2023-12-07T21:12:14.393510+0000","last_fullsized":"2023-12-07T21:12:14.393510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.393370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:28.056034+0000","scrub_duration":0.0012787390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.892420+0000","last_change":"2023-12-07T21:14:02.892444+0000","last_active":"2023-12-07T21:14:02.892420+0000","last_peered":"2023-12-07T21:14:02.892420+0000","last_clean":"2023-12-07T21:14:02.892420+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:14:02.892420+0000","last_undegraded":"2023-12-07T21:14:02.892420+0000","last_fullsized":"2023-12-07T21:14:02.892420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:14:02.892333+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:14:02.892333+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.892333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:08:55.928235+0000","scrub_duration":0.001620423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:22.292065+0000","last_change":"2023-12-07T21:12:22.292065+0000","last_active":"2023-12-07T21:12:22.292065+0000","last_peered":"2023-12-07T21:12:22.292065+0000","last_clean":"2023-12-07T21:12:22.292065+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:12:22.292065+0000","last_undegraded":"2023-12-07T21:12:22.292065+0000","last_fullsized":"2023-12-07T21:12:22.292065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_clean_scrub_stamp":"2023-12-07T21:12:22.291964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:19:35.510802+0000","scrub_duration":0.000955034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607807+0000","last_change":"2023-12-07T21:08:54.893104+0000","last_active":"2023-12-07T21:11:10.607807+0000","last_peered":"2023-12-07T21:11:10.607807+0000","last_clean":"2023-12-07T21:11:10.607807+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:11:10.607807+0000","last_undegraded":"2023-12-07T21:11:10.607807+0000","last_fullsized":"2023-12-07T21:11:10.607807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:24.489652+0000","last_change":"2023-12-07T21:12:24.489652+0000","last_active":"2023-12-07T21:12:24.489652+0000","last_peered":"2023-12-07T21:12:24.489652+0000","last_clean":"2023-12-07T21:12:24.489652+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:12:24.489652+0000","last_undegraded":"2023-12-07T21:12:24.489652+0000","last_fullsized":"2023-12-07T21:12:24.489652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_clean_scrub_stamp":"2023-12-07T21:12:24.489525+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:58:44.073512+0000","scrub_duration":0.0022717330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.088717+0000","last_change":"2023-12-07T21:13:21.088717+0000","last_active":"2023-12-07T21:13:21.088717+0000","last_peered":"2023-12-07T21:13:21.088717+0000","last_clean":"2023-12-07T21:13:21.088717+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:13:21.088717+0000","last_undegraded":"2023-12-07T21:13:21.088717+0000","last_fullsized":"2023-12-07T21:13:21.088717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.088571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:31:27.226694+0000","scrub_duration":0.0016712599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.917521+0000","last_change":"2023-12-07T21:13:00.917521+0000","last_active":"2023-12-07T21:13:00.917521+0000","last_peered":"2023-12-07T21:13:00.917521+0000","last_clean":"2023-12-07T21:13:00.917521+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:13:00.917521+0000","last_undegraded":"2023-12-07T21:13:00.917521+0000","last_fullsized":"2023-12-07T21:13:00.917521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.917383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:19.507436+0000","scrub_duration":0.0013780719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.318731+0000","last_change":"2023-12-07T21:13:11.318731+0000","last_active":"2023-12-07T21:13:11.318731+0000","last_peered":"2023-12-07T21:13:11.318731+0000","last_clean":"2023-12-07T21:13:11.318731+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:13:11.318731+0000","last_undegraded":"2023-12-07T21:13:11.318731+0000","last_fullsized":"2023-12-07T21:13:11.318731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.318563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:32:03.116436+0000","scrub_duration":0.0013115340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:33.322751+0000","last_change":"2023-12-07T21:12:33.322751+0000","last_active":"2023-12-07T21:12:33.322751+0000","last_peered":"2023-12-07T21:12:33.322751+0000","last_clean":"2023-12-07T21:12:33.322751+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:12:33.322751+0000","last_undegraded":"2023-12-07T21:12:33.322751+0000","last_fullsized":"2023-12-07T21:12:33.322751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_clean_scrub_stamp":"2023-12-07T21:12:33.322634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:25:00.599068+0000","scrub_duration":0.001216778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.401789+0000","last_change":"2023-12-07T21:13:20.401789+0000","last_active":"2023-12-07T21:13:20.401789+0000","last_peered":"2023-12-07T21:13:20.401789+0000","last_clean":"2023-12-07T21:13:20.401789+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:13:20.401789+0000","last_undegraded":"2023-12-07T21:13:20.401789+0000","last_fullsized":"2023-12-07T21:13:20.401789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.401627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.790385+0000","scrub_duration":0.001405433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:32.342446+0000","last_change":"2023-12-07T21:12:32.342446+0000","last_active":"2023-12-07T21:12:32.342446+0000","last_peered":"2023-12-07T21:12:32.342446+0000","last_clean":"2023-12-07T21:12:32.342446+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:12:32.342446+0000","last_undegraded":"2023-12-07T21:12:32.342446+0000","last_fullsized":"2023-12-07T21:12:32.342446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_clean_scrub_stamp":"2023-12-07T21:12:32.342321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:46.648309+0000","scrub_duration":0.0011184750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:06.373937+0000","last_change":"2023-12-07T21:14:06.373997+0000","last_active":"2023-12-07T21:14:06.373937+0000","last_peered":"2023-12-07T21:14:06.373937+0000","last_clean":"2023-12-07T21:14:06.373937+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:14:06.373937+0000","last_undegraded":"2023-12-07T21:14:06.373937+0000","last_fullsized":"2023-12-07T21:14:06.373937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:14:06.373834+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:14:06.373834+0000","last_clean_scrub_stamp":"2023-12-07T21:14:06.373834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:02:26.088876+0000","scrub_duration":0.0014409469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'16","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.341269+0000","last_change":"2023-12-07T21:12:27.341269+0000","last_active":"2023-12-07T21:12:27.341269+0000","last_peered":"2023-12-07T21:12:27.341269+0000","last_clean":"2023-12-07T21:12:27.341269+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:12:27.341269+0000","last_undegraded":"2023-12-07T21:12:27.341269+0000","last_fullsized":"2023-12-07T21:12:27.341269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.341151+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:55:08.404366+0000","scrub_duration":0.0024774139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:13.811045+0000","last_change":"2023-12-07T21:08:54.892579+0000","last_active":"2023-12-07T21:11:13.811045+0000","last_peered":"2023-12-07T21:11:13.811045+0000","last_clean":"2023-12-07T21:11:13.811045+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:11:13.811045+0000","last_undegraded":"2023-12-07T21:11:13.811045+0000","last_fullsized":"2023-12-07T21:11:13.811045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:46.318458+0000","last_change":"2023-12-07T21:13:46.318480+0000","last_active":"2023-12-07T21:13:46.318458+0000","last_peered":"2023-12-07T21:13:46.318458+0000","last_clean":"2023-12-07T21:13:46.318458+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:13:46.318458+0000","last_undegraded":"2023-12-07T21:13:46.318458+0000","last_fullsized":"2023-12-07T21:13:46.318458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:46.318375+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:46.318375+0000","last_clean_scrub_stamp":"2023-12-07T21:13:46.318375+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:20:30.826377+0000","scrub_duration":0.001152574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.462656+0000","last_change":"2023-12-07T21:12:54.462656+0000","last_active":"2023-12-07T21:12:54.462656+0000","last_peered":"2023-12-07T21:12:54.462656+0000","last_clean":"2023-12-07T21:12:54.462656+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:12:54.462656+0000","last_undegraded":"2023-12-07T21:12:54.462656+0000","last_fullsized":"2023-12-07T21:12:54.462656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.462543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:12:35.524119+0000","scrub_duration":0.0012396099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:01.404048+0000","last_change":"2023-12-07T21:12:01.404048+0000","last_active":"2023-12-07T21:12:01.404048+0000","last_peered":"2023-12-07T21:12:01.404048+0000","last_clean":"2023-12-07T21:12:01.404048+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:12:01.404048+0000","last_undegraded":"2023-12-07T21:12:01.404048+0000","last_fullsized":"2023-12-07T21:12:01.404048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_clean_scrub_stamp":"2023-12-07T21:12:01.403925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:06:41.638050+0000","scrub_duration":0.0014963070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812768+0000","last_change":"2023-12-07T21:08:54.886862+0000","last_active":"2023-12-07T21:11:18.812768+0000","last_peered":"2023-12-07T21:11:18.812768+0000","last_clean":"2023-12-07T21:11:18.812768+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:11:18.812768+0000","last_undegraded":"2023-12-07T21:11:18.812768+0000","last_fullsized":"2023-12-07T21:11:18.812768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811892+0000","last_change":"2023-12-07T21:08:54.892920+0000","last_active":"2023-12-07T21:11:18.811892+0000","last_peered":"2023-12-07T21:11:18.811892+0000","last_clean":"2023-12-07T21:11:18.811892+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:11:18.811892+0000","last_undegraded":"2023-12-07T21:11:18.811892+0000","last_fullsized":"2023-12-07T21:11:18.811892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:06.990943+0000","last_change":"2023-12-07T21:14:06.990967+0000","last_active":"2023-12-07T21:14:06.990943+0000","last_peered":"2023-12-07T21:14:06.990943+0000","last_clean":"2023-12-07T21:14:06.990943+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:14:06.990943+0000","last_undegraded":"2023-12-07T21:14:06.990943+0000","last_fullsized":"2023-12-07T21:14:06.990943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:14:06.990856+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:14:06.990856+0000","last_clean_scrub_stamp":"2023-12-07T21:14:06.990856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:26.019692+0000","scrub_duration":0.0015824859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.910417+0000","last_change":"2023-12-07T21:13:05.910417+0000","last_active":"2023-12-07T21:13:05.910417+0000","last_peered":"2023-12-07T21:13:05.910417+0000","last_clean":"2023-12-07T21:13:05.910417+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:13:05.910417+0000","last_undegraded":"2023-12-07T21:13:05.910417+0000","last_fullsized":"2023-12-07T21:13:05.910417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.910299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:31:57.708172+0000","scrub_duration":0.001525988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.272208+0000","last_change":"2023-12-07T21:12:56.272208+0000","last_active":"2023-12-07T21:12:56.272208+0000","last_peered":"2023-12-07T21:12:56.272208+0000","last_clean":"2023-12-07T21:12:56.272208+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:12:56.272208+0000","last_undegraded":"2023-12-07T21:12:56.272208+0000","last_fullsized":"2023-12-07T21:12:56.272208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.272079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:16.868178+0000","scrub_duration":0.0010823779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1971,"ondisk_log_size":1971,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1439,"ondisk_log_size":1439,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705739,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35804,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336036,"statfs":{"total":96636764160,"available":96600100864,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.42499999999999999},"min":{"1min":0.32100000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.56399999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.441,"15min":0.44500000000000001},"min":{"1min":0.35999999999999999,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.56999999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Dec 7 21:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32900000000000001,"15min":0.34100000000000003},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.434,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.33600000000000002,"15min":0.34399999999999997},"min":{"1min":0.24099999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.44800000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:13:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.26600000000000001,"5min":0.223,"15min":0.223},"max":{"1min":0.51000000000000001,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.378},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.33100000000000002,"15min":0.33600000000000002},"min":{"1min":0.251,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.47499999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.43099999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705738,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.36599999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52600000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.433,"15min":0.432},"min":{"1min":0.33800000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.55000000000000004,"5min":0.621,"15min":0.621},"last":0.375}]},{"osd":1,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33500000000000002,"15min":0.32300000000000001},"min":{"1min":0.23999999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.42699999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.316},{"interface":"front","average":{"1min":0.308,"5min":0.32000000000000001,"15min":0.33000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.40300000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32500000000000001,"15min":0.32900000000000001},"min":{"1min":0.249,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.40699999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.35399999999999998,"15min":0.36399999999999999},"min":{"1min":0.26000000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.48699999999999999,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705738,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.45500000000000002},"min":{"1min":0.36799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":0.58999999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.45600000000000002,"15min":0.46600000000000003},"min":{"1min":0.371,"5min":0.222,"15min":0.222},"max":{"1min":0.55900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.33400000000000002,"15min":0.35699999999999998},"min":{"1min":0.26000000000000001,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.441,"5min":0.629,"15min":0.629},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.31900000000000001,"5min":0.32100000000000001,"15min":0.32500000000000001},"min":{"1min":0.24399999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.47799999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Dec 7 21:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.33000000000000002,"15min":0.34000000000000002},"min":{"1min":0.251,"5min":0.191,"15min":0.191},"max":{"1min":0.52100000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35699999999999998,"15min":0.374},"min":{"1min":0.26600000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.497,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.40500000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48799999999999999,"15min":0.495},"min":{"1min":0.22800000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.67700000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.28299999999999997,"5min":0.191,"15min":0.191},"max":{"1min":0.68100000000000005,"5min":0.747,"15min":0.747},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.503,"15min":0.48499999999999999},"min":{"1min":0.26900000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.65100000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.503,"15min":0.48099999999999998},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Dec 7 21:13:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.5,"15min":0.496},"min":{"1min":0.32700000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.67500000000000004,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.504,"15min":0.49299999999999999},"min":{"1min":0.33800000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.36599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:14:34.497 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.497 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.498 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.499 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.499 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.499 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.499 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.500 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.500 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.500 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-07T21:08:45.807521+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=45, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.501 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.501 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.501 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.501 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.502 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.502 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.502 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.503 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.503 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:34.503 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:14:54.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:14:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.623+0000 7fb285b65640 1 Processor -- start 2023-12-07T21:14:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.623+0000 7fb285b65640 1 -- start start 2023-12-07T21:14:54.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.624+0000 7fb285b65640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb280130a20 0x7fb280132e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:14:54.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.624+0000 7fb285b65640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28006d960 con 0x7fb28012a640 2023-12-07T21:14:54.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.624+0000 7fb285b65640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb280099400 con 0x7fb280130a20 2023-12-07T21:14:54.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.624+0000 7fb27effd640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb280130a20 0x7fb280132e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:14:54.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.624+0000 7fb27f7fe640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb28012a640 0x7fb28012aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:48020/0 (socket says 172.21.15.89:48020) 2023-12-07T21:14:54.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.624+0000 7fb27f7fe640 1 -- 172.21.15.89:0/3753525402 learned_addr learned my addr 172.21.15.89:0/3753525402 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:14:54.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.624+0000 7fb27effd640 1 -- 172.21.15.89:0/3753525402 >> v1:172.21.15.89:6789/0 conn(0x7fb28012a640 legacy=0x7fb28012aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:54.615 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.624+0000 7fb27effd640 1 -- 172.21.15.89:0/3753525402 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28012b130 con 0x7fb280130a20 2023-12-07T21:14:54.616 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.624+0000 7fb27e7fc640 1 -- 172.21.15.89:0/3753525402 <== mon.0 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870343544 0 0) 0x7fb28006d960 con 0x7fb28012a640 2023-12-07T21:14:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.625+0000 7fb27effd640 1 --2- 172.21.15.89:0/3753525402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280130a20 0x7fb280132e10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb274009750 tx=0x7fb27402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa62e773dd1f8a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:14:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.625+0000 7fb27e7fc640 1 -- 172.21.15.89:0/3753525402 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb27402e070 con 0x7fb280130a20 2023-12-07T21:14:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.625+0000 7fb27e7fc640 1 -- 172.21.15.89:0/3753525402 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2740316d0 con 0x7fb280130a20 2023-12-07T21:14:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.625+0000 7fb27e7fc640 1 -- 172.21.15.89:0/3753525402 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb274031990 con 0x7fb280130a20 2023-12-07T21:14:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.626+0000 7fb285b65640 1 -- 172.21.15.89:0/3753525402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280130a20 msgr2=0x7fb280132e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:54.619 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.626+0000 7fb285b65640 1 --2- 172.21.15.89:0/3753525402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280130a20 0x7fb280132e10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb274009750 tx=0x7fb27402b840 comp rx=0 tx=0).stop 2023-12-07T21:14:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.626+0000 7fb285b65640 1 -- 172.21.15.89:0/3753525402 shutdown_connections 2023-12-07T21:14:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.626+0000 7fb285b65640 1 --2- 172.21.15.89:0/3753525402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280130a20 0x7fb280132e10 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:14:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.626+0000 7fb285b65640 1 -- 172.21.15.89:0/3753525402 >> 172.21.15.89:0/3753525402 conn(0x7fb28006c730 msgr2=0x7fb28006cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:14:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.626+0000 7fb285b65640 1 -- 172.21.15.89:0/3753525402 shutdown_connections 2023-12-07T21:14:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.626+0000 7fb285b65640 1 -- 172.21.15.89:0/3753525402 wait complete. 2023-12-07T21:14:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.627+0000 7fb285b65640 1 Processor -- start 2023-12-07T21:14:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.627+0000 7fb285b65640 1 -- start start 2023-12-07T21:14:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.627+0000 7fb285b65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb28012a640 0x7fb28011b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:14:54.620 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.627+0000 7fb285b65640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28011cb70 con 0x7fb28012a640 2023-12-07T21:14:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.627+0000 7fb27f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb28012a640 0x7fb28011b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:14:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.627+0000 7fb27f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb28012a640 0x7fb28011b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:35966/0 (socket says 172.21.15.89:35966) 2023-12-07T21:14:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.627+0000 7fb27f7fe640 1 -- 172.21.15.89:0/3652030112 learned_addr learned my addr 172.21.15.89:0/3652030112 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:14:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.628+0000 7fb27f7fe640 1 -- 172.21.15.89:0/3652030112 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274009400 con 0x7fb28012a640 2023-12-07T21:14:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.628+0000 7fb27f7fe640 1 --2- 172.21.15.89:0/3652030112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb28012a640 0x7fb28011b130 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb27000c840 tx=0x7fb27000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:14:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.628+0000 7fb267fff640 1 -- 172.21.15.89:0/3652030112 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb270004ea0 con 0x7fb28012a640 2023-12-07T21:14:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.628+0000 7fb267fff640 1 -- 172.21.15.89:0/3652030112 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27000a660 con 0x7fb28012a640 2023-12-07T21:14:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.628+0000 7fb267fff640 1 -- 172.21.15.89:0/3652030112 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb27000a920 con 0x7fb28012a640 2023-12-07T21:14:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.628+0000 7fb285b65640 1 -- 172.21.15.89:0/3652030112 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28011e480 con 0x7fb28012a640 2023-12-07T21:14:54.621 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.628+0000 7fb285b65640 1 -- 172.21.15.89:0/3652030112 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28011e8c0 con 0x7fb28012a640 2023-12-07T21:14:54.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.629+0000 7fb267fff640 1 -- 172.21.15.89:0/3652030112 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fb27000aa80 con 0x7fb28012a640 2023-12-07T21:14:54.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.629+0000 7fb285b65640 1 -- 172.21.15.89:0/3652030112 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb280062110 con 0x7fb28012a640 2023-12-07T21:14:54.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.629+0000 7fb267fff640 1 --2- 172.21.15.89:0/3652030112 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb26c037820 0x7fb26c039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:14:54.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.629+0000 7fb267fff640 1 -- 172.21.15.89:0/3652030112 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fb27004a530 con 0x7fb28012a640 2023-12-07T21:14:54.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.629+0000 7fb27effd640 1 --2- 172.21.15.89:0/3652030112 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb26c037820 0x7fb26c039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:14:54.622 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.630+0000 7fb27effd640 1 --2- 172.21.15.89:0/3652030112 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb26c037820 0x7fb26c039ce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb274036000 tx=0x7fb274008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:14:54.623 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.634+0000 7fb267fff640 1 -- 172.21.15.89:0/3652030112 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb27001a2c0 con 0x7fb28012a640 2023-12-07T21:14:54.787 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.797+0000 7fb285b65640 1 -- 172.21.15.89:0/3652030112 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb280099720 con 0x7fb26c037820 2023-12-07T21:14:54.802 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.812+0000 7fb267fff640 1 -- 172.21.15.89:0/3652030112 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+677556 (secure 0 0 0) 0x7fb274031bc0 con 0x7fb26c037820 2023-12-07T21:14:54.810 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:14:54.815 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:14:54.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.817+0000 7fb285b65640 1 -- 172.21.15.89:0/3652030112 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb26c037820 msgr2=0x7fb26c039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:54.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.817+0000 7fb285b65640 1 --2- 172.21.15.89:0/3652030112 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb26c037820 0x7fb26c039ce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb274036000 tx=0x7fb274008030 comp rx=0 tx=0).stop 2023-12-07T21:14:54.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.817+0000 7fb285b65640 1 -- 172.21.15.89:0/3652030112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb28012a640 msgr2=0x7fb28011b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:14:54.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.817+0000 7fb285b65640 1 --2- 172.21.15.89:0/3652030112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb28012a640 0x7fb28011b130 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb27000c840 tx=0x7fb27000cd00 comp rx=0 tx=0).stop 2023-12-07T21:14:54.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.817+0000 7fb285b65640 1 -- 172.21.15.89:0/3652030112 shutdown_connections 2023-12-07T21:14:54.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.817+0000 7fb285b65640 1 --2- 172.21.15.89:0/3652030112 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fb26c037820 0x7fb26c039ce0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:14:54.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.817+0000 7fb285b65640 1 --2- 172.21.15.89:0/3652030112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb28012a640 0x7fb28011b130 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:14:54.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.817+0000 7fb285b65640 1 -- 172.21.15.89:0/3652030112 >> 172.21.15.89:0/3652030112 conn(0x7fb28006c730 msgr2=0x7fb28012e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:14:54.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.817+0000 7fb285b65640 1 -- 172.21.15.89:0/3652030112 shutdown_connections 2023-12-07T21:14:54.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:14:54.817+0000 7fb285b65640 1 -- 172.21.15.89:0/3652030112 wait complete. 2023-12-07T21:14:54.819 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2023-12-07T21:14:54.162440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1822,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4023,"ondisk_log_size":4023,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152540,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334820,"statfs":{"total":386547056640,"available":386390855680,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":153216792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003982"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:19.413104+0000","last_change":"2023-12-07T21:13:19.413127+0000","last_active":"2023-12-07T21:13:19.413104+0000","last_peered":"2023-12-07T21:13:19.413104+0000","last_clean":"2023-12-07T21:13:19.413104+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:13:19.413104+0000","last_undegraded":"2023-12-07T21:13:19.413104+0000","last_fullsized":"2023-12-07T21:13:19.413104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_clean_scrub_stamp":"2023-12-07T21:13:19.413017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:51.122054+0000","scrub_duration":0.001250333,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.407256+0000","last_change":"2023-12-07T21:12:16.407256+0000","last_active":"2023-12-07T21:12:16.407256+0000","last_peered":"2023-12-07T21:12:16.407256+0000","last_clean":"2023-12-07T21:12:16.407256+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:12:16.407256+0000","last_undegraded":"2023-12-07T21:12:16.407256+0000","last_fullsized":"2023-12-07T21:12:16.407256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.407151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:53.647151+0000","scrub_duration":0.00097124400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.079685+0000","last_change":"2023-12-07T21:13:28.079732+0000","last_active":"2023-12-07T21:13:28.079685+0000","last_peered":"2023-12-07T21:13:28.079685+0000","last_clean":"2023-12-07T21:13:28.079685+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:13:28.079685+0000","last_undegraded":"2023-12-07T21:13:28.079685+0000","last_fullsized":"2023-12-07T21:13:28.079685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.079572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:44:03.747216+0000","scrub_duration":0.0011377760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:30.001172+0000","last_change":"2023-12-07T21:14:30.001172+0000","last_active":"2023-12-07T21:14:30.001172+0000","last_peered":"2023-12-07T21:14:30.001172+0000","last_clean":"2023-12-07T21:14:30.001172+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:14:30.001172+0000","last_undegraded":"2023-12-07T21:14:30.001172+0000","last_fullsized":"2023-12-07T21:14:30.001172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:14:30.001034+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:14:30.001034+0000","last_clean_scrub_stamp":"2023-12-07T21:14:30.001034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:47:32.102632+0000","scrub_duration":0.0013113129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:14.442373+0000","last_change":"2023-12-07T21:14:14.442399+0000","last_active":"2023-12-07T21:14:14.442373+0000","last_peered":"2023-12-07T21:14:14.442373+0000","last_clean":"2023-12-07T21:14:14.442373+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:14:14.442373+0000","last_undegraded":"2023-12-07T21:14:14.442373+0000","last_fullsized":"2023-12-07T21:14:14.442373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:14:14.442278+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:14:14.442278+0000","last_clean_scrub_stamp":"2023-12-07T21:14:14.442278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:47:40.059438+0000","scrub_duration":0.001334046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.314629+0000","last_change":"2023-12-07T21:13:48.314629+0000","last_active":"2023-12-07T21:13:48.314629+0000","last_peered":"2023-12-07T21:13:48.314629+0000","last_clean":"2023-12-07T21:13:48.314629+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:13:48.314629+0000","last_undegraded":"2023-12-07T21:13:48.314629+0000","last_fullsized":"2023-12-07T21:13:48.314629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:48.314524+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:48.314524+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.314524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:17:28.252223+0000","scrub_duration":0.00098961300000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:39.350102+0000","last_change":"2023-12-07T21:13:39.350144+0000","last_active":"2023-12-07T21:13:39.350102+0000","last_peered":"2023-12-07T21:13:39.350102+0000","last_clean":"2023-12-07T21:13:39.350102+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:13:39.350102+0000","last_undegraded":"2023-12-07T21:13:39.350102+0000","last_fullsized":"2023-12-07T21:13:39.350102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:39.350003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:39.350003+0000","last_clean_scrub_stamp":"2023-12-07T21:13:39.350003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:26:22.544329+0000","scrub_duration":0.0013539439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:32.502187+0000","last_change":"2023-12-07T21:13:32.502187+0000","last_active":"2023-12-07T21:13:32.502187+0000","last_peered":"2023-12-07T21:13:32.502187+0000","last_clean":"2023-12-07T21:13:32.502187+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:13:32.502187+0000","last_undegraded":"2023-12-07T21:13:32.502187+0000","last_fullsized":"2023-12-07T21:13:32.502187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:32.502047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:32.502047+0000","last_clean_scrub_stamp":"2023-12-07T21:13:32.502047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:14:30.083430+0000","scrub_duration":0.001154356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:39.336854+0000","last_change":"2023-12-07T21:14:39.336893+0000","last_active":"2023-12-07T21:14:39.336854+0000","last_peered":"2023-12-07T21:14:39.336854+0000","last_clean":"2023-12-07T21:14:39.336854+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:14:39.336854+0000","last_undegraded":"2023-12-07T21:14:39.336854+0000","last_fullsized":"2023-12-07T21:14:39.336854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:39.336739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:39.336739+0000","last_clean_scrub_stamp":"2023-12-07T21:14:39.336739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:58:04.256324+0000","scrub_duration":0.001451075,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:39.304151+0000","last_change":"2023-12-07T21:12:39.304151+0000","last_active":"2023-12-07T21:12:39.304151+0000","last_peered":"2023-12-07T21:12:39.304151+0000","last_clean":"2023-12-07T21:12:39.304151+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:12:39.304151+0000","last_undegraded":"2023-12-07T21:12:39.304151+0000","last_fullsized":"2023-12-07T21:12:39.304151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_clean_scrub_stamp":"2023-12-07T21:12:39.304039+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:10.499475+0000","scrub_duration":0.0026021579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:35.274268+0000","last_change":"2023-12-07T21:13:35.274268+0000","last_active":"2023-12-07T21:13:35.274268+0000","last_peered":"2023-12-07T21:13:35.274268+0000","last_clean":"2023-12-07T21:13:35.274268+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:13:35.274268+0000","last_undegraded":"2023-12-07T21:13:35.274268+0000","last_fullsized":"2023-12-07T21:13:35.274268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:35.274152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:35.274152+0000","last_clean_scrub_stamp":"2023-12-07T21:13:35.274152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:55:25.519724+0000","scrub_duration":0.0012329559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:16.527864+0000","last_change":"2023-12-07T21:14:16.527886+0000","last_active":"2023-12-07T21:14:16.527864+0000","last_peered":"2023-12-07T21:14:16.527864+0000","last_clean":"2023-12-07T21:14:16.527864+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:14:16.527864+0000","last_undegraded":"2023-12-07T21:14:16.527864+0000","last_fullsized":"2023-12-07T21:14:16.527864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:14:16.527771+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:14:16.527771+0000","last_clean_scrub_stamp":"2023-12-07T21:14:16.527771+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:34:09.256870+0000","scrub_duration":0.0023275589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:28.377582+0000","last_change":"2023-12-07T21:14:28.377606+0000","last_active":"2023-12-07T21:14:28.377582+0000","last_peered":"2023-12-07T21:14:28.377582+0000","last_clean":"2023-12-07T21:14:28.377582+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:14:28.377582+0000","last_undegraded":"2023-12-07T21:14:28.377582+0000","last_fullsized":"2023-12-07T21:14:28.377582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:28.377486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:28.377486+0000","last_clean_scrub_stamp":"2023-12-07T21:14:28.377486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:22.031779+0000","scrub_duration":0.0011797929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.406511+0000","last_change":"2023-12-07T21:13:54.406569+0000","last_active":"2023-12-07T21:13:54.406511+0000","last_peered":"2023-12-07T21:13:54.406511+0000","last_clean":"2023-12-07T21:13:54.406511+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:13:54.406511+0000","last_undegraded":"2023-12-07T21:13:54.406511+0000","last_fullsized":"2023-12-07T21:13:54.406511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:54.406416+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:54.406416+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.406416+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:23:33.794119+0000","scrub_duration":0.001131316,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.845908+0000","last_change":"2023-12-07T21:12:54.845908+0000","last_active":"2023-12-07T21:12:54.845908+0000","last_peered":"2023-12-07T21:12:54.845908+0000","last_clean":"2023-12-07T21:12:54.845908+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:12:54.845908+0000","last_undegraded":"2023-12-07T21:12:54.845908+0000","last_fullsized":"2023-12-07T21:12:54.845908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.845780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:05.129794+0000","scrub_duration":0.001437123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'14","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.396728+0000","last_change":"2023-12-07T21:12:49.396728+0000","last_active":"2023-12-07T21:12:49.396728+0000","last_peered":"2023-12-07T21:12:49.396728+0000","last_clean":"2023-12-07T21:12:49.396728+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:12:49.396728+0000","last_undegraded":"2023-12-07T21:12:49.396728+0000","last_fullsized":"2023-12-07T21:12:49.396728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.396576+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:24:16.481666+0000","scrub_duration":0.0022819030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.406138+0000","last_change":"2023-12-07T21:13:44.406161+0000","last_active":"2023-12-07T21:13:44.406138+0000","last_peered":"2023-12-07T21:13:44.406138+0000","last_clean":"2023-12-07T21:13:44.406138+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:13:44.406138+0000","last_undegraded":"2023-12-07T21:13:44.406138+0000","last_fullsized":"2023-12-07T21:13:44.406138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:44.406055+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:44.406055+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.406055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:05:23.635609+0000","scrub_duration":0.001103677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:46.400680+0000","last_change":"2023-12-07T21:12:46.400680+0000","last_active":"2023-12-07T21:12:46.400680+0000","last_peered":"2023-12-07T21:12:46.400680+0000","last_clean":"2023-12-07T21:12:46.400680+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:12:46.400680+0000","last_undegraded":"2023-12-07T21:12:46.400680+0000","last_fullsized":"2023-12-07T21:12:46.400680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_clean_scrub_stamp":"2023-12-07T21:12:46.400562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:25.935064+0000","scrub_duration":0.001127915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:34.273474+0000","last_change":"2023-12-07T21:12:34.273474+0000","last_active":"2023-12-07T21:12:34.273474+0000","last_peered":"2023-12-07T21:12:34.273474+0000","last_clean":"2023-12-07T21:12:34.273474+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:12:34.273474+0000","last_undegraded":"2023-12-07T21:12:34.273474+0000","last_fullsized":"2023-12-07T21:12:34.273474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_clean_scrub_stamp":"2023-12-07T21:12:34.273360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:01:32.940162+0000","scrub_duration":0.0011278239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.451445+0000","last_change":"2023-12-07T21:12:52.451445+0000","last_active":"2023-12-07T21:12:52.451445+0000","last_peered":"2023-12-07T21:12:52.451445+0000","last_clean":"2023-12-07T21:12:52.451445+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:12:52.451445+0000","last_undegraded":"2023-12-07T21:12:52.451445+0000","last_fullsized":"2023-12-07T21:12:52.451445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.451316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:57.500148+0000","scrub_duration":0.001350272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.263073+0000","last_change":"2023-12-07T21:13:14.263073+0000","last_active":"2023-12-07T21:13:14.263073+0000","last_peered":"2023-12-07T21:13:14.263073+0000","last_clean":"2023-12-07T21:13:14.263073+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:13:14.263073+0000","last_undegraded":"2023-12-07T21:13:14.263073+0000","last_fullsized":"2023-12-07T21:13:14.263073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.262960+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:28.327063+0000","scrub_duration":0.0023679700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:16.262731+0000","last_change":"2023-12-07T21:13:16.262731+0000","last_active":"2023-12-07T21:13:16.262731+0000","last_peered":"2023-12-07T21:13:16.262731+0000","last_clean":"2023-12-07T21:13:16.262731+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:13:16.262731+0000","last_undegraded":"2023-12-07T21:13:16.262731+0000","last_fullsized":"2023-12-07T21:13:16.262731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_clean_scrub_stamp":"2023-12-07T21:13:16.262599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:56:19.678023+0000","scrub_duration":0.001231251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:40.827245+0000","last_change":"2023-12-07T21:12:40.827245+0000","last_active":"2023-12-07T21:12:40.827245+0000","last_peered":"2023-12-07T21:12:40.827245+0000","last_clean":"2023-12-07T21:12:40.827245+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:12:40.827245+0000","last_undegraded":"2023-12-07T21:12:40.827245+0000","last_fullsized":"2023-12-07T21:12:40.827245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_clean_scrub_stamp":"2023-12-07T21:12:40.827135+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:20.361638+0000","scrub_duration":0.0013685839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:31.449807+0000","last_change":"2023-12-07T21:13:31.449807+0000","last_active":"2023-12-07T21:13:31.449807+0000","last_peered":"2023-12-07T21:13:31.449807+0000","last_clean":"2023-12-07T21:13:31.449807+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:13:31.449807+0000","last_undegraded":"2023-12-07T21:13:31.449807+0000","last_fullsized":"2023-12-07T21:13:31.449807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:31.449683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:31.449683+0000","last_clean_scrub_stamp":"2023-12-07T21:13:31.449683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:54:42.768855+0000","scrub_duration":0.001302246,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:53.488138+0000","last_change":"2023-12-07T21:12:53.488138+0000","last_active":"2023-12-07T21:12:53.488138+0000","last_peered":"2023-12-07T21:12:53.488138+0000","last_clean":"2023-12-07T21:12:53.488138+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:12:53.488138+0000","last_undegraded":"2023-12-07T21:12:53.488138+0000","last_fullsized":"2023-12-07T21:12:53.488138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_clean_scrub_stamp":"2023-12-07T21:12:53.488022+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:20:06.706860+0000","scrub_duration":0.0010715880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.914123+0000","last_change":"2023-12-07T21:12:58.914123+0000","last_active":"2023-12-07T21:12:58.914123+0000","last_peered":"2023-12-07T21:12:58.914123+0000","last_clean":"2023-12-07T21:12:58.914123+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:12:58.914123+0000","last_undegraded":"2023-12-07T21:12:58.914123+0000","last_fullsized":"2023-12-07T21:12:58.914123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.913992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:18.497979+0000","scrub_duration":0.0013136269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.336936+0000","last_change":"2023-12-07T21:12:23.336936+0000","last_active":"2023-12-07T21:12:23.336936+0000","last_peered":"2023-12-07T21:12:23.336936+0000","last_clean":"2023-12-07T21:12:23.336936+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:12:23.336936+0000","last_undegraded":"2023-12-07T21:12:23.336936+0000","last_fullsized":"2023-12-07T21:12:23.336936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.336820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:54.775680+0000","scrub_duration":0.0015463409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:09.312912+0000","last_change":"2023-12-07T21:14:09.312936+0000","last_active":"2023-12-07T21:14:09.312912+0000","last_peered":"2023-12-07T21:14:09.312912+0000","last_clean":"2023-12-07T21:14:09.312912+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:14:09.312912+0000","last_undegraded":"2023-12-07T21:14:09.312912+0000","last_fullsized":"2023-12-07T21:14:09.312912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:09.312814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:09.312814+0000","last_clean_scrub_stamp":"2023-12-07T21:14:09.312814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:15.357851+0000","scrub_duration":0.001286113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'22","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.448678+0000","last_change":"2023-12-07T21:13:44.448678+0000","last_active":"2023-12-07T21:13:44.448678+0000","last_peered":"2023-12-07T21:13:44.448678+0000","last_clean":"2023-12-07T21:13:44.448678+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:13:44.448678+0000","last_undegraded":"2023-12-07T21:13:44.448678+0000","last_fullsized":"2023-12-07T21:13:44.448678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:13:44.448523+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:13:44.448523+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.448523+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:44:57.772201+0000","scrub_duration":0.0035836259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.461414+0000","last_change":"2023-12-07T21:12:20.461414+0000","last_active":"2023-12-07T21:12:20.461414+0000","last_peered":"2023-12-07T21:12:20.461414+0000","last_clean":"2023-12-07T21:12:20.461414+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:12:20.461414+0000","last_undegraded":"2023-12-07T21:12:20.461414+0000","last_fullsized":"2023-12-07T21:12:20.461414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.461275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:11:30.745289+0000","scrub_duration":0.0012528039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:23.380288+0000","last_change":"2023-12-07T21:14:23.380309+0000","last_active":"2023-12-07T21:14:23.380288+0000","last_peered":"2023-12-07T21:14:23.380288+0000","last_clean":"2023-12-07T21:14:23.380288+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:14:23.380288+0000","last_undegraded":"2023-12-07T21:14:23.380288+0000","last_fullsized":"2023-12-07T21:14:23.380288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:23.380196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:23.380196+0000","last_clean_scrub_stamp":"2023-12-07T21:14:23.380196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:43:39.407879+0000","scrub_duration":0.0011949759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":115,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813687+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:23.813687+0000","last_peered":"2023-12-07T21:11:23.813687+0000","last_clean":"2023-12-07T21:11:23.813687+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:23.813687+0000","last_undegraded":"2023-12-07T21:11:23.813687+0000","last_fullsized":"2023-12-07T21:11:23.813687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:03.666683+0000","last_change":"2023-12-07T21:13:03.666683+0000","last_active":"2023-12-07T21:13:03.666683+0000","last_peered":"2023-12-07T21:13:03.666683+0000","last_clean":"2023-12-07T21:13:03.666683+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:13:03.666683+0000","last_undegraded":"2023-12-07T21:13:03.666683+0000","last_fullsized":"2023-12-07T21:13:03.666683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_clean_scrub_stamp":"2023-12-07T21:13:03.666541+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:29:58.918173+0000","scrub_duration":0.0039456209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.345086+0000","last_change":"2023-12-07T21:12:18.345086+0000","last_active":"2023-12-07T21:12:18.345086+0000","last_peered":"2023-12-07T21:12:18.345086+0000","last_clean":"2023-12-07T21:12:18.345086+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:12:18.345086+0000","last_undegraded":"2023-12-07T21:12:18.345086+0000","last_fullsized":"2023-12-07T21:12:18.345086+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.344968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:53:47.984483+0000","scrub_duration":0.00095218699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:26.318843+0000","last_change":"2023-12-07T21:12:26.318843+0000","last_active":"2023-12-07T21:12:26.318843+0000","last_peered":"2023-12-07T21:12:26.318843+0000","last_clean":"2023-12-07T21:12:26.318843+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:12:26.318843+0000","last_undegraded":"2023-12-07T21:12:26.318843+0000","last_fullsized":"2023-12-07T21:12:26.318843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:26.318685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:21.073203+0000","scrub_duration":0.0010887360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.618014+0000","last_change":"2023-12-07T21:13:07.618014+0000","last_active":"2023-12-07T21:13:07.618014+0000","last_peered":"2023-12-07T21:13:07.618014+0000","last_clean":"2023-12-07T21:13:07.618014+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:13:07.618014+0000","last_undegraded":"2023-12-07T21:13:07.618014+0000","last_fullsized":"2023-12-07T21:13:07.618014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.617909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:13.457658+0000","scrub_duration":0.001206459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:46.387428+0000","last_change":"2023-12-07T21:13:46.387471+0000","last_active":"2023-12-07T21:13:46.387428+0000","last_peered":"2023-12-07T21:13:46.387428+0000","last_clean":"2023-12-07T21:13:46.387428+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:13:46.387428+0000","last_undegraded":"2023-12-07T21:13:46.387428+0000","last_fullsized":"2023-12-07T21:13:46.387428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:46.387320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:46.387320+0000","last_clean_scrub_stamp":"2023-12-07T21:13:46.387320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:00.451423+0000","scrub_duration":0.0012501120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.830085+0000","last_change":"2023-12-07T21:11:53.830085+0000","last_active":"2023-12-07T21:11:53.830085+0000","last_peered":"2023-12-07T21:11:53.830085+0000","last_clean":"2023-12-07T21:11:53.830085+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:53.830085+0000","last_undegraded":"2023-12-07T21:11:53.830085+0000","last_fullsized":"2023-12-07T21:11:53.830085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_clean_scrub_stamp":"2023-12-07T21:11:53.829969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:45.205269+0000","scrub_duration":0.001216066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814302+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:28.814302+0000","last_peered":"2023-12-07T21:11:28.814302+0000","last_clean":"2023-12-07T21:11:28.814302+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:28.814302+0000","last_undegraded":"2023-12-07T21:11:28.814302+0000","last_fullsized":"2023-12-07T21:11:28.814302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.304137+0000","last_change":"2023-12-07T21:11:42.304137+0000","last_active":"2023-12-07T21:11:42.304137+0000","last_peered":"2023-12-07T21:11:42.304137+0000","last_clean":"2023-12-07T21:11:42.304137+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:42.304137+0000","last_undegraded":"2023-12-07T21:11:42.304137+0000","last_fullsized":"2023-12-07T21:11:42.304137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.304031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:14.639583+0000","scrub_duration":0.0010594929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:31.746769+0000","last_change":"2023-12-07T21:12:31.746769+0000","last_active":"2023-12-07T21:12:31.746769+0000","last_peered":"2023-12-07T21:12:31.746769+0000","last_clean":"2023-12-07T21:12:31.746769+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:12:31.746769+0000","last_undegraded":"2023-12-07T21:12:31.746769+0000","last_fullsized":"2023-12-07T21:12:31.746769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_clean_scrub_stamp":"2023-12-07T21:12:31.746658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:02.942094+0000","scrub_duration":0.00135096,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.511164+0000","last_change":"2023-12-07T21:13:14.511164+0000","last_active":"2023-12-07T21:13:14.511164+0000","last_peered":"2023-12-07T21:13:14.511164+0000","last_clean":"2023-12-07T21:13:14.511164+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:13:14.511164+0000","last_undegraded":"2023-12-07T21:13:14.511164+0000","last_fullsized":"2023-12-07T21:13:14.511164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.511066+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:07.222427+0000","scrub_duration":0.0030400240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:53.612056+0000","last_change":"2023-12-07T21:14:53.612083+0000","last_active":"2023-12-07T21:14:53.612056+0000","last_peered":"2023-12-07T21:14:53.612056+0000","last_clean":"2023-12-07T21:14:53.612056+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:14:53.612056+0000","last_undegraded":"2023-12-07T21:14:53.612056+0000","last_fullsized":"2023-12-07T21:14:53.612056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:53.611960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:53.611960+0000","last_clean_scrub_stamp":"2023-12-07T21:14:53.611960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:31.141507+0000","scrub_duration":0.0011825869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.707102+0000","last_change":"2023-12-07T21:11:58.707102+0000","last_active":"2023-12-07T21:11:58.707102+0000","last_peered":"2023-12-07T21:11:58.707102+0000","last_clean":"2023-12-07T21:11:58.707102+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:58.707102+0000","last_undegraded":"2023-12-07T21:11:58.707102+0000","last_fullsized":"2023-12-07T21:11:58.707102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.706965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:56:05.594599+0000","scrub_duration":0.0011023249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.554062+0000","last_change":"2023-12-07T21:11:35.554062+0000","last_active":"2023-12-07T21:11:35.554062+0000","last_peered":"2023-12-07T21:11:35.554062+0000","last_clean":"2023-12-07T21:11:35.554062+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:35.554062+0000","last_undegraded":"2023-12-07T21:11:35.554062+0000","last_fullsized":"2023-12-07T21:11:35.554062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.553946+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:56.699897+0000","scrub_duration":0.0042775269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'247","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:50.595156+0000","last_change":"2023-12-07T21:12:50.595156+0000","last_active":"2023-12-07T21:12:50.595156+0000","last_peered":"2023-12-07T21:12:50.595156+0000","last_clean":"2023-12-07T21:12:50.595156+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:12:50.595156+0000","last_undegraded":"2023-12-07T21:12:50.595156+0000","last_fullsized":"2023-12-07T21:12:50.595156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_clean_scrub_stamp":"2023-12-07T21:12:50.595047+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:57:35.203698+0000","scrub_duration":0.0029719099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:10.459036+0000","last_change":"2023-12-07T21:14:10.459058+0000","last_active":"2023-12-07T21:14:10.459036+0000","last_peered":"2023-12-07T21:14:10.459036+0000","last_clean":"2023-12-07T21:14:10.459036+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:14:10.459036+0000","last_undegraded":"2023-12-07T21:14:10.459036+0000","last_fullsized":"2023-12-07T21:14:10.459036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:10.458940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:10.458940+0000","last_clean_scrub_stamp":"2023-12-07T21:14:10.458940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:42:58.903975+0000","scrub_duration":0.0010316520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.764650+0000","last_change":"2023-12-07T21:12:27.764650+0000","last_active":"2023-12-07T21:12:27.764650+0000","last_peered":"2023-12-07T21:12:27.764650+0000","last_clean":"2023-12-07T21:12:27.764650+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:12:27.764650+0000","last_undegraded":"2023-12-07T21:12:27.764650+0000","last_fullsized":"2023-12-07T21:12:27.764650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.764507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:17:01.731572+0000","scrub_duration":0.0015146649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.348644+0000","last_change":"2023-12-07T21:13:00.348644+0000","last_active":"2023-12-07T21:13:00.348644+0000","last_peered":"2023-12-07T21:13:00.348644+0000","last_clean":"2023-12-07T21:13:00.348644+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:13:00.348644+0000","last_undegraded":"2023-12-07T21:13:00.348644+0000","last_fullsized":"2023-12-07T21:13:00.348644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.348476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:10.632490+0000","scrub_duration":0.001405367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813847+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:23.813847+0000","last_peered":"2023-12-07T21:11:23.813847+0000","last_clean":"2023-12-07T21:11:23.813847+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:23.813847+0000","last_undegraded":"2023-12-07T21:11:23.813847+0000","last_fullsized":"2023-12-07T21:11:23.813847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:29.600086+0000","last_change":"2023-12-07T21:11:29.600086+0000","last_active":"2023-12-07T21:11:29.600086+0000","last_peered":"2023-12-07T21:11:29.600086+0000","last_clean":"2023-12-07T21:11:29.600086+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:29.600086+0000","last_undegraded":"2023-12-07T21:11:29.600086+0000","last_fullsized":"2023-12-07T21:11:29.600086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_clean_scrub_stamp":"2023-12-07T21:11:29.599963+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:30:03.772118+0000","scrub_duration":0.003554771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'247","reported_seq":341,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:02.790465+0000","last_change":"2023-12-07T21:12:02.790465+0000","last_active":"2023-12-07T21:12:02.790465+0000","last_peered":"2023-12-07T21:12:02.790465+0000","last_clean":"2023-12-07T21:12:02.790465+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:12:02.790465+0000","last_undegraded":"2023-12-07T21:12:02.790465+0000","last_fullsized":"2023-12-07T21:12:02.790465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_clean_scrub_stamp":"2023-12-07T21:12:02.790346+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:07.839178+0000","scrub_duration":0.0026089529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:51.249565+0000","last_change":"2023-12-07T21:13:51.249634+0000","last_active":"2023-12-07T21:13:51.249565+0000","last_peered":"2023-12-07T21:13:51.249565+0000","last_clean":"2023-12-07T21:13:51.249565+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:13:51.249565+0000","last_undegraded":"2023-12-07T21:13:51.249565+0000","last_fullsized":"2023-12-07T21:13:51.249565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:51.249439+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:51.249439+0000","last_clean_scrub_stamp":"2023-12-07T21:13:51.249439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:43.146224+0000","scrub_duration":0.001108798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.293568+0000","last_change":"2023-12-07T21:13:36.293592+0000","last_active":"2023-12-07T21:13:36.293568+0000","last_peered":"2023-12-07T21:13:36.293568+0000","last_clean":"2023-12-07T21:13:36.293568+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:13:36.293568+0000","last_undegraded":"2023-12-07T21:13:36.293568+0000","last_fullsized":"2023-12-07T21:13:36.293568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:36.293469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:36.293469+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.293469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:55.877457+0000","scrub_duration":0.0012759609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.443153+0000","last_change":"2023-12-07T21:11:56.443153+0000","last_active":"2023-12-07T21:11:56.443153+0000","last_peered":"2023-12-07T21:11:56.443153+0000","last_clean":"2023-12-07T21:11:56.443153+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:56.443153+0000","last_undegraded":"2023-12-07T21:11:56.443153+0000","last_fullsized":"2023-12-07T21:11:56.443153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.443045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:05.069384+0000","scrub_duration":0.0010685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.606842+0000","last_change":"2023-12-07T21:11:39.606842+0000","last_active":"2023-12-07T21:11:39.606842+0000","last_peered":"2023-12-07T21:11:39.606842+0000","last_clean":"2023-12-07T21:11:39.606842+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:39.606842+0000","last_undegraded":"2023-12-07T21:11:39.606842+0000","last_fullsized":"2023-12-07T21:11:39.606842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.606684+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:36.950556+0000","scrub_duration":0.0069737849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:34.781711+0000","last_change":"2023-12-07T21:11:34.781711+0000","last_active":"2023-12-07T21:11:34.781711+0000","last_peered":"2023-12-07T21:11:34.781711+0000","last_clean":"2023-12-07T21:11:34.781711+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:34.781711+0000","last_undegraded":"2023-12-07T21:11:34.781711+0000","last_fullsized":"2023-12-07T21:11:34.781711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:34.781604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:44.478780+0000","scrub_duration":0.001255822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.468162+0000","last_change":"2023-12-07T21:14:02.468187+0000","last_active":"2023-12-07T21:14:02.468162+0000","last_peered":"2023-12-07T21:14:02.468162+0000","last_clean":"2023-12-07T21:14:02.468162+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:14:02.468162+0000","last_undegraded":"2023-12-07T21:14:02.468162+0000","last_fullsized":"2023-12-07T21:14:02.468162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2023-12-07T21:14:02.468073+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2023-12-07T21:14:02.468073+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.468073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:15.400853+0000","scrub_duration":0.001158437,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'22","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.326862+0000","last_change":"2023-12-07T21:12:36.326862+0000","last_active":"2023-12-07T21:12:36.326862+0000","last_peered":"2023-12-07T21:12:36.326862+0000","last_clean":"2023-12-07T21:12:36.326862+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:12:36.326862+0000","last_undegraded":"2023-12-07T21:12:36.326862+0000","last_fullsized":"2023-12-07T21:12:36.326862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.326694+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:24:30.282151+0000","scrub_duration":0.0028268410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.338776+0000","last_change":"2023-12-07T21:13:06.338776+0000","last_active":"2023-12-07T21:13:06.338776+0000","last_peered":"2023-12-07T21:13:06.338776+0000","last_clean":"2023-12-07T21:13:06.338776+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:13:06.338776+0000","last_undegraded":"2023-12-07T21:13:06.338776+0000","last_fullsized":"2023-12-07T21:13:06.338776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.338641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:59:17.495976+0000","scrub_duration":0.001242176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:07.717459+0000","last_change":"2023-12-07T21:12:07.717459+0000","last_active":"2023-12-07T21:12:07.717459+0000","last_peered":"2023-12-07T21:12:07.717459+0000","last_clean":"2023-12-07T21:12:07.717459+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:12:07.717459+0000","last_undegraded":"2023-12-07T21:12:07.717459+0000","last_fullsized":"2023-12-07T21:12:07.717459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_clean_scrub_stamp":"2023-12-07T21:12:07.717342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:32.009926+0000","scrub_duration":0.0014039289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:09.439747+0000","last_change":"2023-12-07T21:12:09.439747+0000","last_active":"2023-12-07T21:12:09.439747+0000","last_peered":"2023-12-07T21:12:09.439747+0000","last_clean":"2023-12-07T21:12:09.439747+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:12:09.439747+0000","last_undegraded":"2023-12-07T21:12:09.439747+0000","last_fullsized":"2023-12-07T21:12:09.439747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_clean_scrub_stamp":"2023-12-07T21:12:09.439641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:19.195035+0000","scrub_duration":0.0043223589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.735466+0000","last_change":"2023-12-07T21:11:33.735466+0000","last_active":"2023-12-07T21:11:33.735466+0000","last_peered":"2023-12-07T21:11:33.735466+0000","last_clean":"2023-12-07T21:11:33.735466+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:33.735466+0000","last_undegraded":"2023-12-07T21:11:33.735466+0000","last_fullsized":"2023-12-07T21:11:33.735466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.735352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:03.972116+0000","scrub_duration":0.0011441929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:55.388916+0000","last_change":"2023-12-07T21:13:55.388945+0000","last_active":"2023-12-07T21:13:55.388916+0000","last_peered":"2023-12-07T21:13:55.388916+0000","last_clean":"2023-12-07T21:13:55.388916+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:13:55.388916+0000","last_undegraded":"2023-12-07T21:13:55.388916+0000","last_fullsized":"2023-12-07T21:13:55.388916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:55.388828+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:55.388828+0000","last_clean_scrub_stamp":"2023-12-07T21:13:55.388828+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:43:17.552727+0000","scrub_duration":0.0021899129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.429281+0000","last_change":"2023-12-07T21:12:36.429281+0000","last_active":"2023-12-07T21:12:36.429281+0000","last_peered":"2023-12-07T21:12:36.429281+0000","last_clean":"2023-12-07T21:12:36.429281+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:12:36.429281+0000","last_undegraded":"2023-12-07T21:12:36.429281+0000","last_fullsized":"2023-12-07T21:12:36.429281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.429148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:19.936617+0000","scrub_duration":0.001111988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.297715+0000","last_change":"2023-12-07T21:13:52.297739+0000","last_active":"2023-12-07T21:13:52.297715+0000","last_peered":"2023-12-07T21:13:52.297715+0000","last_clean":"2023-12-07T21:13:52.297715+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:13:52.297715+0000","last_undegraded":"2023-12-07T21:13:52.297715+0000","last_fullsized":"2023-12-07T21:13:52.297715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:52.297625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:52.297625+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.297625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:57:04.497787+0000","scrub_duration":0.0012997989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.810375+0000","last_change":"2023-12-07T21:12:15.810375+0000","last_active":"2023-12-07T21:12:15.810375+0000","last_peered":"2023-12-07T21:12:15.810375+0000","last_clean":"2023-12-07T21:12:15.810375+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:12:15.810375+0000","last_undegraded":"2023-12-07T21:12:15.810375+0000","last_fullsized":"2023-12-07T21:12:15.810375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.810269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:33.566530+0000","scrub_duration":0.0014408579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.522112+0000","last_change":"2023-12-07T21:11:50.522112+0000","last_active":"2023-12-07T21:11:50.522112+0000","last_peered":"2023-12-07T21:11:50.522112+0000","last_clean":"2023-12-07T21:11:50.522112+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:50.522112+0000","last_undegraded":"2023-12-07T21:11:50.522112+0000","last_fullsized":"2023-12-07T21:11:50.522112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.521955+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:04.827943+0000","scrub_duration":0.0073561030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":308,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.761887+0000","last_change":"2023-12-07T21:11:35.761887+0000","last_active":"2023-12-07T21:11:35.761887+0000","last_peered":"2023-12-07T21:11:35.761887+0000","last_clean":"2023-12-07T21:11:35.761887+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:35.761887+0000","last_undegraded":"2023-12-07T21:11:35.761887+0000","last_fullsized":"2023-12-07T21:11:35.761887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.761766+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:14.383149+0000","scrub_duration":0.0016151640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:10.903257+0000","last_change":"2023-12-07T21:14:10.903279+0000","last_active":"2023-12-07T21:14:10.903257+0000","last_peered":"2023-12-07T21:14:10.903257+0000","last_clean":"2023-12-07T21:14:10.903257+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:14:10.903257+0000","last_undegraded":"2023-12-07T21:14:10.903257+0000","last_fullsized":"2023-12-07T21:14:10.903257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:14:10.903156+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:14:10.903156+0000","last_clean_scrub_stamp":"2023-12-07T21:14:10.903156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:37.591921+0000","scrub_duration":0.001103047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:55.462356+0000","last_change":"2023-12-07T21:12:55.462356+0000","last_active":"2023-12-07T21:12:55.462356+0000","last_peered":"2023-12-07T21:12:55.462356+0000","last_clean":"2023-12-07T21:12:55.462356+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:12:55.462356+0000","last_undegraded":"2023-12-07T21:12:55.462356+0000","last_fullsized":"2023-12-07T21:12:55.462356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_clean_scrub_stamp":"2023-12-07T21:12:55.462251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:57:45.150167+0000","scrub_duration":0.0012320580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:07.335753+0000","last_change":"2023-12-07T21:14:07.335776+0000","last_active":"2023-12-07T21:14:07.335753+0000","last_peered":"2023-12-07T21:14:07.335753+0000","last_clean":"2023-12-07T21:14:07.335753+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:14:07.335753+0000","last_undegraded":"2023-12-07T21:14:07.335753+0000","last_fullsized":"2023-12-07T21:14:07.335753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:07.335666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:07.335666+0000","last_clean_scrub_stamp":"2023-12-07T21:14:07.335666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:32:21.017600+0000","scrub_duration":0.0011737270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.753724+0000","last_change":"2023-12-07T21:11:55.753724+0000","last_active":"2023-12-07T21:11:55.753724+0000","last_peered":"2023-12-07T21:11:55.753724+0000","last_clean":"2023-12-07T21:11:55.753724+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:55.753724+0000","last_undegraded":"2023-12-07T21:11:55.753724+0000","last_fullsized":"2023-12-07T21:11:55.753724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.753576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:53:37.572475+0000","scrub_duration":0.0013913199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:31.726564+0000","last_change":"2023-12-07T21:11:31.726564+0000","last_active":"2023-12-07T21:11:31.726564+0000","last_peered":"2023-12-07T21:11:31.726564+0000","last_clean":"2023-12-07T21:11:31.726564+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:31.726564+0000","last_undegraded":"2023-12-07T21:11:31.726564+0000","last_fullsized":"2023-12-07T21:11:31.726564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:31.726451+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:36.775283+0000","scrub_duration":0.0038601009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.752564+0000","last_change":"2023-12-07T21:11:56.752564+0000","last_active":"2023-12-07T21:11:56.752564+0000","last_peered":"2023-12-07T21:11:56.752564+0000","last_clean":"2023-12-07T21:11:56.752564+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:56.752564+0000","last_undegraded":"2023-12-07T21:11:56.752564+0000","last_fullsized":"2023-12-07T21:11:56.752564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.752450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:44.261937+0000","scrub_duration":0.0012919610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'6","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:07.983141+0000","last_change":"2023-12-07T21:14:07.983170+0000","last_active":"2023-12-07T21:14:07.983141+0000","last_peered":"2023-12-07T21:14:07.983141+0000","last_clean":"2023-12-07T21:14:07.983141+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:14:07.983141+0000","last_undegraded":"2023-12-07T21:14:07.983141+0000","last_fullsized":"2023-12-07T21:14:07.983141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:14:07.983055+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:14:07.983055+0000","last_clean_scrub_stamp":"2023-12-07T21:14:07.983055+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:09:22.412930+0000","scrub_duration":0.0032971929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:17.483370+0000","last_change":"2023-12-07T21:14:17.483392+0000","last_active":"2023-12-07T21:14:17.483370+0000","last_peered":"2023-12-07T21:14:17.483370+0000","last_clean":"2023-12-07T21:14:17.483370+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:14:17.483370+0000","last_undegraded":"2023-12-07T21:14:17.483370+0000","last_fullsized":"2023-12-07T21:14:17.483370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:17.483282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:17.483282+0000","last_clean_scrub_stamp":"2023-12-07T21:14:17.483282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:28:01.766599+0000","scrub_duration":0.001092197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:58.953267+0000","last_change":"2023-12-07T21:13:58.953288+0000","last_active":"2023-12-07T21:13:58.953267+0000","last_peered":"2023-12-07T21:13:58.953267+0000","last_clean":"2023-12-07T21:13:58.953267+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:13:58.953267+0000","last_undegraded":"2023-12-07T21:13:58.953267+0000","last_fullsized":"2023-12-07T21:13:58.953267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:58.953174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:58.953174+0000","last_clean_scrub_stamp":"2023-12-07T21:13:58.953174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:58.135287+0000","scrub_duration":0.0012512140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.578121+0000","last_change":"2023-12-07T21:12:12.578121+0000","last_active":"2023-12-07T21:12:12.578121+0000","last_peered":"2023-12-07T21:12:12.578121+0000","last_clean":"2023-12-07T21:12:12.578121+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:12:12.578121+0000","last_undegraded":"2023-12-07T21:12:12.578121+0000","last_fullsized":"2023-12-07T21:12:12.578121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.578001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:21:04.951547+0000","scrub_duration":0.0009980639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.222572+0000","last_change":"2023-12-07T21:11:32.222572+0000","last_active":"2023-12-07T21:11:32.222572+0000","last_peered":"2023-12-07T21:11:32.222572+0000","last_clean":"2023-12-07T21:11:32.222572+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:32.222572+0000","last_undegraded":"2023-12-07T21:11:32.222572+0000","last_fullsized":"2023-12-07T21:11:32.222572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.222451+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:29.566323+0000","scrub_duration":0.0042948600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:25.579998+0000","last_change":"2023-12-07T21:13:25.579998+0000","last_active":"2023-12-07T21:13:25.579998+0000","last_peered":"2023-12-07T21:13:25.579998+0000","last_clean":"2023-12-07T21:13:25.579998+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:13:25.579998+0000","last_undegraded":"2023-12-07T21:13:25.579998+0000","last_fullsized":"2023-12-07T21:13:25.579998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_clean_scrub_stamp":"2023-12-07T21:13:25.579880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:22:49.341694+0000","scrub_duration":0.001424259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.608819+0000","last_change":"2023-12-07T21:09:04.928668+0000","last_active":"2023-12-07T21:11:10.608819+0000","last_peered":"2023-12-07T21:11:10.608819+0000","last_clean":"2023-12-07T21:11:10.608819+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:11:10.608819+0000","last_undegraded":"2023-12-07T21:11:10.608819+0000","last_fullsized":"2023-12-07T21:11:10.608819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:18.499430+0000","last_change":"2023-12-07T21:14:18.499472+0000","last_active":"2023-12-07T21:14:18.499430+0000","last_peered":"2023-12-07T21:14:18.499430+0000","last_clean":"2023-12-07T21:14:18.499430+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:14:18.499430+0000","last_undegraded":"2023-12-07T21:14:18.499430+0000","last_fullsized":"2023-12-07T21:14:18.499430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:14:18.499337+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:14:18.499337+0000","last_clean_scrub_stamp":"2023-12-07T21:14:18.499337+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:40:45.976981+0000","scrub_duration":0.0011107020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:04.345887+0000","last_change":"2023-12-07T21:14:04.345941+0000","last_active":"2023-12-07T21:14:04.345887+0000","last_peered":"2023-12-07T21:14:04.345887+0000","last_clean":"2023-12-07T21:14:04.345887+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:14:04.345887+0000","last_undegraded":"2023-12-07T21:14:04.345887+0000","last_fullsized":"2023-12-07T21:14:04.345887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:04.345774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:04.345774+0000","last_clean_scrub_stamp":"2023-12-07T21:14:04.345774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:45.945110+0000","scrub_duration":0.0013151079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:54.784564+0000","last_change":"2023-12-07T21:11:54.784564+0000","last_active":"2023-12-07T21:11:54.784564+0000","last_peered":"2023-12-07T21:11:54.784564+0000","last_clean":"2023-12-07T21:11:54.784564+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:54.784564+0000","last_undegraded":"2023-12-07T21:11:54.784564+0000","last_fullsized":"2023-12-07T21:11:54.784564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_clean_scrub_stamp":"2023-12-07T21:11:54.784441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:06.366596+0000","scrub_duration":0.001044002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.576788+0000","last_change":"2023-12-07T21:11:38.576788+0000","last_active":"2023-12-07T21:11:38.576788+0000","last_peered":"2023-12-07T21:11:38.576788+0000","last_clean":"2023-12-07T21:11:38.576788+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:38.576788+0000","last_undegraded":"2023-12-07T21:11:38.576788+0000","last_fullsized":"2023-12-07T21:11:38.576788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.576637+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:37:48.632379+0000","scrub_duration":0.0068514220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":337,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625046+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625046+0000","last_peered":"2023-12-07T21:11:28.625046+0000","last_clean":"2023-12-07T21:11:28.625046+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625046+0000","last_undegraded":"2023-12-07T21:11:28.625046+0000","last_fullsized":"2023-12-07T21:11:28.625046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.858711+0000","last_change":"2023-12-07T21:12:16.858711+0000","last_active":"2023-12-07T21:12:16.858711+0000","last_peered":"2023-12-07T21:12:16.858711+0000","last_clean":"2023-12-07T21:12:16.858711+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:12:16.858711+0000","last_undegraded":"2023-12-07T21:12:16.858711+0000","last_fullsized":"2023-12-07T21:12:16.858711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.858602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:29:51.847246+0000","scrub_duration":0.0011473449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.447750+0000","last_change":"2023-12-07T21:13:23.447750+0000","last_active":"2023-12-07T21:13:23.447750+0000","last_peered":"2023-12-07T21:13:23.447750+0000","last_clean":"2023-12-07T21:13:23.447750+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:13:23.447750+0000","last_undegraded":"2023-12-07T21:13:23.447750+0000","last_fullsized":"2023-12-07T21:13:23.447750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.447646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:28:02.982148+0000","scrub_duration":0.0010737139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:03.361960+0000","last_change":"2023-12-07T21:14:03.361984+0000","last_active":"2023-12-07T21:14:03.361960+0000","last_peered":"2023-12-07T21:14:03.361960+0000","last_clean":"2023-12-07T21:14:03.361960+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:14:03.361960+0000","last_undegraded":"2023-12-07T21:14:03.361960+0000","last_fullsized":"2023-12-07T21:14:03.361960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:14:03.361875+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:14:03.361875+0000","last_clean_scrub_stamp":"2023-12-07T21:14:03.361875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:49.744783+0000","scrub_duration":0.0013072349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.296697+0000","last_change":"2023-12-07T21:11:38.296697+0000","last_active":"2023-12-07T21:11:38.296697+0000","last_peered":"2023-12-07T21:11:38.296697+0000","last_clean":"2023-12-07T21:11:38.296697+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:38.296697+0000","last_undegraded":"2023-12-07T21:11:38.296697+0000","last_fullsized":"2023-12-07T21:11:38.296697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.296568+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:08.533333+0000","scrub_duration":0.0033144630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.654323+0000","last_change":"2023-12-07T21:13:04.654323+0000","last_active":"2023-12-07T21:13:04.654323+0000","last_peered":"2023-12-07T21:13:04.654323+0000","last_clean":"2023-12-07T21:13:04.654323+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:13:04.654323+0000","last_undegraded":"2023-12-07T21:13:04.654323+0000","last_fullsized":"2023-12-07T21:13:04.654323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.654200+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:02:30.647135+0000","scrub_duration":0.0041448730000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'247","reported_seq":373,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:47.359735+0000","last_change":"2023-12-07T21:11:47.359735+0000","last_active":"2023-12-07T21:11:47.359735+0000","last_peered":"2023-12-07T21:11:47.359735+0000","last_clean":"2023-12-07T21:11:47.359735+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:47.359735+0000","last_undegraded":"2023-12-07T21:11:47.359735+0000","last_fullsized":"2023-12-07T21:11:47.359735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_clean_scrub_stamp":"2023-12-07T21:11:47.359610+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:10.050726+0000","scrub_duration":0.0028663759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.579785+0000","last_change":"2023-12-07T21:12:14.579785+0000","last_active":"2023-12-07T21:12:14.579785+0000","last_peered":"2023-12-07T21:12:14.579785+0000","last_clean":"2023-12-07T21:12:14.579785+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:12:14.579785+0000","last_undegraded":"2023-12-07T21:12:14.579785+0000","last_fullsized":"2023-12-07T21:12:14.579785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.579627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:44.957962+0000","scrub_duration":0.0013656510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.375184+0000","last_change":"2023-12-07T21:12:17.375184+0000","last_active":"2023-12-07T21:12:17.375184+0000","last_peered":"2023-12-07T21:12:17.375184+0000","last_clean":"2023-12-07T21:12:17.375184+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:12:17.375184+0000","last_undegraded":"2023-12-07T21:12:17.375184+0000","last_fullsized":"2023-12-07T21:12:17.375184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.375067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:21:31.008297+0000","scrub_duration":0.001068486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:56.280215+0000","last_change":"2023-12-07T21:13:56.280253+0000","last_active":"2023-12-07T21:13:56.280215+0000","last_peered":"2023-12-07T21:13:56.280215+0000","last_clean":"2023-12-07T21:13:56.280215+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:13:56.280215+0000","last_undegraded":"2023-12-07T21:13:56.280215+0000","last_fullsized":"2023-12-07T21:13:56.280215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:56.280106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:56.280106+0000","last_clean_scrub_stamp":"2023-12-07T21:13:56.280106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:21.512744+0000","scrub_duration":0.001246306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.847914+0000","last_change":"2023-12-07T21:11:28.847914+0000","last_active":"2023-12-07T21:11:28.847914+0000","last_peered":"2023-12-07T21:11:28.847914+0000","last_clean":"2023-12-07T21:11:28.847914+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:28.847914+0000","last_undegraded":"2023-12-07T21:11:28.847914+0000","last_fullsized":"2023-12-07T21:11:28.847914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.847797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:20:42.481026+0000","scrub_duration":0.001132973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262786+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262786+0000","last_peered":"2023-12-07T21:11:27.262786+0000","last_clean":"2023-12-07T21:11:27.262786+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262786+0000","last_undegraded":"2023-12-07T21:11:27.262786+0000","last_fullsized":"2023-12-07T21:11:27.262786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811401+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:18.811401+0000","last_peered":"2023-12-07T21:11:18.811401+0000","last_clean":"2023-12-07T21:11:18.811401+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:18.811401+0000","last_undegraded":"2023-12-07T21:11:18.811401+0000","last_fullsized":"2023-12-07T21:11:18.811401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:42.422577+0000","last_change":"2023-12-07T21:13:42.422626+0000","last_active":"2023-12-07T21:13:42.422577+0000","last_peered":"2023-12-07T21:13:42.422577+0000","last_clean":"2023-12-07T21:13:42.422577+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:13:42.422577+0000","last_undegraded":"2023-12-07T21:13:42.422577+0000","last_fullsized":"2023-12-07T21:13:42.422577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:42.422461+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:42.422461+0000","last_clean_scrub_stamp":"2023-12-07T21:13:42.422461+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:15.762102+0000","scrub_duration":0.0036148259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:08.448223+0000","last_change":"2023-12-07T21:12:08.448223+0000","last_active":"2023-12-07T21:12:08.448223+0000","last_peered":"2023-12-07T21:12:08.448223+0000","last_clean":"2023-12-07T21:12:08.448223+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:12:08.448223+0000","last_undegraded":"2023-12-07T21:12:08.448223+0000","last_fullsized":"2023-12-07T21:12:08.448223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_clean_scrub_stamp":"2023-12-07T21:12:08.448115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:53:48.563995+0000","scrub_duration":0.001037821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:18.321375+0000","last_change":"2023-12-07T21:13:18.321375+0000","last_active":"2023-12-07T21:13:18.321375+0000","last_peered":"2023-12-07T21:13:18.321375+0000","last_clean":"2023-12-07T21:13:18.321375+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:13:18.321375+0000","last_undegraded":"2023-12-07T21:13:18.321375+0000","last_fullsized":"2023-12-07T21:13:18.321375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_clean_scrub_stamp":"2023-12-07T21:13:18.321258+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:57.708960+0000","scrub_duration":0.0041701730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:48.538088+0000","last_change":"2023-12-07T21:14:48.538110+0000","last_active":"2023-12-07T21:14:48.538088+0000","last_peered":"2023-12-07T21:14:48.538088+0000","last_clean":"2023-12-07T21:14:48.538088+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:14:48.538088+0000","last_undegraded":"2023-12-07T21:14:48.538088+0000","last_fullsized":"2023-12-07T21:14:48.538088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:48.537996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:48.537996+0000","last_clean_scrub_stamp":"2023-12-07T21:14:48.537996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:02:00.773606+0000","scrub_duration":0.001115773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:22.413684+0000","last_change":"2023-12-07T21:14:22.413706+0000","last_active":"2023-12-07T21:14:22.413684+0000","last_peered":"2023-12-07T21:14:22.413684+0000","last_clean":"2023-12-07T21:14:22.413684+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:14:22.413684+0000","last_undegraded":"2023-12-07T21:14:22.413684+0000","last_fullsized":"2023-12-07T21:14:22.413684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:22.413596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:22.413596+0000","last_clean_scrub_stamp":"2023-12-07T21:14:22.413596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:58:45.461092+0000","scrub_duration":0.0012623840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.324752+0000","last_change":"2023-12-07T21:11:45.324752+0000","last_active":"2023-12-07T21:11:45.324752+0000","last_peered":"2023-12-07T21:11:45.324752+0000","last_clean":"2023-12-07T21:11:45.324752+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:11:45.324752+0000","last_undegraded":"2023-12-07T21:11:45.324752+0000","last_fullsized":"2023-12-07T21:11:45.324752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.324596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:15.702930+0000","scrub_duration":0.001375037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'84","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.623237+0000","last_change":"2023-12-07T21:12:52.623237+0000","last_active":"2023-12-07T21:12:52.623237+0000","last_peered":"2023-12-07T21:12:52.623237+0000","last_clean":"2023-12-07T21:12:52.623237+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:12:52.623237+0000","last_undegraded":"2023-12-07T21:12:52.623237+0000","last_fullsized":"2023-12-07T21:12:52.623237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'84","last_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_deep_scrub":"33'84","last_deep_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.623072+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:11.772666+0000","scrub_duration":0.0042302950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.743712+0000","last_change":"2023-12-07T21:11:42.743712+0000","last_active":"2023-12-07T21:11:42.743712+0000","last_peered":"2023-12-07T21:11:42.743712+0000","last_clean":"2023-12-07T21:11:42.743712+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:42.743712+0000","last_undegraded":"2023-12-07T21:11:42.743712+0000","last_fullsized":"2023-12-07T21:11:42.743712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.743604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:58.016229+0000","scrub_duration":0.001386167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.433682+0000","last_change":"2023-12-07T21:11:58.433682+0000","last_active":"2023-12-07T21:11:58.433682+0000","last_peered":"2023-12-07T21:11:58.433682+0000","last_clean":"2023-12-07T21:11:58.433682+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:58.433682+0000","last_undegraded":"2023-12-07T21:11:58.433682+0000","last_fullsized":"2023-12-07T21:11:58.433682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.433567+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:08.130743+0000","scrub_duration":0.0014101739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:37.409865+0000","last_change":"2023-12-07T21:13:37.409909+0000","last_active":"2023-12-07T21:13:37.409865+0000","last_peered":"2023-12-07T21:13:37.409865+0000","last_clean":"2023-12-07T21:13:37.409865+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:13:37.409865+0000","last_undegraded":"2023-12-07T21:13:37.409865+0000","last_fullsized":"2023-12-07T21:13:37.409865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:37.409759+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:37.409759+0000","last_clean_scrub_stamp":"2023-12-07T21:13:37.409759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:10.604294+0000","scrub_duration":0.001212444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:40.384110+0000","last_change":"2023-12-07T21:14:40.384110+0000","last_active":"2023-12-07T21:14:40.384110+0000","last_peered":"2023-12-07T21:14:40.384110+0000","last_clean":"2023-12-07T21:14:40.384110+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:14:40.384110+0000","last_undegraded":"2023-12-07T21:14:40.384110+0000","last_fullsized":"2023-12-07T21:14:40.384110+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:40.383987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:40.383987+0000","last_clean_scrub_stamp":"2023-12-07T21:14:40.383987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:31:30.920713+0000","scrub_duration":0.0014216789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.966870+0000","last_change":"2023-12-07T21:13:54.966898+0000","last_active":"2023-12-07T21:13:54.966870+0000","last_peered":"2023-12-07T21:13:54.966870+0000","last_clean":"2023-12-07T21:13:54.966870+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:13:54.966870+0000","last_undegraded":"2023-12-07T21:13:54.966870+0000","last_fullsized":"2023-12-07T21:13:54.966870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:54.966763+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:54.966763+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.966763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:07.675533+0000","scrub_duration":0.0013427319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.687480+0000","last_change":"2023-12-07T21:11:32.687480+0000","last_active":"2023-12-07T21:11:32.687480+0000","last_peered":"2023-12-07T21:11:32.687480+0000","last_clean":"2023-12-07T21:11:32.687480+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:32.687480+0000","last_undegraded":"2023-12-07T21:11:32.687480+0000","last_fullsized":"2023-12-07T21:11:32.687480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.687375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:18:45.906213+0000","scrub_duration":0.001283024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":451,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148420+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148420+0000","last_peered":"2023-12-07T21:11:18.148420+0000","last_clean":"2023-12-07T21:11:18.148420+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148420+0000","last_undegraded":"2023-12-07T21:11:18.148420+0000","last_fullsized":"2023-12-07T21:11:18.148420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:25.481161+0000","last_change":"2023-12-07T21:12:25.481161+0000","last_active":"2023-12-07T21:12:25.481161+0000","last_peered":"2023-12-07T21:12:25.481161+0000","last_clean":"2023-12-07T21:12:25.481161+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:12:25.481161+0000","last_undegraded":"2023-12-07T21:12:25.481161+0000","last_fullsized":"2023-12-07T21:12:25.481161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_clean_scrub_stamp":"2023-12-07T21:12:25.481005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:33:44.071058+0000","scrub_duration":0.001267064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.375053+0000","last_change":"2023-12-07T21:13:54.375076+0000","last_active":"2023-12-07T21:13:54.375053+0000","last_peered":"2023-12-07T21:13:54.375053+0000","last_clean":"2023-12-07T21:13:54.375053+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:13:54.375053+0000","last_undegraded":"2023-12-07T21:13:54.375053+0000","last_fullsized":"2023-12-07T21:13:54.375053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:13:54.374958+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:13:54.374958+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.374958+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:07.083727+0000","scrub_duration":0.0012241019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.103368+0000","last_change":"2023-12-07T21:13:27.103392+0000","last_active":"2023-12-07T21:13:27.103368+0000","last_peered":"2023-12-07T21:13:27.103368+0000","last_clean":"2023-12-07T21:13:27.103368+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:13:27.103368+0000","last_undegraded":"2023-12-07T21:13:27.103368+0000","last_fullsized":"2023-12-07T21:13:27.103368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:04.121495+0000","scrub_duration":0.0012535599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:33.338278+0000","last_change":"2023-12-07T21:13:33.338298+0000","last_active":"2023-12-07T21:13:33.338278+0000","last_peered":"2023-12-07T21:13:33.338278+0000","last_clean":"2023-12-07T21:13:33.338278+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:13:33.338278+0000","last_undegraded":"2023-12-07T21:13:33.338278+0000","last_fullsized":"2023-12-07T21:13:33.338278+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:33.338194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:33.338194+0000","last_clean_scrub_stamp":"2023-12-07T21:13:33.338194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:43.622208+0000","scrub_duration":0.001353496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:37.050040+0000","last_change":"2023-12-07T21:13:37.050079+0000","last_active":"2023-12-07T21:13:37.050040+0000","last_peered":"2023-12-07T21:13:37.050040+0000","last_clean":"2023-12-07T21:13:37.050040+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:13:37.050040+0000","last_undegraded":"2023-12-07T21:13:37.050040+0000","last_fullsized":"2023-12-07T21:13:37.050040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:37.049937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:37.049937+0000","last_clean_scrub_stamp":"2023-12-07T21:13:37.049937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:03:03.042871+0000","scrub_duration":0.0012947099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.627991+0000","last_change":"2023-12-07T21:12:15.627991+0000","last_active":"2023-12-07T21:12:15.627991+0000","last_peered":"2023-12-07T21:12:15.627991+0000","last_clean":"2023-12-07T21:12:15.627991+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:12:15.627991+0000","last_undegraded":"2023-12-07T21:12:15.627991+0000","last_fullsized":"2023-12-07T21:12:15.627991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.627865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:38.318981+0000","scrub_duration":0.0028926030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'25","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:46.537922+0000","last_change":"2023-12-07T21:11:46.537922+0000","last_active":"2023-12-07T21:11:46.537922+0000","last_peered":"2023-12-07T21:11:46.537922+0000","last_clean":"2023-12-07T21:11:46.537922+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:46.537922+0000","last_undegraded":"2023-12-07T21:11:46.537922+0000","last_fullsized":"2023-12-07T21:11:46.537922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_clean_scrub_stamp":"2023-12-07T21:11:46.537795+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:57.338431+0000","scrub_duration":0.0057357379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642698+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642698+0000","last_peered":"2023-12-07T21:11:12.642698+0000","last_clean":"2023-12-07T21:11:12.642698+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642698+0000","last_undegraded":"2023-12-07T21:11:12.642698+0000","last_fullsized":"2023-12-07T21:11:12.642698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813540+0000","last_change":"2023-12-07T21:09:04.930856+0000","last_active":"2023-12-07T21:11:23.813540+0000","last_peered":"2023-12-07T21:11:23.813540+0000","last_clean":"2023-12-07T21:11:23.813540+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:11:23.813540+0000","last_undegraded":"2023-12-07T21:11:23.813540+0000","last_fullsized":"2023-12-07T21:11:23.813540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.097020+0000","last_change":"2023-12-07T21:13:20.097065+0000","last_active":"2023-12-07T21:13:20.097020+0000","last_peered":"2023-12-07T21:13:20.097020+0000","last_clean":"2023-12-07T21:13:20.097020+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:13:20.097020+0000","last_undegraded":"2023-12-07T21:13:20.097020+0000","last_fullsized":"2023-12-07T21:13:20.097020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.096899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.485657+0000","scrub_duration":0.001542213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:41.432321+0000","last_change":"2023-12-07T21:14:41.432341+0000","last_active":"2023-12-07T21:14:41.432321+0000","last_peered":"2023-12-07T21:14:41.432321+0000","last_clean":"2023-12-07T21:14:41.432321+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:14:41.432321+0000","last_undegraded":"2023-12-07T21:14:41.432321+0000","last_fullsized":"2023-12-07T21:14:41.432321+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:41.432212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:41.432212+0000","last_clean_scrub_stamp":"2023-12-07T21:14:41.432212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:07:52.798106+0000","scrub_duration":0.0011517599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.309172+0000","last_change":"2023-12-07T21:13:38.309196+0000","last_active":"2023-12-07T21:13:38.309172+0000","last_peered":"2023-12-07T21:13:38.309172+0000","last_clean":"2023-12-07T21:13:38.309172+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:13:38.309172+0000","last_undegraded":"2023-12-07T21:13:38.309172+0000","last_fullsized":"2023-12-07T21:13:38.309172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:38.309082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:38.309082+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.309082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:56.899135+0000","scrub_duration":0.0011541360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:57.727223+0000","last_change":"2023-12-07T21:11:57.727223+0000","last_active":"2023-12-07T21:11:57.727223+0000","last_peered":"2023-12-07T21:11:57.727223+0000","last_clean":"2023-12-07T21:11:57.727223+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:11:57.727223+0000","last_undegraded":"2023-12-07T21:11:57.727223+0000","last_fullsized":"2023-12-07T21:11:57.727223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_clean_scrub_stamp":"2023-12-07T21:11:57.727085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:53.015740+0000","scrub_duration":0.0013430639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.630855+0000","last_change":"2023-12-07T21:12:49.630855+0000","last_active":"2023-12-07T21:12:49.630855+0000","last_peered":"2023-12-07T21:12:49.630855+0000","last_clean":"2023-12-07T21:12:49.630855+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:12:49.630855+0000","last_undegraded":"2023-12-07T21:12:49.630855+0000","last_fullsized":"2023-12-07T21:12:49.630855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.630741+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:01.513069+0000","scrub_duration":0.0051886659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:30.531782+0000","last_change":"2023-12-07T21:13:30.531836+0000","last_active":"2023-12-07T21:13:30.531782+0000","last_peered":"2023-12-07T21:13:30.531782+0000","last_clean":"2023-12-07T21:13:30.531782+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:13:30.531782+0000","last_undegraded":"2023-12-07T21:13:30.531782+0000","last_fullsized":"2023-12-07T21:13:30.531782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:30.531646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:30.531646+0000","last_clean_scrub_stamp":"2023-12-07T21:13:30.531646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:08:23.567547+0000","scrub_duration":0.001461323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.342736+0000","last_change":"2023-12-07T21:13:52.342759+0000","last_active":"2023-12-07T21:13:52.342736+0000","last_peered":"2023-12-07T21:13:52.342736+0000","last_clean":"2023-12-07T21:13:52.342736+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:13:52.342736+0000","last_undegraded":"2023-12-07T21:13:52.342736+0000","last_fullsized":"2023-12-07T21:13:52.342736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:52.342650+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:52.342650+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.342650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:23:16.104463+0000","scrub_duration":0.0010492120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:10.299642+0000","last_change":"2023-12-07T21:13:10.299666+0000","last_active":"2023-12-07T21:13:10.299642+0000","last_peered":"2023-12-07T21:13:10.299642+0000","last_clean":"2023-12-07T21:13:10.299642+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:13:10.299642+0000","last_undegraded":"2023-12-07T21:13:10.299642+0000","last_fullsized":"2023-12-07T21:13:10.299642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_clean_scrub_stamp":"2023-12-07T21:13:10.299548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:18:32.210130+0000","scrub_duration":0.00096658499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:45.355307+0000","last_change":"2023-12-07T21:13:45.355332+0000","last_active":"2023-12-07T21:13:45.355307+0000","last_peered":"2023-12-07T21:13:45.355307+0000","last_clean":"2023-12-07T21:13:45.355307+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:13:45.355307+0000","last_undegraded":"2023-12-07T21:13:45.355307+0000","last_fullsized":"2023-12-07T21:13:45.355307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:45.355224+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:45.355224+0000","last_clean_scrub_stamp":"2023-12-07T21:13:45.355224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:23:41.232871+0000","scrub_duration":0.0012797419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.037891+0000","last_change":"2023-12-07T21:13:44.037911+0000","last_active":"2023-12-07T21:13:44.037891+0000","last_peered":"2023-12-07T21:13:44.037891+0000","last_clean":"2023-12-07T21:13:44.037891+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:13:44.037891+0000","last_undegraded":"2023-12-07T21:13:44.037891+0000","last_fullsized":"2023-12-07T21:13:44.037891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:44.037804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:44.037804+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.037804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:44:57.361482+0000","scrub_duration":0.0012532349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.771944+0000","last_change":"2023-12-07T21:12:11.771944+0000","last_active":"2023-12-07T21:12:11.771944+0000","last_peered":"2023-12-07T21:12:11.771944+0000","last_clean":"2023-12-07T21:12:11.771944+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:12:11.771944+0000","last_undegraded":"2023-12-07T21:12:11.771944+0000","last_fullsized":"2023-12-07T21:12:11.771944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.771816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:43.210676+0000","scrub_duration":0.0013479799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'72","reported_seq":142,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:45.763012+0000","last_change":"2023-12-07T21:11:45.763012+0000","last_active":"2023-12-07T21:11:45.763012+0000","last_peered":"2023-12-07T21:11:45.763012+0000","last_clean":"2023-12-07T21:11:45.763012+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:11:45.763012+0000","last_undegraded":"2023-12-07T21:11:45.763012+0000","last_fullsized":"2023-12-07T21:11:45.763012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.762875+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:27:47.809323+0000","scrub_duration":0.006706058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594416+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594416+0000","last_peered":"2023-12-07T21:11:25.594416+0000","last_clean":"2023-12-07T21:11:25.594416+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594416+0000","last_undegraded":"2023-12-07T21:11:25.594416+0000","last_fullsized":"2023-12-07T21:11:25.594416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:11.946294+0000","last_change":"2023-12-07T21:14:11.946317+0000","last_active":"2023-12-07T21:14:11.946294+0000","last_peered":"2023-12-07T21:14:11.946294+0000","last_clean":"2023-12-07T21:14:11.946294+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:14:11.946294+0000","last_undegraded":"2023-12-07T21:14:11.946294+0000","last_fullsized":"2023-12-07T21:14:11.946294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:14:11.946210+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:14:11.946210+0000","last_clean_scrub_stamp":"2023-12-07T21:14:11.946210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:06:44.474703+0000","scrub_duration":0.001277083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.332914+0000","last_change":"2023-12-07T21:12:42.332914+0000","last_active":"2023-12-07T21:12:42.332914+0000","last_peered":"2023-12-07T21:12:42.332914+0000","last_clean":"2023-12-07T21:12:42.332914+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:12:42.332914+0000","last_undegraded":"2023-12-07T21:12:42.332914+0000","last_fullsized":"2023-12-07T21:12:42.332914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.332776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:52.088170+0000","scrub_duration":0.00097994699999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:57.984155+0000","last_change":"2023-12-07T21:13:57.984179+0000","last_active":"2023-12-07T21:13:57.984155+0000","last_peered":"2023-12-07T21:13:57.984155+0000","last_clean":"2023-12-07T21:13:57.984155+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:13:57.984155+0000","last_undegraded":"2023-12-07T21:13:57.984155+0000","last_fullsized":"2023-12-07T21:13:57.984155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:57.984065+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:57.984065+0000","last_clean_scrub_stamp":"2023-12-07T21:13:57.984065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:29.842428+0000","scrub_duration":0.0015299650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:47.500849+0000","last_change":"2023-12-07T21:14:47.500871+0000","last_active":"2023-12-07T21:14:47.500849+0000","last_peered":"2023-12-07T21:14:47.500849+0000","last_clean":"2023-12-07T21:14:47.500849+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:14:47.500849+0000","last_undegraded":"2023-12-07T21:14:47.500849+0000","last_fullsized":"2023-12-07T21:14:47.500849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:47.500733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:47.500733+0000","last_clean_scrub_stamp":"2023-12-07T21:14:47.500733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:15:56.051905+0000","scrub_duration":0.0011931909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.626478+0000","last_change":"2023-12-07T21:11:42.626478+0000","last_active":"2023-12-07T21:11:42.626478+0000","last_peered":"2023-12-07T21:11:42.626478+0000","last_clean":"2023-12-07T21:11:42.626478+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:11:42.626478+0000","last_undegraded":"2023-12-07T21:11:42.626478+0000","last_fullsized":"2023-12-07T21:11:42.626478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.626356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:23.689571+0000","scrub_duration":0.001348258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.225043+0000","last_change":"2023-12-07T21:11:33.225043+0000","last_active":"2023-12-07T21:11:33.225043+0000","last_peered":"2023-12-07T21:11:33.225043+0000","last_clean":"2023-12-07T21:11:33.225043+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:33.225043+0000","last_undegraded":"2023-12-07T21:11:33.225043+0000","last_fullsized":"2023-12-07T21:11:33.225043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.224920+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:12.396025+0000","scrub_duration":0.0049945800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":301,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:20.065956+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:11:20.065956+0000","last_peered":"2023-12-07T21:11:20.065956+0000","last_clean":"2023-12-07T21:11:20.065956+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:11:20.065956+0000","last_undegraded":"2023-12-07T21:11:20.065956+0000","last_fullsized":"2023-12-07T21:11:20.065956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813858+0000","last_change":"2023-12-07T21:09:04.931100+0000","last_active":"2023-12-07T21:11:23.813858+0000","last_peered":"2023-12-07T21:11:23.813858+0000","last_clean":"2023-12-07T21:11:23.813858+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:11:23.813858+0000","last_undegraded":"2023-12-07T21:11:23.813858+0000","last_fullsized":"2023-12-07T21:11:23.813858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:26.538543+0000","last_change":"2023-12-07T21:13:26.538591+0000","last_active":"2023-12-07T21:13:26.538543+0000","last_peered":"2023-12-07T21:13:26.538543+0000","last_clean":"2023-12-07T21:13:26.538543+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:13:26.538543+0000","last_undegraded":"2023-12-07T21:13:26.538543+0000","last_fullsized":"2023-12-07T21:13:26.538543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_clean_scrub_stamp":"2023-12-07T21:13:26.538439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:32:03.233013+0000","scrub_duration":0.0011404239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:16.404893+0000","last_change":"2023-12-07T21:14:16.404929+0000","last_active":"2023-12-07T21:14:16.404893+0000","last_peered":"2023-12-07T21:14:16.404893+0000","last_clean":"2023-12-07T21:14:16.404893+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:14:16.404893+0000","last_undegraded":"2023-12-07T21:14:16.404893+0000","last_fullsized":"2023-12-07T21:14:16.404893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:16.404773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:16.404773+0000","last_clean_scrub_stamp":"2023-12-07T21:14:16.404773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:54.222075+0000","scrub_duration":0.0014842950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:47.017061+0000","last_change":"2023-12-07T21:13:47.017082+0000","last_active":"2023-12-07T21:13:47.017061+0000","last_peered":"2023-12-07T21:13:47.017061+0000","last_clean":"2023-12-07T21:13:47.017061+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:13:47.017061+0000","last_undegraded":"2023-12-07T21:13:47.017061+0000","last_fullsized":"2023-12-07T21:13:47.017061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:47.016927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:47.016927+0000","last_clean_scrub_stamp":"2023-12-07T21:13:47.016927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:39.728287+0000","scrub_duration":0.0013272259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.865911+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:11:18.865911+0000","last_peered":"2023-12-07T21:11:18.865911+0000","last_clean":"2023-12-07T21:11:18.865911+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:11:18.865911+0000","last_undegraded":"2023-12-07T21:11:18.865911+0000","last_fullsized":"2023-12-07T21:11:18.865911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:44.632651+0000","last_change":"2023-12-07T21:12:44.632651+0000","last_active":"2023-12-07T21:12:44.632651+0000","last_peered":"2023-12-07T21:12:44.632651+0000","last_clean":"2023-12-07T21:12:44.632651+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:12:44.632651+0000","last_undegraded":"2023-12-07T21:12:44.632651+0000","last_fullsized":"2023-12-07T21:12:44.632651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_clean_scrub_stamp":"2023-12-07T21:12:44.632504+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:24.020207+0000","scrub_duration":0.0053067840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":369,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712229+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712229+0000","last_peered":"2023-12-07T21:11:18.712229+0000","last_clean":"2023-12-07T21:11:18.712229+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712229+0000","last_undegraded":"2023-12-07T21:11:18.712229+0000","last_fullsized":"2023-12-07T21:11:18.712229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.351712+0000","last_change":"2023-12-07T21:13:48.351733+0000","last_active":"2023-12-07T21:13:48.351712+0000","last_peered":"2023-12-07T21:13:48.351712+0000","last_clean":"2023-12-07T21:13:48.351712+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:13:48.351712+0000","last_undegraded":"2023-12-07T21:13:48.351712+0000","last_fullsized":"2023-12-07T21:13:48.351712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-07T21:13:48.351626+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-07T21:13:48.351626+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.351626+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:41.062986+0000","scrub_duration":0.0010460479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:43.441643+0000","last_change":"2023-12-07T21:12:43.441643+0000","last_active":"2023-12-07T21:12:43.441643+0000","last_peered":"2023-12-07T21:12:43.441643+0000","last_clean":"2023-12-07T21:12:43.441643+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:12:43.441643+0000","last_undegraded":"2023-12-07T21:12:43.441643+0000","last_fullsized":"2023-12-07T21:12:43.441643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_clean_scrub_stamp":"2023-12-07T21:12:43.441484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:24.768617+0000","scrub_duration":0.0011182029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:22.456099+0000","last_change":"2023-12-07T21:13:22.456119+0000","last_active":"2023-12-07T21:13:22.456099+0000","last_peered":"2023-12-07T21:13:22.456099+0000","last_clean":"2023-12-07T21:13:22.456099+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:13:22.456099+0000","last_undegraded":"2023-12-07T21:13:22.456099+0000","last_fullsized":"2023-12-07T21:13:22.456099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_clean_scrub_stamp":"2023-12-07T21:13:22.456021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:49.190223+0000","scrub_duration":0.001272902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:44.494789+0000","last_change":"2023-12-07T21:14:44.494829+0000","last_active":"2023-12-07T21:14:44.494789+0000","last_peered":"2023-12-07T21:14:44.494789+0000","last_clean":"2023-12-07T21:14:44.494789+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:14:44.494789+0000","last_undegraded":"2023-12-07T21:14:44.494789+0000","last_fullsized":"2023-12-07T21:14:44.494789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:44.494675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:44.494675+0000","last_clean_scrub_stamp":"2023-12-07T21:14:44.494675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:03:34.122166+0000","scrub_duration":0.0010907639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:37.651334+0000","last_change":"2023-12-07T21:11:37.651334+0000","last_active":"2023-12-07T21:11:37.651334+0000","last_peered":"2023-12-07T21:11:37.651334+0000","last_clean":"2023-12-07T21:11:37.651334+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:11:37.651334+0000","last_undegraded":"2023-12-07T21:11:37.651334+0000","last_fullsized":"2023-12-07T21:11:37.651334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_clean_scrub_stamp":"2023-12-07T21:11:37.651191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:09.090050+0000","scrub_duration":0.0012443790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'94","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:05.544503+0000","last_change":"2023-12-07T21:12:05.544503+0000","last_active":"2023-12-07T21:12:05.544503+0000","last_peered":"2023-12-07T21:12:05.544503+0000","last_clean":"2023-12-07T21:12:05.544503+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:12:05.544503+0000","last_undegraded":"2023-12-07T21:12:05.544503+0000","last_fullsized":"2023-12-07T21:12:05.544503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'94","last_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_deep_scrub":"33'94","last_deep_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_clean_scrub_stamp":"2023-12-07T21:12:05.544369+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:32:13.323537+0000","scrub_duration":0.006343095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.831678+0000","last_change":"2023-12-07T21:11:52.831678+0000","last_active":"2023-12-07T21:11:52.831678+0000","last_peered":"2023-12-07T21:11:52.831678+0000","last_clean":"2023-12-07T21:11:52.831678+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:52.831678+0000","last_undegraded":"2023-12-07T21:11:52.831678+0000","last_fullsized":"2023-12-07T21:11:52.831678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.831531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:22.265020+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:56.419273+0000","last_change":"2023-12-07T21:13:56.419293+0000","last_active":"2023-12-07T21:13:56.419273+0000","last_peered":"2023-12-07T21:13:56.419273+0000","last_clean":"2023-12-07T21:13:56.419273+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:13:56.419273+0000","last_undegraded":"2023-12-07T21:13:56.419273+0000","last_fullsized":"2023-12-07T21:13:56.419273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:56.419176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:56.419176+0000","last_clean_scrub_stamp":"2023-12-07T21:13:56.419176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:37:31.807934+0000","scrub_duration":0.001158671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.528421+0000","last_change":"2023-12-07T21:12:23.528421+0000","last_active":"2023-12-07T21:12:23.528421+0000","last_peered":"2023-12-07T21:12:23.528421+0000","last_clean":"2023-12-07T21:12:23.528421+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:12:23.528421+0000","last_undegraded":"2023-12-07T21:12:23.528421+0000","last_fullsized":"2023-12-07T21:12:23.528421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.528299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:52.961788+0000","scrub_duration":0.00098274400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.407105+0000","last_change":"2023-12-07T21:13:04.407105+0000","last_active":"2023-12-07T21:13:04.407105+0000","last_peered":"2023-12-07T21:13:04.407105+0000","last_clean":"2023-12-07T21:13:04.407105+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:13:04.407105+0000","last_undegraded":"2023-12-07T21:13:04.407105+0000","last_fullsized":"2023-12-07T21:13:04.407105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.406964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:17:33.745379+0000","scrub_duration":0.001091641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:25.352978+0000","last_change":"2023-12-07T21:14:25.353002+0000","last_active":"2023-12-07T21:14:25.352978+0000","last_peered":"2023-12-07T21:14:25.352978+0000","last_clean":"2023-12-07T21:14:25.352978+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:14:25.352978+0000","last_undegraded":"2023-12-07T21:14:25.352978+0000","last_fullsized":"2023-12-07T21:14:25.352978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:25.352881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:25.352881+0000","last_clean_scrub_stamp":"2023-12-07T21:14:25.352881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:50:05.152759+0000","scrub_duration":0.0013146939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.299988+0000","last_change":"2023-12-07T21:11:39.299988+0000","last_active":"2023-12-07T21:11:39.299988+0000","last_peered":"2023-12-07T21:11:39.299988+0000","last_clean":"2023-12-07T21:11:39.299988+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:39.299988+0000","last_undegraded":"2023-12-07T21:11:39.299988+0000","last_fullsized":"2023-12-07T21:11:39.299988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.299849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:48.997025+0000","scrub_duration":0.001356866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813364+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:23.813364+0000","last_peered":"2023-12-07T21:11:23.813364+0000","last_clean":"2023-12-07T21:11:23.813364+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:23.813364+0000","last_undegraded":"2023-12-07T21:11:23.813364+0000","last_fullsized":"2023-12-07T21:11:23.813364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.626993+0000","last_change":"2023-12-07T21:13:05.626993+0000","last_active":"2023-12-07T21:13:05.626993+0000","last_peered":"2023-12-07T21:13:05.626993+0000","last_clean":"2023-12-07T21:13:05.626993+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:13:05.626993+0000","last_undegraded":"2023-12-07T21:13:05.626993+0000","last_fullsized":"2023-12-07T21:13:05.626993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.626860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:01.027919+0000","scrub_duration":0.00097400899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:29.046519+0000","last_change":"2023-12-07T21:14:29.046540+0000","last_active":"2023-12-07T21:14:29.046519+0000","last_peered":"2023-12-07T21:14:29.046519+0000","last_clean":"2023-12-07T21:14:29.046519+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:14:29.046519+0000","last_undegraded":"2023-12-07T21:14:29.046519+0000","last_fullsized":"2023-12-07T21:14:29.046519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:29.046420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:29.046420+0000","last_clean_scrub_stamp":"2023-12-07T21:14:29.046420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:59:49.084841+0000","scrub_duration":0.0013829269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.340557+0000","last_change":"2023-12-07T21:13:05.340557+0000","last_active":"2023-12-07T21:13:05.340557+0000","last_peered":"2023-12-07T21:13:05.340557+0000","last_clean":"2023-12-07T21:13:05.340557+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:13:05.340557+0000","last_undegraded":"2023-12-07T21:13:05.340557+0000","last_fullsized":"2023-12-07T21:13:05.340557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.340431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:24.924419+0000","scrub_duration":0.001119035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.409426+0000","last_change":"2023-12-07T21:13:48.409426+0000","last_active":"2023-12-07T21:13:48.409426+0000","last_peered":"2023-12-07T21:13:48.409426+0000","last_clean":"2023-12-07T21:13:48.409426+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:13:48.409426+0000","last_undegraded":"2023-12-07T21:13:48.409426+0000","last_fullsized":"2023-12-07T21:13:48.409426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:48.409284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:48.409284+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.409284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:42.968321+0000","scrub_duration":0.0012408199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812340+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:18.812340+0000","last_peered":"2023-12-07T21:11:18.812340+0000","last_clean":"2023-12-07T21:11:18.812340+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:18.812340+0000","last_undegraded":"2023-12-07T21:11:18.812340+0000","last_fullsized":"2023-12-07T21:11:18.812340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'9","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.887056+0000","last_change":"2023-12-07T21:11:50.887056+0000","last_active":"2023-12-07T21:11:50.887056+0000","last_peered":"2023-12-07T21:11:50.887056+0000","last_clean":"2023-12-07T21:11:50.887056+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:50.887056+0000","last_undegraded":"2023-12-07T21:11:50.887056+0000","last_fullsized":"2023-12-07T21:11:50.887056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.886922+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:02.989113+0000","scrub_duration":0.0042007399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.812347+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:23.812347+0000","last_peered":"2023-12-07T21:11:23.812347+0000","last_clean":"2023-12-07T21:11:23.812347+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:23.812347+0000","last_undegraded":"2023-12-07T21:11:23.812347+0000","last_fullsized":"2023-12-07T21:11:23.812347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:13.973529+0000","last_change":"2023-12-07T21:14:13.973547+0000","last_active":"2023-12-07T21:14:13.973529+0000","last_peered":"2023-12-07T21:14:13.973529+0000","last_clean":"2023-12-07T21:14:13.973529+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:14:13.973529+0000","last_undegraded":"2023-12-07T21:14:13.973529+0000","last_fullsized":"2023-12-07T21:14:13.973529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:13.973453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:13.973453+0000","last_clean_scrub_stamp":"2023-12-07T21:14:13.973453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:22.652134+0000","scrub_duration":0.0014016110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.033989+0000","last_change":"2023-12-07T21:13:38.033989+0000","last_active":"2023-12-07T21:13:38.033989+0000","last_peered":"2023-12-07T21:13:38.033989+0000","last_clean":"2023-12-07T21:13:38.033989+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:13:38.033989+0000","last_undegraded":"2023-12-07T21:13:38.033989+0000","last_fullsized":"2023-12-07T21:13:38.033989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:38.033840+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:38.033840+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.033840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:33.434899+0000","scrub_duration":0.001381462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.434901+0000","last_change":"2023-12-07T21:13:28.434901+0000","last_active":"2023-12-07T21:13:28.434901+0000","last_peered":"2023-12-07T21:13:28.434901+0000","last_clean":"2023-12-07T21:13:28.434901+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:13:28.434901+0000","last_undegraded":"2023-12-07T21:13:28.434901+0000","last_fullsized":"2023-12-07T21:13:28.434901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.434771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:49.030870+0000","scrub_duration":0.001230061,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.605108+0000","last_change":"2023-12-07T21:12:18.605108+0000","last_active":"2023-12-07T21:12:18.605108+0000","last_peered":"2023-12-07T21:12:18.605108+0000","last_clean":"2023-12-07T21:12:18.605108+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:12:18.605108+0000","last_undegraded":"2023-12-07T21:12:18.605108+0000","last_fullsized":"2023-12-07T21:12:18.605108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.605002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:30.707193+0000","scrub_duration":0.00090833899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.805867+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:23.805867+0000","last_peered":"2023-12-07T21:11:23.805867+0000","last_clean":"2023-12-07T21:11:23.805867+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:23.805867+0000","last_undegraded":"2023-12-07T21:11:23.805867+0000","last_fullsized":"2023-12-07T21:11:23.805867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.302809+0000","last_change":"2023-12-07T21:11:36.302809+0000","last_active":"2023-12-07T21:11:36.302809+0000","last_peered":"2023-12-07T21:11:36.302809+0000","last_clean":"2023-12-07T21:11:36.302809+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:36.302809+0000","last_undegraded":"2023-12-07T21:11:36.302809+0000","last_fullsized":"2023-12-07T21:11:36.302809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.302687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:01.567462+0000","scrub_duration":0.0014296669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:00.345915+0000","last_change":"2023-12-07T21:14:00.345915+0000","last_active":"2023-12-07T21:14:00.345915+0000","last_peered":"2023-12-07T21:14:00.345915+0000","last_clean":"2023-12-07T21:14:00.345915+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:14:00.345915+0000","last_undegraded":"2023-12-07T21:14:00.345915+0000","last_fullsized":"2023-12-07T21:14:00.345915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:00.345796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:00.345796+0000","last_clean_scrub_stamp":"2023-12-07T21:14:00.345796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:47.511446+0000","scrub_duration":0.0010293559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:29.521893+0000","last_change":"2023-12-07T21:13:29.521893+0000","last_active":"2023-12-07T21:13:29.521893+0000","last_peered":"2023-12-07T21:13:29.521893+0000","last_clean":"2023-12-07T21:13:29.521893+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:13:29.521893+0000","last_undegraded":"2023-12-07T21:13:29.521893+0000","last_fullsized":"2023-12-07T21:13:29.521893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:29.521772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:29.521772+0000","last_clean_scrub_stamp":"2023-12-07T21:13:29.521772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:51:27.306062+0000","scrub_duration":0.001149186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:09.325688+0000","last_change":"2023-12-07T21:13:09.325688+0000","last_active":"2023-12-07T21:13:09.325688+0000","last_peered":"2023-12-07T21:13:09.325688+0000","last_clean":"2023-12-07T21:13:09.325688+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:13:09.325688+0000","last_undegraded":"2023-12-07T21:13:09.325688+0000","last_fullsized":"2023-12-07T21:13:09.325688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_clean_scrub_stamp":"2023-12-07T21:13:09.325568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:45:40.066890+0000","scrub_duration":0.00116248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.514142+0000","last_change":"2023-12-07T21:11:52.514142+0000","last_active":"2023-12-07T21:11:52.514142+0000","last_peered":"2023-12-07T21:11:52.514142+0000","last_clean":"2023-12-07T21:11:52.514142+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:52.514142+0000","last_undegraded":"2023-12-07T21:11:52.514142+0000","last_fullsized":"2023-12-07T21:11:52.514142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.514035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:00:51.180837+0000","scrub_duration":0.00101976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.532802+0000","last_change":"2023-12-07T21:11:32.532802+0000","last_active":"2023-12-07T21:11:32.532802+0000","last_peered":"2023-12-07T21:11:32.532802+0000","last_clean":"2023-12-07T21:11:32.532802+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:32.532802+0000","last_undegraded":"2023-12-07T21:11:32.532802+0000","last_fullsized":"2023-12-07T21:11:32.532802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.532666+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:34.382885+0000","scrub_duration":0.0035860219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.812477+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:23.812477+0000","last_peered":"2023-12-07T21:11:23.812477+0000","last_clean":"2023-12-07T21:11:23.812477+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:23.812477+0000","last_undegraded":"2023-12-07T21:11:23.812477+0000","last_fullsized":"2023-12-07T21:11:23.812477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:31.506721+0000","last_change":"2023-12-07T21:13:31.506752+0000","last_active":"2023-12-07T21:13:31.506721+0000","last_peered":"2023-12-07T21:13:31.506721+0000","last_clean":"2023-12-07T21:13:31.506721+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:13:31.506721+0000","last_undegraded":"2023-12-07T21:13:31.506721+0000","last_fullsized":"2023-12-07T21:13:31.506721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:31.506641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:31.506641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:31.506641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:57:50.535477+0000","scrub_duration":0.0015893470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:33.305958+0000","last_change":"2023-12-07T21:14:33.305979+0000","last_active":"2023-12-07T21:14:33.305958+0000","last_peered":"2023-12-07T21:14:33.305958+0000","last_clean":"2023-12-07T21:14:33.305958+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:14:33.305958+0000","last_undegraded":"2023-12-07T21:14:33.305958+0000","last_fullsized":"2023-12-07T21:14:33.305958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:33.305845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:33.305845+0000","last_clean_scrub_stamp":"2023-12-07T21:14:33.305845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:37:20.389797+0000","scrub_duration":0.001218537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:59.757120+0000","last_change":"2023-12-07T21:11:59.757120+0000","last_active":"2023-12-07T21:11:59.757120+0000","last_peered":"2023-12-07T21:11:59.757120+0000","last_clean":"2023-12-07T21:11:59.757120+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:11:59.757120+0000","last_undegraded":"2023-12-07T21:11:59.757120+0000","last_fullsized":"2023-12-07T21:11:59.757120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_clean_scrub_stamp":"2023-12-07T21:11:59.757017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:04:59.018197+0000","scrub_duration":0.001196353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'61","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.783993+0000","last_change":"2023-12-07T21:11:44.783993+0000","last_active":"2023-12-07T21:11:44.783993+0000","last_peered":"2023-12-07T21:11:44.783993+0000","last_clean":"2023-12-07T21:11:44.783993+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:44.783993+0000","last_undegraded":"2023-12-07T21:11:44.783993+0000","last_fullsized":"2023-12-07T21:11:44.783993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.783824+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:07.474940+0000","scrub_duration":0.004588193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.558908+0000","last_change":"2023-12-07T21:11:36.558908+0000","last_active":"2023-12-07T21:11:36.558908+0000","last_peered":"2023-12-07T21:11:36.558908+0000","last_clean":"2023-12-07T21:11:36.558908+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:11:36.558908+0000","last_undegraded":"2023-12-07T21:11:36.558908+0000","last_fullsized":"2023-12-07T21:11:36.558908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.558807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:33:06.320086+0000","scrub_duration":0.001387288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:22.966818+0000","last_change":"2023-12-07T21:14:22.966859+0000","last_active":"2023-12-07T21:14:22.966818+0000","last_peered":"2023-12-07T21:14:22.966818+0000","last_clean":"2023-12-07T21:14:22.966818+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:14:22.966818+0000","last_undegraded":"2023-12-07T21:14:22.966818+0000","last_fullsized":"2023-12-07T21:14:22.966818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:14:22.966677+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:14:22.966677+0000","last_clean_scrub_stamp":"2023-12-07T21:14:22.966677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:21:07.474679+0000","scrub_duration":0.0015071959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:19.862179+0000","last_change":"2023-12-07T21:12:19.862179+0000","last_active":"2023-12-07T21:12:19.862179+0000","last_peered":"2023-12-07T21:12:19.862179+0000","last_clean":"2023-12-07T21:12:19.862179+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:12:19.862179+0000","last_undegraded":"2023-12-07T21:12:19.862179+0000","last_fullsized":"2023-12-07T21:12:19.862179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_clean_scrub_stamp":"2023-12-07T21:12:19.862069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:34.168058+0000","scrub_duration":0.0015085669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.431844+0000","last_change":"2023-12-07T21:13:21.431844+0000","last_active":"2023-12-07T21:13:21.431844+0000","last_peered":"2023-12-07T21:13:21.431844+0000","last_clean":"2023-12-07T21:13:21.431844+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:13:21.431844+0000","last_undegraded":"2023-12-07T21:13:21.431844+0000","last_fullsized":"2023-12-07T21:13:21.431844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.431724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:58:06.040375+0000","scrub_duration":0.0012195439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:23.469100+0000","last_change":"2023-12-07T21:14:23.469123+0000","last_active":"2023-12-07T21:14:23.469100+0000","last_peered":"2023-12-07T21:14:23.469100+0000","last_clean":"2023-12-07T21:14:23.469100+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:14:23.469100+0000","last_undegraded":"2023-12-07T21:14:23.469100+0000","last_fullsized":"2023-12-07T21:14:23.469100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:23.469019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:23.469019+0000","last_clean_scrub_stamp":"2023-12-07T21:14:23.469019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:10:52.576401+0000","scrub_duration":0.00098617400000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.514738+0000","last_change":"2023-12-07T21:12:21.514738+0000","last_active":"2023-12-07T21:12:21.514738+0000","last_peered":"2023-12-07T21:12:21.514738+0000","last_clean":"2023-12-07T21:12:21.514738+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:12:21.514738+0000","last_undegraded":"2023-12-07T21:12:21.514738+0000","last_fullsized":"2023-12-07T21:12:21.514738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.514603+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:11.760175+0000","scrub_duration":0.0065721260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:13.399009+0000","last_change":"2023-12-07T21:12:13.399009+0000","last_active":"2023-12-07T21:12:13.399009+0000","last_peered":"2023-12-07T21:12:13.399009+0000","last_clean":"2023-12-07T21:12:13.399009+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:12:13.399009+0000","last_undegraded":"2023-12-07T21:12:13.399009+0000","last_fullsized":"2023-12-07T21:12:13.399009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_clean_scrub_stamp":"2023-12-07T21:12:13.398859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:54.725992+0000","scrub_duration":0.0011359600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:50.253895+0000","last_change":"2023-12-07T21:13:50.253916+0000","last_active":"2023-12-07T21:13:50.253895+0000","last_peered":"2023-12-07T21:13:50.253895+0000","last_clean":"2023-12-07T21:13:50.253895+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:13:50.253895+0000","last_undegraded":"2023-12-07T21:13:50.253895+0000","last_fullsized":"2023-12-07T21:13:50.253895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:50.253806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:50.253806+0000","last_clean_scrub_stamp":"2023-12-07T21:13:50.253806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:34:11.268340+0000","scrub_duration":0.0010687579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.432392+0000","last_change":"2023-12-07T21:12:11.432392+0000","last_active":"2023-12-07T21:12:11.432392+0000","last_peered":"2023-12-07T21:12:11.432392+0000","last_clean":"2023-12-07T21:12:11.432392+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:12:11.432392+0000","last_undegraded":"2023-12-07T21:12:11.432392+0000","last_fullsized":"2023-12-07T21:12:11.432392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.432277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:48.190145+0000","scrub_duration":0.0010618419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.427565+0000","last_change":"2023-12-07T21:13:36.427565+0000","last_active":"2023-12-07T21:13:36.427565+0000","last_peered":"2023-12-07T21:13:36.427565+0000","last_clean":"2023-12-07T21:13:36.427565+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:13:36.427565+0000","last_undegraded":"2023-12-07T21:13:36.427565+0000","last_fullsized":"2023-12-07T21:13:36.427565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:36.427462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:36.427462+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.427462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:00:09.657217+0000","scrub_duration":0.0011997139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:10.553135+0000","last_change":"2023-12-07T21:12:10.553135+0000","last_active":"2023-12-07T21:12:10.553135+0000","last_peered":"2023-12-07T21:12:10.553135+0000","last_clean":"2023-12-07T21:12:10.553135+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:12:10.553135+0000","last_undegraded":"2023-12-07T21:12:10.553135+0000","last_fullsized":"2023-12-07T21:12:10.553135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_clean_scrub_stamp":"2023-12-07T21:12:10.553023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:52.504367+0000","scrub_duration":0.0013037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.745178+0000","last_change":"2023-12-07T21:11:36.745178+0000","last_active":"2023-12-07T21:11:36.745178+0000","last_peered":"2023-12-07T21:11:36.745178+0000","last_clean":"2023-12-07T21:11:36.745178+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:36.745178+0000","last_undegraded":"2023-12-07T21:11:36.745178+0000","last_fullsized":"2023-12-07T21:11:36.745178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.745068+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:09.080620+0000","scrub_duration":0.0072373669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:16.616710+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:11:16.616710+0000","last_peered":"2023-12-07T21:11:16.616710+0000","last_clean":"2023-12-07T21:11:16.616710+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:11:16.616710+0000","last_undegraded":"2023-12-07T21:11:16.616710+0000","last_fullsized":"2023-12-07T21:11:16.616710+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814594+0000","last_change":"2023-12-07T21:09:04.930974+0000","last_active":"2023-12-07T21:11:28.814594+0000","last_peered":"2023-12-07T21:11:28.814594+0000","last_clean":"2023-12-07T21:11:28.814594+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:11:28.814594+0000","last_undegraded":"2023-12-07T21:11:28.814594+0000","last_fullsized":"2023-12-07T21:11:28.814594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.879540+0000","last_change":"2023-12-07T21:12:56.879540+0000","last_active":"2023-12-07T21:12:56.879540+0000","last_peered":"2023-12-07T21:12:56.879540+0000","last_clean":"2023-12-07T21:12:56.879540+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:12:56.879540+0000","last_undegraded":"2023-12-07T21:12:56.879540+0000","last_fullsized":"2023-12-07T21:12:56.879540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.879389+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:47.124961+0000","scrub_duration":0.0034133409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.341852+0000","last_change":"2023-12-07T21:14:02.341875+0000","last_active":"2023-12-07T21:14:02.341852+0000","last_peered":"2023-12-07T21:14:02.341852+0000","last_clean":"2023-12-07T21:14:02.341852+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:14:02.341852+0000","last_undegraded":"2023-12-07T21:14:02.341852+0000","last_fullsized":"2023-12-07T21:14:02.341852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:02.341757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:02.341757+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.341757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:42.946314+0000","scrub_duration":0.001137264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.324449+0000","last_change":"2023-12-07T21:11:41.324449+0000","last_active":"2023-12-07T21:11:41.324449+0000","last_peered":"2023-12-07T21:11:41.324449+0000","last_clean":"2023-12-07T21:11:41.324449+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:41.324449+0000","last_undegraded":"2023-12-07T21:11:41.324449+0000","last_fullsized":"2023-12-07T21:11:41.324449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.324294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:18:22.956309+0000","scrub_duration":0.001431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:42.649725+0000","last_change":"2023-12-07T21:12:42.649725+0000","last_active":"2023-12-07T21:12:42.649725+0000","last_peered":"2023-12-07T21:12:42.649725+0000","last_clean":"2023-12-07T21:12:42.649725+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:12:42.649725+0000","last_undegraded":"2023-12-07T21:12:42.649725+0000","last_fullsized":"2023-12-07T21:12:42.649725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.649582+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:55:46.065006+0000","scrub_duration":0.0041186950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":325,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411924+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411924+0000","last_peered":"2023-12-07T21:11:10.411924+0000","last_clean":"2023-12-07T21:11:10.411924+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411924+0000","last_undegraded":"2023-12-07T21:11:10.411924+0000","last_fullsized":"2023-12-07T21:11:10.411924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814347+0000","last_change":"2023-12-07T21:09:04.928827+0000","last_active":"2023-12-07T21:11:28.814347+0000","last_peered":"2023-12-07T21:11:28.814347+0000","last_clean":"2023-12-07T21:11:28.814347+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:11:28.814347+0000","last_undegraded":"2023-12-07T21:11:28.814347+0000","last_fullsized":"2023-12-07T21:11:28.814347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.370762+0000","last_change":"2023-12-07T21:13:07.370762+0000","last_active":"2023-12-07T21:13:07.370762+0000","last_peered":"2023-12-07T21:13:07.370762+0000","last_clean":"2023-12-07T21:13:07.370762+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:13:07.370762+0000","last_undegraded":"2023-12-07T21:13:07.370762+0000","last_fullsized":"2023-12-07T21:13:07.370762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:06.037407+0000","scrub_duration":0.0014696010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.432268+0000","last_change":"2023-12-07T21:13:23.432268+0000","last_active":"2023-12-07T21:13:23.432268+0000","last_peered":"2023-12-07T21:13:23.432268+0000","last_clean":"2023-12-07T21:13:23.432268+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:13:23.432268+0000","last_undegraded":"2023-12-07T21:13:23.432268+0000","last_fullsized":"2023-12-07T21:13:23.432268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.432146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:02:08.854218+0000","scrub_duration":0.001156783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.351557+0000","last_change":"2023-12-07T21:11:43.351557+0000","last_active":"2023-12-07T21:11:43.351557+0000","last_peered":"2023-12-07T21:11:43.351557+0000","last_clean":"2023-12-07T21:11:43.351557+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:43.351557+0000","last_undegraded":"2023-12-07T21:11:43.351557+0000","last_fullsized":"2023-12-07T21:11:43.351557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_clean_scrub_stamp":"2023-12-07T21:11:43.351414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:25.302758+0000","scrub_duration":0.001534795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.813759+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:28.813759+0000","last_peered":"2023-12-07T21:11:28.813759+0000","last_clean":"2023-12-07T21:11:28.813759+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:28.813759+0000","last_undegraded":"2023-12-07T21:11:28.813759+0000","last_fullsized":"2023-12-07T21:11:28.813759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.806704+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:28.806704+0000","last_peered":"2023-12-07T21:11:28.806704+0000","last_clean":"2023-12-07T21:11:28.806704+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:28.806704+0000","last_undegraded":"2023-12-07T21:11:28.806704+0000","last_fullsized":"2023-12-07T21:11:28.806704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:58.411345+0000","last_change":"2023-12-07T21:13:58.411345+0000","last_active":"2023-12-07T21:13:58.411345+0000","last_peered":"2023-12-07T21:13:58.411345+0000","last_clean":"2023-12-07T21:13:58.411345+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:13:58.411345+0000","last_undegraded":"2023-12-07T21:13:58.411345+0000","last_fullsized":"2023-12-07T21:13:58.411345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:58.411237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:58.411237+0000","last_clean_scrub_stamp":"2023-12-07T21:13:58.411237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:57.593351+0000","scrub_duration":0.00098503999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:17.462525+0000","last_change":"2023-12-07T21:13:17.462525+0000","last_active":"2023-12-07T21:13:17.462525+0000","last_peered":"2023-12-07T21:13:17.462525+0000","last_clean":"2023-12-07T21:13:17.462525+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:13:17.462525+0000","last_undegraded":"2023-12-07T21:13:17.462525+0000","last_fullsized":"2023-12-07T21:13:17.462525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_clean_scrub_stamp":"2023-12-07T21:13:17.462415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:57.578294+0000","scrub_duration":0.0013457709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:01.338926+0000","last_change":"2023-12-07T21:14:01.338946+0000","last_active":"2023-12-07T21:14:01.338926+0000","last_peered":"2023-12-07T21:14:01.338926+0000","last_clean":"2023-12-07T21:14:01.338926+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:14:01.338926+0000","last_undegraded":"2023-12-07T21:14:01.338926+0000","last_fullsized":"2023-12-07T21:14:01.338926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:01.338826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:01.338826+0000","last_clean_scrub_stamp":"2023-12-07T21:14:01.338826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:19.893425+0000","scrub_duration":0.0012369779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.612358+0000","last_change":"2023-12-07T21:12:17.612358+0000","last_active":"2023-12-07T21:12:17.612358+0000","last_peered":"2023-12-07T21:12:17.612358+0000","last_clean":"2023-12-07T21:12:17.612358+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:12:17.612358+0000","last_undegraded":"2023-12-07T21:12:17.612358+0000","last_fullsized":"2023-12-07T21:12:17.612358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.612233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:19.658682+0000","scrub_duration":0.00093805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.713922+0000","last_change":"2023-12-07T21:11:41.713922+0000","last_active":"2023-12-07T21:11:41.713922+0000","last_peered":"2023-12-07T21:11:41.713922+0000","last_clean":"2023-12-07T21:11:41.713922+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:41.713922+0000","last_undegraded":"2023-12-07T21:11:41.713922+0000","last_fullsized":"2023-12-07T21:11:41.713922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.713762+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:20:34.087308+0000","scrub_duration":0.004054785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.510342+0000","last_change":"2023-12-07T21:12:27.510342+0000","last_active":"2023-12-07T21:12:27.510342+0000","last_peered":"2023-12-07T21:12:27.510342+0000","last_clean":"2023-12-07T21:12:27.510342+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:12:27.510342+0000","last_undegraded":"2023-12-07T21:12:27.510342+0000","last_fullsized":"2023-12-07T21:12:27.510342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.510237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:49.420820+0000","scrub_duration":0.00099611600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.816275+0000","last_change":"2023-12-07T21:09:04.927849+0000","last_active":"2023-12-07T21:11:33.816275+0000","last_peered":"2023-12-07T21:11:33.816275+0000","last_clean":"2023-12-07T21:11:33.816275+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:11:33.816275+0000","last_undegraded":"2023-12-07T21:11:33.816275+0000","last_fullsized":"2023-12-07T21:11:33.816275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.564326+0000","last_change":"2023-12-07T21:13:28.564326+0000","last_active":"2023-12-07T21:13:28.564326+0000","last_peered":"2023-12-07T21:13:28.564326+0000","last_clean":"2023-12-07T21:13:28.564326+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:13:28.564326+0000","last_undegraded":"2023-12-07T21:13:28.564326+0000","last_fullsized":"2023-12-07T21:13:28.564326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.564212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:00.422576+0000","scrub_duration":0.0013779650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.878922+0000","last_change":"2023-12-07T21:13:08.878977+0000","last_active":"2023-12-07T21:13:08.878922+0000","last_peered":"2023-12-07T21:13:08.878922+0000","last_clean":"2023-12-07T21:13:08.878922+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:13:08.878922+0000","last_undegraded":"2023-12-07T21:13:08.878922+0000","last_fullsized":"2023-12-07T21:13:08.878922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_clean_scrub_stamp":"2023-12-07T21:13:08.878805+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:03.437843+0000","scrub_duration":0.0021145529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.412366+0000","last_change":"2023-12-07T21:11:55.412366+0000","last_active":"2023-12-07T21:11:55.412366+0000","last_peered":"2023-12-07T21:11:55.412366+0000","last_clean":"2023-12-07T21:11:55.412366+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:55.412366+0000","last_undegraded":"2023-12-07T21:11:55.412366+0000","last_fullsized":"2023-12-07T21:11:55.412366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.412243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.514434+0000","scrub_duration":0.0010230090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:00.405945+0000","last_change":"2023-12-07T21:12:00.405945+0000","last_active":"2023-12-07T21:12:00.405945+0000","last_peered":"2023-12-07T21:12:00.405945+0000","last_clean":"2023-12-07T21:12:00.405945+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:12:00.405945+0000","last_undegraded":"2023-12-07T21:12:00.405945+0000","last_fullsized":"2023-12-07T21:12:00.405945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_clean_scrub_stamp":"2023-12-07T21:12:00.405797+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:22.672028+0000","scrub_duration":0.0030248670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.620711+0000","last_change":"2023-12-07T21:12:35.620711+0000","last_active":"2023-12-07T21:12:35.620711+0000","last_peered":"2023-12-07T21:12:35.620711+0000","last_clean":"2023-12-07T21:12:35.620711+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:12:35.620711+0000","last_undegraded":"2023-12-07T21:12:35.620711+0000","last_fullsized":"2023-12-07T21:12:35.620711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.620604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:45:58.984206+0000","scrub_duration":0.00101417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.816183+0000","last_change":"2023-12-07T21:09:04.931334+0000","last_active":"2023-12-07T21:11:33.816183+0000","last_peered":"2023-12-07T21:11:33.816183+0000","last_clean":"2023-12-07T21:11:33.816183+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:11:33.816183+0000","last_undegraded":"2023-12-07T21:11:33.816183+0000","last_fullsized":"2023-12-07T21:11:33.816183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:09:03.896562+0000","last_clean_scrub_stamp":"2023-12-07T21:09:03.896562+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'14","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:45.443225+0000","last_change":"2023-12-07T21:12:45.443225+0000","last_active":"2023-12-07T21:12:45.443225+0000","last_peered":"2023-12-07T21:12:45.443225+0000","last_clean":"2023-12-07T21:12:45.443225+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:12:45.443225+0000","last_undegraded":"2023-12-07T21:12:45.443225+0000","last_fullsized":"2023-12-07T21:12:45.443225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_clean_scrub_stamp":"2023-12-07T21:12:45.443116+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:59.105780+0000","scrub_duration":0.003118975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:41.352194+0000","last_change":"2023-12-07T21:12:41.352194+0000","last_active":"2023-12-07T21:12:41.352194+0000","last_peered":"2023-12-07T21:12:41.352194+0000","last_clean":"2023-12-07T21:12:41.352194+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:12:41.352194+0000","last_undegraded":"2023-12-07T21:12:41.352194+0000","last_fullsized":"2023-12-07T21:12:41.352194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_clean_scrub_stamp":"2023-12-07T21:12:41.352075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:21.467955+0000","scrub_duration":0.001369671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.347728+0000","last_change":"2023-12-07T21:11:44.347728+0000","last_active":"2023-12-07T21:11:44.347728+0000","last_peered":"2023-12-07T21:11:44.347728+0000","last_clean":"2023-12-07T21:11:44.347728+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:44.347728+0000","last_undegraded":"2023-12-07T21:11:44.347728+0000","last_fullsized":"2023-12-07T21:11:44.347728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.347582+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:19:20.740832+0000","scrub_duration":0.0032839919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.582486+0000","last_change":"2023-12-07T21:13:06.582486+0000","last_active":"2023-12-07T21:13:06.582486+0000","last_peered":"2023-12-07T21:13:06.582486+0000","last_clean":"2023-12-07T21:13:06.582486+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:13:06.582486+0000","last_undegraded":"2023-12-07T21:13:06.582486+0000","last_fullsized":"2023-12-07T21:13:06.582486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.582338+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:09:35.689720+0000","scrub_duration":0.0045970239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.807904+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:33.807904+0000","last_peered":"2023-12-07T21:11:33.807904+0000","last_clean":"2023-12-07T21:11:33.807904+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:33.807904+0000","last_undegraded":"2023-12-07T21:11:33.807904+0000","last_fullsized":"2023-12-07T21:11:33.807904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.425991+0000","last_change":"2023-12-07T21:13:38.425991+0000","last_active":"2023-12-07T21:13:38.425991+0000","last_peered":"2023-12-07T21:13:38.425991+0000","last_clean":"2023-12-07T21:13:38.425991+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:13:38.425991+0000","last_undegraded":"2023-12-07T21:13:38.425991+0000","last_fullsized":"2023-12-07T21:13:38.425991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:38.425888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:38.425888+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.425888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:24:24.944080+0000","scrub_duration":0.0010394829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.282874+0000","last_change":"2023-12-07T21:12:20.282874+0000","last_active":"2023-12-07T21:12:20.282874+0000","last_peered":"2023-12-07T21:12:20.282874+0000","last_clean":"2023-12-07T21:12:20.282874+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:12:20.282874+0000","last_undegraded":"2023-12-07T21:12:20.282874+0000","last_fullsized":"2023-12-07T21:12:20.282874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.282741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:25.331572+0000","scrub_duration":0.001103185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.410433+0000","last_change":"2023-12-07T21:13:11.410456+0000","last_active":"2023-12-07T21:13:11.410433+0000","last_peered":"2023-12-07T21:13:11.410433+0000","last_clean":"2023-12-07T21:13:11.410433+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:13:11.410433+0000","last_undegraded":"2023-12-07T21:13:11.410433+0000","last_fullsized":"2023-12-07T21:13:11.410433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.410343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:25:05.365800+0000","scrub_duration":0.00143078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.887062+0000","last_change":"2023-12-07T21:12:35.887062+0000","last_active":"2023-12-07T21:12:35.887062+0000","last_peered":"2023-12-07T21:12:35.887062+0000","last_clean":"2023-12-07T21:12:35.887062+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:12:35.887062+0000","last_undegraded":"2023-12-07T21:12:35.887062+0000","last_fullsized":"2023-12-07T21:12:35.887062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.886915+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:07.595951+0000","scrub_duration":0.0013132650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.022855+0000","last_change":"2023-12-07T21:13:52.022881+0000","last_active":"2023-12-07T21:13:52.022855+0000","last_peered":"2023-12-07T21:13:52.022855+0000","last_clean":"2023-12-07T21:13:52.022855+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:13:52.022855+0000","last_undegraded":"2023-12-07T21:13:52.022855+0000","last_fullsized":"2023-12-07T21:13:52.022855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:52.022763+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:52.022763+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.022763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:23:15.784577+0000","scrub_duration":0.001528983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.424126+0000","last_change":"2023-12-07T21:12:12.424126+0000","last_active":"2023-12-07T21:12:12.424126+0000","last_peered":"2023-12-07T21:12:12.424126+0000","last_clean":"2023-12-07T21:12:12.424126+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:12:12.424126+0000","last_undegraded":"2023-12-07T21:12:12.424126+0000","last_fullsized":"2023-12-07T21:12:12.424126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.424026+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:21.643939+0000","scrub_duration":0.002995218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.607794+0000","last_change":"2023-12-07T21:08:54.885033+0000","last_active":"2023-12-07T21:11:10.607794+0000","last_peered":"2023-12-07T21:11:10.607794+0000","last_clean":"2023-12-07T21:11:10.607794+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:11:10.607794+0000","last_undegraded":"2023-12-07T21:11:10.607794+0000","last_fullsized":"2023-12-07T21:11:10.607794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:08:53.839459+0000","last_clean_scrub_stamp":"2023-12-07T21:08:53.839459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.040427+0000","last_change":"2023-12-07T21:13:36.040464+0000","last_active":"2023-12-07T21:13:36.040427+0000","last_peered":"2023-12-07T21:13:36.040427+0000","last_clean":"2023-12-07T21:13:36.040427+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:13:36.040427+0000","last_undegraded":"2023-12-07T21:13:36.040427+0000","last_fullsized":"2023-12-07T21:13:36.040427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:36.040303+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:36.040303+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.040303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:27:20.323619+0000","scrub_duration":0.0015351799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:59.931829+0000","last_change":"2023-12-07T21:13:59.931849+0000","last_active":"2023-12-07T21:13:59.931829+0000","last_peered":"2023-12-07T21:13:59.931829+0000","last_clean":"2023-12-07T21:13:59.931829+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:13:59.931829+0000","last_undegraded":"2023-12-07T21:13:59.931829+0000","last_fullsized":"2023-12-07T21:13:59.931829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:59.931743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:59.931743+0000","last_clean_scrub_stamp":"2023-12-07T21:13:59.931743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:27.479281+0000","scrub_duration":0.0012518340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.893908+0000","last_change":"2023-12-07T21:13:07.893908+0000","last_active":"2023-12-07T21:13:07.893908+0000","last_peered":"2023-12-07T21:13:07.893908+0000","last_clean":"2023-12-07T21:13:07.893908+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:13:07.893908+0000","last_undegraded":"2023-12-07T21:13:07.893908+0000","last_fullsized":"2023-12-07T21:13:07.893908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.893732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:21.957836+0000","scrub_duration":0.0014675510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:43.075446+0000","last_change":"2023-12-07T21:13:43.075468+0000","last_active":"2023-12-07T21:13:43.075446+0000","last_peered":"2023-12-07T21:13:43.075446+0000","last_clean":"2023-12-07T21:13:43.075446+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:13:43.075446+0000","last_undegraded":"2023-12-07T21:13:43.075446+0000","last_fullsized":"2023-12-07T21:13:43.075446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:43.075357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:43.075357+0000","last_clean_scrub_stamp":"2023-12-07T21:13:43.075357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:16.414998+0000","scrub_duration":0.001175125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:39.400478+0000","last_change":"2023-12-07T21:13:39.400502+0000","last_active":"2023-12-07T21:13:39.400478+0000","last_peered":"2023-12-07T21:13:39.400478+0000","last_clean":"2023-12-07T21:13:39.400478+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:13:39.400478+0000","last_undegraded":"2023-12-07T21:13:39.400478+0000","last_fullsized":"2023-12-07T21:13:39.400478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:39.400392+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:39.400392+0000","last_clean_scrub_stamp":"2023-12-07T21:13:39.400392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:58:58.675909+0000","scrub_duration":0.0010690470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.488346+0000","last_change":"2023-12-07T21:13:27.488385+0000","last_active":"2023-12-07T21:13:27.488346+0000","last_peered":"2023-12-07T21:13:27.488346+0000","last_clean":"2023-12-07T21:13:27.488346+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:13:27.488346+0000","last_undegraded":"2023-12-07T21:13:27.488346+0000","last_fullsized":"2023-12-07T21:13:27.488346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.488243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:20.217342+0000","scrub_duration":0.0011396240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.783809+0000","last_change":"2023-12-07T21:12:21.783809+0000","last_active":"2023-12-07T21:12:21.783809+0000","last_peered":"2023-12-07T21:12:21.783809+0000","last_clean":"2023-12-07T21:12:21.783809+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:12:21.783809+0000","last_undegraded":"2023-12-07T21:12:21.783809+0000","last_fullsized":"2023-12-07T21:12:21.783809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.783687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:25.104216+0000","scrub_duration":0.001223366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.417813+0000","last_change":"2023-12-07T21:12:58.417813+0000","last_active":"2023-12-07T21:12:58.417813+0000","last_peered":"2023-12-07T21:12:58.417813+0000","last_clean":"2023-12-07T21:12:58.417813+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:12:58.417813+0000","last_undegraded":"2023-12-07T21:12:58.417813+0000","last_fullsized":"2023-12-07T21:12:58.417813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.417685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:16.173945+0000","scrub_duration":0.0012264019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.393510+0000","last_change":"2023-12-07T21:12:14.393510+0000","last_active":"2023-12-07T21:12:14.393510+0000","last_peered":"2023-12-07T21:12:14.393510+0000","last_clean":"2023-12-07T21:12:14.393510+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:12:14.393510+0000","last_undegraded":"2023-12-07T21:12:14.393510+0000","last_fullsized":"2023-12-07T21:12:14.393510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.393370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:28.056034+0000","scrub_duration":0.0012787390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.892420+0000","last_change":"2023-12-07T21:14:02.892444+0000","last_active":"2023-12-07T21:14:02.892420+0000","last_peered":"2023-12-07T21:14:02.892420+0000","last_clean":"2023-12-07T21:14:02.892420+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:14:02.892420+0000","last_undegraded":"2023-12-07T21:14:02.892420+0000","last_fullsized":"2023-12-07T21:14:02.892420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:14:02.892333+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:14:02.892333+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.892333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:08:55.928235+0000","scrub_duration":0.001620423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:22.292065+0000","last_change":"2023-12-07T21:12:22.292065+0000","last_active":"2023-12-07T21:12:22.292065+0000","last_peered":"2023-12-07T21:12:22.292065+0000","last_clean":"2023-12-07T21:12:22.292065+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:12:22.292065+0000","last_undegraded":"2023-12-07T21:12:22.292065+0000","last_fullsized":"2023-12-07T21:12:22.292065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_clean_scrub_stamp":"2023-12-07T21:12:22.291964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:19:35.510802+0000","scrub_duration":0.000955034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:52.593198+0000","last_change":"2023-12-07T21:14:52.593220+0000","last_active":"2023-12-07T21:14:52.593198+0000","last_peered":"2023-12-07T21:14:52.593198+0000","last_clean":"2023-12-07T21:14:52.593198+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:14:52.593198+0000","last_undegraded":"2023-12-07T21:14:52.593198+0000","last_fullsized":"2023-12-07T21:14:52.593198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:52.593108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:52.593108+0000","last_clean_scrub_stamp":"2023-12-07T21:14:52.593108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:05:50.085454+0000","scrub_duration":0.001128759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:24.489652+0000","last_change":"2023-12-07T21:12:24.489652+0000","last_active":"2023-12-07T21:12:24.489652+0000","last_peered":"2023-12-07T21:12:24.489652+0000","last_clean":"2023-12-07T21:12:24.489652+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:12:24.489652+0000","last_undegraded":"2023-12-07T21:12:24.489652+0000","last_fullsized":"2023-12-07T21:12:24.489652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_clean_scrub_stamp":"2023-12-07T21:12:24.489525+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:58:44.073512+0000","scrub_duration":0.0022717330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.088717+0000","last_change":"2023-12-07T21:13:21.088717+0000","last_active":"2023-12-07T21:13:21.088717+0000","last_peered":"2023-12-07T21:13:21.088717+0000","last_clean":"2023-12-07T21:13:21.088717+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:13:21.088717+0000","last_undegraded":"2023-12-07T21:13:21.088717+0000","last_fullsized":"2023-12-07T21:13:21.088717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.088571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:31:27.226694+0000","scrub_duration":0.0016712599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.917521+0000","last_change":"2023-12-07T21:13:00.917521+0000","last_active":"2023-12-07T21:13:00.917521+0000","last_peered":"2023-12-07T21:13:00.917521+0000","last_clean":"2023-12-07T21:13:00.917521+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:13:00.917521+0000","last_undegraded":"2023-12-07T21:13:00.917521+0000","last_fullsized":"2023-12-07T21:13:00.917521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.917383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:19.507436+0000","scrub_duration":0.0013780719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.318731+0000","last_change":"2023-12-07T21:13:11.318731+0000","last_active":"2023-12-07T21:13:11.318731+0000","last_peered":"2023-12-07T21:13:11.318731+0000","last_clean":"2023-12-07T21:13:11.318731+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:13:11.318731+0000","last_undegraded":"2023-12-07T21:13:11.318731+0000","last_fullsized":"2023-12-07T21:13:11.318731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.318563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:32:03.116436+0000","scrub_duration":0.0013115340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:33.322751+0000","last_change":"2023-12-07T21:12:33.322751+0000","last_active":"2023-12-07T21:12:33.322751+0000","last_peered":"2023-12-07T21:12:33.322751+0000","last_clean":"2023-12-07T21:12:33.322751+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:12:33.322751+0000","last_undegraded":"2023-12-07T21:12:33.322751+0000","last_fullsized":"2023-12-07T21:12:33.322751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_clean_scrub_stamp":"2023-12-07T21:12:33.322634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:25:00.599068+0000","scrub_duration":0.001216778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.401789+0000","last_change":"2023-12-07T21:13:20.401789+0000","last_active":"2023-12-07T21:13:20.401789+0000","last_peered":"2023-12-07T21:13:20.401789+0000","last_clean":"2023-12-07T21:13:20.401789+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:13:20.401789+0000","last_undegraded":"2023-12-07T21:13:20.401789+0000","last_fullsized":"2023-12-07T21:13:20.401789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.401627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.790385+0000","scrub_duration":0.001405433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:32.342446+0000","last_change":"2023-12-07T21:12:32.342446+0000","last_active":"2023-12-07T21:12:32.342446+0000","last_peered":"2023-12-07T21:12:32.342446+0000","last_clean":"2023-12-07T21:12:32.342446+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:12:32.342446+0000","last_undegraded":"2023-12-07T21:12:32.342446+0000","last_fullsized":"2023-12-07T21:12:32.342446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_clean_scrub_stamp":"2023-12-07T21:12:32.342321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:46.648309+0000","scrub_duration":0.0011184750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:06.373937+0000","last_change":"2023-12-07T21:14:06.373997+0000","last_active":"2023-12-07T21:14:06.373937+0000","last_peered":"2023-12-07T21:14:06.373937+0000","last_clean":"2023-12-07T21:14:06.373937+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:14:06.373937+0000","last_undegraded":"2023-12-07T21:14:06.373937+0000","last_fullsized":"2023-12-07T21:14:06.373937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:14:06.373834+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:14:06.373834+0000","last_clean_scrub_stamp":"2023-12-07T21:14:06.373834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:02:26.088876+0000","scrub_duration":0.0014409469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'16","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.341269+0000","last_change":"2023-12-07T21:12:27.341269+0000","last_active":"2023-12-07T21:12:27.341269+0000","last_peered":"2023-12-07T21:12:27.341269+0000","last_clean":"2023-12-07T21:12:27.341269+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:12:27.341269+0000","last_undegraded":"2023-12-07T21:12:27.341269+0000","last_fullsized":"2023-12-07T21:12:27.341269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.341151+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:55:08.404366+0000","scrub_duration":0.0024774139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:37.308528+0000","last_change":"2023-12-07T21:14:37.308564+0000","last_active":"2023-12-07T21:14:37.308528+0000","last_peered":"2023-12-07T21:14:37.308528+0000","last_clean":"2023-12-07T21:14:37.308528+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:14:37.308528+0000","last_undegraded":"2023-12-07T21:14:37.308528+0000","last_fullsized":"2023-12-07T21:14:37.308528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:37.308430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:37.308430+0000","last_clean_scrub_stamp":"2023-12-07T21:14:37.308430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:48.142425+0000","scrub_duration":0.001498482,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:46.318458+0000","last_change":"2023-12-07T21:13:46.318480+0000","last_active":"2023-12-07T21:13:46.318458+0000","last_peered":"2023-12-07T21:13:46.318458+0000","last_clean":"2023-12-07T21:13:46.318458+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:13:46.318458+0000","last_undegraded":"2023-12-07T21:13:46.318458+0000","last_fullsized":"2023-12-07T21:13:46.318458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:46.318375+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:46.318375+0000","last_clean_scrub_stamp":"2023-12-07T21:13:46.318375+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:20:30.826377+0000","scrub_duration":0.001152574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.462656+0000","last_change":"2023-12-07T21:12:54.462656+0000","last_active":"2023-12-07T21:12:54.462656+0000","last_peered":"2023-12-07T21:12:54.462656+0000","last_clean":"2023-12-07T21:12:54.462656+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:12:54.462656+0000","last_undegraded":"2023-12-07T21:12:54.462656+0000","last_fullsized":"2023-12-07T21:12:54.462656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.462543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:12:35.524119+0000","scrub_duration":0.0012396099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:01.404048+0000","last_change":"2023-12-07T21:12:01.404048+0000","last_active":"2023-12-07T21:12:01.404048+0000","last_peered":"2023-12-07T21:12:01.404048+0000","last_clean":"2023-12-07T21:12:01.404048+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:12:01.404048+0000","last_undegraded":"2023-12-07T21:12:01.404048+0000","last_fullsized":"2023-12-07T21:12:01.404048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_clean_scrub_stamp":"2023-12-07T21:12:01.403925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:06:41.638050+0000","scrub_duration":0.0014963070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:35.302672+0000","last_change":"2023-12-07T21:14:35.302695+0000","last_active":"2023-12-07T21:14:35.302672+0000","last_peered":"2023-12-07T21:14:35.302672+0000","last_clean":"2023-12-07T21:14:35.302672+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:14:35.302672+0000","last_undegraded":"2023-12-07T21:14:35.302672+0000","last_fullsized":"2023-12-07T21:14:35.302672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:35.302580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:35.302580+0000","last_clean_scrub_stamp":"2023-12-07T21:14:35.302580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:25:42.101573+0000","scrub_duration":0.0012938610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:51.554341+0000","last_change":"2023-12-07T21:14:51.554365+0000","last_active":"2023-12-07T21:14:51.554341+0000","last_peered":"2023-12-07T21:14:51.554341+0000","last_clean":"2023-12-07T21:14:51.554341+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:14:51.554341+0000","last_undegraded":"2023-12-07T21:14:51.554341+0000","last_fullsized":"2023-12-07T21:14:51.554341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:14:51.554250+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:14:51.554250+0000","last_clean_scrub_stamp":"2023-12-07T21:14:51.554250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:11:27.227545+0000","scrub_duration":0.00126604,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:06.990943+0000","last_change":"2023-12-07T21:14:06.990967+0000","last_active":"2023-12-07T21:14:06.990943+0000","last_peered":"2023-12-07T21:14:06.990943+0000","last_clean":"2023-12-07T21:14:06.990943+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:14:06.990943+0000","last_undegraded":"2023-12-07T21:14:06.990943+0000","last_fullsized":"2023-12-07T21:14:06.990943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:14:06.990856+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:14:06.990856+0000","last_clean_scrub_stamp":"2023-12-07T21:14:06.990856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:26.019692+0000","scrub_duration":0.0015824859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.910417+0000","last_change":"2023-12-07T21:13:05.910417+0000","last_active":"2023-12-07T21:13:05.910417+0000","last_peered":"2023-12-07T21:13:05.910417+0000","last_clean":"2023-12-07T21:13:05.910417+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:13:05.910417+0000","last_undegraded":"2023-12-07T21:13:05.910417+0000","last_fullsized":"2023-12-07T21:13:05.910417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.910299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:31:57.708172+0000","scrub_duration":0.001525988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.272208+0000","last_change":"2023-12-07T21:12:56.272208+0000","last_active":"2023-12-07T21:12:56.272208+0000","last_peered":"2023-12-07T21:12:56.272208+0000","last_clean":"2023-12-07T21:12:56.272208+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:12:56.272208+0000","last_undegraded":"2023-12-07T21:12:56.272208+0000","last_fullsized":"2023-12-07T21:12:56.272208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.272079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:16.868178+0000","scrub_duration":0.0010823779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1971,"ondisk_log_size":1971,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1439,"ondisk_log_size":1439,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705743,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39964,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331876,"statfs":{"total":96636764160,"available":96595841024,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:14:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.433,"15min":0.42699999999999999},"min":{"1min":0.35099999999999998,"5min":0.182,"15min":0.182},"max":{"1min":0.54500000000000004,"5min":0.58399999999999996,"15min":0.60999999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.34000000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.56999999999999995,"15min":0.69699999999999995},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Dec 7 21:14:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.34000000000000002},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.52200000000000002},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.34399999999999997},"min":{"1min":0.254,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45700000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Dec 7 21:14:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.29599999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.68100000000000005},"last":0.317},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.33600000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.29799999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705742,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.32200000000000001,"5min":0.22900000000000001,"15min":0.20000000000000001},"max":{"1min":0.57499999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.432,"15min":0.432},"min":{"1min":0.30599999999999999,"5min":0.24399999999999999,"15min":0.219},"max":{"1min":0.54100000000000004,"5min":0.59499999999999997,"15min":0.621},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Dec 7 21:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33400000000000002,"15min":0.32300000000000001},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.42699999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.315,"15min":0.32900000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.42499999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.42499999999999999}]},{"osd":3,"last update":"Thu Dec 7 21:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32300000000000001,"15min":0.32800000000000001},"min":{"1min":0.247,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":0.42199999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.371},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.36299999999999999},"min":{"1min":0.28999999999999998,"5min":0.26000000000000001,"15min":0.25700000000000001},"max":{"1min":0.45100000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.45000000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705742,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44700000000000001,"15min":0.45300000000000001},"min":{"1min":0.27600000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.59299999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.23799999999999999,"15min":0.222},"max":{"1min":0.60899999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Dec 7 21:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.35399999999999998},"min":{"1min":0.252,"5min":0.20200000000000001,"15min":0.17799999999999999},"max":{"1min":0.46200000000000002,"5min":0.54200000000000004,"15min":0.629},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.315,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.22,"5min":0.214,"15min":0.186},"max":{"1min":0.40699999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Dec 7 21:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32500000000000001,"15min":0.33900000000000002},"min":{"1min":0.252,"5min":0.191,"15min":0.191},"max":{"1min":0.42999999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.246},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35199999999999998,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.25},"max":{"1min":0.43099999999999999,"5min":0.497,"15min":0.52400000000000002},"last":0.29699999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705743,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.35999999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.63100000000000001,"5min":0.68300000000000005,"15min":0.747},"last":0.629}]},{"osd":2,"last update":"Thu Dec 7 21:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50900000000000001,"15min":0.48699999999999999},"min":{"1min":0.39400000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.77300000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50800000000000001,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66900000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Dec 7 21:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.505,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.49399999999999999},"min":{"1min":0.36599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65200000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:14:54.829 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:54.830 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:54.830 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:54.831 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:54.831 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:54.831 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:54.832 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2023-12-07T21:09:03.896562+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=9, tm_sec=3, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:54.832 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-12-07T21:08:53.839459+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=8, tm_sec=53, tm_wday=3, tm_yday=341, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=7, tm_hour=21, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=341, tm_isdst=0) 2023-12-07T21:14:54.832 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-07T21:15:14.833 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T21:15:14.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.954+0000 7fd5654cf640 1 Processor -- start 2023-12-07T21:15:14.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.954+0000 7fd5654cf640 1 -- start start 2023-12-07T21:15:14.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.955+0000 7fd5654cf640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd56009abf0 0x7fd560132a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:15:14.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.955+0000 7fd5654cf640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd560071b60 con 0x7fd56006c710 2023-12-07T21:15:14.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.955+0000 7fd5654cf640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56006d200 con 0x7fd56009abf0 2023-12-07T21:15:14.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.955+0000 7fd55e7fc640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd56009abf0 0x7fd560132a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:15:14.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.955+0000 7fd55effd640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd56006c710 0x7fd56006caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:46994/0 (socket says 172.21.15.89:46994) 2023-12-07T21:15:14.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.955+0000 7fd55effd640 1 -- 172.21.15.89:0/3948619802 learned_addr learned my addr 172.21.15.89:0/3948619802 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:15:14.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.955+0000 7fd55e7fc640 1 -- 172.21.15.89:0/3948619802 >> v1:172.21.15.89:6789/0 conn(0x7fd56006c710 legacy=0x7fd56006caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:15:14.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.955+0000 7fd55e7fc640 1 -- 172.21.15.89:0/3948619802 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56006d5a0 con 0x7fd56009abf0 2023-12-07T21:15:14.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.956+0000 7fd55e7fc640 1 --2- 172.21.15.89:0/3948619802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56009abf0 0x7fd560132a10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd554009720 tx=0x7fd55402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb86db80d773b13 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:15:14.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.956+0000 7fd55dffb640 1 -- 172.21.15.89:0/3948619802 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd55402e070 con 0x7fd56009abf0 2023-12-07T21:15:14.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.956+0000 7fd55dffb640 1 -- 172.21.15.89:0/3948619802 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5540316d0 con 0x7fd56009abf0 2023-12-07T21:15:14.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.956+0000 7fd55dffb640 1 -- 172.21.15.89:0/3948619802 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd554031990 con 0x7fd56009abf0 2023-12-07T21:15:14.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.957+0000 7fd5654cf640 1 -- 172.21.15.89:0/3948619802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56009abf0 msgr2=0x7fd560132a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:15:14.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.957+0000 7fd5654cf640 1 --2- 172.21.15.89:0/3948619802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56009abf0 0x7fd560132a10 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd554009720 tx=0x7fd55402b840 comp rx=0 tx=0).stop 2023-12-07T21:15:14.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.957+0000 7fd5654cf640 1 -- 172.21.15.89:0/3948619802 shutdown_connections 2023-12-07T21:15:14.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.957+0000 7fd5654cf640 1 --2- 172.21.15.89:0/3948619802 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56009abf0 0x7fd560132a10 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:15:14.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.957+0000 7fd5654cf640 1 -- 172.21.15.89:0/3948619802 >> 172.21.15.89:0/3948619802 conn(0x7fd56009bd80 msgr2=0x7fd56009c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:15:14.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.957+0000 7fd5654cf640 1 -- 172.21.15.89:0/3948619802 shutdown_connections 2023-12-07T21:15:14.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.957+0000 7fd5654cf640 1 -- 172.21.15.89:0/3948619802 wait complete. 2023-12-07T21:15:14.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.958+0000 7fd5654cf640 1 Processor -- start 2023-12-07T21:15:14.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.958+0000 7fd5654cf640 1 -- start start 2023-12-07T21:15:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.958+0000 7fd5654cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56006c710 0x7fd56011c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:15:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.958+0000 7fd5654cf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56011d6a0 con 0x7fd56006c710 2023-12-07T21:15:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.958+0000 7fd55effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56006c710 0x7fd56011c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:15:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.958+0000 7fd55effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56006c710 0x7fd56011c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49162/0 (socket says 172.21.15.89:49162) 2023-12-07T21:15:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.958+0000 7fd55effd640 1 -- 172.21.15.89:0/2442599009 learned_addr learned my addr 172.21.15.89:0/2442599009 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:15:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.959+0000 7fd55effd640 1 -- 172.21.15.89:0/2442599009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd554009400 con 0x7fd56006c710 2023-12-07T21:15:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.959+0000 7fd55effd640 1 --2- 172.21.15.89:0/2442599009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56006c710 0x7fd56011c4b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd55000cb20 tx=0x7fd55000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:15:14.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.959+0000 7fd5477fe640 1 -- 172.21.15.89:0/2442599009 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd55000abf0 con 0x7fd56006c710 2023-12-07T21:15:14.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.959+0000 7fd5477fe640 1 -- 172.21.15.89:0/2442599009 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55000ad50 con 0x7fd56006c710 2023-12-07T21:15:14.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.959+0000 7fd5654cf640 1 -- 172.21.15.89:0/2442599009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56011f6c0 con 0x7fd56006c710 2023-12-07T21:15:14.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.959+0000 7fd5477fe640 1 -- 172.21.15.89:0/2442599009 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd550012400 con 0x7fd56006c710 2023-12-07T21:15:14.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.959+0000 7fd5654cf640 1 -- 172.21.15.89:0/2442599009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56011f030 con 0x7fd56006c710 2023-12-07T21:15:14.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.960+0000 7fd5477fe640 1 -- 172.21.15.89:0/2442599009 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7fd550012560 con 0x7fd56006c710 2023-12-07T21:15:14.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.960+0000 7fd5477fe640 1 --2- 172.21.15.89:0/2442599009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd54c037820 0x7fd54c039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:15:14.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.960+0000 7fd5477fe640 1 -- 172.21.15.89:0/2442599009 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7fd55004ab50 con 0x7fd56006c710 2023-12-07T21:15:14.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.960+0000 7fd5654cf640 1 -- 172.21.15.89:0/2442599009 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56011ee90 con 0x7fd56006c710 2023-12-07T21:15:14.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.960+0000 7fd55e7fc640 1 --2- 172.21.15.89:0/2442599009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd54c037820 0x7fd54c039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:15:14.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.961+0000 7fd55e7fc640 1 --2- 172.21.15.89:0/2442599009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd54c037820 0x7fd54c039ce0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd56009b010 tx=0x7fd554008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:15:14.954 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:14.965+0000 7fd5477fe640 1 -- 172.21.15.89:0/2442599009 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd56011ee90 con 0x7fd56006c710 2023-12-07T21:15:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.128+0000 7fd5654cf640 1 -- 172.21.15.89:0/2442599009 --> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd56006dc40 con 0x7fd54c037820 2023-12-07T21:15:15.133 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.143+0000 7fd5477fe640 1 -- 172.21.15.89:0/2442599009 <== mgr.4101 v2:172.21.15.121:6824/3175226153 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+677966 (secure 0 0 0) 0x7fd554031be0 con 0x7fd54c037820 2023-12-07T21:15:15.141 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-12-07T21:15:15.146 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2023-12-07T21:15:15.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.148+0000 7fd5654cf640 1 -- 172.21.15.89:0/2442599009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd54c037820 msgr2=0x7fd54c039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:15:15.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.148+0000 7fd5654cf640 1 --2- 172.21.15.89:0/2442599009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd54c037820 0x7fd54c039ce0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd56009b010 tx=0x7fd554008030 comp rx=0 tx=0).stop 2023-12-07T21:15:15.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.148+0000 7fd5654cf640 1 -- 172.21.15.89:0/2442599009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56006c710 msgr2=0x7fd56011c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:15:15.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.148+0000 7fd5654cf640 1 --2- 172.21.15.89:0/2442599009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56006c710 0x7fd56011c4b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fd55000cb20 tx=0x7fd55000a060 comp rx=0 tx=0).stop 2023-12-07T21:15:15.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.148+0000 7fd5654cf640 1 -- 172.21.15.89:0/2442599009 shutdown_connections 2023-12-07T21:15:15.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.148+0000 7fd5654cf640 1 --2- 172.21.15.89:0/2442599009 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7fd54c037820 0x7fd54c039ce0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:15:15.149 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.148+0000 7fd5654cf640 1 --2- 172.21.15.89:0/2442599009 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd56006c710 0x7fd56011c4b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:15:15.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.148+0000 7fd5654cf640 1 -- 172.21.15.89:0/2442599009 >> 172.21.15.89:0/2442599009 conn(0x7fd56009bd80 msgr2=0x7fd560099030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:15:15.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.148+0000 7fd5654cf640 1 -- 172.21.15.89:0/2442599009 shutdown_connections 2023-12-07T21:15:15.150 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.148+0000 7fd5654cf640 1 -- 172.21.15.89:0/2442599009 wait complete. 2023-12-07T21:15:15.150 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2023-12-07T21:15:14.169077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600856,"num_objects":218,"num_object_clones":0,"num_object_copies":437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":218,"num_whiteouts":0,"num_read":3521,"num_read_kb":3169,"num_write":1520,"num_write_kb":31932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1822,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4024,"ondisk_log_size":4024,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152540,"kb_used_data":2876,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334820,"statfs":{"total":386547056640,"available":386390855680,"internally_reserved":0,"allocated":2945024,"data_stored":1775956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6376,"internal_metadata":153216792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003792"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:19.413127+0000","last_change":"2023-12-07T21:13:19.413127+0000","last_active":"2023-12-07T21:13:19.413127+0000","last_peered":"2023-12-07T21:13:19.413127+0000","last_clean":"2023-12-07T21:13:19.413127+0000","last_became_active":"2023-12-07T21:08:54.882643+0000","last_became_peered":"2023-12-07T21:08:54.882643+0000","last_unstale":"2023-12-07T21:13:19.413127+0000","last_undegraded":"2023-12-07T21:13:19.413127+0000","last_fullsized":"2023-12-07T21:13:19.413127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:19.413017+0000","last_clean_scrub_stamp":"2023-12-07T21:13:19.413017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:51.122054+0000","scrub_duration":0.001250333,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.407256+0000","last_change":"2023-12-07T21:12:16.407256+0000","last_active":"2023-12-07T21:12:16.407256+0000","last_peered":"2023-12-07T21:12:16.407256+0000","last_clean":"2023-12-07T21:12:16.407256+0000","last_became_active":"2023-12-07T21:08:56.886640+0000","last_became_peered":"2023-12-07T21:08:56.886640+0000","last_unstale":"2023-12-07T21:12:16.407256+0000","last_undegraded":"2023-12-07T21:12:16.407256+0000","last_fullsized":"2023-12-07T21:12:16.407256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:16.407151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.407151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:13:53.647151+0000","scrub_duration":0.00097124400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.079732+0000","last_change":"2023-12-07T21:13:28.079732+0000","last_active":"2023-12-07T21:13:28.079732+0000","last_peered":"2023-12-07T21:13:28.079732+0000","last_clean":"2023-12-07T21:13:28.079732+0000","last_became_active":"2023-12-07T21:08:54.890302+0000","last_became_peered":"2023-12-07T21:08:54.890302+0000","last_unstale":"2023-12-07T21:13:28.079732+0000","last_undegraded":"2023-12-07T21:13:28.079732+0000","last_fullsized":"2023-12-07T21:13:28.079732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.079572+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.079572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:44:03.747216+0000","scrub_duration":0.0011377760000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:30.001172+0000","last_change":"2023-12-07T21:14:30.001172+0000","last_active":"2023-12-07T21:14:30.001172+0000","last_peered":"2023-12-07T21:14:30.001172+0000","last_clean":"2023-12-07T21:14:30.001172+0000","last_became_active":"2023-12-07T21:09:35.948093+0000","last_became_peered":"2023-12-07T21:09:35.948093+0000","last_unstale":"2023-12-07T21:14:30.001172+0000","last_undegraded":"2023-12-07T21:14:30.001172+0000","last_fullsized":"2023-12-07T21:14:30.001172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:14:30.001034+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:14:30.001034+0000","last_clean_scrub_stamp":"2023-12-07T21:14:30.001034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:47:32.102632+0000","scrub_duration":0.0013113129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:14.442399+0000","last_change":"2023-12-07T21:14:14.442399+0000","last_active":"2023-12-07T21:14:14.442399+0000","last_peered":"2023-12-07T21:14:14.442399+0000","last_clean":"2023-12-07T21:14:14.442399+0000","last_became_active":"2023-12-07T21:08:54.892384+0000","last_became_peered":"2023-12-07T21:08:54.892384+0000","last_unstale":"2023-12-07T21:14:14.442399+0000","last_undegraded":"2023-12-07T21:14:14.442399+0000","last_fullsized":"2023-12-07T21:14:14.442399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:14:14.442278+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:14:14.442278+0000","last_clean_scrub_stamp":"2023-12-07T21:14:14.442278+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:47:40.059438+0000","scrub_duration":0.001334046,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.314629+0000","last_change":"2023-12-07T21:13:48.314629+0000","last_active":"2023-12-07T21:13:48.314629+0000","last_peered":"2023-12-07T21:13:48.314629+0000","last_clean":"2023-12-07T21:13:48.314629+0000","last_became_active":"2023-12-07T21:08:56.873630+0000","last_became_peered":"2023-12-07T21:08:56.873630+0000","last_unstale":"2023-12-07T21:13:48.314629+0000","last_undegraded":"2023-12-07T21:13:48.314629+0000","last_fullsized":"2023-12-07T21:13:48.314629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:48.314524+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:48.314524+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.314524+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:17:28.252223+0000","scrub_duration":0.00098961300000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:39.350144+0000","last_change":"2023-12-07T21:13:39.350144+0000","last_active":"2023-12-07T21:13:39.350144+0000","last_peered":"2023-12-07T21:13:39.350144+0000","last_clean":"2023-12-07T21:13:39.350144+0000","last_became_active":"2023-12-07T21:08:54.879709+0000","last_became_peered":"2023-12-07T21:08:54.879709+0000","last_unstale":"2023-12-07T21:13:39.350144+0000","last_undegraded":"2023-12-07T21:13:39.350144+0000","last_fullsized":"2023-12-07T21:13:39.350144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:39.350003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:39.350003+0000","last_clean_scrub_stamp":"2023-12-07T21:13:39.350003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:26:22.544329+0000","scrub_duration":0.0013539439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:32.502187+0000","last_change":"2023-12-07T21:13:32.502187+0000","last_active":"2023-12-07T21:13:32.502187+0000","last_peered":"2023-12-07T21:13:32.502187+0000","last_clean":"2023-12-07T21:13:32.502187+0000","last_became_active":"2023-12-07T21:08:56.874346+0000","last_became_peered":"2023-12-07T21:08:56.874346+0000","last_unstale":"2023-12-07T21:13:32.502187+0000","last_undegraded":"2023-12-07T21:13:32.502187+0000","last_fullsized":"2023-12-07T21:13:32.502187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:32.502047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:32.502047+0000","last_clean_scrub_stamp":"2023-12-07T21:13:32.502047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:14:30.083430+0000","scrub_duration":0.001154356,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:39.336854+0000","last_change":"2023-12-07T21:14:39.336893+0000","last_active":"2023-12-07T21:14:39.336854+0000","last_peered":"2023-12-07T21:14:39.336854+0000","last_clean":"2023-12-07T21:14:39.336854+0000","last_became_active":"2023-12-07T21:08:54.886216+0000","last_became_peered":"2023-12-07T21:08:54.886216+0000","last_unstale":"2023-12-07T21:14:39.336854+0000","last_undegraded":"2023-12-07T21:14:39.336854+0000","last_fullsized":"2023-12-07T21:14:39.336854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:39.336739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:39.336739+0000","last_clean_scrub_stamp":"2023-12-07T21:14:39.336739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:58:04.256324+0000","scrub_duration":0.001451075,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'8","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.836443+0000","last_change":"2023-12-07T21:12:39.304151+0000","last_active":"2023-12-07T21:12:58.836443+0000","last_peered":"2023-12-07T21:12:58.836443+0000","last_clean":"2023-12-07T21:12:58.836443+0000","last_became_active":"2023-12-07T21:08:56.873139+0000","last_became_peered":"2023-12-07T21:08:56.873139+0000","last_unstale":"2023-12-07T21:12:58.836443+0000","last_undegraded":"2023-12-07T21:12:58.836443+0000","last_fullsized":"2023-12-07T21:12:58.836443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:39.304039+0000","last_clean_scrub_stamp":"2023-12-07T21:12:39.304039+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:10.499475+0000","scrub_duration":0.0026021579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:35.274268+0000","last_change":"2023-12-07T21:13:35.274268+0000","last_active":"2023-12-07T21:13:35.274268+0000","last_peered":"2023-12-07T21:13:35.274268+0000","last_clean":"2023-12-07T21:13:35.274268+0000","last_became_active":"2023-12-07T21:08:54.879691+0000","last_became_peered":"2023-12-07T21:08:54.879691+0000","last_unstale":"2023-12-07T21:13:35.274268+0000","last_undegraded":"2023-12-07T21:13:35.274268+0000","last_fullsized":"2023-12-07T21:13:35.274268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:35.274152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:35.274152+0000","last_clean_scrub_stamp":"2023-12-07T21:13:35.274152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:55:25.519724+0000","scrub_duration":0.0012329559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:16.527864+0000","last_change":"2023-12-07T21:14:16.527886+0000","last_active":"2023-12-07T21:14:16.527864+0000","last_peered":"2023-12-07T21:14:16.527864+0000","last_clean":"2023-12-07T21:14:16.527864+0000","last_became_active":"2023-12-07T21:09:35.951436+0000","last_became_peered":"2023-12-07T21:09:35.951436+0000","last_unstale":"2023-12-07T21:14:16.527864+0000","last_undegraded":"2023-12-07T21:14:16.527864+0000","last_fullsized":"2023-12-07T21:14:16.527864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:14:16.527771+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:14:16.527771+0000","last_clean_scrub_stamp":"2023-12-07T21:14:16.527771+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:34:09.256870+0000","scrub_duration":0.0023275589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:28.377582+0000","last_change":"2023-12-07T21:14:28.377606+0000","last_active":"2023-12-07T21:14:28.377582+0000","last_peered":"2023-12-07T21:14:28.377582+0000","last_clean":"2023-12-07T21:14:28.377582+0000","last_became_active":"2023-12-07T21:08:54.875129+0000","last_became_peered":"2023-12-07T21:08:54.875129+0000","last_unstale":"2023-12-07T21:14:28.377582+0000","last_undegraded":"2023-12-07T21:14:28.377582+0000","last_fullsized":"2023-12-07T21:14:28.377582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:28.377486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:28.377486+0000","last_clean_scrub_stamp":"2023-12-07T21:14:28.377486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:19:22.031779+0000","scrub_duration":0.0011797929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.406569+0000","last_change":"2023-12-07T21:13:54.406569+0000","last_active":"2023-12-07T21:13:54.406569+0000","last_peered":"2023-12-07T21:13:54.406569+0000","last_clean":"2023-12-07T21:13:54.406569+0000","last_became_active":"2023-12-07T21:08:56.877712+0000","last_became_peered":"2023-12-07T21:08:56.877712+0000","last_unstale":"2023-12-07T21:13:54.406569+0000","last_undegraded":"2023-12-07T21:13:54.406569+0000","last_fullsized":"2023-12-07T21:13:54.406569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:54.406416+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:54.406416+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.406416+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:23:33.794119+0000","scrub_duration":0.001131316,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.845908+0000","last_change":"2023-12-07T21:12:54.845908+0000","last_active":"2023-12-07T21:12:54.845908+0000","last_peered":"2023-12-07T21:12:54.845908+0000","last_clean":"2023-12-07T21:12:54.845908+0000","last_became_active":"2023-12-07T21:08:54.890738+0000","last_became_peered":"2023-12-07T21:08:54.890738+0000","last_unstale":"2023-12-07T21:12:54.845908+0000","last_undegraded":"2023-12-07T21:12:54.845908+0000","last_fullsized":"2023-12-07T21:12:54.845908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.845780+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.845780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:05.129794+0000","scrub_duration":0.001437123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'14","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.839248+0000","last_change":"2023-12-07T21:12:49.396728+0000","last_active":"2023-12-07T21:13:08.839248+0000","last_peered":"2023-12-07T21:13:08.839248+0000","last_clean":"2023-12-07T21:13:08.839248+0000","last_became_active":"2023-12-07T21:08:56.874061+0000","last_became_peered":"2023-12-07T21:08:56.874061+0000","last_unstale":"2023-12-07T21:13:08.839248+0000","last_undegraded":"2023-12-07T21:13:08.839248+0000","last_fullsized":"2023-12-07T21:13:08.839248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:49.396576+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.396576+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:24:16.481666+0000","scrub_duration":0.0022819030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.406138+0000","last_change":"2023-12-07T21:13:44.406161+0000","last_active":"2023-12-07T21:13:44.406138+0000","last_peered":"2023-12-07T21:13:44.406138+0000","last_clean":"2023-12-07T21:13:44.406138+0000","last_became_active":"2023-12-07T21:08:56.874141+0000","last_became_peered":"2023-12-07T21:08:56.874141+0000","last_unstale":"2023-12-07T21:13:44.406138+0000","last_undegraded":"2023-12-07T21:13:44.406138+0000","last_fullsized":"2023-12-07T21:13:44.406138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:44.406055+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:44.406055+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.406055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:05:23.635609+0000","scrub_duration":0.001103677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:46.400680+0000","last_change":"2023-12-07T21:12:46.400680+0000","last_active":"2023-12-07T21:12:46.400680+0000","last_peered":"2023-12-07T21:12:46.400680+0000","last_clean":"2023-12-07T21:12:46.400680+0000","last_became_active":"2023-12-07T21:08:54.886672+0000","last_became_peered":"2023-12-07T21:08:54.886672+0000","last_unstale":"2023-12-07T21:12:46.400680+0000","last_undegraded":"2023-12-07T21:12:46.400680+0000","last_fullsized":"2023-12-07T21:12:46.400680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:46.400562+0000","last_clean_scrub_stamp":"2023-12-07T21:12:46.400562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:25.935064+0000","scrub_duration":0.001127915,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:34.273474+0000","last_change":"2023-12-07T21:12:34.273474+0000","last_active":"2023-12-07T21:12:34.273474+0000","last_peered":"2023-12-07T21:12:34.273474+0000","last_clean":"2023-12-07T21:12:34.273474+0000","last_became_active":"2023-12-07T21:08:56.876317+0000","last_became_peered":"2023-12-07T21:08:56.876317+0000","last_unstale":"2023-12-07T21:12:34.273474+0000","last_undegraded":"2023-12-07T21:12:34.273474+0000","last_fullsized":"2023-12-07T21:12:34.273474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:34.273360+0000","last_clean_scrub_stamp":"2023-12-07T21:12:34.273360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:01:32.940162+0000","scrub_duration":0.0011278239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.451445+0000","last_change":"2023-12-07T21:12:52.451445+0000","last_active":"2023-12-07T21:12:52.451445+0000","last_peered":"2023-12-07T21:12:52.451445+0000","last_clean":"2023-12-07T21:12:52.451445+0000","last_became_active":"2023-12-07T21:08:54.884949+0000","last_became_peered":"2023-12-07T21:08:54.884949+0000","last_unstale":"2023-12-07T21:12:52.451445+0000","last_undegraded":"2023-12-07T21:12:52.451445+0000","last_fullsized":"2023-12-07T21:12:52.451445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:52.451316+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.451316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:57.500148+0000","scrub_duration":0.001350272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.263073+0000","last_change":"2023-12-07T21:13:14.263073+0000","last_active":"2023-12-07T21:13:14.263073+0000","last_peered":"2023-12-07T21:13:14.263073+0000","last_clean":"2023-12-07T21:13:14.263073+0000","last_became_active":"2023-12-07T21:08:56.881903+0000","last_became_peered":"2023-12-07T21:08:56.881903+0000","last_unstale":"2023-12-07T21:13:14.263073+0000","last_undegraded":"2023-12-07T21:13:14.263073+0000","last_fullsized":"2023-12-07T21:13:14.263073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:13:14.262960+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.262960+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:28.327063+0000","scrub_duration":0.0023679700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:16.262731+0000","last_change":"2023-12-07T21:13:16.262731+0000","last_active":"2023-12-07T21:13:16.262731+0000","last_peered":"2023-12-07T21:13:16.262731+0000","last_clean":"2023-12-07T21:13:16.262731+0000","last_became_active":"2023-12-07T21:08:54.889399+0000","last_became_peered":"2023-12-07T21:08:54.889399+0000","last_unstale":"2023-12-07T21:13:16.262731+0000","last_undegraded":"2023-12-07T21:13:16.262731+0000","last_fullsized":"2023-12-07T21:13:16.262731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:16.262599+0000","last_clean_scrub_stamp":"2023-12-07T21:13:16.262599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:56:19.678023+0000","scrub_duration":0.001231251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'10","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:40.827245+0000","last_change":"2023-12-07T21:12:40.827245+0000","last_active":"2023-12-07T21:12:40.827245+0000","last_peered":"2023-12-07T21:12:40.827245+0000","last_clean":"2023-12-07T21:12:40.827245+0000","last_became_active":"2023-12-07T21:08:56.875658+0000","last_became_peered":"2023-12-07T21:08:56.875658+0000","last_unstale":"2023-12-07T21:12:40.827245+0000","last_undegraded":"2023-12-07T21:12:40.827245+0000","last_fullsized":"2023-12-07T21:12:40.827245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:40.827135+0000","last_clean_scrub_stamp":"2023-12-07T21:12:40.827135+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:27:20.361638+0000","scrub_duration":0.0013685839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:31.449807+0000","last_change":"2023-12-07T21:13:31.449807+0000","last_active":"2023-12-07T21:13:31.449807+0000","last_peered":"2023-12-07T21:13:31.449807+0000","last_clean":"2023-12-07T21:13:31.449807+0000","last_became_active":"2023-12-07T21:08:54.878223+0000","last_became_peered":"2023-12-07T21:08:54.878223+0000","last_unstale":"2023-12-07T21:13:31.449807+0000","last_undegraded":"2023-12-07T21:13:31.449807+0000","last_fullsized":"2023-12-07T21:13:31.449807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:31.449683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:31.449683+0000","last_clean_scrub_stamp":"2023-12-07T21:13:31.449683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:54:42.768855+0000","scrub_duration":0.001302246,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:53.488138+0000","last_change":"2023-12-07T21:12:53.488138+0000","last_active":"2023-12-07T21:12:53.488138+0000","last_peered":"2023-12-07T21:12:53.488138+0000","last_clean":"2023-12-07T21:12:53.488138+0000","last_became_active":"2023-12-07T21:08:56.874746+0000","last_became_peered":"2023-12-07T21:08:56.874746+0000","last_unstale":"2023-12-07T21:12:53.488138+0000","last_undegraded":"2023-12-07T21:12:53.488138+0000","last_fullsized":"2023-12-07T21:12:53.488138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:53.488022+0000","last_clean_scrub_stamp":"2023-12-07T21:12:53.488022+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:20:06.706860+0000","scrub_duration":0.0010715880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.914123+0000","last_change":"2023-12-07T21:12:58.914123+0000","last_active":"2023-12-07T21:12:58.914123+0000","last_peered":"2023-12-07T21:12:58.914123+0000","last_clean":"2023-12-07T21:12:58.914123+0000","last_became_active":"2023-12-07T21:08:54.890210+0000","last_became_peered":"2023-12-07T21:08:54.890210+0000","last_unstale":"2023-12-07T21:12:58.914123+0000","last_undegraded":"2023-12-07T21:12:58.914123+0000","last_fullsized":"2023-12-07T21:12:58.914123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.913992+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.913992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:18.497979+0000","scrub_duration":0.0013136269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.336936+0000","last_change":"2023-12-07T21:12:23.336936+0000","last_active":"2023-12-07T21:12:23.336936+0000","last_peered":"2023-12-07T21:12:23.336936+0000","last_clean":"2023-12-07T21:12:23.336936+0000","last_became_active":"2023-12-07T21:08:56.883279+0000","last_became_peered":"2023-12-07T21:08:56.883279+0000","last_unstale":"2023-12-07T21:12:23.336936+0000","last_undegraded":"2023-12-07T21:12:23.336936+0000","last_fullsized":"2023-12-07T21:12:23.336936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.336820+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.336820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:54.775680+0000","scrub_duration":0.0015463409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:09.312912+0000","last_change":"2023-12-07T21:14:09.312936+0000","last_active":"2023-12-07T21:14:09.312912+0000","last_peered":"2023-12-07T21:14:09.312912+0000","last_clean":"2023-12-07T21:14:09.312912+0000","last_became_active":"2023-12-07T21:08:54.875640+0000","last_became_peered":"2023-12-07T21:08:54.875640+0000","last_unstale":"2023-12-07T21:14:09.312912+0000","last_undegraded":"2023-12-07T21:14:09.312912+0000","last_fullsized":"2023-12-07T21:14:09.312912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:09.312814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:09.312814+0000","last_clean_scrub_stamp":"2023-12-07T21:14:09.312814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:15.357851+0000","scrub_duration":0.001286113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'22","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.448678+0000","last_change":"2023-12-07T21:13:44.448678+0000","last_active":"2023-12-07T21:13:44.448678+0000","last_peered":"2023-12-07T21:13:44.448678+0000","last_clean":"2023-12-07T21:13:44.448678+0000","last_became_active":"2023-12-07T21:09:04.931695+0000","last_became_peered":"2023-12-07T21:09:04.931695+0000","last_unstale":"2023-12-07T21:13:44.448678+0000","last_undegraded":"2023-12-07T21:13:44.448678+0000","last_fullsized":"2023-12-07T21:13:44.448678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:13:44.448523+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:13:44.448523+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.448523+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:44:57.772201+0000","scrub_duration":0.0035836259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.461414+0000","last_change":"2023-12-07T21:12:20.461414+0000","last_active":"2023-12-07T21:12:20.461414+0000","last_peered":"2023-12-07T21:12:20.461414+0000","last_clean":"2023-12-07T21:12:20.461414+0000","last_became_active":"2023-12-07T21:08:56.872694+0000","last_became_peered":"2023-12-07T21:08:56.872694+0000","last_unstale":"2023-12-07T21:12:20.461414+0000","last_undegraded":"2023-12-07T21:12:20.461414+0000","last_fullsized":"2023-12-07T21:12:20.461414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:12:20.461275+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.461275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:11:30.745289+0000","scrub_duration":0.0012528039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:23.380288+0000","last_change":"2023-12-07T21:14:23.380309+0000","last_active":"2023-12-07T21:14:23.380288+0000","last_peered":"2023-12-07T21:14:23.380288+0000","last_clean":"2023-12-07T21:14:23.380288+0000","last_became_active":"2023-12-07T21:08:54.885189+0000","last_became_peered":"2023-12-07T21:08:54.885189+0000","last_unstale":"2023-12-07T21:14:23.380288+0000","last_undegraded":"2023-12-07T21:14:23.380288+0000","last_fullsized":"2023-12-07T21:14:23.380288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:23.380196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:23.380196+0000","last_clean_scrub_stamp":"2023-12-07T21:14:23.380196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:43:39.407879+0000","scrub_duration":0.0011949759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"33'2","reported_seq":115,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813687+0000","last_change":"2023-12-07T21:11:12.797174+0000","last_active":"2023-12-07T21:11:23.813687+0000","last_peered":"2023-12-07T21:11:23.813687+0000","last_clean":"2023-12-07T21:11:23.813687+0000","last_became_active":"2023-12-07T21:08:58.878087+0000","last_became_peered":"2023-12-07T21:08:58.878087+0000","last_unstale":"2023-12-07T21:11:23.813687+0000","last_undegraded":"2023-12-07T21:11:23.813687+0000","last_fullsized":"2023-12-07T21:11:23.813687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:11:12.797028+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.797028+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:04.172329+0000","scrub_duration":0.0029501330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":84,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'35","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:03.666683+0000","last_change":"2023-12-07T21:13:03.666683+0000","last_active":"2023-12-07T21:13:03.666683+0000","last_peered":"2023-12-07T21:13:03.666683+0000","last_clean":"2023-12-07T21:13:03.666683+0000","last_became_active":"2023-12-07T21:09:00.895467+0000","last_became_peered":"2023-12-07T21:09:00.895467+0000","last_unstale":"2023-12-07T21:13:03.666683+0000","last_undegraded":"2023-12-07T21:13:03.666683+0000","last_fullsized":"2023-12-07T21:13:03.666683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:13:03.666541+0000","last_clean_scrub_stamp":"2023-12-07T21:13:03.666541+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:29:58.918173+0000","scrub_duration":0.0039456209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.345086+0000","last_change":"2023-12-07T21:12:18.345086+0000","last_active":"2023-12-07T21:12:18.345086+0000","last_peered":"2023-12-07T21:12:18.345086+0000","last_clean":"2023-12-07T21:12:18.345086+0000","last_became_active":"2023-12-07T21:09:02.906987+0000","last_became_peered":"2023-12-07T21:09:02.906987+0000","last_unstale":"2023-12-07T21:12:18.345086+0000","last_undegraded":"2023-12-07T21:12:18.345086+0000","last_fullsized":"2023-12-07T21:12:18.345086+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.344968+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.344968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:53:47.984483+0000","scrub_duration":0.00095218699999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:26.318843+0000","last_change":"2023-12-07T21:12:26.318843+0000","last_active":"2023-12-07T21:12:26.318843+0000","last_peered":"2023-12-07T21:12:26.318843+0000","last_clean":"2023-12-07T21:12:26.318843+0000","last_became_active":"2023-12-07T21:09:04.931675+0000","last_became_peered":"2023-12-07T21:09:04.931675+0000","last_unstale":"2023-12-07T21:12:26.318843+0000","last_undegraded":"2023-12-07T21:12:26.318843+0000","last_fullsized":"2023-12-07T21:12:26.318843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:26.318685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:26.318685+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:35:21.073203+0000","scrub_duration":0.0010887360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.618014+0000","last_change":"2023-12-07T21:13:07.618014+0000","last_active":"2023-12-07T21:13:07.618014+0000","last_peered":"2023-12-07T21:13:07.618014+0000","last_clean":"2023-12-07T21:13:07.618014+0000","last_became_active":"2023-12-07T21:08:56.874016+0000","last_became_peered":"2023-12-07T21:08:56.874016+0000","last_unstale":"2023-12-07T21:13:07.618014+0000","last_undegraded":"2023-12-07T21:13:07.618014+0000","last_fullsized":"2023-12-07T21:13:07.618014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.617909+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.617909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:13.457658+0000","scrub_duration":0.001206459,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:46.387428+0000","last_change":"2023-12-07T21:13:46.387471+0000","last_active":"2023-12-07T21:13:46.387428+0000","last_peered":"2023-12-07T21:13:46.387428+0000","last_clean":"2023-12-07T21:13:46.387428+0000","last_became_active":"2023-12-07T21:08:54.880292+0000","last_became_peered":"2023-12-07T21:08:54.880292+0000","last_unstale":"2023-12-07T21:13:46.387428+0000","last_undegraded":"2023-12-07T21:13:46.387428+0000","last_fullsized":"2023-12-07T21:13:46.387428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:46.387320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:46.387320+0000","last_clean_scrub_stamp":"2023-12-07T21:13:46.387320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:00.451423+0000","scrub_duration":0.0012501120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:53.830085+0000","last_change":"2023-12-07T21:11:53.830085+0000","last_active":"2023-12-07T21:11:53.830085+0000","last_peered":"2023-12-07T21:11:53.830085+0000","last_clean":"2023-12-07T21:11:53.830085+0000","last_became_active":"2023-12-07T21:08:58.877200+0000","last_became_peered":"2023-12-07T21:08:58.877200+0000","last_unstale":"2023-12-07T21:11:53.830085+0000","last_undegraded":"2023-12-07T21:11:53.830085+0000","last_fullsized":"2023-12-07T21:11:53.830085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:53.829969+0000","last_clean_scrub_stamp":"2023-12-07T21:11:53.829969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:09:45.205269+0000","scrub_duration":0.001216066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.814302+0000","last_change":"2023-12-07T21:11:11.053083+0000","last_active":"2023-12-07T21:11:28.814302+0000","last_peered":"2023-12-07T21:11:28.814302+0000","last_clean":"2023-12-07T21:11:28.814302+0000","last_became_active":"2023-12-07T21:09:00.892885+0000","last_became_peered":"2023-12-07T21:09:00.892885+0000","last_unstale":"2023-12-07T21:11:28.814302+0000","last_undegraded":"2023-12-07T21:11:28.814302+0000","last_fullsized":"2023-12-07T21:11:28.814302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:11.052978+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.052978+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:42.987817+0000","scrub_duration":0.0035853970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.304137+0000","last_change":"2023-12-07T21:11:42.304137+0000","last_active":"2023-12-07T21:11:42.304137+0000","last_peered":"2023-12-07T21:11:42.304137+0000","last_clean":"2023-12-07T21:11:42.304137+0000","last_became_active":"2023-12-07T21:09:02.900743+0000","last_became_peered":"2023-12-07T21:09:02.900743+0000","last_unstale":"2023-12-07T21:11:42.304137+0000","last_undegraded":"2023-12-07T21:11:42.304137+0000","last_fullsized":"2023-12-07T21:11:42.304137+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.304031+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.304031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:14.639583+0000","scrub_duration":0.0010594929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"31'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:31.746769+0000","last_change":"2023-12-07T21:12:31.746769+0000","last_active":"2023-12-07T21:12:31.746769+0000","last_peered":"2023-12-07T21:12:31.746769+0000","last_clean":"2023-12-07T21:12:31.746769+0000","last_became_active":"2023-12-07T21:09:04.925163+0000","last_became_peered":"2023-12-07T21:09:04.925163+0000","last_unstale":"2023-12-07T21:12:31.746769+0000","last_undegraded":"2023-12-07T21:12:31.746769+0000","last_fullsized":"2023-12-07T21:12:31.746769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:31.746658+0000","last_clean_scrub_stamp":"2023-12-07T21:12:31.746658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:26:02.942094+0000","scrub_duration":0.00135096,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:14.511164+0000","last_change":"2023-12-07T21:13:14.511164+0000","last_active":"2023-12-07T21:13:14.511164+0000","last_peered":"2023-12-07T21:13:14.511164+0000","last_clean":"2023-12-07T21:13:14.511164+0000","last_became_active":"2023-12-07T21:08:56.874173+0000","last_became_peered":"2023-12-07T21:08:56.874173+0000","last_unstale":"2023-12-07T21:13:14.511164+0000","last_undegraded":"2023-12-07T21:13:14.511164+0000","last_fullsized":"2023-12-07T21:13:14.511164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:14.511066+0000","last_clean_scrub_stamp":"2023-12-07T21:13:14.511066+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:07.222427+0000","scrub_duration":0.0030400240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:53.612056+0000","last_change":"2023-12-07T21:14:53.612083+0000","last_active":"2023-12-07T21:14:53.612056+0000","last_peered":"2023-12-07T21:14:53.612056+0000","last_clean":"2023-12-07T21:14:53.612056+0000","last_became_active":"2023-12-07T21:08:54.884653+0000","last_became_peered":"2023-12-07T21:08:54.884653+0000","last_unstale":"2023-12-07T21:14:53.612056+0000","last_undegraded":"2023-12-07T21:14:53.612056+0000","last_fullsized":"2023-12-07T21:14:53.612056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:53.611960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:53.611960+0000","last_clean_scrub_stamp":"2023-12-07T21:14:53.611960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:31.141507+0000","scrub_duration":0.0011825869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.707102+0000","last_change":"2023-12-07T21:11:58.707102+0000","last_active":"2023-12-07T21:11:58.707102+0000","last_peered":"2023-12-07T21:11:58.707102+0000","last_clean":"2023-12-07T21:11:58.707102+0000","last_became_active":"2023-12-07T21:08:58.879777+0000","last_became_peered":"2023-12-07T21:08:58.879777+0000","last_unstale":"2023-12-07T21:11:58.707102+0000","last_undegraded":"2023-12-07T21:11:58.707102+0000","last_fullsized":"2023-12-07T21:11:58.707102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:58.706965+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.706965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:56:05.594599+0000","scrub_duration":0.0011023249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.554062+0000","last_change":"2023-12-07T21:11:35.554062+0000","last_active":"2023-12-07T21:11:35.554062+0000","last_peered":"2023-12-07T21:11:35.554062+0000","last_clean":"2023-12-07T21:11:35.554062+0000","last_became_active":"2023-12-07T21:09:00.890305+0000","last_became_peered":"2023-12-07T21:09:00.890305+0000","last_unstale":"2023-12-07T21:11:35.554062+0000","last_undegraded":"2023-12-07T21:11:35.554062+0000","last_fullsized":"2023-12-07T21:11:35.554062+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:11:35.553946+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.553946+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:56.699897+0000","scrub_duration":0.0042775269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'247","reported_seq":324,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:50.595156+0000","last_change":"2023-12-07T21:12:50.595156+0000","last_active":"2023-12-07T21:12:50.595156+0000","last_peered":"2023-12-07T21:12:50.595156+0000","last_clean":"2023-12-07T21:12:50.595156+0000","last_became_active":"2023-12-07T21:09:02.905752+0000","last_became_peered":"2023-12-07T21:09:02.905752+0000","last_unstale":"2023-12-07T21:12:50.595156+0000","last_undegraded":"2023-12-07T21:12:50.595156+0000","last_fullsized":"2023-12-07T21:12:50.595156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:50.595047+0000","last_clean_scrub_stamp":"2023-12-07T21:12:50.595047+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:57:35.203698+0000","scrub_duration":0.0029719099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:10.459036+0000","last_change":"2023-12-07T21:14:10.459058+0000","last_active":"2023-12-07T21:14:10.459036+0000","last_peered":"2023-12-07T21:14:10.459036+0000","last_clean":"2023-12-07T21:14:10.459036+0000","last_became_active":"2023-12-07T21:09:04.928078+0000","last_became_peered":"2023-12-07T21:09:04.928078+0000","last_unstale":"2023-12-07T21:14:10.459036+0000","last_undegraded":"2023-12-07T21:14:10.459036+0000","last_fullsized":"2023-12-07T21:14:10.459036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:10.458940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:10.458940+0000","last_clean_scrub_stamp":"2023-12-07T21:14:10.458940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:42:58.903975+0000","scrub_duration":0.0010316520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.764650+0000","last_change":"2023-12-07T21:12:27.764650+0000","last_active":"2023-12-07T21:12:27.764650+0000","last_peered":"2023-12-07T21:12:27.764650+0000","last_clean":"2023-12-07T21:12:27.764650+0000","last_became_active":"2023-12-07T21:08:56.885330+0000","last_became_peered":"2023-12-07T21:08:56.885330+0000","last_unstale":"2023-12-07T21:12:27.764650+0000","last_undegraded":"2023-12-07T21:12:27.764650+0000","last_fullsized":"2023-12-07T21:12:27.764650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:27.764507+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.764507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:17:01.731572+0000","scrub_duration":0.0015146649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.348644+0000","last_change":"2023-12-07T21:13:00.348644+0000","last_active":"2023-12-07T21:13:00.348644+0000","last_peered":"2023-12-07T21:13:00.348644+0000","last_clean":"2023-12-07T21:13:00.348644+0000","last_became_active":"2023-12-07T21:08:54.878121+0000","last_became_peered":"2023-12-07T21:08:54.878121+0000","last_unstale":"2023-12-07T21:13:00.348644+0000","last_undegraded":"2023-12-07T21:13:00.348644+0000","last_fullsized":"2023-12-07T21:13:00.348644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:00.348476+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.348476+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:10.632490+0000","scrub_duration":0.001405367,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813847+0000","last_change":"2023-12-07T21:11:14.775119+0000","last_active":"2023-12-07T21:11:23.813847+0000","last_peered":"2023-12-07T21:11:23.813847+0000","last_clean":"2023-12-07T21:11:23.813847+0000","last_became_active":"2023-12-07T21:09:35.950413+0000","last_became_peered":"2023-12-07T21:09:35.950413+0000","last_unstale":"2023-12-07T21:11:23.813847+0000","last_undegraded":"2023-12-07T21:11:23.813847+0000","last_fullsized":"2023-12-07T21:11:23.813847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.775006+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.775006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:26.357161+0000","scrub_duration":0.00097299599999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'34","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:29.600086+0000","last_change":"2023-12-07T21:11:29.600086+0000","last_active":"2023-12-07T21:11:29.600086+0000","last_peered":"2023-12-07T21:11:29.600086+0000","last_clean":"2023-12-07T21:11:29.600086+0000","last_became_active":"2023-12-07T21:09:00.892496+0000","last_became_peered":"2023-12-07T21:09:00.892496+0000","last_unstale":"2023-12-07T21:11:29.600086+0000","last_undegraded":"2023-12-07T21:11:29.600086+0000","last_fullsized":"2023-12-07T21:11:29.600086+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:29.599963+0000","last_clean_scrub_stamp":"2023-12-07T21:11:29.599963+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:30:03.772118+0000","scrub_duration":0.003554771,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'247","reported_seq":341,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:02.790465+0000","last_change":"2023-12-07T21:12:02.790465+0000","last_active":"2023-12-07T21:12:02.790465+0000","last_peered":"2023-12-07T21:12:02.790465+0000","last_clean":"2023-12-07T21:12:02.790465+0000","last_became_active":"2023-12-07T21:09:02.900898+0000","last_became_peered":"2023-12-07T21:09:02.900898+0000","last_unstale":"2023-12-07T21:12:02.790465+0000","last_undegraded":"2023-12-07T21:12:02.790465+0000","last_fullsized":"2023-12-07T21:12:02.790465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:12:02.790346+0000","last_clean_scrub_stamp":"2023-12-07T21:12:02.790346+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:07.839178+0000","scrub_duration":0.0026089529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:51.249565+0000","last_change":"2023-12-07T21:13:51.249634+0000","last_active":"2023-12-07T21:13:51.249565+0000","last_peered":"2023-12-07T21:13:51.249565+0000","last_clean":"2023-12-07T21:13:51.249565+0000","last_became_active":"2023-12-07T21:08:56.889319+0000","last_became_peered":"2023-12-07T21:08:56.889319+0000","last_unstale":"2023-12-07T21:13:51.249565+0000","last_undegraded":"2023-12-07T21:13:51.249565+0000","last_fullsized":"2023-12-07T21:13:51.249565+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:51.249439+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:51.249439+0000","last_clean_scrub_stamp":"2023-12-07T21:13:51.249439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:43.146224+0000","scrub_duration":0.001108798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.293568+0000","last_change":"2023-12-07T21:13:36.293592+0000","last_active":"2023-12-07T21:13:36.293568+0000","last_peered":"2023-12-07T21:13:36.293568+0000","last_clean":"2023-12-07T21:13:36.293568+0000","last_became_active":"2023-12-07T21:08:54.879678+0000","last_became_peered":"2023-12-07T21:08:54.879678+0000","last_unstale":"2023-12-07T21:13:36.293568+0000","last_undegraded":"2023-12-07T21:13:36.293568+0000","last_fullsized":"2023-12-07T21:13:36.293568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:36.293469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:36.293469+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.293469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:55.877457+0000","scrub_duration":0.0012759609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.443153+0000","last_change":"2023-12-07T21:11:56.443153+0000","last_active":"2023-12-07T21:11:56.443153+0000","last_peered":"2023-12-07T21:11:56.443153+0000","last_clean":"2023-12-07T21:11:56.443153+0000","last_became_active":"2023-12-07T21:08:58.877682+0000","last_became_peered":"2023-12-07T21:08:58.877682+0000","last_unstale":"2023-12-07T21:11:56.443153+0000","last_undegraded":"2023-12-07T21:11:56.443153+0000","last_fullsized":"2023-12-07T21:11:56.443153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.443045+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.443045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:57:05.069384+0000","scrub_duration":0.0010685460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.606842+0000","last_change":"2023-12-07T21:11:39.606842+0000","last_active":"2023-12-07T21:11:39.606842+0000","last_peered":"2023-12-07T21:11:39.606842+0000","last_clean":"2023-12-07T21:11:39.606842+0000","last_became_active":"2023-12-07T21:09:00.888499+0000","last_became_peered":"2023-12-07T21:09:00.888499+0000","last_unstale":"2023-12-07T21:11:39.606842+0000","last_undegraded":"2023-12-07T21:11:39.606842+0000","last_fullsized":"2023-12-07T21:11:39.606842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2023-12-07T21:11:39.606684+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.606684+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:36.950556+0000","scrub_duration":0.0069737849999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:34.781711+0000","last_change":"2023-12-07T21:11:34.781711+0000","last_active":"2023-12-07T21:11:34.781711+0000","last_peered":"2023-12-07T21:11:34.781711+0000","last_clean":"2023-12-07T21:11:34.781711+0000","last_became_active":"2023-12-07T21:09:02.897300+0000","last_became_peered":"2023-12-07T21:09:02.897300+0000","last_unstale":"2023-12-07T21:11:34.781711+0000","last_undegraded":"2023-12-07T21:11:34.781711+0000","last_fullsized":"2023-12-07T21:11:34.781711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:34.781604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:34.781604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:44.478780+0000","scrub_duration":0.001255822,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'3","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.468162+0000","last_change":"2023-12-07T21:14:02.468187+0000","last_active":"2023-12-07T21:14:02.468162+0000","last_peered":"2023-12-07T21:14:02.468162+0000","last_clean":"2023-12-07T21:14:02.468162+0000","last_became_active":"2023-12-07T21:09:04.930898+0000","last_became_peered":"2023-12-07T21:09:04.930898+0000","last_unstale":"2023-12-07T21:14:02.468162+0000","last_undegraded":"2023-12-07T21:14:02.468162+0000","last_fullsized":"2023-12-07T21:14:02.468162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2023-12-07T21:14:02.468073+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2023-12-07T21:14:02.468073+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.468073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:23:15.400853+0000","scrub_duration":0.001158437,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'22","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.326862+0000","last_change":"2023-12-07T21:12:36.326862+0000","last_active":"2023-12-07T21:12:36.326862+0000","last_peered":"2023-12-07T21:12:36.326862+0000","last_clean":"2023-12-07T21:12:36.326862+0000","last_became_active":"2023-12-07T21:08:56.870934+0000","last_became_peered":"2023-12-07T21:08:56.870934+0000","last_unstale":"2023-12-07T21:12:36.326862+0000","last_undegraded":"2023-12-07T21:12:36.326862+0000","last_fullsized":"2023-12-07T21:12:36.326862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2023-12-07T21:12:36.326694+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.326694+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:24:30.282151+0000","scrub_duration":0.0028268410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":94,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.338776+0000","last_change":"2023-12-07T21:13:06.338776+0000","last_active":"2023-12-07T21:13:06.338776+0000","last_peered":"2023-12-07T21:13:06.338776+0000","last_clean":"2023-12-07T21:13:06.338776+0000","last_became_active":"2023-12-07T21:08:54.884362+0000","last_became_peered":"2023-12-07T21:08:54.884362+0000","last_unstale":"2023-12-07T21:13:06.338776+0000","last_undegraded":"2023-12-07T21:13:06.338776+0000","last_fullsized":"2023-12-07T21:13:06.338776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:06.338641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.338641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:59:17.495976+0000","scrub_duration":0.001242176,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:07.717459+0000","last_change":"2023-12-07T21:12:07.717459+0000","last_active":"2023-12-07T21:12:07.717459+0000","last_peered":"2023-12-07T21:12:07.717459+0000","last_clean":"2023-12-07T21:12:07.717459+0000","last_became_active":"2023-12-07T21:08:58.879965+0000","last_became_peered":"2023-12-07T21:08:58.879965+0000","last_unstale":"2023-12-07T21:12:07.717459+0000","last_undegraded":"2023-12-07T21:12:07.717459+0000","last_fullsized":"2023-12-07T21:12:07.717459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:07.717342+0000","last_clean_scrub_stamp":"2023-12-07T21:12:07.717342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:03:32.009926+0000","scrub_duration":0.0014039289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:09.439747+0000","last_change":"2023-12-07T21:12:09.439747+0000","last_active":"2023-12-07T21:12:09.439747+0000","last_peered":"2023-12-07T21:12:09.439747+0000","last_clean":"2023-12-07T21:12:09.439747+0000","last_became_active":"2023-12-07T21:09:00.895125+0000","last_became_peered":"2023-12-07T21:09:00.895125+0000","last_unstale":"2023-12-07T21:12:09.439747+0000","last_undegraded":"2023-12-07T21:12:09.439747+0000","last_fullsized":"2023-12-07T21:12:09.439747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:12:09.439641+0000","last_clean_scrub_stamp":"2023-12-07T21:12:09.439641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:19.195035+0000","scrub_duration":0.0043223589999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.735466+0000","last_change":"2023-12-07T21:11:33.735466+0000","last_active":"2023-12-07T21:11:33.735466+0000","last_peered":"2023-12-07T21:11:33.735466+0000","last_clean":"2023-12-07T21:11:33.735466+0000","last_became_active":"2023-12-07T21:09:02.906476+0000","last_became_peered":"2023-12-07T21:09:02.906476+0000","last_unstale":"2023-12-07T21:11:33.735466+0000","last_undegraded":"2023-12-07T21:11:33.735466+0000","last_fullsized":"2023-12-07T21:11:33.735466+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:33.735352+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.735352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:03.972116+0000","scrub_duration":0.0011441929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:55.388916+0000","last_change":"2023-12-07T21:13:55.388945+0000","last_active":"2023-12-07T21:13:55.388916+0000","last_peered":"2023-12-07T21:13:55.388916+0000","last_clean":"2023-12-07T21:13:55.388916+0000","last_became_active":"2023-12-07T21:09:04.925754+0000","last_became_peered":"2023-12-07T21:09:04.925754+0000","last_unstale":"2023-12-07T21:13:55.388916+0000","last_undegraded":"2023-12-07T21:13:55.388916+0000","last_fullsized":"2023-12-07T21:13:55.388916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:55.388828+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:55.388828+0000","last_clean_scrub_stamp":"2023-12-07T21:13:55.388828+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:43:17.552727+0000","scrub_duration":0.0021899129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:36.429281+0000","last_change":"2023-12-07T21:12:36.429281+0000","last_active":"2023-12-07T21:12:36.429281+0000","last_peered":"2023-12-07T21:12:36.429281+0000","last_clean":"2023-12-07T21:12:36.429281+0000","last_became_active":"2023-12-07T21:08:56.879352+0000","last_became_peered":"2023-12-07T21:08:56.879352+0000","last_unstale":"2023-12-07T21:12:36.429281+0000","last_undegraded":"2023-12-07T21:12:36.429281+0000","last_fullsized":"2023-12-07T21:12:36.429281+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:36.429148+0000","last_clean_scrub_stamp":"2023-12-07T21:12:36.429148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:19.936617+0000","scrub_duration":0.001111988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.297715+0000","last_change":"2023-12-07T21:13:52.297739+0000","last_active":"2023-12-07T21:13:52.297715+0000","last_peered":"2023-12-07T21:13:52.297715+0000","last_clean":"2023-12-07T21:13:52.297715+0000","last_became_active":"2023-12-07T21:08:54.876015+0000","last_became_peered":"2023-12-07T21:08:54.876015+0000","last_unstale":"2023-12-07T21:13:52.297715+0000","last_undegraded":"2023-12-07T21:13:52.297715+0000","last_fullsized":"2023-12-07T21:13:52.297715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:52.297625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:52.297625+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.297625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:57:04.497787+0000","scrub_duration":0.0012997989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.810375+0000","last_change":"2023-12-07T21:12:15.810375+0000","last_active":"2023-12-07T21:12:15.810375+0000","last_peered":"2023-12-07T21:12:15.810375+0000","last_clean":"2023-12-07T21:12:15.810375+0000","last_became_active":"2023-12-07T21:08:58.874288+0000","last_became_peered":"2023-12-07T21:08:58.874288+0000","last_unstale":"2023-12-07T21:12:15.810375+0000","last_undegraded":"2023-12-07T21:12:15.810375+0000","last_fullsized":"2023-12-07T21:12:15.810375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:15.810269+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.810269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:33.566530+0000","scrub_duration":0.0014408579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.522112+0000","last_change":"2023-12-07T21:11:50.522112+0000","last_active":"2023-12-07T21:11:50.522112+0000","last_peered":"2023-12-07T21:11:50.522112+0000","last_clean":"2023-12-07T21:11:50.522112+0000","last_became_active":"2023-12-07T21:09:00.889265+0000","last_became_peered":"2023-12-07T21:09:00.889265+0000","last_unstale":"2023-12-07T21:11:50.522112+0000","last_undegraded":"2023-12-07T21:11:50.522112+0000","last_fullsized":"2023-12-07T21:11:50.522112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:50.521955+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.521955+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:04.827943+0000","scrub_duration":0.0073561030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'246","reported_seq":308,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:35.761887+0000","last_change":"2023-12-07T21:11:35.761887+0000","last_active":"2023-12-07T21:11:35.761887+0000","last_peered":"2023-12-07T21:11:35.761887+0000","last_clean":"2023-12-07T21:11:35.761887+0000","last_became_active":"2023-12-07T21:09:02.905376+0000","last_became_peered":"2023-12-07T21:09:02.905376+0000","last_unstale":"2023-12-07T21:11:35.761887+0000","last_undegraded":"2023-12-07T21:11:35.761887+0000","last_fullsized":"2023-12-07T21:11:35.761887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:35.761766+0000","last_clean_scrub_stamp":"2023-12-07T21:11:35.761766+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:14.383149+0000","scrub_duration":0.0016151640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:10.903257+0000","last_change":"2023-12-07T21:14:10.903279+0000","last_active":"2023-12-07T21:14:10.903257+0000","last_peered":"2023-12-07T21:14:10.903257+0000","last_clean":"2023-12-07T21:14:10.903257+0000","last_became_active":"2023-12-07T21:09:04.919038+0000","last_became_peered":"2023-12-07T21:09:04.919038+0000","last_unstale":"2023-12-07T21:14:10.903257+0000","last_undegraded":"2023-12-07T21:14:10.903257+0000","last_fullsized":"2023-12-07T21:14:10.903257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:14:10.903156+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:14:10.903156+0000","last_clean_scrub_stamp":"2023-12-07T21:14:10.903156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:11:37.591921+0000","scrub_duration":0.001103047,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:55.462356+0000","last_change":"2023-12-07T21:12:55.462356+0000","last_active":"2023-12-07T21:12:55.462356+0000","last_peered":"2023-12-07T21:12:55.462356+0000","last_clean":"2023-12-07T21:12:55.462356+0000","last_became_active":"2023-12-07T21:08:56.870368+0000","last_became_peered":"2023-12-07T21:08:56.870368+0000","last_unstale":"2023-12-07T21:12:55.462356+0000","last_undegraded":"2023-12-07T21:12:55.462356+0000","last_fullsized":"2023-12-07T21:12:55.462356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:55.462251+0000","last_clean_scrub_stamp":"2023-12-07T21:12:55.462251+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:57:45.150167+0000","scrub_duration":0.0012320580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:07.335753+0000","last_change":"2023-12-07T21:14:07.335776+0000","last_active":"2023-12-07T21:14:07.335753+0000","last_peered":"2023-12-07T21:14:07.335753+0000","last_clean":"2023-12-07T21:14:07.335753+0000","last_became_active":"2023-12-07T21:08:54.883965+0000","last_became_peered":"2023-12-07T21:08:54.883965+0000","last_unstale":"2023-12-07T21:14:07.335753+0000","last_undegraded":"2023-12-07T21:14:07.335753+0000","last_fullsized":"2023-12-07T21:14:07.335753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:07.335666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:07.335666+0000","last_clean_scrub_stamp":"2023-12-07T21:14:07.335666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:32:21.017600+0000","scrub_duration":0.0011737270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.753724+0000","last_change":"2023-12-07T21:11:55.753724+0000","last_active":"2023-12-07T21:11:55.753724+0000","last_peered":"2023-12-07T21:11:55.753724+0000","last_clean":"2023-12-07T21:11:55.753724+0000","last_became_active":"2023-12-07T21:08:58.879801+0000","last_became_peered":"2023-12-07T21:08:58.879801+0000","last_unstale":"2023-12-07T21:11:55.753724+0000","last_undegraded":"2023-12-07T21:11:55.753724+0000","last_fullsized":"2023-12-07T21:11:55.753724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.753576+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.753576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:53:37.572475+0000","scrub_duration":0.0013913199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'59","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:31.726564+0000","last_change":"2023-12-07T21:11:31.726564+0000","last_active":"2023-12-07T21:11:31.726564+0000","last_peered":"2023-12-07T21:11:31.726564+0000","last_clean":"2023-12-07T21:11:31.726564+0000","last_became_active":"2023-12-07T21:09:00.894372+0000","last_became_peered":"2023-12-07T21:09:00.894372+0000","last_unstale":"2023-12-07T21:11:31.726564+0000","last_undegraded":"2023-12-07T21:11:31.726564+0000","last_fullsized":"2023-12-07T21:11:31.726564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:31.726451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:31.726451+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:26:36.775283+0000","scrub_duration":0.0038601009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:56.752564+0000","last_change":"2023-12-07T21:11:56.752564+0000","last_active":"2023-12-07T21:11:56.752564+0000","last_peered":"2023-12-07T21:11:56.752564+0000","last_clean":"2023-12-07T21:11:56.752564+0000","last_became_active":"2023-12-07T21:09:02.901031+0000","last_became_peered":"2023-12-07T21:09:02.901031+0000","last_unstale":"2023-12-07T21:11:56.752564+0000","last_undegraded":"2023-12-07T21:11:56.752564+0000","last_fullsized":"2023-12-07T21:11:56.752564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:56.752450+0000","last_clean_scrub_stamp":"2023-12-07T21:11:56.752450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:44.261937+0000","scrub_duration":0.0012919610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'6","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:07.983141+0000","last_change":"2023-12-07T21:14:07.983170+0000","last_active":"2023-12-07T21:14:07.983141+0000","last_peered":"2023-12-07T21:14:07.983141+0000","last_clean":"2023-12-07T21:14:07.983141+0000","last_became_active":"2023-12-07T21:09:04.931564+0000","last_became_peered":"2023-12-07T21:09:04.931564+0000","last_unstale":"2023-12-07T21:14:07.983141+0000","last_undegraded":"2023-12-07T21:14:07.983141+0000","last_fullsized":"2023-12-07T21:14:07.983141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:14:07.983055+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:14:07.983055+0000","last_clean_scrub_stamp":"2023-12-07T21:14:07.983055+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:09:22.412930+0000","scrub_duration":0.0032971929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:17.483370+0000","last_change":"2023-12-07T21:14:17.483392+0000","last_active":"2023-12-07T21:14:17.483370+0000","last_peered":"2023-12-07T21:14:17.483370+0000","last_clean":"2023-12-07T21:14:17.483370+0000","last_became_active":"2023-12-07T21:09:35.950166+0000","last_became_peered":"2023-12-07T21:09:35.950166+0000","last_unstale":"2023-12-07T21:14:17.483370+0000","last_undegraded":"2023-12-07T21:14:17.483370+0000","last_fullsized":"2023-12-07T21:14:17.483370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:17.483282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:17.483282+0000","last_clean_scrub_stamp":"2023-12-07T21:14:17.483282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:28:01.766599+0000","scrub_duration":0.001092197,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:58.953267+0000","last_change":"2023-12-07T21:13:58.953288+0000","last_active":"2023-12-07T21:13:58.953267+0000","last_peered":"2023-12-07T21:13:58.953267+0000","last_clean":"2023-12-07T21:13:58.953267+0000","last_became_active":"2023-12-07T21:08:54.873779+0000","last_became_peered":"2023-12-07T21:08:54.873779+0000","last_unstale":"2023-12-07T21:13:58.953267+0000","last_undegraded":"2023-12-07T21:13:58.953267+0000","last_fullsized":"2023-12-07T21:13:58.953267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:58.953174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:58.953174+0000","last_clean_scrub_stamp":"2023-12-07T21:13:58.953174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:58.135287+0000","scrub_duration":0.0012512140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.578121+0000","last_change":"2023-12-07T21:12:12.578121+0000","last_active":"2023-12-07T21:12:12.578121+0000","last_peered":"2023-12-07T21:12:12.578121+0000","last_clean":"2023-12-07T21:12:12.578121+0000","last_became_active":"2023-12-07T21:08:58.877699+0000","last_became_peered":"2023-12-07T21:08:58.877699+0000","last_unstale":"2023-12-07T21:12:12.578121+0000","last_undegraded":"2023-12-07T21:12:12.578121+0000","last_fullsized":"2023-12-07T21:12:12.578121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:12.578001+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.578001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:21:04.951547+0000","scrub_duration":0.0009980639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'37","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.222572+0000","last_change":"2023-12-07T21:11:32.222572+0000","last_active":"2023-12-07T21:11:32.222572+0000","last_peered":"2023-12-07T21:11:32.222572+0000","last_clean":"2023-12-07T21:11:32.222572+0000","last_became_active":"2023-12-07T21:09:00.892517+0000","last_became_peered":"2023-12-07T21:09:00.892517+0000","last_unstale":"2023-12-07T21:11:32.222572+0000","last_undegraded":"2023-12-07T21:11:32.222572+0000","last_fullsized":"2023-12-07T21:11:32.222572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:32.222451+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.222451+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:29.566323+0000","scrub_duration":0.0042948600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:25.579998+0000","last_change":"2023-12-07T21:13:25.579998+0000","last_active":"2023-12-07T21:13:25.579998+0000","last_peered":"2023-12-07T21:13:25.579998+0000","last_clean":"2023-12-07T21:13:25.579998+0000","last_became_active":"2023-12-07T21:09:02.905847+0000","last_became_peered":"2023-12-07T21:09:02.905847+0000","last_unstale":"2023-12-07T21:13:25.579998+0000","last_undegraded":"2023-12-07T21:13:25.579998+0000","last_fullsized":"2023-12-07T21:13:25.579998+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:25.579880+0000","last_clean_scrub_stamp":"2023-12-07T21:13:25.579880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:22:49.341694+0000","scrub_duration":0.001424259,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:15:01.655749+0000","last_change":"2023-12-07T21:15:01.655749+0000","last_active":"2023-12-07T21:15:01.655749+0000","last_peered":"2023-12-07T21:15:01.655749+0000","last_clean":"2023-12-07T21:15:01.655749+0000","last_became_active":"2023-12-07T21:09:04.927984+0000","last_became_peered":"2023-12-07T21:09:04.927984+0000","last_unstale":"2023-12-07T21:15:01.655749+0000","last_undegraded":"2023-12-07T21:15:01.655749+0000","last_fullsized":"2023-12-07T21:15:01.655749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:15:01.655636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:15:01.655636+0000","last_clean_scrub_stamp":"2023-12-07T21:15:01.655636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:41:41.252672+0000","scrub_duration":0.001177177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'10","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:18.499430+0000","last_change":"2023-12-07T21:14:18.499472+0000","last_active":"2023-12-07T21:14:18.499430+0000","last_peered":"2023-12-07T21:14:18.499430+0000","last_clean":"2023-12-07T21:14:18.499430+0000","last_became_active":"2023-12-07T21:09:35.952929+0000","last_became_peered":"2023-12-07T21:09:35.952929+0000","last_unstale":"2023-12-07T21:14:18.499430+0000","last_undegraded":"2023-12-07T21:14:18.499430+0000","last_fullsized":"2023-12-07T21:14:18.499430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:14:18.499337+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:14:18.499337+0000","last_clean_scrub_stamp":"2023-12-07T21:14:18.499337+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:40:45.976981+0000","scrub_duration":0.0011107020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:04.345887+0000","last_change":"2023-12-07T21:14:04.345941+0000","last_active":"2023-12-07T21:14:04.345887+0000","last_peered":"2023-12-07T21:14:04.345887+0000","last_clean":"2023-12-07T21:14:04.345887+0000","last_became_active":"2023-12-07T21:08:54.875317+0000","last_became_peered":"2023-12-07T21:08:54.875317+0000","last_unstale":"2023-12-07T21:14:04.345887+0000","last_undegraded":"2023-12-07T21:14:04.345887+0000","last_fullsized":"2023-12-07T21:14:04.345887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:04.345774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:04.345774+0000","last_clean_scrub_stamp":"2023-12-07T21:14:04.345774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:03:45.945110+0000","scrub_duration":0.0013151079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:54.784564+0000","last_change":"2023-12-07T21:11:54.784564+0000","last_active":"2023-12-07T21:11:54.784564+0000","last_peered":"2023-12-07T21:11:54.784564+0000","last_clean":"2023-12-07T21:11:54.784564+0000","last_became_active":"2023-12-07T21:08:58.879660+0000","last_became_peered":"2023-12-07T21:08:58.879660+0000","last_unstale":"2023-12-07T21:11:54.784564+0000","last_undegraded":"2023-12-07T21:11:54.784564+0000","last_fullsized":"2023-12-07T21:11:54.784564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:54.784441+0000","last_clean_scrub_stamp":"2023-12-07T21:11:54.784441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:14:06.366596+0000","scrub_duration":0.001044002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.576788+0000","last_change":"2023-12-07T21:11:38.576788+0000","last_active":"2023-12-07T21:11:38.576788+0000","last_peered":"2023-12-07T21:11:38.576788+0000","last_clean":"2023-12-07T21:11:38.576788+0000","last_became_active":"2023-12-07T21:09:00.884494+0000","last_became_peered":"2023-12-07T21:09:00.884494+0000","last_unstale":"2023-12-07T21:11:38.576788+0000","last_undegraded":"2023-12-07T21:11:38.576788+0000","last_fullsized":"2023-12-07T21:11:38.576788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:11:38.576637+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.576637+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:37:48.632379+0000","scrub_duration":0.0068514220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'246","reported_seq":337,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.625046+0000","last_change":"2023-12-07T21:11:28.625046+0000","last_active":"2023-12-07T21:11:28.625046+0000","last_peered":"2023-12-07T21:11:28.625046+0000","last_clean":"2023-12-07T21:11:28.625046+0000","last_became_active":"2023-12-07T21:09:02.897132+0000","last_became_peered":"2023-12-07T21:09:02.897132+0000","last_unstale":"2023-12-07T21:11:28.625046+0000","last_undegraded":"2023-12-07T21:11:28.625046+0000","last_fullsized":"2023-12-07T21:11:28.625046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:28.624927+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.624927+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:48:22.339116+0000","scrub_duration":0.001431306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'10","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:16.858711+0000","last_change":"2023-12-07T21:12:16.858711+0000","last_active":"2023-12-07T21:12:16.858711+0000","last_peered":"2023-12-07T21:12:16.858711+0000","last_clean":"2023-12-07T21:12:16.858711+0000","last_became_active":"2023-12-07T21:09:04.919012+0000","last_became_peered":"2023-12-07T21:09:04.919012+0000","last_unstale":"2023-12-07T21:12:16.858711+0000","last_undegraded":"2023-12-07T21:12:16.858711+0000","last_fullsized":"2023-12-07T21:12:16.858711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:12:16.858602+0000","last_clean_scrub_stamp":"2023-12-07T21:12:16.858602+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:29:51.847246+0000","scrub_duration":0.0011473449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.447750+0000","last_change":"2023-12-07T21:13:23.447750+0000","last_active":"2023-12-07T21:13:23.447750+0000","last_peered":"2023-12-07T21:13:23.447750+0000","last_clean":"2023-12-07T21:13:23.447750+0000","last_became_active":"2023-12-07T21:08:56.879828+0000","last_became_peered":"2023-12-07T21:08:56.879828+0000","last_unstale":"2023-12-07T21:13:23.447750+0000","last_undegraded":"2023-12-07T21:13:23.447750+0000","last_fullsized":"2023-12-07T21:13:23.447750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.447646+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.447646+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:28:02.982148+0000","scrub_duration":0.0010737139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:03.361960+0000","last_change":"2023-12-07T21:14:03.361984+0000","last_active":"2023-12-07T21:14:03.361960+0000","last_peered":"2023-12-07T21:14:03.361960+0000","last_clean":"2023-12-07T21:14:03.361960+0000","last_became_active":"2023-12-07T21:08:54.882754+0000","last_became_peered":"2023-12-07T21:08:54.882754+0000","last_unstale":"2023-12-07T21:14:03.361960+0000","last_undegraded":"2023-12-07T21:14:03.361960+0000","last_fullsized":"2023-12-07T21:14:03.361960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:14:03.361875+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:14:03.361875+0000","last_clean_scrub_stamp":"2023-12-07T21:14:03.361875+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:35:49.744783+0000","scrub_duration":0.0013072349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":206,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:38.296697+0000","last_change":"2023-12-07T21:11:38.296697+0000","last_active":"2023-12-07T21:11:38.296697+0000","last_peered":"2023-12-07T21:11:38.296697+0000","last_clean":"2023-12-07T21:11:38.296697+0000","last_became_active":"2023-12-07T21:08:58.876223+0000","last_became_peered":"2023-12-07T21:08:58.876223+0000","last_unstale":"2023-12-07T21:11:38.296697+0000","last_undegraded":"2023-12-07T21:11:38.296697+0000","last_fullsized":"2023-12-07T21:11:38.296697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:11:38.296568+0000","last_clean_scrub_stamp":"2023-12-07T21:11:38.296568+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:51:08.533333+0000","scrub_duration":0.0033144630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":171,"num_read_kb":171,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.654323+0000","last_change":"2023-12-07T21:13:04.654323+0000","last_active":"2023-12-07T21:13:04.654323+0000","last_peered":"2023-12-07T21:13:04.654323+0000","last_clean":"2023-12-07T21:13:04.654323+0000","last_became_active":"2023-12-07T21:09:00.895280+0000","last_became_peered":"2023-12-07T21:09:00.895280+0000","last_unstale":"2023-12-07T21:13:04.654323+0000","last_undegraded":"2023-12-07T21:13:04.654323+0000","last_fullsized":"2023-12-07T21:13:04.654323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:13:04.654200+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.654200+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:02:30.647135+0000","scrub_duration":0.0041448730000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'247","reported_seq":373,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:47.359735+0000","last_change":"2023-12-07T21:11:47.359735+0000","last_active":"2023-12-07T21:11:47.359735+0000","last_peered":"2023-12-07T21:11:47.359735+0000","last_clean":"2023-12-07T21:11:47.359735+0000","last_became_active":"2023-12-07T21:09:02.899776+0000","last_became_peered":"2023-12-07T21:09:02.899776+0000","last_unstale":"2023-12-07T21:11:47.359735+0000","last_undegraded":"2023-12-07T21:11:47.359735+0000","last_fullsized":"2023-12-07T21:11:47.359735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'247","last_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_deep_scrub":"33'247","last_deep_scrub_stamp":"2023-12-07T21:11:47.359610+0000","last_clean_scrub_stamp":"2023-12-07T21:11:47.359610+0000","objects_scrubbed":1,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:10.050726+0000","scrub_duration":0.0028663759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'4","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:14.579785+0000","last_change":"2023-12-07T21:12:14.579785+0000","last_active":"2023-12-07T21:12:14.579785+0000","last_peered":"2023-12-07T21:12:14.579785+0000","last_clean":"2023-12-07T21:12:14.579785+0000","last_became_active":"2023-12-07T21:09:04.922664+0000","last_became_peered":"2023-12-07T21:09:04.922664+0000","last_unstale":"2023-12-07T21:12:14.579785+0000","last_undegraded":"2023-12-07T21:12:14.579785+0000","last_fullsized":"2023-12-07T21:12:14.579785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:14.579627+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.579627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:44.957962+0000","scrub_duration":0.0013656510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.375184+0000","last_change":"2023-12-07T21:12:17.375184+0000","last_active":"2023-12-07T21:12:17.375184+0000","last_peered":"2023-12-07T21:12:17.375184+0000","last_clean":"2023-12-07T21:12:17.375184+0000","last_became_active":"2023-12-07T21:08:56.888987+0000","last_became_peered":"2023-12-07T21:08:56.888987+0000","last_unstale":"2023-12-07T21:12:17.375184+0000","last_undegraded":"2023-12-07T21:12:17.375184+0000","last_fullsized":"2023-12-07T21:12:17.375184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:12:17.375067+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.375067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:21:31.008297+0000","scrub_duration":0.001068486,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:56.280215+0000","last_change":"2023-12-07T21:13:56.280253+0000","last_active":"2023-12-07T21:13:56.280215+0000","last_peered":"2023-12-07T21:13:56.280215+0000","last_clean":"2023-12-07T21:13:56.280215+0000","last_became_active":"2023-12-07T21:08:54.882459+0000","last_became_peered":"2023-12-07T21:08:54.882459+0000","last_unstale":"2023-12-07T21:13:56.280215+0000","last_undegraded":"2023-12-07T21:13:56.280215+0000","last_fullsized":"2023-12-07T21:13:56.280215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:56.280106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:56.280106+0000","last_clean_scrub_stamp":"2023-12-07T21:13:56.280106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:21.512744+0000","scrub_duration":0.001246306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.847914+0000","last_change":"2023-12-07T21:11:28.847914+0000","last_active":"2023-12-07T21:11:28.847914+0000","last_peered":"2023-12-07T21:11:28.847914+0000","last_clean":"2023-12-07T21:11:28.847914+0000","last_became_active":"2023-12-07T21:08:58.879519+0000","last_became_peered":"2023-12-07T21:08:58.879519+0000","last_unstale":"2023-12-07T21:11:28.847914+0000","last_undegraded":"2023-12-07T21:11:28.847914+0000","last_fullsized":"2023-12-07T21:11:28.847914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:28.847797+0000","last_clean_scrub_stamp":"2023-12-07T21:11:28.847797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:20:42.481026+0000","scrub_duration":0.001132973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'46","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:27.262786+0000","last_change":"2023-12-07T21:11:27.262786+0000","last_active":"2023-12-07T21:11:27.262786+0000","last_peered":"2023-12-07T21:11:27.262786+0000","last_clean":"2023-12-07T21:11:27.262786+0000","last_became_active":"2023-12-07T21:09:00.892422+0000","last_became_peered":"2023-12-07T21:09:00.892422+0000","last_unstale":"2023-12-07T21:11:27.262786+0000","last_undegraded":"2023-12-07T21:11:27.262786+0000","last_fullsized":"2023-12-07T21:11:27.262786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2023-12-07T21:11:27.262593+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.262593+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:23.815230+0000","scrub_duration":0.0070242600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.811401+0000","last_change":"2023-12-07T21:11:14.426987+0000","last_active":"2023-12-07T21:11:18.811401+0000","last_peered":"2023-12-07T21:11:18.811401+0000","last_clean":"2023-12-07T21:11:18.811401+0000","last_became_active":"2023-12-07T21:09:02.906192+0000","last_became_peered":"2023-12-07T21:09:02.906192+0000","last_unstale":"2023-12-07T21:11:18.811401+0000","last_undegraded":"2023-12-07T21:11:18.811401+0000","last_fullsized":"2023-12-07T21:11:18.811401+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:14.426857+0000","last_clean_scrub_stamp":"2023-12-07T21:11:14.426857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:36:21.702433+0000","scrub_duration":0.0012013200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:42.422577+0000","last_change":"2023-12-07T21:13:42.422626+0000","last_active":"2023-12-07T21:13:42.422577+0000","last_peered":"2023-12-07T21:13:42.422577+0000","last_clean":"2023-12-07T21:13:42.422577+0000","last_became_active":"2023-12-07T21:09:04.920004+0000","last_became_peered":"2023-12-07T21:09:04.920004+0000","last_unstale":"2023-12-07T21:13:42.422577+0000","last_undegraded":"2023-12-07T21:13:42.422577+0000","last_fullsized":"2023-12-07T21:13:42.422577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:42.422461+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:42.422461+0000","last_clean_scrub_stamp":"2023-12-07T21:13:42.422461+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:15.762102+0000","scrub_duration":0.0036148259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.839865+0000","last_change":"2023-12-07T21:12:08.448223+0000","last_active":"2023-12-07T21:13:08.839865+0000","last_peered":"2023-12-07T21:13:08.839865+0000","last_clean":"2023-12-07T21:13:08.839865+0000","last_became_active":"2023-12-07T21:08:56.874638+0000","last_became_peered":"2023-12-07T21:08:56.874638+0000","last_unstale":"2023-12-07T21:13:08.839865+0000","last_undegraded":"2023-12-07T21:13:08.839865+0000","last_fullsized":"2023-12-07T21:13:08.839865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:08.448115+0000","last_clean_scrub_stamp":"2023-12-07T21:12:08.448115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:53:48.563995+0000","scrub_duration":0.001037821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":195,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:18.321375+0000","last_change":"2023-12-07T21:13:18.321375+0000","last_active":"2023-12-07T21:13:18.321375+0000","last_peered":"2023-12-07T21:13:18.321375+0000","last_clean":"2023-12-07T21:13:18.321375+0000","last_became_active":"2023-12-07T21:08:41.978151+0000","last_became_peered":"2023-12-07T21:08:41.978151+0000","last_unstale":"2023-12-07T21:13:18.321375+0000","last_undegraded":"2023-12-07T21:13:18.321375+0000","last_fullsized":"2023-12-07T21:13:18.321375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2023-12-07T21:13:18.321258+0000","last_clean_scrub_stamp":"2023-12-07T21:13:18.321258+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:57.708960+0000","scrub_duration":0.0041701730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:48.538110+0000","last_change":"2023-12-07T21:14:48.538110+0000","last_active":"2023-12-07T21:14:48.538110+0000","last_peered":"2023-12-07T21:14:48.538110+0000","last_clean":"2023-12-07T21:14:48.538110+0000","last_became_active":"2023-12-07T21:08:46.819672+0000","last_became_peered":"2023-12-07T21:08:46.819672+0000","last_unstale":"2023-12-07T21:14:48.538110+0000","last_undegraded":"2023-12-07T21:14:48.538110+0000","last_fullsized":"2023-12-07T21:14:48.538110+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:48.537996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:48.537996+0000","last_clean_scrub_stamp":"2023-12-07T21:14:48.537996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:02:00.773606+0000","scrub_duration":0.001115773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:22.413706+0000","last_change":"2023-12-07T21:14:22.413706+0000","last_active":"2023-12-07T21:14:22.413706+0000","last_peered":"2023-12-07T21:14:22.413706+0000","last_clean":"2023-12-07T21:14:22.413706+0000","last_became_active":"2023-12-07T21:08:54.883200+0000","last_became_peered":"2023-12-07T21:08:54.883200+0000","last_unstale":"2023-12-07T21:14:22.413706+0000","last_undegraded":"2023-12-07T21:14:22.413706+0000","last_fullsized":"2023-12-07T21:14:22.413706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:22.413596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:22.413596+0000","last_clean_scrub_stamp":"2023-12-07T21:14:22.413596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:58:45.461092+0000","scrub_duration":0.0012623840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.839090+0000","last_change":"2023-12-07T21:11:45.324752+0000","last_active":"2023-12-07T21:13:08.839090+0000","last_peered":"2023-12-07T21:13:08.839090+0000","last_clean":"2023-12-07T21:13:08.839090+0000","last_became_active":"2023-12-07T21:08:58.875366+0000","last_became_peered":"2023-12-07T21:08:58.875366+0000","last_unstale":"2023-12-07T21:13:08.839090+0000","last_undegraded":"2023-12-07T21:13:08.839090+0000","last_fullsized":"2023-12-07T21:13:08.839090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:45.324596+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.324596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:00:15.702930+0000","scrub_duration":0.001375037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'84","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:52.623237+0000","last_change":"2023-12-07T21:12:52.623237+0000","last_active":"2023-12-07T21:12:52.623237+0000","last_peered":"2023-12-07T21:12:52.623237+0000","last_clean":"2023-12-07T21:12:52.623237+0000","last_became_active":"2023-12-07T21:09:00.891072+0000","last_became_peered":"2023-12-07T21:09:00.891072+0000","last_unstale":"2023-12-07T21:12:52.623237+0000","last_undegraded":"2023-12-07T21:12:52.623237+0000","last_fullsized":"2023-12-07T21:12:52.623237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'84","last_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_deep_scrub":"33'84","last_deep_scrub_stamp":"2023-12-07T21:12:52.623072+0000","last_clean_scrub_stamp":"2023-12-07T21:12:52.623072+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:08:11.772666+0000","scrub_duration":0.0042302950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:42.743712+0000","last_change":"2023-12-07T21:11:42.743712+0000","last_active":"2023-12-07T21:11:42.743712+0000","last_peered":"2023-12-07T21:11:42.743712+0000","last_clean":"2023-12-07T21:11:42.743712+0000","last_became_active":"2023-12-07T21:09:02.905378+0000","last_became_peered":"2023-12-07T21:09:02.905378+0000","last_unstale":"2023-12-07T21:11:42.743712+0000","last_undegraded":"2023-12-07T21:11:42.743712+0000","last_fullsized":"2023-12-07T21:11:42.743712+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.743604+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.743604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:58.016229+0000","scrub_duration":0.001386167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'59","reported_seq":149,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:58.433682+0000","last_change":"2023-12-07T21:11:58.433682+0000","last_active":"2023-12-07T21:11:58.433682+0000","last_peered":"2023-12-07T21:11:58.433682+0000","last_clean":"2023-12-07T21:11:58.433682+0000","last_became_active":"2023-12-07T21:09:04.924414+0000","last_became_peered":"2023-12-07T21:09:04.924414+0000","last_unstale":"2023-12-07T21:11:58.433682+0000","last_undegraded":"2023-12-07T21:11:58.433682+0000","last_fullsized":"2023-12-07T21:11:58.433682+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'59","last_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_deep_scrub":"33'59","last_deep_scrub_stamp":"2023-12-07T21:11:58.433567+0000","last_clean_scrub_stamp":"2023-12-07T21:11:58.433567+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:13:08.130743+0000","scrub_duration":0.0014101739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":213,"num_write":127,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:37.409865+0000","last_change":"2023-12-07T21:13:37.409909+0000","last_active":"2023-12-07T21:13:37.409865+0000","last_peered":"2023-12-07T21:13:37.409865+0000","last_clean":"2023-12-07T21:13:37.409865+0000","last_became_active":"2023-12-07T21:08:56.872127+0000","last_became_peered":"2023-12-07T21:08:56.872127+0000","last_unstale":"2023-12-07T21:13:37.409865+0000","last_undegraded":"2023-12-07T21:13:37.409865+0000","last_fullsized":"2023-12-07T21:13:37.409865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:37.409759+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:37.409759+0000","last_clean_scrub_stamp":"2023-12-07T21:13:37.409759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:53:10.604294+0000","scrub_duration":0.001212444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:40.384110+0000","last_change":"2023-12-07T21:14:40.384110+0000","last_active":"2023-12-07T21:14:40.384110+0000","last_peered":"2023-12-07T21:14:40.384110+0000","last_clean":"2023-12-07T21:14:40.384110+0000","last_became_active":"2023-12-07T21:08:46.819225+0000","last_became_peered":"2023-12-07T21:08:46.819225+0000","last_unstale":"2023-12-07T21:14:40.384110+0000","last_undegraded":"2023-12-07T21:14:40.384110+0000","last_fullsized":"2023-12-07T21:14:40.384110+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:40.383987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:40.383987+0000","last_clean_scrub_stamp":"2023-12-07T21:14:40.383987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:31:30.920713+0000","scrub_duration":0.0014216789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.966898+0000","last_change":"2023-12-07T21:13:54.966898+0000","last_active":"2023-12-07T21:13:54.966898+0000","last_peered":"2023-12-07T21:13:54.966898+0000","last_clean":"2023-12-07T21:13:54.966898+0000","last_became_active":"2023-12-07T21:08:54.879966+0000","last_became_peered":"2023-12-07T21:08:54.879966+0000","last_unstale":"2023-12-07T21:13:54.966898+0000","last_undegraded":"2023-12-07T21:13:54.966898+0000","last_fullsized":"2023-12-07T21:13:54.966898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:54.966763+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:54.966763+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.966763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:07.675533+0000","scrub_duration":0.0013427319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.687480+0000","last_change":"2023-12-07T21:11:32.687480+0000","last_active":"2023-12-07T21:11:32.687480+0000","last_peered":"2023-12-07T21:11:32.687480+0000","last_clean":"2023-12-07T21:11:32.687480+0000","last_became_active":"2023-12-07T21:08:58.878851+0000","last_became_peered":"2023-12-07T21:08:58.878851+0000","last_unstale":"2023-12-07T21:11:32.687480+0000","last_undegraded":"2023-12-07T21:11:32.687480+0000","last_fullsized":"2023-12-07T21:11:32.687480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:32.687375+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.687375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:18:45.906213+0000","scrub_duration":0.001283024,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'258","reported_seq":451,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.148420+0000","last_change":"2023-12-07T21:11:18.148420+0000","last_active":"2023-12-07T21:11:18.148420+0000","last_peered":"2023-12-07T21:11:18.148420+0000","last_clean":"2023-12-07T21:11:18.148420+0000","last_became_active":"2023-12-07T21:09:00.891818+0000","last_became_peered":"2023-12-07T21:09:00.891818+0000","last_unstale":"2023-12-07T21:11:18.148420+0000","last_undegraded":"2023-12-07T21:11:18.148420+0000","last_fullsized":"2023-12-07T21:11:18.148420+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'258","last_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_deep_scrub":"33'258","last_deep_scrub_stamp":"2023-12-07T21:11:18.148255+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.148255+0000","objects_scrubbed":10,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:40:12.590181+0000","scrub_duration":0.0061168969999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":339,"num_read_kb":324,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:25.481161+0000","last_change":"2023-12-07T21:12:25.481161+0000","last_active":"2023-12-07T21:12:25.481161+0000","last_peered":"2023-12-07T21:12:25.481161+0000","last_clean":"2023-12-07T21:12:25.481161+0000","last_became_active":"2023-12-07T21:09:02.905082+0000","last_became_peered":"2023-12-07T21:09:02.905082+0000","last_unstale":"2023-12-07T21:12:25.481161+0000","last_undegraded":"2023-12-07T21:12:25.481161+0000","last_fullsized":"2023-12-07T21:12:25.481161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:25.481005+0000","last_clean_scrub_stamp":"2023-12-07T21:12:25.481005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:33:44.071058+0000","scrub_duration":0.001267064,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'5","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:54.375053+0000","last_change":"2023-12-07T21:13:54.375076+0000","last_active":"2023-12-07T21:13:54.375053+0000","last_peered":"2023-12-07T21:13:54.375053+0000","last_clean":"2023-12-07T21:13:54.375053+0000","last_became_active":"2023-12-07T21:09:04.925930+0000","last_became_peered":"2023-12-07T21:09:04.925930+0000","last_unstale":"2023-12-07T21:13:54.375053+0000","last_undegraded":"2023-12-07T21:13:54.375053+0000","last_fullsized":"2023-12-07T21:13:54.375053+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2023-12-07T21:13:54.374958+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2023-12-07T21:13:54.374958+0000","last_clean_scrub_stamp":"2023-12-07T21:13:54.374958+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:03:07.083727+0000","scrub_duration":0.0012241019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.103368+0000","last_change":"2023-12-07T21:13:27.103392+0000","last_active":"2023-12-07T21:13:27.103368+0000","last_peered":"2023-12-07T21:13:27.103368+0000","last_clean":"2023-12-07T21:13:27.103368+0000","last_became_active":"2023-12-07T21:08:56.882970+0000","last_became_peered":"2023-12-07T21:08:56.882970+0000","last_unstale":"2023-12-07T21:13:27.103368+0000","last_undegraded":"2023-12-07T21:13:27.103368+0000","last_fullsized":"2023-12-07T21:13:27.103368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:27.103280+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.103280+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:04.121495+0000","scrub_duration":0.0012535599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:33.338298+0000","last_change":"2023-12-07T21:13:33.338298+0000","last_active":"2023-12-07T21:13:33.338298+0000","last_peered":"2023-12-07T21:13:33.338298+0000","last_clean":"2023-12-07T21:13:33.338298+0000","last_became_active":"2023-12-07T21:08:46.819356+0000","last_became_peered":"2023-12-07T21:08:46.819356+0000","last_unstale":"2023-12-07T21:13:33.338298+0000","last_undegraded":"2023-12-07T21:13:33.338298+0000","last_fullsized":"2023-12-07T21:13:33.338298+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:33.338194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:33.338194+0000","last_clean_scrub_stamp":"2023-12-07T21:13:33.338194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:12:43.622208+0000","scrub_duration":0.001353496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:37.050079+0000","last_change":"2023-12-07T21:13:37.050079+0000","last_active":"2023-12-07T21:13:37.050079+0000","last_peered":"2023-12-07T21:13:37.050079+0000","last_clean":"2023-12-07T21:13:37.050079+0000","last_became_active":"2023-12-07T21:08:54.881616+0000","last_became_peered":"2023-12-07T21:08:54.881616+0000","last_unstale":"2023-12-07T21:13:37.050079+0000","last_undegraded":"2023-12-07T21:13:37.050079+0000","last_fullsized":"2023-12-07T21:13:37.050079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:37.049937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:37.049937+0000","last_clean_scrub_stamp":"2023-12-07T21:13:37.049937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:03:03.042871+0000","scrub_duration":0.0012947099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:15.627991+0000","last_change":"2023-12-07T21:12:15.627991+0000","last_active":"2023-12-07T21:12:15.627991+0000","last_peered":"2023-12-07T21:12:15.627991+0000","last_clean":"2023-12-07T21:12:15.627991+0000","last_became_active":"2023-12-07T21:08:58.875434+0000","last_became_peered":"2023-12-07T21:08:58.875434+0000","last_unstale":"2023-12-07T21:12:15.627991+0000","last_undegraded":"2023-12-07T21:12:15.627991+0000","last_fullsized":"2023-12-07T21:12:15.627991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:15.627865+0000","last_clean_scrub_stamp":"2023-12-07T21:12:15.627865+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:38.318981+0000","scrub_duration":0.0028926030000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'25","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:46.537922+0000","last_change":"2023-12-07T21:11:46.537922+0000","last_active":"2023-12-07T21:11:46.537922+0000","last_peered":"2023-12-07T21:11:46.537922+0000","last_clean":"2023-12-07T21:11:46.537922+0000","last_became_active":"2023-12-07T21:09:00.888203+0000","last_became_peered":"2023-12-07T21:09:00.888203+0000","last_unstale":"2023-12-07T21:11:46.537922+0000","last_undegraded":"2023-12-07T21:11:46.537922+0000","last_fullsized":"2023-12-07T21:11:46.537922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2023-12-07T21:11:46.537795+0000","last_clean_scrub_stamp":"2023-12-07T21:11:46.537795+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:57.338431+0000","scrub_duration":0.0057357379999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:12.642698+0000","last_change":"2023-12-07T21:11:12.642698+0000","last_active":"2023-12-07T21:11:12.642698+0000","last_peered":"2023-12-07T21:11:12.642698+0000","last_clean":"2023-12-07T21:11:12.642698+0000","last_became_active":"2023-12-07T21:09:02.905294+0000","last_became_peered":"2023-12-07T21:09:02.905294+0000","last_unstale":"2023-12-07T21:11:12.642698+0000","last_undegraded":"2023-12-07T21:11:12.642698+0000","last_fullsized":"2023-12-07T21:11:12.642698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:12.642577+0000","last_clean_scrub_stamp":"2023-12-07T21:11:12.642577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:45:33.788528+0000","scrub_duration":0.0011438640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"31'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:15:07.653454+0000","last_change":"2023-12-07T21:15:07.653478+0000","last_active":"2023-12-07T21:15:07.653454+0000","last_peered":"2023-12-07T21:15:07.653454+0000","last_clean":"2023-12-07T21:15:07.653454+0000","last_became_active":"2023-12-07T21:09:04.930547+0000","last_became_peered":"2023-12-07T21:09:04.930547+0000","last_unstale":"2023-12-07T21:15:07.653454+0000","last_undegraded":"2023-12-07T21:15:07.653454+0000","last_fullsized":"2023-12-07T21:15:07.653454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:15:07.653365+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:15:07.653365+0000","last_clean_scrub_stamp":"2023-12-07T21:15:07.653365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:15:31.060740+0000","scrub_duration":0.0010779299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.097065+0000","last_change":"2023-12-07T21:13:20.097065+0000","last_active":"2023-12-07T21:13:20.097065+0000","last_peered":"2023-12-07T21:13:20.097065+0000","last_clean":"2023-12-07T21:13:20.097065+0000","last_became_active":"2023-12-07T21:08:56.871998+0000","last_became_peered":"2023-12-07T21:08:56.871998+0000","last_unstale":"2023-12-07T21:13:20.097065+0000","last_undegraded":"2023-12-07T21:13:20.097065+0000","last_fullsized":"2023-12-07T21:13:20.097065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:20.096899+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.096899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.485657+0000","scrub_duration":0.001542213,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:41.432341+0000","last_change":"2023-12-07T21:14:41.432341+0000","last_active":"2023-12-07T21:14:41.432341+0000","last_peered":"2023-12-07T21:14:41.432341+0000","last_clean":"2023-12-07T21:14:41.432341+0000","last_became_active":"2023-12-07T21:08:46.819226+0000","last_became_peered":"2023-12-07T21:08:46.819226+0000","last_unstale":"2023-12-07T21:14:41.432341+0000","last_undegraded":"2023-12-07T21:14:41.432341+0000","last_fullsized":"2023-12-07T21:14:41.432341+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:41.432212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:41.432212+0000","last_clean_scrub_stamp":"2023-12-07T21:14:41.432212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:07:52.798106+0000","scrub_duration":0.0011517599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.309196+0000","last_change":"2023-12-07T21:13:38.309196+0000","last_active":"2023-12-07T21:13:38.309196+0000","last_peered":"2023-12-07T21:13:38.309196+0000","last_clean":"2023-12-07T21:13:38.309196+0000","last_became_active":"2023-12-07T21:08:54.879815+0000","last_became_peered":"2023-12-07T21:08:54.879815+0000","last_unstale":"2023-12-07T21:13:38.309196+0000","last_undegraded":"2023-12-07T21:13:38.309196+0000","last_fullsized":"2023-12-07T21:13:38.309196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:38.309082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:38.309082+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.309082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:56.899135+0000","scrub_duration":0.0011541360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.827171+0000","last_change":"2023-12-07T21:11:57.727223+0000","last_active":"2023-12-07T21:13:08.827171+0000","last_peered":"2023-12-07T21:13:08.827171+0000","last_clean":"2023-12-07T21:13:08.827171+0000","last_became_active":"2023-12-07T21:08:58.881604+0000","last_became_peered":"2023-12-07T21:08:58.881604+0000","last_unstale":"2023-12-07T21:13:08.827171+0000","last_undegraded":"2023-12-07T21:13:08.827171+0000","last_fullsized":"2023-12-07T21:13:08.827171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:57.727085+0000","last_clean_scrub_stamp":"2023-12-07T21:11:57.727085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:53.015740+0000","scrub_duration":0.0013430639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:49.630855+0000","last_change":"2023-12-07T21:12:49.630855+0000","last_active":"2023-12-07T21:12:49.630855+0000","last_peered":"2023-12-07T21:12:49.630855+0000","last_clean":"2023-12-07T21:12:49.630855+0000","last_became_active":"2023-12-07T21:09:00.891750+0000","last_became_peered":"2023-12-07T21:09:00.891750+0000","last_unstale":"2023-12-07T21:12:49.630855+0000","last_undegraded":"2023-12-07T21:12:49.630855+0000","last_fullsized":"2023-12-07T21:12:49.630855+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2023-12-07T21:12:49.630741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:49.630741+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:01.513069+0000","scrub_duration":0.0051886659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:30.531782+0000","last_change":"2023-12-07T21:13:30.531836+0000","last_active":"2023-12-07T21:13:30.531782+0000","last_peered":"2023-12-07T21:13:30.531782+0000","last_clean":"2023-12-07T21:13:30.531782+0000","last_became_active":"2023-12-07T21:09:02.906564+0000","last_became_peered":"2023-12-07T21:09:02.906564+0000","last_unstale":"2023-12-07T21:13:30.531782+0000","last_undegraded":"2023-12-07T21:13:30.531782+0000","last_fullsized":"2023-12-07T21:13:30.531782+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:30.531646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:30.531646+0000","last_clean_scrub_stamp":"2023-12-07T21:13:30.531646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:08:23.567547+0000","scrub_duration":0.001461323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"31'2","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.342736+0000","last_change":"2023-12-07T21:13:52.342759+0000","last_active":"2023-12-07T21:13:52.342736+0000","last_peered":"2023-12-07T21:13:52.342736+0000","last_clean":"2023-12-07T21:13:52.342736+0000","last_became_active":"2023-12-07T21:09:04.932049+0000","last_became_peered":"2023-12-07T21:09:04.932049+0000","last_unstale":"2023-12-07T21:13:52.342736+0000","last_undegraded":"2023-12-07T21:13:52.342736+0000","last_fullsized":"2023-12-07T21:13:52.342736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:52.342650+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:52.342650+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.342650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:23:16.104463+0000","scrub_duration":0.0010492120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:10.299666+0000","last_change":"2023-12-07T21:13:10.299666+0000","last_active":"2023-12-07T21:13:10.299666+0000","last_peered":"2023-12-07T21:13:10.299666+0000","last_clean":"2023-12-07T21:13:10.299666+0000","last_became_active":"2023-12-07T21:08:56.881998+0000","last_became_peered":"2023-12-07T21:08:56.881998+0000","last_unstale":"2023-12-07T21:13:10.299666+0000","last_undegraded":"2023-12-07T21:13:10.299666+0000","last_fullsized":"2023-12-07T21:13:10.299666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:10.299548+0000","last_clean_scrub_stamp":"2023-12-07T21:13:10.299548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:18:32.210130+0000","scrub_duration":0.00096658499999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:45.355332+0000","last_change":"2023-12-07T21:13:45.355332+0000","last_active":"2023-12-07T21:13:45.355332+0000","last_peered":"2023-12-07T21:13:45.355332+0000","last_clean":"2023-12-07T21:13:45.355332+0000","last_became_active":"2023-12-07T21:08:54.880833+0000","last_became_peered":"2023-12-07T21:08:54.880833+0000","last_unstale":"2023-12-07T21:13:45.355332+0000","last_undegraded":"2023-12-07T21:13:45.355332+0000","last_fullsized":"2023-12-07T21:13:45.355332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:45.355224+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:45.355224+0000","last_clean_scrub_stamp":"2023-12-07T21:13:45.355224+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:23:41.232871+0000","scrub_duration":0.0012797419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:44.037911+0000","last_change":"2023-12-07T21:13:44.037911+0000","last_active":"2023-12-07T21:13:44.037911+0000","last_peered":"2023-12-07T21:13:44.037911+0000","last_clean":"2023-12-07T21:13:44.037911+0000","last_became_active":"2023-12-07T21:08:46.821698+0000","last_became_peered":"2023-12-07T21:08:46.821698+0000","last_unstale":"2023-12-07T21:13:44.037911+0000","last_undegraded":"2023-12-07T21:13:44.037911+0000","last_fullsized":"2023-12-07T21:13:44.037911+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:44.037804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:44.037804+0000","last_clean_scrub_stamp":"2023-12-07T21:13:44.037804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:44:57.361482+0000","scrub_duration":0.0012532349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.827048+0000","last_change":"2023-12-07T21:12:11.771944+0000","last_active":"2023-12-07T21:13:08.827048+0000","last_peered":"2023-12-07T21:13:08.827048+0000","last_clean":"2023-12-07T21:13:08.827048+0000","last_became_active":"2023-12-07T21:08:58.881644+0000","last_became_peered":"2023-12-07T21:08:58.881644+0000","last_unstale":"2023-12-07T21:13:08.827048+0000","last_undegraded":"2023-12-07T21:13:08.827048+0000","last_fullsized":"2023-12-07T21:13:08.827048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:11.771816+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.771816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:43.210676+0000","scrub_duration":0.0013479799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'72","reported_seq":143,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:03.825697+0000","last_change":"2023-12-07T21:11:45.763012+0000","last_active":"2023-12-07T21:13:03.825697+0000","last_peered":"2023-12-07T21:13:03.825697+0000","last_clean":"2023-12-07T21:13:03.825697+0000","last_became_active":"2023-12-07T21:09:00.892684+0000","last_became_peered":"2023-12-07T21:09:00.892684+0000","last_unstale":"2023-12-07T21:13:03.825697+0000","last_undegraded":"2023-12-07T21:13:03.825697+0000","last_fullsized":"2023-12-07T21:13:03.825697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'72","last_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_deep_scrub":"33'72","last_deep_scrub_stamp":"2023-12-07T21:11:45.762875+0000","last_clean_scrub_stamp":"2023-12-07T21:11:45.762875+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:27:47.809323+0000","scrub_duration":0.006706058,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":76,"num_read_kb":82,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:25.594416+0000","last_change":"2023-12-07T21:11:25.594416+0000","last_active":"2023-12-07T21:11:25.594416+0000","last_peered":"2023-12-07T21:11:25.594416+0000","last_clean":"2023-12-07T21:11:25.594416+0000","last_became_active":"2023-12-07T21:09:02.897193+0000","last_became_peered":"2023-12-07T21:09:02.897193+0000","last_unstale":"2023-12-07T21:11:25.594416+0000","last_undegraded":"2023-12-07T21:11:25.594416+0000","last_fullsized":"2023-12-07T21:11:25.594416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:25.594282+0000","last_clean_scrub_stamp":"2023-12-07T21:11:25.594282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:16:57.529120+0000","scrub_duration":0.001227119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:11.946294+0000","last_change":"2023-12-07T21:14:11.946317+0000","last_active":"2023-12-07T21:14:11.946294+0000","last_peered":"2023-12-07T21:14:11.946294+0000","last_clean":"2023-12-07T21:14:11.946294+0000","last_became_active":"2023-12-07T21:09:04.918638+0000","last_became_peered":"2023-12-07T21:09:04.918638+0000","last_unstale":"2023-12-07T21:14:11.946294+0000","last_undegraded":"2023-12-07T21:14:11.946294+0000","last_fullsized":"2023-12-07T21:14:11.946294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:14:11.946210+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:14:11.946210+0000","last_clean_scrub_stamp":"2023-12-07T21:14:11.946210+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:06:44.474703+0000","scrub_duration":0.001277083,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.839012+0000","last_change":"2023-12-07T21:12:42.332914+0000","last_active":"2023-12-07T21:13:08.839012+0000","last_peered":"2023-12-07T21:13:08.839012+0000","last_clean":"2023-12-07T21:13:08.839012+0000","last_became_active":"2023-12-07T21:08:56.878624+0000","last_became_peered":"2023-12-07T21:08:56.878624+0000","last_unstale":"2023-12-07T21:13:08.839012+0000","last_undegraded":"2023-12-07T21:13:08.839012+0000","last_fullsized":"2023-12-07T21:13:08.839012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:42.332776+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.332776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:35:52.088170+0000","scrub_duration":0.00097994699999999989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:57.984179+0000","last_change":"2023-12-07T21:13:57.984179+0000","last_active":"2023-12-07T21:13:57.984179+0000","last_peered":"2023-12-07T21:13:57.984179+0000","last_clean":"2023-12-07T21:13:57.984179+0000","last_became_active":"2023-12-07T21:08:54.879890+0000","last_became_peered":"2023-12-07T21:08:54.879890+0000","last_unstale":"2023-12-07T21:13:57.984179+0000","last_undegraded":"2023-12-07T21:13:57.984179+0000","last_fullsized":"2023-12-07T21:13:57.984179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:57.984065+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:57.984065+0000","last_clean_scrub_stamp":"2023-12-07T21:13:57.984065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:29.842428+0000","scrub_duration":0.0015299650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:47.500871+0000","last_change":"2023-12-07T21:14:47.500871+0000","last_active":"2023-12-07T21:14:47.500871+0000","last_peered":"2023-12-07T21:14:47.500871+0000","last_clean":"2023-12-07T21:14:47.500871+0000","last_became_active":"2023-12-07T21:08:46.819442+0000","last_became_peered":"2023-12-07T21:08:46.819442+0000","last_unstale":"2023-12-07T21:14:47.500871+0000","last_undegraded":"2023-12-07T21:14:47.500871+0000","last_fullsized":"2023-12-07T21:14:47.500871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:47.500733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:47.500733+0000","last_clean_scrub_stamp":"2023-12-07T21:14:47.500733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:15:56.051905+0000","scrub_duration":0.0011931909999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.839505+0000","last_change":"2023-12-07T21:11:42.626478+0000","last_active":"2023-12-07T21:13:08.839505+0000","last_peered":"2023-12-07T21:13:08.839505+0000","last_clean":"2023-12-07T21:13:08.839505+0000","last_became_active":"2023-12-07T21:08:58.878520+0000","last_became_peered":"2023-12-07T21:08:58.878520+0000","last_unstale":"2023-12-07T21:13:08.839505+0000","last_undegraded":"2023-12-07T21:13:08.839505+0000","last_fullsized":"2023-12-07T21:13:08.839505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:42.626356+0000","last_clean_scrub_stamp":"2023-12-07T21:11:42.626356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:54:23.689571+0000","scrub_duration":0.001348258,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.225043+0000","last_change":"2023-12-07T21:11:33.225043+0000","last_active":"2023-12-07T21:11:33.225043+0000","last_peered":"2023-12-07T21:11:33.225043+0000","last_clean":"2023-12-07T21:11:33.225043+0000","last_became_active":"2023-12-07T21:09:00.890438+0000","last_became_peered":"2023-12-07T21:09:00.890438+0000","last_unstale":"2023-12-07T21:11:33.225043+0000","last_undegraded":"2023-12-07T21:11:33.225043+0000","last_fullsized":"2023-12-07T21:11:33.225043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2023-12-07T21:11:33.224920+0000","last_clean_scrub_stamp":"2023-12-07T21:11:33.224920+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:12.396025+0000","scrub_duration":0.0049945800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'246","reported_seq":302,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:03.837507+0000","last_change":"2023-12-07T21:11:20.065956+0000","last_active":"2023-12-07T21:13:03.837507+0000","last_peered":"2023-12-07T21:13:03.837507+0000","last_clean":"2023-12-07T21:13:03.837507+0000","last_became_active":"2023-12-07T21:09:02.900202+0000","last_became_peered":"2023-12-07T21:09:02.900202+0000","last_unstale":"2023-12-07T21:13:03.837507+0000","last_undegraded":"2023-12-07T21:13:03.837507+0000","last_fullsized":"2023-12-07T21:13:03.837507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:20.065840+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.065840+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:10:27.484331+0000","scrub_duration":0.0016895809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:15:12.676815+0000","last_change":"2023-12-07T21:15:12.676869+0000","last_active":"2023-12-07T21:15:12.676815+0000","last_peered":"2023-12-07T21:15:12.676815+0000","last_clean":"2023-12-07T21:15:12.676815+0000","last_became_active":"2023-12-07T21:09:04.930656+0000","last_became_peered":"2023-12-07T21:09:04.930656+0000","last_unstale":"2023-12-07T21:15:12.676815+0000","last_undegraded":"2023-12-07T21:15:12.676815+0000","last_fullsized":"2023-12-07T21:15:12.676815+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:15:12.676706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:15:12.676706+0000","last_clean_scrub_stamp":"2023-12-07T21:15:12.676706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:44:04.855681+0000","scrub_duration":0.0014108829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:26.538591+0000","last_change":"2023-12-07T21:13:26.538591+0000","last_active":"2023-12-07T21:13:26.538591+0000","last_peered":"2023-12-07T21:13:26.538591+0000","last_clean":"2023-12-07T21:13:26.538591+0000","last_became_active":"2023-12-07T21:08:56.887661+0000","last_became_peered":"2023-12-07T21:08:56.887661+0000","last_unstale":"2023-12-07T21:13:26.538591+0000","last_undegraded":"2023-12-07T21:13:26.538591+0000","last_fullsized":"2023-12-07T21:13:26.538591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:26.538439+0000","last_clean_scrub_stamp":"2023-12-07T21:13:26.538439+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:32:03.233013+0000","scrub_duration":0.0011404239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:16.404893+0000","last_change":"2023-12-07T21:14:16.404929+0000","last_active":"2023-12-07T21:14:16.404893+0000","last_peered":"2023-12-07T21:14:16.404893+0000","last_clean":"2023-12-07T21:14:16.404893+0000","last_became_active":"2023-12-07T21:08:54.875264+0000","last_became_peered":"2023-12-07T21:08:54.875264+0000","last_unstale":"2023-12-07T21:14:16.404893+0000","last_undegraded":"2023-12-07T21:14:16.404893+0000","last_fullsized":"2023-12-07T21:14:16.404893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:16.404773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:16.404773+0000","last_clean_scrub_stamp":"2023-12-07T21:14:16.404773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:30:54.222075+0000","scrub_duration":0.0014842950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:47.017061+0000","last_change":"2023-12-07T21:13:47.017082+0000","last_active":"2023-12-07T21:13:47.017061+0000","last_peered":"2023-12-07T21:13:47.017061+0000","last_clean":"2023-12-07T21:13:47.017061+0000","last_became_active":"2023-12-07T21:08:46.821828+0000","last_became_peered":"2023-12-07T21:08:46.821828+0000","last_unstale":"2023-12-07T21:13:47.017061+0000","last_undegraded":"2023-12-07T21:13:47.017061+0000","last_fullsized":"2023-12-07T21:13:47.017061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:47.016927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:47.016927+0000","last_clean_scrub_stamp":"2023-12-07T21:13:47.016927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:39.728287+0000","scrub_duration":0.0013272259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.839484+0000","last_change":"2023-12-07T21:11:18.865911+0000","last_active":"2023-12-07T21:13:08.839484+0000","last_peered":"2023-12-07T21:13:08.839484+0000","last_clean":"2023-12-07T21:13:08.839484+0000","last_became_active":"2023-12-07T21:08:58.878031+0000","last_became_peered":"2023-12-07T21:08:58.878031+0000","last_unstale":"2023-12-07T21:13:08.839484+0000","last_undegraded":"2023-12-07T21:13:08.839484+0000","last_fullsized":"2023-12-07T21:13:08.839484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:18.865751+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.865751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:14:06.375238+0000","scrub_duration":0.0014286489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'15","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:44.632651+0000","last_change":"2023-12-07T21:12:44.632651+0000","last_active":"2023-12-07T21:12:44.632651+0000","last_peered":"2023-12-07T21:12:44.632651+0000","last_clean":"2023-12-07T21:12:44.632651+0000","last_became_active":"2023-12-07T21:09:00.895932+0000","last_became_peered":"2023-12-07T21:09:00.895932+0000","last_unstale":"2023-12-07T21:12:44.632651+0000","last_undegraded":"2023-12-07T21:12:44.632651+0000","last_fullsized":"2023-12-07T21:12:44.632651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:44.632504+0000","last_clean_scrub_stamp":"2023-12-07T21:12:44.632504+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:22:24.020207+0000","scrub_duration":0.0053067840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'246","reported_seq":369,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.712229+0000","last_change":"2023-12-07T21:11:18.712229+0000","last_active":"2023-12-07T21:11:18.712229+0000","last_peered":"2023-12-07T21:11:18.712229+0000","last_clean":"2023-12-07T21:11:18.712229+0000","last_became_active":"2023-12-07T21:09:02.897179+0000","last_became_peered":"2023-12-07T21:09:02.897179+0000","last_unstale":"2023-12-07T21:11:18.712229+0000","last_undegraded":"2023-12-07T21:11:18.712229+0000","last_fullsized":"2023-12-07T21:11:18.712229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:18.712121+0000","last_clean_scrub_stamp":"2023-12-07T21:11:18.712121+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:06.614644+0000","scrub_duration":0.00179857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"31'3","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.351712+0000","last_change":"2023-12-07T21:13:48.351733+0000","last_active":"2023-12-07T21:13:48.351712+0000","last_peered":"2023-12-07T21:13:48.351712+0000","last_clean":"2023-12-07T21:13:48.351712+0000","last_became_active":"2023-12-07T21:09:04.929141+0000","last_became_peered":"2023-12-07T21:09:04.929141+0000","last_unstale":"2023-12-07T21:13:48.351712+0000","last_undegraded":"2023-12-07T21:13:48.351712+0000","last_fullsized":"2023-12-07T21:13:48.351712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2023-12-07T21:13:48.351626+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2023-12-07T21:13:48.351626+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.351626+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:54:41.062986+0000","scrub_duration":0.0010460479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.838681+0000","last_change":"2023-12-07T21:12:43.441643+0000","last_active":"2023-12-07T21:13:08.838681+0000","last_peered":"2023-12-07T21:13:08.838681+0000","last_clean":"2023-12-07T21:13:08.838681+0000","last_became_active":"2023-12-07T21:08:56.874033+0000","last_became_peered":"2023-12-07T21:08:56.874033+0000","last_unstale":"2023-12-07T21:13:08.838681+0000","last_undegraded":"2023-12-07T21:13:08.838681+0000","last_fullsized":"2023-12-07T21:13:08.838681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:43.441484+0000","last_clean_scrub_stamp":"2023-12-07T21:12:43.441484+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:06:24.768617+0000","scrub_duration":0.0011182029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:22.456099+0000","last_change":"2023-12-07T21:13:22.456119+0000","last_active":"2023-12-07T21:13:22.456099+0000","last_peered":"2023-12-07T21:13:22.456099+0000","last_clean":"2023-12-07T21:13:22.456099+0000","last_became_active":"2023-12-07T21:08:54.888242+0000","last_became_peered":"2023-12-07T21:08:54.888242+0000","last_unstale":"2023-12-07T21:13:22.456099+0000","last_undegraded":"2023-12-07T21:13:22.456099+0000","last_fullsized":"2023-12-07T21:13:22.456099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:22.456021+0000","last_clean_scrub_stamp":"2023-12-07T21:13:22.456021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:45:49.190223+0000","scrub_duration":0.001272902,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:44.494789+0000","last_change":"2023-12-07T21:14:44.494829+0000","last_active":"2023-12-07T21:14:44.494789+0000","last_peered":"2023-12-07T21:14:44.494789+0000","last_clean":"2023-12-07T21:14:44.494789+0000","last_became_active":"2023-12-07T21:08:47.170359+0000","last_became_peered":"2023-12-07T21:08:47.170359+0000","last_unstale":"2023-12-07T21:14:44.494789+0000","last_undegraded":"2023-12-07T21:14:44.494789+0000","last_fullsized":"2023-12-07T21:14:44.494789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:44.494675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:44.494675+0000","last_clean_scrub_stamp":"2023-12-07T21:14:44.494675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:03:34.122166+0000","scrub_duration":0.0010907639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.836553+0000","last_change":"2023-12-07T21:11:37.651334+0000","last_active":"2023-12-07T21:12:58.836553+0000","last_peered":"2023-12-07T21:12:58.836553+0000","last_clean":"2023-12-07T21:12:58.836553+0000","last_became_active":"2023-12-07T21:09:35.952807+0000","last_became_peered":"2023-12-07T21:09:35.952807+0000","last_unstale":"2023-12-07T21:12:58.836553+0000","last_undegraded":"2023-12-07T21:12:58.836553+0000","last_fullsized":"2023-12-07T21:12:58.836553+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:37.651191+0000","last_clean_scrub_stamp":"2023-12-07T21:11:37.651191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:43:09.090050+0000","scrub_duration":0.0012443790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'94","reported_seq":181,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:05.544503+0000","last_change":"2023-12-07T21:12:05.544503+0000","last_active":"2023-12-07T21:12:05.544503+0000","last_peered":"2023-12-07T21:12:05.544503+0000","last_clean":"2023-12-07T21:12:05.544503+0000","last_became_active":"2023-12-07T21:09:00.891458+0000","last_became_peered":"2023-12-07T21:09:00.891458+0000","last_unstale":"2023-12-07T21:12:05.544503+0000","last_undegraded":"2023-12-07T21:12:05.544503+0000","last_fullsized":"2023-12-07T21:12:05.544503+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'94","last_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_deep_scrub":"33'94","last_deep_scrub_stamp":"2023-12-07T21:12:05.544369+0000","last_clean_scrub_stamp":"2023-12-07T21:12:05.544369+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:32:13.323537+0000","scrub_duration":0.006343095,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.831678+0000","last_change":"2023-12-07T21:11:52.831678+0000","last_active":"2023-12-07T21:11:52.831678+0000","last_peered":"2023-12-07T21:11:52.831678+0000","last_clean":"2023-12-07T21:11:52.831678+0000","last_became_active":"2023-12-07T21:09:02.897821+0000","last_became_peered":"2023-12-07T21:09:02.897821+0000","last_unstale":"2023-12-07T21:11:52.831678+0000","last_undegraded":"2023-12-07T21:11:52.831678+0000","last_fullsized":"2023-12-07T21:11:52.831678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.831531+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.831531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:22.265020+0000","scrub_duration":0.001488783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:56.419273+0000","last_change":"2023-12-07T21:13:56.419293+0000","last_active":"2023-12-07T21:13:56.419273+0000","last_peered":"2023-12-07T21:13:56.419273+0000","last_clean":"2023-12-07T21:13:56.419273+0000","last_became_active":"2023-12-07T21:09:04.924177+0000","last_became_peered":"2023-12-07T21:09:04.924177+0000","last_unstale":"2023-12-07T21:13:56.419273+0000","last_undegraded":"2023-12-07T21:13:56.419273+0000","last_fullsized":"2023-12-07T21:13:56.419273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:56.419176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:56.419176+0000","last_clean_scrub_stamp":"2023-12-07T21:13:56.419176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:37:31.807934+0000","scrub_duration":0.001158671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:23.528421+0000","last_change":"2023-12-07T21:12:23.528421+0000","last_active":"2023-12-07T21:12:23.528421+0000","last_peered":"2023-12-07T21:12:23.528421+0000","last_clean":"2023-12-07T21:12:23.528421+0000","last_became_active":"2023-12-07T21:09:04.924770+0000","last_became_peered":"2023-12-07T21:09:04.924770+0000","last_unstale":"2023-12-07T21:12:23.528421+0000","last_undegraded":"2023-12-07T21:12:23.528421+0000","last_fullsized":"2023-12-07T21:12:23.528421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:23.528299+0000","last_clean_scrub_stamp":"2023-12-07T21:12:23.528299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:45:52.961788+0000","scrub_duration":0.00098274400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:04.407105+0000","last_change":"2023-12-07T21:13:04.407105+0000","last_active":"2023-12-07T21:13:04.407105+0000","last_peered":"2023-12-07T21:13:04.407105+0000","last_clean":"2023-12-07T21:13:04.407105+0000","last_became_active":"2023-12-07T21:08:56.876889+0000","last_became_peered":"2023-12-07T21:08:56.876889+0000","last_unstale":"2023-12-07T21:13:04.407105+0000","last_undegraded":"2023-12-07T21:13:04.407105+0000","last_fullsized":"2023-12-07T21:13:04.407105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:04.406964+0000","last_clean_scrub_stamp":"2023-12-07T21:13:04.406964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:17:33.745379+0000","scrub_duration":0.001091641,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:25.352978+0000","last_change":"2023-12-07T21:14:25.353002+0000","last_active":"2023-12-07T21:14:25.352978+0000","last_peered":"2023-12-07T21:14:25.352978+0000","last_clean":"2023-12-07T21:14:25.352978+0000","last_became_active":"2023-12-07T21:08:54.886305+0000","last_became_peered":"2023-12-07T21:08:54.886305+0000","last_unstale":"2023-12-07T21:14:25.352978+0000","last_undegraded":"2023-12-07T21:14:25.352978+0000","last_fullsized":"2023-12-07T21:14:25.352978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:25.352881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:25.352881+0000","last_clean_scrub_stamp":"2023-12-07T21:14:25.352881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:50:05.152759+0000","scrub_duration":0.0013146939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:39.299988+0000","last_change":"2023-12-07T21:11:39.299988+0000","last_active":"2023-12-07T21:11:39.299988+0000","last_peered":"2023-12-07T21:11:39.299988+0000","last_clean":"2023-12-07T21:11:39.299988+0000","last_became_active":"2023-12-07T21:08:58.875953+0000","last_became_peered":"2023-12-07T21:08:58.875953+0000","last_unstale":"2023-12-07T21:11:39.299988+0000","last_undegraded":"2023-12-07T21:11:39.299988+0000","last_fullsized":"2023-12-07T21:11:39.299988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:39.299849+0000","last_clean_scrub_stamp":"2023-12-07T21:11:39.299849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:12:48.997025+0000","scrub_duration":0.001356866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'37","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.813364+0000","last_change":"2023-12-07T21:11:20.839849+0000","last_active":"2023-12-07T21:11:23.813364+0000","last_peered":"2023-12-07T21:11:23.813364+0000","last_clean":"2023-12-07T21:11:23.813364+0000","last_became_active":"2023-12-07T21:09:00.893456+0000","last_became_peered":"2023-12-07T21:09:00.893456+0000","last_unstale":"2023-12-07T21:11:23.813364+0000","last_undegraded":"2023-12-07T21:11:23.813364+0000","last_fullsized":"2023-12-07T21:11:23.813364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:11:20.839715+0000","last_clean_scrub_stamp":"2023-12-07T21:11:20.839715+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:34:16.128370+0000","scrub_duration":0.0037438720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.626993+0000","last_change":"2023-12-07T21:13:05.626993+0000","last_active":"2023-12-07T21:13:05.626993+0000","last_peered":"2023-12-07T21:13:05.626993+0000","last_clean":"2023-12-07T21:13:05.626993+0000","last_became_active":"2023-12-07T21:09:02.907282+0000","last_became_peered":"2023-12-07T21:09:02.907282+0000","last_unstale":"2023-12-07T21:13:05.626993+0000","last_undegraded":"2023-12-07T21:13:05.626993+0000","last_fullsized":"2023-12-07T21:13:05.626993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.626860+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.626860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:01.027919+0000","scrub_duration":0.00097400899999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:29.046540+0000","last_change":"2023-12-07T21:14:29.046540+0000","last_active":"2023-12-07T21:14:29.046540+0000","last_peered":"2023-12-07T21:14:29.046540+0000","last_clean":"2023-12-07T21:14:29.046540+0000","last_became_active":"2023-12-07T21:09:04.930923+0000","last_became_peered":"2023-12-07T21:09:04.930923+0000","last_unstale":"2023-12-07T21:14:29.046540+0000","last_undegraded":"2023-12-07T21:14:29.046540+0000","last_fullsized":"2023-12-07T21:14:29.046540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:29.046420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:29.046420+0000","last_clean_scrub_stamp":"2023-12-07T21:14:29.046420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:59:49.084841+0000","scrub_duration":0.0013829269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"31'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.340557+0000","last_change":"2023-12-07T21:13:05.340557+0000","last_active":"2023-12-07T21:13:05.340557+0000","last_peered":"2023-12-07T21:13:05.340557+0000","last_clean":"2023-12-07T21:13:05.340557+0000","last_became_active":"2023-12-07T21:08:56.878898+0000","last_became_peered":"2023-12-07T21:08:56.878898+0000","last_unstale":"2023-12-07T21:13:05.340557+0000","last_undegraded":"2023-12-07T21:13:05.340557+0000","last_fullsized":"2023-12-07T21:13:05.340557+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2023-12-07T21:13:05.340431+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.340431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:59:24.924419+0000","scrub_duration":0.001119035,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:48.409426+0000","last_change":"2023-12-07T21:13:48.409426+0000","last_active":"2023-12-07T21:13:48.409426+0000","last_peered":"2023-12-07T21:13:48.409426+0000","last_clean":"2023-12-07T21:13:48.409426+0000","last_became_active":"2023-12-07T21:08:54.880253+0000","last_became_peered":"2023-12-07T21:08:54.880253+0000","last_unstale":"2023-12-07T21:13:48.409426+0000","last_undegraded":"2023-12-07T21:13:48.409426+0000","last_fullsized":"2023-12-07T21:13:48.409426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:48.409284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:48.409284+0000","last_clean_scrub_stamp":"2023-12-07T21:13:48.409284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:42.968321+0000","scrub_duration":0.0012408199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:18.812340+0000","last_change":"2023-12-07T21:11:15.790833+0000","last_active":"2023-12-07T21:11:18.812340+0000","last_peered":"2023-12-07T21:11:18.812340+0000","last_clean":"2023-12-07T21:11:18.812340+0000","last_became_active":"2023-12-07T21:08:58.882453+0000","last_became_peered":"2023-12-07T21:08:58.882453+0000","last_unstale":"2023-12-07T21:11:18.812340+0000","last_undegraded":"2023-12-07T21:11:18.812340+0000","last_fullsized":"2023-12-07T21:11:18.812340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.790706+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.790706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:18.496476+0000","scrub_duration":0.001346199,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'9","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:50.887056+0000","last_change":"2023-12-07T21:11:50.887056+0000","last_active":"2023-12-07T21:11:50.887056+0000","last_peered":"2023-12-07T21:11:50.887056+0000","last_clean":"2023-12-07T21:11:50.887056+0000","last_became_active":"2023-12-07T21:09:00.886200+0000","last_became_peered":"2023-12-07T21:09:00.886200+0000","last_unstale":"2023-12-07T21:11:50.887056+0000","last_undegraded":"2023-12-07T21:11:50.887056+0000","last_fullsized":"2023-12-07T21:11:50.887056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2023-12-07T21:11:50.886922+0000","last_clean_scrub_stamp":"2023-12-07T21:11:50.886922+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:02.989113+0000","scrub_duration":0.0042007399999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.812347+0000","last_change":"2023-12-07T21:11:19.515594+0000","last_active":"2023-12-07T21:11:23.812347+0000","last_peered":"2023-12-07T21:11:23.812347+0000","last_clean":"2023-12-07T21:11:23.812347+0000","last_became_active":"2023-12-07T21:09:02.906228+0000","last_became_peered":"2023-12-07T21:09:02.906228+0000","last_unstale":"2023-12-07T21:11:23.812347+0000","last_undegraded":"2023-12-07T21:11:23.812347+0000","last_fullsized":"2023-12-07T21:11:23.812347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:19.515443+0000","last_clean_scrub_stamp":"2023-12-07T21:11:19.515443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:36:28.898650+0000","scrub_duration":0.001038382,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:13.973529+0000","last_change":"2023-12-07T21:14:13.973547+0000","last_active":"2023-12-07T21:14:13.973529+0000","last_peered":"2023-12-07T21:14:13.973529+0000","last_clean":"2023-12-07T21:14:13.973529+0000","last_became_active":"2023-12-07T21:09:04.925476+0000","last_became_peered":"2023-12-07T21:09:04.925476+0000","last_unstale":"2023-12-07T21:14:13.973529+0000","last_undegraded":"2023-12-07T21:14:13.973529+0000","last_fullsized":"2023-12-07T21:14:13.973529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:13.973453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:13.973453+0000","last_clean_scrub_stamp":"2023-12-07T21:14:13.973453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:22.652134+0000","scrub_duration":0.0014016110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'4","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.033989+0000","last_change":"2023-12-07T21:13:38.033989+0000","last_active":"2023-12-07T21:13:38.033989+0000","last_peered":"2023-12-07T21:13:38.033989+0000","last_clean":"2023-12-07T21:13:38.033989+0000","last_became_active":"2023-12-07T21:08:56.874408+0000","last_became_peered":"2023-12-07T21:08:56.874408+0000","last_unstale":"2023-12-07T21:13:38.033989+0000","last_undegraded":"2023-12-07T21:13:38.033989+0000","last_fullsized":"2023-12-07T21:13:38.033989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:13:38.033840+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:13:38.033840+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.033840+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:24:33.434899+0000","scrub_duration":0.001381462,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.434901+0000","last_change":"2023-12-07T21:13:28.434901+0000","last_active":"2023-12-07T21:13:28.434901+0000","last_peered":"2023-12-07T21:13:28.434901+0000","last_clean":"2023-12-07T21:13:28.434901+0000","last_became_active":"2023-12-07T21:08:54.883521+0000","last_became_peered":"2023-12-07T21:08:54.883521+0000","last_unstale":"2023-12-07T21:13:28.434901+0000","last_undegraded":"2023-12-07T21:13:28.434901+0000","last_fullsized":"2023-12-07T21:13:28.434901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:28.434771+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.434771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:49.030870+0000","scrub_duration":0.001230061,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:18.605108+0000","last_change":"2023-12-07T21:12:18.605108+0000","last_active":"2023-12-07T21:12:18.605108+0000","last_peered":"2023-12-07T21:12:18.605108+0000","last_clean":"2023-12-07T21:12:18.605108+0000","last_became_active":"2023-12-07T21:08:58.873338+0000","last_became_peered":"2023-12-07T21:08:58.873338+0000","last_unstale":"2023-12-07T21:12:18.605108+0000","last_undegraded":"2023-12-07T21:12:18.605108+0000","last_fullsized":"2023-12-07T21:12:18.605108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:18.605002+0000","last_clean_scrub_stamp":"2023-12-07T21:12:18.605002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:30.707193+0000","scrub_duration":0.00090833899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.805867+0000","last_change":"2023-12-07T21:11:11.678798+0000","last_active":"2023-12-07T21:11:23.805867+0000","last_peered":"2023-12-07T21:11:23.805867+0000","last_clean":"2023-12-07T21:11:23.805867+0000","last_became_active":"2023-12-07T21:09:00.891883+0000","last_became_peered":"2023-12-07T21:09:00.891883+0000","last_unstale":"2023-12-07T21:11:23.805867+0000","last_undegraded":"2023-12-07T21:11:23.805867+0000","last_fullsized":"2023-12-07T21:11:23.805867+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'41","last_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_deep_scrub":"33'41","last_deep_scrub_stamp":"2023-12-07T21:11:11.678642+0000","last_clean_scrub_stamp":"2023-12-07T21:11:11.678642+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:13.528861+0000","scrub_duration":0.0041473289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.302809+0000","last_change":"2023-12-07T21:11:36.302809+0000","last_active":"2023-12-07T21:11:36.302809+0000","last_peered":"2023-12-07T21:11:36.302809+0000","last_clean":"2023-12-07T21:11:36.302809+0000","last_became_active":"2023-12-07T21:09:02.899669+0000","last_became_peered":"2023-12-07T21:09:02.899669+0000","last_unstale":"2023-12-07T21:11:36.302809+0000","last_undegraded":"2023-12-07T21:11:36.302809+0000","last_fullsized":"2023-12-07T21:11:36.302809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.302687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.302687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:43:01.567462+0000","scrub_duration":0.0014296669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:00.345915+0000","last_change":"2023-12-07T21:14:00.345915+0000","last_active":"2023-12-07T21:14:00.345915+0000","last_peered":"2023-12-07T21:14:00.345915+0000","last_clean":"2023-12-07T21:14:00.345915+0000","last_became_active":"2023-12-07T21:09:04.928110+0000","last_became_peered":"2023-12-07T21:09:04.928110+0000","last_unstale":"2023-12-07T21:14:00.345915+0000","last_undegraded":"2023-12-07T21:14:00.345915+0000","last_fullsized":"2023-12-07T21:14:00.345915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:00.345796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:00.345796+0000","last_clean_scrub_stamp":"2023-12-07T21:14:00.345796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:45:47.511446+0000","scrub_duration":0.0010293559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:29.521893+0000","last_change":"2023-12-07T21:13:29.521893+0000","last_active":"2023-12-07T21:13:29.521893+0000","last_peered":"2023-12-07T21:13:29.521893+0000","last_clean":"2023-12-07T21:13:29.521893+0000","last_became_active":"2023-12-07T21:08:56.886922+0000","last_became_peered":"2023-12-07T21:08:56.886922+0000","last_unstale":"2023-12-07T21:13:29.521893+0000","last_undegraded":"2023-12-07T21:13:29.521893+0000","last_fullsized":"2023-12-07T21:13:29.521893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:29.521772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:29.521772+0000","last_clean_scrub_stamp":"2023-12-07T21:13:29.521772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:51:27.306062+0000","scrub_duration":0.001149186,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:09.325688+0000","last_change":"2023-12-07T21:13:09.325688+0000","last_active":"2023-12-07T21:13:09.325688+0000","last_peered":"2023-12-07T21:13:09.325688+0000","last_clean":"2023-12-07T21:13:09.325688+0000","last_became_active":"2023-12-07T21:08:54.878199+0000","last_became_peered":"2023-12-07T21:08:54.878199+0000","last_unstale":"2023-12-07T21:13:09.325688+0000","last_undegraded":"2023-12-07T21:13:09.325688+0000","last_fullsized":"2023-12-07T21:13:09.325688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:09.325568+0000","last_clean_scrub_stamp":"2023-12-07T21:13:09.325568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:45:40.066890+0000","scrub_duration":0.00116248,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:52.514142+0000","last_change":"2023-12-07T21:11:52.514142+0000","last_active":"2023-12-07T21:11:52.514142+0000","last_peered":"2023-12-07T21:11:52.514142+0000","last_clean":"2023-12-07T21:11:52.514142+0000","last_became_active":"2023-12-07T21:08:58.878170+0000","last_became_peered":"2023-12-07T21:08:58.878170+0000","last_unstale":"2023-12-07T21:11:52.514142+0000","last_undegraded":"2023-12-07T21:11:52.514142+0000","last_fullsized":"2023-12-07T21:11:52.514142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:52.514035+0000","last_clean_scrub_stamp":"2023-12-07T21:11:52.514035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:00:51.180837+0000","scrub_duration":0.00101976,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'34","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:32.532802+0000","last_change":"2023-12-07T21:11:32.532802+0000","last_active":"2023-12-07T21:11:32.532802+0000","last_peered":"2023-12-07T21:11:32.532802+0000","last_clean":"2023-12-07T21:11:32.532802+0000","last_became_active":"2023-12-07T21:09:00.885242+0000","last_became_peered":"2023-12-07T21:09:00.885242+0000","last_unstale":"2023-12-07T21:11:32.532802+0000","last_undegraded":"2023-12-07T21:11:32.532802+0000","last_fullsized":"2023-12-07T21:11:32.532802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'34","last_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_deep_scrub":"33'34","last_deep_scrub_stamp":"2023-12-07T21:11:32.532666+0000","last_clean_scrub_stamp":"2023-12-07T21:11:32.532666+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:32:34.382885+0000","scrub_duration":0.0035860219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:23.812477+0000","last_change":"2023-12-07T21:11:17.544268+0000","last_active":"2023-12-07T21:11:23.812477+0000","last_peered":"2023-12-07T21:11:23.812477+0000","last_clean":"2023-12-07T21:11:23.812477+0000","last_became_active":"2023-12-07T21:09:02.899577+0000","last_became_peered":"2023-12-07T21:09:02.899577+0000","last_unstale":"2023-12-07T21:11:23.812477+0000","last_undegraded":"2023-12-07T21:11:23.812477+0000","last_fullsized":"2023-12-07T21:11:23.812477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:17.544167+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.544167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:41:11.013505+0000","scrub_duration":0.001052575,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:31.506752+0000","last_change":"2023-12-07T21:13:31.506752+0000","last_active":"2023-12-07T21:13:31.506752+0000","last_peered":"2023-12-07T21:13:31.506752+0000","last_clean":"2023-12-07T21:13:31.506752+0000","last_became_active":"2023-12-07T21:08:56.872271+0000","last_became_peered":"2023-12-07T21:08:56.872271+0000","last_unstale":"2023-12-07T21:13:31.506752+0000","last_undegraded":"2023-12-07T21:13:31.506752+0000","last_fullsized":"2023-12-07T21:13:31.506752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:31.506641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:31.506641+0000","last_clean_scrub_stamp":"2023-12-07T21:13:31.506641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:57:50.535477+0000","scrub_duration":0.0015893470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:33.305958+0000","last_change":"2023-12-07T21:14:33.305979+0000","last_active":"2023-12-07T21:14:33.305958+0000","last_peered":"2023-12-07T21:14:33.305958+0000","last_clean":"2023-12-07T21:14:33.305958+0000","last_became_active":"2023-12-07T21:08:54.892888+0000","last_became_peered":"2023-12-07T21:08:54.892888+0000","last_unstale":"2023-12-07T21:14:33.305958+0000","last_undegraded":"2023-12-07T21:14:33.305958+0000","last_fullsized":"2023-12-07T21:14:33.305958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:33.305845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:33.305845+0000","last_clean_scrub_stamp":"2023-12-07T21:14:33.305845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:37:20.389797+0000","scrub_duration":0.001218537,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.825163+0000","last_change":"2023-12-07T21:11:59.757120+0000","last_active":"2023-12-07T21:12:58.825163+0000","last_peered":"2023-12-07T21:12:58.825163+0000","last_clean":"2023-12-07T21:12:58.825163+0000","last_became_active":"2023-12-07T21:08:58.879220+0000","last_became_peered":"2023-12-07T21:08:58.879220+0000","last_unstale":"2023-12-07T21:12:58.825163+0000","last_undegraded":"2023-12-07T21:12:58.825163+0000","last_fullsized":"2023-12-07T21:12:58.825163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:59.757017+0000","last_clean_scrub_stamp":"2023-12-07T21:11:59.757017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:04:59.018197+0000","scrub_duration":0.001196353,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'61","reported_seq":128,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.783993+0000","last_change":"2023-12-07T21:11:44.783993+0000","last_active":"2023-12-07T21:11:44.783993+0000","last_peered":"2023-12-07T21:11:44.783993+0000","last_clean":"2023-12-07T21:11:44.783993+0000","last_became_active":"2023-12-07T21:09:00.885372+0000","last_became_peered":"2023-12-07T21:09:00.885372+0000","last_unstale":"2023-12-07T21:11:44.783993+0000","last_undegraded":"2023-12-07T21:11:44.783993+0000","last_fullsized":"2023-12-07T21:11:44.783993+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'61","last_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_deep_scrub":"33'61","last_deep_scrub_stamp":"2023-12-07T21:11:44.783824+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.783824+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:13:07.474940+0000","scrub_duration":0.004588193,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.558908+0000","last_change":"2023-12-07T21:11:36.558908+0000","last_active":"2023-12-07T21:11:36.558908+0000","last_peered":"2023-12-07T21:11:36.558908+0000","last_clean":"2023-12-07T21:11:36.558908+0000","last_became_active":"2023-12-07T21:09:02.900126+0000","last_became_peered":"2023-12-07T21:09:02.900126+0000","last_unstale":"2023-12-07T21:11:36.558908+0000","last_undegraded":"2023-12-07T21:11:36.558908+0000","last_fullsized":"2023-12-07T21:11:36.558908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:36.558807+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.558807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:33:06.320086+0000","scrub_duration":0.001387288,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'10","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:22.966818+0000","last_change":"2023-12-07T21:14:22.966859+0000","last_active":"2023-12-07T21:14:22.966818+0000","last_peered":"2023-12-07T21:14:22.966818+0000","last_clean":"2023-12-07T21:14:22.966818+0000","last_became_active":"2023-12-07T21:09:04.929423+0000","last_became_peered":"2023-12-07T21:09:04.929423+0000","last_unstale":"2023-12-07T21:14:22.966818+0000","last_undegraded":"2023-12-07T21:14:22.966818+0000","last_fullsized":"2023-12-07T21:14:22.966818+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2023-12-07T21:14:22.966677+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2023-12-07T21:14:22.966677+0000","last_clean_scrub_stamp":"2023-12-07T21:14:22.966677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:21:07.474679+0000","scrub_duration":0.0015071959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.825151+0000","last_change":"2023-12-07T21:12:19.862179+0000","last_active":"2023-12-07T21:12:58.825151+0000","last_peered":"2023-12-07T21:12:58.825151+0000","last_clean":"2023-12-07T21:12:58.825151+0000","last_became_active":"2023-12-07T21:08:56.876818+0000","last_became_peered":"2023-12-07T21:08:56.876818+0000","last_unstale":"2023-12-07T21:12:58.825151+0000","last_undegraded":"2023-12-07T21:12:58.825151+0000","last_fullsized":"2023-12-07T21:12:58.825151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:19.862069+0000","last_clean_scrub_stamp":"2023-12-07T21:12:19.862069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:34.168058+0000","scrub_duration":0.0015085669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.431844+0000","last_change":"2023-12-07T21:13:21.431844+0000","last_active":"2023-12-07T21:13:21.431844+0000","last_peered":"2023-12-07T21:13:21.431844+0000","last_clean":"2023-12-07T21:13:21.431844+0000","last_became_active":"2023-12-07T21:08:54.882008+0000","last_became_peered":"2023-12-07T21:08:54.882008+0000","last_unstale":"2023-12-07T21:13:21.431844+0000","last_undegraded":"2023-12-07T21:13:21.431844+0000","last_fullsized":"2023-12-07T21:13:21.431844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:21.431724+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.431724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:58:06.040375+0000","scrub_duration":0.0012195439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:23.469123+0000","last_change":"2023-12-07T21:14:23.469123+0000","last_active":"2023-12-07T21:14:23.469123+0000","last_peered":"2023-12-07T21:14:23.469123+0000","last_clean":"2023-12-07T21:14:23.469123+0000","last_became_active":"2023-12-07T21:09:35.952932+0000","last_became_peered":"2023-12-07T21:09:35.952932+0000","last_unstale":"2023-12-07T21:14:23.469123+0000","last_undegraded":"2023-12-07T21:14:23.469123+0000","last_fullsized":"2023-12-07T21:14:23.469123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:23.469019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:23.469019+0000","last_clean_scrub_stamp":"2023-12-07T21:14:23.469019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:10:52.576401+0000","scrub_duration":0.00098617400000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'44","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:21.514738+0000","last_change":"2023-12-07T21:12:21.514738+0000","last_active":"2023-12-07T21:12:21.514738+0000","last_peered":"2023-12-07T21:12:21.514738+0000","last_clean":"2023-12-07T21:12:21.514738+0000","last_became_active":"2023-12-07T21:09:00.887001+0000","last_became_peered":"2023-12-07T21:09:00.887001+0000","last_unstale":"2023-12-07T21:12:21.514738+0000","last_undegraded":"2023-12-07T21:12:21.514738+0000","last_fullsized":"2023-12-07T21:12:21.514738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2023-12-07T21:12:21.514603+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.514603+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:11.760175+0000","scrub_duration":0.0065721260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:13.399009+0000","last_change":"2023-12-07T21:12:13.399009+0000","last_active":"2023-12-07T21:12:13.399009+0000","last_peered":"2023-12-07T21:12:13.399009+0000","last_clean":"2023-12-07T21:12:13.399009+0000","last_became_active":"2023-12-07T21:09:02.907024+0000","last_became_peered":"2023-12-07T21:09:02.907024+0000","last_unstale":"2023-12-07T21:12:13.399009+0000","last_undegraded":"2023-12-07T21:12:13.399009+0000","last_fullsized":"2023-12-07T21:12:13.399009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:13.398859+0000","last_clean_scrub_stamp":"2023-12-07T21:12:13.398859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:05:54.725992+0000","scrub_duration":0.0011359600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:50.253895+0000","last_change":"2023-12-07T21:13:50.253916+0000","last_active":"2023-12-07T21:13:50.253895+0000","last_peered":"2023-12-07T21:13:50.253895+0000","last_clean":"2023-12-07T21:13:50.253895+0000","last_became_active":"2023-12-07T21:09:04.927658+0000","last_became_peered":"2023-12-07T21:09:04.927658+0000","last_unstale":"2023-12-07T21:13:50.253895+0000","last_undegraded":"2023-12-07T21:13:50.253895+0000","last_fullsized":"2023-12-07T21:13:50.253895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:50.253806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:50.253806+0000","last_clean_scrub_stamp":"2023-12-07T21:13:50.253806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:34:11.268340+0000","scrub_duration":0.0010687579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:11.432392+0000","last_change":"2023-12-07T21:12:11.432392+0000","last_active":"2023-12-07T21:12:11.432392+0000","last_peered":"2023-12-07T21:12:11.432392+0000","last_clean":"2023-12-07T21:12:11.432392+0000","last_became_active":"2023-12-07T21:08:56.884918+0000","last_became_peered":"2023-12-07T21:08:56.884918+0000","last_unstale":"2023-12-07T21:12:11.432392+0000","last_undegraded":"2023-12-07T21:12:11.432392+0000","last_fullsized":"2023-12-07T21:12:11.432392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:11.432277+0000","last_clean_scrub_stamp":"2023-12-07T21:12:11.432277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:48.190145+0000","scrub_duration":0.0010618419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.427565+0000","last_change":"2023-12-07T21:13:36.427565+0000","last_active":"2023-12-07T21:13:36.427565+0000","last_peered":"2023-12-07T21:13:36.427565+0000","last_clean":"2023-12-07T21:13:36.427565+0000","last_became_active":"2023-12-07T21:08:54.887254+0000","last_became_peered":"2023-12-07T21:08:54.887254+0000","last_unstale":"2023-12-07T21:13:36.427565+0000","last_undegraded":"2023-12-07T21:13:36.427565+0000","last_fullsized":"2023-12-07T21:13:36.427565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:36.427462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:36.427462+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.427462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:00:09.657217+0000","scrub_duration":0.0011997139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:10.553135+0000","last_change":"2023-12-07T21:12:10.553135+0000","last_active":"2023-12-07T21:12:10.553135+0000","last_peered":"2023-12-07T21:12:10.553135+0000","last_clean":"2023-12-07T21:12:10.553135+0000","last_became_active":"2023-12-07T21:08:58.876164+0000","last_became_peered":"2023-12-07T21:08:58.876164+0000","last_unstale":"2023-12-07T21:12:10.553135+0000","last_undegraded":"2023-12-07T21:12:10.553135+0000","last_fullsized":"2023-12-07T21:12:10.553135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:10.553023+0000","last_clean_scrub_stamp":"2023-12-07T21:12:10.553023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:52.504367+0000","scrub_duration":0.0013037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:36.745178+0000","last_change":"2023-12-07T21:11:36.745178+0000","last_active":"2023-12-07T21:11:36.745178+0000","last_peered":"2023-12-07T21:11:36.745178+0000","last_clean":"2023-12-07T21:11:36.745178+0000","last_became_active":"2023-12-07T21:09:00.889924+0000","last_became_peered":"2023-12-07T21:09:00.889924+0000","last_unstale":"2023-12-07T21:11:36.745178+0000","last_undegraded":"2023-12-07T21:11:36.745178+0000","last_fullsized":"2023-12-07T21:11:36.745178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2023-12-07T21:11:36.745068+0000","last_clean_scrub_stamp":"2023-12-07T21:11:36.745068+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:48:09.080620+0000","scrub_duration":0.0072373669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:03.826019+0000","last_change":"2023-12-07T21:11:16.616710+0000","last_active":"2023-12-07T21:13:03.826019+0000","last_peered":"2023-12-07T21:13:03.826019+0000","last_clean":"2023-12-07T21:13:03.826019+0000","last_became_active":"2023-12-07T21:09:02.900854+0000","last_became_peered":"2023-12-07T21:09:02.900854+0000","last_unstale":"2023-12-07T21:13:03.826019+0000","last_undegraded":"2023-12-07T21:13:03.826019+0000","last_fullsized":"2023-12-07T21:13:03.826019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:16.616606+0000","last_clean_scrub_stamp":"2023-12-07T21:11:16.616606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:46:13.169243+0000","scrub_duration":0.0012155689999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'2","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:15:05.649028+0000","last_change":"2023-12-07T21:15:05.649078+0000","last_active":"2023-12-07T21:15:05.649028+0000","last_peered":"2023-12-07T21:15:05.649028+0000","last_clean":"2023-12-07T21:15:05.649028+0000","last_became_active":"2023-12-07T21:09:04.930702+0000","last_became_peered":"2023-12-07T21:09:04.930702+0000","last_unstale":"2023-12-07T21:15:05.649028+0000","last_undegraded":"2023-12-07T21:15:05.649028+0000","last_fullsized":"2023-12-07T21:15:05.649028+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:15:05.648920+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:15:05.648920+0000","last_clean_scrub_stamp":"2023-12-07T21:15:05.648920+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:00:48.283337+0000","scrub_duration":0.00116956,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.879540+0000","last_change":"2023-12-07T21:12:56.879540+0000","last_active":"2023-12-07T21:12:56.879540+0000","last_peered":"2023-12-07T21:12:56.879540+0000","last_clean":"2023-12-07T21:12:56.879540+0000","last_became_active":"2023-12-07T21:08:56.872294+0000","last_became_peered":"2023-12-07T21:08:56.872294+0000","last_unstale":"2023-12-07T21:12:56.879540+0000","last_undegraded":"2023-12-07T21:12:56.879540+0000","last_fullsized":"2023-12-07T21:12:56.879540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:56.879389+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.879389+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:54:47.124961+0000","scrub_duration":0.0034133409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.341852+0000","last_change":"2023-12-07T21:14:02.341875+0000","last_active":"2023-12-07T21:14:02.341852+0000","last_peered":"2023-12-07T21:14:02.341852+0000","last_clean":"2023-12-07T21:14:02.341852+0000","last_became_active":"2023-12-07T21:08:54.880666+0000","last_became_peered":"2023-12-07T21:08:54.880666+0000","last_unstale":"2023-12-07T21:14:02.341852+0000","last_undegraded":"2023-12-07T21:14:02.341852+0000","last_fullsized":"2023-12-07T21:14:02.341852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:02.341757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:02.341757+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.341757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:33:42.946314+0000","scrub_duration":0.001137264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.324449+0000","last_change":"2023-12-07T21:11:41.324449+0000","last_active":"2023-12-07T21:11:41.324449+0000","last_peered":"2023-12-07T21:11:41.324449+0000","last_clean":"2023-12-07T21:11:41.324449+0000","last_became_active":"2023-12-07T21:08:58.875303+0000","last_became_peered":"2023-12-07T21:08:58.875303+0000","last_unstale":"2023-12-07T21:11:41.324449+0000","last_undegraded":"2023-12-07T21:11:41.324449+0000","last_fullsized":"2023-12-07T21:11:41.324449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:41.324294+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.324294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:18:22.956309+0000","scrub_duration":0.001431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'15","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:03.838621+0000","last_change":"2023-12-07T21:12:42.649725+0000","last_active":"2023-12-07T21:13:03.838621+0000","last_peered":"2023-12-07T21:13:03.838621+0000","last_clean":"2023-12-07T21:13:03.838621+0000","last_became_active":"2023-12-07T21:09:00.895912+0000","last_became_peered":"2023-12-07T21:09:00.895912+0000","last_unstale":"2023-12-07T21:13:03.838621+0000","last_undegraded":"2023-12-07T21:13:03.838621+0000","last_fullsized":"2023-12-07T21:13:03.838621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2023-12-07T21:12:42.649582+0000","last_clean_scrub_stamp":"2023-12-07T21:12:42.649582+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:55:46.065006+0000","scrub_duration":0.0041186950000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'246","reported_seq":325,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:10.411924+0000","last_change":"2023-12-07T21:11:10.411924+0000","last_active":"2023-12-07T21:11:10.411924+0000","last_peered":"2023-12-07T21:11:10.411924+0000","last_clean":"2023-12-07T21:11:10.411924+0000","last_became_active":"2023-12-07T21:09:02.907694+0000","last_became_peered":"2023-12-07T21:09:02.907694+0000","last_unstale":"2023-12-07T21:11:10.411924+0000","last_undegraded":"2023-12-07T21:11:10.411924+0000","last_fullsized":"2023-12-07T21:11:10.411924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'246","last_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_deep_scrub":"33'246","last_deep_scrub_stamp":"2023-12-07T21:11:10.411809+0000","last_clean_scrub_stamp":"2023-12-07T21:11:10.411809+0000","objects_scrubbed":1,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:03:15.960283+0000","scrub_duration":0.0015206340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:59.602832+0000","last_change":"2023-12-07T21:14:59.602860+0000","last_active":"2023-12-07T21:14:59.602832+0000","last_peered":"2023-12-07T21:14:59.602832+0000","last_clean":"2023-12-07T21:14:59.602832+0000","last_became_active":"2023-12-07T21:09:04.927489+0000","last_became_peered":"2023-12-07T21:09:04.927489+0000","last_unstale":"2023-12-07T21:14:59.602832+0000","last_undegraded":"2023-12-07T21:14:59.602832+0000","last_fullsized":"2023-12-07T21:14:59.602832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:59.602719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:59.602719+0000","last_clean_scrub_stamp":"2023-12-07T21:14:59.602719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:55:26.307001+0000","scrub_duration":0.001066827,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"31'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:07.370762+0000","last_change":"2023-12-07T21:13:07.370762+0000","last_active":"2023-12-07T21:13:07.370762+0000","last_peered":"2023-12-07T21:13:07.370762+0000","last_clean":"2023-12-07T21:13:07.370762+0000","last_became_active":"2023-12-07T21:08:56.870689+0000","last_became_peered":"2023-12-07T21:08:56.870689+0000","last_unstale":"2023-12-07T21:13:07.370762+0000","last_undegraded":"2023-12-07T21:13:07.370762+0000","last_fullsized":"2023-12-07T21:13:07.370762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:13:07.370606+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.370606+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:02:06.037407+0000","scrub_duration":0.0014696010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"31'2","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:23.432268+0000","last_change":"2023-12-07T21:13:23.432268+0000","last_active":"2023-12-07T21:13:23.432268+0000","last_peered":"2023-12-07T21:13:23.432268+0000","last_clean":"2023-12-07T21:13:23.432268+0000","last_became_active":"2023-12-07T21:08:54.876465+0000","last_became_peered":"2023-12-07T21:08:54.876465+0000","last_unstale":"2023-12-07T21:13:23.432268+0000","last_undegraded":"2023-12-07T21:13:23.432268+0000","last_fullsized":"2023-12-07T21:13:23.432268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:23.432146+0000","last_clean_scrub_stamp":"2023-12-07T21:13:23.432146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:02:08.854218+0000","scrub_duration":0.001156783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:43.351557+0000","last_change":"2023-12-07T21:11:43.351557+0000","last_active":"2023-12-07T21:11:43.351557+0000","last_peered":"2023-12-07T21:11:43.351557+0000","last_clean":"2023-12-07T21:11:43.351557+0000","last_became_active":"2023-12-07T21:08:58.875795+0000","last_became_peered":"2023-12-07T21:08:58.875795+0000","last_unstale":"2023-12-07T21:11:43.351557+0000","last_undegraded":"2023-12-07T21:11:43.351557+0000","last_fullsized":"2023-12-07T21:11:43.351557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:43.351414+0000","last_clean_scrub_stamp":"2023-12-07T21:11:43.351414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:50:25.302758+0000","scrub_duration":0.001534795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'43","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.813759+0000","last_change":"2023-12-07T21:11:17.102589+0000","last_active":"2023-12-07T21:11:28.813759+0000","last_peered":"2023-12-07T21:11:28.813759+0000","last_clean":"2023-12-07T21:11:28.813759+0000","last_became_active":"2023-12-07T21:09:00.891999+0000","last_became_peered":"2023-12-07T21:09:00.891999+0000","last_unstale":"2023-12-07T21:11:28.813759+0000","last_undegraded":"2023-12-07T21:11:28.813759+0000","last_fullsized":"2023-12-07T21:11:28.813759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'43","last_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_deep_scrub":"33'43","last_deep_scrub_stamp":"2023-12-07T21:11:17.102467+0000","last_clean_scrub_stamp":"2023-12-07T21:11:17.102467+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:28:11.711550+0000","scrub_duration":0.0053068029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:28.806704+0000","last_change":"2023-12-07T21:11:27.804304+0000","last_active":"2023-12-07T21:11:28.806704+0000","last_peered":"2023-12-07T21:11:28.806704+0000","last_clean":"2023-12-07T21:11:28.806704+0000","last_became_active":"2023-12-07T21:09:02.906513+0000","last_became_peered":"2023-12-07T21:09:02.906513+0000","last_unstale":"2023-12-07T21:11:28.806704+0000","last_undegraded":"2023-12-07T21:11:28.806704+0000","last_fullsized":"2023-12-07T21:11:28.806704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:27.804160+0000","last_clean_scrub_stamp":"2023-12-07T21:11:27.804160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:32:38.604796+0000","scrub_duration":0.001275041,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:58.411345+0000","last_change":"2023-12-07T21:13:58.411345+0000","last_active":"2023-12-07T21:13:58.411345+0000","last_peered":"2023-12-07T21:13:58.411345+0000","last_clean":"2023-12-07T21:13:58.411345+0000","last_became_active":"2023-12-07T21:09:04.925215+0000","last_became_peered":"2023-12-07T21:09:04.925215+0000","last_unstale":"2023-12-07T21:13:58.411345+0000","last_undegraded":"2023-12-07T21:13:58.411345+0000","last_fullsized":"2023-12-07T21:13:58.411345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:58.411237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:58.411237+0000","last_clean_scrub_stamp":"2023-12-07T21:13:58.411237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:14:57.593351+0000","scrub_duration":0.00098503999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:17.462525+0000","last_change":"2023-12-07T21:13:17.462525+0000","last_active":"2023-12-07T21:13:17.462525+0000","last_peered":"2023-12-07T21:13:17.462525+0000","last_clean":"2023-12-07T21:13:17.462525+0000","last_became_active":"2023-12-07T21:08:56.870713+0000","last_became_peered":"2023-12-07T21:08:56.870713+0000","last_unstale":"2023-12-07T21:13:17.462525+0000","last_undegraded":"2023-12-07T21:13:17.462525+0000","last_fullsized":"2023-12-07T21:13:17.462525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:17.462415+0000","last_clean_scrub_stamp":"2023-12-07T21:13:17.462415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:57.578294+0000","scrub_duration":0.0013457709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:01.338926+0000","last_change":"2023-12-07T21:14:01.338946+0000","last_active":"2023-12-07T21:14:01.338926+0000","last_peered":"2023-12-07T21:14:01.338926+0000","last_clean":"2023-12-07T21:14:01.338926+0000","last_became_active":"2023-12-07T21:08:54.891527+0000","last_became_peered":"2023-12-07T21:08:54.891527+0000","last_unstale":"2023-12-07T21:14:01.338926+0000","last_undegraded":"2023-12-07T21:14:01.338926+0000","last_fullsized":"2023-12-07T21:14:01.338926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:01.338826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:01.338826+0000","last_clean_scrub_stamp":"2023-12-07T21:14:01.338826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:05:19.893425+0000","scrub_duration":0.0012369779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:17.612358+0000","last_change":"2023-12-07T21:12:17.612358+0000","last_active":"2023-12-07T21:12:17.612358+0000","last_peered":"2023-12-07T21:12:17.612358+0000","last_clean":"2023-12-07T21:12:17.612358+0000","last_became_active":"2023-12-07T21:08:58.881633+0000","last_became_peered":"2023-12-07T21:08:58.881633+0000","last_unstale":"2023-12-07T21:12:17.612358+0000","last_undegraded":"2023-12-07T21:12:17.612358+0000","last_fullsized":"2023-12-07T21:12:17.612358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:17.612233+0000","last_clean_scrub_stamp":"2023-12-07T21:12:17.612233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:28:19.658682+0000","scrub_duration":0.00093805400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'35","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:41.713922+0000","last_change":"2023-12-07T21:11:41.713922+0000","last_active":"2023-12-07T21:11:41.713922+0000","last_peered":"2023-12-07T21:11:41.713922+0000","last_clean":"2023-12-07T21:11:41.713922+0000","last_became_active":"2023-12-07T21:09:00.894316+0000","last_became_peered":"2023-12-07T21:09:00.894316+0000","last_unstale":"2023-12-07T21:11:41.713922+0000","last_undegraded":"2023-12-07T21:11:41.713922+0000","last_fullsized":"2023-12-07T21:11:41.713922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2023-12-07T21:11:41.713762+0000","last_clean_scrub_stamp":"2023-12-07T21:11:41.713762+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:20:34.087308+0000","scrub_duration":0.004054785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.510342+0000","last_change":"2023-12-07T21:12:27.510342+0000","last_active":"2023-12-07T21:12:27.510342+0000","last_peered":"2023-12-07T21:12:27.510342+0000","last_clean":"2023-12-07T21:12:27.510342+0000","last_became_active":"2023-12-07T21:09:02.907394+0000","last_became_peered":"2023-12-07T21:09:02.907394+0000","last_unstale":"2023-12-07T21:12:27.510342+0000","last_undegraded":"2023-12-07T21:12:27.510342+0000","last_fullsized":"2023-12-07T21:12:27.510342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:27.510237+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.510237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:17:49.420820+0000","scrub_duration":0.00099611600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'3","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:15:03.709933+0000","last_change":"2023-12-07T21:15:03.709964+0000","last_active":"2023-12-07T21:15:03.709933+0000","last_peered":"2023-12-07T21:15:03.709933+0000","last_clean":"2023-12-07T21:15:03.709933+0000","last_became_active":"2023-12-07T21:09:04.927541+0000","last_became_peered":"2023-12-07T21:09:04.927541+0000","last_unstale":"2023-12-07T21:15:03.709933+0000","last_undegraded":"2023-12-07T21:15:03.709933+0000","last_fullsized":"2023-12-07T21:15:03.709933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2023-12-07T21:15:03.709851+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2023-12-07T21:15:03.709851+0000","last_clean_scrub_stamp":"2023-12-07T21:15:03.709851+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:25:08.226473+0000","scrub_duration":0.002659897,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'6","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:28.564326+0000","last_change":"2023-12-07T21:13:28.564326+0000","last_active":"2023-12-07T21:13:28.564326+0000","last_peered":"2023-12-07T21:13:28.564326+0000","last_clean":"2023-12-07T21:13:28.564326+0000","last_became_active":"2023-12-07T21:08:56.872807+0000","last_became_peered":"2023-12-07T21:08:56.872807+0000","last_unstale":"2023-12-07T21:13:28.564326+0000","last_undegraded":"2023-12-07T21:13:28.564326+0000","last_fullsized":"2023-12-07T21:13:28.564326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:28.564212+0000","last_clean_scrub_stamp":"2023-12-07T21:13:28.564212+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:58:00.422576+0000","scrub_duration":0.0013779650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.878977+0000","last_change":"2023-12-07T21:13:08.878977+0000","last_active":"2023-12-07T21:13:08.878977+0000","last_peered":"2023-12-07T21:13:08.878977+0000","last_clean":"2023-12-07T21:13:08.878977+0000","last_became_active":"2023-12-07T21:08:54.890440+0000","last_became_peered":"2023-12-07T21:08:54.890440+0000","last_unstale":"2023-12-07T21:13:08.878977+0000","last_undegraded":"2023-12-07T21:13:08.878977+0000","last_fullsized":"2023-12-07T21:13:08.878977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:08.878805+0000","last_clean_scrub_stamp":"2023-12-07T21:13:08.878805+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T09:00:03.437843+0000","scrub_duration":0.0021145529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:55.412366+0000","last_change":"2023-12-07T21:11:55.412366+0000","last_active":"2023-12-07T21:11:55.412366+0000","last_peered":"2023-12-07T21:11:55.412366+0000","last_clean":"2023-12-07T21:11:55.412366+0000","last_became_active":"2023-12-07T21:08:58.878179+0000","last_became_peered":"2023-12-07T21:08:58.878179+0000","last_unstale":"2023-12-07T21:11:55.412366+0000","last_undegraded":"2023-12-07T21:11:55.412366+0000","last_fullsized":"2023-12-07T21:11:55.412366+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:55.412243+0000","last_clean_scrub_stamp":"2023-12-07T21:11:55.412243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:07.514434+0000","scrub_duration":0.0010230090000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:00.405945+0000","last_change":"2023-12-07T21:12:00.405945+0000","last_active":"2023-12-07T21:12:00.405945+0000","last_peered":"2023-12-07T21:12:00.405945+0000","last_clean":"2023-12-07T21:12:00.405945+0000","last_became_active":"2023-12-07T21:09:00.889623+0000","last_became_peered":"2023-12-07T21:09:00.889623+0000","last_unstale":"2023-12-07T21:12:00.405945+0000","last_undegraded":"2023-12-07T21:12:00.405945+0000","last_fullsized":"2023-12-07T21:12:00.405945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'29","last_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_deep_scrub":"33'29","last_deep_scrub_stamp":"2023-12-07T21:12:00.405797+0000","last_clean_scrub_stamp":"2023-12-07T21:12:00.405797+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:48:22.672028+0000","scrub_duration":0.0030248670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.620711+0000","last_change":"2023-12-07T21:12:35.620711+0000","last_active":"2023-12-07T21:12:35.620711+0000","last_peered":"2023-12-07T21:12:35.620711+0000","last_clean":"2023-12-07T21:12:35.620711+0000","last_became_active":"2023-12-07T21:09:02.905909+0000","last_became_peered":"2023-12-07T21:09:02.905909+0000","last_unstale":"2023-12-07T21:12:35.620711+0000","last_undegraded":"2023-12-07T21:12:35.620711+0000","last_fullsized":"2023-12-07T21:12:35.620711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:35.620604+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.620604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:45:58.984206+0000","scrub_duration":0.00101417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:15:10.635238+0000","last_change":"2023-12-07T21:15:10.635274+0000","last_active":"2023-12-07T21:15:10.635238+0000","last_peered":"2023-12-07T21:15:10.635238+0000","last_clean":"2023-12-07T21:15:10.635238+0000","last_became_active":"2023-12-07T21:09:04.930768+0000","last_became_peered":"2023-12-07T21:09:04.930768+0000","last_unstale":"2023-12-07T21:15:10.635238+0000","last_undegraded":"2023-12-07T21:15:10.635238+0000","last_fullsized":"2023-12-07T21:15:10.635238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:15:10.635097+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:15:10.635097+0000","last_clean_scrub_stamp":"2023-12-07T21:15:10.635097+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:42:54.262919+0000","scrub_duration":0.0011852309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'14","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:45.443225+0000","last_change":"2023-12-07T21:12:45.443225+0000","last_active":"2023-12-07T21:12:45.443225+0000","last_peered":"2023-12-07T21:12:45.443225+0000","last_clean":"2023-12-07T21:12:45.443225+0000","last_became_active":"2023-12-07T21:08:56.869375+0000","last_became_peered":"2023-12-07T21:08:56.869375+0000","last_unstale":"2023-12-07T21:12:45.443225+0000","last_undegraded":"2023-12-07T21:12:45.443225+0000","last_fullsized":"2023-12-07T21:12:45.443225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:45.443116+0000","last_clean_scrub_stamp":"2023-12-07T21:12:45.443116+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:59.105780+0000","scrub_duration":0.003118975,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.839315+0000","last_change":"2023-12-07T21:12:41.352194+0000","last_active":"2023-12-07T21:13:08.839315+0000","last_peered":"2023-12-07T21:13:08.839315+0000","last_clean":"2023-12-07T21:13:08.839315+0000","last_became_active":"2023-12-07T21:08:54.878410+0000","last_became_peered":"2023-12-07T21:08:54.878410+0000","last_unstale":"2023-12-07T21:13:08.839315+0000","last_undegraded":"2023-12-07T21:13:08.839315+0000","last_fullsized":"2023-12-07T21:13:08.839315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:41.352075+0000","last_clean_scrub_stamp":"2023-12-07T21:12:41.352075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:54:21.467955+0000","scrub_duration":0.001369671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'8","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:44.347728+0000","last_change":"2023-12-07T21:11:44.347728+0000","last_active":"2023-12-07T21:11:44.347728+0000","last_peered":"2023-12-07T21:11:44.347728+0000","last_clean":"2023-12-07T21:11:44.347728+0000","last_became_active":"2023-12-07T21:08:58.877368+0000","last_became_peered":"2023-12-07T21:08:58.877368+0000","last_unstale":"2023-12-07T21:11:44.347728+0000","last_undegraded":"2023-12-07T21:11:44.347728+0000","last_fullsized":"2023-12-07T21:11:44.347728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:11:44.347582+0000","last_clean_scrub_stamp":"2023-12-07T21:11:44.347582+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:19:20.740832+0000","scrub_duration":0.0032839919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":920,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'37","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:06.582486+0000","last_change":"2023-12-07T21:13:06.582486+0000","last_active":"2023-12-07T21:13:06.582486+0000","last_peered":"2023-12-07T21:13:06.582486+0000","last_clean":"2023-12-07T21:13:06.582486+0000","last_became_active":"2023-12-07T21:09:00.887563+0000","last_became_peered":"2023-12-07T21:09:00.887563+0000","last_unstale":"2023-12-07T21:13:06.582486+0000","last_undegraded":"2023-12-07T21:13:06.582486+0000","last_fullsized":"2023-12-07T21:13:06.582486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'37","last_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_deep_scrub":"33'37","last_deep_scrub_stamp":"2023-12-07T21:13:06.582338+0000","last_clean_scrub_stamp":"2023-12-07T21:13:06.582338+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:09:35.689720+0000","scrub_duration":0.0045970239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:11:33.807904+0000","last_change":"2023-12-07T21:11:15.597790+0000","last_active":"2023-12-07T21:11:33.807904+0000","last_peered":"2023-12-07T21:11:33.807904+0000","last_clean":"2023-12-07T21:11:33.807904+0000","last_became_active":"2023-12-07T21:09:02.906600+0000","last_became_peered":"2023-12-07T21:09:02.906600+0000","last_unstale":"2023-12-07T21:11:33.807904+0000","last_undegraded":"2023-12-07T21:11:33.807904+0000","last_fullsized":"2023-12-07T21:11:33.807904+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:11:15.597687+0000","last_clean_scrub_stamp":"2023-12-07T21:11:15.597687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:32:45.358966+0000","scrub_duration":0.0015293150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:38.425991+0000","last_change":"2023-12-07T21:13:38.425991+0000","last_active":"2023-12-07T21:13:38.425991+0000","last_peered":"2023-12-07T21:13:38.425991+0000","last_clean":"2023-12-07T21:13:38.425991+0000","last_became_active":"2023-12-07T21:09:04.927735+0000","last_became_peered":"2023-12-07T21:09:04.927735+0000","last_unstale":"2023-12-07T21:13:38.425991+0000","last_undegraded":"2023-12-07T21:13:38.425991+0000","last_fullsized":"2023-12-07T21:13:38.425991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:38.425888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:38.425888+0000","last_clean_scrub_stamp":"2023-12-07T21:13:38.425888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T01:24:24.944080+0000","scrub_duration":0.0010394829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'8","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:20.282874+0000","last_change":"2023-12-07T21:12:20.282874+0000","last_active":"2023-12-07T21:12:20.282874+0000","last_peered":"2023-12-07T21:12:20.282874+0000","last_clean":"2023-12-07T21:12:20.282874+0000","last_became_active":"2023-12-07T21:08:56.883842+0000","last_became_peered":"2023-12-07T21:08:56.883842+0000","last_unstale":"2023-12-07T21:12:20.282874+0000","last_undegraded":"2023-12-07T21:12:20.282874+0000","last_fullsized":"2023-12-07T21:12:20.282874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:20.282741+0000","last_clean_scrub_stamp":"2023-12-07T21:12:20.282741+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:27:25.331572+0000","scrub_duration":0.001103185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.410456+0000","last_change":"2023-12-07T21:13:11.410456+0000","last_active":"2023-12-07T21:13:11.410456+0000","last_peered":"2023-12-07T21:13:11.410456+0000","last_clean":"2023-12-07T21:13:11.410456+0000","last_became_active":"2023-12-07T21:08:54.882979+0000","last_became_peered":"2023-12-07T21:08:54.882979+0000","last_unstale":"2023-12-07T21:13:11.410456+0000","last_undegraded":"2023-12-07T21:13:11.410456+0000","last_fullsized":"2023-12-07T21:13:11.410456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.410343+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.410343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:25:05.365800+0000","scrub_duration":0.00143078,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:35.887062+0000","last_change":"2023-12-07T21:12:35.887062+0000","last_active":"2023-12-07T21:12:35.887062+0000","last_peered":"2023-12-07T21:12:35.887062+0000","last_clean":"2023-12-07T21:12:35.887062+0000","last_became_active":"2023-12-07T21:08:56.873059+0000","last_became_peered":"2023-12-07T21:08:56.873059+0000","last_unstale":"2023-12-07T21:12:35.887062+0000","last_undegraded":"2023-12-07T21:12:35.887062+0000","last_fullsized":"2023-12-07T21:12:35.887062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2023-12-07T21:12:35.886915+0000","last_clean_scrub_stamp":"2023-12-07T21:12:35.886915+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:14:07.595951+0000","scrub_duration":0.0013132650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"31'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:52.022881+0000","last_change":"2023-12-07T21:13:52.022881+0000","last_active":"2023-12-07T21:13:52.022881+0000","last_peered":"2023-12-07T21:13:52.022881+0000","last_clean":"2023-12-07T21:13:52.022881+0000","last_became_active":"2023-12-07T21:08:54.873778+0000","last_became_peered":"2023-12-07T21:08:54.873778+0000","last_unstale":"2023-12-07T21:13:52.022881+0000","last_undegraded":"2023-12-07T21:13:52.022881+0000","last_fullsized":"2023-12-07T21:13:52.022881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:52.022763+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:52.022763+0000","last_clean_scrub_stamp":"2023-12-07T21:13:52.022763+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:23:15.784577+0000","scrub_duration":0.001528983,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:12.424126+0000","last_change":"2023-12-07T21:12:12.424126+0000","last_active":"2023-12-07T21:12:12.424126+0000","last_peered":"2023-12-07T21:12:12.424126+0000","last_clean":"2023-12-07T21:12:12.424126+0000","last_became_active":"2023-12-07T21:08:56.874320+0000","last_became_peered":"2023-12-07T21:08:56.874320+0000","last_unstale":"2023-12-07T21:12:12.424126+0000","last_undegraded":"2023-12-07T21:12:12.424126+0000","last_fullsized":"2023-12-07T21:12:12.424126+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:12.424026+0000","last_clean_scrub_stamp":"2023-12-07T21:12:12.424026+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:21.643939+0000","scrub_duration":0.002995218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"31'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:54.589143+0000","last_change":"2023-12-07T21:14:54.589143+0000","last_active":"2023-12-07T21:14:54.589143+0000","last_peered":"2023-12-07T21:14:54.589143+0000","last_clean":"2023-12-07T21:14:54.589143+0000","last_became_active":"2023-12-07T21:08:54.884649+0000","last_became_peered":"2023-12-07T21:08:54.884649+0000","last_unstale":"2023-12-07T21:14:54.589143+0000","last_undegraded":"2023-12-07T21:14:54.589143+0000","last_fullsized":"2023-12-07T21:14:54.589143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:14:54.589022+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:14:54.589022+0000","last_clean_scrub_stamp":"2023-12-07T21:14:54.589022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:44:14.494330+0000","scrub_duration":0.0012822790000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:36.040427+0000","last_change":"2023-12-07T21:13:36.040464+0000","last_active":"2023-12-07T21:13:36.040427+0000","last_peered":"2023-12-07T21:13:36.040427+0000","last_clean":"2023-12-07T21:13:36.040427+0000","last_became_active":"2023-12-07T21:08:56.871972+0000","last_became_peered":"2023-12-07T21:08:56.871972+0000","last_unstale":"2023-12-07T21:13:36.040427+0000","last_undegraded":"2023-12-07T21:13:36.040427+0000","last_fullsized":"2023-12-07T21:13:36.040427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:36.040303+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:36.040303+0000","last_clean_scrub_stamp":"2023-12-07T21:13:36.040303+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:27:20.323619+0000","scrub_duration":0.0015351799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:59.931849+0000","last_change":"2023-12-07T21:13:59.931849+0000","last_active":"2023-12-07T21:13:59.931849+0000","last_peered":"2023-12-07T21:13:59.931849+0000","last_clean":"2023-12-07T21:13:59.931849+0000","last_became_active":"2023-12-07T21:08:54.881818+0000","last_became_peered":"2023-12-07T21:08:54.881818+0000","last_unstale":"2023-12-07T21:13:59.931849+0000","last_undegraded":"2023-12-07T21:13:59.931849+0000","last_fullsized":"2023-12-07T21:13:59.931849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:59.931743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:59.931743+0000","last_clean_scrub_stamp":"2023-12-07T21:13:59.931743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:28:27.479281+0000","scrub_duration":0.0012518340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.827004+0000","last_change":"2023-12-07T21:13:07.893908+0000","last_active":"2023-12-07T21:13:08.827004+0000","last_peered":"2023-12-07T21:13:08.827004+0000","last_clean":"2023-12-07T21:13:08.827004+0000","last_became_active":"2023-12-07T21:08:56.875735+0000","last_became_peered":"2023-12-07T21:08:56.875735+0000","last_unstale":"2023-12-07T21:13:08.827004+0000","last_undegraded":"2023-12-07T21:13:08.827004+0000","last_fullsized":"2023-12-07T21:13:08.827004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:13:07.893732+0000","last_clean_scrub_stamp":"2023-12-07T21:13:07.893732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T03:08:21.957836+0000","scrub_duration":0.0014675510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:43.075446+0000","last_change":"2023-12-07T21:13:43.075468+0000","last_active":"2023-12-07T21:13:43.075446+0000","last_peered":"2023-12-07T21:13:43.075446+0000","last_clean":"2023-12-07T21:13:43.075446+0000","last_became_active":"2023-12-07T21:08:54.874313+0000","last_became_peered":"2023-12-07T21:08:54.874313+0000","last_unstale":"2023-12-07T21:13:43.075446+0000","last_undegraded":"2023-12-07T21:13:43.075446+0000","last_fullsized":"2023-12-07T21:13:43.075446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:43.075357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:43.075357+0000","last_clean_scrub_stamp":"2023-12-07T21:13:43.075357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T08:54:16.414998+0000","scrub_duration":0.001175125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:39.400502+0000","last_change":"2023-12-07T21:13:39.400502+0000","last_active":"2023-12-07T21:13:39.400502+0000","last_peered":"2023-12-07T21:13:39.400502+0000","last_clean":"2023-12-07T21:13:39.400502+0000","last_became_active":"2023-12-07T21:08:56.882947+0000","last_became_peered":"2023-12-07T21:08:56.882947+0000","last_unstale":"2023-12-07T21:13:39.400502+0000","last_undegraded":"2023-12-07T21:13:39.400502+0000","last_fullsized":"2023-12-07T21:13:39.400502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:39.400392+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:39.400392+0000","last_clean_scrub_stamp":"2023-12-07T21:13:39.400392+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:58:58.675909+0000","scrub_duration":0.0010690470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:27.488346+0000","last_change":"2023-12-07T21:13:27.488385+0000","last_active":"2023-12-07T21:13:27.488346+0000","last_peered":"2023-12-07T21:13:27.488346+0000","last_clean":"2023-12-07T21:13:27.488346+0000","last_became_active":"2023-12-07T21:08:54.886945+0000","last_became_peered":"2023-12-07T21:08:54.886945+0000","last_unstale":"2023-12-07T21:13:27.488346+0000","last_undegraded":"2023-12-07T21:13:27.488346+0000","last_fullsized":"2023-12-07T21:13:27.488346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:27.488243+0000","last_clean_scrub_stamp":"2023-12-07T21:13:27.488243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:33:20.217342+0000","scrub_duration":0.0011396240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.826918+0000","last_change":"2023-12-07T21:12:21.783809+0000","last_active":"2023-12-07T21:13:08.826918+0000","last_peered":"2023-12-07T21:13:08.826918+0000","last_clean":"2023-12-07T21:13:08.826918+0000","last_became_active":"2023-12-07T21:08:56.875940+0000","last_became_peered":"2023-12-07T21:08:56.875940+0000","last_unstale":"2023-12-07T21:13:08.826918+0000","last_undegraded":"2023-12-07T21:13:08.826918+0000","last_fullsized":"2023-12-07T21:13:08.826918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:21.783687+0000","last_clean_scrub_stamp":"2023-12-07T21:12:21.783687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:56:25.104216+0000","scrub_duration":0.001223366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:58.417813+0000","last_change":"2023-12-07T21:12:58.417813+0000","last_active":"2023-12-07T21:12:58.417813+0000","last_peered":"2023-12-07T21:12:58.417813+0000","last_clean":"2023-12-07T21:12:58.417813+0000","last_became_active":"2023-12-07T21:08:54.884603+0000","last_became_peered":"2023-12-07T21:08:54.884603+0000","last_unstale":"2023-12-07T21:12:58.417813+0000","last_undegraded":"2023-12-07T21:12:58.417813+0000","last_fullsized":"2023-12-07T21:12:58.417813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:58.417685+0000","last_clean_scrub_stamp":"2023-12-07T21:12:58.417685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:15:16.173945+0000","scrub_duration":0.0012264019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:08.838702+0000","last_change":"2023-12-07T21:12:14.393510+0000","last_active":"2023-12-07T21:13:08.838702+0000","last_peered":"2023-12-07T21:13:08.838702+0000","last_clean":"2023-12-07T21:13:08.838702+0000","last_became_active":"2023-12-07T21:08:56.886731+0000","last_became_peered":"2023-12-07T21:08:56.886731+0000","last_unstale":"2023-12-07T21:13:08.838702+0000","last_undegraded":"2023-12-07T21:13:08.838702+0000","last_fullsized":"2023-12-07T21:13:08.838702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:14.393370+0000","last_clean_scrub_stamp":"2023-12-07T21:12:14.393370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:42:28.056034+0000","scrub_duration":0.0012787390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"31'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:02.892420+0000","last_change":"2023-12-07T21:14:02.892444+0000","last_active":"2023-12-07T21:14:02.892420+0000","last_peered":"2023-12-07T21:14:02.892420+0000","last_clean":"2023-12-07T21:14:02.892420+0000","last_became_active":"2023-12-07T21:08:54.881785+0000","last_became_peered":"2023-12-07T21:08:54.881785+0000","last_unstale":"2023-12-07T21:14:02.892420+0000","last_undegraded":"2023-12-07T21:14:02.892420+0000","last_fullsized":"2023-12-07T21:14:02.892420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2023-12-07T21:14:02.892333+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2023-12-07T21:14:02.892333+0000","last_clean_scrub_stamp":"2023-12-07T21:14:02.892333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:08:55.928235+0000","scrub_duration":0.001620423,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:22.292065+0000","last_change":"2023-12-07T21:12:22.292065+0000","last_active":"2023-12-07T21:12:22.292065+0000","last_peered":"2023-12-07T21:12:22.292065+0000","last_clean":"2023-12-07T21:12:22.292065+0000","last_became_active":"2023-12-07T21:08:56.881706+0000","last_became_peered":"2023-12-07T21:08:56.881706+0000","last_unstale":"2023-12-07T21:12:22.292065+0000","last_undegraded":"2023-12-07T21:12:22.292065+0000","last_fullsized":"2023-12-07T21:12:22.292065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:22.291964+0000","last_clean_scrub_stamp":"2023-12-07T21:12:22.291964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:19:35.510802+0000","scrub_duration":0.000955034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:52.593198+0000","last_change":"2023-12-07T21:14:52.593220+0000","last_active":"2023-12-07T21:14:52.593198+0000","last_peered":"2023-12-07T21:14:52.593198+0000","last_clean":"2023-12-07T21:14:52.593198+0000","last_became_active":"2023-12-07T21:08:54.892526+0000","last_became_peered":"2023-12-07T21:08:54.892526+0000","last_unstale":"2023-12-07T21:14:52.593198+0000","last_undegraded":"2023-12-07T21:14:52.593198+0000","last_fullsized":"2023-12-07T21:14:52.593198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:52.593108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:52.593108+0000","last_clean_scrub_stamp":"2023-12-07T21:14:52.593108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:05:50.085454+0000","scrub_duration":0.001128759,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'8","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:24.489652+0000","last_change":"2023-12-07T21:12:24.489652+0000","last_active":"2023-12-07T21:12:24.489652+0000","last_peered":"2023-12-07T21:12:24.489652+0000","last_clean":"2023-12-07T21:12:24.489652+0000","last_became_active":"2023-12-07T21:08:56.875175+0000","last_became_peered":"2023-12-07T21:08:56.875175+0000","last_unstale":"2023-12-07T21:12:24.489652+0000","last_undegraded":"2023-12-07T21:12:24.489652+0000","last_fullsized":"2023-12-07T21:12:24.489652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2023-12-07T21:12:24.489525+0000","last_clean_scrub_stamp":"2023-12-07T21:12:24.489525+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:58:44.073512+0000","scrub_duration":0.0022717330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:21.088717+0000","last_change":"2023-12-07T21:13:21.088717+0000","last_active":"2023-12-07T21:13:21.088717+0000","last_peered":"2023-12-07T21:13:21.088717+0000","last_clean":"2023-12-07T21:13:21.088717+0000","last_became_active":"2023-12-07T21:08:54.883322+0000","last_became_peered":"2023-12-07T21:08:54.883322+0000","last_unstale":"2023-12-07T21:13:21.088717+0000","last_undegraded":"2023-12-07T21:13:21.088717+0000","last_fullsized":"2023-12-07T21:13:21.088717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:13:21.088571+0000","last_clean_scrub_stamp":"2023-12-07T21:13:21.088571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:31:27.226694+0000","scrub_duration":0.0016712599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:00.917521+0000","last_change":"2023-12-07T21:13:00.917521+0000","last_active":"2023-12-07T21:13:00.917521+0000","last_peered":"2023-12-07T21:13:00.917521+0000","last_clean":"2023-12-07T21:13:00.917521+0000","last_became_active":"2023-12-07T21:08:56.875634+0000","last_became_peered":"2023-12-07T21:08:56.875634+0000","last_unstale":"2023-12-07T21:13:00.917521+0000","last_undegraded":"2023-12-07T21:13:00.917521+0000","last_fullsized":"2023-12-07T21:13:00.917521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:00.917383+0000","last_clean_scrub_stamp":"2023-12-07T21:13:00.917383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T00:34:19.507436+0000","scrub_duration":0.0013780719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:11.318731+0000","last_change":"2023-12-07T21:13:11.318731+0000","last_active":"2023-12-07T21:13:11.318731+0000","last_peered":"2023-12-07T21:13:11.318731+0000","last_clean":"2023-12-07T21:13:11.318731+0000","last_became_active":"2023-12-07T21:08:54.886818+0000","last_became_peered":"2023-12-07T21:08:54.886818+0000","last_unstale":"2023-12-07T21:13:11.318731+0000","last_undegraded":"2023-12-07T21:13:11.318731+0000","last_fullsized":"2023-12-07T21:13:11.318731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:11.318563+0000","last_clean_scrub_stamp":"2023-12-07T21:13:11.318563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:32:03.116436+0000","scrub_duration":0.0013115340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:33.322751+0000","last_change":"2023-12-07T21:12:33.322751+0000","last_active":"2023-12-07T21:12:33.322751+0000","last_peered":"2023-12-07T21:12:33.322751+0000","last_clean":"2023-12-07T21:12:33.322751+0000","last_became_active":"2023-12-07T21:08:56.870903+0000","last_became_peered":"2023-12-07T21:08:56.870903+0000","last_unstale":"2023-12-07T21:12:33.322751+0000","last_undegraded":"2023-12-07T21:12:33.322751+0000","last_fullsized":"2023-12-07T21:12:33.322751+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:33.322634+0000","last_clean_scrub_stamp":"2023-12-07T21:12:33.322634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:25:00.599068+0000","scrub_duration":0.001216778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:20.401789+0000","last_change":"2023-12-07T21:13:20.401789+0000","last_active":"2023-12-07T21:13:20.401789+0000","last_peered":"2023-12-07T21:13:20.401789+0000","last_clean":"2023-12-07T21:13:20.401789+0000","last_became_active":"2023-12-07T21:08:54.883184+0000","last_became_peered":"2023-12-07T21:08:54.883184+0000","last_unstale":"2023-12-07T21:13:20.401789+0000","last_undegraded":"2023-12-07T21:13:20.401789+0000","last_fullsized":"2023-12-07T21:13:20.401789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:20.401627+0000","last_clean_scrub_stamp":"2023-12-07T21:13:20.401627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:36:55.790385+0000","scrub_duration":0.001405433,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"33'2","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:32.342446+0000","last_change":"2023-12-07T21:12:32.342446+0000","last_active":"2023-12-07T21:12:32.342446+0000","last_peered":"2023-12-07T21:12:32.342446+0000","last_clean":"2023-12-07T21:12:32.342446+0000","last_became_active":"2023-12-07T21:08:56.879235+0000","last_became_peered":"2023-12-07T21:08:56.879235+0000","last_unstale":"2023-12-07T21:12:32.342446+0000","last_undegraded":"2023-12-07T21:12:32.342446+0000","last_fullsized":"2023-12-07T21:12:32.342446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:12:32.342321+0000","last_clean_scrub_stamp":"2023-12-07T21:12:32.342321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:42:46.648309+0000","scrub_duration":0.0011184750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"31'4","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:06.373937+0000","last_change":"2023-12-07T21:14:06.373997+0000","last_active":"2023-12-07T21:14:06.373937+0000","last_peered":"2023-12-07T21:14:06.373937+0000","last_clean":"2023-12-07T21:14:06.373937+0000","last_became_active":"2023-12-07T21:08:54.874383+0000","last_became_peered":"2023-12-07T21:08:54.874383+0000","last_unstale":"2023-12-07T21:14:06.373937+0000","last_undegraded":"2023-12-07T21:14:06.373937+0000","last_fullsized":"2023-12-07T21:14:06.373937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:14:06.373834+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:14:06.373834+0000","last_clean_scrub_stamp":"2023-12-07T21:14:06.373834+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:02:26.088876+0000","scrub_duration":0.0014409469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"33'16","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:27.341269+0000","last_change":"2023-12-07T21:12:27.341269+0000","last_active":"2023-12-07T21:12:27.341269+0000","last_peered":"2023-12-07T21:12:27.341269+0000","last_clean":"2023-12-07T21:12:27.341269+0000","last_became_active":"2023-12-07T21:08:56.882324+0000","last_became_peered":"2023-12-07T21:08:56.882324+0000","last_unstale":"2023-12-07T21:12:27.341269+0000","last_undegraded":"2023-12-07T21:12:27.341269+0000","last_fullsized":"2023-12-07T21:12:27.341269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2023-12-07T21:12:27.341151+0000","last_clean_scrub_stamp":"2023-12-07T21:12:27.341151+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T04:55:08.404366+0000","scrub_duration":0.0024774139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":39,"num_write":21,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:37.308528+0000","last_change":"2023-12-07T21:14:37.308564+0000","last_active":"2023-12-07T21:14:37.308528+0000","last_peered":"2023-12-07T21:14:37.308528+0000","last_clean":"2023-12-07T21:14:37.308528+0000","last_became_active":"2023-12-07T21:08:54.891994+0000","last_became_peered":"2023-12-07T21:08:54.891994+0000","last_unstale":"2023-12-07T21:14:37.308528+0000","last_undegraded":"2023-12-07T21:14:37.308528+0000","last_fullsized":"2023-12-07T21:14:37.308528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:37.308430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:37.308430+0000","last_clean_scrub_stamp":"2023-12-07T21:14:37.308430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T21:15:48.142425+0000","scrub_duration":0.001498482,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:46.318458+0000","last_change":"2023-12-07T21:13:46.318480+0000","last_active":"2023-12-07T21:13:46.318458+0000","last_peered":"2023-12-07T21:13:46.318458+0000","last_clean":"2023-12-07T21:13:46.318458+0000","last_became_active":"2023-12-07T21:08:56.876611+0000","last_became_peered":"2023-12-07T21:08:56.876611+0000","last_unstale":"2023-12-07T21:13:46.318458+0000","last_undegraded":"2023-12-07T21:13:46.318458+0000","last_fullsized":"2023-12-07T21:13:46.318458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2023-12-07T21:13:46.318375+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2023-12-07T21:13:46.318375+0000","last_clean_scrub_stamp":"2023-12-07T21:13:46.318375+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:20:30.826377+0000","scrub_duration":0.001152574,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:54.462656+0000","last_change":"2023-12-07T21:12:54.462656+0000","last_active":"2023-12-07T21:12:54.462656+0000","last_peered":"2023-12-07T21:12:54.462656+0000","last_clean":"2023-12-07T21:12:54.462656+0000","last_became_active":"2023-12-07T21:08:54.884768+0000","last_became_peered":"2023-12-07T21:08:54.884768+0000","last_unstale":"2023-12-07T21:12:54.462656+0000","last_undegraded":"2023-12-07T21:12:54.462656+0000","last_fullsized":"2023-12-07T21:12:54.462656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:54.462543+0000","last_clean_scrub_stamp":"2023-12-07T21:12:54.462543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T23:12:35.524119+0000","scrub_duration":0.0012396099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:01.404048+0000","last_change":"2023-12-07T21:12:01.404048+0000","last_active":"2023-12-07T21:12:01.404048+0000","last_peered":"2023-12-07T21:12:01.404048+0000","last_clean":"2023-12-07T21:12:01.404048+0000","last_became_active":"2023-12-07T21:08:56.889129+0000","last_became_peered":"2023-12-07T21:08:56.889129+0000","last_unstale":"2023-12-07T21:12:01.404048+0000","last_undegraded":"2023-12-07T21:12:01.404048+0000","last_fullsized":"2023-12-07T21:12:01.404048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2023-12-07T21:12:01.403925+0000","last_clean_scrub_stamp":"2023-12-07T21:12:01.403925+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T07:06:41.638050+0000","scrub_duration":0.0014963070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:35.302672+0000","last_change":"2023-12-07T21:14:35.302695+0000","last_active":"2023-12-07T21:14:35.302672+0000","last_peered":"2023-12-07T21:14:35.302672+0000","last_clean":"2023-12-07T21:14:35.302672+0000","last_became_active":"2023-12-07T21:08:54.885599+0000","last_became_peered":"2023-12-07T21:08:54.885599+0000","last_unstale":"2023-12-07T21:14:35.302672+0000","last_undegraded":"2023-12-07T21:14:35.302672+0000","last_fullsized":"2023-12-07T21:14:35.302672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:14:35.302580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:14:35.302580+0000","last_clean_scrub_stamp":"2023-12-07T21:14:35.302580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T06:25:42.101573+0000","scrub_duration":0.0012938610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"31'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:51.554341+0000","last_change":"2023-12-07T21:14:51.554365+0000","last_active":"2023-12-07T21:14:51.554341+0000","last_peered":"2023-12-07T21:14:51.554341+0000","last_clean":"2023-12-07T21:14:51.554341+0000","last_became_active":"2023-12-07T21:08:54.892445+0000","last_became_peered":"2023-12-07T21:08:54.892445+0000","last_unstale":"2023-12-07T21:14:51.554341+0000","last_undegraded":"2023-12-07T21:14:51.554341+0000","last_fullsized":"2023-12-07T21:14:51.554341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'4","last_scrub_stamp":"2023-12-07T21:14:51.554250+0000","last_deep_scrub":"31'4","last_deep_scrub_stamp":"2023-12-07T21:14:51.554250+0000","last_clean_scrub_stamp":"2023-12-07T21:14:51.554250+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:11:27.227545+0000","scrub_duration":0.00126604,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:14:06.990943+0000","last_change":"2023-12-07T21:14:06.990967+0000","last_active":"2023-12-07T21:14:06.990943+0000","last_peered":"2023-12-07T21:14:06.990943+0000","last_clean":"2023-12-07T21:14:06.990943+0000","last_became_active":"2023-12-07T21:08:56.882952+0000","last_became_peered":"2023-12-07T21:08:56.882952+0000","last_unstale":"2023-12-07T21:14:06.990943+0000","last_undegraded":"2023-12-07T21:14:06.990943+0000","last_fullsized":"2023-12-07T21:14:06.990943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2023-12-07T21:14:06.990856+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2023-12-07T21:14:06.990856+0000","last_clean_scrub_stamp":"2023-12-07T21:14:06.990856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T05:58:26.019692+0000","scrub_duration":0.0015824859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:13:05.910417+0000","last_change":"2023-12-07T21:13:05.910417+0000","last_active":"2023-12-07T21:13:05.910417+0000","last_peered":"2023-12-07T21:13:05.910417+0000","last_clean":"2023-12-07T21:13:05.910417+0000","last_became_active":"2023-12-07T21:08:54.883491+0000","last_became_peered":"2023-12-07T21:08:54.883491+0000","last_unstale":"2023-12-07T21:13:05.910417+0000","last_undegraded":"2023-12-07T21:13:05.910417+0000","last_fullsized":"2023-12-07T21:13:05.910417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:13:05.910299+0000","last_clean_scrub_stamp":"2023-12-07T21:13:05.910299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T22:31:57.708172+0000","scrub_duration":0.001525988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-07T21:12:56.272208+0000","last_change":"2023-12-07T21:12:56.272208+0000","last_active":"2023-12-07T21:12:56.272208+0000","last_peered":"2023-12-07T21:12:56.272208+0000","last_clean":"2023-12-07T21:12:56.272208+0000","last_became_active":"2023-12-07T21:08:56.881547+0000","last_became_peered":"2023-12-07T21:08:56.881547+0000","last_unstale":"2023-12-07T21:12:56.272208+0000","last_undegraded":"2023-12-07T21:12:56.272208+0000","last_fullsized":"2023-12-07T21:12:56.272208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T21:12:56.272079+0000","last_clean_scrub_stamp":"2023-12-07T21:12:56.272079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-09T02:27:16.868178+0000","scrub_duration":0.0010823779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1336,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":308,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1971,"ondisk_log_size":1971,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1535,"num_read_kb":1321,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1439,"ondisk_log_size":1439,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":355,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":956,"num_read_kb":900,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":153,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705747,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39964,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331876,"statfs":{"total":96636764160,"available":96595841024,"internally_reserved":0,"allocated":479232,"data_stored":151787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":40434120},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:14:48 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.433,"15min":0.42699999999999999},"min":{"1min":0.35099999999999998,"5min":0.182,"15min":0.182},"max":{"1min":0.54500000000000004,"5min":0.58399999999999996,"15min":0.60999999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.442,"15min":0.44600000000000001},"min":{"1min":0.34000000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55100000000000005,"5min":0.56999999999999995,"15min":0.69699999999999995},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Dec 7 21:14:48 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.34000000000000002},"min":{"1min":0.248,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.52200000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.34399999999999997},"min":{"1min":0.254,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45700000000000002,"5min":0.48899999999999999,"15min":0.49299999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:14:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36399999999999999,"15min":0.36899999999999999},"min":{"1min":0.29599999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.68100000000000005},"last":0.373},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.33000000000000002,"15min":0.33600000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.309}]}]},{"osd":2,"up_from":9,"seq":38654705746,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":1003520,"data_stored":738933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.32200000000000001,"5min":0.22900000000000001,"15min":0.20000000000000001},"max":{"1min":0.57499999999999996,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.432,"15min":0.432},"min":{"1min":0.30599999999999999,"5min":0.24399999999999999,"15min":0.219},"max":{"1min":0.54100000000000004,"5min":0.59499999999999997,"15min":0.621},"last":0.44}]},{"osd":1,"last update":"Thu Dec 7 21:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.33400000000000002,"15min":0.32300000000000001},"min":{"1min":0.247,"5min":0.218,"15min":0.218},"max":{"1min":0.42699999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.314,"5min":0.315,"15min":0.32900000000000001},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.42499999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.24199999999999999}]},{"osd":3,"last update":"Thu Dec 7 21:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32300000000000001,"15min":0.32800000000000001},"min":{"1min":0.247,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":0.42199999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35099999999999998,"15min":0.36299999999999999},"min":{"1min":0.28999999999999998,"5min":0.26000000000000001,"15min":0.25700000000000001},"max":{"1min":0.45100000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.30299999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705746,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1028096,"data_stored":736015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 21:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.44700000000000001,"15min":0.45300000000000001},"min":{"1min":0.27600000000000002,"5min":0.182,"15min":0.182},"max":{"1min":0.59299999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45100000000000001,"15min":0.46500000000000002},"min":{"1min":0.32800000000000001,"5min":0.23799999999999999,"15min":0.222},"max":{"1min":0.60899999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Dec 7 21:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32600000000000001,"15min":0.35399999999999998},"min":{"1min":0.252,"5min":0.20200000000000001,"15min":0.17799999999999999},"max":{"1min":0.46200000000000002,"5min":0.54200000000000004,"15min":0.629},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.315,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.22,"5min":0.214,"15min":0.186},"max":{"1min":0.40699999999999997,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Dec 7 21:14:49 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32500000000000001,"15min":0.33900000000000002},"min":{"1min":0.252,"5min":0.191,"15min":0.191},"max":{"1min":0.42999999999999999,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.35199999999999998,"15min":0.372},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.25},"max":{"1min":0.43099999999999999,"5min":0.497,"15min":0.52400000000000002},"last":0.315}]}]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39920,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331920,"statfs":{"total":96636764160,"available":96595886080,"internally_reserved":0,"allocated":434176,"data_stored":149221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 21:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.35999999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.63100000000000001,"5min":0.68300000000000005,"15min":0.747},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Dec 7 21:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50900000000000001,"15min":0.48699999999999999},"min":{"1min":0.39400000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.77300000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.50800000000000001,"15min":0.48299999999999998},"min":{"1min":0.34999999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66900000000000004,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Dec 7 21:14:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.505,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.70799999999999996,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.629},{"interface":"front","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.49399999999999999},"min":{"1min":0.36599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65200000000000002,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T21:15:15.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-07T21:15:15.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.298+0000 7feee3533640 1 Processor -- start 2023-12-07T21:15:15.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.298+0000 7feee3533640 1 -- start start 2023-12-07T21:15:15.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.298+0000 7feee3533640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feedc06e870 0x7feedc12f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:15:15.289 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.298+0000 7feee3533640 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feedc06f190 con 0x7feedc06dd80 2023-12-07T21:15:15.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.298+0000 7feee3533640 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feedc06f3c0 con 0x7feedc06e870 2023-12-07T21:15:15.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.298+0000 7feee0ace640 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feedc06e870 0x7feedc12f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:15:15.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.298+0000 7feee12cf640 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7feedc06dd80 0x7feedc06e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:47008/0 (socket says 172.21.15.89:47008) 2023-12-07T21:15:15.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.298+0000 7feee12cf640 1 -- 172.21.15.89:0/2853602226 learned_addr learned my addr 172.21.15.89:0/2853602226 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-12-07T21:15:15.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.299+0000 7feee0ace640 1 -- 172.21.15.89:0/2853602226 >> v1:172.21.15.89:6789/0 conn(0x7feedc06dd80 legacy=0x7feedc06e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:15:15.290 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.299+0000 7feee0ace640 1 -- 172.21.15.89:0/2853602226 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc09af00 con 0x7feedc06e870 2023-12-07T21:15:15.295 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.299+0000 7feee0ace640 1 --2- 172.21.15.89:0/2853602226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feedc06e870 0x7feedc12f840 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7feecc009720 tx=0x7feecc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6d0cb15b08436f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:15:15.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.299+0000 7feed3fff640 1 -- 172.21.15.89:0/2853602226 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feecc02e070 con 0x7feedc06e870 2023-12-07T21:15:15.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.299+0000 7feed3fff640 1 -- 172.21.15.89:0/2853602226 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc0316d0 con 0x7feedc06e870 2023-12-07T21:15:15.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.299+0000 7feed3fff640 1 -- 172.21.15.89:0/2853602226 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feecc031990 con 0x7feedc06e870 2023-12-07T21:15:15.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.300+0000 7feee3533640 1 -- 172.21.15.89:0/2853602226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feedc06e870 msgr2=0x7feedc12f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:15:15.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.300+0000 7feee3533640 1 --2- 172.21.15.89:0/2853602226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feedc06e870 0x7feedc12f840 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7feecc009720 tx=0x7feecc02b840 comp rx=0 tx=0).stop 2023-12-07T21:15:15.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.300+0000 7feee3533640 1 -- 172.21.15.89:0/2853602226 shutdown_connections 2023-12-07T21:15:15.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.300+0000 7feee3533640 1 --2- 172.21.15.89:0/2853602226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feedc06e870 0x7feedc12f840 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:15:15.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.300+0000 7feee3533640 1 -- 172.21.15.89:0/2853602226 >> 172.21.15.89:0/2853602226 conn(0x7feedc098880 msgr2=0x7feedc098c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:15:15.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.300+0000 7feee3533640 1 -- 172.21.15.89:0/2853602226 shutdown_connections 2023-12-07T21:15:15.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.300+0000 7feee3533640 1 -- 172.21.15.89:0/2853602226 wait complete. 2023-12-07T21:15:15.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.301+0000 7feee3533640 1 Processor -- start 2023-12-07T21:15:15.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.301+0000 7feee3533640 1 -- start start 2023-12-07T21:15:15.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.301+0000 7feee3533640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feedc06dd80 0x7feedc12ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:15:15.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.301+0000 7feee3533640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc12f280 con 0x7feedc06dd80 2023-12-07T21:15:15.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.301+0000 7feee12cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feedc06dd80 0x7feedc12ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:15:15.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.301+0000 7feee12cf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feedc06dd80 0x7feedc12ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49178/0 (socket says 172.21.15.89:49178) 2023-12-07T21:15:15.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.301+0000 7feee12cf640 1 -- 172.21.15.89:0/223245460 learned_addr learned my addr 172.21.15.89:0/223245460 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-12-07T21:15:15.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.302+0000 7feee12cf640 1 -- 172.21.15.89:0/223245460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc009400 con 0x7feedc06dd80 2023-12-07T21:15:15.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.302+0000 7feee12cf640 1 --2- 172.21.15.89:0/223245460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feedc06dd80 0x7feedc12ba80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7feed800c4a0 tx=0x7feed800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:15:15.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.302+0000 7feed1ffb640 1 -- 172.21.15.89:0/223245460 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feed8005c10 con 0x7feedc06dd80 2023-12-07T21:15:15.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.302+0000 7feed1ffb640 1 -- 172.21.15.89:0/223245460 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed8005d70 con 0x7feedc06dd80 2023-12-07T21:15:15.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.302+0000 7feee3533640 1 -- 172.21.15.89:0/223245460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feedc12ee90 con 0x7feedc06dd80 2023-12-07T21:15:15.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.302+0000 7feed1ffb640 1 -- 172.21.15.89:0/223245460 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feed80071a0 con 0x7feedc06dd80 2023-12-07T21:15:15.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.302+0000 7feee3533640 1 -- 172.21.15.89:0/223245460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feedc12f950 con 0x7feedc06dd80 2023-12-07T21:15:15.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.303+0000 7feed1ffb640 1 -- 172.21.15.89:0/223245460 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 44856+0+0 (secure 0 0 0) 0x7feed8007300 con 0x7feedc06dd80 2023-12-07T21:15:15.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.303+0000 7feee3533640 1 -- 172.21.15.89:0/223245460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feedc12f020 con 0x7feedc06dd80 2023-12-07T21:15:15.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.303+0000 7feed1ffb640 1 --2- 172.21.15.89:0/223245460 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7feec0037820 0x7feec0039ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T21:15:15.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.303+0000 7feed1ffb640 1 -- 172.21.15.89:0/223245460 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6241+0+0 (secure 0 0 0) 0x7feed804a0a0 con 0x7feedc06dd80 2023-12-07T21:15:15.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.303+0000 7feee0ace640 1 --2- 172.21.15.89:0/223245460 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7feec0037820 0x7feec0039ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T21:15:15.299 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.304+0000 7feee0ace640 1 --2- 172.21.15.89:0/223245460 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7feec0037820 0x7feec0039ce0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feecc036000 tx=0x7feecc008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T21:15:15.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.308+0000 7feed1ffb640 1 -- 172.21.15.89:0/223245460 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feed80198b0 con 0x7feedc06dd80 2023-12-07T21:15:15.462 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.473+0000 7feee3533640 1 -- 172.21.15.89:0/223245460 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7feedc12de40 con 0x7feedc06dd80 2023-12-07T21:15:15.465 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.476+0000 7feed1ffb640 1 -- 172.21.15.89:0/223245460 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7feed8017020 con 0x7feedc06dd80 2023-12-07T21:15:15.466 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.476+0000 7feed1ffb640 1 -- 172.21.15.89:0/223245460 <== mon.0 v2:172.21.15.89:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7feed80198b0 con 0x7feedc06dd80 2023-12-07T21:15:15.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.478+0000 7feee3533640 1 -- 172.21.15.89:0/223245460 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7feec0037820 msgr2=0x7feec0039ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:15:15.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.478+0000 7feee3533640 1 --2- 172.21.15.89:0/223245460 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7feec0037820 0x7feec0039ce0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feecc036000 tx=0x7feecc008030 comp rx=0 tx=0).stop 2023-12-07T21:15:15.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.478+0000 7feee3533640 1 -- 172.21.15.89:0/223245460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feedc06dd80 msgr2=0x7feedc12ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T21:15:15.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.478+0000 7feee3533640 1 --2- 172.21.15.89:0/223245460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feedc06dd80 0x7feedc12ba80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7feed800c4a0 tx=0x7feed800c960 comp rx=0 tx=0).stop 2023-12-07T21:15:15.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.478+0000 7feee3533640 1 -- 172.21.15.89:0/223245460 shutdown_connections 2023-12-07T21:15:15.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.478+0000 7feee3533640 1 --2- 172.21.15.89:0/223245460 >> [v2:172.21.15.121:6824/3175226153,v1:172.21.15.121:6825/3175226153] conn(0x7feec0037820 0x7feec0039ce0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:15:15.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.478+0000 7feee3533640 1 --2- 172.21.15.89:0/223245460 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feedc06dd80 0x7feedc12ba80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T21:15:15.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.478+0000 7feee3533640 1 -- 172.21.15.89:0/223245460 >> 172.21.15.89:0/223245460 conn(0x7feedc098880 msgr2=0x7feedc128040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T21:15:15.468 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.478+0000 7feee3533640 1 -- 172.21.15.89:0/223245460 shutdown_connections 2023-12-07T21:15:15.469 INFO:teuthology.orchestra.run.smithi089.stderr:2023-12-07T21:15:15.478+0000 7feee3533640 1 -- 172.21.15.89:0/223245460 wait complete. 2023-12-07T21:15:15.478 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-07T21:15:15.478 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-07T21:15:15.478 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-07T21:15:15.478 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T21:15:15.514 INFO:tasks.ceph.osd.0:Stopped 2023-12-07T21:15:15.515 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-07T21:15:15.515 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T21:15:15.546 INFO:tasks.ceph.osd.1:Stopped 2023-12-07T21:15:15.546 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-07T21:15:15.546 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T21:15:15.619 INFO:tasks.ceph.osd.2:Stopped 2023-12-07T21:15:15.619 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-07T21:15:15.619 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T21:15:15.694 INFO:tasks.ceph.osd.3:Stopped 2023-12-07T21:15:15.694 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-07T21:15:15.694 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-07T21:15:15.694 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T21:15:15.762 INFO:tasks.ceph.mgr.x:Stopped 2023-12-07T21:15:15.763 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-07T21:15:15.763 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-07T21:15:15.763 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T21:15:15.774 INFO:tasks.ceph.mon.a:Stopped 2023-12-07T21:15:15.774 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-07T21:15:15.774 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2023-12-07T21:15:15.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-12-07T21:15:15.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T21:15:15.848 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-07T21:15:16.002 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi121.front.sepia.ceph.com 2023-12-07T21:15:16.002 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-07T21:15:16.120 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi121.front.sepia.ceph.com 2023-12-07T21:15:16.121 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-07T21:15:16.199 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi121.front.sepia.ceph.com 2023-12-07T21:15:16.199 DEBUG:teuthology.orchestra.run.smithi121:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-07T21:15:16.249 INFO:tasks.ceph:Archiving mon data... 2023-12-07T21:15:16.250 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323/data/mon.a.tgz 2023-12-07T21:15:16.250 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-12-07T21:15:16.265 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.LVWydezdm1 2023-12-07T21:15:16.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.LVWydezdm1 2023-12-07T21:15:16.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.LVWydezdm1 2023-12-07T21:15:16.492 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.LVWydezdm1 is 299KB 2023-12-07T21:15:16.587 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.LVWydezdm1 2023-12-07T21:15:16.601 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-07T21:15:16.602 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-07T21:15:16.644 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-07T21:15:16.723 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-07T21:15:16.741 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-07T21:15:16.741 INFO:tasks.ceph:Archiving crash dumps... 2023-12-07T21:15:16.743 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323/remote/smithi089/crash 2023-12-07T21:15:16.744 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-07T21:15:16.790 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323/remote/smithi121/crash 2023-12-07T21:15:16.791 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-07T21:15:16.846 INFO:tasks.ceph:Compressing logs... 2023-12-07T21:15:16.846 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T21:15:16.849 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T21:15:16.902 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85988.log 2023-12-07T21:15:16.902 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-07T21:15:16.902 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85232.log 2023-12-07T21:15:16.903 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85988.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85610.log 2023-12-07T21:15:16.903 INFO:teuthology.orchestra.run.smithi089.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.85988.log.gz 2023-12-07T21:15:16.903 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84504.log 2023-12-07T21:15:16.903 INFO:teuthology.orchestra.run.smithi089.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.85232.log.gz 2023-12-07T21:15:16.903 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84322.log 2023-12-07T21:15:16.903 INFO:teuthology.orchestra.run.smithi089.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.85610.log.gz 2023-12-07T21:15:16.903 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84924.log 2023-12-07T21:15:16.903 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84322.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.84504.log.gz 2023-12-07T21:15:16.903 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84646.log 2023-12-07T21:15:16.904 INFO:teuthology.orchestra.run.smithi089.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.84322.log.gz 2023-12-07T21:15:16.904 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82222.log 2023-12-07T21:15:16.904 INFO:teuthology.orchestra.run.smithi089.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.84924.log.gz 2023-12-07T21:15:16.904 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84815.log 2023-12-07T21:15:16.904 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.82222.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84646.log.gz 2023-12-07T21:15:16.904 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84546.log 2023-12-07T21:15:16.904 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84815.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.82222.log.gz 2023-12-07T21:15:16.904 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85176.log 2023-12-07T21:15:16.904 INFO:teuthology.orchestra.run.smithi089.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.84815.log.gz 2023-12-07T21:15:16.905 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84982.log 2023-12-07T21:15:16.905 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85176.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.84546.log.gz 2023-12-07T21:15:16.905 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86114.log 2023-12-07T21:15:16.905 INFO:teuthology.orchestra.run.smithi089.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.85176.log.gz 2023-12-07T21:15:16.905 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85568.log 2023-12-07T21:15:16.905 INFO:teuthology.orchestra.run.smithi089.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.84982.log.gz 2023-12-07T21:15:16.905 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85400.log 2023-12-07T21:15:16.905 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85568.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.86114.log.gz 2023-12-07T21:15:16.906 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84813.log 2023-12-07T21:15:16.906 INFO:teuthology.orchestra.run.smithi089.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.85568.log.gz 2023-12-07T21:15:16.906 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85652.log 2023-12-07T21:15:16.906 INFO:teuthology.orchestra.run.smithi089.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.85400.log.gz 2023-12-07T21:15:16.906 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85862.log 2023-12-07T21:15:16.906 INFO:teuthology.orchestra.run.smithi089.stderr: 86.8%/var/log/ceph/ceph-client.admin.85652.log: -- replaced with /var/log/ceph/ceph-client.admin.84813.log.gz 2023-12-07T21:15:16.906 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86156.log 2023-12-07T21:15:16.906 INFO:teuthology.orchestra.run.smithi089.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.85652.log.gz/var/log/ceph/ceph-client.admin.85862.log: 2023-12-07T21:15:16.906 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85134.log 2023-12-07T21:15:16.907 INFO:teuthology.orchestra.run.smithi089.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.85862.log.gz 2023-12-07T21:15:16.907 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85904.log 2023-12-07T21:15:16.907 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85134.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.86156.log.gz 2023-12-07T21:15:16.907 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-07T21:15:16.907 INFO:teuthology.orchestra.run.smithi089.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.85134.log.gz 2023-12-07T21:15:16.907 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84462.log 2023-12-07T21:15:16.907 INFO:teuthology.orchestra.run.smithi089.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.85904.log.gz 2023-12-07T21:15:16.907 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85484.log 2023-12-07T21:15:16.907 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84645.log 2023-12-07T21:15:16.907 INFO:teuthology.orchestra.run.smithi089.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-07T21:15:16.908 INFO:teuthology.orchestra.run.smithi089.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.84462.log.gz 2023-12-07T21:15:16.908 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84984.log 2023-12-07T21:15:16.908 INFO:teuthology.orchestra.run.smithi089.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.85484.log.gz 2023-12-07T21:15:16.908 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86240.log 2023-12-07T21:15:16.908 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84645.log: /var/log/ceph/ceph-client.admin.84984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85526.log 2023-12-07T21:15:16.908 INFO:teuthology.orchestra.run.smithi089.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84645.log.gz 2023-12-07T21:15:16.908 INFO:teuthology.orchestra.run.smithi089.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.84984.log.gz 2023-12-07T21:15:16.908 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85736.log 2023-12-07T21:15:16.908 INFO:teuthology.orchestra.run.smithi089.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.86240.log.gz 2023-12-07T21:15:16.908 INFO:teuthology.orchestra.run.smithi089.stderr:gzip/var/log/ceph/ceph-client.admin.85526.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.85946.log 2023-12-07T21:15:16.909 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85736.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.85526.log.gz 2023-12-07T21:15:16.909 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85274.log 2023-12-07T21:15:16.909 INFO:teuthology.orchestra.run.smithi089.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.85736.log.gz 2023-12-07T21:15:16.909 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84648.log 2023-12-07T21:15:16.909 INFO:teuthology.orchestra.run.smithi089.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.85946.log.gz 2023-12-07T21:15:16.909 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84265.log 2023-12-07T21:15:16.909 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84648.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.85274.log.gz 2023-12-07T21:15:16.909 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84814.log 2023-12-07T21:15:16.909 INFO:teuthology.orchestra.run.smithi089.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.84648.log.gz 2023-12-07T21:15:16.909 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82260.log 2023-12-07T21:15:16.910 INFO:teuthology.orchestra.run.smithi089.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.84265.log.gz 2023-12-07T21:15:16.910 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84814.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.80400.log 2023-12-07T21:15:16.910 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.82260.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.84814.log.gz 2023-12-07T21:15:16.910 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86072.log 2023-12-07T21:15:16.910 INFO:teuthology.orchestra.run.smithi089.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.82260.log.gz 2023-12-07T21:15:16.910 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.tmp-client.admin.80400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85778.log 2023-12-07T21:15:16.910 INFO:teuthology.orchestra.run.smithi089.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.80400.log.gz 2023-12-07T21:15:16.910 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84378.log 2023-12-07T21:15:16.910 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85778.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.86072.log.gz 2023-12-07T21:15:16.911 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85092.log 2023-12-07T21:15:16.911 INFO:teuthology.orchestra.run.smithi089.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.85778.log.gz 2023-12-07T21:15:16.911 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84816.log 2023-12-07T21:15:16.911 INFO:teuthology.orchestra.run.smithi089.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.84378.log.gz 2023-12-07T21:15:16.911 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85316.log 2023-12-07T21:15:16.911 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84816.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.85092.log.gz 2023-12-07T21:15:16.911 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86030.log 2023-12-07T21:15:16.911 INFO:teuthology.orchestra.run.smithi089.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.84816.log.gz 2023-12-07T21:15:16.911 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84983.log 2023-12-07T21:15:16.912 INFO:teuthology.orchestra.run.smithi089.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.85316.log.gz 2023-12-07T21:15:16.912 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86198.log 2023-12-07T21:15:16.912 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84983.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.86030.log.gz 2023-12-07T21:15:16.912 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85694.log 2023-12-07T21:15:16.912 INFO:teuthology.orchestra.run.smithi089.stderr: 86.9%/var/log/ceph/ceph-client.admin.86198.log: -- replaced with /var/log/ceph/ceph-client.admin.84983.log.gz 2023-12-07T21:15:16.912 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-07T21:15:16.912 INFO:teuthology.orchestra.run.smithi089.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.86198.log.gz 2023-12-07T21:15:16.912 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85694.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.85694.log.gz 2023-12-07T21:15:16.912 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84420.log 2023-12-07T21:15:16.912 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-07T21:15:16.913 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.84420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86280.log 2023-12-07T21:15:16.913 INFO:teuthology.orchestra.run.smithi089.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.84420.log.gz 2023-12-07T21:15:16.913 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85820.log 2023-12-07T21:15:16.913 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82104.log 2023-12-07T21:15:16.913 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.86280.log: /var/log/ceph/ceph-client.admin.85820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85442.log 2023-12-07T21:15:16.913 INFO:teuthology.orchestra.run.smithi089.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.86280.log.gz 2023-12-07T21:15:16.913 INFO:teuthology.orchestra.run.smithi089.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.85820.log.gz 2023-12-07T21:15:16.913 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.82104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85358.log 2023-12-07T21:15:16.913 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85442.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.82104.log.gz 2023-12-07T21:15:16.913 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84647.log 2023-12-07T21:15:16.914 INFO:teuthology.orchestra.run.smithi089.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-07T21:15:16.914 INFO:teuthology.orchestra.run.smithi089.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.85442.log.gz 2023-12-07T21:15:16.914 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.85358.log: /var/log/ceph/ceph-client.admin.84647.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.85358.log.gz 2023-12-07T21:15:16.914 INFO:teuthology.orchestra.run.smithi089.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84647.log.gz 2023-12-07T21:15:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97138.log 2023-12-07T21:15:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96434.log 2023-12-07T21:15:16.943 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.97138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94497.log 2023-12-07T21:15:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.96434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91153.log 2023-12-07T21:15:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.94497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90977.log 2023-12-07T21:15:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.91153.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.97138.log.gz 2023-12-07T21:15:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95201.log 2023-12-07T21:15:16.944 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1%gzip -- replaced with /var/log/ceph/ceph-client.0.96434.log.gz 2023-12-07T21:15:16.944 INFO:teuthology.orchestra.run.smithi121.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.97314.log 2023-12-07T21:15:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.90977.log: /var/log/ceph/ceph-client.0.95201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95025.log 2023-12-07T21:15:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.97314.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94497.log.gz 2023-12-07T21:15:16.944 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90367.log 2023-12-07T21:15:16.945 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.91153.log.gz 2023-12-07T21:15:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91505.log 2023-12-07T21:15:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.95025.log: /var/log/ceph/ceph-client.0.90367.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90977.log.gz 2023-12-07T21:15:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93617.log 2023-12-07T21:15:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90807.log/var/log/ceph/ceph-client.0.91505.log: 2023-12-07T21:15:16.945 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.97314.log.gz 2023-12-07T21:15:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.93617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96082.log 2023-12-07T21:15:16.945 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.90807.log: 92.6% 91.9% -- replaced with /var/log/ceph/ceph-client.0.90367.log.gz 2023-12-07T21:15:16.945 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.0.95201.log.gz 2023-12-07T21:15:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96170.log 2023-12-07T21:15:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90631.log 2023-12-07T21:15:16.946 INFO:teuthology.orchestra.run.smithi121.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.91505.log.gz 2023-12-07T21:15:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.96082.log: 89.8% -- replaced with /var/log/ceph/ceph-client.0.90807.log.gz 2023-12-07T21:15:16.946 INFO:teuthology.orchestra.run.smithi121.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.95025.log.gz 2023-12-07T21:15:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.96170.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93617.log.gz 2023-12-07T21:15:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96786.log 2023-12-07T21:15:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.90631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91945.log 2023-12-07T21:15:16.946 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.96786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91593.log 2023-12-07T21:15:16.947 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.96082.log.gz 2023-12-07T21:15:16.947 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.96170.log.gz 2023-12-07T21:15:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.91945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97402.log 2023-12-07T21:15:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.91593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92209.log 2023-12-07T21:15:16.947 INFO:teuthology.orchestra.run.smithi121.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.96786.log.gz 2023-12-07T21:15:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.97402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93265.log 2023-12-07T21:15:16.947 INFO:teuthology.orchestra.run.smithi121.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.90631.log.gz 2023-12-07T21:15:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.92209.log: 89.7% -- replaced with /var/log/ceph/ceph-client.0.97402.log.gz 2023-12-07T21:15:16.947 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89541.log 2023-12-07T21:15:16.948 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.91945.log.gz 2023-12-07T21:15:16.948 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91593.log.gz 2023-12-07T21:15:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.93265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94233.log 2023-12-07T21:15:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.89541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92561.log 2023-12-07T21:15:16.948 INFO:teuthology.orchestra.run.smithi121.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.89541.log.gz 2023-12-07T21:15:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.94233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94761.log 2023-12-07T21:15:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95994.log 2023-12-07T21:15:16.948 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.92561.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92209.log.gz 2023-12-07T21:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.94761.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.93265.log.gz 2023-12-07T21:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93441.log 2023-12-07T21:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90889.log 2023-12-07T21:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.95994.log: /var/log/ceph/ceph-client.0.93441.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.94233.log.gz 2023-12-07T21:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.92561.log.gz 2023-12-07T21:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92737.log 2023-12-07T21:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.94761.log.gz 2023-12-07T21:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93793.log 2023-12-07T21:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.90889.log: /var/log/ceph/ceph-client.0.92737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96698.log 2023-12-07T21:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.95994.log.gz 2023-12-07T21:15:16.949 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.93793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97812.log 2023-12-07T21:15:16.950 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.96698.log: gzip -5 90.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.93441.log.gz /var/log/ceph/ceph-client.0.93353.log 2023-12-07T21:15:16.950 INFO:teuthology.orchestra.run.smithi121.stderr: 2023-12-07T21:15:16.950 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.97812.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92737.log.gz 2023-12-07T21:15:16.950 INFO:teuthology.orchestra.run.smithi121.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.90889.log.gz 2023-12-07T21:15:16.950 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97226.log 2023-12-07T21:15:16.950 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.93353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95465.log 2023-12-07T21:15:16.950 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.97226.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.93793.log.gz 2023-12-07T21:15:16.950 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.96698.log.gz 2023-12-07T21:15:16.950 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92825.log 2023-12-07T21:15:16.951 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.97812.log.gz 2023-12-07T21:15:16.951 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.95465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92033.log 2023-12-07T21:15:16.951 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93353.log.gz 2023-12-07T21:15:16.951 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.92825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97934.log 2023-12-07T21:15:16.951 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.92033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94585.log 2023-12-07T21:15:16.951 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.95465.log.gz 2023-12-07T21:15:16.951 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.97934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93705.log 2023-12-07T21:15:16.951 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92825.log.gz 2023-12-07T21:15:16.951 INFO:teuthology.orchestra.run.smithi121.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.97226.log.gz 2023-12-07T21:15:16.951 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95289.log 2023-12-07T21:15:16.952 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.94585.log: 90.8% -- replaced with /var/log/ceph/ceph-client.0.92033.log.gz 2023-12-07T21:15:16.952 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.93705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93881.log 2023-12-07T21:15:16.952 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.95289.log: /var/log/ceph/ceph-osd.1.log 2023-12-07T21:15:16.952 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.93881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91329.log 2023-12-07T21:15:16.952 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.1.log: 90.8%gzip -- replaced with /var/log/ceph/ceph-client.0.93705.log.gz -5 2023-12-07T21:15:16.952 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph-client.0.92649.log 2023-12-07T21:15:16.952 INFO:teuthology.orchestra.run.smithi121.stderr:gzip 91.1% -- replaced with /var/log/ceph/ceph-client.0.94585.log.gz 2023-12-07T21:15:16.952 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.91329.log: -5 --verbose -- /var/log/ceph/ceph-client.0.93001.log 2023-12-07T21:15:16.952 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.92649.log: gzip -5 91.1% -- replaced with /var/log/ceph/ceph-client.0.95289.log.gz 2023-12-07T21:15:16.952 INFO:teuthology.orchestra.run.smithi121.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.93881.log.gz 2023-12-07T21:15:16.953 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph-client.0.91681.log 2023-12-07T21:15:16.953 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.93001.log: 93.4% -- replaced with /var/log/ceph/ceph-client.0.97934.log.gz 2023-12-07T21:15:16.953 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94849.log 2023-12-07T21:15:16.953 INFO:teuthology.orchestra.run.smithi121.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.91329.log.gz 2023-12-07T21:15:16.953 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.91681.log: gzip 90.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.92649.log.gz -- 2023-12-07T21:15:16.953 INFO:teuthology.orchestra.run.smithi121.stderr: /var/log/ceph/ceph-client.0.95817.log 2023-12-07T21:15:16.953 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89501.log 2023-12-07T21:15:16.953 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.94849.log: /var/log/ceph/ceph-client.0.95817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94145.log 2023-12-07T21:15:16.953 INFO:teuthology.orchestra.run.smithi121.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.93001.log.gz 2023-12-07T21:15:16.953 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.89501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95377.log 2023-12-07T21:15:16.954 INFO:teuthology.orchestra.run.smithi121.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.91681.log.gz 2023-12-07T21:15:16.954 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.94145.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.89501.log.gz 2023-12-07T21:15:16.954 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90719.log 2023-12-07T21:15:16.954 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.95377.log: 90.8% -- replaced with /var/log/ceph/ceph-client.0.94849.log.gz 2023-12-07T21:15:16.954 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92913.log 2023-12-07T21:15:16.954 INFO:teuthology.orchestra.run.smithi121.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.95817.log.gz 2023-12-07T21:15:16.954 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.90719.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94145.log.gz 2023-12-07T21:15:16.954 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96874.log 2023-12-07T21:15:16.955 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.92913.log: 90.8% -- replaced with /var/log/ceph/ceph-client.0.95377.log.gz 2023-12-07T21:15:16.955 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84474.log 2023-12-07T21:15:16.955 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.96874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89581.log 2023-12-07T21:15:16.955 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.84474.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.90719.log.gz 2023-12-07T21:15:16.955 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93177.log 2023-12-07T21:15:16.955 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.89581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91417.log 2023-12-07T21:15:16.955 INFO:teuthology.orchestra.run.smithi121.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.84474.log.gz 2023-12-07T21:15:16.955 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92913.log.gz 2023-12-07T21:15:16.955 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.93177.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.89581.log.gz 2023-12-07T21:15:16.956 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91241.log 2023-12-07T21:15:16.956 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.91417.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.96874.log.gz 2023-12-07T21:15:16.956 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-07T21:15:16.956 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.91241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84554.log 2023-12-07T21:15:16.956 INFO:teuthology.orchestra.run.smithi121.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.93177.log.gz 2023-12-07T21:15:16.956 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95729.log 2023-12-07T21:15:16.956 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91417.log.gz 2023-12-07T21:15:16.956 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97648.log 2023-12-07T21:15:16.956 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.84554.log: /var/log/ceph/ceph-client.0.95729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93969.log 2023-12-07T21:15:16.957 INFO:teuthology.orchestra.run.smithi121.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.84554.log.gz 2023-12-07T21:15:16.957 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91241.log.gz 2023-12-07T21:15:16.957 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.97648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95553.log 2023-12-07T21:15:16.957 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.93969.log: 89.6% -- replaced with /var/log/ceph/ceph-client.0.97648.log.gz 2023-12-07T21:15:16.957 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89621.log 2023-12-07T21:15:16.957 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84514.log 2023-12-07T21:15:16.957 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.95553.log: 90.8% -- replaced with /var/log/ceph/ceph-client.0.95729.log.gz 2023-12-07T21:15:16.957 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.89621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96258.log 2023-12-07T21:15:16.958 INFO:teuthology.orchestra.run.smithi121.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.89621.log.gz 2023-12-07T21:15:16.958 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.84514.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-07T21:15:16.958 INFO:teuthology.orchestra.run.smithi121.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.84514.log.gz 2023-12-07T21:15:16.958 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.96258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95906.log 2023-12-07T21:15:16.958 INFO:teuthology.orchestra.run.smithi121.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.93969.log.gz 2023-12-07T21:15:16.958 INFO:teuthology.orchestra.run.smithi121.stderr:gzip/var/log/ceph/ceph-mgr.x.log: -5 --verbose -- /var/log/ceph/ceph-client.0.90455.log 2023-12-07T21:15:16.958 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.95906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96962.log 2023-12-07T21:15:16.958 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.90455.log: 91.5% 91.0% -- replaced with /var/log/ceph/ceph-client.0.96258.log.gz 2023-12-07T21:15:16.959 INFO:teuthology.orchestra.run.smithi121.stderr: -- replaced with /var/log/ceph/ceph-client.0.95553.log.gz 2023-12-07T21:15:16.959 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97730.log 2023-12-07T21:15:16.959 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5/var/log/ceph/ceph-client.0.96962.log: --verbose -- /var/log/ceph/ceph-client.admin.89461.log 2023-12-07T21:15:16.959 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.97730.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.95906.log.gz 2023-12-07T21:15:16.959 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94057.log 2023-12-07T21:15:16.959 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92385.log 2023-12-07T21:15:16.959 INFO:teuthology.orchestra.run.smithi121.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.0.97730.log.gz 2023-12-07T21:15:16.959 INFO:teuthology.orchestra.run.smithi121.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.90455.log.gz 2023-12-07T21:15:16.959 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.89461.log: /var/log/ceph/ceph-client.0.94057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90543.log 2023-12-07T21:15:16.959 INFO:teuthology.orchestra.run.smithi121.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.89461.log.gz 2023-12-07T21:15:16.960 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.92385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84594.log 2023-12-07T21:15:16.960 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.90543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97484.log 2023-12-07T21:15:16.960 INFO:teuthology.orchestra.run.smithi121.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.96962.log.gz 2023-12-07T21:15:16.960 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.admin.84594.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92385.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.92297.log 2023-12-07T21:15:16.960 INFO:teuthology.orchestra.run.smithi121.stderr: 2023-12-07T21:15:16.960 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94057.log.gz 2023-12-07T21:15:16.960 INFO:teuthology.orchestra.run.smithi121.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.84594.log.gz/var/log/ceph/ceph-client.0.97484.log: 2023-12-07T21:15:16.960 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2023-12-07T21:15:16.960 INFO:teuthology.orchestra.run.smithi121.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.90543.log.gz 2023-12-07T21:15:16.960 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.92297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91769.log 2023-12-07T21:15:16.961 INFO:teuthology.orchestra.run.smithi121.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.97484.log.gz 2023-12-07T21:15:16.961 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92473.log 2023-12-07T21:15:16.961 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5/var/log/ceph/ceph-client.0.91769.log: --verbose -- /var/log/ceph/ceph-client.0.96346.log 2023-12-07T21:15:16.961 INFO:teuthology.orchestra.run.smithi121.stderr: 90.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2023-12-07T21:15:16.961 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.92473.log: gzip -5 90.9% -- replaced with /var/log/ceph/ceph-client.0.92297.log.gz 2023-12-07T21:15:16.961 INFO:teuthology.orchestra.run.smithi121.stderr: --verbose -- /var/log/ceph/ceph-client.0.95641.log 2023-12-07T21:15:16.961 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.96346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95113.log 2023-12-07T21:15:16.961 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91769.log.gz 2023-12-07T21:15:16.961 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.95641.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-07T21:15:16.961 INFO:teuthology.orchestra.run.smithi121.stderr: 90.8%/var/log/ceph/ceph-client.0.95113.log: -- replaced with /var/log/ceph/ceph-client.0.92473.log.gz 2023-12-07T21:15:16.962 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94321.log 2023-12-07T21:15:16.962 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.96346.log.gz 2023-12-07T21:15:16.962 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.2.log: -- /var/log/ceph/ceph-client.0.96610.log 2023-12-07T21:15:16.962 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.94321.log: gzip 90.8% -5 -- replaced with /var/log/ceph/ceph-client.0.95641.log.gz --verbose 2023-12-07T21:15:16.962 INFO:teuthology.orchestra.run.smithi121.stderr: -- /var/log/ceph/ceph-client.0.96522.log 2023-12-07T21:15:16.962 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93529.log 2023-12-07T21:15:16.962 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.96610.log: /var/log/ceph/ceph-client.0.96522.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94321.log.gz 2023-12-07T21:15:16.963 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2023-12-07T21:15:16.963 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.96522.log.gz/var/log/ceph/ceph-client.0.93529.log: 2023-12-07T21:15:16.963 INFO:teuthology.orchestra.run.smithi121.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.95113.log.gz 2023-12-07T21:15:16.963 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94937.log 2023-12-07T21:15:16.963 INFO:teuthology.orchestra.run.smithi121.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.96610.log.gz 2023-12-07T21:15:16.963 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94409.log 2023-12-07T21:15:16.963 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.94937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91857.log 2023-12-07T21:15:16.963 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.93529.log.gz 2023-12-07T21:15:16.964 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.94409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94673.log 2023-12-07T21:15:16.964 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.91857.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.94937.log.gz 2023-12-07T21:15:16.964 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97050.log 2023-12-07T21:15:16.964 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.94673.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.91857.log.gz 2023-12-07T21:15:16.964 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.94409.log.gz 2023-12-07T21:15:16.964 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.97566.log 2023-12-07T21:15:16.964 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.97050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92121.log 2023-12-07T21:15:16.964 INFO:teuthology.orchestra.run.smithi121.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.94673.log.gz 2023-12-07T21:15:16.965 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.97566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91065.log 2023-12-07T21:15:16.965 INFO:teuthology.orchestra.run.smithi121.stderr: 89.7%/var/log/ceph/ceph-client.0.92121.log: -- replaced with /var/log/ceph/ceph-client.0.97566.log.gz 2023-12-07T21:15:16.965 INFO:teuthology.orchestra.run.smithi121.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.0.97050.log.gz 2023-12-07T21:15:16.965 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93089.log 2023-12-07T21:15:16.965 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/ceph-client.0.91065.log: /var/log/ceph/ceph-client.0.93089.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92121.log.gz 2023-12-07T21:15:16.965 INFO:teuthology.orchestra.run.smithi121.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91065.log.gz 2023-12-07T21:15:16.965 INFO:teuthology.orchestra.run.smithi121.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.93089.log.gz 2023-12-07T21:15:16.965 INFO:teuthology.orchestra.run.smithi121.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2023-12-07T21:15:16.966 INFO:teuthology.orchestra.run.smithi121.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-07T21:15:17.063 INFO:teuthology.orchestra.run.smithi089.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-07T21:15:17.735 INFO:teuthology.orchestra.run.smithi121.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-07T21:15:17.775 INFO:teuthology.orchestra.run.smithi089.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-07T21:15:17.777 INFO:teuthology.orchestra.run.smithi089.stderr: 2023-12-07T21:15:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m0.917s 2023-12-07T21:15:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m1.069s 2023-12-07T21:15:17.777 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.081s 2023-12-07T21:15:17.822 INFO:teuthology.orchestra.run.smithi121.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-07T21:15:17.883 INFO:teuthology.orchestra.run.smithi121.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-07T21:15:17.885 INFO:teuthology.orchestra.run.smithi121.stderr: 2023-12-07T21:15:17.885 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m1.020s 2023-12-07T21:15:17.885 INFO:teuthology.orchestra.run.smithi121.stderr:user 0m2.838s 2023-12-07T21:15:17.885 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m0.195s 2023-12-07T21:15:17.886 INFO:tasks.ceph:Archiving logs... 2023-12-07T21:15:17.886 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323/remote/smithi089/log 2023-12-07T21:15:17.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-07T21:15:18.122 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323/remote/smithi121/log 2023-12-07T21:15:18.123 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-07T21:15:18.634 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-07T21:15:18.644 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-07T21:15:18.645 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-07T21:15:18.647 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-07T21:15:18.736 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-07T21:15:18.745 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-07T21:15:18.745 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T21:15:18.748 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T21:15:18.760 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2023-12-07T21:15:18.762 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2023-12-07T21:15:18.765 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-07T21:15:18.765 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-12-07T21:15:18.765 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 41 +579us[ +579us] +/- 79ms 2023-12-07T21:15:18.766 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv02.front.sepia.ceph.com 3 6 377 42 -556us[ -557us] +/- 73ms 2023-12-07T21:15:18.766 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +121us[ +121us] +/- 82ms 2023-12-07T21:15:18.766 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T21:15:18.767 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-07T21:15:18.767 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2023-12-07T21:15:18.767 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 44 +590us[ +591us] +/- 79ms 2023-12-07T21:15:18.767 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv02.front.sepia.ceph.com 3 6 377 44 -548us[ -546us] +/- 73ms 2023-12-07T21:15:18.767 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +132us[ +132us] +/- 82ms 2023-12-07T21:15:18.767 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T21:15:18.768 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-07T21:15:18.778 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-07T21:15:18.779 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-07T21:15:18.822 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-07T21:15:18.916 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-07T21:15:19.007 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-07T21:15:19.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T21:15:19.039 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-07T21:15:19.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T21:15:19.071 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-07T21:15:19.082 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-07T21:15:19.105 INFO:teuthology.task.internal:Duration was 1529.133649 seconds 2023-12-07T21:15:19.106 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-07T21:15:19.138 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-07T21:15:19.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-07T21:15:19.141 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-07T21:15:19.182 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-07T21:15:19.184 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-07T21:15:19.429 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-07T21:15:19.429 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2023-12-07T21:15:19.429 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-07T21:15:19.488 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2023-12-07T21:15:19.488 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-07T21:15:19.513 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-07T21:15:19.513 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-07T21:15:19.530 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-07T21:15:19.582 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-07T21:15:19.582 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-07T21:15:19.599 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-07T21:15:19.715 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-07T21:15:19.725 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-07T21:15:19.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-07T21:15:19.752 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-07T21:15:19.779 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-07T21:15:19.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-07T21:15:19.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-07T21:15:19.817 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2023-12-07T21:15:19.844 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2023-12-07T21:15:19.885 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-07T21:15:19.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T21:15:19.904 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-07T21:15:19.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T21:15:19.939 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-07T21:15:19.949 INFO:teuthology.task.internal:Transferring archived files... 2023-12-07T21:15:19.950 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323/remote/smithi089 2023-12-07T21:15:19.950 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-07T21:15:19.986 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323/remote/smithi121 2023-12-07T21:15:19.986 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-07T21:15:20.022 INFO:teuthology.task.internal:Removing archive directory... 2023-12-07T21:15:20.022 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-07T21:15:20.025 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-07T21:15:20.072 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-07T21:15:20.083 INFO:teuthology.task.internal:Not uploading archives. 2023-12-07T21:15:20.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-07T21:15:20.106 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-07T21:15:20.107 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-07T21:15:20.109 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-07T21:15:20.121 INFO:teuthology.orchestra.run.smithi089.stdout: 265256 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 7 21:15 /home/ubuntu/cephtest 2023-12-07T21:15:20.126 INFO:teuthology.orchestra.run.smithi121.stdout: 265984 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 7 21:15 /home/ubuntu/cephtest 2023-12-07T21:15:20.128 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-07T21:15:20.141 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-07T21:15:20.206 INFO:teuthology.nuke:Checking targets against current locks 2023-12-07T21:15:20.233 DEBUG:teuthology.nuke:shortname: smithi089 2023-12-07T21:15:20.234 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T21:15:20.258 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 20:38:29.251787', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLM2438ztJXfdnTagA2nT29HZR9nBGpJrnYRh2U9uLn0mBlAUk+OofhGilOo4qq4ke7uRXDOCkEo8B3dymSV6aM='} 2023-12-07T21:15:20.262 DEBUG:teuthology.nuke:shortname: smithi121 2023-12-07T21:15:20.262 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T21:15:20.286 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-07_20:37:17-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7482323', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 20:38:29.250530', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIl5farQZmxpaZ6o/if+Dk79iL9fDEl5O2THifirD3722iW1FYBNJQCUdolBA0qWqVJZdCH9zoCIGsDGMaQYNqs='} 2023-12-07T21:15:20.308 INFO:teuthology.orchestra.console.smithi089:Power off 2023-12-07T21:15:20.309 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T21:15:20.333 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-12-07T21:15:20.333 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T21:15:20.354 INFO:teuthology.orchestra.console.smithi121:Power off 2023-12-07T21:15:20.354 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T21:15:20.365 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-07T21:15:20.377 DEBUG:teuthology.orchestra.console.smithi121:power off output: Chassis Power Control: Down/Off 2023-12-07T21:15:20.377 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T21:15:20.404 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2023-12-07T21:15:20.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-12-07T21:15:24.366 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T21:15:24.405 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T21:15:24.478 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-12-07T21:15:24.517 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is on 2023-12-07T21:15:28.482 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T21:15:28.518 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T21:15:28.594 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-12-07T21:15:28.629 DEBUG:teuthology.orchestra.console.smithi121:check power output: Chassis Power is off 2023-12-07T21:15:28.695 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-12-07T21:15:28.730 INFO:teuthology.orchestra.console.smithi121:Power off completed 2023-12-07T21:15:28.834 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} duration: 1529.133648633957 failure_reason: '' flavor: default owner: scheduled_alimasa@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7ba7907f34b141e1a57dbf83dcdd083f status: fail success: false 2023-12-07T21:15:28.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T21:15:28.921 INFO:teuthology.run:FAIL